TY - JOUR
T1 - Inter- and intra-observer reliability and agreement of O 2 Pulse inflection during cardiopulmonary exercise testing: A comparison of subjective and novel objective methodology
T2 - A comparison of subjective and novel objective methodology
AU - Nickolay, Thomas
AU - McGregor, Gordon
AU - Powell, Richard
AU - Begg, Brian
AU - Birkett, Stefan
AU - Nichols, Simon
AU - Ennis, Stuart
AU - Banerjee, Prithwish
AU - Shave, Rob
AU - Metcalfe, James
AU - Hoye, Angela
AU - Ingle, Lee
A2 - Jaafar, Zulkarnain
N1 - Copyright: © 2024 Nickolay et al. This is an open access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited.
PY - 2024/3/7
Y1 - 2024/3/7
N2 - Cardiopulmonary exercise testing (CPET) is the ‘gold standard’ method for evaluating functional capacity, with oxygen pulse (O2Pulse) inflections serving as a potential indicator of myocardial ischaemia. However, the reliability and agreement of identifying these inflections have not been thoroughly investigated. This study aimed to assess the inter- and intra-observer reliability and agreement of a subjective quantification method for identifying O2Pulse inflections during CPET, and to propose a more robust and objective novel algorithm as an alternative methodology. A retrospective analysis was conducted using baseline data from the HIIT or MISS UK trial. The O2Pulse curves were visually inspected by two independent examiners, and compared against an objective algorithm. Fleiss’ Kappa was used to determine the reliability of agreement between the three groups of observations. The results showed almost perfect agreement between the algorithm and both examiners, with a Fleiss’ Kappa statistic of 0.89. The algorithm also demonstrated excellent inter-rater reliability (ICC) when compared to both examiners (0.92–0.98). However, a significant level (P ≤0.05) of systematic bias was observed in Bland-Altman analysis for comparisons involving the novice examiner. In conclusion, this study provides evidence for the reliability of both subjective and novel objective methods for identifying inflections in O2Pulse during CPET. These findings suggest that further research into the clinical significance of O2Pulse inflections is warranted, and that the adoption of a novel objective means of quantification may be preferable to ensure equality of outcome for patients.
AB - Cardiopulmonary exercise testing (CPET) is the ‘gold standard’ method for evaluating functional capacity, with oxygen pulse (O2Pulse) inflections serving as a potential indicator of myocardial ischaemia. However, the reliability and agreement of identifying these inflections have not been thoroughly investigated. This study aimed to assess the inter- and intra-observer reliability and agreement of a subjective quantification method for identifying O2Pulse inflections during CPET, and to propose a more robust and objective novel algorithm as an alternative methodology. A retrospective analysis was conducted using baseline data from the HIIT or MISS UK trial. The O2Pulse curves were visually inspected by two independent examiners, and compared against an objective algorithm. Fleiss’ Kappa was used to determine the reliability of agreement between the three groups of observations. The results showed almost perfect agreement between the algorithm and both examiners, with a Fleiss’ Kappa statistic of 0.89. The algorithm also demonstrated excellent inter-rater reliability (ICC) when compared to both examiners (0.92–0.98). However, a significant level (P ≤0.05) of systematic bias was observed in Bland-Altman analysis for comparisons involving the novice examiner. In conclusion, this study provides evidence for the reliability of both subjective and novel objective methods for identifying inflections in O2Pulse during CPET. These findings suggest that further research into the clinical significance of O2Pulse inflections is warranted, and that the adoption of a novel objective means of quantification may be preferable to ensure equality of outcome for patients.
KW - Exercise Test/methods
KW - Humans
KW - Observer Variation
KW - Reproducibility of Results
KW - Retrospective Studies
UR - http://www.scopus.com/inward/record.url?scp=85187180324&partnerID=8YFLogxK
U2 - 10.1371/journal.pone.0299486
DO - 10.1371/journal.pone.0299486
M3 - Article
C2 - 38452129
SN - 1932-6203
VL - 19
SP - e0299486
JO - PLoS ONE
JF - PLoS ONE
IS - 3
M1 - e0299486
ER -