Evaluation of an ambulatory system for the quantification of cough frequency in patients with chronic obstructive pulmonary disease
© Coyle et al; licensee BioMed Central Ltd. 2005
Received: 25 April 2005
Accepted: 04 August 2005
Published: 04 August 2005
To date, methods used to assess cough have been primarily subjective, and only broadly reflect the impact of chronic cough and/or chronic cough therapies on quality of life. Objective assessment of cough has been attempted, but early techniques were neither ambulatory nor feasible for long-term data collection. We evaluated a novel ambulatory cardio-respiratory monitoring system with an integrated unidirectional, contact microphone, and report here the results from a study of patients with COPD who were videotaped in a quasi-controlled environment for 24 continuous hours while wearing the ambulatory system.
Eight patients with a documented history of COPD with ten or more years of smoking (6 women; age 57.4 ± 11.8 yrs.; percent predicted FEV1 49.6 ± 13.7%) who complained of cough were evaluated in a clinical research unit equipped with video and sound recording capabilities. All patients wore the LifeShirt® system (LS) while undergoing simultaneous video (with sound) surveillance. Video data were visually inspected and annotated to indicate all cough events. Raw physiologic data records were visually inspected by technicians who remained blinded to the video data. Cough events from LS were analyzed quantitatively with a specialized software algorithm to identify cough. The output of the software algorithm was compared to video records on a per event basis in order to determine the validity of the LS system to detect cough in COPD patients.
Video surveillance identified a total of 3,645 coughs, while LS identified 3,363 coughs during the same period. The median cough rate per patient was 21.3 coughs·hr-1 (Range: 10.1 cghs·hr-1 – 59.9 cghs·hr-1). The overall accuracy of the LS system was 99.0%. Overall sensitivity and specificity of LS, when compared to video surveillance, were 0.781 and 0.996, respectively, while positive- and negative-predictive values were 0.846 and 0.994. There was very good agreement between the LS system and video (kappa = 0.807).
The LS system demonstrated a high level of accuracy and agreement when compared to video surveillance for the measurement of cough in patients with COPD.
The most frequent complaint for which patients seek treatment from primary care physicians in the United States is cough . Type, frequency and diurnal changes of cough may be criteria for differential diagnosis, therapeutic efficacy, and a gauge for the progression of chronic disease. Historically, cough evaluation has been difficult and of limited clinical value due to a lack of surveillance tools to assess cough frequency completely and its impact on health-related quality of life (HRQL).
To date, methods used to assess cough have been primarily subjective, and only broadly reflect the impact of chronic cough and/or chronic cough therapies on quality of life [2–5]. These methods have been unable to offer substantial information related to the minimal reduction in cough frequency necessary to achieve a significant improvement in HQRL. Objective assessment of cough has been attempted, but these techniques were neither ambulatory nor feasible for long-term data collection [6–8]. Other systems have evaluated sound to quantify cough frequency and intensity with moderate success [9, 10], but have been limited in their effectiveness outside the laboratory and requires labor intensive analysis and interpretation [11–15].
We evaluated a novel ambulatory cardio-respiratory monitoring system with an integrated unidirectional, contact microphone, and report here the results from a study of patients with COPD who were videotaped in a quasi-controlled environment for 24 continuous hours while wearing the ambulatory system.
Patient characteristics. Values are means ± SD; Ht = height; Wt = weight; BMI = Body mass index; %FEV1 = % predicted forced expiratory volume in one second; n = 8 (6 women)
57.4 ± 11.8
165.4 ± 7.2
76.1 ± 14.4
27.8 ± 4.7
49.6 ± 13.7
The protocol was approved by an independent ethical review board (Western IRB, 3535 7th Avenue SW, Olympia, WA, USA, 98502) and all patients received a verbal and written description of the study and gave informed consent prior to participation. All data were collected under the medical supervision of board certified pulmonologists.
Instrumentation and monitoring
Patients were fitted with the wearable LifeShirt® system (LS, VivoMetrics, Inc., Ventura, CA, USA), which incorporates respiratory inductance plethysmography (RIP) for the non-invasive measurement of volume and timing ventilatory variables and has been described elsewhere [15–22]. The system also incorporates a unidirectional contact microphone, a single channel ECG, and a centrally located, 3-axis accelerometer. Data were processed and stored on a compact flash card that was housed within the recorder unit. Patients were invited to wear the LS system for a maximum of 24 hours.
Patients spent the testing period in an assigned room where the video monitoring equipment was installed. Patients were monitored via video recorder camera (low-lux) with unidirectional free-air microphone for the duration of the testing period. The video data stream was synchronized to the LS data stream by the coordination of the device clocks. The LS recorder has an on-board electronic diary which creates an event time stamp in the LS software data stream which was referenced to the video data time display to determine the beginning of the recording period. Patients were allowed free range of the research facility and were permitted to watch television, use the telephone, dine, take breaks and sleep.
Data analysis and statistics
Raw physiologic data records were uploaded to a centralized data center and were visually inspected for quality by technicians. 94.1% of the data were interpretable and available for comparison to video. Specialized software (VivoLogic®, VivoMetrics, Inc., Ventura, CA, USA) was used to view the LS data and a proprietary algorithm housed within the software was used to identify cough from the physiologic recordings. LS data were visually inspected by two independent reviewers who remained blinded to the video data. Each noted the time (hour, minute and second) of each cough. These data were captured into a spreadsheet. Cough events (hour, minute, second, millisecond) identified by the LS software were exported into a separate spreadsheet. A practical extraction and report language (PERL) script was written to temporally align the two data streams so that the output from each device could be compared for agreement on an event by event basis.
To summarize the validity and reliability of the ambulatory system to detect cough under several conditions, six validation and agreement measures were used including, sensitivity (SN), specificity (SP), positive predictive value (PPV), negative predictive value (NPV), accuracy and kappa  were calculated relative to video rating. The PPV is the probability that a patient coughed, if the system judged the respiratory event as a cough. Likewise, the NPV is the probability that the patient did not cough, given that the system did not judge the event as a cough. Accuracy is the proportion of all correct tests. The method used to calculate the confidence intervals was the Wilson score method without continuity correction , which has been previously shown to exhibit a logit scale symmetry property with consequent log scale symmetry for certain derived intervals .
Patients were invited to be observed for a maximum of 24 hours. A total of 109 hours of simultaneous recordings of video and LS were obtained. Of that time, 73.9 hours were observed during the day and 34.7 hours were observed during the night. During the recording period, the total number of coughs documented by video surveillance was 3,645. The LS system reported 3,363 coughs during the same time period. The median cough rate per patient was 21.3 coughs·hr-1 (Range: 10.1 cghs·hr-1 – 59.9 cghs·hr-1).
Validation and agreement statistics (with 95% confidence intervals) for the LifeShirt system during day & night and at low & high respiration rates. Values are calculated values for the sensitivity (SN), specificity (SP), positive predictive-value (PPV), negative predictive-value (NPV), accuracy (ACC) and the kappa statistic. Values in parentheses are the 95% confidence intervals. All values are for LS system compared to video documentation of cough events; * p-value < 0.0001 for night vs. day comparisons of period for SN, SP, NPV and ACC; ¶p-value < 0.0001 for night vs. day comparisons of respiratory rate for SN, SP, PPV, NPV; ‡ p-value = 0.004 for day vs. night comparisons of respiratory rate for ACC. Day period defined as 0600–1800; Night period defined as 1800–0600. Patients were assigned to the low or high respiratory rate group based on whether their mean Fb was below or above the median Fb (median = 21 br·min-1).
78.1 (76.7, 79.4)
76.7 (75.1, 78.2)
82.7 (80.0, 85.1)*
69.5 (66.3, 72.6)
80.6 (79.0, 82.0)¶
99.6 (99.5, 99.6)
99.6 (99.5, 99.6)
99.7 (99.7, 99.8)*
99.5 (99.5, 99.6)
99.7 (99.6, 99.7) ¶
84.6 (83.3, 85.8)
84.5 (83.0, 85.8)
85.0 (82.3, 87.3)
69.8 (66.5, 72.8)
89.4 (88.1, 90.5) ¶
99.4 (99.3, 99.4)
99.3 (99.2, 99.3)
99.7 (99.6, 99.7)*
99.5 (99.5, 99.6)
99.3 (99.2, 99.3) ¶
99.0 (99.0, 99.1)
98.8 (98.8, 98.9)
99.4 (99.3, 99.5)*
99.1 (99.0, 99.2)
99.0 (98.9, 99.0)‡
80.7 (79.7, 81.7)
79.8 (78.6, 81.0)
83.5 (81.5, 85.5)
69.2 (66.6, 71.7)
84.2 (83.1, 85.3)
We report validity and reliability statistics for a novel ambulatory system to evaluate its capability to detect cough and demonstrate a high level of agreement and accuracy when compared to video surveillance for cough over an extended period. The system was well-tolerated and allowed for free movement throughout the monitoring facility. The system continuously monitors several cardio-pulmonary-activity variables, which allowed us to evaluate ventilatory strategies associated with coughing, which is one of its novel features.
The patient population in this study coughed with great frequency, which reflects the fact these were COPD patients who had a primary complaint of cough. At screening, patients were asked if they coughed ten times per day or more. Although all of the patients met this requirement, they had difficulty recalling how many cough bouts per day they experienced. As such, we did not predict that this population would cough with such a high frequency and, although the number of coughs was higher than anticipated, it was within the range of what has been reported previously .
Agreement between the LS system and video surveillance was excellent. Interestingly, we did observe that the nocturnal validation and agreement statistics, as well as differences between low and high respiratory rates, were statistically significantly different, although they differed only slightly in magnitude. These small, yet statistically significant, difference likely reflect the influence of the respiratory events (e.g., VT and Fb) sample size during the recording period on the statistical power for these comparisons and is not clinically significant.
Objective cough assessment has been attempted on numerous previous occasions [6–8, 10, 12, 14]. Until now, a robust, accurate ambulatory system has failed to emerge. This is likely due to the fact that previous systems have attempted to identify cough with a single physiologic signal (e.g., sound). Sound-based technologies have been the primary means of cough assessment due to the audible sound that is generated during a cough . These systems, however, are susceptible to a high false positive rate when ambient noise is prominent and are unable to distinguish cough-like sounds (e.g., throat clearing) from true cough. Hsu et al. (1994)  augmented sound analyses with concomitant intercostal electromyography (EMG) analyses and evaluated various clinical populations (e.g., normal controls, stable asthmatics and patients with daily, persistent & non-productive cough) and concluded that their system may be useful in the assessment of antitussive therapies. Hsu et al., however, did not present evidence of agreement by comparing their results to a reference standard.
There were three limitations to the study. First, the sample size was small. Sample size was limited by available resources to review the vast amount of video and LS data. Second, women (6/8) were over represented in the study, which was due to an inauspicious baseline imbalance. Third, the data were collected in a clinical setting due to the requirement for video monitoring equipment. However, patients were not confined to any one space and ambulated, spoke on the phone, dined and performed additional activities of daily living.
A substantial challenge in this study was the choice of a reference standard with which to evaluate the novel device. We chose video based on the fact that the source document (video) could be reviewed during the adjudication process if there was uncertainty with respect to the occurrence of a cough. Scoring the video in duplicate was an arduous task which likely increased the possibility of human error due to fatigue and it is possible that some coughs were missed. Events that were missed by both reviewers would not have been adjudicated, but identified by the LS system and therefore would have been inappropriately scored as a false-positive. Thus, these results are a conservative estimate of LS capabilities and may underestimate the predictive power of the device.
We report data from a novel, ambulatory, multi-signal device that shows a high level of agreement and accuracy when compared to video/audio surveillance over an extended period and confirm its potential in the evaluation of antitussive therapies. The availability of a valid, robust ambulatory tool for quantifying cough will enable the determination of the minimal required reduction in cough to maximally improve patient HQRL, and open up a broad array of research questions both specific to cough and wherein cough may be an important covariate, comorbidity, or confounding factor.
- Schappert SM: National ambulatory medical care survey: summary. Vital Health Stat. 1993, 230: 1-20.Google Scholar
- Birring SS, Prudon B, Carr AJ, Singh SJ, Morgan MD, Pavord ID: Development of a symptom specific health status measure for patients with chronic cough: Leicester Cough Questionnaire (LCQ). Thorax. 2003, 58: 339-343. 10.1136/thorax.58.4.339.PubMed CentralView ArticlePubMedGoogle Scholar
- French CL, Irwin RS, Curley FJ, Krikorian CJ: Impact of chronic cough on quality of life. Arch Intern Med. 1998, 158: 1657-1661. 10.1001/archinte.158.15.1657.View ArticlePubMedGoogle Scholar
- Irwin RS, French CT, Fletcher KE: Quality of life in coughers. Pulm Pharmacol Ther. 2002, 15: 283-286. 10.1006/pupt.2002.0347.View ArticlePubMedGoogle Scholar
- French CT, Irwin RS, Fletcher KE, Adams TM: Evaluation of a cough-specific quality-of-life questionnaire. Chest. 2002, 121: 1123-1131. 10.1378/chest.121.4.1123.View ArticlePubMedGoogle Scholar
- Barach AL, Bickerman HA, Beck GJ: Clinical and physiological studies on the use of metacortandracin in respiratory disease.1.Bronchial asthma. DC. 1955, 27: 515-522.Google Scholar
- Bickerman HA, Barach AL: The experimental production of cough in human subjects induced by citric acid aerosols. Peliminary studies in the evaluation of antitussive agents. Am J Med Sci. 1954, 228: 156-163.View ArticlePubMedGoogle Scholar
- Prime FJ: The assessment of antitusive drugs in man. Br Med J. 1961, 1: 1149-1151.PubMed CentralView ArticlePubMedGoogle Scholar
- Woolf CR, Rosenberg A: The cough suppressant effect of heroin and codeine: a controlled clinical study. Can Med Assoc J. 1962, 87: 810-814.Google Scholar
- Sevelius H, Colmore JP: Objective assessment of antitussive agents in patients with chronic cough. J New Drugs. 1966, 6: 216-233.PubMedGoogle Scholar
- Chang AB, Phelan PD, Robertson CF, Newman RG, Sawyer SM: Frequency and perception of cough severity. J Paediatr Child Health. 2001, 37: 142-145. 10.1046/j.1440-1754.2001.00608.x.View ArticlePubMedGoogle Scholar
- Hsu JY, Stone RA, Logan-Sinclair RB, Worsdell M, Busst CM, Chung KF: Coughing frequency in patients with persistent cough: assessment using a 24 hour ambulatory recorder. Eur Respir J. 1994, 7: 1246-1253. 10.1183/09031936.94.07071246.View ArticlePubMedGoogle Scholar
- Dalmasso F, Isnardi E, Sudaro L, Bellantoni R: Bioacoustins of cough during bronchial inhalation challenge (BIC) with methacholine. Eur Resp J. 2001, 18: 135S-Google Scholar
- Subburaj S, Parvez L, Rajagopalan TG: Methods of recording and analysing cough sounds. Pulm Pharmacol. 1996, 9: 269-279. 10.1006/pulp.1996.0035.View ArticlePubMedGoogle Scholar
- Tobin MJ, Chadha TS, Jenouri G, Birch SJ, Gazeroglu HB, Sackner MA: Breathing patterns. 1. Normal subjects. Chest. 1983, 84: 202-205.View ArticlePubMedGoogle Scholar
- Tobin MJ, Chadha TS, Jenouri G, Birch SJ, Gazeroglu HB, Sackner MA: Breathing patterns. 2. Diseased subjects. Chest. 1983, 84: 286-294.PubMedGoogle Scholar
- Chadha TS, Schneider AW, Birch S, Jenouri G, Sackner MA: Breathing pattern during induced bronchoconstriction. Journal of Applied Physiology: Respiratory, Environmental & Exercise Physiology. 1984, 56: 1053-1059.Google Scholar
- Sackner MA, Gonzalez HF, Jenouri G, Rodriguez M: Effects of abdominal and thoracic breathing on breathing pattern components in normal subjects and in patients with chronic obstructive pulmonary disease. American Review of Respiratory Disease. 1984, 130: 584-587.PubMedGoogle Scholar
- Tobin MJ, Guenther SM, Perez W, Mador MJ: Accuracy of the respiratory inductive plethysmograph during loaded breathing. Journal of Applied Physiology. 1987, 62: 497-505.PubMedGoogle Scholar
- Cantineau JP, Escourrou P, Sartene R, Gaultier C, Goldman M: Accuracy of respiratory inductive plethysmography during wakefulness and sleep in patients with obstructive sleep apnea. Chest. 1992, 102: 1145-1151.View ArticlePubMedGoogle Scholar
- Carter GS, Coyle MA, Mendelson WB: Validity of a portable cardio-respiratory system to collect data in the home environment in patients with obstructive sleep apnea. Sleep and Hypnosis. 2004, 6: 85-92.Google Scholar
- Clarenbach CF, Senn O, Brack T, Bloch KE: Monitoring of ventilation during exercise by a novel portable respiratory inductive plethysmograph. Chest, In Print. 2005Google Scholar
- Greenhalgh T: How to read a paper. Papers that report diagnostic or screening tests. BMJ. 1997, 315: 540-543.PubMed CentralView ArticlePubMedGoogle Scholar
- Wilson EB: Probable inference, the law of succession, and statistical inference. J Am Stat Assoc. 1927, 22: 209-212.View ArticleGoogle Scholar
- Newcombe RG: Two-sided confidence intervals for the single proportion: comparison of seven methods. Stat Med. 1998, 17: 857-872. 10.1002/(SICI)1097-0258(19980430)17:8<857::AID-SIM777>3.0.CO;2-E.View ArticlePubMedGoogle Scholar
- Byrt T: How good is that agreement? (Letter to editor). Epidemiology. 1996, 7: 561-PubMedGoogle Scholar
This article is published under license to BioMed Central Ltd. This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.