Skip to main content
Journal of Patient-Reported Outcomes
Download PDF
Download ePub

Responsiveness of PROMIS® to change in chronic obstructive pulmonary disease

Journal of Patient-Reported Outcomes volume 3, Article number: 65 (2019) Cite this article

Abstract

Background

Chronic obstructive pulmonary disease (COPD) is a progressive chronic disease characterized by airflow obstruction that leads to shortness of breath and substantial negative impacts on health-related quality of life (HRQL). The course of COPD includes periodic acute exacerbations that require changes in treatment and/or hospitalizations. This study was designed to examine the responsiveness of Patient-Reported Outcomes Measurement Information System® (PROMIS®) measures to changes associated with COPD exacerbation recovery.

Methods

A longitudinal analysis using mixed-effects models was conducted of people who were enrolled while stable (n = 100) and those who experienced an acute exacerbation (n = 85). PROMIS (physical function, pain interference, pain behavior, fatigue, anxiety, depression, anger, social roles, discretionary social activities, Global Health, dyspnea severity and dyspnea functional limitations) and COPD-targeted HRQL measures were completed at baseline and at 12 weeks.

Results

We administered PROMIS measures using computer adaptive testing (CAT), followed by administration of any remaining short form (SF) items that had not yet been administered by CAT. Examination of the difference between group differences from baseline to 12 weeks in the stable and exacerbation groups revealed that the exacerbation group changed (improved) significantly more than the stable group in anxiety (p < .001 to p < .01; f2 effect size [ES] = 0.023/0.021), fatigue (p < .0001; ES = 0.036/0.047) and social roles (p < .001 to p < .05; ES = 0.035/0.024). All effect sizes were small in magnitude and smaller than hypothesized. Depression was also statistically significant (p < .05, SF only) but the ES was trivial. For all other PROMIS domains, the differences were not significant and ES were trivial.

Conclusions

This longitudinal study provides some support for the validity of the PROMIS fatigue, anxiety, and social roles domains in COPD, but further evaluation of responsiveness is warranted.

Background

Chronic obstructive pulmonary disease (COPD) is a heterogeneous group of slowly progressive diseases characterized by airflow obstruction that interferes with normal breathing and leads to shortness of breath or dyspnea that can limit physical activity [1]. COPD is the third leading cause of death in the U.S. and the only leading cause of death increasing in prevalence [2, 3]. Those with COPD experience limitations in functioning and well-being or health-related quality of life (HRQL) comparable to or worse than patients with advanced lung cancer [4].

COPD leads to progressive decline in lung function associated with worsening of symptoms. Many patients experience periodic exacerbations, defined as an acute sustained worsening of their COPD, that result in unscheduled clinic or emergency department (ED) visits and require antibiotics and/or steroids, with severe cases requiring hospitalization for observation and treatment. The decline in lung function, symptoms, and physical function associated with exacerbations represent substantial negative impacts on HRQL and contribute to the downward trajectory of disease over time [5, 6].

Measures of lung function, such as forced expiratory volume in 1 s (FEV1) and forced vital capacity (FVC), are used to estimate the severity of airflow limitation but fail to capture the systemic manifestations and patient-experienced impact of the disease [7, 8]. Hence, patient-reported outcomes (PROs) are needed in COPD observational studies, clinical trials, and patient care [9]. Stable COPD is associated with relatively poor status in several PRO domains, namely depression [10, 11], anxiety [11], fatigue [12,13,14,15], mobility, activities of daily living (ADLs) [13] and social activities [13]. Acute exacerbations of COPD are, by definition, characterized by worsening of respiratory symptoms, including dyspnea [16,17,18,19] as well as decreased health-related quality of life [20,21,22], lower levels of physical function [5, 20, 23, 24]; increased fatigue [23,24,25,26], depression and anxiety [23, 27,28,29,30,31], reduced social functioning [23, 28], and to a lesser degree, increased pain [23] and anger [23]. Thus, COPD is a potentially informative target condition for evaluating the measurement properties of PROs, including change in outcomes that are expected to change with recovery from an exacerbation (e.g., fatigue, anxiety, mobility, ADLs, social activities) and stability in outcomes that are expected to remain relatively unchanged (e.g., depression).

The Patient Reported Outcomes Measurement Information System® (PROMIS®) quantifies self-reported health with domains relevant to multiple chronic diseases and conditions, permitting selective or comprehensive outcome assessment based on user interests and needs. Each measure comprising this system was developed using standardized, rigorous psychometric methods [32, 33] with testing in the general population and across a number of different patient subgroups [34,35,36,37,38,39]. Most PROMIS measures are universal (i.e., not disease-specific), but some are particularly relevant to patients with COPD such as fatigue, physical function, anxiety, depression, dyspnea and social function. Although other instruments exist to measure some or all of these outcomes in various combinations [7, 40], PROMIS offers single-site open access (www.healthmeasures.net) to each measure, computer adaptive test (CAT) versions for efficient assessments, and information on normative values. Cross-sectional analyses in patients with COPD provide support for the reliability and validity of PROMIS measures [41].

Acute exacerbations of COPD are clinically relevant events with important therapeutic and prognostic implications and with considerable heterogeneity in terms of their clinical presentation [42]. The majority of the literature on impacts of acute exacerbations of COPD has focused on respiratory symptoms, morbidity, mortality, hospitalizations and disease-specific health-related quality of life questionnaires (e.g., St. George’s Respiratory Questionnaire [43]) [44,45,46,47,48,49,50,51]. In contrast, this study examines the responsiveness of PROMIS measures of specific physical, mental and social health status domains over 12 weeks in patients with COPD who were recovering from an acute COPD exacerbation. We also studied patients with COPD who were enrolled in a stable (non-exacerbating) state and followed for 12 weeks to allow us to explore any changes in the measures that were unrelated to exacerbation recovery. We hypothesized that there would be significant improvement in most of the PROMIS domain measures in COPD patients during recovery from exacerbation to a stable period, and that the largest magnitude changes would be in physical function, fatigue, anxiety, dyspnea and social function. While those in the stable condition might change over time due to unmeasured factors, we hypothesized that there would be little to no change over 12 weeks, and any observed change would be smaller than that of patients recovering from an acute exacerbation.

Methods

This study used a longitudinal, multisite prospective cohort of two groups: 1) patients with COPD enrolled at the time of an exacerbation, and 2) patients with COPD enrolled at a time of stability. Both groups were followed for 12 weeks and completed assessments at enrollment (baseline) and then weekly for the remaining 11 weeks. In this paper, we report on the baseline and 12-week findings. Subjects were recruited from outpatient clinics and hospitals at four research sites (University of North Carolina Health System, NorthShore University HealthSystem, Pittsburgh VA Medical Center, and Durham VA Medical Center).

Participants

We enrolled patients 40 years and older with an established clinical history of COPD in accordance with the GOLD definition at the time of the study [52] and at least a 10 pack/year history of smoking. Participants had to be able to read and speak English and be able to see and interact with a computer screen, mouse, and keyboard. People were excluded if, based on the input of clinic staff or evidence in the medical chart, they had a concurrent medical or psychiatric condition that precluded participation in the study or completion of self-report questionnaires (e.g., dementia, uncontrolled schizophrenia). They were also excluded if they had a history of asthma without co-existent COPD or were experiencing a heart failure exacerbation. For those enrolled into the exacerbation group, participants recruited in the outpatient setting may have started treatment no more than 3 days prior to the day of enrollment, and for participants recruited in the inpatient setting, no more than 6 days prior to the day of enrollment. Those enrolled into the stable state group had to be exacerbation-free for a minimum of 2 months prior to enrollment. An exacerbation was defined as sustained worsening of COPD symptoms from stable state and beyond normal day-to-day variations that is acute in onset and necessitates a change in regular medication in a patient with underlying COPD; in addition, the exacerbation had to be established by a clinic visit or hospitalization with a medical diagnosis of COPD exacerbation and treatment with antibiotics or corticosteroids [53].

The study was conducted in accordance with the amended Declaration of Helsinki and was approved by the Institutional Review Board (IRB) at each site (University of North Carolina, 08–0138; NorthShore University HealthSystem, EH04–179; Pittsburgh VA Medical Center, 02683; Duke University, Pro00006904). At the time of enrollment and prior to beginning the baseline assessment, informed consent was obtained from all participants included in the study.

Procedures

For those stable at enrollment, the baseline assessment included questionnaire measures, pulmonary function testing with GOLD classification [54], and a six-minute walk test. Because of the compromised health of those in an exacerbation state at enrollment, only the questionnaires were administered; the six-minute walk test (6MWT) and pulmonary function testing with GOLD classification were performed at the 12-week follow-up when patients had returned to stable state. Thus, all analysis of clinical measures (i.e., pulmonary function testing, GOLD classification, 6MWT) reflected data obtained when patients were deemed stable.

All baseline questionnaires were completed by patients on a laptop computer in the clinic or in the hospital and included demographics, comorbid conditions, COPD history (symptoms, duration of diagnosis, number of exacerbations, and recent hospitalizations and ED visits), and the PRO measures. The research assistant also reviewed the clinical chart to record clinical variables such as body mass index (BMI) and COPD medications. If patients completed pulmonary function tests in-clinic that same day, the values were obtained from the medical chart and they were not asked to repeat the spirometry for the study. The follow-up at 12 weeks (+ 30-day window) was completed in-person in the clinic on the laptop computer. If, during the course of follow-up, a participant had a recurrent exacerbation, as defined previously, they were censored from analysis.

Measures

PROMIS measures

The primary goal of this study was to assess the responsiveness of PROMIS version 1.0 measures to changes associated with COPD exacerbation recovery. These measures assessed anxiety, depression, anger [55], fatigue [56], pain behavior [57], pain interference [58], physical function [59], satisfaction with participation in discretionary social activities [discretionary social activities], satisfaction with participation in social roles [social roles] [60], the 10-item Global Health short form [61] (producing scores for physical health and mental health) and dyspnea (Functional Assessment of Chronic Illness Therapy (FACIT) dyspnea severity and functional limitations measures). The FACIT dyspnea short forms (now also included as PROMIS measures) consist of items that assess dyspnea severity (10 items) and related functional limitations (10 items) and were newly developed, with this being the first longitudinal administration [62, 63].

PROMIS measures can be administered as fixed-length short forms (SF) or dynamically by CAT. Questionnaires were administered using Assessment CenterSM, a web-based data collection platform [64]. For PROMIS CATs, the first item administered in a CAT is usually one in the middle of the range of function or symptom severity. After a person provides a response, an estimated score is calculated. The CAT algorithm then selects the best item in the item bank for refining the estimated score. After a person provides a response, the estimated score is recalculated. The CAT continues to administer items until a specified level of measurement precision is reached (standard error < 0.3 on theta metric or 3.0 on a T-score metric) or a specified maximum number of items was administered (12). For this study, Assessment Center administered the PROMIS measures using CAT, followed by administration of any remaining SF items that had not yet been administered by CAT. These SF items were derived from the version 1.0 anger 8a, anxiety 7a, depression 8b, fatigue 7a, physical function 10a, pain interference 6b, pain behavior 7a, discretionary social activities 7a, and social roles 7a short forms.

PROMIS scores are estimated using item response theory parameters and scored on a T-score metric, with 50 typically representing the mean and 10 the standard deviation in the U. S. general population (for most domains). Exceptions to this include the PROMIS dyspnea severity and functional limitations measures, for which the mean and standard deviation (50/10) reflect the sample on which the measures were developed - people with COPD. For all PROMIS measures, the direction of scoring is guided by the domain name; higher scores indicate more of the construct being measured. Thus, for the PROMIS domains of anger, anxiety, depression, fatigue, dyspnea severity, dyspnea functional limitations, pain behavior and pain interference, higher scores indicate worse health, and for domains of physical function, discretionary social activities, social roles, and Global Health (physical health and mental health), higher scores indicate better health.

Additional measures

We administered two PRO assessments commonly used to assess COPD or related symptoms at baseline and week 12. The St. George's Respiratory Questionnaire (SGRQ) contains three domains (symptoms, activity, and impacts) and a summary score on a 0–100 possible range with 100 representing the worst HRQL [43]. The Modified Medical Research Council (MMRC) dyspnea scale is scored on a scale of 0 to 4 (0 = not troubled with breathlessness except with strenuous exercise, to 4 = too breathless to leave the house or breathless when dressing or undressing) [65, 66]. We transformed the MMRC score linearly to a 0–100 possible range (1 = 0; 2 = 25; 3 = 50; 4 = 75; 5 = 100) for some analyses.

Clinical measures

Two clinical assessments, FEV1 and the 6MWT, were obtained from participants in a stable state (either baseline or week 12). FEV1 was measured using a portable spirometer administered by a research assistant trained in spirometry. Study-related spirometry was not performed if the patient had already undergone testing in-clinic that same day. The 6MWT measured the distance in meters that a participant was able to walk in a six-minute time span [67].

Data analysis

Sample size considerations

Sample size estimates were based on an ability to detect approximately medium effect sizes (ES) in PROMIS scores between stable and acute COPD patients during the 12-week period [68,69,70]. With intraclass correlation of 0.5, a sample size of 81 in each group would enable us to detect a medium between-group ES with 80% power when using a two-sided alpha level of 0.05. Based on our previous research experience and the literature, we anticipated a 10% attrition rate over the 12-week study period. Thus, we targeted a total sample size of 180 based on a 10% attrition rate to account for potential study dropout and missing data for the planned study. All power calculations are based on the methods recommended in Cohen [71] and Kraemer and Thieman [72].

Data was summarized using descriptive statistics (e.g., means and standard deviation for continuous (and ordered) variables; frequency, mode and percentages for categorical variables) for demographic variables and all PRO and clinical measures. All item responses were examined using measures of central tendency (mean, median), spread (standard deviation, range), and response category (frequencies).

Responsiveness is an aspect of construct validity [73] and is estimated by evaluating the relationship between changes in clinical or patient-reported “anchors” and changes in the PRO scores over time; it can be evaluated in intervention studies, clinical trials and observational studies [74]. The COnsensus-based Standards for the selection of health Measurement Instruments (COSMIN) initiative [75] has proposed a definition of “responsiveness” as “The ability of an HR-PRO instrument to detect change over time in the construct to be measured.” In this paper, we examine responsiveness of the PROMIS measures over 12 weeks in patients with COPD who were recovering from an acute COPD exacerbation.

As detailed in Table 1, we hypothesized that some PROMIS domains (physical function, fatigue, anxiety, dyspnea severity, dyspnea functional limitations, discretionary social activities and social roles) would be impaired during a COPD exacerbation, and recovery from the exacerbation would be associated with improvements in these domains. Associated with changes in these physical and mental health domains, we also hypothesized responsiveness during recovery in Global Health (physical health and mental health). We hypothesized no or small changes over the 12 week recovery period for depression, anger, pain interference, and pain behavior. We hypothesized little change between baseline and 12 weeks on domains reported by participants enrolled in a stable state, and any change observed would be of a lesser magnitude than that observed in the exacerbation group. Thus, we compared the slope of changes in PROMIS and other PRO scores using mixed models (details below). We used Cohen’s f2 as a measure of local effect within a multivariate, mixed-effects regression model [71]. Cohen’s f2 convention is to classify these ES as small (≥0.02), medium (≥0.15) or large (≥0.35).

Table 1 PROMIS Measures and Hypothesized Responsiveness in COPD, with Results
Full size table

The mixed-effect model approach provides the flexibility of modeling not only the means of the data (as in the standard linear model), but also individual patients’ variation over time. Mixed models take into account the fact that measurements taken close in time are more highly correlated than measurements taken far apart in time. With mixed effect model approach, the slope of change for fixed effect (e.g., between baseline and 12-weeks later) is equivalent to the average group change. Other advantages of using mixed models include its handling of unbalanced research designs and missing data. In model fitting, the mixed model uses all available data from each subject rather than only including data from the subjects who have complete data at all of the time points. While we attempted to over-sample to compensate for the foreseeable loss of subjects due to dropout, the use of mixed models minimizes the impact of data missing throughout the course of the study. We hypothesized that there would be significant improvement (positive slope) in most PROMIS and clinical measures in COPD patients during recovery to a stable period. For each PROMIS and clinical outcome measure, the mixed model included group (fixed effect; i.e., stable and exacerbation), time (fixed effect; i.e., baseline and 12 weeks), and group by time interaction. We anticipated there would be significant group by time interaction effects in the PRO measures hypothesized to show large magnitude change (i.e., physical function, fatigue, anxiety, dyspnea severity, dyspnea functional limitations, discretionary social activities, social roles, Global physical health and Global mental health), illustrating a different slope of change between the stable and exacerbation groups across the 12-week study period for these domains.

Product-moment correlations between clinical measures (6MWT and FEV1) and PROMIS and SGRQ scores were estimated at baseline for stable patients and for patients enrolled in an exacerbated state, when the patients were deemed stable (i.e., 12 weeks after the baseline visit).

Results

Across four sites, 770 individuals were screened. Of those, 288 were ineligible (e.g., heart failure exacerbation, smoking status, altered mental status, etc.), 212 refused participation, 11 consented but withdrew before completing an assessment, and 74 were not enrolled for various and unknown reasons. One hundred individuals with COPD were enrolled in a stable state and 85 were enrolled in an exacerbated state. Of the stable subjects, 90 (90%) completed the study (3 withdrew due to health, 2 died, 3 lost to follow up, 2 withdrew for unknown reasons) and 11 were censored due to exacerbations. Of the 85 in the exacerbation group, 61 (72%) completed the study (2 withdrew due to health, 2 died, 11 lost to follow-up, 9 withdrew for unknown reasons), and 15 had subsequent exacerbations. Thus, at week 12 follow-up, there were 79 (79%) individuals remaining in the stable group and 46 (54%) in the exacerbation group.

We conducted post-hoc analyses to examine whether drop-out differed by group (exacerbation vs stable). Results of the binary logistic regression indicated that the exacerbation group experienced a higher rate of dropout than the stable group (χ2(1) = 12.5, p = .0004). We examined whether age, gender, education, physical function and fatigue were associated with dropout and found that only physical function approached significance (p = .0512). When we added physical function in the model, the drop-out rate difference between the groups remained significant (χ2(1) = 8.45, p = .0037). There were no significant group by covariate interactions.

Baseline demographic and clinical characteristics of the enrolled subjects are presented in Table 2. Those enrolled in stable and exacerbation states did not differ on any demographic characteristic other than age, with the exacerbation group patients being younger. Exacerbation group participants also reported worse COPD and health at baseline. More patients enrolled in an exacerbation state reported having a COPD diagnosis for less than a year (p = .03), having more exacerbations in the past 12 months (80%, p < .0001), more COPD-related hospitalizations in the past 12 months (72%, p < .0001) and more COPD-related ED visits in the past 12 months (50%, p < .0001).

Table 2 Baseline Demographic and Clinical Characteristics of Enrolled Patients
Full size table

The PRO scores for the baseline and 12-week follow-up by baseline enrollment status as well as the responsiveness in PRO measures over 12 weeks, as evaluated by the difference between stable and exacerbation group differences over 12 weeks is summarized in Table 1 and detailed in Table 3. Significant differences were found in anxiety SF/CAT (p = .001/p < .01), fatigue (p < .0001/p < .0001), social roles (p < .001/p < .05) and depression (p < .05, SF only), with the exacerbation group reporting greater change (improvement) than the stable group. The magnitude of change (ES) for SF/CAT anxiety (0.023/0.021), fatigue (0.036/0.047) and social roles (0.035/0.024), which were hypothesized to be medium/large/large, respectively, were all small. The ES for depression (0.018) was trivial (less than the threshold for small). Physical function, discretionary social activities, and the Global-physical and Global-mental health scales, all hypothesized to improve during recovery, did not significantly change from baseline and had no to trivial ES. Dyspnea severity and dyspnea functional limitations, also hypothesized to improve during recovery, did not change significantly but showed near-small ES (0.017, 0.015, respectively). All other PROMIS domains that were hypothesized to have small to large ES demonstrated trivial to no effect sizes. The SGRQ symptoms, impacts and total scores (but not activities) also showed significant change from baseline (all p < .0001) and all (but activities) demonstrated small effect sizes.

Table 3 Changes in patient-reported outcomes (PRO) scores from mixed model1 (N = 185)
Full size table

As a reminder, the 6MWTs on patients enrolled in an exacerbated state were performed at the 12-week follow-up when patients had returned to stable state. Six-minute walk scores were most highly correlated with PROMIS CAT scores for physical function (r = 0.50, p < .0001), fatigue (r = − 0.29, p < .01), depression (r = − 0.26, p < .01), discretionary social activities (r = 0.32, p < .01) and social roles (r = 0.32, p < .01), with similar correlations with SFs. Dyspnea severity/functional limitations SFs (r = − 0.39/− 0.35, p < .01) and SGRQ Impacts (r = − 0.22, p < .01) were also associated with six-minute walk scores. Percent predicted FEV1 scores were significantly correlated with PROMIS CATs for physical function (r = 0.32, p < .01), dyspnea severity (r = − 0.39, p < .0001), functional limitations (r = − 0.25, p < .01) and SGRQ Activities (r = − 0.25, p < .01).

Discussion

The HRQL of COPD patients during an exacerbation is known to be significantly poorer than COPD patients in a stable state [16, 41, 68, 76], and in our study, participants enrolled during an exacerbation reported worse baseline health than those enrolled in stable status on nearly all HRQL measures. Given the significant symptom burden associated with exacerbations, these known group differences were expected and provide some evidence of construct validity of some PROMIS measures for people with COPD.

Of the nine domains hypothesized to be responsive to recovery from an exacerbation, only three demonstrated statistically significant change using both SF and CAT, and in none of the three was the hypothesized magnitude of change supported by the findings; all demonstrated small effect sizes. We had hypothesized that pain interference, pain behavior, depression and anger would not change over the 12 weeks. Only the change in the depression SF (not CAT) was statistically significant and the ES was trivial (below the threshold for small). Finally, we hypothesized that stable participants (exacerbation-free at enrollment and throughout the study period) would not demonstrate any change in PROs from baseline to the 12-week follow-up. The changes in PRO scores over 12 weeks in the stable group did reflect some change, but the changes were uniformly of lesser magnitude than the changes in the exacerbation group. Given the stability in their COPD during this time, such changes may reflect variations in other life and non-measured health events in these patients.

While some of the findings were unexpected, the most curious and unexpected finding was the lack of change in PROMIS physical function. Of note, the SGRQ did not demonstrate change in the activity section of the instrument, which is most similar to the PROMIS physical function. One possibility is that physical function does not change during recovery from an exacerbation, but we reject this notion based on obvious clinical characteristics of these patients. Declines in physical function with the onset of exacerbations are well documented [48, 77, 78]. Furthermore, physical function (as measured with PROMIS) has been shown to affect people across the spectrum of disease severity, including mild disease, whereas mental health was impaired only in patients with more severe disease [78]. Lung function does not always return to pre-exacerbation levels following an exacerbation, but the trajectory of recovery of physical function/activity is less well established [79,80,81]. Some reports have documented recovery to (or nearly to) baseline levels [82]. One of the few longitudinal studies evaluating “objectively” measured (accelerometer) physical activity for up to 6 months during COPD exacerbations and periods of clinical stability found that physical activity decreased significantly during exacerbations and persisted for about 2 weeks after symptomatic recovery. Others have reported a slow recovery trajectory or failure to return to baseline [5, 83], leading some to suggest that recovery in health status after an exacerbation may take longer than previously expected [48]. It is possible that improvement in physical function following an exacerbation takes longer than 12 weeks. In addition to the literature that contradicts this [81, 84, 85], we censored individuals with subsequent exacerbations, which is likely to have eliminated those with an extended recovery trajectory. Finally, these patients may be sedentary in the absence of exacerbation and not regularly testing their own physical function [86, 87].

An alternative explanation is that physical recovery occurs, but the PROMIS physical function measures (and SGRQ activity measure) did not detect it. This might have occurred for several reasons. The severity of exacerbations experienced by our participants might not have been of sufficient magnitude to be reflected in physical function recovery; however, 38 of the participants enrolled during an exacerbated state were hospitalized for their exacerbation, suggesting severe exacerbations. It is also possible that the sample size limited the power to detect significant change. The dropout in the exacerbation group was larger than anticipated and resulted in a sample size at follow-up smaller than the power analysis indicated was needed to detect hypothesized change. However, some other domain measures demonstrated significant change, so there appeared to be adequate power for the other domains. Another explanation is the possibility that, for the physical function items, patient responses during an exacerbation did not reflect their true current (i.e., exacerbation) state. Most PROMIS domains have a 7-day context (“In the past 7 days …”), but the physical function items do not have a specific time interval. It is possible that patients were not reflecting on their exacerbation (and often hospitalized) state, but rather they were considering their physical capability prior to deterioration. Thus, the lack of a context might represent an opportunity for participants to variably interpret their “current” state of health. The lack of context may work well in a state without rapid changes (e.g., arthritis), but may not work as well for conditions with acute periods of worsening (e.g., COPD). Some support for this derives from analyses of other chronic conditions. For example, the PROMIS physical function scores for stable patients and those recovering from a COPD exacerbation in this study (34–38) are not altogether dissimilar from physical function scores from samples of patients with back pain and chronic heart failure prior to receiving an intervention (38 and 35, respectively) [36]. However, the back pain and heart failure samples demonstrated notable improvements in physical function scores in response to clinical interventions (all p ≤ 0.001) [36]. Investigators hypothesized that, in contrast with the relatively stable disability associated with back pain and heart failure, acute worsening associated with COPD exacerbations may lead patients to over-report their physical function because they reference their usual state rather than acutely ill state [36]. However, to our knowledge, there is no evidence at present to support the possibility that reframing the question (e.g., “Considering how you feel right now…”) would produce different results, so this remains a hypothesis for future research to evaluate.

Similarly, we did not demonstrate significant change in the PROMIS dyspnea severity and functional limitation measures. It’s reasonable to expect dyspnea severity and functional limitations to improve during recovery from a COPD exacerbation, as dyspnea is one of the primary symptoms associated with an exacerbation. However, these were newly developed measures and this was the first longitudinal study in which they had been administered. Items on both measures reference the same set of activities, and individuals may not have had the opportunity to perform some of these activities during an exacerbation state, especially if hospitalized (e.g., preparing meals, washing dishes). The MMRC dyspnea scale score also did not improve during the recovery, and it is similarly based on activity (e.g., walking, strenuous exercise, etc.). Although the effect sizes reflecting change in PROMIS dyspnea severity and functional limitations approached the threshold for small magnitude and did not reach statistical significance in this study, prior cross-sectional studies have provided support for the reliability and validity of these measures in COPD [62, 63, 78] and other chronic lung diseases [88], suggesting that the small sample size might have limited the responsiveness observed here.

Our findings indicate that responsiveness to change was demonstrated for three of the nine PROMIS domains in which change was hypothesized. While there is only limited support for responsiveness among the domains tested, the score differences and the effect sizes reflecting the difference in differences between the two groups reflected greater magnitude of change in the exacerbation group. With the exception of depression, responsiveness to changes was similar for the PROMIS dynamic CATs and corresponding static SFs, suggesting there is no advantage of one administration option over the other, with equivalent precision and responsiveness to clinicians and researchers. CAT administration offers the advantage of minimal participant burden without sacrificing measurement precision, but requires a computer for administration. Short forms can be administered via paper and pencil and do not require a computer for administration. Both were developed with rigorous qualitative and quantitative methodology and offer the advantages of comparability across conditions, reliability, validity, and precision.

SGRQ total, symptoms, and impacts scores significantly discriminated longitudinal change between the stable and exacerbation groups, indicating the health status of these two groups were different, consistent with the intent of the study design. Three PROMIS measures fatigue, anxiety and social roles, also demonstrated differential longitudinal change between the two groups. We note also that the magnitude of effect sizes for the SGRQ symptoms and impacts subscales scores and total score were in the small range, albeit larger than that of the PROMIS measures. This is not unexpected, because one of the putative benefits of disease-specific compared to generic measures is their sensitivity to the disease itself. The SGRQ mean score for symptoms, impacts and total score (but not activities) for the exacerbation group also exceeded the minimal clinically important difference threshold estimates reported in the literature (4–7), including the higher threshold (7+) for patients with severe disease [89,90,91,92,93].

There are several limitations to this study worth noting. Both groups experienced drop-out, but this was most prominent in the exacerbation group, which reduced the available sample size and precision of our estimates of change. However, we were still able to demonstrate responsiveness, i.e., change over the course of recovery from an exacerbation, in some measures that were hypothesized to reflect such a change. Nevertheless, the high dropout rate likely limited our power to detect the hypothesized effect size. The demographic and clinical characteristics of patients lost to follow-up were not significantly different from those of patients that completed the study. Fatigue and physical function (as measured by both PROMIS SF and CAT) were associated with drop out, however, with those who dropped out from the exacerbation group demonstrating the highest levels of fatigue and lowest levels of physical function. The findings still showed strong evidence of responsiveness in the fatigue measures in the exacerbation group, but it is unclear if or how this might have impacted responsiveness of the physical function measures. We recruited participants across four distinct clinical sites, but our sample size precluded our ability to analyze site differences. However, a rigorous three-day face-to-face training was held for all study staff before the study was launched to standardize implementation of the study protocol and ensure consistent recruitment, enrollment and assessment procedures.

Conclusion

This longitudinal study provides some initial support for the responsiveness of the PROMIS fatigue, anxiety and social roles domains relevant to COPD. As responsiveness is one element of a measure’s validity [73], this study provides some preliminary evidence of validity of some of the PROMIS measures as well. Further longitudinal studies with larger sample sizes are required to evaluate additional aspects of reliability and validity of the PROMIS measures and their performance in the COPD population. Additional evaluation of selected domains, especially the PROMIS physical function domain, is warranted, given the lack of responsiveness in this study.

Because PROMIS measures are generic, they can be used to assess the relative health status of respondents across diseases or functional characteristics. The multiple options for PROMIS administration (various short form lengths and CAT), allow for a customizable and efficient solution for measuring health outcomes important to patients. PROMIS is a useful tool for tracking select domains of HRQL in patients with COPD for research and possibly for clinical care.

Availability of data and materials

The datasets generated and/or analyzed during the current study are available for download from HealthMeasures Dataverse on the HealthMeasures website at: http://www.healthmeasures.net/resource-center/measurement-science/datasets-for-your-research.

Abbreviations

6MWT:

6 min walk test

ADL:

Activities of daily living

ANOVA:

Analysis of variance

BMI:

Body mass index

CAT:

Computer adaptive test

COPD:

Chronic obstructive pulmonary disease

COSMIN:

COnsensus-based Standards for the selection of health Measurement Instruments

ED:

Emergency department

FACIT:

Functional Assessment of Chronic Illness Therapy

FEV1:

Forced expiratory volume in 1 s

FVC:

Forced vital capacity

HRQL:

Health-related quality of life

IRB:

Institutional review board

MMRC:

Modified Medical Research Council dyspnea scale

PRO:

Patient-reported outcome

PROMIS:

Patient-Reported Outcomes Measurement Information System

SGRQ:

St. George’s Respiratory Questionnaire

References

  1. Rennard, S. I. (1998). COPD: Overview of definitions, epidemiology, and factors influencing its development. Chest, 113(4 Suppl), 235S–241S.

    Article  CAS  PubMed  Google Scholar 

  2. Kochanek, K., Xu, J., Murphy, S., Miniño, A., & Kung, H. (2011). Deaths: Preliminary data for 2009. Hyattsville: National Center for Health Statistics.

    Google Scholar 

  3. National Institutes of Health National Heart Lung and Blood Institute. (2009). Morbidity & Mortality: Chart book on cardiovascular, lung, and blood diseases Retrieved January 2, 2011, from http://www.nhlbi.nih.gov/resources/docs/2009_ChartBook.pdf.

    Google Scholar 

  4. Bausewein, C., Booth, S., Gysels, M., Kuhnbach, R., Haberland, B., & Higginson, I. J. (2010). Understanding breathlessness: Cross-sectional comparison of symptom burden and palliative care needs in chronic obstructive pulmonary disease and cancer. Journal of Palliative Medicine, 13(9), 1109–1118.

    Article  PubMed  Google Scholar 

  5. Connors Jr., A. F., Dawson, N. V., Thomas, C., Harrell Jr., F. E., Desbiens, N., Fulkerson, W. J., Kussin, P., Bellamy, P., Goldman, L., & Knaus, W. A. (1996). Outcomes following acute exacerbation of severe chronic obstructive lung disease. The SUPPORT investigators (study to understand prognoses and preferences for outcomes and risks of treatments). American Journal of Respiratory and Critical Care Medicine, 154(4 Pt 1), 959–967.

    Article  PubMed  Google Scholar 

  6. Spencer, S., Calverley, P. M., Burge, P. S., & Jones, P. W. (2004). Impact of preventing exacerbations on deterioration of health status in COPD. The European Respiratory Journal, 23(5), 698–702.

    Article  CAS  PubMed  Google Scholar 

  7. Glaab, T., Vogelmeier, C., & Buhl, R. (2010). Outcome measures in chronic obstructive pulmonary disease (COPD): Strengths and limitations. Respiratory Research, 11, 79.

    Article  PubMed  PubMed Central  Google Scholar 

  8. Cazzola, M., MacNee, W., Martinez, F. J., Rabe, K. F., Franciosi, L. G., Barnes, P. J., Brusasco, V., Burge, P. S., Calverley, P. M. A., Celli, B. R., Jones, P. W., Mahler, D. A., Make, B., Miravitlles, M., Page, C. P., Palange, P., Parr, D., Pistolesi, M., Rennard, S. I., Rutten-van Molken, M. P., Stockley, R., Sullivan, S. D., Wedzicha, J. A., Wouters, E. F., American Thoracic, S., & European Respiratory Society Task Force on outcomes of, C. (2008). Outcomes for COPD pharmacological trials: From lung function to biomarkers. The European Respiratory Journal, 31(2), 416–469.

    Article  CAS  PubMed  Google Scholar 

  9. Jones, P. W., Price, D., & van der Molen, T. (2011). Role of clinical questionnaires in optimizing everyday care of chronic obstructive pulmonary disease. International Journal of Chronic Obstructive Pulmonary Disease, 6, 289–296.

    Article  PubMed  PubMed Central  Google Scholar 

  10. Yohannes, A. M., Roomi, J., Baldwin, R. C., & Connolly, M. J. (1998). Depression in elderly outpatients with disabling chronic obstructive pulmonary disease. Age and Ageing, 27(2), 155–160.

    Article  CAS  PubMed  Google Scholar 

  11. Wamboldt, F. S. (2005). Anxiety and depression in COPD: A call (and need) for further research. Copd, 2(2), 199–201.

    Article  PubMed  Google Scholar 

  12. Kapella, M. C., Larson, J. L., Patel, M. K., Covey, M. K., & Berry, J. K. (2006). Subjective fatigue, influencing variables, and consequences in chronic obstructive pulmonary disease. Nursing Research, 55(1), 10–17.

    Article  PubMed  Google Scholar 

  13. Reardon, J. Z., Lareau, S. C., & ZuWallack, R. (2006). Functional status and quality of life in chronic obstructive pulmonary disease. The American Journal of Medicine, 119(10 Suppl 1), 32–37.

    Article  PubMed  Google Scholar 

  14. Guyatt, G. H., Berman, L. B., Townsend, M., Pugsley, S. O., & Chambers, L. W. (1987). A measure of quality of life for clinical trials in chronic lung disease. Thorax, 42(10), 773–778.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  15. Peters, J. B., Heijdra, Y. F., Daudey, L., Boer, L. M., Molema, J., Dekhuijzen, P. N., Schermer, T. R., & Vercoulen, J. H. (2011). Course of normal and abnormal fatigue in patients with chronic obstructive pulmonary disease, and its relationship with domains of health status. Patient Education and Counseling, 85(2), 281–285.

    Article  PubMed  Google Scholar 

  16. Schmier, J. K., Halpern, M. T., Higashi, M. K., & Bakst, A. (2005). The quality of life impact of acute exacerbations of chronic bronchitis (AECB): A literature review. Quality of Life Research, 14(2), 329–347.

    Article  PubMed  Google Scholar 

  17. Rodriguez-Roisin, R. (2000). Toward a consensus definition for COPD exacerbations. Chest, 117(5 Suppl 2), 398s–401s.

    Article  CAS  PubMed  Google Scholar 

  18. Anthonisen, N. R., Manfreda, J., Warren, C. P., Hershfield, E. S., Harding, G. K., & Nelson, N. A. (1987). Antibiotic therapy in exacerbations of chronic obstructive pulmonary disease. Annals of Internal Medicine, 106(2), 196–204.

    Article  CAS  PubMed  Google Scholar 

  19. Rosenberg, A. R., Dussel, V., Kang, T., Geyer, J. R., Gerhardt, C. A., Feudtner, C., & Wolfe, J. (2013). Psychological distress in parents of children with advanced cancer. JAMA Pediatrics, 167(6), 537–543.

    Article  PubMed  PubMed Central  Google Scholar 

  20. Donaldson, G. C., Wilkinson, T. M., Hurst, J. R., Perera, W. R., & Wedzicha, J. A. (2005). Exacerbations and time spent outdoors in chronic obstructive pulmonary disease. American Journal of Respiratory and Critical Care Medicine, 171(5), 446–452.

    Article  PubMed  Google Scholar 

  21. Seemungal, T. A. R., Donaldson, G. C., Paul, E. A., Bestall, J. C., Jeffries, D. J., & Wedzicha, J. A. (1998). Effect of exacerbation on quality of life in patients with chronic obstructive pulmonary disease. American Journal of Respiratory and Critical Care Medicine, 157(5), 1418–1422.

    Article  CAS  PubMed  Google Scholar 

  22. Miravitlles, M., Ferrer, M., Pont, A., Zalacain, R., Alvarez-Sala, J. L., Masa, F., Verea, H., Murio, C., Ros, F., & Vidal, R. (2004). Effect of exacerbations on quality of life in patients with chronic obstructive pulmonary disease: A 2 year follow up study. Thorax, 59(5), 387–395.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  23. Kessler, R., Ståhl, E., Vogelmeier, C., Haughney, J., Trudeau, E., Löfdahl, C.-G., & Partridge, M. R. (2006). Patient understanding, detection, and experience of COPD exacerbations: An observational, interview-based study. Chest, 130(1), 133–142.

    Article  PubMed  Google Scholar 

  24. Garcia-Aymerich, J., Lange, P., Benet, M., Schnohr, P., & Anto, J. M. (2006). Regular physical activity reduces hospital admission and mortality in chronic obstructive pulmonary disease: A population based cohort study. Thorax, 61(9), 772–778.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  25. Baghai-Ravary, R., Quint, J. K., Goldring, J. J., Hurst, J. R., Donaldson, G. C., & Wedzicha, J. A. (2009). Determinants and impact of fatigue in patients with chronic obstructive pulmonary disease. Respiratory Medicine, 103(2), 216–223.

    Article  PubMed  Google Scholar 

  26. Donaldson, G. C., & Wedzicha, J. A. (2006). COPD exacerbations 1: Epidemiology. Thorax, 61(2), 164–168.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  27. Harrison, S. L., Robertson, N., Graham, C. D., Williams, J., Steiner, M. C., Morgan, M. D., & Singh, S. J. (2014). Can we identify patients with different illness schema following an acute exacerbation of COPD: A cluster analysis. Respiratory Medicine, 108(2), 319–328.

    Article  CAS  PubMed  Google Scholar 

  28. Quint, J. K., Baghai-Ravary, R., Donaldson, G. C., & Wedzicha, J. A. (2008). Relationship between depression and exacerbations in COPD. The European Respiratory Journal, 32(1), 53.

    Article  CAS  PubMed  Google Scholar 

  29. Pumar, M. I., Gray, C. R., Walsh, J. R., Yang, I. A., Rolls, T. A., & Ward, D. L. (2014). Anxiety and depression-important psychological comorbidities of COPD. Journal of Thoracic Disease, 6(11), 1615–1631.

    PubMed  PubMed Central  Google Scholar 

  30. Bailey, P. H. (2004). The dyspnea-anxiety-dyspnea cycle--COPD patients' stories of breathlessness: "It's scary when you can't breathe". Qualitative Health Research, 14(6), 760–778.

    Article  PubMed  Google Scholar 

  31. Gudmundsson, G., Gislason, T., Janson, C., Lindberg, E., Suppli Ulrik, C., Brondum, E., Nieminen, M. M., Aine, T., Hallin, R., & Bakke, P. (2006). Depression, anxiety and health status after hospitalisation for COPD: A multicentre study in the Nordic countries. Respiratory Medicine, 100(1), 87–93.

    Article  PubMed  Google Scholar 

  32. Cella, D., Riley, W., Stone, A., Rothrock, N., Reeve, B., Yount, S., Amtmann, D., Bode, R., Buysse, D., Choi, S., Cook, K., Devellis, R., Dewalt, D., Fries, J. F., Gershon, R., Hahn, E. A., Pilkonis, P., Revicki, D., Rose, M., Weinfurt, K., Hays, R., Lai, J. S., & PROMIS Cooperative Group. (2010). The patient reported outcomes measurement information system (PROMIS) developed and tested its first wave of adult self-reported health outcome item banks: 2005-2008. Journal of Clinical Epidemiology, 63(11), 1179–1194.

    Article  PubMed  PubMed Central  Google Scholar 

  33. DeWalt, D. A., Rothrock, N., Yount, S., Stone, A. A., & PROMIS Cooperative Group. (2007). Evaluation of item candidates: The PROMIS qualitative item review. Medical Care, 45(5 Suppl 1), S12–S21.

    Article  PubMed  PubMed Central  Google Scholar 

  34. Reeve, B. B., Hays, R. D., Bjorner, J. B., Cook, K. F., Crane, P. K., Teresi, J. A., Thissen, D., Revicki, D. A., Weiss, D. J., Hambleton, R. K., Liu, H., Gershon, R., Reise, S. P., Lai, J. S., & Cella, D. (2007). Psychometric evaluation and calibration of health-related quality of life item banks: Plans for the patient-reported outcomes measurement information system (PROMIS). Medical Care, 45(5 Suppl 1), S22–S31.

    Article  PubMed  Google Scholar 

  35. Askew, R. L., Cook, K. F., Revicki, D. A., Cella, D., & Amtmann, D. (2016). Clinical validity of PROMIS(®) pain interference and pain behavior in diverse clinical populations. Journal of Clinical Epidemiology, 73, 103–111.

    Article  PubMed  PubMed Central  Google Scholar 

  36. Schalet, B. D., Hays, R. D., Jensen, S. E., Beaumont, J. L., Fries, J. F., & Cella, D. (2016). Validity of PROMIS physical function measured in diverse clinical samples. Journal of Clinical Epidemiology, 73, 112–118.

    Article  PubMed  PubMed Central  Google Scholar 

  37. Schalet, B. D., Pilkonis, P. A., Yu, L., Dodds, N., Johnston, K. L., Yount, S., Riley, W., & Cella, D. (2016). Clinical validity of PROMIS depression, anxiety, and anger across diverse clinical samples. Journal of Clinical Epidemiology, 73, 119–127.

    Article  PubMed  PubMed Central  Google Scholar 

  38. Cella, D., Lai, J.-S., Jensen, S. E., Christodoulou, C., Junghaenel, D. U., Reeve, B. B., & Stone, A. A. (2016). Clinical validity of the PROMIS(®) fatigue item Bank across diverse clinical samples. Journal of Clinical Epidemiology, 73, 128–134.

    Article  PubMed  PubMed Central  Google Scholar 

  39. Cook, K. F., Jensen, S. E., Schalet, B. D., Beaumont, J. L., Amtmann, D., Czajkowski, S., Dewalt, D. A., Fries, J. F., Pilkonis, P. A., Reeve, B. B., Stone, A. A., Weinfurt, K. P., & Cella, D. (2016). PROMIS measures of pain, fatigue, negative affect, physical function, and social function demonstrated clinical validity across a range of chronic conditions. Journal of Clinical Epidemiology, 73, 89–102.

    Article  PubMed  PubMed Central  Google Scholar 

  40. Eakin, E., Sassi-Dambron, D., Ries, A., & Kaplan, R. (1995). Reliability and validity of dyspnea measures in patients with obstructive lung disease. International Journal of Behavioral Medicine, 2(2), 118–134.

    Article  CAS  PubMed  Google Scholar 

  41. Irwin, D. E., Atwood Jr., C. A., Hays, R. D., Spritzer, K., Liu, H., Donohue, J. F., Leidy, N. K., Yount, S. E., & DeWalt, D. A. (2015). Correlation of PROMIS scales and clinical measures among chronic obstructive pulmonary disease patients with and without exacerbations. Quality of Life Research, 24(4), 999–1009.

    Article  PubMed  Google Scholar 

  42. Hurst, J. R. (2011). Exacerbation phenotyping in chronic obstructive pulmonary disease. American Journal of Respiratory and Critical Care Medicine, 184(6), 625–626.

    Article  PubMed  Google Scholar 

  43. Jones, P. W., Quirk, F. H., Baveystock, C. M., & Littlejohns, P. (1992). A self-complete measure of health status for chronic airflow limitation. The St. George's respiratory questionnaire. The American Review of Respiratory Disease, 145(6), 1321–1327.

    Article  CAS  PubMed  Google Scholar 

  44. Zhou, A., Zhou, Z., Zhao, Y., & Chen, P. (2017). The recent advances of phenotypes in acute exacerbations of COPD. International Journal of Chronic Obstructive Pulmonary Disease, 12, 1009–1018.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  45. Doll, H., & Miravitlles, M. (2005). Health-related QOL in acute exacerbations of chronic bronchitis and chronic obstructive pulmonary disease: A review of the literature. Pharmacoeconomics, 23(4), 345–363.

    Article  PubMed  Google Scholar 

  46. Mantero, M., Rogliani, P., Di Pasquale, M., Polverino, E., Crisafulli, E., Guerrero, M., Gramegna, A., Cazzola, M., & Blasi, F. (2017). Acute exacerbations of COPD: Risk factors for failure and relapse. International Journal of Chronic Obstructive Pulmonary Disease, 12, 2687–2693.

    Article  PubMed  PubMed Central  Google Scholar 

  47. Cote, C. G., Dordelly, L. J., & Celli, B. R. (2007). Impact of COPD exacerbations on patient-centered outcomes. Chest, 131(3), 696–704.

    Article  PubMed  Google Scholar 

  48. Anzueto, A. (2010). Impact of exacerbations on COPD. European Respiratory Review, 19(116), 113–118.

    Article  CAS  PubMed  Google Scholar 

  49. Goldstein, R., & Brooks, D. (2014). Pulmonary rehabilitation at the time of the COPD exacerbation. Clinics in Chest Medicine, 35(2), 391–398.

    Article  PubMed  Google Scholar 

  50. van Geffen, W. H., Hajian, B., Vos, W., De Backer, J., Cahn, A., Usmani, O. S., Van Holsbeke, C., Pistolesi, M., Kerstjens, H. A., & De Backer, W. (2018). Functional respiratory imaging: Heterogeneity of acute exacerbations of COPD. International Journal of Chronic Obstructive Pulmonary Disease, 13, 1783–1792.

    Article  PubMed  PubMed Central  Google Scholar 

  51. Garcia-Gutierrez, S., Quintana, J. M., Unzurrunzaga, A., Esteban, C., Bare, M., Fernandez de Larrea, N., Pulido, E., Rivas, P., & Copd Group, I. (2016). Predictors of change in dyspnea level in acute exacerbations of COPD. Copd, 13(3), 303–311.

    Article  PubMed  Google Scholar 

  52. Rabe, K. F., Hurd, S., Anzueto, A., Barnes, P. J., Buist, S. A., Calverley, P., Fukuchi, Y., Jenkins, C., Rodriguez-Roisin, R., van Weel, C., & Zielinski, J. (2007). Global strategy for the diagnosis, management, and prevention of chronic obstructive pulmonary disease: GOLD executive summary. American Journal of Respiratory and Critical Care Medicine, 176(6), 532–555.

    Article  PubMed  Google Scholar 

  53. Calverley, P., Pauwels, R., Vestbo, J., Jones, P., Pride, N., Gulsvik, A., Anderson, J., & Maden, C. (2003). Combined salmeterol and fluticasone in the treatment of chronic obstructive pulmonary disease: A randomised controlled trial. Lancet, 361(9356), 449–456.

    Article  CAS  PubMed  Google Scholar 

  54. Global Initiative for Chronic Obstructive Pulmonary Disease, Pocket Guide to COPD Diagnosis, Management and Prevention. (2017). http://goldcopd.org/wp-content/uploads/2016/12/wms-GOLD-2017-Pocket-Guide.pdf

  55. Pilkonis, P. A., Choi, S. W., Reise, S. P., Stover, A. M., Riley, W. T., & Cella, D. (2011). Item banks for measuring emotional distress from the patient-reported outcomes measurement information system (PROMIS®): Depression, anxiety, and anger. Assessment, 18(3), 263–283.

    Article  PubMed  PubMed Central  Google Scholar 

  56. Lai, J. S., Cella, D., Choi, S., Junghaenel, D. U., Christodoulou, C., Gershon, R., Stone, A. (2011). How item banks and their application can influence measurement practice in rehabilitation medicine: a PROMIS fatigue item bank example. Arch Phys Med Rehabil, 92 (10 Suppl):S20-7.

  57. Revicki, D. A., Chen, W.-H., Harnam, N., Cook, K. F., Amtmann, D., Callahan, L. F., Jensen, M. P., & Keefe, F. J. (2009). Development and psychometric analysis of the PROMIS pain behavior item Bank. Pain, 146(1–2), 158–169.

    Article  PubMed  PubMed Central  Google Scholar 

  58. Amtmann, D., Cook, K. F., Jensen, M. P., Chen, W.-H., Choi, S., Revicki, D., Cella, D., Rothrock, N., Keefe, F., & Callahan, L. (2010). Development of a Promis item Bank to measure pain interference. Pain, 150(1), 173–182.

    Article  PubMed  PubMed Central  Google Scholar 

  59. Bruce, B., Fries, J. F., Ambrosini, D., Lingala, B., Gandek, B., Rose, M., & Ware Jr., J. E. (2009). Better assessment of physical function: Item improvement is neglected but essential. Arthritis Research & Therapy, 11(6), R191.

    Article  Google Scholar 

  60. Hahn, E. A., Devellis, R. F., Bode, R. K., Garcia, S. F., Castel, L. D., Eisen, S. V., Bosworth, H. B., Heinemann, A. W., Rothrock, N., & Cella, D. (2010). Measuring social health in the patient-reported outcomes measurement information system (PROMIS): Item bank development and testing. Quality of Life Research, 19(7), 1035–1044.

    Article  PubMed  PubMed Central  Google Scholar 

  61. Hays, R. D., Bjorner, J. B., Revicki, D. A., Spritzer, K. L., & Cella, D. (2009). Development of physical and mental health summary scores from the patient-reported outcomes measurement information system (PROMIS) global items. Quality of Life Research, 18(7), 873–880.

    Article  PubMed  PubMed Central  Google Scholar 

  62. Yount, S. E., Choi, S. W., Victorson, D., Ruo, B., Cella, D., Anton, S., & Hamilton, A. (2011). Brief, valid measures of dyspnea and related functional limitations in chronic obstructive pulmonary disease (COPD). Value in Health, 14(2), 307–315.

    Article  PubMed  Google Scholar 

  63. Choi, S. W., Victorson, D. E., Yount, S., Anton, S., & Cella, D. (2011). Development of a conceptual framework and calibrated item banks to measure patient-reported dyspnea severity and related functional limitations. Value in Health, 14(2), 291–306.

    Article  PubMed  Google Scholar 

  64. Gershon, R., Rothrock, N. E., Hanrahan, R. T., Jansky, L. J., Harniss, M., & Riley, W. (2010). The development of a clinical outcomes survey research application: Assessment CenterSM. Quality of Life Research, 19(5), 677–685.

    Article  PubMed  PubMed Central  Google Scholar 

  65. Stenton, C. (2008). The MRC breathlessness scale. Occupational Medicine, 58(3), 226–227.

    Article  PubMed  Google Scholar 

  66. Medical Research Council's Committee on the Aetiology of Chronic Bronchitis. (1960). Standardized Questionaries on Respiratory Symptoms. British Medical Journal, 2(5213), 1665-1665.

  67. Reybrouck, T. (2003). Clinical usefulness and limitations of the 6-minute walk test in patients with cardiovascular or pulmonary disease. Chest, 123(2), 325–327.

    Article  PubMed  Google Scholar 

  68. Doll, H., Duprat-Lomon, I., Ammerman, E., & Sagnier, P. P. (2003). Validity of the St George's respiratory questionnaire at acute exacerbation of chronic bronchitis: Comparison with the Nottingham health profile. Quality of Life Research, 12(2), 117–132.

    Article  PubMed  Google Scholar 

  69. Paterson, C., Langan, C. E., McKaig, G. A., Anderson, P. M., Maclaine, G. D., Rose, L. B., Walker, S. J., & Campbell, M. J. (2000). Assessing patient outcomes in acute exacerbations of chronic bronchitis: The measure your medical outcome profile (MYMOP), medical outcomes study 6-item general health survey (MOS-6A) and EuroQol (EQ-5D). Quality of Life Research, 9(5), 521–527.

    Article  CAS  PubMed  Google Scholar 

  70. Aaron, S. D., Vandemheen, K. L., Clinch, J. J., Ahuja, J., Brison, R. J., Dickinson, G., & Hebert, P. C. (2002). Measurement of short-term changes in dyspnea and disease-specific quality of life following an acute COPD exacerbation. Chest, 121(3), 688–696.

    Article  PubMed  Google Scholar 

  71. Cohen, J. (1988). Statistical power analysis for the behavioral sciences. New York: Academic.

    Google Scholar 

  72. Kraemer, H. C., & T. S. (1987). How many subjects? Statistical power analysis in research. Newbury Park: Sage.

    Google Scholar 

  73. Hays, R. D., & Hadorn, D. (1992). Responsiveness to change: An aspect of validity, not a separate dimension. Quality of Life Research, 1(1), 73–75.

    Article  CAS  PubMed  Google Scholar 

  74. Revicki, D., Hays, R. D., Cella, D., & Sloan, J. (2008). Recommended methods for determining responsiveness and minimally important differences for patient-reported outcomes. Journal of Clinical Epidemiology, 61(2), 102–109.

    Article  PubMed  Google Scholar 

  75. Mokkink, L. B., Terwee, C. B., Patrick, D. L., Alonso, J., Stratford, P. W., Knol, D. L., Bouter, L. M., & de Vet, H. C. (2010). The COSMIN study reached international consensus on taxonomy, terminology, and definitions of measurement properties for health-related patient-reported outcomes. Journal of Clinical Epidemiology, 63(7), 737–745.

    Article  PubMed  Google Scholar 

  76. Solem, C. T., Sun, S. X., Sudharshan, L., Macahilig, C., Katyal, M., & Gao, X. (2013). Exacerbation-related impairment of quality of life and work productivity in severe and very severe chronic obstructive pulmonary disease. International Journal of Chronic Obstructive Pulmonary Disease, 8, 641–652.

    Article  PubMed  PubMed Central  Google Scholar 

  77. Miravitlles, M., Anzueto, A., Legnani, D., Forstmeier, L., & Fargel, M. (2007). Patient's perception of exacerbations of COPD--the PERCEIVE study. Respiratory Medicine, 101(3), 453–460.

    Article  PubMed  Google Scholar 

  78. Lin, F. J., Pickard, A. S., Krishnan, J. A., Joo, M. J., Au, D. H., Carson, S. S., Gillespie, S., Henderson, A. G., Lindenauer, P. K., McBurnie, M. A., Mularski, R. A., Naureckas, E. T., Vollmer, W. M., & Lee, T. A. (2014). Measuring health-related quality of life in chronic obstructive pulmonary disease: Properties of the EQ-5D-5L and PROMIS-43 short form. BMC Medical Research Methodology, 14, 78.

    Article  PubMed  PubMed Central  Google Scholar 

  79. Kanner, R. E., Anthonisen, N. R., & Connett, J. E. (2001). Lower respiratory illnesses promote FEV(1) decline in current smokers but not ex-smokers with mild chronic obstructive pulmonary disease: Results from the lung health study. American Journal of Respiratory and Critical Care Medicine, 164(3), 358–364.

    Article  CAS  PubMed  Google Scholar 

  80. Global Initiative for Chronic Obstructive Lung Disease (GOLD). (2010). Global strategy for the diagnosis, management and prevention of chronic obstructive pulmonary disease.

    Google Scholar 

  81. Seemungal, T. A., Donaldson, G. C., Bhowmik, A., Jeffries, D. J., & Wedzicha, J. A. (2000). Time course and recovery of exacerbations in patients with chronic obstructive pulmonary disease. American Journal of Respiratory and Critical Care Medicine, 161(5), 1608–1613.

    Article  CAS  PubMed  Google Scholar 

  82. Miravitlles, M., Mayordomo, C., Artes, M., Sanchez-Agudo, L., Nicolau, F., & Segu, J. L. (1999). Treatment of chronic obstructive pulmonary disease and its exacerbations in general practice. EOLO group. Estudio Observacional de la Limitacion Obstructiva al Flujo aEreo. Respiratory Medicine, 93(3), 173–179.

    Article  CAS  PubMed  Google Scholar 

  83. Spencer, S., Calverley, P. M., Sherwood Burge, P., & Jones, P. W. (2001). Health status deterioration in patients with chronic obstructive pulmonary disease. American Journal of Respiratory and Critical Care Medicine, 163(1), 122–128.

    Article  CAS  PubMed  Google Scholar 

  84. Aaron, S. D., Donaldson, G. C., Whitmore, G. A., Hurst, J. R., Ramsay, T., & Wedzicha, J. A. (2012). Time course and pattern of COPD exacerbation onset. Thorax, 67(3), 238–243.

    Article  PubMed  Google Scholar 

  85. Donaldson, G. C., Law, M., Kowlessar, B., Singh, R., Brill, S. E., Allinson, J. P., & Wedzicha, J. A. (2015). Impact of prolonged exacerbation recovery in chronic obstructive pulmonary disease. American Journal of Respiratory and Critical Care Medicine, 192(8), 943–950.

    Article  PubMed  PubMed Central  Google Scholar 

  86. Pitta, F., Troosters, T., Spruit, M. A., Probst, V. S., Decramer, M., & Gosselink, R. (2005). Characteristics of physical activities in daily life in chronic obstructive pulmonary disease. American Journal of Respiratory and Critical Care Medicine, 171(9), 972–977.

    Article  PubMed  Google Scholar 

  87. Vorrink, S. N., Kort, H. S., Troosters, T., & Lammers, J. W. (2011). Level of daily physical activity in individuals with COPD compared with healthy controls. Respiratory Research, 12, 33.

    Article  PubMed  PubMed Central  Google Scholar 

  88. Yount, S. E., Beaumont, J. L., Chen, S. Y., Kaiser, K., Wortman, K., Van Brunt, D. L., Swigris, J., & Cella, D. (2016). Health-related quality of life in patients with idiopathic pulmonary fibrosis. Lung, 194(2), 227–234.

    Article  PubMed  Google Scholar 

  89. Jones, P. W. (2005). St. George's respiratory questionnaire: MCID. Copd, 2(1), 75–79.

    Article  PubMed  Google Scholar 

  90. Osman, I. M., Godden, D. J., Friend, J. A., Legge, J. S., & Douglas, J. G. (1997). Quality of life and hospital re-admission in patients with chronic obstructive pulmonary disease. Thorax, 52(1), 67–71.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  91. Tsiligianni, I. G., van der Molen, T., Moraitaki, D., Lopez, I., Kocks, J. W. H., Karagiannis, K., Siafakas, N., & Tzanakis, N. (2012). Assessing health status in COPD. A head-to-head comparison between the COPD assessment test (CAT) and the clinical COPD questionnaire (CCQ). BMC Pulmonary Medicine, 12, 20–20.

    Article  PubMed  PubMed Central  Google Scholar 

  92. Alma, H., de Jong, C., Jelusic, D., Wittmann, M., Schuler, M., Flokstra-de Blok, B., Kocks, J., Schultz, K., & van der Molen, T. (2016). Health status instruments for patients with COPD in pulmonary rehabilitation: Defining a minimal clinically important difference. NPJ Primary Care Respiratory Medicine, 26, 16041–16041.

    Article  PubMed  PubMed Central  Google Scholar 

  93. Welling, J. B. A., Hartman, J. E., Ten Hacken, N. H. T., Klooster, K., & Slebos, D.-J. (2015). The minimal important difference for the St George&#039;s respiratory questionnaire in patients with severe COPD. The European Respiratory Journal, 46(6), 1598.

    Article  CAS  PubMed  Google Scholar 

Download references

Acknowledgements

PROMIS was funded with cooperative agreements from the National Institutes of Health (NIH) Common Fund Initiative (Northwestern University, PI: David Cella, PhD, U54AR057951, U01AR052177; Northwestern University, PI: Richard C. Gershon, PhD, U54AR057943; American Institutes for Research, PI: Susan (San) D. Keller, PhD, U54AR057926; State University of New York, Stony Brook, PIs: Joan E. Broderick, PhD and Arthur A. Stone, PhD, U01AR057948, U01AR052170; University of Washington, Seattle, PIs: Heidi M. Crane, MD, MPH, Paul K. Crane, MD, MPH, and Donald L. Patrick, PhD, U01AR057954; University of Washington, Seattle, PI: Dagmar Amtmann, PhD, U01AR052171; University of North Carolina, Chapel Hill, PI: Harry A. Guess, MD, PhD (deceased), Darren A. DeWalt, MD, MPH, U01AR052181; Children’s Hospital of Philadelphia, PI: Christopher B. Forrest, MD, PhD, U01AR057956; Stanford University, PI: James F. Fries, MD, U01AR052158; Boston University, PIs: Alan Jette, PT, PhD, Stephen M. Haley, PhD (deceased), and David Scott Tulsky, PhD (University of Michigan, Ann Arbor), U01AR057929; University of California, Los Angeles, PIs: Dinesh Khanna, MD (University of Michigan, Ann Arbor) and Brennan Spiegel, MD, MSHS, U01AR057936; University of Pittsburgh, PI: Paul A. Pilkonis, PhD, U01AR052155; Georgetown University, PIs: Carol M. Moinpour, PhD (Fred Hutchinson Cancer Research Center, Seattle) and Arnold L. Potosky, PhD, U01AR057971; Children’s Hospital Medical Center, Cincinnati, PI: Esi M. Morgan DeWitt, MD, MSCE, U01AR057940; University of Maryland, Baltimore, PI: Lisa M. Shulman, MD, U01AR057967; and Duke University, PI: Kevin P. Weinfurt, PhD, U01AR052186. NIH Science Officers on this project have included Deborah Ader, PhD, Vanessa Ameen, MD (deceased), Susan Czajkowski, PhD, Basil Eldadah, MD, PhD, Lawrence Fine, MD, DrPH, Lawrence Fox, MD, PhD, Lynne Haverkos, MD, MPH, Thomas Hilton, PhD, Laura Lee Johnson, PhD, Michael Kozak, PhD, Peter Lyster, PhD, Donald Mattison, MD, Claudia Moy, PhD, Louis Quatrano, PhD, Bryce Reeve, PhD, William Riley, PhD, Peter Scheidt, MD, Ashley Wilder Smith, PhD, MPH, Susana Serrate-Sztein, MD, William Phillip Tonkins, DrPH, Ellen Werner, PhD, Tisha Wiley, PhD, and James Witter, MD, PhD. The contents of this article uses data developed under PROMIS. These contents do not necessarily represent an endorsement by the US Federal Government or PROMIS. See www.healthmeasures.net for additional information on the PROMIS initiative.

Funding

This study was funded by the National Institutes of Health grants: U01AR052177 and U01AR052181.

Author information

Authors and Affiliations

  1. Department of Medical Social Sciences, Northwestern University Feinberg School of Medicine, 625 N. Michigan Avenue, 27th floor, Chicago, IL, 60611, USA

    Susan E. Yount

  2. Pulmonary Section, VA Pittsburgh Healthcare System and University of Pittsburgh Medical Center, Pittsburgh, PA, USA

    Charles Atwood

  3. Division of Pulmonary Medicine, University of North Carolina School of Medicine, University of North Carolina, Chapel Hill, NC, USA

    James Donohue

  4. Department of Medicine, University of California, Los Angeles, Los Angeles, CA, USA

    Ron D. Hays & Karen L. Spritzer

  5. Department of Epidemiology, Gillings School of Global Public Health, University of North Carolina – Chapel Hill, Chapel Hill, NC, USA

    Debra Irwin

  6. Evidera, Bethesda, MD, USA

    Nancy Kline Leidy

  7. School of Dentistry, University of California, Los Angeles, Los Angeles, CA, USA

    Honghu Liu

  8. Division of General Medicine and Clinical Epidemiology and the Cecil G. Sheps Center for Health Services Research, University of North Carolina School of Medicine – Chapel Hill, Chapel Hill, NC, USA

    Darren A. DeWalt

Authors
  1. Susan E. Yount
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Charles Atwood
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. James Donohue
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Ron D. Hays
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Debra Irwin
    View author publications

    You can also search for this author in PubMed Google Scholar

  6. Nancy Kline Leidy
    View author publications

    You can also search for this author in PubMed Google Scholar

  7. Honghu Liu
    View author publications

    You can also search for this author in PubMed Google Scholar

  8. Karen L. Spritzer
    View author publications

    You can also search for this author in PubMed Google Scholar

  9. Darren A. DeWalt
    View author publications

    You can also search for this author in PubMed Google Scholar

Contributions

The study was designed by all authors. Data collection activities were overseen by DD, DI, CA, JD, and SEY. Data analysis was conducted by KS. Interpretation of data was completed by all authors. All authors have reviewed all drafts of the manuscript and approved the final version.

Authors’ information

Not applicable.

Corresponding author

Correspondence to Susan E. Yount.

Ethics declarations

Ethics approval and consent to participate

All procedures performed in studies involving human participants were in accordance with the ethical standards of the institutional and/or national research committee and with the 1964 Helsinki declaration and its later amendments or comparable ethical standards. The study was approved by the Institutional Review Board (IRB) at each site (NorthShore University HealthSystem, EH04–179; University of North Carolina, 08–0138; Pittsburgh VA Medical Center, 02683; Duke University, Pro00006904). At the time of enrollment and prior to beginning the baseline assessment, informed consent was obtained from all participants included in the study.

Consent for publication

Not applicable.

Competing interests

The authors declare that they have no competing interests.

Additional information

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Open Access This article is distributed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Yount, S.E., Atwood, C., Donohue, J. et al. Responsiveness of PROMIS® to change in chronic obstructive pulmonary disease. J Patient Rep Outcomes 3, 65 (2019). https://doi.org/10.1186/s41687-019-0155-9

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1186/s41687-019-0155-9

Keywords