Skip to main content

Advertisement

Two-item PROMIS® global physical and mental health scales

Article metrics

Abstract

Background

Self-reports of health provide useful information about function and well-being that can improve communication between patients and clinicians. Global health items provide summary information that are predictive of health care utilization and mortality. There is a need for parsimonious global health scales for use in large sample surveys. This study evaluates the reliability and validity of brief measures of global physical health and mental health in the Patient Reported Outcomes Measurement and Information System (PROMIS®) project.

Methods

A total of 21,133 persons included in the PROMIS development sample: 52% female; 82% White, 9% Black, 9% Hispanic; median age of 50 years. We identified two global physical health items (GPH-2) and two global mental health items (GMH-2) with highest discrimination parameters and compared their reliabilities and construct validity to that of the original 4-item scales (GPH-4 and GMH-4) and a single global health item (Global01).

Results

Internal consistency reliability was 0.73 for the GPH-2 (versus 0.81 for the GPH-4) and 0.81 for the GMH-2 (versus 0.86 for the GMH-4). Marginal reliabilities were 0.55 for Global01, 0.70 for GPH-2, 0.79 for GPH-4, 0.80 for GMH-2, and 0.86 for GMH-4. The product-moment correlation between the GPH-2 and GPH-4 was 0.94 and between GMH-2 and GMH-4 was 0.97. The 2-item and 4-item versions of the scales had similar correlations with PROMIS domain scores, the EQ-5D-3L and comorbidities, but the 4-item scales were more strongly correlated with these measures.

Conclusions

Adding a single item to a large cross-sectional population survey can cost as much as $100,000. The 2-item variants of the PROMIS global health scales reduce the cost of use on national surveys by 50%, a substantial cost savings. These briefer scales are also more practical for use in clinical practice. The 2-item versions of the PROMIS global health scales display adequate reliability for group comparisons and their associations with other indicators of health are similar to that of the original 4-item scales. The briefer scales are psychometrically sound and reduce burden of survey administration.

Background

The Patient-Reported Outcomes Measurement Information System (PROMIS®) is a National Institutes of Health initiative to develop state-of-the-science measures that assess function and well-being in the physical, mental and social domains of health. PROMIS goals include using these measures as indicators of health care outcomes that may guide reduction of health care disparities and improvement of population health in the U.S. [1]. These measures are useful in screening for disability and in improving communication between patients and clinicians [2]. In addition, self-reported health is predictive of health care utilization and subsequent mortality [3].

Global health items assess overall health. PROMIS global health items include global ratings of five primary domains (physical function, fatigue, pain, emotional distress, and social health) as well as perceptions of general health that cut across domains [4]. Global items allow respondents to weigh together different aspects of health to arrive at a “bottom-line” indicator of their health. Four-item global physical health (GPH-4) and global mental health (GMH-4) scales were developed in PROMIS® that had internal consistency reliability coefficients of 0.79 and 0.86, respectively.

Despite the parsimony of the GPH-4 and GMH-4, there are applications where even fewer global health items are desired. For example, adding a single item to a large population survey can cost as much as $100,000. Indeed, the most widely used global health measure is a single item: In general, how would you rate your health: excellent, very good, good, fair, or poor? [5] This item (Global01) correlated strongly with the GPH-4 but its reliability was considerably lower than that of the GPH-4 [6]. When considering briefer versions of multi-item scales, comparability of scores produced from the shorter measure needs to be demonstrated and tradeoffs carefully considered [7].

This study identifies 2-item variants of the PROMIS global physical and mental health scales (GPH-2 and GMH-2) and compares their psychometric properties to the GPH-4, GMH-4, and the Global01 item.

Methods

Sample

The data were collected in 2007 and 2008 and consisted of 21,133 individuals, of whom 19,601 were members of the YouGovPolimetrix panel sample, while 1532 were recruited at medical sites (University of North Carolina, Stanford, Pittsburgh, and Duke) [1]. The sample was 52% female, had median age of 50 years, 82% White (non-Hispanic), 9% Black (non-Hispanic), and 9% Hispanic. Three percent of this sample had less than a high school education, 16% were high school graduates, and 43% had educational attainment beyond high school. While those with lower levels of educational attainment were underrepresented [8], each global health item response option was selected by at least 100 respondents. In addition, equivalence testing showed similarly between the PROMIS general population and national norms related to body mass index and self-rated health [9].

PROMIS measures

The PROMIS Global Health (v 1.2) instrument consists of ten global health items that represent five core PROMIS domains (physical function, pain, fatigue, emotional distress, social health). Four items are used to assess global physical health. Three of these are administered using five-category response scales, and one item (rating of pain on average) uses a response scale of 0–10 that is recoded to five categories (0 = 1; 1-3 = 2; 4-6 = 3; 7-9 = 4; 10 = 5):

  1. 1)

    In general, how would you rate your physical health? Excellent, Very Good, Good, Fair, Poor

  2. 2)

    To what extent are you able to carry out your everyday physical activities such as walking, climbing stairs, carrying groceries, or moving a chair? Completely, Mostly, Moderately, A little, Not at all

  3. 3)

    In the past 7 days, how would you rate your pain on average? Scale of 0 to 10, where 0 = no pain and 10 = worst pain imaginable

  4. 4)

    In the past 7 days, how would you rate your fatigue on average? None, Mild, Moderate, Severe, Very severe

Four items are used to assess global mental health, all of which are administered using five-category response scales:

  1. 1)

    In general, would you say your quality of life is: Excellent, Very Good, Good, Fair, Poor

  2. 2)

    In general, how would you rate your mental health, including your mood and your ability to think? Excellent, Very Good, Good, Fair, Poor

  3. 3)

    In general, how would you rate your satisfaction with social activities and relationships? Excellent, Very Good, Good, Fair, Poor

  4. 4)

    How often have you been bothered by emotional problems? Never, Rarely, Sometimes, Often, Always

The dataset also included PROMIS version 1.0 measures of physical function, pain behavior, pain interference, fatigue, anxiety, anger, depressive symptoms, satisfaction with participation in discretionary social activities, satisfaction with participation in social roles, as well as self-reported chronic conditions and the EQ-5D-3L [10].

The Evanston Northwestern Healthcare institutional review board reviewed and approved the study.

Analysis plan

We selected 2 of 4 items from both the GPH-4 and GMH-4 scales for psychometric evaluation (GPH-2 and GMH-2) that had the highest discrimination parameters [11], indicating they best represented the underlying construct. The GPH-2 items are: 1) Global03: In general, how would you rate your physical health? 2) Global06: To what extent are you able to carry out your everyday physical activities such as walking, climbing stairs, carrying groceries, or moving a chair? The GMH-2 items are: 1) Global04: In general, how would you rate your mental health, including your mood and your ability to think? 2) Global05: In general, how would you rate your satisfaction with your social activities and relationships?

We provide mean scores, internal consistency reliability [12], and marginal reliability of the GPH-4, GPH-2, Global01, GMH-4 and GMH-2 scales. Marginal (empirical) reliability was estimated by calculating the ratio of the average of the squared standard errors of observed expected a-posteriori (EAP) scores over the observed EAP score variance, and subtracting that ratio from one. In addition, we estimated product-moment correlations of the 2-item scales (GPH-2 and GMH-2) and the single item (Global01) with the original 4-item (GPH-4 and GMH-4) scales. We also evaluated construct validity using product-moment correlations with other measures included in the study: PROMIS physical function, pain behavior, pain interference, fatigue, anxiety, anger, depressive symptoms, social discretionary and social roles domains, EQ-5D-3L, and count of number of 25 self-reported chronic conditions: high blood pressure (hypertension), chest pain (angina), hardening of the arteries (coronary artery disease), heart failure or congestive heart failure, heart attack (myocardial infarction), stroke or transient ischemic attack (TIA), liver disease, hepatitis or cirrhosis, kidney disease, arthritis or rheumatism, osteoarthritis or degenerative arthritis, migraines or severe headaches, asthma, chronic lung disease (COPD), chronic bronchitis or emphysema, diabetes or high blood sugar or sugar in your urine, cancer (other than non-melanoma skin cancer), depression, anxiety, alcohol or drug problem, sleep disorder, HIV or AIDS, spinal cord injury, multiple sclerosis, Parkinson’s Disease, epilepsy, and ALS (amyotrophic lateral sclerosis). We also included a count of the number of those conditions that were reported to limit the respondent’s current activities. Both number of conditions variables were recoded to 0, 1, 2, 3, 4, or 5 or more conditions.

Results

As seen in Table 1, means ranged from 49.10 to 49.41 for the GPH-4, GPH-2 and Global01, while means were 49.85 and 49.91 for the GMH-4 and GMH-2, respectively. Coefficient alpha for the GPH-2 was 0.73 (versus 0.81 for the GPH-4) and 0.81 for the GMH-2 (versus 0.86 for GMH-4). Marginal reliabilities were 0.79 for GPH-4, 0.70 for GPH-2, 0.55 for Global01, 0.86 for GMH-4, and 0.80 for GMH-2. The product-moment correlation of the GPH-2 with the GPH-4 was 0.94 and between the GMH-2 and GMH-4 was 0.97. The single item (Global01) correlated 0.80 with GPH-4 and 0.60 with GMH-4.

Table 1 Means, Standard Deviations, and Reliability Estimates for PROMIS Global Health Scales

Correlations of the global health scales with other PROMIS measures, the EQ-5D-3L, and the count of chronic condition variables are given in Table 2. The 2-item variants of the global health scales had the same pattern of correlations with other measures but they tended to be slightly smaller in magnitude. The largest correlation of the Global01, GPH-2 and GHP-4 was with physical function, and the largest correlation for the GMH-4 and GMH-2 was with depressive symptoms.

Table 2 Product-moment correlations with PROMIS Global Health Scales

Discussion and conclusions

The PROMIS Global Health (v 1.2) instrument contains one physical and one mental health scale. These scales were developed to be parsimonious generic self-report measures of health, consisting of 4 items each [11]. This study evaluates even briefer (2-item) versions of the scales. The 2-item scales had lower but acceptable levels of reliability (0.70 or above) for group-level comparisons [13]. These new variants also had similar but slightly smaller correlations with PROMIS health domain scores, the EQ-5D-3L, and chronic conditions. In addition, the benefit of using just two items rather than one is evident by comparing the GPH-2 with the “In general, how would you rate your health?” item (Global01) evaluated previously [6]. Marginal reliability was larger for the GPH-2 than for Global01. In addition, GPH-2 correlated more strongly with GPH-4, the PROMIS domain scores, the EQ-5D-3L, and count of chronic conditions than Global01 did. The global physical health forms are available for download, scoring, and electronic administration at http://www.healthmeasures.net/search-view-measures. The full names of the current versions are PROMIS Scale v1.2-Global Health Physical 2a and PROMIS Scale v1.2-Global Health Mental 2a.

A major advantage of these new 2-item scales is that they reduce the cost of use on national surveys by 50%. This represents substantial cost savings because adding a single item to a large cross-sectional population survey can cost as much as $100,000. Hence, briefer scales reduce the cost and burden of measuring global health. Thus, the two-item versions of global physical and mental health appear to be good options for estimating self-reported health in large sample surveys, including population-based public health surveys. These briefer variants of the PROMIS global health scales may also be useful for screening of patients in clinical practices analogous to what is done with the Dartmouth COOP charts [14]. Simple tools such as these brief measures increase the likelihood of successful integration and institutionalization by practices [15].

References

  1. 1.

    Cella, D., Riley, W., Stone, A., et al. (2010). Initial item banks and first wave testing of the patient-reported outcomes measurement information system (PROMIS) network: 2005-2008. J Clin Epidemiol, 63, 1179–1194.

  2. 2.

    Snyder, C. F., Aaronson, N. K., Choucair, A. K., Elliott, T. E., Greenhalgh, J., Halyard, M. Y., Hess, R., Miller, D. M., Reeve, B. B., & Santana, M. (2012). Implementing patient-reported outcomes assessment in clinical practice: A review of the options and considerations. Qual Life Res, 21(8), 1305–1314.

  3. 3.

    DeSalvo, K. B., Bloser, N., Reynolds, K., et al. (2006). Mortality prediction with a single general self-rated health question; a meta-analysis. J Gen Intern Med, 21, 267–275.

  4. 4.

    Riley, W. T., Rothrock, N., Bruce, B., Christodolou, C., Cook, K., Hahn, E. A., & Cella, D. (2010). Patient-reported outcomes measurement information system (PROMIS) domain names and definitions revisions: Further evaluation of content validity in IRT-derived item banks. Qual Life Res, 19(9), 1311–1321.

  5. 5.

    Stewart, A. L., Hays, R. D., & Ware, J. E. (1992). Health perceptions, energy/fatigue, and health distress measures. In A. L. Stewart & J. E. Ware (Eds.), Measuring functioning and well-being: The medical outcomes study approach. Durham, NC: Duke University Press.

  6. 6.

    Hays, R. D., Spritzer, K. L., Thompson, W. W., et al. (2015). U.S. general population estimate for “excellent” to “poor” self-rated health item. J Gen Intern Med, 30, 1511–1516.

  7. 7.

    Hays, R. D., Reise, S., & Calderón, J. L. (2013). How much is lost in using single items? J Gen Intern Med, 27, 1402–1403.

  8. 8.

    Hays, R. D., Liu, H., & Kapteyn, A. (2015). Use of internet panels to conduct surveys. Behav Res Methods, 47(3), 685–690.

  9. 9.

    Liu, H. H., Cella, D., Gershon, R., Shen, J., Morales, L. S., Riley, W., & Hays, R. D. (2010). Representativeness of the PROMIS internet panel. J Clin Epidemiol, 63(11), 1169–1178.

  10. 10.

    Revicki, D. A., Kawata, A. K., Harnam, N., Chen, W.-H., Hays, R. D., & Cella, D. (2009). Predicting EuroQol (EQ-5D) scores from the patient-reported outcomes measurement information system (PROMIS) global items and domain item banks in a United States sample. Qual Life Res , 18, 783–791.

  11. 11.

    Hays, R. D., Bjorner, J., Revicki, D. A., et al. (2009). Development of physical and mental health summary scores from the patient-reported outcomes measurement information system (PROMIS) global items. Qual Life Res, 18, 873–880.

  12. 12.

    Cronbach, L. J. (1951). Coefficient alpha and the internal structure of tests. Psychometrika, 16, 297–334.

  13. 13.

    Nunnally, J. C. (1978). Assessment of reliability. In: Psychometric theory (2nd ed.). New York: McGraw-Hill.

  14. 14.

    Nelson, E. C., Wasson, J. H., Johnson, D. J., & Hays, R. D. (1996). Dartmouth COOP functional health measurement charts: Brief measures for clinical practice. In B. Spilker (Ed.), Quality of life and Pharmacoeconomics in clinical trials (2nd ed., pp. 161–168). New York: Lippincott-Raven Publishers.

  15. 15.

    Wasson, J., Keller, A., Rubenstein, L., Hays, R. D., Nelson E., Johnson, D. & Dartmouth primary care COOP staff. (1992). Benefits and obstacles of health status assessment in ambulatory settings: The clinician’s point of view. Med Care, 30, 42–49s.

Download references

Acknowledgements

Victor Gonzalez provided administrative assistance.

Funding

Preparation of this paper was supported in part by grants from NCI (No. 1U2C-CA186878-01), the NIA (No. P30-AG021684), and the NIMHD (No. P20-MD000182).

Authors’ contributions

RDH supervised the analyses, wrote the first draft, and revised the manuscript based on feedback from the coauthors. KLS conducted the analyses. KLS, BDS and DC provided suggestions on the analyses and edits to the manuscript. All authors read and approved the final manuscript.

Author information

Correspondence to Ron D. Hays.

Ethics declarations

Ethics approval and consent to participate

The study was conducted in accordance with the Declaration of Helsinki and patients provided informed consent to participate.

Competing interests

The authors have no conflicts of interests associated with this manuscript.

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Open Access This article is distributed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made.

Reprints and Permissions

About this article

Verify currency and authenticity via CrossMark

Keywords

  • PROMIS®
  • Global health
  • Patient-reported outcomes