Skip to main content
Journal of Patient-Reported Outcomes
Download PDF
Download ePub
  • Short report
  • Open access
  • Published:

Changes in the ability to participate in and satisfaction with social roles and activities in patients in outpatient rehabilitation

Journal of Patient-Reported Outcomes volume 4, Article number: 73 (2020) Cite this article

Abstract

Background

One of the main aims of rehabilitation is to improve participation. Patient-Reported Outcomes Measurement Information System (PROMIS®) item banks ‘Ability to Participate in Social roles and Activities, (PROMIS-APS) and ‘Satisfaction with Social Roles and Activities’ (PROMIS-SPS) are promising options to measure participation, but the literature on PROMIS measures of (satisfaction with) participation across diagnoses in rehabilitation is limited. Therefore, the objective of this study was to describe levels of and changes in participation, as assessed with the PROMIS-APS and the PROMIS-SPS short forms, of patients in outpatient rehabilitation.

Methods

This study had quantitative, observational design with assessments at admission and discharge. Consecutive patients treated between April and August 2018 receiving outpatient multidisciplinary rehabilitation were the population of this study. The following diagnosis categories were included: brain injury (e.g. stroke), spinal cord and nerve injury, neuromuscular disorder (e.g. lateral sclerosis), amputation, musculoskeletal condition (e.g. osteoarthritis) or heart or lung disease (e.g. myocardial infarction, chronic obstructive pulmonary disease). The main patient-reported outcomes (PRO) of this study were the short form of the PROMIS-APS (8 items, Dutch general population reference score 50.6 [SD 9.5]), and PROMIS-SPS (8 items, Dutch general population reference score 47.5 [SD 8.3].

Results

Of the 1279 patients invited, 777 (61%) completed the online forms at admission. Of those, 329 patients were invited at discharge, with 209 (64%) completing the forms. The mean (SD) T-scores of the PROMIS-APS and PROMIS-SPS were lower at admission (42.7 [SD 7.4]; (41.4 [SD 7.7]) and discharge (43.6 [SD 7.2]; (43.7 [SD 7.8]) than the Dutch general population. The change scores of the PROMIS-APS and PROMIS-SPS were 1.2 (95% CI 0.4–1.9; p = 0.004; effect size 0.16), and 2.4 (95% CI 1.6–3.2; p < 0.0001; effect size 0.31), respectively. In all diagnostic subgroups with > 30 paired measurements statistically significant improvements of PROMIS-APS, PROMIS-SPS or both were seen.

Conclusions

Patients undergoing outpatient rehabilitation had, both at admission and discharge, considerably lower PROMIS-APS and PROMIS-SPS T-scores short forms than the general Dutch population, and showed small T-score improvements at discharge.

Background

One of the primary aims of outpatient rehabilitation is improving activities of daily living and participation of patients with disabilities [1]. Personal goals of patients are often not only formulated in terms of alleviating impairments or limitations of activities, but in improving participation as well [2, 3]. In rehabilitation, activities and participation are often conceptualised according to the International Classification of Functioning Disability and Health (ICF) of the World Health Organisation (WHO) [4]. In that classification, participation is defined as “Involvement in a life situation”. Studies have shown that participation is strongly related to health related quality of life and well-being [5, 6].

To compare the effectiveness of rehabilitation across conditions or across rehabilitation centres or to relate the outcomes of rehabilitation to its costs (i.e. value based healthcare principles [7]), measurement instruments for participation should have adequate measurement properties. That is, these measurement instruments should be reliable, valid, responsive and change scores should be interpretable. Determining such properties of a measurement instrument for participation is however not easy, as previous research showed that participation is a difficult construct [8]. It encompasses a diversity of subdomains, such as paid work, sports or recreational activities, that might not be applicable or relevant to every individual subject [9].

Promising new methods to measure participation are instruments based on Item Response Theory (IRT) as they can be applied as short forms or Computer Adaptive Tests (CATs), resulting in less completion burden for patients. For participation this is for instance constituted by the IRT-based Patient-Reported Outcomes Measurement Information System (PROMIS®) v2.0 item bank ‘Ability to Participate in Social Roles and Activities’ (PROMIS-APS) and the v2.0 item bank ‘Satisfaction with Social Roles and Activities’ (PROMIS-SPS). A primary assumption of IRT is that the construct is unidimensional. Despite the above-mentioned challenges with the construct of participation, previous research found that the PROMIS-APS and PROMIS-SPS, show sufficient measurement properties including unidimensionality and reference scores have been determined recently [10, 11].

Although there is experience with PROMIS measures in rehabilitation (e.g. [12, 13]), the literature on PROMIS measures of (satisfaction with) participation across diagnoses in rehabilitation is limited. Therefore, the objective of this study was to describe levels of and changes in participation, as assessed with the PROMIS-APS and the PROMIS-SPS short forms, of patients in outpatient rehabilitation. Our hypothesis was that patients starting outpatient rehabilitation would have lower levels of participation compared to the general population and that they would improve considerably after outpatient rehabilitation.

Methods

Study design and setting

This observational study, used data that were routinely gathered in the context of care provided in a rehabilitation centre with two locations. The need for full medical ethical review and informed consent was waived according to Dutch Law as it concerned the voluntary completion of a concise questionnaire embedded in routine care [14]. The study was carried out in accordance with Dutch legislation regarding the storage and processing of patients’ personal data and in accordance with the Declaration of Helsinki [15].

All consecutive patients starting outpatient rehabilitation between April 1st and August 31st 2018 received an invitation by e-mail to complete an online questionnaire at admission and discharge. No reminders were sent.

Demographic and clinical information was derived from the clinic’s registry and medical records. The diagnosis was categorized as follows: brain injury (e.g. stroke, traumatic brain injury), spinal cord and nerve injury, neuromuscular disorder (e.g. lateral sclerosis), amputation, musculoskeletal condition (e.g. osteoarthritis) or heart or lung disease (e.g. myocardial infarction, chronic obstructive pulmonary disease).

Daily clinical outpatient rehabilitation

In the current study, patients received multi-disciplinary outpatient rehabilitation in a large rehabilitation centre in the south-west part of the Netherlands, which is an urban area. By 2020 there are 18 medical specialist rehabilitation centres in the Netherlands, offering inpatient and outpatient rehabilitation [16]. Rehabilitation is accessible only after referral by a physician. Important criteria for admission include the need for multidisciplinary care and a potential for improvement in terms of return to society. Outpatient specialist rehabilitation includes, apart from medical care by a rehabilitation physician, care provided by the members of multidisciplinary team (consisting of physical and occupational therapists, social workers and psychologists) as required by the patient. Medical specialist rehabilitation treatment is included in the general medical insurance, and thus fully reimbursed.

Patient-reported outcome (PRO)

Social participation and satisfaction with participation

The main PROs of this study were the short forms of the PROMIS-APS and PROMIS-SPS item banks [10, 11]. The PROMIS-APS measures “the perceived ability to perform one’s usual social roles and activities”. All items refer to limitations. The PROMIS-SPS measures “satisfaction with performing one’s usual social roles and activities”. Both short forms consists of 8 items and response options are provided on a 5-point Likert scale. They do not refer to a time frame. A higher score represents better ability to participate or more satisfaction. Good measurement properties were reported for both short forms [10]. The general Dutch population had PROMIS-APS and PROMIS-SPS T-scores of 50.6 (standard deviation (SD) 9.5) and 47.5 (SD 8.3) respectively, which were used as reference scores in this study [10].

Statistical analysis

In order to determine the presence of selection bias with regard to those patients who did and did not complete all questionnaires, we compared the following characteristics of (1) patients who completed the measures both at admission and at discharge and patients (2) who completed the admission measures only: age, sex, diagnosis category, length of treatment, PROMIS-APS and PROMIS-SPS. Comparisons were done by means of Fisher’s Exact Test, Independent Samples T-test or Mann-Whitney U Test, where appropriate.

Mean changes between admission and discharge were computed with the 95% confidence interval with the paired Samples T-test or Wilcoxon Signed rank test, where appropriate. The effect size of the mean score difference was computed with Hedges’ gav with thresholds for small being 0.2, for moderate 0.5 and large for 0.8. Hedges’ gav is largely based on Cohen’s d but less biased leading to smaller effect sizes as it corrects for the fact that the measurements before and after rehabilitation are correlated within subjects [17, 18].

The mean changes between admission and discharge as well as the effect size were also carried out per diagnostic category if ≥30 paired measurements were available. Calculations of effect sizes and 95% confidence interval around effect sizes were performed using Excel [17]. All other analyses were done with SPSS Statistics, Version 22.0 [19].

Results

Of the 1279 patients invited, 777 completed the PROMIS-APS and PROMIS-SPS at admission (61% response rate). Of the 329 patients invited at discharge, 209 completed both short forms at discharge (64% response rate). Patients who completed both measurements were significantly older, had more often a musculoskeletal condition and longer treatment duration (Table 1), but they did not differ statistically significant with respect to PROMIS-APS and PROMIS-SPS admission scores (data not shown).

Table 1 Sociodemographic and disease characteristics and duration of treatment of patients
Full size table

The mean admission T-scores of the PROMIS-APS and the PROMIS SPS were 42.7 (SD 7.4) and 41.4 (SD 7.7), respectively, and about 1 SD below the general Dutch population reference T-scores [10]. The mean discharge T-scores of the PROMIS-APS and PROMIS-SPS were 43.6 (SD 7.2) and 43.3 (SD 7.8), respectively, and also below the general Dutch population reference T-scores.

The change in T-score on the PROMIS-APS was 1.2 (95% CI 0.4–1.9; p = 0.004) with an effect size of 0.16, and the change score on the PROMIS-SPS was 2.4 (95% CI 1.6–3.2; p < 0.0001) with an effect size of 0.31 (Table 2).

Table 2 PROMIS-APS and PROMIS-SPS T-scores at admission and discharge and change scores (T1 T0)
Full size table

Highest scores for both APS and SPS at admission were seen in the amputation group (44.0 ± 7.9 and 42.6 ± 8.1, n = 29) and lowest in the musculoskeletal disorder group (41.4 ± 6.8 and 40.9 ± 7.5, n = 81).

Discussion

We found small improvements of participation as assessed with the PROMIS-APS and PROMIS-SPS after rehabilitation. In our study, the PROMIS-APS and PROMIS-SPS short forms were completed online by more than half of the patients and about two thirds at discharge, without sending reminders. The finding that lower levels of participation were found at the start of outpatient rehabilitation may indicate that referring physicians and rehabilitation physicians were able to make an appropriate selection of patients for rehabilitation.

Although at discharge the observed levels were still lower than those of the general population, for both the PROMIS-APS and the PROMIS-SPS improvements were seen over time. Improvements of about 2 to 6 T-score points in PROMIS measures have been found to be minimally important to patients [20, 21], which means that improvements lower than 2 to 6 are on average not perceived as important improvement. Taking into account the effect size observed in the present study, in previous research, in a comparable patient group, comparable improvements were found with the Utrecht Scale for Evaluation of Rehabilitation-Participation (USER-P) subscale ‘satisfaction’ (effect size 0.31 vs 0.36) with the PROMIS-SPS [22]. However, larger changes were found with the USER-P subscale ‘restrictions’ compared to the PROMIS-APS (effect size 0.49 vs 0.16) [22]. These differences in effect sizes might be explained by the fact that the USER-P subscale ‘restrictions’ consists of items that are slightly more related to limitations of activities of daily living rather than participation in comparison to the PROMIS-APS. Outpatient rehabilitation may have more impact on limitations in daily living than participation. This does however not necessarily mean that the effect of rehabilitation is smaller or absent. It may be related to the fact that participation is a complex construct, which is influenced by many aspects, such as economic factors or social support. It may thus appear that it is easier to demonstrate the effect of rehabilitation within the domain impairments than participation [23]. Moreover, the patients’ perception of participation may change over time. In particular when the rehabilitation phase ends and patients are returning to their life situations, they may face challenges that increase with the number of roles patients are willing and/or able to take up or that patients became more aware of their participation restrictions.

Another possible explanation for the small improvements on the PROMIS-APS might be that improving participation may take more time than spent in outpatient rehabilitation. On the other hand, it is also possible that due to outpatient rehabilitation, patients became more aware of their participation restrictions. We thus need measurement instruments that are flexible to adjust to individual participation goals changing or emerging with time, it is clear that the (ecological) validity of the PROMIS-APS and PROMIS-SPS in rehabilitation warrants further research.

Although very relevant for clinical practice, it is difficult to draw conclusions on the extent to which rehabilitation actually has an impact on participation from the results of our study. Either the observed small changes on PROMIS-APS and PROMIS-SPS reflect true small changes in participation or the PROMIS-APS and PROMIS-SPS are insufficiently able to measure changes in participation. In the absence of a gold standard to reflect changes in participation a study including multiple other measures of participation would be needed to answer this question.

In this study, we used the PROMIS-APS and PROMIS-SPS short forms. We do however, recommend to use the PROMIS CATs in future research, as the CATs measure participation more precisely than the short forms [10]. A personalised PROMIS short form could also be considered, e.g. a short form consisting of the five most problematic items for the patient at issue, as rehabilitation treatment is focused on patient’s request for help and, therefore, tailor-made. The use of tailor-made short forms appeared to be feasible [24].

Study limitations

Despite the overall good response, fewer patients completed the forms at discharge as compared to admission. As patients who completed both measurements differed from those with one measurement, selection bias might hamper the generalisability of our findings. In particular, the number of patients at discharge were too low to calculate the effect size for four of the diagnostic categories. To improve the response rates we recommend to send reminders, and provide patients and healthcare professionals with feedback on their scores [25].

Another limitation is that it was not possible to determine responsiveness and interpretability of the PROMIS-SPS and PROMIS-APS as we did not include comparator instruments or an anchor question at follow-up. We therefore recommend for further research to study the responsiveness and interpretability of the PROMIS-SPS and PROMIS-APS and identify the Minimal Important Change using an anchor-based method.

Conclusions

Patients in outpatient rehabilitation have considerably lower levels of societal participation as compared to the general Dutch population, and show small improvements at discharge.

Abbreviations

ICF:

International Classification of Functioning

WHO:

World Health Organisation

IRT:

Item Response Theory

CAT:

Computer Adaptive Test

PROMIS:

Patient-Reported Outcomes Measurement Information System

PROMIS-APS:

Ability to Participate in Social Roles and Activities

PROMIS-SPS:

Satisfaction with Social Roles and Activities

PRO:

Patient-reported outcomes

SD:

Standard Deviation

USER-P:

Utrecht Scale for Evaluation of Rehabilitation – Participation

References

  1. Wade, D. T., & de Jong, B. A. (2000). Recent advances in rehabilitation. BMJ, 320(7246), 1385–1388.

    Article  CAS  Google Scholar 

  2. Leach, E., et al. (2010). Patient centered goal-setting in a subacute rehabilitation setting. Disabil Rehabil, 32(2), 159–172.

    Article  Google Scholar 

  3. van Seben, R., Smorenburg, S. M., & Buurman, B. M. (2019). A qualitative study of patient-centered goal-setting in geriatric rehabilitation: Patient and professional perspectives. Clin Rehabil, 33(1), 128–140.

    Article  Google Scholar 

  4. World Health Organization (WHO). (2001). International classification of functioning, disability and health: ICF. Geneva: World Health Organization.

  5. van der Holst, M., et al. (2018). Participation restrictions among adolescents and adults with neonatal brachial plexus palsy: The patient perspective. Disabil Rehabil, 40(26), 3147–3155.

    Article  Google Scholar 

  6. Douglas, H., Georgiou, A., & Westbrook, J. (2017). Social participation as an indicator of successful aging: An overview of concepts and their associations with health. Aust Health Rev, 41(4), 455–462.

    Article  Google Scholar 

  7. Porter, M. E. T. (2006). E. O., Redefining Health Care - Creating Value-Base Competition On Results. USA: Harvard Business Review Press.

    Google Scholar 

  8. Eyssen, I. C., et al. (2011). A systematic review of instruments assessing participation: Challenges in defining participation. Arch Phys Med Rehabil, 92(6), 983–997.

    Article  Google Scholar 

  9. de Wind, A., et al. (2019). A qualitative study investigating the meaning of participation to improve the measurement of this construct. Qual Life Res, 28(8), 2233–2246.

    Article  Google Scholar 

  10. Terwee, C. B., et al. (2019). Validation of two PROMIS item banks for measuring social participation in the Dutch general population. Qual Life Res, 28(1), 211–220.

    Article  CAS  Google Scholar 

  11. Hahn, E. A., et al. (2010). Measuring social health in the patient-reported outcomes measurement information system (PROMIS): Item bank development and testing. Qual Life Res, 19(7), 1035–1044.

    Article  Google Scholar 

  12. Liegl, G., et al. (2018). An initial psychometric evaluation of the German PROMIS v1.2 physical function item bank in patients with a wide range of health conditions. Clin Rehabil, 32(1), 84–93.

    Article  Google Scholar 

  13. Schalet, B. D., et al. (2018). Using PROMIS Pain Interference Items to Improve Quality Measurement in Inpatient Rehabilitation Facilities. J Am Med Dir Assoc, 19(10), 846–851 e2.

    Article  Google Scholar 

  14. Code of Conduct for Health reserach. Federa (Foundation Federation of Dutch Medical Scientific Societies), Rotterdam, the Netherlands. https://www.federa.org/sites/default/files/bijlagen/coreon/code_of_conduct_for_medical_research_1.pdf. Accessed Jan 2020.

  15. Declaration of Helsinki - Medical Research Involving Human subjects. World Medical Association, France. https://www.wma.net/what-we-do/medical-ethics/declaration-of-helsinki. Accessed Jan 2020. 

  16. Rehabilitation Netherlands. Available at www.revalidatienederland.nl Accessed 12th of May 2020.

  17. Lakens, D. (2013). Calculating and reporting effect sizes to facilitate cumulative science: A practical primer for t-tests and ANOVAs. Front Psychol, 4.

  18. Hedges, L. (1981). Distribution Theory for Glass’s Estimator of Effect Size and Related Estimators. J Educ Stat, 107–128.

  19. IBM SPSS Statistics version 22, New York, USA.

  20. Yost, K. J., et al. (2011). Minimally important differences were estimated for six patient-reported outcomes measurement information system-Cancer scales in advanced-stage cancer patients. J Clin Epidemiol, 64(5), 507–516.

    Article  Google Scholar 

  21. Lee, A. C., et al. (2017). Responsiveness and minimally important differences for 4 patient-reported outcomes measurement information system short forms: Physical function, pain interference, depression, and anxiety in knee osteoarthritis. J Pain, 18(9), 1096–1110.

    Article  Google Scholar 

  22. van der Zee, C. H., et al. (2011). Responsiveness of four participation measures to changes during and after outpatient rehabilitation. J Rehabil Med, 43(11), 1003–1009.

    Article  Google Scholar 

  23. Rice, D. B., et al. (2017). Patient-centered goal setting in a hospital-based outpatient stroke rehabilitation center. PM R, 9(9), 856–865.

    Article  Google Scholar 

  24. van der Meij, E., et al. (2018). Personalised perioperative care by e-health after intermediate-grade abdominal surgery: A multicentre, single-blind, randomised, placebo-controlled trial. Lancet, 392(10141), 51–59.

    Article  Google Scholar 

  25. Peters, M., et al. (2014). The routine collection of patient-reported outcome measures (PROMs) for long-term conditions in primary care: A cohort survey. BMJ Open, 4(2), e003968.

    Article  Google Scholar 

Download references

Acknowledgements

Not applicable.

Availability of data and material

The datasets used and/or analysed during the current study are available from the corresponding author on reasonable request.

Funding

No external funding received for this study.

Author information

Authors and Affiliations

  1. Basalt Rehabilitation, Leiden/The Hague, the Netherlands

    Sietske J. Tamminga, Félicie M. van Vree, Gerard Volker & Thea P. M. Vliet Vlieland

  2. Department of Orthopaedics, Rehabilitation and Physical Therapy, Leiden University Medical Center, Leiden, the Netherlands

    Sietske J. Tamminga & Thea P. M. Vliet Vlieland

  3. Amsterdam Rehabilitation Research Center, Amsterdam, the Netherlands

    Leo D. Roorda

  4. Department of Epidemiology and Biostatistics, Amsterdam UMC, Vrije Universiteit Amsterdam, Amsterdam, the Netherlands

    Caroline B. Terwee

  5. Merem Rehabilitation, Lelystad, the Netherlands

    Paulien H. Goossens

Authors
  1. Sietske J. Tamminga
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Félicie M. van Vree
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Gerard Volker
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Leo D. Roorda
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Caroline B. Terwee
    View author publications

    You can also search for this author in PubMed Google Scholar

  6. Paulien H. Goossens
    View author publications

    You can also search for this author in PubMed Google Scholar

  7. Thea P. M. Vliet Vlieland
    View author publications

    You can also search for this author in PubMed Google Scholar

Contributions

FV, PG, TV designed the study. FV and PG were responsible for data collection. GV analysed the data. ST drafted the manuscript which was critically revised by all authors. All authors interpreted the data and approved the final manuscript.

Corresponding author

Correspondence to Sietske J. Tamminga.

Ethics declarations

Ethics approval and consent to participate

This observational study, used data that were routinely gathered in the context of care provided in a rehabilitation center with two locations. The need for full medical ethical review and informed consent was waved according to Dutch Law as it concerned the voluntary completion of a concise questionnaire embedded in routine care. The study was carried out in accordance with Dutch legislation regarding the storage and processing of patients’ personal data and in accordance with the Declaration of Helsinki.

Consent for publication

Not applicable.

Competing interests

Caroline B. Terwee is president of the PROMIS health organization and the Dutch-Flemish PROMIS group. Leo D. Roorda is member of the PROMIS health organization and the Dutch-Flemish PROMIS group. All authors have no financial or non-financial conflict of interest.

Additional information

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Tamminga, S.J., van Vree, F.M., Volker, G. et al. Changes in the ability to participate in and satisfaction with social roles and activities in patients in outpatient rehabilitation. J Patient Rep Outcomes 4, 73 (2020). https://doi.org/10.1186/s41687-020-00236-3

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1186/s41687-020-00236-3

Keywords