Skip to main content

Measuring value in healthcare from a patients’ perspective

Introduction

Throughout the world there is a growing recognition that the patient’s perspective is highly relevant to efforts to deliver high-value patient-centered care and to improve the quality and effectiveness of healthcare. One of the key challenges to achieving this is the limited measurement of outcomes that matter most to patients. At an OECD conference in 2017, Ministers of Health from around the world stated, “We need to invest in measures that will help us assess whether our health systems deliver what matters most to people” [1]. The introduction of patient-reported outcome measures (PROMs)—measurement instruments designed to assess the status of a patient’s health condition that comes directly from the patient [2]—is one strategy to ensure that patient’s perspectives are systematically incorporated into the approaches of delivering healthcare services, and valuing the performance of the healthcare system [3,4,5,6]. PROMs could act to improve the quality of care in the same way as any other benchmarking tool [7], and some suggest that PROMs have the potential to transform healthcare [3].

There has been an increased use of PROMs in health systems around the world, a movement that started and has been led by the National Health System (NHS) in the UK [7]. In Canada, the Canadian Institute for Health Information (CIHI) and the Alberta PROMs and EQ-5D Research and Support Unit (APERSU) are leading similar efforts to establish national and provincial PROMs strategies, and support the use of PROMs in the Canadian healthcare system [8, 9].

The Alberta context

The province of Alberta is home to nearly 4.4 million Canadians, and, like Canada’s other provinces and territories, has a publicly funded healthcare system. Alberta Health Services (AHS) is the organization through which the provincial health ministry (Alberta Health) provides health care to Alberta residents. AHS is Canada’s first and largest province-wide fully integrated health system, is the provincial organization responsible for delivery of hospital, long-term care and community health care services to Albertans. AHS is the largest employer in Alberta with over 103,000 direct employees and thousands of other affiliated healthcare personnel and volunteers, with an annual operating budget for 2019–2020 fiscal year of $15.4 billion CAD [10].

AHS monitors the performance of the health system using 13 performance measures grouped into four categories: (1) improving patients and families experiences; (2) improving patient and population health outcomes; (3) improving the experience and safety of AHS employees; and (4) improving financial health and value for money [11]. AHS, like many other healthcare systems, collects large amounts of healthcare data to inform various performance measures; however, what is often lacking is understanding how the system is performing from a patients’ perspective. In order to meaningfully assess value, measuring outcomes—especially those that matter to patients—is imperative. As such, PROMs have been increasingly playing a crucial role in outcome measurement within the Alberta healthcare system.

AHS has embarked on a data acquisition strategy across the domains of the triple aim framework: improving the health of populations, improving the patient experience, and reducing per capita cost of care [12]. PROMs add a critical dimension by measuring outcomes from the patient’s perspective, which allow us to assess what we produce in terms of health impact based on what matters most to patients, not just healthcare utilization. Additionally, PROMs align with key foundational strategies for AHS, especially the patient and family first strategy that strives to ensure practices place families and patients at the centre of all activities and improves their health and wellness [13]. Hearing directly from patients on outcomes and experiences of health system encounters is key to that strategy.

AHS has supported the use of PROMs within the healthcare system first by selecting and endorsing the EQ-5D (Additional file 1) as the generic PROM for use in Alberta in 2015, and embedding the ability to capture the EQ-5D and other PROMs in Connect Care, the province-wide electronic patient medical information system. Among commonly available generic PROMs, the EQ-5D was selected by AHS for 4 main reasons: (1) evidence of adequate measurement properties in most applications (also recognizing expected improvements with the new 5-level version); (2) Canadian preference-based scoring function for application in economic/value-based evaluations; (3) brevity; 4: local expertise to provide support to end-users in the province. To this fourth point, AHS partnered with the EuroQol Research Foundation, the developer of EQ-5D instruments, and supported the establishment of a centre of excellence at the University of Alberta called Alberta PROMs and EQ-5D Research and Support Unit (APERSU) to support and enhance the use of PROMs in Alberta’s healthcare system, and conduct research to inform local implementation of PROMs programs and strategies.

The standardization of generic PROM measurement in Alberta, enabling systematic measurement through patient’s electronic medical record, developing provider buy-in and resource investment, and the establishment of a local center of excellence supporting PROMs end-users have accelerated and advanced the use of PROMs in various clinical settings in our province, which will allow sharing data on outcome more efficiently as well as comparisons that will accelerate care improvement. Currently, the EQ-5D, along with disease-specific PROMs in some clinical areas are being widely collected across the healthcare system. PROMs implementation varies across clinical settings, with varying levels of integration into clinical workflows, and data use at the micro, meso and macro levels within the system [14].

PROMs and value-based care

Health systems tend to be held to account for outcomes that are administrative in nature, such as balancing budgets, improving wait time improvements, service volume targets, or adding health care capacity. The use of PROMs enables the system to move closer to managing outcomes as opposed to administrative activities. There is a lot of focus on cost in Alberta’s health system given the fiscal challenges. Alberta went from being one of the lowest spending provinces on health care in the 1990’s to one of the highest, with an average health spending of $7658 CAD per person in 2019, and projections of continued increase over the coming years [15]. We need to examine costs together with outcomes, as a cost without an outcome is interesting at best. The movement to capturing outcomes and cost will lead to much better judgements on where to reduce expenditures. PROMs provide a valuable source of evidence to complement and enhance outcome measurement frameworks that will help establish whether the Alberta healthcare system services are effective and a good value-for-money from patients’ perspectives.

Funding systems may also be tied to outcomes. Alberta funding mechanisms are largely based on global budgets and Fee For Service funding systems [16]. As we develop PROMs there is an opportunity to enhance and incentivise funding systems that promote outcomes. For instance, PROMs data being collected in the system could be used in evaluating, monitoring, and improving provider performance, setting performance standards and benchmarks, and identifying the poorest and best performing providers. This in turn would inform funding systems, and enhance value-based care. Ultimately the health care system goal to enable longer and better quality of lives and that goal can be better gauged with the formal use PROMs.

Final remarks

Despite successful PROMs implementation by many users within the Alberta health system and significant investment from the provincial healthcare system, several operational and methodological challenges continue to exist. Investigating the best approaches of collecting PROMs data including timing and frequency of data collection in various clinical areas, exploring effective ways of interpreting and reporting PROMs data to clinicians and patients, using PROMs data to support performance evaluation and value of care, and identifying the most appropriate risk-adjustment methods, as well as exploring methods for using PROMs to support decision-making around healthcare planning and resource allocation are areas that require further investigation and development. We continue our efforts alongside leading PROMs researchers and stakeholders in our province alongside national and international collaborators to address these questions and support initiatives to generate evidence to further enhance the use of PROMs within healthcare systems in Canada and internationally.

In this supplement, we share eight papers starting with one introducing a multi-level approach that we have adopted for the use of PROMs data within the healthcare system in Alberta, followed by a paper on a strategy for the selection of PROMs for their use in health systems, and then a series of papers reporting on the implementation of PROMs in various clinical settings within the healthcare system in Alberta. This supplement is complemented by a closing commentary by PROMs leaders at the Canadian Institute of Health Information (CIHI) highlighting national PROMs initiatives, and a look into the future for using PROMs in Canada.

Availability of data and materials

Not applicable.

Abbreviations

OECD:

Organization for Economic Cooperation and Development

PROMs:

Patient-reported outcome measures

AHS:

Alberta health services

APERSU:

Alberta PROMs and EQ-5D Research and Support Unit

CIHI:

Canadian Institute of Health Information

References

  1. OECD (2017) Recommendations to OECD Ministers of Health from the high level reflection group on the future of health statistics: Strengthening the international comparison of health system performance through patient-reported indicators. OECD

  2. Canadian Institute for Health Information (2015) Patient reported outcome measures. https://www.cihi.ca/en/health-system-performance/quality-of-care-and-outcomes/outcomes/patient-reported-outcome-measures. Accessed August 26, 2021

  3. Black N (2013) Patient reported outcome measures could help transform healthcare. BMJ 346:167

    Article  Google Scholar 

  4. National Quality Forum (2013) Patient reported outcomes (PROs) in performance measurement. National Quality Forum, Washington DC

    Google Scholar 

  5. Greenhalgh J et al (2018) How do aggregated patient-reported outcome measures data stimulate health care improvement? A realist synthesis. J Health Serv Res Policy 23(1):57–65

    Article  Google Scholar 

  6. Squitieri L, Bozic KJ, Pusic AL (2017) The role of patient-reported outcome measures in value-based payment reform. Value Health 20(6):834–836

    Article  Google Scholar 

  7. Devlin N, Appleby J (2010) Getting the most out of PROMs: putting health outcomes at the heart of NHS decision-making. The King’s Fund and The Office Health Economics: London

  8. (CIHI) C.I.f.H.I. (2015) Patient reported outcome measures. [cited 2016 September 30 ]; https://www.cihi.ca/en/health-system-performance/quality-of-care-and-outcomes/outcomes/patient-reported-outcome-measures. Accessed August 26, 2021

  9. (APERSU) A.P.a.E.-D.R.a.S.U. (2015) Alberta PROMs and EQ-5D research and support unit (APERSU). [cited 2016 September 30]; www.apersu.ca. Accessed August 26, 2021

  10. Services, A.H. About AHS. [cited 2020 December 8]; Available from: https://www.albertahealthservices.ca/about/about.aspx. Accessed August 26, 2021.

  11. Services AH (2017) AHS 2017–2020 public performance measure definitions.

  12. Improvement IfH (2021) The IHI Triple Aim. [cited 2020 December 8]; http://www.ihi.org/Engage/Initiatives/TripleAim/Pages/default.aspx. Accessed August 26, 2021

  13. Services AH (2021) Patient first strategy. https://www.albertahealthservices.ca/info/Page11981.aspx. Accessed August 26, 2021

  14. Al Sayah F et al (2020) Enhancing the use of patient-reported outcome measures (PROMs) in the healthcare system in Alberta. Alberta PROMs and EQ-5D research and support unit (APERSU): Edmonton, AB. https://apersu.ca/wp-content/uploads/2020/09/APERSU-PROMs-White-Paper.pdf Accessed August 26, 2021

  15. Information CIfH (2019) National health expenditure trends, 1975 to 2019. CIHI

  16. Services AH (2021) Updates to AHS Physician Compensation. https://www.albertahealthservices.ca/medstaff/Page16919.aspx. Accessed August 26, 2021

Download references

Acknowledgements

Not applicable.

About this supplement

This article has been published as part of Journal of Patient-Reported Outcomes Volume 5, Supplement 2 2021: The Use of PROMs in Health Systems – Implementation Stories from Alberta, Canada. The full contents of the supplement are available at https://jpro.springeropen.com/articles/supplements/volume-5-supplement-2.

Funding

Article processing fees for the publication of this supplement were paid by a grant from the EuroQol Research Foundation to Alberta PROMs and EQ-5D Research and Support Unit (APERSU), University of Alberta. Authors received no direct remuneration.

Author information

Authors and Affiliations

Authors

Contributions

SD wrote the first draft of this paper, with significant contributions by FAS and JAJ. All authors reviewed and approved the final draft.

Corresponding author

Correspondence to Jeffrey A. Johnson.

Ethics declarations

Ethics approval and consent to participate

Not applicable.

Consent for publication

Not applicable.

Competing interests

The authors declare that they have no competing interests.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Supplementary Information

Additional file 1

. Appendix: EQ-5D-5L Instrument.

Rights and permissions

Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Dean, S., Al Sayah, F. & Johnson, J.A. Measuring value in healthcare from a patients’ perspective. J Patient Rep Outcomes 5 (Suppl 2), 88 (2021). https://doi.org/10.1186/s41687-021-00364-4

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1186/s41687-021-00364-4