Skip to main content
Journal of Patient-Reported Outcomes
Download PDF

Collection and use of EQ-5D for follow-up, decision-making, and quality improvement in health care - the case of the Swedish National Quality Registries

Journal of Patient-Reported Outcomes volume 4, Article number: 78 (2020) Cite this article

Abstract

Background

The Swedish National Quality Registries (NQRs) contain individual-level health care data for specific patient populations, or patients receiving specific interventions. Approximately 90% of the 105 Swedish NQRs include any patient-reported outcome measure, with EQ-5D being the most common. As there has been no general overview of EQ-5D data within the NQRs, this study fills a knowledge gap by reporting how the data are collected, presented, and used at different levels of the Swedish health care system.

Methods

All 46 NQRs with a license for the use of EQ-5D were included. Information was retrieved from the registries’ annual reports or from websites, using a template that was subsequently sent to each registry for completion and confirmation. If considered necessary, the contact was followed-up with an interview, either in-person or over the telephone. The uses of EQ-5D were categorised as denoting usage for follow-up, decision-making, or quality improvement in Swedish health care.

Results

In total, 41 of the 46 licensed registries reported collection of EQ-5D data. EQ-5D is most commonly collected within registries related to the musculoskeletal system, but it has a wide application also in other disease areas. Thirty-six registries provide EQ-5D results to patients, clinicians, or other decision-makers. Twenty-two of the registries reported that EQ-5D data are being used for follow-up, decision-making or quality improvement. The registries most commonly reported use of data for assessing interventions, and in quality indicators to follow-up the quality of care at a national level.

Conclusion

Collection and use of EQ-5D data vary across the Swedish NQRs, which may partly be accounted for by the different purposes of the registries. The provided examples of use illustrate how EQ-5D data can inform decisions at different levels of the health care system. However, there is potential for improving the use of EQ-5D data.

Background

There are 105 National Quality Registries (NQRs) in Sweden [1]. The registries contain structured health care data for specific patient populations, or patients receiving specific interventions. The data are collected and registered nationally by routine health care practice providers, for the purpose of monitoring and developing the quality of Swedish health care [2]. Many of the registries began as an initiative of one or several local health care professionals, either at a specific hospital or at a group of hospitals (the first one was in 1975) [2]. As years went by, more and more registries were launched, and eventually, the need for a national support organisation became evident. Registries now strive for a high affiliation of clinics, as well as high and complete coverage of eligible patients.

The Swedish Government has supported the registries financially since 1990, and the registries are today jointly financed by the Swedish Government and the 21 health care regions that have the main responsibility for providing health care to their inhabitants in the highly decentralised Swedish health care system [2]. In order to receive financial support, the registries are required to take part in an annual monitoring process, and the financial support has to be approved by an Executive Committee [1]. Each registry is supported by an inter-professional team of health care professionals and researchers, with patient representatives also often included [2]. However, the registries have different purposes and needs, which influence their organisation and structure.

From their commencement, the registries have focused on clinical measures such as survival, complications, and other clinical signs of disease progression in the follow-up of health care [2]. However, it has become more common to include one or more patient-reported outcome measures (PROMs). PROMs are standardised self-reported measures that are typically developed to capture a person’s perspective on outcomes related to their health status or health-related quality of life (HRQoL), such as symptoms, functioning, overall health, or well-being [3].

Several potential uses of PROMs in clinical practice have been identified [4,5,6,7,8]. At an individual level, PROMs may, for example, be used as a screening tool (e.g. to detect depression or anxiety), to monitor effects of a patient’s treatment, and/or to get patients more involved in decisions regarding their own care (shared decision-making) [4, 6]. In addition, results on an aggregated level may be used in decision aids, to provide patients and health care professionals with information regarding the impact of different treatment options, to inform health technology assessments or reimbursement decisions regarding the effectiveness of health care interventions, to evaluate the quality of care within a practice, and/or to enable providers to benchmark their performance with others [5, 7, 8].

In a previous review, it was reported that almost 90% of the NQRs have included at least one PROM [9]. The most commonly collected PROM was EQ-5D. EQ-5D is a measure of health, and consists of two parts: a questionnaire with five items (the descriptive system) that can be summarised in a health profile; and a visual analogue scale (EQ VAS) that patients may use to rate their own health on a scale between 0 (worst imaginable health) and 100 (best imaginable health) [10, 11]. The five items in the descriptive system each represent a dimension of a person’s health status; mobility, self-care, usual activities, pain/discomfort, and anxiety/depression. There are currently two different versions for adults (EQ-5D-3L and EQ-5D-5L), and a child-friendly version for children and adolescents (EQ-5D-Y). The difference between the two versions for adults is mainly the number of response levels on each question (three or five), but the questions have also been slightly modified in the newest version (EQ-5D-5L) [12]. The responses to the five questions may be converted to an index value that can be used for calculating quality-adjusted life years (QALYs), which is the recommended health outcome measure used in cost-effectiveness analyses of health care interventions in many countries [13, 14]. The index values are obtained from existing value sets that are typically developed for reimbursement purposes in each specific country. EQ-5D value sets have been derived and published for many countries worldwide [15].

The implementation and use of PROMs in clinical practice is associated with several challenges [16,17,18,19,20,21]. These challenges include: the patients’ willingness to respond to topics addressed in different PROMs; choosing the most adequate PROM; interpreting results; skepticism regarding their usefulness and associated workload; and how the measurements fit into the way the care is organised, including (IT) infrastructure. More generally, low interpretability of output data (e.g. by patients and care givers), as well as survey fatigue, have been identified as barriers to the use of clinical registry data in quality improvement, research, and interactions with patients [22]. Altogether, these findings highlight the importance of not only focusing on the data collection when exploring the implementation of PROMs in routine health care, but also the need to study the actual use of PROMs, and their implications in terms of improvement of patient care and/or health outcomes.

Experiences from some previous large-scale initiatives for implementing PROMs in routine care settings have been described in the literature [21, 23]. Nevertheless, reports of real-world implementation initiatives are still limited [5, 24, 25]. Studying the collection and use of EQ-5D within the Swedish NQRs represents a unique opportunity to learn from a real-world case of a large-scale application of a specific PROM in routine health care. There has so far been no overview available on how these registries collect and use the EQ-5D data. This study fills the gap by reporting how EQ-5D data are collected, presented, and used at different levels of the Swedish health care system. The results can be useful for clinicians, researchers, and decision-makers at different levels of the health care system in Sweden, and in other countries, who may learn from the experiences and progress of the Swedish national quality registries.

Methods

The aim of the study was to increase knowledge on how EQ-5D data are collected within the Swedish NQRs, and how the data are made available and are being used in the Swedish health care system. All 46 registries with a license to use EQ-5D at the point of data collection were included. Ten of these NQRs were sub-registries within the Swedish Neuro Registries.

Information concerning each registry was based on information available online, as well as on personal communications with representatives from all 46 registries. The representatives were persons engaged in the management and/or development of the registry, for example as registry holder or being involved in the registry’s work with PROMs and/or PREMs.

Prior to the data collection, a template including questions regarding the registries’ collection and use of EQ-5D was developed by the authors (Table S1). The questions concerned characteristics of the registry in general, the collection of PROM data, and specifically EQ-5D data, administration of the PROM instruments, and use of PROM data for quality improvement and decision-making. The template was completed with information from the registries’ annual reports and/or websites, and sent by e-mail to a representative from each registry for confirmation and completion. If considered necessary, the e-mail contact was followed up with additional questions over e-mail, or in an interview, either in-person or over the telephone. The information was retrieved between August 2018 and June 2019.

For each reported use of the data, the representatives were asked to provide examples of how EQ-5D data from their registry are being used for that purpose. Subsequently, the resulting comprehensive information was condensed and tabulated. The contact persons for each registry were given the opportunity to confirm the information regarding how EQ-5D data are collected (Table S2–S12), presented, and used (Table 2).

The registries were categorised into disease categories (e.g., cancer, circulatory system), based on a classification system developed by the Swedish Association of Local Authorities and Regions (SALAR) [1] (Table 1). The registries were also categorised depending on their purpose. A “diagnosis registry” was defined as a registry that follows patients based on a diagnosis, and an “intervention registry” as a registry that follows patients based on them having received a specific intervention. This categorisation was performed by the authors in dialogue with colleagues at the Quality Registry Centre (QRC) Stockholm, based on the collected information regarding the criteria for including patients in each registry.

Table 1 Swedish National Quality Registries collecting EQ-5D data, 2018
Full size table

The collected information regarding how EQ-5D data are made available was categorised to describe the different ways the results are provided to care givers, patients, and other decision-makers. The developed categories included feedback on an aggregated level, as well as on an individual level. Feedback on the aggregated level was categorised into feedback presented in: annual reports/websites; research publications; reports adapted for individual clinics, units, or teams; reports with patients as the target group; and other reports. Feedback on the individual level was categorised into: feedback directed to healthcare professionals entering data; and feedback to patients.

The use of the data was also categorised to describe how, and to what extent, the EQ-5D data are being used for follow-up, quality improvement, or decision-making at the individual level. The categories represent use in assessment of interventions, health economic studies, quality indicators, benchmarking, quality improvement, and in individual patient consultations. The categorisation was based on usage as defined by the representatives of the registries, but was modified by the authors in collaboration with the registries, using the information in the provided examples. For example, to be categorised as use in a quality indicator, the EQ-5D data from the registry had to be presented in a format that the registry or some other stakeholder defined as a quality indicator. In addition, we also required that the measure fulfilled some basic criteria in order to be defined as a quality indicator, i.e. that it represented a quantitative summary of health care data, had a clear direction of what indicates good or poor quality, and was relevant and important for improvement [2, 26]. The quality indicators could be based on outcome measures describing the health outcome of the patients (e.g. the patient’s responses to EQ-5D), or on process measures describing measurement and follow-up (e.g. the proportion of patients that are being followed-up with EQ-5D) [2].

To be defined as use in benchmarking, the usage reported by the registries had to represent a comparison of performance in terms of EQ-5D results between different health care providers, with the purpose of assessing the performance of each provider, and identifying needs for improvement [27]. These comparisons should preferably be case-mix adjusted, which means that the results have been adjusted for differences in the characteristics of the patient populations.

For the use of EQ-5D to be categorised as use in quality improvement, it was required that the registry representatives reported active use of EQ-5D data in efforts to improve the quality of care.

As it was found too difficult to separate the use of EQ-5D data for screening, monitoring, in decision aids, and for shared decision-making, these were combined in one category of use at an individual level, in patient consultations. Decision aids were defined as the presentation and use of individual or aggregated EQ-5D results to support health care professionals and/or patients in decisions regarding the individual patient’s care. Shared decision-making refers to the use of EQ-5D results in the discussion between a health care professional and a patient, with the purpose of encouraging patients to express their preferences regarding different treatment options, and to make decisions regarding their care, together with the care giver, based on the best available evidence [28].

Results

Collection of EQ-5D data

In total, EQ-5D data were collected in 41 of the 46 registries with a license for collection of EQ-5D (Table 1). EQ-5D data were most commonly collected in registries targeting conditions related to the musculoskeletal system, followed by those targeting conditions related to the nervous system, circulatory system, psychiatry, cancer, infections, paediatrics, obstetrics and gynaecology, stomach and intestines, endocrine organs, skin diseases, and rare diseases (see Table S2–S12 and Fig. 1). Fifteen of the registries with collection of EQ-5D data were intervention registries, and 26 were diagnosis registries (Table 1).

Fig. 1
figure 1

Number of registries collecting EQ-5D data (2018), per registry category

Full size image

The two registries that first initiated collection of EQ-5D data started in 1998 (Fig. 2). These registries were the Swedish Spine Register (SWESPINE), and the National Quality Registry for Rehabilitation Medicine (Webrehab Sweden). Since 2004, when the Swedish Elbow Arthroplasty Register and The Swedish Shoulder Arthroplasty Register started collecting EQ-5D data, the number of registries collecting EQ-5D has gradually increased. The National Quality Registry for Respiratory Diseases intended to start collecting EQ-5D data for both adults and children with asthma and chronic obstructive lung disease, but had not begun to at the time of analysis for this study. In addition, four of the ten sub-registries within the Neuro registries did not collect EQ-5D data.

Fig. 2
figure 2

Number of registries collecting EQ-5D-3L and EQ-5D-5L, per year (1998–2018)

Full size image

Twenty-three registries reported collection of EQ-5D-3L data, and 16 registries reported collection of EQ-5D-5L data. Further, one registry reported collection of EQ-5D-Y data, and one reported collection of both EQ-5D-3L and EQ-5D-Y data (Fig. 1, Table S2–S12). Among the registries collecting EQ-5D-5L data, seven registries had changed from EQ-5D-3L in 2017 (n = 6) or 2018 (n = 1). Five of these were registries within conditions related to the musculoskeletal system. All but four of the registries containing EQ-5D data have included EQ VAS since the start of EQ-5D collection. In one additional registry, the collection of EQ VAS started when changing to EQ-5D-5L in 2017.

The frequency of measurements varies between the registries. EQ-5D is either measured before and after interventions (n = 14), continuously at specific time points (n = 12), at baseline and at one or several follow-ups (n = 5), at one or several follow-ups without baseline (n = 3), once per patient (n = 3), at specific ages (n = 1), before injury (retrospectively) and at follow-up (n = 2), or whenever the patient wants to (n = 1). Among those measuring before and after intervention (n = 14), most registries reported having two or more follow-up measurements (n = 11). The registries with continuous measurements at specific time points (n = 12) were all diagnosis registries in which EQ-5D was measured every 6 months, annually, at each health care visit or health care contact, or every second or third year.

The most common mode of administration was to use paper questionnaires only (n = 20), followed by the use of either paper or web questionnaires (n = 10), web questionnaires only (n = 6), and either paper, web questionnaires, or interviews (n = 2). The remaining three registries reported collection of EQ-5D data using interviews (n = 1), paper questionnaires or interviews, (n = 1), or a paper questionnaire followed up with a telephone interview (n = 1).

The number of measurements ranged from approximately 60 individuals with EQ-5D measurements in the National Quality Registry for Atrial Fibrillation and Anticoagulation (AuriculA) (since year 2018), and in the Swedish Neuro Registry for Myasthenia Gravis (since year 2016), to more than 440,000 measurements in the Swedish Hip Arthroplasty Registry (since year 2008) (Table S2–S12).

Presentation of EQ-5D data

The registries reported that EQ-5D results are provided to care givers, patients, and other decision-makers through several channels. Aggregated EQ-5D results are most commonly made available through the registries’ annual reports or websites (n = 29) (for examples of visualizations, see [29,30,31]). However, it is also relatively common for the clinics’ own aggregated EQ-5D data to be presented in reports directed to each clinic or unit, and/or as feedback to professional teams (n = 20). In addition, several registries reported that the EQ-5D results have been included in scientific publications (n = 18).

Some registries reported that data on an individual patient level are made available to health care professionals (n = 17), and/or patients (n = 12), and that data on an aggregated level are made available to patients (n = 5), and/or in other types of reports (n = 6). Other types of reports include national online tools for monitoring health care, public reports to governmental agencies, master theses, or other publications regarding the health status of the patient group. Only five registries reported that they are not communicating EQ-5D data through any channel. Of these, four registries began collecting EQ-5D in 2016 or 2018.

Use of EQ-5D data for follow-up, quality improvement, and decision-making

Our study shows that the EQ-5D data from the registries are being used in quality indicators, for assessment and/or economic evaluations of interventions, for quality improvement, benchmarking, and/or in individual patient consultations (Table 2). The use of the data is described in more detail below. Representatives from 67% (10/15) of the intervention registries reported use of EQ-5D data (Table 2). The corresponding number for the diagnosis registries was 46% (12/26). Nevertheless, representatives from several registries reported that it is unclear if the data are being used for any purpose, or that it is not being used at all (n = 19). Four of these registries began collecting EQ-5D data in 2017 or 2018.

Table 2 Frequency of registries reporting use of EQ-5D data, per category of registry and category of use
Full size table

Use of EQ-5D data in assessment of interventions and health economic studies

Ten registries reported that the collected EQ-5D data are being used to assess health care interventions. For example, EQ-5D data from the National Quality Registry for Atrial Fibrillation and Anticoagulation (AuriculA) have been used in a study that aimed to assess the effectiveness and cost-effectiveness of a risk score-based treatment of patients with atrial fibrillation [32]. Furthermore, EQ-5D data from other registries have been used to assess the outcome of an osteoarthritis learning programme [33], biological treatment in psoriasis [34], pain rehabilitation [35], treatment of fractures [36], hip arthroplasty [37], shoulder arthroplasty [38], spine surgery [39], knee arthroplasty [30], foot surgery [40], and total ankle replacement [41, 42]. In addition to AuriculA, four registries (SQRP, Swespine, MMCUP, and NREV) described ongoing collaborations with health economists to investigate the health economic aspects of the disease, or specific interventions.

Use of EQ-5D data in quality indicators

In total, ten registries reported use of EQ-5D data in quality indicators (Table 3). The majority of the described quality indicators are based on the outcome results of EQ-5D, but there are also three examples utilising the number of EQ-5D measurements as a process-based quality indicator for assessment of the follow-up process. The quality indicators (either outcome- or process-based) are presented in the registries’ reports, at national platforms, or on online tools, such as “Health care in numbers” (“Vården i siffror”), or the SVEUS platform. “Health care in numbers” is a national online tool for quality improvement in Swedish health care. It is administrated by SALAR and financed by the 21 regions that are responsible for providing health care in Sweden [50]. SVEUS is a platform for real time follow-up of health care data, and it is a collaborative initiative between SALAR and the participating health care regions [45].

Table 3 Use of EQ-5D-data in quality indicators
Full size table

The outcome-based quality indicators are  most commonly based on the EQ-5D index values, or on results from EQ VAS. One of the registries has chosen to focus on one of the items (pain/discomfort) of the child-friendly version EQ-5D-Y as a quality indicator.

Use of EQ-5D data in benchmarking

Seven registries reported that their EQ-5D data are used for benchmarking (Table 4). Health care regions, or contributing units, are most commonly compared in terms of EQ-5D index values. In two cases, results from EQ VAS are compared. The comparisons are either presented on the registries’ web pages, in annual reports, in reports to the individual units, or through other portals such as “Health care in numbers” [50] or SVEUS [45]. Adjustments for differences in patient characteristics (case-mix) were only reported in two cases.

Table 4 Use of EQ-5D data for benchmarking
Full size table

Use of EQ-5D data for quality improvement

Six registries reported that EQ-5D data from their registry have been used for quality improvement (CPUP, MMCUP, BOA, Riksfot, SQRP, the Neuro registry for Motor Neuron Disease). However, quality improvement projects are most commonly initiated locally by the health care providers and the representatives for the registries could in most cases not provide detailed information regarding these initiatives.

Use of EQ-5D results during individual patient consultations

EQ-5D data from seven registries were reported as being used for screening and monitoring, as supporting clinical decisions for individual patients, and/or for shared decision-making during individual patient consultations (Table 5). For these purposes, the patients’ individual data are most commonly used, but there is also one example of aggregated data being used to inform how other patients have experienced their HRQoL after surgery (RiksFot).

Table 5 Use of EQ-5D results during individual patient consultations (with the purpose of screening, monitoring, decision aids and/or shared decision-making)
Full size table

Discussion

Main findings

This study presents a real-world case where a specific PROM has been implemented on a large scale in routine health care. It intends to contribute to the knowledge regarding routine collection of PROMs in clinical practice by describing how EQ-5D is collected, presented, and used for different purposes. Our findings indicate that EQ-5D is most commonly collected within registries related to the musculoskeletal system, and that it has a wide application among the disease areas covered by the registries. Data collection has increased continuously, with growing interest in EQ-5D-5L over the last 7 years.

Most registries provide some feedback regarding the results of the EQ-5D data collection to patients, clinicians, or other decision-makers, most commonly on an aggregated level. Individual responses are, to some extent, also made available to treating clinicians and/or the individual patients, e.g. for shared decision-making. The collected EQ-5D data are most commonly used for assessing interventions, and as quality indicators for following up the quality of care. The provided examples illustrate how the EQ-5D data can be analysed and summarised to provide information for decisions at different levels of the Swedish health care system.

Yet, there are areas for improvement to consider. Although EQ-5D outcomes are made available and are being used, it is, based on our findings, unclear whether the data influence actual health care decisions, and if such influence leads to better health outcomes. To improve the quality of care, information from quality indicators and benchmarking needs to be actively used in quality improvement efforts, which was reported by only a few of the registries. In addition, representatives from almost 50% of the registries reported that the EQ-5D data are not being used, or that they are unaware of whether the data are being used.

Interpretation of study findings and comparison to previous research

Limited use of PROMs data has previously been observed in initiatives for implementing PROMs in clinical practice [23]. Proposed explanations include a perception that the collected data are not fit for purpose, and that there are challenges associated with accessing, understanding and acting on the results [19]. Several authors have emphasised the importance of the collected data being perceived as relevant and meaningful by the health care personnel who invest their time and effort to collecting it [5, 20, 21, 53]. Thus, for a successful implementation in clinical practice, it has been recommended to have a clear goal when starting the collection, and to involve relevant stakeholders in the planning phase [21].

The incentives for including PROMs in the NQRs have, until recently, largely focused on whether PROM data are collected. In 2010, the collection of patient-reported measures became a requirement for the registries to reach a certain certification level [9]. As the certification level is linked to the financing of the registry [54], it has likely created an incentive for the registries to primarily initiate the collection of PROM data, which has also been mentioned by several of the registry representatives. Today, data collection from patient-reported measures is still a criterion in the certification process, but only if it is considered relevant to the scope of the registry [54]. More importantly, the revised criterion is focused on whether data from patient-reported measures are made publicly available.

Since 2014, the registries also need to specify how PROM data are used for quality improvement in their annual funding applications submitted to SALAR [9]. However, this is usually a result of local initiatives and, as supported by our findings, the registries may be unaware whether the data are used for quality improvement or not. Notably, several representatives from the registries commented that there is no demand, or only a limited demand, for the EQ-5D data from health care providers. Whether this is because the health care providers do not know that the data are available, or how it can be used, or if they do not find the data relevant, was difficult to assess in this study.

For the results to be actionable, previous literature emphasizes that the data must be analysed and presented in a way that users can easily interpret and understand [24, 55]. Interestingly, our study has shown that the analysis of the EQ-5D data from the registries has quite often been focused on the mean EQ-5D index value, which summarises the responses to the five questions into one overall index, based on country-specific value sets. These value sets are mainly developed for use in health economic evaluations, and are most commonly based on techniques for eliciting preferences for hypothetical health states among the general public [15]. However, our study reveals that the use of the EQ-5D data from the NQRs is considerably focused on the clinical context. For such purposes, alternative analysis methods have been recommended, that place more focus on the patients’ responses to the individual items, and their rating on EQ VAS [56, 57]. Furthermore, local improvement teams may face additional challenges when making use of PROMs data from the NQRs in local quality improvement initiatives, as these may have differing needs regarding the type of instrument, as well as the timing and frequency of measurements.

Other possible explanations for the relatively limited reported use of EQ-5D data from the NQRs are that some of the registries only recently began collecting data, that the coverage is too low for the analysis to be considered meaningful, or that the use of the data is more focused around other measures collected in the registry. Hence, attention must be given to that the NQRs are collecting other health outcome measures, and that the findings and interpretations from our study are limited to the use of EQ-5D data only.

Strengths and limitations

The information in this study has been collected in collaboration with at least one representative from each of the included registries, and we have therefore had access to the most updated information from each registry. All representatives had the opportunity to confirm or modify the compiled information regarding the collection, presentation, and use of EQ-5D data from the registry.

Yet, relying on information from one or two representatives may also have some limitations. First, the information provided may be influenced by whom we were in contact with. The representatives from the registries may have interpreted the questions differently. Thus, it is possible that some information may have been missed, and our aggregated quantitative analysis should consequently be interpreted with caution. Nevertheless, the findings on the specific uses of EQ-5D data have been strengthened by the fact that we have asked for examples and references.

Second, as previously mentioned, the representatives from the registries may be unaware of how the data have been used in clinical practice, or in decision-making by other stakeholders. This study limitation is especially prominent in the interpretation of use in quality improvement. As quality improvement work is most commonly performed locally by the health care providers, we have not been able to go into depth regarding the characteristics of these initiatives. We found that collecting this information would have required interviews with a large number of care givers, which was beyond the scope of this study. Thus, additional studies are needed to explore how PROMs are currently integrated in quality improvement initiatives in health care.

Third, the template that was distributed and discussed together with the registry representatives included both open questions and examples (e.g., of channels for feedback and use of data). It could be considered a limitation that examples were provided, as this may have influenced their responses. However, the personal communications with the registry representatives enabled good dialogue regarding the questions in the template, and how these were applicable for each particular registry.

Finally, we have only been in contact with the registries that currently have a license for using EQ-5D. Thus, we do not have any information on why other registries have decided not to use EQ-5D, or why some registries that previously collected EQ-5D data have stopped.

Implications

The initiative to collect EQ-5D within the Swedish NQRs is one of the most ambitious large-scale PROM implementations that we have been able to identify in the literature. Our study is the first to describe this initiative in detail, and contains several valuable examples of how PROM data can be collected and used for follow-up and decision-making. It also shows a potential for improving the use of EQ-5D, such as setting up clear goals for data collection, together with the stakeholders, and considering alternative data analyses in order to improve the interpretability of the results, including a focus on the specific items of EQ-5D, and case-mix adjustments. In this process, the guidelines developed by ISOQOL may provide useful guidance considering aspects such as the purpose of collecting the data, key barriers that need to be addressed, and how, when, and where the results could be presented [18, 21].

Our findings suggest that the case of EQ-5D within the NQRs provides opportunities to study whether the use of PROMs leads to actual improvements in patient care. Although some previous studies indicate that the use of PROMs is associated with improved communication and decision-making [58], reviews of the scientific literature have highlighted that there is limited evidence for the effects from implementing and using PROMs in clinical practice [5, 58,59,60]. Thus, there is a need for future studies to investigate if the use of PROMs has an actual effect on the decisions made by patients and care givers, and ultimately improves the care and health of the patients. The examples presented in our study may provide useful real-world cases for follow-up.

Conclusions

This study contributes to the field of routine collection of PROMs in clinical practice by describing how EQ-5D data are collected within the Swedish NQRs, as well as how results are presented and used at different levels of the Swedish health care system. It shows that the collection and use of EQ-5D data vary across the registries, which may be explained in part by the different purposes of the registries. Although our study has shown multiple valuable examples of the usefulness of EQ-5D data as a PROM, it has also revealed that there is potential for improving feedback and the use of the data at different levels of the health care system.

Availability of data and materials

The majority of data generated or analyzed during this study are included in this published article [and its supplementary information files]. Any additional data used and/or analyzed during the current study are available from the corresponding author on reasonable request.

Abbreviations

HRQoL:

Health-related quality of life

ISOQOL:

International Society for Quality of Life Research

NQRs:

National Quality Registries

PROM:

Patient-reported outcome measure

SALAR:

Swedish Association of Local Authorities and Regions

References

  1. National Quality Registries. Swedish Association of Local Authorities and Regions (2019) About the National Quality Registries. http://www.kvalitetsregister.se/englishpages/aboutqualityregistries.2422.html. Accessed 22 Aug 2019.

  2. Jacobsson Ekman, G., Lindahl, B., & Nordin, A. (Eds.) (2016). National Quality Registries in Swedish health care. Halmstad: Karolinska Institutet University Press.

    Google Scholar 

  3. Fayers, M. P., & Machin, D. (2016). QUALITY OF LIFE the assessment, analysis and reporting of patient-reported outcomes, (3rd ed., ). Chichester: Wiley Inc.

    Google Scholar 

  4. Higginson, I. J., & Carr, A. J. (2001). Measuring quality of life: Using quality of life measures in the clinical setting. BMJ., 322(7297), 1297–1300.

    Article  PubMed  PubMed Central  CAS  Google Scholar 

  5. Greenhalgh, J., Dalkin, S., Gibbons, E., Wright, J., Valderas, J. M., Meads, D., & Black, N. (2018). How do aggregated patient-reported outcome measures data stimulate health care improvement? A realist synthesis. J Health Serv Res Policy, 23(1), 57–65.

    Article  PubMed  Google Scholar 

  6. International Society for Quality of Life Research (prepared by Aaronson N E T, Greenhalgh J, Halyard M, Hess R, Miller D, Reeve B, Santana M, Snyder C) (2015) User’s guide to implementing patient-reported outcomes assessment in clinical practice. International Society for Quality of Life Research, http://www.isoqol.org/UserFiles/2015UsersGuide-Version2.pdf. Accessed 3 Sept 2019

  7. Calvert, M., Kyte, D., Price, G., Valderas, J. M., & Hjollund, N. H. (2019). Maximising the impact of patient reported outcome assessment for patients and society. BMJ, 364, k5267.

    Article  PubMed  Google Scholar 

  8. Van Der Wees, P. J., Nijhuis-Van Der Sanden, M. W., Ayanian, J. Z., Black, N., Westert, G. P., & Schneider, E. C. (2014). Integrating the use of patient-reported outcomes for both clinical practice and performance measurement: Views of experts from 3 countries. Milbank Q, 92(4), 754–775.

    Article  Google Scholar 

  9. Nilsson, E., Orwelius, L., & Kristenson, M. (2016). Patient-reported outcomes in the Swedish National Quality Registers. J Intern Med, 279(2), 141–153.

    Article  PubMed  CAS  Google Scholar 

  10. Brooks, R. (1996). EuroQol: The current state of play. Health Policy, 37(1), 53–72.

    Article  PubMed  CAS  Google Scholar 

  11. EuroQol, G. (1990). EuroQol--a new facility for the measurement of health-related quality of life. Health Policy, 16(3), 199–208.

    Article  Google Scholar 

  12. Herdman, M., Gudex, C., Lloyd, A., Janssen, M., Kind, P., Parkin, D., et al. (2011). Development and preliminary testing of the new five-level version of EQ-5D (EQ-5D-5L). Qual Life Res, 20(10), 1727–1736.

    Article  PubMed  PubMed Central  CAS  Google Scholar 

  13. EunetHta Joint Action, W. P. S., Heintz, E., Gerber-Grote, A., Ghabri, S., Hamers, F. F., Rupel, V. P., et al. (2016). Is there a European view on health economic evaluations? Results from a synopsis of methodological guidelines used in the EUnetHTA partner countries. Pharmacoeconomics, 34(1), 59–76.

    Article  Google Scholar 

  14. Drummond, M., Sculpher, M. J., Claxton, K., Stoddart, G. L., & Torrance, G. W. (2015). Methods for the economic evaluation of health care programmes, (4th ed., ). Oxford: Oxford University Press.

    Google Scholar 

  15. EuroQol Research Foundation (2020) Value sets. https://eurowol.org/publications/key-euroqol-references/value-sets. Accessed 19 Jan 2020.

    Google Scholar 

  16. Greenhalgh, J. (2009). The applications of PROs in clinical practice: What are they, do they work, and why? Qual Life Res, 18(1), 115–123.

    Article  PubMed  Google Scholar 

  17. Greenhalgh, J., Long, A. F., & Flynn, R. (2005). The use of patient reported outcome measures in routine clinical practice: Lack of impact or lack of theory? Soc Sci Med, 60(4), 833–843.

    Article  PubMed  Google Scholar 

  18. Snyder, C. F., Aaronson, N. K., Choucair, A. K., Elliott, T. E., Greenhalgh, J., Halyard, M. Y., et al. (2012). Implementing patient-reported outcomes assessment in clinical practice: A review of the options and considerations. Qual Life Res, 21(8), 1305–1314.

    Article  PubMed  Google Scholar 

  19. McKenna, S. P., Heaney, A., & Wilburn, J. (2019). Measurement of patient-reported outcomes. 2: Are current measures failing us? J Med Econ, 22(6), 523–530.

    Article  PubMed  Google Scholar 

  20. Boyce, M. B., Browne, J. P., & Greenhalgh, J. (2014). The experiences of professionals with using information from patient-reported outcome measures to improve the quality of healthcare: A systematic review of qualitative research. BMJ Qual Saf, 23(6), 508–518.

    Article  PubMed  Google Scholar 

  21. Chan, E. K. H., Edwards, T. C., Haywood, K., Mikles, S. P., & Newton, L. (2019). Implementing patient-reported outcome measures in clinical practice: A companion guide to the ISOQOL user's guide. Qual Life Res, 28(3), 621–627.

    Article  PubMed  Google Scholar 

  22. Sparring, V., Granstrom, E., Andreen Sachs, M., Brommels, M., & Nystrom, M. E. (2018). One size fits none - a qualitative study investigating nine national quality registries’ conditions for use in quality improvement, research and interaction with patients. BMC Health Serv Res, 18(1), 802.

    Article  PubMed  PubMed Central  Google Scholar 

  23. Devlin, N. J., & Appleby, J. (2010). Getting the most out of PROMs. Putting health outcomes at the heart of NHS decision-making. London: Office of Health Economics (OHE).

    Google Scholar 

  24. Anatchkova, M., Donelson, S. M., Skalicky, A. M., McHorney, C. A., Jagun, D., & Whiteley, J. (2018). Exploring the implementation of patient-reported outcome measures in cancer care: Need for more real-world evidence results in the peer reviewed literature. J Patient Rep Outcomes, 2(1), 64.

    Article  PubMed  PubMed Central  Google Scholar 

  25. Ciani, O., & Baldassarre Federici, C. (2020). Value lies in the eye of the patients: The why, what, and how of patient-reported outcomes measures. Clin Ther, 42(1), 25–33.

    Article  PubMed  Google Scholar 

  26. The National Board of Health and Welfare (2017) Handbok för utveckling av indikatorer - för god vård och omsorg [Handbook for developing indicators - for good care and nursing]. Stockholm: The National Board of Health and Welfare, https://www.socialstyrelsen.se/globalassets/sharepoint-dokument/artikelkatalog/handbocker/2017-5-19.pdf. Accessed 22 Aug 2019.

  27. Thonon, F., Watson, J., & Saghatchian, M. (2015). Benchmarking facilities providing care: An international overview of initiatives. SAGE Open Med, 3, 2050312115601692.

    Article  PubMed  PubMed Central  Google Scholar 

  28. Elwyn, G., Laitner, S., Coulter, A., Walker, E., Watson, P., & Thomson, R. (2010). Implementing shared decision making in the NHS. BMJ., 341, c5146.

    Article  PubMed  Google Scholar 

  29. Hillert, J., & Stawiarz, L. (2015). The Swedish MS registry - clinical support tool and scientific resource. Acta Neurol Scand, 132(199), 11–19.

    Article  PubMed  PubMed Central  CAS  Google Scholar 

  30. The Swedish Knee Arthroplasty Register (2018) Årsrapport 2018 [In English: Annual report 2018]. http://www.myknee.se/pdf/SVK_2018_1.1.pdf. Accessed 22 Aug 2019.

  31. The Swedish Hip Arthroplasty Register (SHPR) (2020) Koll på läget. https://shpr.registercentrum.se/statistik/koll-pa-laeget/p/rJdIs4_mS. Accessed 6 July 2020.

  32. UCR - Uppsala Clinical Research Center (2019) Välkommen till ABC AF-studien [In English: Welcome to the ABC AF study]. http://www.abcafstudy.se/. Accessed 22 Aug 2019.

  33. Better management of patients with OsteoArthritis (BOA) (2019) Statistik [In English: Statistics]. https://boa.registercentrum.se/statistik/statistik/p/HJSjx8Jvx#!overview. Accessed 22 Aug 2019.

  34. Hjalte, F., Carlsson, K. S., & Schmitt-Egenolf, M. (2018). Sustained psoriasis area and severity index, dermatology life quality index and EuroQol-5D response of biological treatment in psoriasis: 10 years of real-world data in the Swedish National Psoriasis Register. Br J Dermatol, 178(1), 245–252.

    Article  PubMed  CAS  Google Scholar 

  35. The Swedish Quality Registry for Pain Rehabilitation (SQRP) (2019) Specialistvård Rapport 2019:1, Årsrapport 2018 del 1, Patienter som avslutats under 2018 [In English: Specialist Care Report 2019: 1, Annual Report 2018 Part 1, Patients terminated during 2018]. https://www.ucr.uu.se/nrs/nrs-specialistvard/arsrapporter-specialistvard/1-arsrapport-nrs-specialistvard-2018-del-1-rapport-2019-1-rev/viewdocument. Accessed 22 Aug 2019.

  36. The Swedish Fracture Register (SFR) (2018) Årsrapport 2017 [In English: Annual report 2017]. http://www.registercentrum.blob.core.windows.net/sfr/r/Arsrapport-2017-HJeCNSgVyE.pdf. Accessed 22 Aug 2019.

  37. The Swedish Hip Arthroplasty Register (SHPR) (2018) Årsrapport 2017 [In English: Annual report 2017]. https://registercentrum.blob.core.windows.net/shpr/r/-rsrapport-2017-S1xKMzsAwX.pdf. Accessed 22 Aug 2019.

  38. The Swedish Elbow Arthroplasty Register and The Swedish Shoulder Arthtroplasty Register (2018) ÅRSRAPPORT 2018 [In English: Annual report 2018]. http://www.ssas.se/files/docs/rapp18.pdf. Accessed 22 Aug 2019.

  39. The Swedish Spine Register (2019) Annual report 2019 [In English: Annual report 2019]. http://4s.nu/pdf/190909_Swespine_arsrapport_2019_PeterFritzell_14_final.pdf. Accessed 25 Nov 2019.

  40. The National Quality Registry for Podiatric Surgery (RiksFot) (2019) EQ 5D inför respektive 1 år efter operation, per enhet [In English: EQ 5D before and 1 year after surgery, per unit]. https://fot.registercentrum.se/statistik/eq5d-infoer-respektive-1-ar-efter-operation-per-enhet/hallux-valgus-medelvaerde-eq5d-score-infoer-respektive-1-ar-efter-operation-per-enhet/p/HyxoTJSFE. Accessed 22 Aug 2019.

  41. Kamrad, I., Carlsson, A., Henricson, A., Magnusson, H., Karlsson, M. K., & Rosengren, B. E. (2017). Good outcome scores and high satisfaction rate after primary total ankle replacement. Acta Orthop, 88(6), 675–680.

    Article  PubMed  PubMed Central  Google Scholar 

  42. Kamrad, I., Henricson, A., Magnusson, H., Carlsson, A., & Rosengren, B. E. (2016). Outcome after salvage arthrodesis for failed Total ankle replacement. Foot Ankle Int, 37(3), 255–261.

    Article  PubMed  Google Scholar 

  43. The health care in numbers. The Swedish Association of Local Authorities and Regions (SALAR) (2019) Hälsorelaterad livskvalitet efter artrosskola vid höftartros [In English: Health-related quality of life after a osteoarthritis learning program for patients with hip osteoarthritis]. https://vardenisiffror.se/indikator?metadatameasure=3df9334e-b386-4f11-9188-8f231309171c&relatedmeasuresbyentry=keyword&relatedmeasuresbyid=forebyggande-vard&units=se. Accessed 22 Aug 2019.

  44. The health care in numbers. The Swedish Association of Local Authorities and Regions (SALAR) (2019) Patientrapporterat hälsotillstånd (EQ VAS) efter total höftprotesoperation [In English: Patient-reported health state (EQ VAS) after total hip arthroplasty]. https://vardenisiffror.se/indikator?datefrom=2014-01-01&metadatameasure=6bc1088f-bc08-4576-8aef-8490802a8e5e&units=se. Accessed 25 Nov 2019.

  45. SVEUS (2019) Vad är SVEUS? [In English: What is SVEUS?]. https://www.sveus.se/om-sveus/valkommen-till-sveus. Accessed 22 Aug 2019.

  46. National Quality Registry for Child and Adolescent Habilitation H (2019) Kvalitetsindikatorer. Kvalitetsindikatorer med målnivåer för barn med cerebral pares i HabQ [In English: Quality indicators. Quality indicators with target levels for children with cerebral paresis in HabQ]. http://habq.se/patient/resultat/resultat-start/habiliteringens-kvalitet/kvalitetsindikatorer/. Accessed 26 Aug 2019.

  47. The health care in numbers. The Swedish Association of Local Authorities and Regions (SALAR) Registrering av patientskattad hälsa inför fotkirurgisk operation. Andel patienter som inför fotkirurgisk operation skattar sin hälsa (pre-PROM). [In English: Registration of patient-reported health prior to foot surgery. Proportion of patients assessing their health prior to foot surgery (pre-PROM)]. https://vardenisiffror.se/indikator?metadatameasure=af1dae69-6a0f-4c17-a0e0-5e02e37b05e8&units=01&units=03&units=04&units=05&units=06&units=07. Accessed 26 Aug 2019.

  48. The National Board of Health and Welfare (2019) Nationella riktlinjer för vård vid psoriasis. Indikatorer Bilaga [In English: National guidelines for care for psoriasis. Indicators Appendix]. https://www.socialstyrelsen.se/globalassets/sharepoint-dokument/artikelkatalog/nationella-riktlinjer/2019-3-11-indikatorbilaga-nr-psoriasis.pdf.

  49. The National Board of Health and Welfare (2018) Utvärdering av rikssjukvårdsområdet hjärtkirurgi på vuxna med medfödda hjärtfel [In English: Evaluation of the national health care area cardiac surgery in adults with congenital heart defects]. https://www.socialstyrelsen.se/globalassets/sharepoint-dokument/artikelkatalog/ovrigt/2018-8-2.pdf. Accessed 22 Aug 2019.

  50. The Swedish Association of Local Authorities and Regions (SALAR) (2019) Om Vården i siffror [In English: About Healthcare in Numbers]. https://vardenisiffror.se/about?open=finansiering-och-forvaltning. Accessed 22 Aug 2019.

  51. The Swedish Quality Registry for Pain Rehabilitation (SQRP) (2019) Specialistvård Rapport 2018:1, Årsrapport 2018 del 1 Bilaga, Patienter som avslutats under 2018 [In English: Specialist Care Report 2018: 1, Annual Report 2018 Part 1 Appendix, Patients terminated during 2018]. https://www.ucr.uu.se/nrs/nrs-specialistvard/arsrapporter-specialistvard/arsrapport-2019-bilagor/viewdocument. Accessed 26 Aug 2019.

  52. National Quality Registry for Systemic Psoriasis Treatment (PsoReg) (2019) PsoReg:s årsrapport för 2018 [In English: Psoreg's annual report 2018]. http://www.psoreg.se/wp-content/uploads/2019/04/Arsrapport_PsoReg_2018.pdf. Accessed 3 Sept 2019.

  53. Ahmed, S., Ware, P., Gardner, W., Witter, J., Bingham 3rd, C. O., Kairy, D., & Bartlett, S. J. (2017). Montreal accord on patient-reported outcomes (PROs) use series - paper 8: Patient-reported outcomes in electronic health records can inform clinical and policy decisions. J Clin Epidemiol, 89, 160–167.

    Article  PubMed  Google Scholar 

  54. The National Quality Registries. The Swedish Association of Local Authorities and Regions (SALAR) (2018) Certifieringsnivåer för nationella kvalitetsregister och registerkandidater [In English: Certification levels for the national quality registries and registry candidates]. http://www.kvalitetsregister.se/download/18.417bafc8162a9bb6a23c85fa/1523865632363/Uppdaterade_certifieringsnivaer_2018_20180411.pdf. Accessed 9 Sept 2019.

  55. Bingham 3rd, C. O., Noonan, V. K., Auger, C., Feldman, D. E., Ahmed, S., & Bartlett, S. J. (2017). Montreal accord on patient-reported outcomes (PROs) use series - paper 4: Patient-reported outcomes can inform clinical decision making in chronic care. J Clin Epidemiol, 89, 136–141.

    Article  PubMed  PubMed Central  Google Scholar 

  56. Devlin, N. J., Parkin, D., & Browne, J. (2010). Patient-reported outcome measures in the NHS: New methods for analysing and reporting EQ-5D data. Health Econ, 19(8), 886–905.

    Article  PubMed  Google Scholar 

  57. Devlin N (2016) 5 Things You Should Do with EQ-5D Data. https://www.ohe.org/news/5-things-you-should-do-eq-5d-data. Accessed 7 Nov 2019.

  58. Ishaque, S., Karnon, J., Chen, G., Nair, R., & Salter, A. B. (2019). A systematic review of randomised controlled trials evaluating the use of patient-reported outcome measures (PROMs). Qual Life Res, 28(3), 567–592.

    Article  PubMed  CAS  Google Scholar 

  59. Valderas, J. M., Kotzeva, A., Espallargues, M., Guyatt, G., Ferrans, C. E., Halyard, M. Y., et al. (2008). The impact of measuring patient-reported outcomes in clinical practice: A systematic review of the literature. Qual Life Res, 17(2), 179–193.

    Article  PubMed  CAS  Google Scholar 

  60. Marshall, S., Haywood, K., & Fitzpatrick, R. (2006). Impact of patient-reported outcome measures on routine practice: A structured review. J Eval Clin Pract, 12(5), 559–568.

    Article  PubMed  Google Scholar 

Download references

Acknowledgements

The authors are grateful to the representatives from the registries for their contribution with information for this study. We would also like to thank our colleagues Hans Lindqvist, Gunilla Jacobsson-Ekman and Seher Korkmaz at Region Stockholm, Evalill Nilsson at Linköping University, and Niklas Zethraeus at Karolinska Institutet for their valuable comments on the manuscript.

Funding

MJ is working on a freelance basis at the EuroQol Business Office. EH received a grant from VinnVård/FORTE. OE and (partly) EH were funded by Region Stockholm within a license agreement between Region Stockholm and the EuroQol Research Foundation. The funding bodies had no influence in the design of the study, data collection, analysis, or in writing the manuscript. Open access funding provided by Karolinska Institute.

Author information

Authors and Affiliations

  1. Department of Learning, Informatics, Management and Ethics (LIME), Karolinska Institutet, Tomtebodavägen 18A, SE-171 77, Stockholm, Sweden

    Olivia Ernstsson & Emelie Heintz

  2. Section Medical Psychology and Psychotherapy, Department of Psychiatry, Erasmus MC, Dr. Molewaterplein 40, Rotterdam, 3015 GD, the Netherlands

    Mathieu F. Janssen

  3. EuroQol Research Foundation, Rotterdam, the Netherlands

    Mathieu F. Janssen

Authors
  1. Olivia Ernstsson
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Mathieu F. Janssen
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Emelie Heintz
    View author publications

    You can also search for this author in PubMed Google Scholar

Contributions

All authors participated in the planning of the study and the preparation of the manuscript. The data collection and analysis was conducted by EH and OE. All authors read and approved the final manuscript.

Corresponding author

Correspondence to Olivia Ernstsson.

Ethics declarations

Ethics approval and consent to participate

Not applicable.

Consent for publication

Not applicable.

Competing interests

MJ is working on a freelance basis at the EuroQol Business Office and is a EuroQol member. OE and (partly) EH are funded by Region Stockholm within a research program that is part of a license agreement between Region Stockholm and the EuroQol Research Foundation. OE and EH have received travel grants from the EuroQol Research Foundation.

Additional information

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Supplementary information

Additional file 1: Table S1.

Template requesting information regarding the registries’ collection, presentation, and use of EQ-5D (originally in Swedish). Table S2. Collection of EQ-5D. Registries within the category of Cancer. Table S3. Collection of EQ-5D. Registries within the category of Circulatory system. Table S4. Collection of EQ-5D. Registries within the category of Endocrine organs. Table S5. Collection of EQ-5D. Registries within the category of Infection. Table S6. Collection of EQ-5D. Registries within the category of Musculoskeletal system. Table S7. Collection of EQ-5D. Registries within the category of Nervous system. Table S8. Collection of EQ-5D. Registries within the category of Paediatrics. Table S9. Collection of EQ-5D. Registries within the category of Psychiatry. Table S10. Collection of EQ-5D. Registries within the category of Stomach and intestines. Table S11. Collection of EQ-5D. Registries within the category of Other areas (rare diseases). Table S12. Collection of EQ-5D. Registries within the category of Other areas (skin disease).

Rights and permissions

Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/.

Reprints and Permissions

About this article

Verify currency and authenticity via CrossMark

Cite this article

Ernstsson, O., Janssen, M.F. & Heintz, E. Collection and use of EQ-5D for follow-up, decision-making, and quality improvement in health care - the case of the Swedish National Quality Registries. J Patient Rep Outcomes 4, 78 (2020). https://doi.org/10.1186/s41687-020-00231-8

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1186/s41687-020-00231-8

Keywords

  • EQ-5D
  • Patient-reported outcome measures
  • PROM
  • Health-related quality of life
  • Quality registries
  • Quality improvement
  • Routine measurement