Skip to main content

Patient-reported outcome measures in physical therapy practice for neck pain: an overview of reviews

Abstract

Background

Understanding which patient-reported outcome measures are being collected and utilized in clinical practice and research for patients with neck pain will help to inform recommendations for a core set of measures that provide value to patients and clinicians during diagnosis, clinical decision-making, goal setting and evaluation of responsiveness to treatment. Therefore, the aim of this study was to conduct a review of systematic reviews using a qualitative synthesis on the use of patient-reported outcome measures (PROMs) for patients presenting with neck pain to physical therapy.

Methods

An electronic search of systematic reviews and guideline publications was performed using MEDLINE (OVID), Embase (Elsevier), CINAHL Complete (EBSCOhost), and Web of Science (Clarivate) databases to identify reviews that evaluated physical therapy interventions or interventions commonly performed by a physical therapist for individuals with neck pain and included at least one patient-reported outcome measure. The frequency and variability in which the outcome measures were reported among the studies in the review and the constructs for which they measured were evaluated. The evaluation of a core set of outcome measures was assessed. Risk of bias and quality assessment was performed using A Measurement Tool to Assess systematic Reviews 2.

Results

Of the initial 7,003 articles, a total of 37 studies were included in the final review. Thirty-one PROMs were represented within the 37 reviews with eleven patient-reported outcome measures in three or more reviews. The eleven PROMs assessed the constructs of disability, pain intensity, psychosocial factors and quality of life. The greatest variability was found amongst individual measures assessing psychosocial factors. Assessment of psychosocial factors was the least represented construct in the included studies. Overall, the most frequently utilized patient reported outcome measures were the Neck Disability Index, Visual Analog Scale, and Numeric Pain Rating Scale. The most frequently used measures evaluating the constructs of disability, pain intensity, quality of life and psychosocial functioning included the Neck Disability Index, Visual Analog Scale, Short-Form-36 health survey and Fear Avoidance Belief Questionnaire respectively. Overall risk of bias and quality assessment confidence levels ranged from critically low (2 studies), low (12 studies), moderate (8 studies), and high (15 studies).

Conclusion

This study identified a core set of patient-reported outcome measures that represented the constructs of disability, pain intensity and quality of life. This review recommends the collection and use of the Neck Disability Index and the Numeric Pain Rating Scale or Visual Analog Scale. Recommendation for a QoL measure needs to be considered in the context of available resources and administrative burden. Further research is needed to confidently recommend a QoL and psychosocial measure for patients presenting with neck pain. Other measures that were not included in this review but should be further evaluated for patients with neck pain are the Patient Reported Outcomes Measurement Information System (PROMIS) Physical function, PROMIS Pain Interference and the Optimal Screening for Prediction of Referral and Outcome Yellow Flag (OSPRO-YF) tool.

Background

It is well understood that “measuring health is the first step to understanding health and understanding health is the first step to improving health” [1]. Patient-reported outcome measures (PROMs) present the opportunity to capture information directly from the patient that can help clinicians and researchers understand the impact of disease, treatment, and health status directly as the patient perceives it [2]. Moreover, PROMs play a critical role in supporting shared decision-making and personalized goal-setting between a patient and provider [2, 3]. In high-burden diseases with multifactorial causes, such as neck pain, PROMs present an opportunity to capture information that can inform the development of individualized evidence-based interventions, assess responsiveness to treatment and inform prognosis beyond traditional objective assessments [4].

Various evidence-based interventions have been recommended for the treatment of neck pain including treatments provided by a variety of interdisciplinary clinicians. However, due to the lack of standardization of PROMs across disciplines and in many cases even within a single discipline, there is difficulty in comparing the outcomes of these interventions [5]. This heterogeneity of measures makes it challenging to quantitatively evaluate which treatments are effective, their use in clinically meaningful research and comparison of findings between studies [3]. To that end, the expansion of electronic health record capabilities and data management allow the aggregation of large scale data collection and patient reported outcome integration at an unprecedented level. However, with the continued heterogeneity of measurement use in patients with neck pain and without minimal mandates, the ability to use this data to improve patient outcomes and advance the field will remain suboptimal.

Standardized PROM use has the potential to complement a clinician’s experience and expertise with an objective assessment of a patient’s status as they perceive it, assist with shared decision making, detect improvement in function, and provide informative large scale data to drive value based care pathways and quality improvement [6]. Various professional organizations, including the American Physical Therapy Association(APTA) have included recommendations for standardized PROM collection within published clinical practice guidelines(CPGs) including those specific to neck pain [4]. Despite open access to these guidelines, continued inconsistencies and lack of standardization in PROMs exist. To that end, these inconsistencies subsequently reduce the value of PROMs within physical therapy and across other professions [7].

Continued challenges to their implementation into clinical practice has been attributed to multifaceted barriers including lack of time to complete questionnaires, administrative burden, and lack of knowledge on how to translate data to knowledge [7, 8]. Additionally, without standardization of PROMs, patients may face “survey fatigue”. This combined with a clinician’s potential lack of knowledge on how to use the results to inform their clinical decision making further enhances the patients’ assumptions that they provide little value to their care. To that end, it’s critical to consider a PROMs measurement characteristics such as validity, consistency, feasibility, interpretability, and responsiveness. Therefore, a thoughtful, pragmatic, and evidence-informed selection process will ultimately influence the extent that the measure will be valuable, useful, and informative in clinical practice [1, 9].

In 2019, Chiarotto described three-steps to guide selection of the most appropriate PROM for a particular context [10]. Understanding what you want to measure and for what purpose, reviewing the literature, and assessing the quality of the measurement tool of interest were recommended steps to ensure what matters most to patients is captured [10]. Additionally, utilization of a conceptual model and framework to guide appropriate patient-reported outcome selection has also been suggested [11]. Physical therapists are one of the primary non-operative providers for patients with neck pain [12]. Accordingly, patients with neck pain account for approximately 20% of patients referred to outpatient physical therapy [13]. The first step to making recommendations for a set of PROMs to be used for patients with neck pain is to understand the breadth of PROMs within the profession. Secondly, it’s critical to understand what patient populations and clinical context these PROMs are reported in the literature. Therefore, the purpose of this study was to identify PROMs that are reported in patients with neck pain receiving physical therapy interventions and to provide guidance for physical therapists and other practitioners on PROM selection in this patient population.

Methods

Review design

The protocol for this systematic review was designed in accordance with the Preferred Reporting Items for Systematic Reviews and Meta-analysis (PRISMA) guidelines [14] and is registered with the International Prospective Register of Systematic Reviews (PROSPERO) database (CRD42023391158) [15]. We collaborated with a research librarian (SH) to develop an appropriate search strategy and management of the literature review.

Data sources and search strategy

We searched MEDLINE (OVID), Embase (Elsevier), CINAHL Complete (EBSCOhost), and Web of Science (Clarivate) on September 13, 2022, using a combination of keywords and database-specific subject headings for the following concepts: neck pain, including any conditions that had a primary symptom of pain, and specific outcomes identified of interest by the group. An additional modified filter from the COnsensus-based Standards for the selection of health status Measurement Instruments (COSMIN) was used to further limit studies that mentioned reliability and validity information [16]. No restrictions were placed by date or language. The search was limited to only systematic review and guideline publications using two Canadian Agency for Drugs and Technologies in Health (CADTH) search hedges, which were only modified to remove the health technology assessment terms. The search strategies were peer-reviewed by another librarian with expertise in systematic review searches prior to execution using the Peer Review of Electronic Search Strategies (PRESS) checklist [17]. The full, reproducible search strategies for all included databases are available in supplementary material 1.

Inclusion and exclusion criteria

The inclusion criteria for this study were systematic reviews of patients of any age or sex with neck pain receiving a physical therapy intervention or interventions commonly performed by a physical therapist. Studies included in this review must have met the additional criteria of reported outcomes in patients 18 years or older, patients with neck pain or cervicogenic headaches, and at least one patient-reported outcome measure recorded. The exclusion criteria applied in this study were if the study design was anything other than a systematic review of studies that used an experimental, quasi-experimental, or observational design, patients evaluated had neck pain with another spine-related condition such as low back pain, the intervention was provided by a chiropractor or the patient population included patients with neck pain who had neurologic deficits, severe cardiovascular diseases, serious pathology (e.g., malignancy, infection, cancer, inflammatory arthritis, fractures, upper cervical instability, etc.).

Study selection and data extraction

After databases were searched, titles and abstracts of studies were uploaded into Covidence. The article selection process was completed in two phases. In the first phase, two authors (MR and MH) performed independent reviews of titles and abstracts in Covidence using the predefined inclusion and exclusion criteria above. Articles were moved to full-text review if one or both authors found the article potentially relevant. In the second phase, the same two authors independently reviewed full-text articles for eligibility. Any conflicts were resolved by discussion between authors. Three reviewers (MR, MH, MS) performed independent data extraction with a checked final review performed by a single reviewer (MR). Data extraction was performed using a Population, Intervention, Comparison, Outcome (PICO) format with elements representing author, year, title, databases searched, study type, number of included studies, population, intervention, comparators, and patient-reported outcome measures evaluated. Any other measures included in the reviews were also extracted.

Data analysis and synthesis

Studies included in this review were evaluated from December 2022 to February 2023. The primary purpose of this review was to describe PROMs in physical therapy research and practice through qualitative synthesis. Therefore, we did not perform a meta-analysis of the data. For the qualitative synthesis, we described the studies by publication year, clinical population, study type, number of studies included in the review, and the outcomes reported in each study. We reported the frequency of PROMs by the constructs of disability, pain intensity, psychosocial factors, and quality of life. These were described according to their context of use (diagnosis, prognosis, and/or risk) within the included reviews.

Risk of bias

Two review authors (CH and JM) independently assessed the risk of bias in included reviews using the Assessment of Multiple Systematic Reviews 2 (AMSTAR 2) tools. AMSTAR 2 is a validated instrument that uses 16 questions to assess systematic reviews that include randomized and non-randomized studies of healthcare interventions, or both [18]. The included studies were appraised according to AMSTAR 2 guidance and rated the reviews into four categories: “high”, “moderate”, “low”, and “critically low” in overall confidence. We considered the potential impact of an inadequate rating for each item individually. Particularly, we took into account the critical domains, which include whether or not a protocol was registered before the commencement of the review, the adequacy of the literature search, the justification for excluding individual studies, the risk of bias from individual studies being included in the review, consideration of the risk of bias when interpreting the results of the review and the assessment of the presence and likely impact of publication bias. Disagreements between the review authors over the risk of bias in particular studies were resolved by consensus.

Results

Study characteristics

The electronic search resulted in an initial 9457 articles (Fig. 1). After 2454 duplicates were removed, 7003 articles were included for abstract and title review. Eighty-eight articles met the inclusion/exclusion criteria and were included in full-text retrieval. One study was excluded due to lack of full-text availability. After a full-text review, a total of 50 studies were excluded. This was due to the wrong patient population (19), wrong intervention (17), wrong study design (6), wrong comparator (3), wrong outcomes (2), non-English (2), and wrong setting (1).

Fig. 1
figure 1

PRISMA flow diagram of screened and eligible citations

Thirty-seven studies were included in the final review, were published between 2015 and 2022 and included a total of 31 distinct PROMs reported across all studies. Detailed characteristics of the included studies and PROMs are described and summarized in Table 1. Of the studies extracted for final review, 17 were systematic reviews and 20 were systematic reviews with meta-analyses. The mean number of studies included within each review was 13 (range 4–51). 70% of reviews included individuals with non-specific neck pain (acute, sub-acute, chronic), 27% included study populations specifically with whiplash-associated disorder (WAD), 27% included systematic reviews of individuals with radiating pain (radicular), and 22% of studies included populations consistent with cervicogenic headache. There were fourteen studies that included more than one study population within their review. There were a total of thirty-one PROMs reported across the thirty-seven studies in patients with non-specific neck pain, WAD, radiating pain and cervicogenic headache. Four patient-reported outcome constructs were identified amongst the included measures (Table 2). This included the constructs of disability, pain intensity, psychosocial factors, and QoL.

Table 1 Description and characteristics of included reviews
Table 2 The top five patient-reported outcome measure stratified by construct a

Patient-reported outcome measure constructs

Disability

Details of the PROMs included in three or more reviews are presented in Fig. 2. Of the eleven PROMs that were represented in three or more reviews, 45% (n = 5) of the PROMs assessed disability. The most frequently reported PROMs measuring disability included the Neck Disability Index (NDI), Neck Pain Questionnaire (NPQ), Patient Specific Functional Scale (PSFS), Neck Pain and Disability Scale (NPAD), and Disabilities of the arm, shoulder and hand (DASH). The NDI was represented in 89% (n = 33) of studies and was the most frequently included measure of disability within our review. This was followed by the NPQ, PSFS and DASH represented in 35%, 14% and 8% of studies respectively. The aforementioned PROMs context of use was for diagnosis and prognosis in patients with neck pain and cervicogenic headache.

Fig. 2
figure 2

The 11 most frequently reported PROMs. *DASH, Disabilities of the Arm, Shoulder and Hand; FABQ, Fear Avoidance Belief Questionnaire; NDI, Neck Disability Index; NPAD, Neck Pain and Disability Scale; NPQ, Neck Pain Questionnaire; NPRS, Numeric Pain Rating Scale; PSFS, Patient Specific Functional Scale; SF-12, Short Form Health Survey-12; SF-36, Short Form Health Survey-36; TSK, Tampa Scale of Kinesiophobia; VAS, Visual Analog Scale

Pain intensity

13% (n = 4) of all included PROMs (n = 31) measured the construct of pain intensity. Four measures of pain intensity were represented in this review and only two PROMs were represented in three or more reviews. These included the visual analog scale (VAS) and numeric pain rating scale (NPRS). The VAS was the most frequently utilized pain intensity measure and was represented in 76% (n = 28) of included studies. The NPRS was included in 73% (n = 27) of studies.

Psychosocial

Ten measures of psychosocial function were represented in the included studies, with two PROMs represented in three or more reviews. These included the Fear Avoidance Belief Questionnaire (FABQ) and Tampa Scale of Kinesiophobia (TSK). The FABQ was the most utilized of the two measures, representing 14% (n = 5) of all reviews. The second most frequently utilized measure of psychosocial function was the TSK, represented in 8% (n = 3) of all reviews.

Quality of life

Four QoL measures were represented in the included 31 PROMs with two PROMs present in three or more reviews. These included the Short Form Health Survey-12(SF-12) and Short Form Health Survey-36(SF-36). The SF-36 was the most frequently utilized QoL measure and was represented in 30% (n = 11) of included reviews. The SF-12 was the second most frequently utilized QoL measure and was included in 11% (n = 4) of reviews with risk of bias ratings of low (2) and high (2).

Risk of bias

A summary of the results from the critical appraisal of 37 studies using the AMSTAR2 are described in Fig. 3 with full details provided in supplementary materials 1. Confidence in the results were rated as critically low [19, 20], low [21,22,23,24,25,26,27,28,29,30,31,32], moderate [12, 33,34,35,36,37,38,39], and high [40,41,42,43,44,45,46,47,48,49,50,51,52,53,54]. The methodological weaknesses in the critically low and low rated studies are considered critical domains by AMSTAR2. These included a failure to adequately investigate publication bias and its impact on the results (9 studies), a lack of consideration of risk of bias when interpreting the results of the review (5 studies), or insufficient justification for excluding individual studies (3 studies). Studies rated as moderate were lacking information in more than one of the non-critical domains. This included not performing study selection in duplicate (1 study), not performing data extraction in duplicate (8 studies), lack of reporting on sources of funding for the studies included in the review (14 studies), not assessing the potential impact of RoB in individual studies on the results of the meta-analysis or other evidence synthesis (3 studies), lack of satisfactory explanation for, and discussion of, any heterogeneity observed in the results of the review (9 studies), or failing to report any potential sources of conflict of interest, including funding (4 studies).

Fig. 3
figure 3

AMSTAR2(A MeaSurement Tool to Assess systematic Reviews) Confidence Ratings of included reviews

Discussion

The purpose of this review was to identify PROMs that are reported in patients with neck pain receiving physical therapy interventions and to provide guidance for physical therapists and other practitioners on PROM selection for patients with neck pain. Similar to the findings described in the Academy of Orthopaedic Physical Therapy(AOPT) Neck Pain CPG revision, our review found that the NDI was the most commonly utilized PROM [4]. The NDI has demonstrated high-quality evidence of good to excellent internal consistency, moderate to excellent test-retest reliability, and moderate quality evidence of poor to moderate responsiveness in patients with neck disorders [55].

Second and third to the NDI in the frequency of use for evaluation of perceived disability, were the NPQ and PSFS respectively. These findings were not surprising as they were consistent with another systematic review [55] that found the NDI and NPQ to be the most frequently utilized PROMs in physical therapy practice for patients with neck disorders. Bobos et al. demonstrated the NPQ to be the second most frequently evaluated PROM assessing disability in individuals with neck pain and moderate quality evidence demonstrating good to excellent internal consistency and good test-retest reliability [55]. Although the PSFS was originally developed to be used across a variety of conditions, moderate quality evidence of high test-retest reliability (ICC = 0.82 for cervical radiculopathy) of the PSFS has been found in patients with neck disorders [55, 56].

For the construct of pain intensity, both the VAS and NPRS were reported in over three quarters of the studies in our review. Not surprisingly, an international survey of researchers determined the NPRS to be the most widely used measure in primary care for patients presenting with neck pain [57]. The NPRS has demonstrated high-to-moderate-quality evidence of moderate to strong (0.58 to 0.93) test-retest reliability with a moderate association of concurrent construct validity between the NDI and VAS of r = 0.36 to 0.69 in patients with neck pain [57].

An in-depth understanding of the outcomes associated with physical therapy interventions in the treatment of neck pain is critical to enhancing the quality and effectiveness of clinical practice. Although there is no substitute for clinical experience and an evidence-based objective examination, the knowledge gathered from understanding a patient’s health status as they perceive it is equally, if not more important to recognize.

It’s critical to note the use of these instruments in clinical care. Standardized PROMs are intended to improve patient-centered care, measure intervention effectiveness, inform clinical decision making, quality improvement initiatives, and enhance shared decision making between the patient and the clinician. A recent systematic review summarizing patients’ experiences and perspectives of PROMs in clinical care found that patients’ perceived benefits of PROMs included a sense of empowerment, providing information to inform clinical planning, assessment, diagnosis and individualized treatment. However they also noted some common barriers to engagement including the PROMs perceived relevance, utility of questions, understanding the measures purpose and concerns about how information is applied clinically [58]. In accordance with patients, most clinicians value PROMs as long as they can be useful during the decision-making process. Noted barriers to their use include not having the infrastructure in place for data collection and when collection of PROMs disrupts their normal workflow [59].

Our review has some noted strengths. First, our study was a review of reviews, resulting in our confidence in the results of our study. Moreover, our findings were consistent with what has been reported in the recent literature. Following Cochrane guidance, our study methodology was thorough and robust creating the platform to capture as many relevant reviews as possible that met our a priori defined inclusion and exclusion criteria. Additionally, this study only reviewed systematic reviews, therefore it is possible that other PROMs have been evaluated for patients with neck pain or cervicogenic headache which have not been previously included in a systematic review analysis. However, it would be anticipated that the most frequently utilized PROMs for patients with neck pain would have been included in the selected reviews.

Our review also has some noted limitations which are important to acknowledge. A limitation of our study is a bias in established measures being reported at higher rates. For example, the NDI and the VAS were initially published in 1991 and 1921 respectively [60, 61]. Comparatively speaking, other disability measures such as the NPQ and the NPAD were published in 1994 and 1999 respectively [62, 63]. For other domains, the SF-36, SF-12, TSK and FBQ were published between 1991–1995 [64,65,66,67]. Therefore, no outcome measures in our study that were included in three or more reviews have been published in the last 20 years.

Additionally, there were PROMs that were not reported in our review that have emerged recently. Patient-Reported Outcomes Measurement Information System (PROMIS) measures were not reported in any of the included studies in this review. The PROMIS PROMs are gaining increasing popularity in clinical practice and research due to their psychometric properties and their ability to compare patient health and treatment outcomes across the continuum of care. A recent systematic review by Young et al. found that the PROMIS-Physical Function(PROMIS-PF) and PROMIS-Pain interference(PROMIS-PI) demonstrate moderate to strong correlations with the NDI, VAS, and SF-12 [68]. Additionally, there is increasing interest in lifestyle behaviors related to neck pain [69,70,71,72]. PROMs related to lifestyle behaviors such as sleep, which has been shown to contribute to neck pain intensity and outcomes, were not found within our review [72].

There were several research gaps that were identified by our study that highlight key areas for future research. Although there was moderate consistency in the reporting of PROMs within the disability and pain intensity constructs, our review found much lower rates of reporting and higher variability within the psychosocial construct. Psychosocial measures represented 32% of all PROMs however these varied greatly (10 total) with 80% (8 out of 10) used in only one review across the 37 included studies. Given the prevalence of psychosocial factors that may influence neck pain intensity [73, 74],prognosis [4, 20, 74, 75], and treatment approaches [38, 76], these data suggest that psychosocial measures are infrequently and inconsistently used when evaluating patients with neck pain. Thus, it seems reasonable to suggest that a gap exists on which measures assessing psychosocial factors are psychometrically supported and valuable in clinical practice, therefore resulting in this mass heterogeneity. This finding suggests a need for future research and specific recommendations for psychosocial PROMs that may be used in clinical practice and research in patients with neck pain.

Another measure which was not found in our review, is the Optimal Screening for Prediction of Referral and Outcome Yellow Flag (OSPRO–YF) tool. Although psychological characteristics can present independently, for example as either depression or anxiety, in patients with chronic pain they often coexist [77]. The evaluation of multiple domains of psychological distress including depression, anxiety, and pain catastrophizing allows for increased effectiveness and efficiency in discriminating between patients who may be at risk for poor outcomes. This comprehensive evaluation also allows for classifying pain phenotypes and identifying those who would benefit from targeted treatment interventions such as cognitive behavioral therapy or psychologically informed treatment [77,78,79]. Due to this, considering a multidimensional tool which evaluates a global psychological profile would inform a clinician if specific targeted interventions would be beneficial for their patient. The OSPRO-YF tool was originally published in 2016 and combines 11 unidimensional psychological questionnaires into 3 domains (negative mood, fear avoidance and positive affect). This single questionnaire has been shown to have good accuracy estimating individual, full-length psychological questionnaire scores for depressive symptoms, anxiety, anger, fear-avoidance beliefs, kinesiophobia, catastrophizing, self-efficacy, and pain acceptance in those with neck pain [80,81,82].

In contrast to the findings within the psychosocial construct, our review found consistency of PROMs within the construct of QoL, with 41% of studies reporting the use of the SF-36 or the shorter version SF-12. However, both measures have associated costs, are lengthy and have high clinician and patient burden. Therefore clinically, we are not able to confidently recommend the SF-36 or 12 without taking these barriers into consideration and understanding contextual factors including the resources that are available to a clinic setting or clinician.

There are several key implications of our findings. First, our study highlights the need for minimal mandates of PROMs that capture the full spectrum of neck pain-related constructs, including psychosocial factors. This has important implications for both clinical practice and research, as a comprehensive understanding of patients’ health as they perceive it is crucial for providing optimal care, facilitating shared-decision making, measuring intervention effectiveness, informing clinical decision making and high quality research. Second, our review identified a core set of patient-reported outcome measures that demonstrate clinical value to clinicians and patients. We provide recommendations of these measures in clinical practice and research settings, aiming to improve the standardization and comparability of patient-reported outcomes across studies and interventions.

Conclusion

There is great variability in PROMs used for patients with neck pain in physical therapy research and clinical practice. Based on these findings, we suggest that future research for neck pain evaluate PROMs that are most reported and psychometrically supported in the literature while considering clinician and patient burden. Based on the findings from this review, in the context of other literature, we recommend a core set of PROMs evaluating disability and pain intensity. This includes the NDI and NPRS or VAS. Assessment of patient QoL is critical, however recommendations for QoL PROMs need to be considered in the context of available resources and administrative burden. The findings from this review provides empirical evidence to assist in informing clinicians and researchers on the use of patient-reported outcome measures for patients with neck pain seeking physical therapy. Further research is needed to confidently recommend a QoL and psychosocial measure for patients presenting with neck pain. Other measures that were not included in this review but should be further evaluated for patients with neck pain are the PROMIS-PF, PROMIS-PI and the OSPRO-YF tool.

Data Availability

All data generated or analyzed during this study are included in this published article and its additional files.

Abbreviations

ADLQ:

Activities of daily living questionnaire

AMSTAR2:

Assessment of Multiple Systematic Reviews 2

AOPT:

Academy of Orthopaedic Physical Therapy

BDI:

Becks depression inventory

CADTH:

Canadian Agency for Drugs and Technologies in Health

CES-D:

Center for epidemiologic studies depression scale

CPG:

Clinical Practice Guideline

COSMIN:

COnsensus-based Standards for the selection of health status measurement Instruments

DASH:

Disabilities of the arm, shoulder and hand

EQ-5D:

EuroQoL-5D

FABQ:

Fear avoidance belief questionnaire

GSES:

General self-efficacy scale

GHQ-28:

General health questionnaire-28

GS:

Goldberg scale

HIT-6:

Headache impact test-6

HI:

Headache index

HqoLQ:

Health quality of life questionnaire

HSCL:

Hopkins symptoms checklist-25

IES:

Impact of event scale

MPQ:

McGill Pain Questionnaire

MVKS:

Modified Von Korf scale

NDI:

Neck disability index

NHP:

Nottingham health profile

NPAD:

Neck pain and disability scale

NPQ:

Northwick park neck pain questionnaire

NPRS:

Numeric pain rating scale

OSPRO-YF:

Optimal Screening for Prediction of Referral and Outcome-Yellow Flag

PDI:

Pain disability index

PICO:

Population, Intervention, Comparison, Outcome

POMS:

Profile of mood states

PRESS:

Peer Review of Electronic Search Strategies

PRISMA:

Preferred Reporting Items for Systematic Reviews and Meta-analysis

PROMIS:

Patient-Reported Outcomes Measurement Information System

PROMIS-PF:

Patient-Reported Outcomes Measurement Information System- Physical Function

PROMIS-PI:

Patient-Reported Outcomes Measurement Information System- Pain interference

PROMs:

Patient-reported outcome measures

PROSPERO:

Prospective Register of Systematic Reviews

PSFS:

Patient specific functional scale

QDASH:

Quick disabilities of the arm, shoulder and hand

SF-12:

12 item short form questionnaire

SF-36:

36 item short form questionnaire

SF-MPQ:

Short form McGill pain questionnaire

TSK:

Tampa scale of kinesiophobia

QoL:

Quality of life

VAS:

Visual analog scale

VNPDI:

Vernon neck pain disability index

WAD:

Whiplash-associated disorder

References

  1. Coles TM, Curtis LH, Boulware LE (2019) Measuring Health Prim Care 46:485–491

    PubMed  Google Scholar 

  2. Weinfurt KP, Reeve BB (2022) Patient-reported outcome measures in Clinical Research. JAMA 328:472–473

    Article  PubMed  Google Scholar 

  3. Makhni EC (2021) Meaningful clinical applications of patient-reported outcome measures in Orthopaedics. J Bone Joint Surg Am 103:84–91

    Article  PubMed  Google Scholar 

  4. Blanpied PR, Gross AR, Elliott JM et al (2017) Neck pain: revision 2017. J Orthop Sports Phys Ther 47:A1–A83

    Article  PubMed  Google Scholar 

  5. Stefanovitch-Lawbuary N, Amirfeyz R, Lovell R, Bannister G (2019) Reliability and responsiveness of patient-reported outcome measures of Neck disability to physical therapy: comparison of the Copenhagen, Northwick Park, and Neck Bournemouth Questionnaires and the Neck Disability Index. J Manipulative Physiol Ther 42:104–107

    Article  PubMed  Google Scholar 

  6. Keeney T, Kumar A, Erler KS, Karmarkar AM (2022) Making the case for patient-reported outcome measures in Big-Data Rehabilitation Research: implications for optimizing patient-centered care. Arch Phys Med Rehabil 103:S140–S145

    Article  PubMed  Google Scholar 

  7. Jette DU, Halbert J, Iverson C et al (2009) Use of standardized outcome measures in physical therapist practice: perceptions and applications. Phys Ther 89:125–135

    Article  PubMed  Google Scholar 

  8. McDonnell B, Stillwell S, Hart S, Davis RB (2018) Breaking down barriers to the utilization of standardized tests and outcome measures in Acute Care Physical Therapist Practice: an observational longitudinal study. Phys Ther 98:528–538

    Article  PubMed  PubMed Central  Google Scholar 

  9. Mokkink LB, Terwee CB, Knol DL et al (2010) The COSMIN checklist for evaluating the methodological quality of studies on measurement properties: a clarification of its content. BMC Med Res Methodol 10:22

    Article  PubMed  PubMed Central  Google Scholar 

  10. Chiarotto A (2019) Patient-reported outcome measures: best is the enemy of good (but what if good is not good Enough?). J Orthop Sports Phys Ther 49:39–42

    Article  PubMed  Google Scholar 

  11. Weldring T, Smith SMS (2013) Patient-reported outcomes (PROs) and patient-reported outcome measures (PROMs). Health Serv Insights 6:61–68

    PubMed  PubMed Central  Google Scholar 

  12. Cox LG, Kidgell DJ, Iles RA (2019) Neck-specific strengthening exercises and cognitive therapy for chronic neck pain: a systematic review. Phys Ther Rev 24:335–345

    Article  Google Scholar 

  13. Swinkels ICS, Kooijman MK, Spreeuwenberg PM et al (2014) An overview of 5 years of patient self-referral for physical therapy in the Netherlands. Phys Ther 94:1785–1795

    Article  PubMed  Google Scholar 

  14. Moher D, Liberati A, Tetzlaff J et al (2009) Preferred reporting items for systematic reviews and meta-analyses: the PRISMA statement. PLoS Med 6:e1000097

    Article  PubMed  PubMed Central  Google Scholar 

  15. Schiavo JH (2019) PROSPERO: An International Register of systematic review protocols. Med Ref Serv Q 38:171–180

    Article  PubMed  Google Scholar 

  16. Terwee CB, Jansma EP, Riphagen II, de Vet HCW (2009) Development of a methodological PubMed search filter for finding studies on measurement properties of measurement instruments. Qual Life Res 18:1115–1123

    Article  PubMed  PubMed Central  Google Scholar 

  17. McGowan J, Sampson M, Salzwedel DM et al (2016) PRESS peer review of electronic search strategies: 2015 Guideline Statement. J Clin Epidemiol 75:40–46

    Article  PubMed  Google Scholar 

  18. Shea BJ, Reeves BC, Wells G et al (2017) AMSTAR 2: a critical appraisal tool for systematic reviews that include randomised or non-randomised studies of healthcare interventions, or both. BMJ 358:j4008

    Article  PubMed  PubMed Central  Google Scholar 

  19. Viswanathan R, Paul J, Manoharlal MA et al (2018) Efficacy of endurance exercise on pain and disability in chronic neck PainA systematic review. J Clin Diagn Res. https://doi.org/10.7860/jcdr/2018/37419.12382

    Article  Google Scholar 

  20. Walton DM, Carroll LJ, Kasch H et al (2013) An overview of systematic reviews on prognostic factors in Neck Pain: results from the International collaboration on Neck Pain (ICON) project. Open Orthop J 7:494–505

    Article  PubMed  PubMed Central  Google Scholar 

  21. Borrella-Andrés S, Marqués-García I, Lucha-López MO et al (2021) Manual therapy as a management of cervical Radiculopathy: a systematic review. Biomed Res Int 2021:9936981

    Article  PubMed  PubMed Central  Google Scholar 

  22. Fredin K, Lorås H (2017) Manual therapy, exercise therapy or combined treatment in the management of adult neck pain – A systematic review and meta-analysis. Musculoskelet Sci Pract 31:62–71

    Article  PubMed  Google Scholar 

  23. Garzonio S, Arbasetti C, Geri T et al (2022) Effectiveness of specific Exercise for Deep cervical muscles in nonspecific Neck Pain: a systematic review and Meta-analysis. https://doi.org/10.1093/ptj/pzac001. Phys Ther 102.

  24. Liang L, Feng M, Cui X et al (2019) The effect of exercise on cervical radiculopathy: a systematic review and meta-analysis. Medicine 98:e17733

    Article  PubMed  PubMed Central  Google Scholar 

  25. Lin K-Y, Tsai Y-J, Hsu P-Y et al (2021) Effects of Sling Exercise for Neck Pain: a systematic review and Meta-analysis. https://doi.org/10.1093/ptj/pzab120. Phys Ther 101.

  26. Louw S, Makwela S, Manas L et al (2017) Effectiveness of exercise in office workers with neck pain: a systematic review and meta-analysis. S Afr J Physiother 73:392

    Article  PubMed  PubMed Central  Google Scholar 

  27. Monticone M, Cedraschi C, Ambrosini E et al (2015) Cognitive-behavioural treatment for subacute and chronic neck pain. Cochrane Database Syst Rev 2015:CD010664

  28. Núñez-Cabaleiro P, Leirós-Rodríguez R (2022) Effectiveness of manual therapy in the treatment of cervicogenic headache: a systematic review. Headache 62:271–283

    Article  PubMed  Google Scholar 

  29. Romeo A, Vanti C, Boldrini V et al (2018) Cervical Radiculopathy: effectiveness of adding traction to physical Therapy—A systematic review and Meta-analysis of Randomized controlled trials. Phys Ther 98:231–242

    Article  PubMed  Google Scholar 

  30. Villanueva-Ruiz I, Falla D, Lascurain-Aguirrebeña I (2022) Effectiveness of specific Neck Exercise for nonspecific Neck Pain; usefulness of strategies for patient selection and tailored Exercise—A systematic review with Meta-analysis. Phys Ther 102:zab259

    Article  Google Scholar 

  31. Yang J-D, Tam K-W, Huang T-W et al (2017) Intermittent cervical traction for treating Neck Pain: a Meta-analysis of Randomized controlled trials. Spine 42:959–965

    Article  CAS  PubMed  Google Scholar 

  32. Fernandez M, Moore C, Tan J et al (2020) Spinal manipulation for the management of cervicogenic headache: a systematic review and meta-analysis. Eur J Pain 24:1687–1702

    Article  PubMed  Google Scholar 

  33. Amiri Arimi S, Mohseni Bandpei MA, Javanshir K et al (2017) The Effect of different Exercise Programs on size and function of deep cervical flexor muscles in patients with chronic nonspecific Neck Pain: a systematic review of Randomized controlled trials. Am J Phys Med Rehabil 96:582–588

    Article  PubMed  Google Scholar 

  34. de Araujo FX, Scholl Schell M, Ribeiro DC (2017) Effectiveness of physiotherapy interventions plus extrinsic feedback for neck disorders: a systematic review with meta-analysis. Musculoskelet Sci Pract 29:132–143

    Article  PubMed  Google Scholar 

  35. Dorji K, Graham N, Macedo L et al (2022) The effect of ultrasound or phonophoresis as an adjuvant treatment for non-specific neck pain: systematic review of randomised controlled trials. Disabil Rehabil 44:2968–2974

    Article  PubMed  Google Scholar 

  36. Lantz JM, Abedi A, Tran F et al (2021) The impact of physical therapy following cervical spine surgery for degenerative spine Disorders: a systematic review. Clin Spine Surg 34:291–307

    Article  PubMed  Google Scholar 

  37. Qing W, Shi X, Zhang Q et al (2021) Effect of therapeutic Ultrasound for Neck Pain: a systematic review and Meta-analysis. Arch Phys Med Rehabil 102:2219–2230

    Article  PubMed  Google Scholar 

  38. Southerst D, Nordin MC, Côté P et al (2016) Is exercise effective for the management of neck pain and associated disorders or whiplash-associated disorders? A systematic review by the Ontario Protocol for Traffic Injury Management (OPTIMa) collaboration. Spine J 16:1503–1523

    Article  PubMed  Google Scholar 

  39. Rodríguez-Huguet M, Vinolo-Gil MJ, Góngora-Rodríguez J (2022) Dry needling in physical therapy treatment of chronic Neck Pain: systematic review. J Clin Med 11:2370

    Article  PubMed  PubMed Central  Google Scholar 

  40. Gross A, Langevin P, Burnie SJ et al (2015) Manipulation and mobilisation for neck pain contrasted against an inactive control or another active treatment. Cochrane Database Syst Rev CD004249

  41. Hanel J, Owen PJ, Held S et al (2020) Effects of Exercise Training on Fear-Avoidance in Pain and Pain-Free populations: systematic review and Meta-analysis. Sports Med 50:2193–2207

    Article  PubMed  Google Scholar 

  42. Mallard F, Wong JJ, Lemeunier N, Côté P (2022) Effectiveness of Multimodal Rehabilitation Interventions for Management of Cervical Radiculopathy in adults: an updated systematic review from the Ontario Protocol for Traffic Injury Management (Optima) collaboration. J Rehabil Med 54:jrm00318

    Article  PubMed  Google Scholar 

  43. Martimbianco ALC, Porfírio GJ, Pacheco RL et al (2019) Transcutaneous electrical nerve stimulation (TENS) for chronic neck pain. Cochrane Database Syst Rev 12:CD011927

    PubMed  Google Scholar 

  44. Martin-Gomez C, Sestelo-Diaz R, Carrillo-Sanjuan V et al (2019) Motor control using cranio-cervical flexion exercises versus other treatments for non-specific chronic neck pain: a systematic review and meta-analysis. Musculoskelet Sci Pract 42:52–59

    Article  PubMed  Google Scholar 

  45. Masaracchio M, Kirker K, States R et al (2019) Thoracic spine manipulation for the management of mechanical neck pain: a systematic review and meta-analysis. PLoS ONE 14:e0211877

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  46. Price J, Rushton A, Tyros I et al (2020) Effectiveness and optimal dosage of exercise training for chronic non-specific neck pain: a systematic review with a narrative synthesis. PLoS ONE 15:e0234511

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  47. Rampazo ÉP, Martignago CCS, de Noronha M, Liebano RE (2022) Transcutaneous electrical stimulation in neck pain: a systematic review and meta-analysis. Eur J Pain 26:18–42

    Article  PubMed  Google Scholar 

  48. Tsiringakis G, Dimitriadis Z, Triantafylloy E, McLean S (2020) Motor control training of deep neck flexors with pressure biofeedback improves pain and disability in patients with neck pain: a systematic review and meta-analysis. Musculoskelet Sci Pract 50:102220

    Article  PubMed  Google Scholar 

  49. Varangot-Reille C, Cuenca-Martínez F, Arribas-Romano A et al (2022) Effectiveness of neural mobilization techniques in the management of Musculoskeletal Neck Disorders with nerve-related symptoms: a systematic review and Meta-analysis with a Mapping Report. Pain Med 23:707–732

    Article  PubMed  Google Scholar 

  50. Wang S-Q, Jiang A-Y, Gao Q (2022) Effect of manual soft tissue therapy on the pain in patients with chronic neck pain: a systematic review and meta-analysis. Complement Ther Clin Pract 49:101619

    Article  PubMed  Google Scholar 

  51. Wilhelm MP, Donaldson M, Griswold D et al (2020) The Effects of Exercise Dosage on Neck-Related Pain and disability: a systematic review with Meta-analysis. J Orthop Sports Phys Ther 50:607–621

    Article  PubMed  Google Scholar 

  52. Yu H, Côté P, Southerst D et al (2016) Does structured patient education improve the recovery and clinical outcomes of patients with neck pain? A systematic review from the Ontario Protocol for Traffic Injury Management (OPTIMa) collaboration. Spine J 16:1524–1540

    Article  PubMed  Google Scholar 

  53. Zacharakis A-M, Zanelli LM, Watkins HR et al (2020) What is the evidence for the effectiveness of Scapulothoracic strengthening exercises in individuals with Neck Pain: a systematic review. Internet J Allied Health Sci Pract 18:11

    Google Scholar 

  54. Chaibi A, Stavem K, Russell MB (2021) Spinal manipulative therapy for Acute Neck Pain: a systematic review and Meta-analysis of Randomised controlled trials. J Clin Med 10:5011

    Article  PubMed  PubMed Central  Google Scholar 

  55. Bobos P, MacDermid JC, Walton DM et al (2018) Patient-reported outcome measures used for Neck Disorders: an overview of systematic reviews. J Orthop Sports Phys Ther 48:775–788

    Article  PubMed  Google Scholar 

  56. Cleland JA, Fritz JM, Whitman JM, Palmer JA (2006) The reliability and construct validity of the Neck Disability Index and patient specific functional scale in patients with cervical radiculopathy. Spine 31:598–602

    Article  PubMed  Google Scholar 

  57. Modarresi S, Lukacs MJ, Ghodrati M et al (2021) A systematic review and synthesis of Psychometric Properties of the Numeric Pain Rating Scale and the Visual Analog Scale for Use in People with Neck Pain. Clin J Pain 38:132–148

    Article  PubMed  Google Scholar 

  58. Carfora L, Foley CM, Hagi-Diakou P et al (2022) Patients’ experiences and perspectives of patient-reported outcome measures in clinical care: a systematic review and qualitative meta-synthesis. PLoS ONE 17:e0267030

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  59. Boyce MB, Browne JP, Greenhalgh J (2014) The experiences of professionals with using information from patient-reported outcome measures to improve the quality of healthcare: a systematic review of qualitative research. BMJ Qual Saf 23:508–518

    Article  PubMed  Google Scholar 

  60. Vernon H, Mior S (1991) The Neck Disability Index: a study of reliability and validity. J Manipulative Physiol Ther 14:409–415

    CAS  PubMed  Google Scholar 

  61. Yeung AWK, Wong NSM (2019) The historical roots of Visual Analog Scale in psychology as revealed by reference publication year spectroscopy. Front Hum Neurosci 13:86

    Article  PubMed  PubMed Central  Google Scholar 

  62. Leak AM, Cooper J, Dyer S et al (1994) The Northwick Park Neck Pain Questionnaire, devised to measure neck pain and disability. Br J Rheumatol 33:469–474

    Article  CAS  PubMed  Google Scholar 

  63. Wheeler AH, Goolkasian P, Baird AC, Darden BV 2nd (1999) Development of the Neck Pain and Disability Scale. Item analysis, face, and criterion-related validity. Spine 24:1290–1294

  64. Ware JE Jr, Sherbourne CD (1992) The MOS 36-item short-form health survey (SF-36). I. conceptual framework and item selection. Med Care 30:473–483

    Article  PubMed  Google Scholar 

  65. Ware J Jr, Kosinski M, Keller SD (1996) A 12-Item short-form Health Survey: construction of scales and preliminary tests of reliability and validity. Med Care 34:220–233

    Article  PubMed  Google Scholar 

  66. Miller RP, Kori SH, Todd DD (1991) The Tampa Scale: a measure of Kinisophobia. Clin J Pain 7:51

    Article  Google Scholar 

  67. Waddell G, Newton M, Henderson I et al (1993) A fear-avoidance beliefs questionnaire (FABQ) and the role of fear-avoidance beliefs in chronic low back pain and disability. Pain 52:157–168

    Article  PubMed  Google Scholar 

  68. Young K, Steinhaus M, Gang C et al (2021) The Use of patient-reported outcomes Measurement Information System in Spine: a systematic review. Int J Spine Surg 15:186–194

    Article  PubMed  PubMed Central  Google Scholar 

  69. Skillgate E, Pico-Espinosa OJ, Hallqvist J et al (2017) Healthy lifestyle behavior and risk of long duration troublesome neck pain or low back pain among men and women: results from the Stockholm Public Health Cohort. Clin Epidemiol 9:491–500

    Article  PubMed  PubMed Central  Google Scholar 

  70. Kirsch Micheletti J, Bláfoss R, Sundstrup E et al (2019) Association between lifestyle and musculoskeletal pain: cross-sectional study among 10,000 adults from the general working population. BMC Musculoskelet Disord 20:609

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  71. Nijs J, Reis F (2022) The key role of lifestyle factors in perpetuating Chronic Pain: towards Precision Pain Medicine. J Clin Med Res 11. https://doi.org/10.3390/jcm11102732

  72. Neilson BD, Shepherd MH, Dickerson C et al (2022) Relationship between attitudes and beliefs about Sleep, Sleep Disturbance, and Pain Interference in patients with spinal Pain. Clin J Pain 38:541–549

    Article  PubMed  Google Scholar 

  73. Anarte-Lazo E, Bernal-Utrera C, Montaño-Ocaña J et al (2022) Higher Neck Pain Intensity and the Presence of Psychosocial factors are more likely when Headache is Present after a Whiplash Injury: a case-control study. Pain Med 23:1529–1535

    Article  PubMed  PubMed Central  Google Scholar 

  74. Leclerc A, Niedhammer I, Landre MF et al (1999) One-year predictive factors for various aspects of neck disorders. Spine 24:1455–1462

    Article  CAS  PubMed  Google Scholar 

  75. Carroll LJ, Hogg-Johnson S, Côté P et al (2009) Course and prognostic factors for neck pain in workers: results of the bone and joint decade 2000–2010 Task Force on Neck Pain and its Associated Disorders. J Manipulative Physiol Ther 32:S108–S116

    Article  PubMed  Google Scholar 

  76. Williams AC, de Fisher C, Hearn E, Eccleston L C (2020) Psychological therapies for the management of chronic pain (excluding headache) in adults. Cochrane Database Syst Rev 8:CD007407

    PubMed  Google Scholar 

  77. Campbell P, Bishop A, Dunn KM et al (2013) Conceptual overlap of psychological constructs in low back pain. Pain 154:1783–1791

    Article  PubMed  PubMed Central  Google Scholar 

  78. Wideman TH, Hill JC, Main CJ et al (2012) Comparing the responsiveness of a brief, multidimensional risk screening tool for back pain to its unidimensional reference standards: the whole is greater than the sum of its parts. PAIN® 153:2182–2191

    Article  PubMed  Google Scholar 

  79. Wilson AT, Riley JL 3rd, Bishop MD et al (2023) Pain phenotyping and investigation of outcomes in physical therapy: an exploratory study in patients with low back pain. PLoS ONE 18:e0281517

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  80. George SZ, Beneciuk JM, Lentz TA, Wu SS (2017) The optimal screening for prediction of Referral and Outcome (OSPRO) in patients with musculoskeletal pain conditions: a longitudinal validation cohort from the USA. BMJ Open 7:e015188

    Article  PubMed  PubMed Central  Google Scholar 

  81. Beneciuk JM, Lentz TA, He Y et al (2018) Prediction of Persistent Musculoskeletal Pain at 12 months: a secondary analysis of the optimal screening for prediction of Referral and Outcome (OSPRO) Validation Cohort Study. Phys Ther 98:290–301

    Article  PubMed  PubMed Central  Google Scholar 

  82. Butera KA, George SZ, Lentz TA (2020) Psychometric evaluation of the optimal screening for prediction of Referral and Outcome Yellow Flag (OSPRO-YF) Tool: factor structure, reliability, and Validity. J Pain 21:557–569

    Article  PubMed  Google Scholar 

  83. Wu B, Yuan H, Geng D et al (2020) The impact of a stabilization Exercise on Neck Pain: a systematic review and Meta-analysis. J Neurol Surg A Cent Eur Neurosurg 81:342–347

    Article  PubMed  Google Scholar 

Download references

Acknowledgements

We would like to thank Sarah Cantrell, MLIS from the Duke Medical Center Library & Archives of Duke University School of Medicine for assisting during the search strategy phase of our study.

Funding

No funding supported this study.

Author information

Authors and Affiliations

Authors

Contributions

MR and MH participated in article and abstract screening. SH contributed to the search strategy. MR, MH, MS contributed to data extraction. SJM, CH and MR contributed to risk of bias assessment. MR, MH, MS, SJM, CH, CB, LC, SH contributed to the writing of the manuscript. All authors read and approved the final manuscript.

Corresponding author

Correspondence to Michelle M. Ramirez.

Ethics declarations

Ethics approval and consent to participate

Not applicable.

Consent for publication

Not applicable.

Competing interests

The authors declare that they have no competing interests.

Additional information

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Electronic supplementary material

Below is the link to the electronic supplementary material.

Supplementary Material 1

Supplementary Material 2

Rights and permissions

Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article’s Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article’s Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Ramirez, M.M., Shepherd, M.H., Melnick, S.J. et al. Patient-reported outcome measures in physical therapy practice for neck pain: an overview of reviews. J Patient Rep Outcomes 7, 97 (2023). https://doi.org/10.1186/s41687-023-00637-0

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1186/s41687-023-00637-0

Keywords