Skip to main content

Literature review to characterize the empirical basis for response scale selection in pediatric populations

Abstract

Background

Despite the importance of response option selection for patient-reported outcome measures, there seems to be little empirical evidence for the selected scale type. This article provides an overview of the published research on response scale types and empirical support within pediatric populations.

Methods

A comprehensive review of the scientific literature was conducted to identify response scale option types appropriate for use in pediatric populations and to review and summarize the available empirical evidence for each scale type.

Results

Eleven review/consensus guideline/expert opinion articles and 20 empirical articles that provided guidance or evidence regarding pediatric response scale selection were identified. There was general consensus that 5-point verbal rating scales, including Likert scales, were appropriate for children aged 7 or 8 and older, while graphical or faces scales are often used in pediatric studies with children of younger ages.

Conclusion

In general, the verbal rating scale, numeric rating scale, visual analogue scale, and graphical scales have each demonstrated to be reliable and valid response option formats in specific contexts among pediatric populations; however, their appropriateness is dependent upon sample age. When selecting response scales, it is important to consider target population and context of use during the development of patient-reported outcome measures, especially with respect to tense, recall period, attribution, number of options, etc. In addition to age, cognitive development is an important aspect to consider for optimizing pediatric self-reported measures. More research is needed to determine clinically relevant changes and differences within pediatric research, which includes different response scale options.

Background

The development of patient-reported outcome (PRO) measures involves the identification of the relevant concepts which are measured through one or more items (questions or statements (items)) that can be evaluated by utilizing a response option set. The response options must be consistent with each item’s purpose and intended usage. The selection of response options is an important component of item construction and characterizes how the concept is measured. When determining the type of response options to be used, many factors must be taken into account, most importantly the target population and intended use of the item. For instance, Lukas et al. [1] was able to demonstrate reliable reports of pain through appropriate selection of response types based upon the cognitive ability of the target population.

Historical use of response option types, the use of qualitative research and the assessment of measurement properties contribute to the identification of response categories that will perform most reliably within the intended population. Special consideration should be given to different populations, particularly the pediatric population. Important characteristics of pediatric populations influencing response set choice include age, literacy skills, ability to verbally communicate, cognitive ability to quantify feelings or symptoms, and motivational desire to please or select the ‘right’ answer [2, 3]. Therefore the development of a reliable and valid PRO measure for the pediatric patient population presents unique challenges.

The thoughtful selection of response options for new pediatric PRO measures is important, however, there is very little empirical basis for the type of response scale selected or attributes of the response scale including, number of response options, visual orientation of the scale (for example, vertical vs. horizontal), and response scale anchor wording. The United States Food and Drug Administration emphasizes the importance of self-report in pediatric populations rather than proxy-report, but do not recommend any specific response options for inclusion in a PRO measure. However, several response option types commonly seen in PRO instruments are listed for consideration in their 2009 Guidance for Industry, titled Patient-Reported Outcome Measures: Use in Medical Product Development to Support Labeling Claims [4]. Typical response options employed in PRO instruments include verbal rating scales (VRS), visual analogue scales (VAS), numeric rating scales (NRS), and various graphical scales such as a Faces scale. In the pediatric literature, it has been reported that children can reliably distinguish and understand fewer response options than adults; for example, in testing the Childhood Asthma Control Test, Liu et al. [5] found that a 4-point response scale was optimal. Further, graphical rather than numeric or verbal response scales may enhance comprehension of response scales in children [2].

The purpose of this article is to provide an overview of the published research on response scale option types used within pediatric populations. Evidence identified through this comprehensive literature review is intended to inform and enhance response scale selection for newly developed PRO instruments designed for use in pediatric populations.

Methods

Search procedure

A comprehensive review of the scientific literature was conducted to identify appropriate response scale option types for the pediatric population, and to review and summarize the available empirical evidence for each type of scale. The literature review was part of a larger study, funded by the Critical Path Institute’s Patient-Reported Outcome (PRO) Consortium, to summarize the available empirical evidence to support response option selection for PRO measures, by context of use. Published articles, limited to English-based in the preceding 10 years (2004–2014), were retrieved and reviewed to provide information on optimal response options for PRO measures in the pediatric population.

The search databases included EMBASE, MEDLINE, and PsycINFO. In addition to formal searches, a number of supplementary sources were utilized to identify additional relevant articles for inclusion in the review. Further, the reference lists of articles identified from the formal and supplementary searches were also reviewed to identify additional articles to be included in the review.

Lastly, a search was conducted for presentation abstracts that were accepted during the past two years of the meetings/conferences of the International Society for Pharmacoeconomics and Outcomes Research (2013 and 2014) and the International Society for Quality of Life Research (2012 and 2013) meetings/conferences to identify any scientific disclosures prior to publication in the peer-reviewed literature.

Search strategy

Search terms used to identify articles in EMBASE, MEDLINE, and PsycINFO that met the search objective and were applicable to the pediatric population are presented in Table 1. Articles that provided both direct and indirect evidence were included. Direct evidence was defined as evidence that provided a direct answer to the research question of interest; for example, direct evidence articles empirically compared the relative robustness or merits of two different response scale types within the same study/population. Indirect evidence was defined as relevant evidence that should be considered in the review and overall conclusions, but that did not directly answer the research question or hypothesis. Articles were excluded if they provided no direct or indirect evidence relevant to the search objectives, were not applicable to PRO development, or addressed an area not pre-specified for inclusion.

Table 1 Literature review search terms

Data extraction

During the review process, eligibility assessment of both abstracts and full text articles were evaluated by two independent reviewers. In the case of non-agreement, a third senior reviewer made the final judgment. Relevant data were extracted from articles that were identified based on the inclusion/exclusion criteria and summarized in tables. For each article included in the review, an assessment on the quality of the data presented and therefore strength of results and recommendations was made. Each article was assigned a grade based on the type of article and strength of the data, as outlined by the following criteria:

  1. A.

    Primary research; compares different response scales within the study.

  2. B.

    Review or expert opinion; based on empirical evidence.

  3. C.

    Primary research; evaluates a single response scale type within the study.

  4. D.

    Review or expert opinion; based on expert consensus, convention or historical experience.

The letter grade A reflects the strongest empirical evidence for response scale recommendation and a letter grade D reflects the weakest empirically-based evidence.

Results

The initial search yielded 1083 abstracts; a manual review of additional articles yielded 11 articles; lastly, a review of the potential 439 conference abstracts with the term “scale” yielded three potential abstracts. After abstract and full text screening and screening references from additional sources (full literature review results), in this review, we identified 6 review/consensus guideline/expert opinion articles and 16 empirical articles that provided guidance or evidence regarding pediatric response scale selection (Fig. 1). Three age groups (4 to 8 years, 6 to 18 years, and 10 to 18 years) emerged as most commonly described in the literature.

Fig. 1
figure 1

Screening and Review Process

Across the review and expert opinion articles, there was general consensus that the 5-point VRS, including Likert scales, were appropriate for children 7 or 8 years of age and older (Table 2) [2, 6]. While graphical or faces scales are often used in pediatric studies [7, 8], some of the review articles noted that additional empirical evidence is needed to support the use of these scales and the specific ages for which they are appropriate [2]. There is some evidence that supports using a facial-graphics enhanced response scale in younger children (between the ages of 4 and 7) [9]. For children ages 7 or 8 and older, some review articles advocated use of NRS or VAS [9], whereas another article suggested that children prefer a VRS to an NRS or VAS [2]. Cohen et al. [10] noted that visual orientation of scales, emotions expressed in graphical scales, and word choice for verbal anchors can produce unexpected biases due to immaturity in abstract thinking skills of respondents; for example, a child might choose a numerical response based on favorite number rather than representation of experience.

Table 2 Summary of Key Evidence to Support Response Scale Selection for the Pediatric Population

Children between the ages of 4 and 8

Table 3 presents the empirical studies evaluating optimal response scale choice among the youngest of respondents (ranging in age from 4 up to 7 to 8). Liu et al. [5] found a 4-point VRS with graphical faces to aid in response-enhanced comprehension of the scale in children between 4 and 11 years of age. In a study evaluating various pain response scales for use in children between the ages of 6 and 8, results were inconclusive as to whether a Faces, NRS, VAS, or a color scale (e.g., children select a color associated with level of intensity), was superior [11]. These response scales did produce different estimates of pain and were not considered interchangeable in young children [11].

Table 3 Summary of key evidence to support response scale selection for children 4 to 8 years old

Children between the ages of 6 and 18

Table 4 includes the studies evaluating multiple response scales within the same study among children 6 years of age and older. Van Laerhoven et al. [12] found a 5-point VRS to be preferred over VAS or NRS in children 6 to 18 years of age, but all scale types showed comparable reliability. In contrast, Jylli et al. [13] found that younger children (ages 6 to 11 years) in their sample (overall range between 6 and 16 years of age) did not fully understand all descriptive words in a 5-point VRS, and that the VRS was not highly correlated with a pain VAS. Bailey et al. [14] found the VAS, NRS, and VRS to be reliable and valid in evaluating pain in children 8 to 17 years of age, but the scores produced were not interchangeable. Connelly and Neville [15] found that the VAS, NRS, and Faces scales tended to be highly inter-related, but scores were generally higher on the NRS, and that VAS and Faces were more responsive to decreasing trends in pain scores in children between the ages of 9 and 18. Bailey et al. [16] evaluated the correspondence between NRS, VAS, VAS with color, and Faces scales in children ages 8 to 18 who had abdominal pain, and found that, while there was high correspondence between the VAS and VAS with color, the NRS did not correspond with the other scale types. Benini et al. [17] found VAS to be easiest for children 7 to 18 years of age to understand and use as compared to Faces and other graphical scales, especially for children with mild or moderate developmental delay suffering from Down’s syndrome or spastic tetraplegia.

Table 4 Summary of key evidence to support response scale selection for children 6 to 18 years old

Children between the ages of 10 and 18

Table 5 presents studies evaluating response scale selection in older children (10 to 18 years). The NRS was found to produce higher scores than either the VAS or Faces scale, but the NRS had higher correspondence with the VAS than it had with Faces [18]. A 5-point VRS was found to be well accepted and understood [19]. Finally, a 5-point VRS was found to be stable regardless of recall period [20].

Table 5 Summary of key evidence to support response scale selection for children 10 to 18 years old

Discussion

The aim of this review was to provide an overview of the published research on response scale option types used within pediatric populations. Results showed that there was empirical evidence supporting the use of VRS, NRS, and VAS response options in children and adolescents aged 8 to 18 years with age-appropriate literacy skills and cognitive development. There was also evidence that self-report instruments can be used for children as young as 4 years of age when graphical scales are used as the response scale option. Meanwhile, there was little support in the published literature for a preferred response scale option type in the age group 8 to 18 years. Our findings indicate the importance of evaluating different response options in cognitive interviews when developing a new or modifying an existing PRO measure.

In a 2007 review, Grange et al. stated that, for children younger than 5 years old, there was no clear empirical support for the use of self-report instruments [21]. Instead it was recommended that assessments regarding these children should rely upon clinical measures and observational reports. When they evaluated the psychometric properties of different health-related quality of life instruments that measure physical and/or emotional impact of symptoms, Grange et al. noted that these aspects may be just too abstract for children younger than 5 years old [21]. However, several studies have shown that children from the age of 4 years often can provide information on their health status, especially when it concerns concrete aspects, such as pain and use of medication [5, 11]. Well-defined, tangible concepts are important when considering self-report for this population.

When choosing response options to be used for 4 to 7 year olds, limitations in reading skills, vocabulary, and conceptual understanding of numbers must also be considered [2, 3]. Hence, the VRS, VAS, and NRS are likely not appropriate response options [2, 3, 9, 22]; whereas several instruments that use different graphical scales have shown acceptable validity and reliability (e.g., [5, 23]). However, there were aspects found among the acceptable graphical response options that were problematic. These included the expression of gender neutrality, the depiction of images resembling a target population or a stereotype of that population, and the recognition that the emotional cues expressed, such as smiling or frowning, in the faces in a graphical response option may be culturally dependent [5, 10].

As for the age group of 10 to 17 years, there was limited support in the published literature for any user-preferred response option. However, some studies have shown that the VAS appears to have shortcomings in this age group. Shields et al. [24] found that only one-third of study participants aged 5 to 14 were able to understand the VAS, and that those who were able to understand the VAS were significantly older (mean = 9.8 years) than those who did not understand it (mean = 8.2 years). More studies are needed to evaluate the robustness of these findings.

Development of PRO measures should be conducted so that the target population informs the selection of the type and the appropriate number of response options, recall period, attribution, etc. While VAS, NRS, VAS, and graphical scales have demonstrated to be reliable and valid formats when used in specific contexts among pediatric populations, response type used should be confirmed for each construct of interest and intended use [25]. The selection of responses should consider psychometric properties, represent the full continuum of the potential respondent experience, and should be ordered, equally spaced, and distinct from one another [4, 26, 27]. Ease of translatability and cultural adaptation should be considered and assessed early in development of PRO measures. While expert opinion and experience suggests the NRS may not pose problems in translation as the response numbers are not changed, the choice of word(s) used for NRS and VAS anchors may have implications for translations.

Typically 5- or 7-point scales are easier to translate than scales with more than seven response choices which can pose problems in other languages where more granular verbal distinctions do not exist. In a review of the translatability of various commonly used verbal anchors, agreement anchors (e.g., strongly agree, agree, disagree, strongly disagree) were found to be easy to translate and to have a high degree of equivalence across languages. In contrast, terms such as “fair” have multiple translation options and connotations across languages. Anchors such as “a little bit” are difficult to translate because of the lack of equivalence for the term “bit” in some languages. Further, item stems and response anchors corresponding to “…of the time” were found to be difficult to translate comparably across languages [28]. Authors recommended that the NRS or VAS should be used where possible, as those need only minimal translation [28].

Furthermore, the intended mode of data collection (e.g., paper/pen versus electronic) should be considered depending on the age of the person completing the instrument [29, 30]. Based on expert opinion and experience, an NRS response set can be easily implemented via electronic modality in an interactive voice response system, handheld (smartphone), tablet, and Web modes. However, formatting on handheld, tablet, and Web-based systems needs to be carefully considered so that the anchors of the NRS are associated with their intended number, and no ambiguity is caused by anchors that extend beyond one numerical category. It is impossible to implement a VAS using an interactive voice response system because the participant cannot place a mark on the line. Further, a VAS may be challenging to implement in other electronic modes due to screen size limitations and space constraints that cannot accommodate the 100-mm length presented on paper. Modifications such as a shorter line length that provides 101 data points can accomplish the same goal, as the electronic version scores the response automatically, eliminating the need for manual measurement using a ruler. For a VRS, the number of response options and length of verbal descriptors should be carefully selected so as to lighten the cognitive load (for an interactive voice response system) and to allow for equidistant formatting on one screen for handheld, tablet, and Web-based implementations. Faces scales, though less widely utilized in the PRO measurement literature reviewed, cannot be administered orally (via an interactive voice response system), but are easily administered via screen-based electronic modes.

This literature review was conducted in early 2015 and was limited to articles published in English during a 10-year timespan from 2004 through 2014, from which the key direct and indirect evidence was identified. Each article was graded based on the type of article and strength of the data. The search strategy was based on pre-specified criteria that may not have been inclusive of global research utilizing different terminology for PRO instruments designed for use in specific pediatric populations (e.g. “response format”, “response option”, “response set”, “item format”, “PROM”, or “patient-reported outcome(s)”), thus introducing risk of omitting relevant studies in the literature. Due to the scope of our literature review and the paucity of literature identified, more differentiated presentation of the findings was not pragmatic.

Conclusion

The VRS, NRS, VAS, and graphical scales can all be reliable and valid response options in pediatric populations. However, the current empirical basis is insufficient to draw firm conclusions and to make differentiated recommendations. Therefore, when choosing a response format, it is important to consider the context of use during the development/modification of PRO measures and the study design. Apart from age, important aspects to consider are cultural background and cognitive development. More global studies on children’s preferences for response formats are needed to optimize pediatric self-reported measures. Additionally, more research is needed to assess the psychometric properties of items and their response options, to determine clinically meaningful changes and differences within pediatric clinical trials, which are impacted by the response scale chosen and the scoring function applied.

Abbreviations

NRS:

numeric rating scale

PRO:

patient-reported outcome

VAS:

visual analogue scale

VRS:

verbal rating scale

References

  1. Lukas, A., Niederecker, T., Gunther, I., Mayer, B., & Nikolaus, T. (2013). Self- and proxy report for the assessment of pain in patients with and without cognitive impairment: Experiences gained in a geriatric hospital. Zeitschrift für Gerontologie und Geriatrie, 46(3), 214–221. https://doi.org/10.1007/s00391-013-0475-y.

    Article  CAS  PubMed  Google Scholar 

  2. Matza, L. S., Patrick, D. L., Riley, A. W., Alexander, J. J., Rajmil, L., Pleil, A. M., & Bullinger, M. (2013). Pediatric patient-reported outcome instruments for research to support medical product labeling: Report of the ispor pro good research practices for the assessment of children and adolescents task force. Value in Health, 16(4), 461–479. https://doi.org/10.1016/j.jval.2013.04.004.

    Article  PubMed  Google Scholar 

  3. Eiser, C., Mohay, H., & Morse, R. (2000). The measurement of quality of life in young children. Child: Care, Health and Development, 26(5), 401–414.

    CAS  Google Scholar 

  4. Center for Drug Evaluation and Research (CDER), in cooperation with the Center for Biologics Evaluation and Research (CBER), and the Center for Devices and Radiological Health (CDRH), at the Food and Drug Administration (FDA), Guidance for industry. (2009). Patient-reported outcome measures: Use in medical product development to support labeling claims. Silver Spring: Food and Drug Administration Available at https://www.Fda.Gov/downloads/drugs/guidances/ucm193282.Pdf.

    Google Scholar 

  5. Liu, A. H., Zeiger, R., Sorkness, C., Mahr, T., Ostrom, N., Burgess, S., Rosenzweig, J. C., & Manjunath, R. (2007). Development and cross-sectional validation of the childhood asthma control test. The Journal of Allergy and Clinical Immunology, 119(4), 817–825. https://doi.org/10.1016/j.jaci.2006.12.662.

    Article  PubMed  Google Scholar 

  6. Matza, L. S., Swensen, A. R., Flood, E. M., Secnik, K., & Leidy, N. K. (2004). Assessment of health-related quality of life in children: A review of conceptual, methodological, and regulatory issues. Value in Health, 7(1), 79–92. https://doi.org/10.1111/j.1524-4733.2004.71273.x.

    Article  PubMed  Google Scholar 

  7. D'Arcy, Y. (2011). Compact clinical guide to acute pain management: An evidence-based approach for nurses first edn. New York: Springer Publishing Co..

    Google Scholar 

  8. Tomlinson, D., von Baeyer, C. L., Stinson, J. N., & Sung, L. (2010). A systematic review of faces scales for the self-report of pain intensity in children. Pediatrics, 126(5), e1168–e1198. https://doi.org/10.1542/peds.2010-1609.

    Article  PubMed  Google Scholar 

  9. von Baeyer, C. L. (2006). Children's self-reports of pain intensity: Scale selection, limitations and interpretation. Pain Research & Management, 11(3), 157–162.

    Article  Google Scholar 

  10. Cohen, L. L., Lemanek, K., Blount, R. L., Dahlquist, L. M., Lim, C. S., Palermo, T. M., McKenna, K. D., & Weiss, K. E. (2008). Evidence-based assessment of pediatric pain. Journal of Pediatric Psychology, 33(9), 939–955; discussion 956-937. https://doi.org/10.1093/jpepsy/jsm103.

    Article  PubMed  Google Scholar 

  11. Sanchez-Rodriguez, E., Miro, J., & Castarlenas, E. (2012). A comparison of four self-report scales of pain intensity in 6- to 8-year-old children. Pain, 153(8), 1715–1719. https://doi.org/10.1016/j.pain.2012.05.007.

    Article  PubMed  Google Scholar 

  12. van Laerhoven, H., van der Zaag-Loonen, H. J., & Derkx, B. H. (2004). A comparison of likert scale and visual analogue scales as response options in children's questionnaires. Acta Paediatrica, 93(6), 830–835.

    Article  CAS  PubMed  Google Scholar 

  13. Jylli, L., Brostrom, E., Hagelberg, S., Stenstrom, C. H., Olsson, G. L., & Langius-Eklof, A. (2006). Sensory and affective components of pain as recorded with the pain-o-meter (pom) among children with acute and chronic pain. Acta Paediatrica, 95(11), 1429–1434. https://doi.org/10.1080/08035250600667383.

    Article  PubMed  Google Scholar 

  14. Bailey, B., Daoust, R., Doyon-Trottier, E., Dauphin-Pierre, S., & Gravel, J. (2010). Validation and properties of the verbal numeric scale in children with acute pain. Pain, 149(2), 216–221. https://doi.org/10.1016/j.pain.2009.12.008.

    Article  PubMed  Google Scholar 

  15. Connelly, M., & Neville, K. (2010). Comparative prospective evaluation of the responsiveness of single-item pediatric pain-intensity self-report scales and their uniqueness from negative affect in a hospital setting. The Journal of Pain, 11(12), 1451–1460. https://doi.org/10.1016/j.jpain.2010.04.011.

    Article  PubMed  Google Scholar 

  16. Bailey, B., Bergeron, S., Gravel, J., & Daoust, R. (2007). Comparison of four pain scales in children with acute abdominal pain in a pediatric emergency department. Ann Emerg Med, 50(4), 379–383, 383 e371-372. https://doi.org/10.1016/j.annemergmed.2007.04.021.

    Article  PubMed  Google Scholar 

  17. Benini, F., Trapanotto, M., Gobber, D., Agosto, C., Carli, G., Drigo, P., Eland, J., & Zacchello, F. (2004). Evaluating pain induced by venipuncture in pediatric patients with developmental delay. The Clinical Journal of Pain, 20(3), 156–163.

    Article  PubMed  Google Scholar 

  18. Takahashi, J. M., & Yamamoto, L. G. (2006). Correlation and consistency of pain severity ratings by teens using different pain scales. Hawaii Medical Journal, 65(9), 257–259.

    PubMed  Google Scholar 

  19. Lakkis, C., & Weidemann, K. (2006). Evaluation of the performance of photochromic spectacle lenses in children and adolescents aged 10 to 15 years. Clinical & Experimental Optometry, 89(4), 246–252. https://doi.org/10.1111/j.1444-0938.2006.00056.x.

    Article  Google Scholar 

  20. Bennett, A. V., Patrick, D. L., Lymp, J. F., Edwards, T. C., & Goss, C. H. (2010). Comparison of 7-day and repeated 24-hour recall of symptoms of cystic fibrosis. Journal of Cystic Fibrosis, 9(6), 419–424. https://doi.org/10.1016/j.jcf.2010.08.008.

    Article  PubMed  Google Scholar 

  21. Grange, A., Bekker, H., Noyes, J., & Langley, P. (2007). Adequacy of health-related quality of life measures in children under 5 years old: Systematic review. Journal of Advanced Nursing, 59(3), 197–220. https://doi.org/10.1111/j.1365-2648.2007.04333.x.

    Article  PubMed  Google Scholar 

  22. Dahlquist, L. M. (1990). Obtaining child reports in health care settings in: LaGreca a (ed) through the eyes of the child: Obtaining self-reports from children and adolescents (pp. 395–439). Boston: Allyn and Bacon.

    Google Scholar 

  23. Garra, G., Singer, A. J., Taira, B. R., Chohan, J., Cardoz, H., Chisena, E., & Thode Jr., H. C. (2010). Validation of the wong-baker faces pain rating scale in pediatric emergency department patients. Academic Emergency Medicine, 17(1), 50–54. https://doi.org/10.1111/j.1553-2712.2009.00620.x.

    Article  PubMed  Google Scholar 

  24. Shields, B. J., Cohen, D. M., Harbeck-Weber, C., Powers, J. D., & Smith, G. A. (2003). Pediatric pain measurement using a visual analogue scale: A comparison of two teaching methods. Clinical Pediatrics (Phila), 42(3), 227–234. https://doi.org/10.1177/000992280304200306.

    Article  Google Scholar 

  25. Liegl, G., Gandek, B., Fischer, H. F., Bjorner, J. B., Ware Jr., J. E., Rose, M., Fries, J. F., & Nolte, S. (2017). Varying the item format improved the range of measurement in patient-reported outcome measures assessing physical function. Arthritis Research & Therapy, 19(1), 66. https://doi.org/10.1186/s13075-017-1273-5.

    Article  Google Scholar 

  26. Marfeo, E. E., Ni, P., Chan, L., Rasch, E. K., & Jette, A. M. (2014). Combining agreement and frequency rating scales to optimize psychometrics in measuring behavioral health functioning. Journal of Clinical Epidemiology, 67(7), 781–784. https://doi.org/10.1016/j.jclinepi.2014.02.005.

    Article  PubMed  PubMed Central  Google Scholar 

  27. Gries K, Berry P, Harrington M, Crescioni M, Patel M, Rudell K, Safikhani S, Pease S, Vernon M (Under review) literature review to assemble the evidence for response scales used in patient-reported outcome measures. Journal of Patient-Reported Outcomes. https://doi.org/10.1186/s41687-018-0056-3.

  28. Gawlicki, M. C., McKown, S., Talbert, M., & Brandt, B. A. (2013). Translatability of response sets used in patient reported outcomes and best practices for development. Miami: Paper presented at the ISOQOL 20th annual conference.

    Google Scholar 

  29. Coons, S. J., Eremenco, S., Lundy, J. J., O'Donohoe, P., O'Gorman, H., & Malizia, W. (2015). Capturing patient-reported outcome (pro) data electronically: The past, present, and promise of epro measurement in clinical trials. The patient, 8(4), 301–309. https://doi.org/10.1007/s40271-014-0090-z.

    Article  PubMed  Google Scholar 

  30. von Niederhausern, B., Saccilotto, R., Schadelin, S., Ziesenitz, V., Benkert, P., Decker, M. L., Hammann, A., Bielicki, J., Pfister, M., & Pauli-Magnus, C. (2017). Validity of mobile electronic data capture in clinical studies: A pilot study in a pediatric population. BMC Medical Research Methodology, 17(1), 163. https://doi.org/10.1186/s12874-017-0438-x.

    Article  PubMed  PubMed Central  Google Scholar 

Download references

Acknowledgements

The authors gratefully acknowledge the managerial and logistical support provided by Theresa Hall during the completion of the overall project and these manuscripts. They thank Janet Dooley of the Evidera Editorial and Design team for her editorial and preparation assistance. In addition, they thank Sarah Mann of the PRO Consortium for her assistance to the authors with communications, and reporting of disclosures and contributions.

Funding

This project was funded by the Patient-Reported Outcome (PRO) Consortium’s Measurement Projects Fund. The Measurement Projects Fund is supported by the members of the PRO Consortium (https://c-path.org/programs/pro/). The Critical Path Institute’s PRO Consortium is funded, in part, by Critical Path Public Private Partnerships Grant number U18 FD005320 from the U.S. Food and Drug Administration.

Availability of data and materials

This article is entirely based on data and materials that have been published, are publicly available (thus, accessible to any interested researcher), and appear in the References list.

Author information

Authors and Affiliations

Authors

Contributions

Concentrating on the study concept and design were AN, KG, and SS: JH and SS acquired the data; MV focused on the analysis and data interpretation, as did KG and SS. All the authors have agreed to be accountable for all aspects of the work, particularly for ensuring that any questions of the work’s accuracy or integrity are promptly investigated and resolved. All authors have given their approval of the final version or the manuscript. Each author participated in creating drafts of the manuscript or in critical revisions.

Corresponding author

Correspondence to Margaret Vernon.

Ethics declarations

Ethics approval and consent to participate

This article does not contain any studies with human participants or animals performed by any of the authors.

Consent for publication

Not applicable.

Competing interests

Mabel Crescioni and Mira Patel report no employment in a pharmaceutical company nor do they hold stocks, shares, or stock options in a pharmaceutical company. Katherine Gries reports she is a current employee at Janssen but reports no stocks, shares, nor options. Anna Rydén is an employee and shareholder of AstraZeneca. Jennifer T. Hanlon is a salaried employee who owns stocks, shares, and stock options at Ironwood Pharmaceuticals. April N. Naegeli is a salaried employee who owns stocks, shares, and stock options at Eli Lilly and Company. Shima Safikhani and Margaret Vernon are employees of Evidera, a research and consulting firm to the biopharma industry and, as such, are not allowed to accept remuneration from any Evidera clients. None of these authors report any other arrangements that could be perceived as conflicts of interest.

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Open Access This article is distributed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Naegeli, A.N., Hanlon, J., Gries, K.S. et al. Literature review to characterize the empirical basis for response scale selection in pediatric populations. J Patient Rep Outcomes 2, 39 (2018). https://doi.org/10.1186/s41687-018-0051-8

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1186/s41687-018-0051-8

Keywords