Skip to main content

Table 3 Quality ratings of content validity studies following the COSMIN methodology

From: A critical evaluation of the content validity of patient-reported outcome measures assessing health-related quality of life in children with cancer: a systematic review

PROM

Content validity studies

Justification for given ratings other than ‘very good’ (V)

Patients

Experts

Parents1

Total content validation

Relevance

Comprehensiveness

Comprehensibility

Relevance

Comprehensiveness

Relevance

Comprehensiveness

DISABKIDS

I

I

I

D

D

I

I

I

Validity assessment of the DCGM-37 in cancer patients primarily based on quantitative methods; focus groups on ‘feasibility’ with nurses, only a few written comments by parents or patients; suggestions for reformulations and to add filter-questions did not result in according adaptations [55].

KIDSCREEN

N/A

N/A

N/A

N/A

N/A

N/A

N/A

I

The assessment of psychometric properties of the final 52-item-version were exclusively based on quantitative methods [47, 48]. For the development of the shorter versions with 27 and 10 items, no information was found.

KINDL-R Generic

I

I

I

I

I

N/A

N/A

I

A CV study in children with chronic diseases (asthma, diabetes, not cancer), was ‘doubtful’, as they rated the comprehensibility and relevance of the questionnaire as a whole instead of single items [76]. Further validation based on quantitative methods only [49, 50].

KINDL-R Oncology

N/A

N/A

N/A

N/A

N/A

N/A

N/A

I

As it relied solely on quantitative methods to analyze reliability and construct validity, the paper by Ergin et al. [60] can not be taken into account as a content validity study.

PAC-QoL Child

N/A

N/A

N/A

N/A

N/A

N/A

N/A

I

No CV study available, but within a short correspondence Dr. Cataudella (Research Gate, 08/17/2020) announced that another paper on face validity and preliminary psychometrics is in preparation.

PedsQL Generic

N/A

N/A

N/A

N/A

N/A

N/A

N/A

I

No CV study available. In a study validating its Arabic version, Arabiat et al. [83] ask healthy children—interestingly not the children with cancer, who participated as well—to comment on the comprehensibility. However, no further information on methods or results reported.

PedsQL Cancer

N/A

N/A

N/A

N/A

N/A

N/A

N/A

I

No CV study available. Study on Chinese translation did not provide any relevant information [84]..

PedsQL Brain Tumor

N/A

N/A

N/A

N/A

N/A

N/A

N/A

I

Available studies on validating the PedsQL Brain Tumor Module relied on quantitative methods only [63, 81] and thus cannot be considered as CV studies.

PROMIS Ped Profile

N/A

N/A

N/A

N/A

N/A

N/A

N/A

I

No CV study in pediatric cancer patients available. Studies investigating PROMIS-scales in children with cancer relied on quantitative methods only [56, 57, 94,95,96,97, 104]. Also, studies on translations and cross-cultural comparison did not rely on qualitative methods [95, 98, 99].

Jones et al. [105] asked pediatric cancer survivors as well as their parents and clinicians for relevance ratings of items from four PROMIS Pediatric scales (i.e., fatigue, pain interference, psychological stress, positive affect). However, they did not report overall scores for relevance ratings, but only differences between child- and parent-ratings.

Anxiety and depression2

N/A

N/A

N/A

N/A

N/A

N/A

N/A

I

Fatigue

N/A

N/A

N/A

N/A

N/A

N/A

N/A

I

Mobility and upper extremity2

N/A

N/A

N/A

N/A

N/A

N/A

N/A

I

Pain Intensity

N/A

N/A

N/A

N/A

N/A

N/A

N/A

I

Pain Interference

N/A

N/A

N/A

N/A

N/A

N/A

N/A

I

Peer Relationships

N/A

N/A

N/A

N/A

N/A

N/A

N/A

I

QOLCC-7-12

I

I

I

D

D

N/A

N/A

I

CV was assessed within a Master Thesis, which is only available in Chinese [Huang, 2000 cited in 100]. Following scarce information provided in later studies [65, 100], no patients or parents were included. Five experts were involved to rate the relevance, analyzed with the content validity index (CVI). As it is unclear whether two researchers conducted the analysis, the quality remains ‘doubtful’.

SQOLPOP

N/A

N/A

N/A

N/A

N/A

N/A

N/A

I

Further validity and reliability testing by Kudubes and Bektas [67] relies on quantitative methods only and therefore cannot be considered as CV study. No other CV study available.

TACQOL

N/A

N/A

N/A

N/A

N/A

N/A

N/A

I

No CV study available. The reference study relied on quantitative methods only [102].

  1. V, very good; A, adequate; D, doubtful; I, inadequate; N/A, no study available; “ see last rating above; bold = total ratings per section
  2. 1 This section was added to take the central role of parents in pediatric healthcare into account. As it is not required by the COSMIN Guidelines, ‘inadequate’ ratings were only given when parents were involved using ‘inadequate’ methods. If content validity studies were performed without parents, parent involvement was not rated
  3. 2 PROMIS-scales developed together in one study are listed in combined rows