Skip to main content

Psychometric performance of the Chichewa versions of the EQ-5D-Y-3L and EQ-5D-Y-5L among healthy and sick children and adolescents in Malawi

Abstract

Objectives

The EuroQol Group has developed an extended version of the EQ-5D-Y-3L with five response levels for each of its five dimensions (EQ-5D-Y-5L). The psychometric performance has been reported in several studies for the EQ-5D-Y-3L but not for the EQ-5D-Y-5L. This study aimed to psychometrically evaluate the EQ-5D-Y-3L and EQ-5D-Y-5L Chichewa (Malawi) versions.

Methods

The EQ-5D-Y-3L, EQ-5D-Y-5L and PedsQL™ 4.0 Chichewa versions were administered to children and adolescents aged 8–17 years in Blantyre, Malawi. Both of the EQ-5D-Y versions were evaluated for missing data, floor/ceiling effects, and validity (convergent, discriminant, known-group and empirical).

Results

A total of 289 participants (95 healthy, and 194 chronic and acute) self-completed the questionnaires. There was little problem with missing data (< 5%) except in children aged 8–12 years particularly for the EQ-5D-Y-5L. Ceiling effects was generally reduced in moving from the EQ-5D-Y-3L to the EQ-5D-Y-5L. For both EQ-5D-Y-3L and EQ-5D-Y-5L, convergent validity tested with PedsQL™ 4.0 was found to be satisfactory (correlation ≥ 0.4) at scale level but mixed at dimension /sub-scale level. There was evidence of discriminant validity (p > 0.05) with respect to gender and age, but not for school grade (p < 0.05). For empirical validity, the EQ-5D-Y-5L was 31–91% less efficient than the EQ-5D-Y-3L at detecting differences in health status using external measures.

Conclusions

Both versions of the EQ-5D-Y-3L and EQ-5D-Y-5L had issues with missing data in younger children. Convergent validity, discriminant validity with respect to gender and age, and known-group validity of either measures were also met for use among children and adolescents in this population, although with some limitations (discriminant validity by grade and empirical validity). The EQ-5D-Y-3L seems particularly suited for use in younger children (8–12 years) and the EQ-5D-Y-5L in adolescents (13–17 years). However, further psychometric testing is required for test re-test reliability and responsiveness that could not be carried out in this study due to COVID-19 restrictions.

Introduction

The adult EQ-5D-3L, is one of the most widely used preference-based health-related quality of life (HRQoL) measures for health economic evaluations [1]. Despite this prominence, the EQ-5D-3L has been criticized for its simplicity and insensitivity to small changes in health status, leading to the development of the five response level, the EQ-5D-5L [2]. Evidence suggests that the EQ-5D-5L performs better, is less affected by ceiling effects and improves known-group validity compared to the EQ-5D-3L [3,4,5].

The youth friendly three response level, EQ-5D-Y-3L, and the experimental five response level EQ-5D-Y-5L have emerged from the adult EQ-5D versions [6, 7]. The EQ-5D-Y-5L was developed on the same premise as the adult EQ-5D-5L version to increase sensitivity and reduce ceiling effects [2]. Psychometric performance of the EQ-5D-Y-3L has been reported in studies involving children with different health conditions [8,9,10]. To a large extent, it has demonstrated good reliability, with acceptable levels of convergent, discriminant and known-group validity [11,12,13], but has reported problems with missing values [14]. The performance of the newly developed EQ-5D-Y-5L has only been reported in a small number of studies [15,16,17,18,19,20,21,22]. The EQ-5D-Y-5L has demonstrated feasibility and minimal ceiling effects in these studies, but it has not performed differently on other psychometric properties compared to the EQ-5D-Y-3L [15, 17, 23].

Neither the EQ-5D-Y-3L nor the EQ-5D-Y-5L have been psychometrically evaluated in Malawi where economic evaluation in health programs is becoming increasingly important [24]. This study set out to psychometrically evaluate the Chichewa (Malawi’s national language) versions of the EQ-5D-Y-3L and EQ-5D-Y-5L among children and adolescents.

Methods

Participants, recruitment and procedure

The study recruited participants from a convenience sample of healthy and sick children (8–12 years) and adolescents (13–17 years) in urban Blantyre, Malawi. Children and adolescents attending schools and seeking any health care services through out-patient department at the Queen Elizabeth Central Hospital made up healthy and sick participants, respectively. Written assent and consent was obtained from children and their parents/guardians. For sick participants, the invitation came at the end of clinical care. For healthy participants, invitations were made through the school via a teacher. Participants took the study information leaflets and consent forms home for receipt of consent by their respective parents/guardians and these were brought back to the school the following day. For both sets of participants, once consent was obtained, the questionnaires were distributed by the research team at the end of clinical care or interviews were arranged on a school day. Once the participants completed the questionnaires (in clinic or classroom settings, respectively), the forms were handed over and collected by the study staff. Only children who were literate (as evident from the written consenting process) and therefore able to self-complete the questionnaires were included, but the critically ill were excluded from recruitment. As previous research had revealed a tendency for respondents to avoid the middle responses when completing the adult EQ-5D-5L questionnaire if the EQ-5D-3L is administered first [3], the EQ-5D-Y-5L was administered before the EQ-5D-Y-3L. This was followed by the self-report Pediatric Quality of Life (PedsQL)™ 4.0 Generic Core Scales for children (8–12 years) or teens (13–17 years). Ethical approval for this study was granted by Ethics Committees at the Malawi College of Medicine (now KUHeS) (P.10/18/2509) and Liverpool School of Tropical Medicine (19-045). A sample size of 200 participants was calculated to provide 80% power, at the two-sided significance level of 0.05, to address the minimum psychometric criteria for convergent and discriminant validity.

The instruments

The EQ-5D-Y-3L

The EQ-5D-Y-3L consists of five dimensions: ‘mobility’, ‘looking after myself’, ‘doing usual activities’, ‘having pain or discomfort’, and ‘feeling worried, sad or unhappy’. Responses in each dimension are separated into three ordinal levels: (1) no problems, (2) some problems /a bit, and (3) a lot of problems/very. Self-rated health status was also assessed with the measure’s visual analogue scale (EQ VAS), a vertical scale with scores ranging between 0 (representing worst imaginable health) and 100 (representing best imaginable health). The EQ-5D-Y has a same day recall period [6].

The EQ-5D-Y-5L

The EQ-5D-Y-5L consists of the same five dimensions as the EQ-5D-Y-3L but with five responses each: (1) no problems/not, (2) a little bit of a problem, (3) some problems /quite, (4) a lot of problems/really, and (5) extreme problems/extremely/cannot.

The cross-cultural adaptation of both the EQ-5D-Y-3L and EQ-5D-Y-5L into Chichewa has been reported elsewhere [25]. Briefly, this included forward and backward translation, and cognitive debriefing among children and adolescents aged 8–15 years. Sociodemographic and medical data were also recorded for each participant on a separate page.

The EQ-5D-Y-3L and EQ-5D-Y-5L were scored using the sum scores by summing the responses. The sum score is a crude measure with some limitations, but for psychometric evaluation it gives a better indication of the dimension performance [26]. A health state (represented by responses) ‘11111’ (denoting a one for each of the five dimensions) had a level sum score of 5. The sum scores ranged between 5 and 15 (EQ-5D-Y-3L) or 25 (EQ-5D-Y-5L) (lower = better). Secondly, utility scores indexed at 0 and 1 (higher = better) for the EQ-5D-Y-3L and EQ-5D-Y-5L were calculated using value sets for adults as no EQ-5D-Y-5L value sets were available at the time of conducting this study. Few countries have adult value sets for both the EQ-5D-3L and EQ-5D-5L, and none of these are in Africa [27]. Thus, the utility scores were calculated using the adult value sets (for the United States of America (US)) developed by Shaw et al. [28] and Pickard et al. [29], respectively. The 2005 US EQ-5D-3L (n = 4048) value set (range -0.109, 1) used the Measurement and Valuation of Health (MVH) protocol which uses a different approach for states worse than dead, whereas the 2019 US EQ-5D-5L (n = 1134) value set (range -0.573, 1) used a composite time trade-off (cTTO) in estimating utilities.

Self-rated general health

A self-rated general health rating was included through the question: How would you rate your health today? Excellent, very good, good, fair, or poor? Although limited, a single question health rating is an efficient measure of health status that can provide a useful comparison [17, 30].

The Pediatric Quality of Life ™ version 4.0 Generic Core Scales

The Chichewa versions of the Pediatric Quality of Life™ version 4.0 Generic Core Scales (GCS) child self-report (8–12 years) or the PedsQL™ 4.0 GCS teen self-report (13–18 years) were administered, dependent on the age of the respondent. The translation processes and approvals for these measures were provided by the Mapi Trust [31]. Both the PedsQL™ 4.0 GCS versions (herein referred to as PedsQL™ 4.0 GCS for brevity) have 23 items across four subscales: (1) Physical Functioning (8 items), (2) Emotional Functioning (5 items), (3) Social Functioning (5 items), and (4) School Functioning (5 items). The only difference between the child and teen versions is the use of the terms ‘kids’ or ‘teens’ for some items. Responses for each item are on a 5-point scale coded: (0) never a problem, (1) almost never a problem, (2) sometimes a problem, (3) often a problem, or (4) almost always a problem. Responses are reverse scored and linearly transformed on to a 0–100 scale (0 = 100, 1 = 75, 2 = 50, 3 = 25, 4 = 0). The PedsQL™ 4.0 GCS total scale score is obtained by scoring across all 23 items (higher = better). The Physical Functioning subscale score is obtained by summing the scores for the eight Physical Functioning items, whereas the last three subscales (15 items) are combined to form the Psychosocial Health scale score. The subscale scores are obtained through the summation of scores divided by the number of items answered to give a score ranging from 0–100, thereby accounting for missing responses if present [32, 33].

The cross-cultural adaptation of both the PedsQL™ 4.0 GCS child self-report and PedsQL™ 4.0 GCS teen self-report into Chichewa is being prepared for publication elsewhere. Briefly, this process similarly included forward and backward translation, as well as cognitive debriefing among children and adolescents aged 8–15 years.

Psychometric analyses

Data analysis were performed using IBM SPSS 26.0.0 for Mac (IBM Corp. Armonk, New York, USA) [34]. The sample was divided into two groups: children and adolescents to reflect the age ranges for the self-report PedsQL™ 4.0 GCS child (8–12 years) and teen (13–18 years) scales. Psychometric analyses were evaluated using these age groups, as well as combined age groups, and by health conditions (acute and chronic).

General performance and feasibility

The analysis of the EQ-5D-Y-3L and EQ-5D-Y-5L followed that of Janssen et al. [32] for comparison of the EQ-5D-3L and EQ-5D-5L. Frequency of dimensions responses was summarised across age groups and health condition. Feasibility was examined by comparing the number of missing responses for the two EQ-5D-Y versions across age groups and health condition. Missing responses ≥ 5% per dimension was considered problematic since higher values may imply that the item is either not understood or does not make sense [35].

The ceiling and floor effects of the EQ-5D-Y-3L and EQ-5D-Y-5L were defined as the proportion of children/adolescents scoring “no problem” (11111) or the “most severe problems” (33333/55555) across all five dimensions, respectively. A reduction (absolute or relative) in ceiling or floor effect would suggest enhanced classification efficiency. The absolute reduction was calculated as the difference in proportion scoring 11111 or 33333/55555 from the EQ-5D-Y-3L to the EQ-5D-Y-5L. The relative reduction was calculated as ([ceiling/floorEQ-5D-Y-3L- ceiling/floorEQ_5D-Y-5L)]/ceiling/floorEQ-5D-Y-3L. It was hypothesized that the ceiling effect would be reduced both by age group and health condition when moving from the EQ-5D-Y-3L to the EQ-5D-Y-5L.

Redistribution properties of the EQ-5D-Y-3L to the EQ-5D-Y-5L

Paired dimension responses on the EQ-5D-Y-3L and EQ-5D-Y-5L were assessed for inconsistency across age groups and health condition using previously established criteria [16, 34]. A response pair was considered inconsistent if the EQ-5D-Y-5L response was more than two levels away from that of the EQ-5D-Y-3L. For example, a respondent choosing level 2 (some problems) in the EQ-5D-Y-3L but answering 5 (extreme problems) in the EQ-5D-Y-5L was considered inconsistent. The Chichewa versions are semantically equivalent to the English EQ-5D-Y versions such that level 3 on the EQ-5D-Y-3L (mavuto aakulu) matches level 4 on the EQ-5D-Y-5L (mavuto aakulu).

Discriminatory power

Discriminator power was evaluated using the Shannon Index (H′) and the Shannon Evenness Index (J′) informativity (absolute and relative) [3, 36]. The Shannon index has shown evidence of assessing spread of information within dimensions. The Shannon indices are defined as:

$$H^{\prime} = \mathop \sum \limits_{i = 1}^{L} p_{i} \log_{2} p_{i} \,\,{\text{and}}\,\,J^{\prime} = \frac{H^{\prime}}{{H^{\prime}_{\max } }}$$

where H′ is the absolute amount of informativity, L is the number of dimensions levels and pi is the proportion of observations in the ith level where the EQ-5D-Y-3L has three levels and the EQ-5D-Y-5L has five levels. A higher H’ index reflects that the descriptive system has captured more information; the maximum H′index is 1.58 and 2.32 on the EQ-5D-Y-3L and EQ-5D-Y-5L, respectively [3]. It was anticipated that the H′index would increase for the EQ-5D-Y-5L compared to the EQ-5D-Y-3L. The Shannon Evenness index (J’) reflects the spread of the responses across levels regardless of the number of levels included in the descriptive system [3]. It was hypothesized that the J’index would remain the same or marginally decrease (as its not dependent on response levels) for the EQ-5D-Y-5L compared to the EQ-5D-Y-3L.

Convergent validity

Convergent validity is the extent to which similar dimensions of two or more instruments are related. It is expected that similar dimensions will have a moderate to strong correlation. It was therefore hypothesized that the EQ-5D-Y-3L and EQ-5D-Y-5L sum and utility scores would be correlated (Pearson) with PedsQL™ 4.0 GCS total scale scores. It was further hypothesized that for both of the EQ-5D-Y versions, the dimensions of “mobility”, “doing usual activities”, and “feeling worried, sad or unhappy” would be correlated with PedsQL™ 4.0 GCS physical, school, and emotional functioning scores, respectively. It was hypothesized that the PedsQL™ 4.0 GCS correlation would be negative with the EQ-5D-Y levels sum score (better = lower score) but positive for the EQ-5D-Y utility score (better = higher score). A correlation ≥ 0.4 is considered moderate to strong [37].

Discriminant validity

Discriminant validity is the extent to which unrelated dimensions between scales should not be similar. Further, it was anticipated that age, school grade and gender would not be factors in self-completion of the EQ-5D-Y-3L and EQ-5D-Y-5L. A Pearson correlation < 0.2 indicates lack of correlation. It was anticipated that there would be a lack of correlation between EQ-5D-Y-3L, EQ-5D-Y-5L sum and utility scores with age. It was also hypothesised that the correlation direction for sum score and age would be negative, and positive between age and utility scores. This is because a lower value is better for sum scores and vice versa for utility scores. No association at the 5% significance level was hypothesized between both the EQ-5D-Y-3L and EQ-5D-Y-5L sum and utility scores, with gender (t-test) and grade (one-way ANOVA). School grade was dichotomised based on general distribution and in line with the former scaling for primary school education in Malawi: grades 1–5 made group 1, grades 6–8 made group 2, and secondary/high school made group 3.

Known-group validity

Known-group validity is the extent to which scores differ for two or more groups that are known to be different in some other aspects e.g., health status. It was hypothesised that for the two EQ-5D-Y versions, sum and utility scores would be worse for the sick compared to the healthy children. A t-test evaluated the relationship and the effect size was interpreted according to Cohen’s criterion: < 0.2 poor, 0.3–0.49 small, 0.5–0.8 moderate, and > 0.8 large [35, 38].

Utility score performance (empirical validity)

The EQ-5D-Y-3L and EQ-5D-Y-5L are preference-based instruments used not only for measuring HRQoL but also in economic evaluation. As such, the EQ-5D measures the preference (value or utility) placed on specific health states [39]. It is important to evaluate how and to what extent the utilities generated by these instruments reflect revealed preferences, stated preferences or hypothesised preferences. In the absence of revealed preference and stated preference data, it was hypothesised that utility scores for both EQ-5D-Y versions would detect differences in external indicators of health status with the EQ-5D-Y-5L being more efficient at detecting differences (reflecting greater empirical validity) than the EQ-5D-Y-3L. It was further hypothesized that people would ‘prefer’ lower mild health problems.

The relative ability to assess external indicators of health status was investigated by comparing the utility scores with self-reported general health and the PedsQL™ 4.0 GCS total scale scores using the relative efficiency (RE) statistic. RE was defined as ‘the ratio of the square of the t-statistic of the comparator instrument over the square of the t-statistic of the reference instrument’ [40]. The EQ-5D-Y-5L acted as the comparator instrument and the EQ-5D-Y-3L as the referent since the latter has been widely used and psychometrically validated [7]. RE = 1.0 indicates that the EQ-5D-Y-5L has the same efficiency as the EQ-5D-Y-3L at detecting differences in health status; > 1.0 indicates that the EQ-5D-Y-5L is more efficient than the EQ-5D-Y-3L; and the converse is true [40].

Self-reported general health status was dichotomised using a frequency distribution [40] into two categories: (i) excellent or very good versus good or fair or poor, and (ii) excellent versus very good or good or fair or poor. The mean for the total scale scores provided a cut-off for the PedsQL™ 4.0 GCS such that less than mean, and mean and above formed two categories. The cut-off points used to create these dichotomous variables were necessarily arbitrary and may lead to different conclusions depending on which cut-offs are chosen. Therefore, in a series of sensitivity analyses, we dichotomised the self-reported general health status and PedsQL™ 4.0 GCS variables in alternative ways and replicated the analyses.

All empirical validity analyses were based on participants who completed both the EQ-5D-Y-5L and EQ-5D-Y-3L, thus any respondents with missing responses for either measure were excluded from this analysis. However, for the PedsQL™ 4.0 GCS, a volume of missing values of < 50% are taken into account as per the scoring algorithm [32]. There is a possibility that utility scores below 0 (which could lead to under predicting poorest heath states) would be different for the EQ-5D-Y-5L and EQ-5D-Y-3L since the utility scores are based on two different valuation models [29]. To overcome this,

Results

Participant characteristics

A total of 289 participants completed the EQ-5D-Y, EQ-5D-Y-5L, and PedsQL™ 4.0 GCS, aged 8–17 years (mean 13.6, median 14) as presented in Table 1. There were slightly more participants that were: females (56%), in primary school (60%) or ill (67%). The majority of the participants were adolescents (66%), and as expected all these were in high school.

Table 1 Participant characteristics

General instrument performance and feasibility

The EQ-5D-Y-3L had missing responses in all dimensions among children compared to none among adolescents (Table 2). For the EQ-5D-Y-5L, missing responses were observed in three dimensions among both children and adolescents. Across all respondents (aged 8–17 years), there were fewer dimensions with missing responses for the EQ-5D-Y-3L (two) compared to the EQ-5D-Y-5L (four).

Table 2 Proportion of reported problems in the EQ-5D-Y-3L and the EQ-5D-Y-5L

For the analysis based on health condition (Additional file 1: Table S1), both the EQ-5D-Y-3L and the EQ-5D-Y-5L had missing responses in all five dimensions among the acute (highest proportion) and chronically ill, but not in the healthy population.

The dimensions “looking after myself” and “having pain or discomfort” had the highest and lowest proportion of responses for both the EQ-5D-Y-3L and EQ-5D-Y-5L, respectively. This was similarly the case when the data were stratified by age and health condition. The dimensions of “mobility” (86%), “looking after myself” (88%), and “doing usual activities” (82%) had consistently higher proportions of “no problems” among adolescents, compared to children for the EQ-5D-Y-3L. Similarly, this was evident for the EQ-5D-Y-5L “mobility” (81%) and “looking after myself” (86%) dimensions.

The ceiling effect (11111) for all dimensions was generally reduced (9%) from the EQ-5D-Y-3L to EQ-5D-Y-5L for all participants (8–17 years) and among adolescents (Table 3). The greatest reduction in ceiling effect was in the ‘having pain or discomfort’ dimension for all participants (5%) and adolescents (11%). Among children, however, ceiling effects increased overall (48%) and for “having pain or discomfort” (10%). Overall, the floor effect (33333/55555) was mostly low except in the “having pain or discomfort” dimension (50–100%).

Table 3 Ceiling effect for the EQ-5D-Y-3L and EQ-5D-Y-5L across age groups and health condition

There was an increase in ceiling effect among the acute and chronically ill, but not among healthy participants. At a dimension level, the reduction was largest (6%) for “having pain or discomfort” in the acute and chronically ill. Additionally, there was a 6% ceiling effect reduction for “mobility” and “doing usual activities” among the chronically ill. Among the healthy participants, the largest ceiling effect reduction was in “feeling worried, sad or unhappy”. As with age, the floor effect, reporting most severe problems across all dimensions (33333/55555) ranged between 1 and 3% among the acutely and chronically ill. There was no floor effect reduction in any dimension for healthy participants.

Redistribution properties of the EQ-5D-Y-3L to the EQ-5D-Y-5L

Inconsistent responses were similar across dimensions and age groups (Additional file 2: Table S2) except for “looking after myself”, which had significantly higher inconsistency for 8–12 year olds (14%) compared to 13–18 year olds (3%). Across age groups and dimensions, the greatest inconsistency was in the “having pain or discomfort” dimension, 15% in children and 8% among adolescents. Similarly, for all respondents, the highest inconsistency (10%) was in the “having pain or discomfort” dimension. Across age groups and dimensions, this inconsistency happened mainly by moving from some problems on the EQ-5D-Y-3L to no problems on the EQ-5D-Y-5L.

Discriminatory power

Informativity of dimensions did not improve across all dimensions on the EQ-5D-Y-5L compared to the EQ-5D-Y-3L (Table 4). In contrast to what was hypothesized, the EQ-5D-Y-3L had a higher H’ index in all dimensions compared to the EQ-5D-Y-5L. It was anticipated that the J’ index (spread of responses) would remain the same or marginally decrease on the EQ-5D-Y-5L compared to the EQ-5D-Y-3L. The small difference (0.021–0.073) in the J’ index shows that the spread of responses on the EQ-5D-Y-5L and EQ-5D-Y-3L was distributed evenly. The EQ-5D-Y-3L had a higher J’ in all dimensions except “feeling worried, sad or unhappy” in comparison to the EQ-5D-Y-5L.

Table 4 Shannon Index (H′) and Shannon Evenness Index (J′) for the EQ-5D-Y-3L and EQ-5D-Y-5L dimensions

Convergent validity

Results of tests of convergent validity are summarised in Additional file 3: Table S3. Correlations were consistently in the right direction and met the criterion (≥ 0.4) for the EQ-5D-Y-3L and the teen PedsQL™ 4.0 GCS summary scores, and the EQ-5D-Y-5L with the child PedsQL™ 4.0 GCS summary scores. Most of the sub-scales also met the criterion of 0.4, except a few that did not (e.g., school/usual activities for all respondents (8–17-years), physical/mobility for child version and emotional/worried, sad or unhappy for the teen version).

Discriminant validity

There was no significant difference (p > 0.05) between gender and EQ-5D-Y-3L nor EQ-5D-Y-5L sum scores or utility scores with exception of the direction of the relationship (Table 5).

Table 5 EQ-5D-Y-3L and EQ-5D-Y-5L discriminant validity by gender, school grade and age

There was a low Pearson correlation (0.1–0.2) and thus no association between age and both the sum and utility scores for the EQ-5D-Y-3L, and EQ-5D-Y-5L. The direction of correlation was as hypothesized in adolescents but not for children. However, this correlation between age and both the sum and utility scores improved (0.2–0.3) and was in the hypothesized direction in all respondents.

There was no evidence of difference between either EQ-5D-Y version’s sum (and utility) scores and school grade categories in children (p > 0.05), but this was statistically significant among adolescents (p < 0.05), and for all respondents (p < 0.001).

Known-group validity

In children, although this might have skewed by a small number of healthy participants in this group (n = 12), the effect size was low (0.23) for the EQ-5D-Y-5L compared to high (− 1.15) for the EQ-5D-Y-3L. In adolescents, effect sizes were generally higher (> 0.5) suggesting reasonably good known-group validity (Additional file 4: Table S4). A similar effect size was observed for the utility scores between the healthy and sick groups although, as expected, the direction of the effect size was opposite to the sum scores.

Empirical validity

Table 6 presents the relative efficiency statistics for the EQ-5D-Y-3L and EQ-5D-Y-5L over the dichotomous self-reported general health status and PedsQL™ 4.0 GCS measures, respectively. When the EQ-5D-Y-3L was referenced at 1.0, the EQ-5D-Y-5L was between 31 and 91% and between 5 and 44% less efficient than the EQ-5D-Y-3L at detecting differences in self-reported general health and the PedsQL™ 4.0 total scale score, respectively.

Table 6 Efficiency of the EQ-5D to detect differences in self-reported health status

Restricting the analyses to participants with utility scores between 0 and 1 had the same outcome with the exception of the sensitivity analysis that dichotomised self-reported general health status as excellent versus very good, good or fair, which found that the EQ-5D-Y-5L was 736% more efficient than the EQ-5D-Y-3L at detecting differences in self-reported general health status. (Additional file 5: Table S5).

Discussion

In this urban Malawian setting, both the EQ-5D-Y Chichewa versions demonstrated mixed evidence of instrument performance and feasibility, and validity. Both Chichewa versions demonstrated that they can be used with some limitations in missing responses, convergent and discriminant validity in this setting. The EQ-5D-Y-3L seems particularly suited for use in younger children (8–12 years) and the EQ-5D-Y-5L in adolescents (13–17 years). Other psychometric properties like test–retest reliability and responsiveness also need to be evaluated in this context.

Generally, the use of childhood preference-based HRQoL measures in sub-Saharan African settings is limited, as previously reported [41], and so the ability to generalize these findings in an African context is limited. Missing responses were relatively high in this study compared to other general population studies [9, 20]. The particularly high level of missing values among children (8–12 years) may point to sub-optimal reading skills in this age group in Malawi. This may indicate difficulty in providing good quality self-reported HRQoL assessment [24, 42] suggesting that younger children may benefit from an interviewer assisted approach [43].

The proportion reporting ‘no problems’ was similar between the EQ-5D-Y-3L and the EQ-5D-Y-5L, with the highest proportion for “looking after myself” and lowest in “having pain or discomfort” for both versions. This is consistent with findings from other studies with general population samples [9, 20, 42]. The proportion of ‘no problems’ was similarly spread across health conditions indicating that participants in this study may have had ‘milder’ health conditions. Like the adult EQ-5D-5L [44,45,46], the EQ-5D-Y-5L edged the EQ-5D-Y-3L in reducing ceiling effects, which may point to its improved sensitivity. However, the reduction but not elimination of the ceiling effect may indicate that this problem could be due to a true phenomenon as opposed to EQ-5D-Y-3L deficiency [18]. Further, the lack of ceiling effect reduction among the healthy group [18] is expected as this group should be experiencing fewer problems and may indicate that it is not necessary to include them in between-instruments ceiling effect comparisons in future studies.

The greatest proportion of inconsistencies was in the “having pain or discomfort” and “feeling worried, sad or unhappy” dimensions across age groups. As observed elsewhere [3, 20], these dimensions pertain to psychosocial concepts as opposed to physical aspect conveyed by the “mobility”, “looking after myself”, and “doing usual activities”. However, this variability originated from high ceiling effects, which may explain that among healthy participants (where reporting of no problems is expected) both versions work consistently well.

The discriminative power of the EQ-5D-Y-3L was marginally higher than that of the EQ-5D-Y-5L. This may imply that the informativity of dimensions does not improve on the EQ-5D-Y-5L in this setting. This has been observed in a previous study of idiopathic scoliosis [15], but is different from the general population [20] and those with other health conditions [47]. Considering that the application of Shannon indices is relatively new in HRQoL measurements, this might require further investigation.

The evidence for convergent validity shows that pre-specified criteria were met at scale but not at dimension level. This might imply that the EQ-5D-Y-3L and EQ-5D-Y-5L are best suited to assess physical functioning as opposed to other aspects of HRQoL. While the adult EQ-5D-5L has been found to be highly correlated with other health measures compared to the EQ-5D-3L [48,49,50], this was not the case with the two youth versions. These correlations were low to moderate, which is similar with other findings [12, 18, 46].

The discriminant ability of the EQ-5D-Y-3L and EQ-5D-Y-5L as regards gender and age is consistent with the adult EQ-5D-3L and EQ-5D-5L versions [45, 51]. The criterion was met for age groups but not across all respondents. Also, there were mixed relationships between sum and utility scores with age, which could not be established in this study but needs further research. While age has been associated with different scores for the EQ-5D-3L and EQ-5D-5L [45], this study did not find such differences between the EQ-5D-Y-3L and EQ-5D-Y-5L. Also, discriminant validity between both the EQ-5D-Y versions and school grade was met in children, but not among adolescents and across all respondents. This may indicate that years of education contributes to better completion and comprehension of questionnaires. Both the EQ-5D-Y-3L and EQ-5D-Y-5L showed evidence of known-group validity, which has been observed elsewhere [9, 17, 19, 21]. While the EQ-5D-Y-3L had the largest effect size in children, this was the case for the EQ-5D-Y-5L among adolescents. This study shows that the EQ-5D-Y-5L may be best suited for adolescents due to their ability to better distinguish responses, which is consistent with adult findings [52].

Tests of empirical validity demonstrated that the EQ-5D-Y-3L was generally more efficient than the EQ-5D-Y-5L at detecting hypothesised differences in external health status. This was surprising as the adult EQ-5D-5L has demonstrated greater relative efficiency compared to the EQ-5D-3L [53,54,55]. Our results may partly be due to the fact that the US EQ-5D-3L value set has additional interaction terms that may add more disutility to the weights compared to the US EQ-5D-5L value set. Also, the adult EQ-5D-5L has been found to overestimate health problems, leading to underestimation of utilities [4], which may have been the case with the sample in this study. Full understanding of why the EQ-5D-Y-3L outperformed the EQ-5D-Y-5L could benefit from future research.

Finally, it should be noted that there were no major differences in the psychometric tests focussed on utility values and the sum scores. The only difference was in the direction of the correlation. While the higher values were associated with better health outcomes for the utilities and vice versa for lower values, the opposite was true for the sum scores.

Limitations of this study include COVID-19 restrictions that led to collection of data in one wave and therefore test–retest reliability and responsiveness could not be evaluated. Secondly, preference-based value sets are not available for the EQ-5D-Y-5L and these have only recently been developed in three countries (at the time of doing this research) for the EQ-5D-Y-3L [56,57,58]. The use of adult values for childhood health states has been extensively discussed elsewhere [59]. The development of country-specific preference-based values for the EQ-5D-Y-5L is clearly an area that will benefit from further research although this may still be a limitation for the empirical validity i.e., whether EQ-5D reflect patient preferences in comparison to stated or revealed preferences.

Conclusion

The two EQ-5D-Y versions established convergent and known-group validity among children and adolescents. Both versions had issues with missing values in younger children and discriminant validity by school grade as well as utilization of response options suggesting that the instruments can be used with caveats in this setting. These issues are likely not to be specific to Malawi as shown by evidence from elsewhere. Although the EQ-5D-Y-3L could be used across the age groups studied, it seems particularly suited (due to less nuanced responses) for use in younger children (8–12 years) whilst the EQ-5D-Y-5L seems particularly suited for use in adolescents (13–17 years) in Malawian contexts. Further psychometric testing for test re-test reliability and responsiveness is required, which could not be carried out in this study.

Availability of data and materials

The datasets generated and analysed during the current study are not publicly available as consent was not sought from participants for such but are available from the corresponding author on reasonable request.

References

  1. Chen G, Ratcliffe J (2015) A review of the development and application of generic multi-attribute utility instruments for paediatric populations. Pharmacoeconomics 33:1013–1028

    Article  PubMed  Google Scholar 

  2. Herdman M, Gudex C, Lloyd A et al (2011) Development and preliminary testing of the new five-level version of EQ-5D (EQ-5D-5L). Qual Life Res 20:1727–1736

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  3. Janssen M, Birnie E, Haagsma JA et al (2008) Comparing the Standard EQ-5D three-level system with a five-level version. Value Health 11:275–284

    Article  PubMed  Google Scholar 

  4. Janssen MF, Bonsel GJ, Luo N (2018) Is EQ-5D-5L better than EQ-5D-3L? A head-to-head comparison of descriptive systems and value sets from seven countries. Pharmacoeconomics 36:675–697

    Article  PubMed  PubMed Central  Google Scholar 

  5. Janssen MF, Szende A, Cabases J et al (2019) Population norms for the EQ-5D-3L: a cross-country analysis of population surveys for 20 countries. Eur J Health Econ 20:205–216

    Article  CAS  PubMed  Google Scholar 

  6. Wille N, Badia X, Bonsel G et al (2010) Development of the EQ-5D-Y: a child-friendly version of the EQ-5D. Qual Life Res 19:875–886

    Article  PubMed  PubMed Central  Google Scholar 

  7. Kreimeier S, Astrom M, Burstrom K et al (2019) EQ-5D-Y-5L: developing a revised EQ-5D-Y with increased response categories. Qual Life Res 28:1951–1961

    Article  PubMed  PubMed Central  Google Scholar 

  8. Kreimeier S, Greiner W (2019) EQ-5D-Y as a health-related quality of life instrument for children and adolescents: the instrument’s characteristics, development, current use, and challenges of developing its value set. Value Health 22:31–37

    Article  PubMed  Google Scholar 

  9. Ravens-Sieberer U, Wille N, Badia X et al (2010) Feasibility, reliability, and validity of the EQ-5D-Y: results from a multinational study. Qual Life Res 19:887–897

    Article  PubMed  PubMed Central  Google Scholar 

  10. Burstrom K, Bartonek A, Brostrom E et al (2014) EQ-5D-Y as a health-related quality of life measure in children and adolescents with functional disability in Sweden: testing feasibility and validity. Acta Paediatr 103:426–435

    Article  CAS  PubMed  Google Scholar 

  11. Shiroiwa T, Fukuda T, Shimozuma K (2019) Psychometric properties of the Japanese version of the EQ-5D-Y by self-repot and proxy-version: reliability and construct validity. Qual Life Res 28:3093–3105

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  12. Scott D, Ferguson GD, Jelsma J (2017) The use of the EQ-5D-Y health related quality of life outcome measure in children in the Western Cape, South Africa: psychometric properties, feasibility and usefulness - a longitudinal, analytical study. Health Qual Life Outcomes 15:12

    Article  PubMed  PubMed Central  Google Scholar 

  13. Scalone L, Ciampichini R, Fagiuoli S et al (2013) Comparing the performance of the standard EQ-5D 3L with the new version EQ-5D 5L in patients with chronic hepatic diseases. Qual Life Res 22:1707–1716

    Article  PubMed  Google Scholar 

  14. Noyes J, Edwards RT (2011) EQ-5D for the assessment of health-related quality of life and resource allocation in children: a systematic methodological review. Value Health 14:1117–1129

    Article  CAS  PubMed  Google Scholar 

  15. Wong CKH, Cheung PWH, Luo N et al (2019) A head-to-head comparison of five-level (EQ-5D-5L-Y) and three-level EQ-5D-Y questionnaires in paediatric patients. Eur J Health Econ 20:647–656

    Article  PubMed  Google Scholar 

  16. Wong CKH, Cheung PWH, Luo N et al (2019) Responsiveness of the EQ-5D youth version 5-level (EQ-5D-5L-Y) and 3-level (EQ-5D-3L-Y) in patients with idiopathic scoliosis. Spine 44:1507–1514

    Article  PubMed  Google Scholar 

  17. Astrom M, Krig S, Ryding S et al (2020) EQ-5D-Y-5L as a patient-reported outcome measure in psychiatric inpatient care for children and adolescents - a cross-sectional study. Health Qual Life Outcomes 18:164

    Article  PubMed  PubMed Central  Google Scholar 

  18. Fitriana TS, Purba FD, Rahmatika R et al (2021) Comparing measurement properties of EQ-5D-Y-3L and EQ-5D-Y-5L in paediatric patients. Health Qual Life Outcomes 19:256

    Article  PubMed  PubMed Central  Google Scholar 

  19. Doeleman MJH, de Roock S, Buijsse N et al (2021) Monitoring patients with juvenile idiopathic arthritis using health-related quality of life. Pediatr Rheumatol Online J 19:40

    Article  PubMed  PubMed Central  Google Scholar 

  20. Pérez-Sousa MÁ, Olivares PR, Ramírez-Vélez R et al (2021) Comparison of the psychometric properties of the EQ-5D-3L-Y and EQ-5D-5L-Y instruments in Spanish children and adolescents. Value Health 24:1799–1806

    Article  PubMed  Google Scholar 

  21. Pei W, Yue S, Zhi-Hao Y et al (2021) Testing measurement properties of two EQ-5D youth versions and KIDSCREEN-10 in China. Eur J Health Econ 22:1083–1093

    Article  PubMed  Google Scholar 

  22. Verstraete J, Marthinus Z, Dix-Peek S et al (2022) Measurement properties and responsiveness of the EQ-5D-Y-5L compared to the EQ-5D-Y-3L in children and adolescents receiving acute orthopaedic care. Health Qual Life Outcomes 20:28

    Article  PubMed  PubMed Central  Google Scholar 

  23. Zhou W, Shen A, Yang Z et al (2021) Patient-caregiver agreement and test-retest reliability of the EQ-5D-Y-3L and EQ-5D-Y-5L in paediatric patients with haematological malignancies. Eur J Health Econ 22:1103–1113

    Article  PubMed  PubMed Central  Google Scholar 

  24. Ngwira LG, Jelsma J, Maheswaran H et al (2022) Cross-CULTURAL adaptation of the beta EQ-5D-Y-5L into Chichewa (Malawi). Value Health Reg Issues 29:36–44

    Article  PubMed  Google Scholar 

  25. Ngwira LG, Jelsma J, Maheswaran H, et al. Cross-cultural adaptation of the beta EQ-5D-Y-5L into Chichewa (Malawi) Accepted VIHRI. 2021.

  26. Parkin D, Rice N, Devlin N (2010) Statistical analysis of EQ-5D profiles: does the use of value sets bias inference? Med Decis Making 30:556–565

    Article  PubMed  Google Scholar 

  27. EuroQol Group. https://euroqol.org/eq-5d-instruments/eq-5d-3l-about/valuation/choosing-a-value-set/. Last assessed 15th September 2021.

  28. Shaw JW, Johnson JA, Coon SJ (2005) US valuation of the EQ-5D health states: development and testing of the D1 valuation model. Med Care 43:203–220

    Article  PubMed  Google Scholar 

  29. Pickard AS, Law EH, Jiang R et al (2019) United States valuation of EQ-5D-5L health states using an international protocol. Value Health 22:931–941

    Article  PubMed  Google Scholar 

  30. Bowling A (2005) Just one question: if one question works, why ask several? J Epidemiol Community Health 59:342–345

    Article  PubMed  PubMed Central  Google Scholar 

  31. Institute MR. Linguitic valiation of the PedsQL™—a Quality of Life Questionnaire. 2002.

  32. Trust MR, Varni JW. Scaling and Scoring of the Pediatric Quality of Life Inventory ™ PedsQL™. In: Trust MR, ed., 2017.

  33. Varni JW, Burwinkle TM, Seid M et al (2003) The PedsQLy 4.0 as a pediatric population health measure: feasibility, reliability, and validity. Ambul Pediatr 3:329–341

    Article  PubMed  Google Scholar 

  34. IBM Corp. IBM SPSS statistics for mac. Version 26.0. In: Corp I, ed. Armonk, NY, 2018.

  35. Smith SC, Lamping DL, Banerjee S et al (2005) Measurement of health-related quality of life for people with dementia: development of a new instrument (DEMQOL) and an evaluation of current methodology. Health Technol Assess 9:1–93

    Article  CAS  PubMed  Google Scholar 

  36. Bas Janssen MF, Birnie E, Bonsel GJ (2007) Evaluating the discriminatory power of EQ-5D, HUI2 and HUI3 in a US general population survey using Shannon’s indices. Qual Life Res 16:895–904

    Article  PubMed  Google Scholar 

  37. (FDA) UDoHaHSFaDA. Guidance for industry: patient-reported outcome measures: use in medical product development to support labeling claims. In: FDA U, ed., Federal Register. Rockville, MD: FDA, 2009.

  38. Cohen J (1988) Statistical power analysis for the behavioural sciences, 2nd edn. Lawrence Erlbaum Associates, Hillsdale

    Google Scholar 

  39. Brazier J, Deverill M, Green C (1999) A review of the use of health status measures in economic evaluation. J Health Serv Res Policy 4:174–184

    Article  CAS  PubMed  Google Scholar 

  40. Petrou S, Morrell J, Spiby H (2009) Assessing the empirical validity of alternative multi-attribute utility measures in the maternity context. Health Qual Life Outcomes 7:40

    Article  PubMed  PubMed Central  Google Scholar 

  41. Ngwira LG, Khan K, Maheswaran H et al (2021) A systematic literature review of preference-based health-related quality-of-life measures applied and validated for use in childhood and adolescent populations in sub-saharan Africa. Value Health Reg Issues 25:37–47

    Article  PubMed  Google Scholar 

  42. Pan CW, Zhong H, Li J et al (2020) Measuring health-related quality of life in elementary and secondary school students using the Chinese version of the EQ-5D-Y in rural China. BMC Public Health 20:982

    Article  PubMed  PubMed Central  Google Scholar 

  43. Amien R, Scott D, Verstraete J (2022) Performance of the EQ-5D-Y Interviewer Administered Version in Young Children. Children (Basel) 9:93

    PubMed  Google Scholar 

  44. Buchholz I, Janssen MF, Kohlmann T et al (2018) A systematic review of studies comparing the measurement properties of the three-level and five-level versions of the EQ-5D. Pharmacoeconomics 36:645–661

    Article  PubMed  PubMed Central  Google Scholar 

  45. Feng Y, Devlin N, Herdman M (2015) Assessing the health of the general population in England: how do the three- and five-level versions of EQ-5D compare? Health Qual Life Outcomes 13:171

    Article  PubMed  PubMed Central  Google Scholar 

  46. Scalone L, Tomasetto C, Matteucci M et al (2011) Assessing quality of life in children and adolescents: development and validation of the Italian version of the EQ-5D-Y. Italian J Public Health 8:331–341

    Google Scholar 

  47. Verstraete J, Amien R, Scott D. Comparing measurement properties of the English EQ-5D-Y three-level version with the five-level version in South Africa. Preprints (https://www.preprints.org) 2022.

  48. Conner-Spady BL, Marshall DA, Bohm E et al (2015) Reliability and validity of the EQ-5D-5L compared to the EQ-5D-3L in patients with osteoarthritis referred for hip and knee replacement. Qual Life Res 24:1775–1784

    Article  PubMed  Google Scholar 

  49. Kim SH, Kim HJ, Lee SI et al (2012) Comparing the psychometric properties of the EQ-5D-3L and EQ-5D-5L in cancer patients in Korea. Qual Life Res 21:1065–1073

    Article  PubMed  Google Scholar 

  50. Janssen MF, Pickard AS, Golicki D et al (2013) Measurement properties of the EQ-5D-5L compared to the EQ-5D-3L across eight patient groups: a multi-country study. Qual Life Res 22:1717–1727

    Article  CAS  PubMed  Google Scholar 

  51. Ferreira LN, Ferreira PL, Ribeiro FP et al (2016) Comparing the performance of the EQ-5D-3L and the EQ-5D-5L in young Portuguese adults. Health Qual Life Outcomes 14:89

    Article  PubMed  PubMed Central  Google Scholar 

  52. Rencz F, Lakatos PL, Gulacsi L et al (2019) Validity of the EQ-5D-5L and EQ-5D-3L in patients with Crohn’s disease. Qual Life Res 28:141–152

    Article  PubMed  Google Scholar 

  53. Wang P, Luo N, Tai ES et al (2016) The EQ-5D-5L is more discriminative than the EQ-5D-3L in patients with diabetes in Singapore. Value Health Reg Issues 9:57–62

    Article  PubMed  Google Scholar 

  54. Pickard AS, De Leon MC, Kohlmann T et al (2007) Psychometric comparison of the standard EQ-5D to a 5 level version in cancer patients. Med Care 45:259–263

    Article  PubMed  Google Scholar 

  55. Pan CW, Sun HP, Wang X et al (2015) The EQ-5D-5L index score is more discriminative than the EQ-5D-3L index score in diabetes patients. Qual Life Res 24:1767–1774

    Article  PubMed  Google Scholar 

  56. Shiroiwa T, Ikeda S, Noto S et al (2021) Valuation survey of EQ-5D-Y based on the international common protocol: development of a value set in Japan. Med Decis Making 41:597–606

    Article  PubMed  PubMed Central  Google Scholar 

  57. PrevolnikRupel V, Ogorevc M (2021) EQ-5D-Y value set for Slovenia. Pharmacoeconomics 9:463–471

    Article  Google Scholar 

  58. Ramos-Goñi JM, Oppe M, Estévez-Carrillo A et al (2022) Accounting for unobservable preference heterogeneity and evaluating alternative anchoring approaches to estimate country-specific EQ-5D-Y value sets: a case study using Spanish preference data. Value Health 25:835–843

    Article  PubMed  Google Scholar 

  59. Petrou S (2003) Methodological issues raised by preference-based approaches to measuring the health status of children. Health Econ 12:697–702

    Article  PubMed  Google Scholar 

Download references

Acknowledgements

The authors would like to acknowledge the MRC Norway for funding this work as part of the BREATHE trial (NCT02426112) and the EuroQol Research Foundation (Project no. 20190200). The views and conclusions expressed in this paper are those of the authors and may not reflect those of the funders.

Funding

LGN was Doctoral Research Fellow funded by MRC Norway under BREATHE trial (NCT02426112). LGN also received funding from the EuroQol Research Foundation (Project no. 20190200) and the IMPALA consortium NIHR 16/36/35.

Author information

Authors and Affiliations

Authors

Contributions

LGN, HM, SP, LN and SS conceptualized and designed the study. LGN led the data collection, and preparation of the manuscript. LGN, JV and SS analysed and interpreted the data. LGN, HM, JV, SP, LN and SS drafted the manuscript and reviewed for important intellectual content. All authors read and approved the final manuscript.

Corresponding author

Correspondence to Lucky G. Ngwira.

Ethics declarations

Ethical approval and consent to participate

This study was approved by the Malawi College of Medicine (now Kamuzu University of Health Sciences (KUHES)) Research Ethics Committee and the Liverpool School of Tropical Medicine Research Ethics Committee.

Consent for publication

Informed consent was provided by parents/carers of all participants in this study, and assent was given by the participants themselves. All authors have provided their consent for the publication of this manuscript.

Competing interests

JV is a member of the EuroQol Group and the study received some funding from the EuroQol Research Foundation. However, neither the EuroQol Group nor the EuroQol Research Foundation influenced the findings of this work. SP received grants as a NIHR Senior Investigator (NF-Sl-0616-10103), and from the NIHR Applied Research Collaboration Oxford and Thames Valley during the conduct of the study.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Supplementary Information

Additional file 1: Table S1.

Proportion of reported problems in the EQ-5D-Y-3L and the EQ-5D-Y-5L by health condition

Additional file 2: Table S2.

Redistribution of the EQ-5D-Y-3L and EQ-5D-Y-5L dimension scores

Additional file 3: Table S3.

Convergent validity of the EQ-5D-Y and EQ-5D-Y-5L with PedsQL™ 4.0 self-report sub-scale.

Additional file 4: Table S4.

EQ-5D-Y-3L and EQ-5D-Y-5L sum score known group validity

Additional file 5: Table S5.

Efficiency of the EQ-5D to detect differences in self-reported health status (utility set to between 0 and 1 only for both EQ-5D-Y and EQ-5D-Y-5L)

Rights and permissions

Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Ngwira, L.G., Maheswaran, H., Verstraete, J. et al. Psychometric performance of the Chichewa versions of the EQ-5D-Y-3L and EQ-5D-Y-5L among healthy and sick children and adolescents in Malawi. J Patient Rep Outcomes 7, 22 (2023). https://doi.org/10.1186/s41687-023-00560-4

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1186/s41687-023-00560-4

Keywords