Health utilities and parental quality of life effects for three rare conditions tested in newborns

Background

Measurement of health utilities is required for economic evaluations. Few studies have evaluated health utilities for rare conditions; even fewer have incorporated disutility that may be experienced by caregivers. This study aimed to (1) estimate health utilities for three rare conditions currently recommended for newborn screening at the state or federal level, and (2) estimate the disutility, or spillover, experienced by parents of patients diagnosed with a rare, heritable disorder.

Methods

A stated-preference survey using a time trade-off approach elicited health utilities for Krabbe disease, phenylketonuria, and Pompe disease at varying stages (mild, moderate, severe) and onset of disease symptoms (infancy, childhood, and adulthood). We recruited respondents from a nationally representative community sample (n = 862). Respondents valued disease specific health states in three consecutive question frames: (1) adult health state (> = 18 years of age), (2) child health state (< 18 years of age), and (3) as a parent of a child with a condition (parent spillover state). Corresponding mean utilities were calculated for plausible disease states in adulthood and childhood. Mean disutility was estimated for parental spillover. Predictors of utilities were evaluated using a negative binomial regression model.

Results

More severe conditions and infant health states received lower estimated utility and greater estimated disutility among parents. Conditions with the lowest estimated health utilities were severe infantile Pompe disease (0.40, CI: 0.34–0.46) and infantile Krabbe disease (0.37, CI: 0.32–0.43). Disutility was evident for all conditions evaluated (range: 0.07–0.19).

Conclusions

Rare childhood conditions are associated with substantial estimated losses in quality of life. Evidence of disutility among parents further warrants the inclusion of spillover effects in cost-effectiveness analyses. Continued research is needed to assess and measure the effects of childhood disease from a family perspective.

Newborn screening has expanded rapidly over the last two decades with the introduction of tandem mass spectrometry, advances in genetic identification, and policy initiatives to improve and align newborn screening resources [1, 2]. Currently, 34 conditions are recommended for screening by the Advisory Committee for Heritable Disorders in Newborns and Children (ACHDNC) [3]. States typically view these recommendations as a minimum set of conditions for which to screen; many states screen for more than 50 conditions [4].

Economic evaluations are conducted to better estimate the implications of expanding newborn screening for recommended disorders. Health utility estimates are required as part of economic evaluation to quantify the burden of disease and derive quality-adjusted life years (QALYs), the outcome measure recommended for use in cost-effectiveness analysis [5,6,7]. To date few studies have elicited health utilities for conditions recommended for newborn screening; utility estimates are necessary for evaluating whether the averted morbidity and mortality for patients identified through newborn screening are worth the costs associated with earlier detection and treatment of heritable disorders [8].

A growing body of evidence suggests that quality of life effects included in economic evaluations should be considered beyond the individual patient. Parents, family members, and informal caregivers can be significantly affected by the stress and caregiving responsibilities related to a family member’s disease [9,10,11,12,13]. Few studies have directly measured these ‘spillover’ effects. Among studies that have, results vary depending on the disease state, the relationship of a family member to the ill patient, and patient age [14]. Opportunities exist to more comprehensively capture the burden of disease in economic evaluation by considering the quality of life effects on both patients and family members.

This study aimed to estimate health utilities to support economic evaluations using a family perspective. We used accepted health utility elicitation techniques to (1) estimate health utilities at varying ages and stages of disease from infancy to adulthood, and (2) estimate parental spillover effects for three rare conditions: Krabbe disease, phenylketonuria (PKU), and Pompe disease (Fig. 1).

Rare Disorder Descriptions

Full size image

These conditions share the substantial risk of death or severe sequelae if not identified and treated close to birth. Additionally, all conditions have either been recommended or nominated by the Advisory Committee for Heritable Disorders in Newborns and Children (ACHDNC) for screening [15,16,17]. Although Krabbe disease is not currently included on the recommended uniform screening panel endorsed by the ACHDNC, 4 states are currently screening for Krabbe disease with 6 other states in various stages of implementation [18]. Secondary objectives of this study aimed to evaluate differences in health utility valuations based on respondent confidence, predictors of health utility valuations, and use of video health state descriptions.

We developed an online, stated-preference survey to elicit health utilities using direct-valuation methods. The time trade-off (TTO) approach asked respondents to trade off a portion of their remaining life to avoid an undesirable health state. The modified time trade off approach utilized in this study has been used previously to elicit utilities for childhood health states [19, 20] and family spillover [11]. Derived utility values are calculated on a scale from (0) dead to (1) perfect health [21].

Study participants

We invited a nationally representative sample of adults to participate in this study. This community sample was drawn from a commercially available panel of US adults, the GfK KnowledgePanel [22]. GfK recruits panel members via random digit dialing and address-based sampling. Members are compensated for their participation in the panel with personal home internet access. In addition, we identified a convenience sample of adult patients and parents experienced with PKU and mild-hyperphe, a mild variant of PKU, to participate in the survey. Further details regarding the experienced sample recruitment and results can be found in the online appendix (Additional file 1).

Survey design and development

The survey included four sections: an eligibility screener, TTO practice questions, TTO health state valuations, and questions concerning current wellbeing and socio-demographics. The screener collected information regarding the respondent’s age, gender, and familiarity with the three conditions. Hover-over text was provided to describe the three conditions to identify community members experienced with one of the three conditions.

Health state scenario descriptions for the TTO tasks were developed in consultation with patients and medical experts familiar with Krabbe, PKU, and Pompe disease. Health states were based on a combination of attributes including stage of disease (mild, moderate, or severe), age of symptom onset (infancy, childhood, or adulthood), adherence to therapy (low or high) and treatment. In total, 18 health states were developed for health utility elicitation: 4 PKU, 6 Krabbe, 6 Pompe, and 2 enzyme replacement therapy (ERT) treatment conditions. ERT is a lifelong medical treatment for Pompe disease that slows the progression of disease but is not curative.

Health state descriptions included physical, mental, and emotional health domains as well as unique attributes of each disorder like diet and medical care. In addition to written health states, a graphic designer created customized illustrations for a 20–30 s animated video health state. Previous studies have shown that many adults lack basic literacy and numeracy skills required to understand written health states [23, 24]; videos offer an alternative medium to present health states to reduce literacy barriers (Fig. 2). The complete set of health state descriptions is available in the online appendix (Additional file 1).

Sample of a Health State Animation*

Full size image

TTO health state valuation questions

Respondents completed practice questions to cognitively prepare for the TTO valuation task. After completion of the practice questions, each respondent evaluated 6–9 parallel health states in three successive question frames: (1) adult health state (> = 18 years of age), (2) child health state (< 18 years of age), and (3) as a parent of a child with a condition (parent spillover state). Frame 1 asked the respondent to imagine how she would feel if she had the hypothetical condition (termed “Adult” frame). The adult frame asked the respondent how many years of her life she would trade off to avoid having the condition herself. Frame 2 asked the respondent to consider how her child would feel if her child had the hypothetical condition (termed “Child Patient” frame). The child patient frame question asked the respondent how many years of her life she would tradeoff to avoid her child from having the condition. Frame 3 asked the respondent to imagine how she would feel if her child had the hypothetical condition (termed “Spillover” frame). The spillover frame asked the respondent how many years of her life she would trade to avoid her own pain and suffering if her child had the condition (Fig. 3). Each respondent received personalized information on remaining life years based on the respondent’s age and national estimates of life expectancy in the United States [25]. After completion of the valuation task, respondents were asked to assess their level of confidence in their responses on a four-point scale: (1) Very confident, (2) Somewhat confident, (3) Not confident, and (4) They were total guesses.

Sample of a Time Trade-Off Question

Full size image

Socio-demographic questions and metadata

GfK collects socio-demographic information on panel members including race and ethnicity, household income, education, marital status, employment status, and internet access prior to panel participation. We also collected metadata on health state video usage to evaluate any differences in population characteristics and utility ratings among users and non-users.

The survey instrument was tested and refined through cognitive interviews (n = 31). The large number of cognitive pretests reflects the complexity of the survey and the valuation task.

Data collection

The survey was piloted online in February 2016 (n = 75). The survey was administered between March and June 2016; 2132 individuals were invited to participate, of which 862 individuals completed the survey (40% response rate). Respondents were randomized to complete one of five survey versions (Additional file 1). The survey took an average of 24 min to complete. All survey instruments were approved by the University of Michigan Medical School Institutional Review Board.

Statistical analysis

Statistical analyses were conducted using STATA v13 statistical software [26]. Primary analyses included summary statistics of the respondent population and mean utility weights for plausible disease health states experienced in adulthood and childhood (TTO Adult Frame and Child Patient Frame). Non-parametric bootstrapping procedures estimated standard errors and confidence intervals around the means. Disutility weights, defined as 1 minus the health state valued, were calculated for the spillover health states (TTO Spillover Frame). In secondary analyses, respondents were dichotomized based on their self-reported confidence in the valuation task. “Confident” respondents included those who were (1) confident or (2) somewhat confident in their valuations; “Not confident” included those respondents who were (3) not confident or responded their answers were (4) total guesses. Summary statistics were re-calculated to evaluate if utility weights differed depending on respondent confidence.

Subsequent analyses included a negative binomial regression model to assess relationships between time trade-off amounts (in years) and respondent characteristics. Responses were normalized by dividing the respondent TTO amounts by the mean TTO amounts for each health state. GEE models were used to adjust for multiple responses per respondent. Evaluated characteristics included video usage, age, sex, race and ethnicity, household income, educational attainment, employment status, marital status, and internet access prior to GfK panel participation. Finally, summary statistics were calculated for respondents using any health state video. Fischer’s exact test evaluated differences in population characteristics among video users and non-users.

Respondent characteristics

Respondents (n = 862) ranged in age from 18 to 90 years with a median age of 55. Respondent characteristics were similar to the US general population with a few exceptions, namely our sample was older and more likely to be White and of non-Hispanic origin (74%) [27]. Among respondents, 36% held a bachelor’s degree or higher and 61% were married or living with a partner. Approximately 56% of respondents reported being employed at the time of survey participation while 24% reported being retired (Table 1). None of the respondents reported having or knowing someone with PKU, Pompe disease, or Krabbe disease.

Health utility weights

Mean health utility weights were calculated for all childhood and adult conditions based on responses to the adult (frame 1) and child (frame 2) TTO questions (Table 2; Fig. 4). Infantile-onset health states elicited the lowest utility across all evaluated conditions. Severe infantile Pompe disease (0.40, CI: 0.34–0.46) and infantile advanced Krabbe disease (0.37, CI: 0.32–0.43) elicited the lowest utilities. Conversely, the highest mean utilities were calculated for milder health states in adulthood. The highest utilities were estimated for adult early stage Krabbe disease (0.81, CI: 0.76–0.85), adult mild Pompe disease (0.85, CI: 0.81–0.89), and adult PKU with high adherence to a low-protein diet (0.81, CI: 0.76–0.85). This trend was also consistent for the enzyme replacement therapy (ERT) treatment condition in which assigned utilities were significantly lower for the childhood treatment states (0.48, CI: 0.42–0.53) compared to the adult treatment states (0.67, CI: 0.62–0.72).

Health Utilities by Disease Condition and Age of Symptom Experience or Onset

Full size image

Parent disutility, or spillover, was calculated for all childhood conditions (Table 3). Spillover estimated the burden of disease on a parent of a child with one of the specified conditions. The greater the spillover effect, the greater the quality of life loss to the parent due to the child’s condition. The greatest spillover disutility was assigned to the infantile-onset advanced Krabbe condition (0.19, CI: 0.14–0.24). The lowest spillover disutility was assigned to mild Pompe disease in childhood (0.07, CI: 0.04–0.10). Mean spillover disutility assigned to the PKU conditions, low and high adherence, were similar (0.12 and 0.11 respectively).

Secondary analyses

Further analyses restricted approximately 16% of respondents who expressed low confidence in their health state valuations. Mean health utility results were similar among the restricted sample compared to the full sample of respondents. Respondents with confidence in their responses generally assigned lower health utility values for more severe conditions in both adulthood and childhood. These differences approached, but did not reach, statistical significance (0.05) except for two conditions, childhood severe Pompe disease (0.43, CI: 0.37–0.50) and the adult ERT treatment condition (0.64, CI: 0.59–0.70; full results not shown).

Results of the regression analysis demonstrated that few respondent characteristics were associated with time trade off valuations. Marital status and employment status were exceptions. Respondents who reported separation from a partner or spouse and respondents temporarily laid-off were less likely to trade off time at the end of their life and therefore assigned higher utilities to described health states compared individuals who were married or employed (Additional file 1).

Finally, descriptive statistics explored the frequency of video use as well as respondent characteristics of video viewers. Videos were most often accessed for health states presented in the first question evaluated; at most 35% of respondents ‘clicked’ on the available video for any given health state; 42% clicked on a video at least once. Video ‘clicks’ progressively decreased as respondents advanced through the survey. Among video users and non-users, significant differences with regard to age and home internet access were observed: video users were more often over 60 years of age and reported having home internet access prior to panel participation (Additional file 1).

This study estimated substantial quality of life losses associated with Pompe disease, PKU, and Krabbe disease. Our results indicate that health utility and spillover effects vary by condition, age of symptom onset, and stage of disease. Trends emerged in which more debilitating conditions and infant onset conditions were associated with lower ratings of utility and higher disutility among parents. Our results corroborate existing research that suggest infantile-onset conditions are more distressing for parents and caregivers compared to conditions experienced in older children, adolescents, or adults [10].

Previous studies have reported health utilities for Pompe disease and sequelae of PKU [28,29,30,31,32,33], but not Krabbe disease. Studies have typically utilized indirect elicitation methods. Our estimates for adult onset Pompe disease and ERT are similar to other studies [28,29,30]. In contrast, our health utility estimates for childhood Pompe disease are higher than other estimates [31]. For PKU, our results are consistent with those reported from two studies valuing health related quality of life for mild to moderate developmental delay [32, 33]. Particularly among children, our results also estimate quality of life losses for patient both adherent and less-adherent to a low-protein diet. This is in contrast to other studies which have demonstrated that with early detection of PKU and treatment, quality of life among adolescents and adults is not different than otherwise healthy individuals for studies using patients as respondents [34,35,36]. This discrepancy is consistent with research that indicates respondents who are inexperienced with a health state (community sample), compared with an experienced patient sample, may overestimate quality of life losses at least for some conditions [37]. When incorporating health utility weights into a cost-effectiveness analysis, it is important to consider the respondent sample. Guidelines for cost-effectiveness analysis typically recommend health utility weights from a community sample for resource allocation decisions [38] and it is important to note that the selection of respondent sample could influence the magnitude of weights.

This study is the first, to our knowledge, to elicit spillover utilities using direct valuation methods for these rare conditions. Parental spillover effects were detected in all of the health conditions evaluated, and were especially notable in severe early infantile and childhood onset conditions. Among our sample, mean disutility or parental spillover estimates ranged from 0.07 for mild Pompe disease in childhood to 0.19 for severe early infantile Krabbe disease. Other studies have reported mean spillover effects within the ranges observed in our study from 0.08 among experienced parents of children with physical limitations [39], 0.10 among parents of children with two rare congenital disorders [40], and mean spillover of 0.26 among parents of children with a severe childhood condition like cancer [11]. Our study is consistent with findings from a previous study utilizing TTO methods in which spillover effects between 0.08–0.27 were estimated for a childhood condition requiring a restricted protein diet [41]. Our findings reiterate the importance of including parental spillover effects into economic evaluation as quality of life losses can be substantial.

In a previous study, we collected preferences for a false positive newborn screening test result [41]. We found that patients assigned a small but significant disutility of 0.003 (0.001 to 0.006) to the false positive newborn screening experience and mean WTP to avoid this experience was $159 (95 to 246). While small at the individual patient level, it is important to consider this value when conducting cost-effectiveness analyses of newborn screening, since false positive rates can vary substantially across target conditions for a given population.

This study has some limitations. First, there are few well-established methods for valuing child health utilities, especially for very young children [14, 42]. A recent review highlighted the lack of evidence for judging the use of direct valuation methods for child health [43]. More research is needed in this area to identify feasible and reliable methods. Additionally, appropriate methods for integrating parent and family spillover remains an active area of discussion. Utilizing the direct elicitation methods employed in this study, it is possible that parental spillover effects are incorporated in child health state valuations, which would result in double counting of the quality of life losses among parents. This is especially possible in the early infantile-onset health states in which it may be hardest for parents to separate the effect of a disease on themselves versus their child. Further understanding and development of methods to measure and incorporate parental spillover can improve cost-effectiveness estimates of childhood interventions.

Second, some challenges are present due to the complexity of the preference-based evaluation task. Wide confidence intervals on many of our estimates indicate substantial variability and uncertainty in measurements. This is a recognized challenge in estimating quality of life for pediatric conditions and is indicative of the complexities of valuing child health for economic evaluation [10, 44]. To mitigate against this complexity, we attempted to find alternative formats to communicate health state descriptions including videos to assist survey respondents in their evaluation of the hypothetical health states. While health utility ratings did not differ based upon video usage, our results indicate that older respondents were more likely to use the videos. Future research should continue to explore a variety of methods to communicate complicated health states to different audiences through available web-based technology.

Third, consistent with conventional approaches to utility elicitation, we did not specify the duration of time spent in a specific health state. This could also have added to the complexity of the questions as respondents may have made assumptions for the duration of time spent in a health state given the severe nature of some of the health states.

Finally, we were limited in selecting an experienced (or patient) sample of respondents due to the rare nature of these conditions. Respondent valuations may not be representative of all experienced adult patients and parents of children with Pompe, PKU or Krabbe disease in the US. As more states begin to screen for these rare diseases, particularly Pompe disease, state-based registries may become more widely available to recruit experienced patients and families to more fully understand the quality of life implications of these rare conditions and their treatment.

Our results indicate that estimated health utilities for Krabbe disease, phenylketonuria, and Pompe disease vary by condition, age of disease onset, and stage of childhood disease; however, all conditions are associated with substantial quality of life losses for children with these rare conditions and their parents. Parental spillover effects were observed across all childhood conditions in this study and were especially notable among infantile-onset and severe childhood conditions. Finally, quality of life valuations reflect the burden of disease for both patients and parents; our study further supports the inclusion of parental spillover effects in economic evaluations to fully assess the quality of life gains and losses related to early detection and treatment of rare conditions in pediatric populations.

CEA:

Cost-effectiveness analysis

ERT:

Enzyme replacement therapy

PKU:

Phenylketonuria

QALY:

Quality-Adjusted Life Year

RUSP:

Recommended Uniform Screening Panel

SACHDNC:

Secretary’s Advisory Committee for Heritable Disorders in Newborns and Children

TTO:

Time-trade-off

We would like to acknowledge the following clinical experts for their time and thoughtful review of the descriptions of health state conditions: Maria Escolar, MD, Priya Kishnani, MD, and Susan Waisbren, PhD. We would also like to acknowledge the contributions and partnerships of Mary Klein, MS and Janice Bach, MS, CGC at the Michigan Department of Health and Human Services and June Ventimiglia, RD at the Metabolic Clinic at the Children’s Hospital of Michigan. We acknowledge Dalton Simancek, and Nicole Elmblad for technical and research assistance, Kate Ulleman for graphic design, and Acham Gebremariam for programming support.

Funding

Financial support for this study was provided by a grant from the Agency for Health Care Research and Quality, R01 HS020644. The funding agreement ensured the authors’ independence in designing the study, interpreting the data, writing, and publishing the report.

Availability of data and materials

The datasets generated and/or analyzed during the current study are not publicly available but are available from the corresponding author upon reasonable request.

Affiliations

1. Ann and Robert H. Lurie Children’s Hospital of Chicago, 225 East Chicago Ave, Chicago, IL, 60611, USA

   • Norma-Jean Simon

2. RTI International, 3040 East Cornwallis Road, P.O. Box 12194, Research Triangle Park, NC, 27709-2194, USA

   • John Richardson

3. Division of Pediatric Genetics, Metabolism and Genomic Medicine, Department of Pediatrics, The University of Michigan Medical School, 4810 Jackson Road, Ann Arbor, MI, 48103, USA

   • Ayesha Ahmad

4. Child Health Evaluation and Research Center, Department of Pediatrics, University of Michigan Medical School, 300 North Ingalls Building, Ann Arbor, MI, 48109, USA

   • Angela Rose
   •  & Lisa A. Prosser

5. Harvard TH Chan School of Public Health, 677 Huntington Avenue, Boston, MA, 02115, USA

   • Eve Wittenberg

6. Center for the Evaluation of Value & Risk in Health, Tufts Medical Center, 800 Washington Street, Boston, MA, 02111, USA

   • Brittany D’Cruz

7. Health Management and Policy, The University of Michigan School of Public Health, 1415 Washington Heights, Ann Arbor, MI, 48109, USA

   • Lisa A. Prosser

Contributions

NJS participated in the design and testing of survey instruments and contributed as primary author of the manuscript. JR conducted statistical analyses and interpreted findings. AA served as a clinical expert and participated in the review of the health state components. AR assisted with acquisition of survey data and contributed to manuscript preparation. BDC participated in the design and testing of survey instruments. LP and EW made substantial contribution to the concept and design of the study, provided interpretation of all study findings, and made contributions to manuscript content. All authors read and approved the final manuscript.

Corresponding author

Correspondence to Lisa A. Prosser.

Ethics approval and consent to participate

This study was approved by the Institutional Review Board at the University of Michigan, Ann Arbor, MI and the Michigan Department of Health and Human Services. UM Protocol No. HUM00079907; MDHHS Protocol No. 201408–14-EA. All procedures performed in studies involving human participants were in accordance with the ethical standards of the institutional research committee and with the 1964 Helsinki declaration and its later amendments or comparable ethical standards.

Consent for publication

Not applicable

Competing interests

The authors declare that they have no competing interests.

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Reprints and Permissions