Skip to main content

The reliability and validity of the TBI-CareQOL system in four diverse caregiver groups

Abstract

Purpose

Establishing the psychometric reliability and validity of new measures is an ongoing process. More work is needed in to confirm the clinical utility of the TBI-CareQOL measurement development system in both an independent cohort of caregivers of traumatic brain injury (TBI), as well as in additional caregiver groups.

Methods

An independent cohort of caregivers of people with TBI (n = 139), as well as three new diverse caregiver cohorts (n = 19 caregivers of persons with spinal cord injury, n = 21 caregivers for persons with Huntington disease, and n = 30 caregivers for persons with cancer), completed 11 TBI-CareQOL measures (caregiver strain; caregiver-specific anxiety; anxiety; depression; anger; self-efficacy; positive affect and well-being; perceived stress; satisfaction with social roles and activities; fatigue; sleep-related impairment), as well as two additional measures to examine convergent and discriminant validity (PROMIS Global Health; the Caregiver Appraisal Scale).

Results

Findings support the internal consistency reliability (all alphas > 0.70 with the vast majority being > 0.80 across the different cohorts) of the TBI-CareQOL measures. All measures were free of ceiling effects, and the vast majority were also free of floor effects. Convergent validity was supported by moderate to high correlations between the TBI-CareQOL and related measures, while discriminant validity was supported by low correlations between the TBI-CareQOL measures and unrelated constructs.

Conclusion

Findings indicate that the TBI-CareQOL measures have clinical utility in caregivers of people with TBI, as well as in other caregiver groups. As such, these measures should be considered as important outcome measures for clinical trials aiming to improve caregiver outcomes.

Plain English summary

As the complexities of disease management and care needs grow, so does the need for informal caregivers. Providing care for a family member or friend with a significant health condition can have a deleterious impact on caregiver health-related quality of life (HRQOL), as well as the HRQOL of the care recipient. Reliable and valid measures of HRQOL can help us to better understand the treatment needs of these caregiver populations.

Introduction

The prevention and treatment of health conditions have traditionally been placed on the individual patient. However, illness impacts the entire family, and the complete picture of health conditions is a collage of the affected patient and family caregiver, experienced by both. While significant scientific discoveries and advances in human health are being made, the complexities of health management and care needs are also growing substantially. As a society, these needs have always been placed on family caregivers who eventually face enormous burden, providing care to a loved one, while maintaining their own health and well-being (e.g., health-related quality of life, HRQOL). It is well-established that the burden of caregiving adversely affects mental well-being, and further prolonged caregiving may even worsen physical health [1,2,3,4,5,6,7,8,9,10,11,12,13,14,15,16,17,18,19,20,21,22,23,24,25,26,27,28,29,30,31,32,33,34]. In turn, caregiver HRQOL can also have a profound impact on care-recipient HRQOL [12, 24,25,26,27,28,29,30,31, 35,36,37,38,39,40,41,42,43]. For decades, the nation’s rapidly aging population and increasing need for caregiving have been called to attention. However, very little action has been taken and this remains a major overlooked challenge facing the aging U.S. population. Thus, family caregiving is an urgent public health issue.

Until recently, existing clinical trials to improve caregiver and care recipient HRQOL was stymied by a lack of available measures to comprehensively assess the multiple areas of HRQOL that are impacted by the caregiver role. To address this gap in measurement, the TBI-CareQOL measurement system was developed to capture important HRQOL concepts specific to caregivers of people with traumatic brain injury [44,45,46,47,48,49,50,51,52]. This system includes 27 item banks that represent aspects of HRQOL that are applicable across different diseases and conditions, as well as those aspects that are more unique to caregivers or caregivers of people with traumatic brain injury, specifically. Preliminary data in the development cohorts has supported the clinical utility of this measurement system in caregivers of people with TBI, but it has yet to be confirmed in an independent sample of caregivers.

In addition, most of the concepts that the TBI-CareQOL captures, at least at face value, are broadly applicable to other caregiving populations. We would expect that the clinical utility of these measures should be broadly applicable to caregivers of people that experience other adult-onset traumatic injuries. We would also like to determine if these measures will demonstrate clinical utility in caregiver cohorts of individuals caring for those with insidious, progressive conditions, as well as caregiver cohorts of individuals dealing with more episodic relapsing and remitting conditions. As such, we need to examine the psychometric properties of these new measures in diverse caregiver populations, in order to establish their clinical utility as primary or secondary endpoints in clinical trials.

Therefore, the purpose of this analysis was to provide data to support the psychometric reliability and validity of 11 of the TBI-CareQOL measurement system item banks (caregiver strain, caregiver-specific anxiety, anxiety, depression, anger, self-efficacy, positive affect and well-being, perceived stress, satisfaction with social roles and activities, fatigue and sleep-related impairment) in an independent sample of caregivers of people with TBI, as well as in three new diverse caregiver cohorts (caregivers of persons with: (1) a chronic condition that was caused by a traumatic event [SCI = spinal cord injury], (2) caregivers for persons with a progressive, fatal neurodegenerative disease [HD = Huntington disease], and (3) caregivers for persons with an episodic cancer condition that requires intense, prolonged inpatient and outpatient treatment (HCT = allogeneic hematopoietic cell transplantation]). We provide data examining the internal consistency, measurement characteristics, concurrent validity, and discriminant validity of these 11 TBI-CareQOL system item banks across these four diverse cohorts to contribute to a body of growing research to support both their clinical utility in caregivers of people with TBI, but also in other, independent caregiver cohorts.

Method

Participants

The data examined in this analysis represents data collected across two different studies: an independent cohort of N = 139 caregivers of people with TBI (NCT04570930), as well as three new caregiver cohorts: N = 19 caregivers of people with SCI, N = 21 caregivers of people with HD, and N = 30 caregivers of people undergoing HCT (NCT04556591). The detailed protocols for these RCTs are published and available for review [53, 54]. Data collection for the TBI cohort occurred at both the University of Michigan and Baylor College of Medicine/TIRR Memorial Hermann; data collection for the SCI, HD, and HCT cohorts occurred only at the University of Michigan. Several recruitment sources were used including hospital and community-based recruitment, as well as lab-specific research registries (of both caregivers and patients), medical record data capture systems [55], and a website and social media postings. Caregivers were recruited directly, or through the person for whom they provide care (i.e., the individual with TBI, SCI, HD or HCT).

All caregivers had to be at least 18 years of age, able to read and understand English, and caring for an adult (i.e., ages 18 and above) with a medically documented SCI, HD, HCT, or TBI. Caregivers had to indicate a response ≥ 1 on the following question: “On a scale of 0–10, where 0 is ‘no assistance’ and 10 is ‘assistance with all activities’, how much assistance does the person you care for require from you to complete activities of daily living due to problems resulting from his/her TBI/HD/SCI/HCT? Activities could consist of personal hygiene, dressing and undressing, housework, taking medications, managing money, running errands, shopping for groceries or clothing, transportation, meal preparation and cleanup, remembering things, etc.” In addition, caregivers of individuals with SCI and TBI had to be caring for someone that was ≥ 1 year post-injury and caregivers of persons with HCT had to be caring for an individual who was receiving, had received or was scheduled to receive HCT. Caregivers also had to be willing to use their own technology (i.e., smartphone/tablet and internet access) and be willing to download the CareQOL app and the Fitbit® app on their personal device. Paid, professional caregivers were excluded.

Study design

Both studies used a two-arm randomized controlled design. Study participation involved a 2-h baseline virtual study visit followed by a 10-day run-in period then a 6-month (120 day) or 3-month (90 day) home monitoring period (for the TBI study, and the SCI/HCT/HD study, respectively). Data for this analysis was from the baseline visit (i.e., the 2-h virtual study visit; data collection occurred from December 2020 through February 2022 for the TBI study, and from November 2020 through March 2021 for the SCI/HCT/HD study) which involved informed consent, the completion of several self-report measures and instructions for the home-monitoring period. All study procedures were approved by the institutional review board (IRBs) for the data collection sites (IRBMED HUM00184455, HUM00181282, and HUM00186921; IRBMED Baylor College of Medicine SITE0000087; Baylor College of Medicine/Memorial Hermann IRB number H-48478). These trials are also registered with ClinicalTrials.gov (NCT04556591 and NCT04570930).

Measures

The measures that were considered for these analyses are reported below.

TBI-CareQOL Caregiver-specific measures. Two caregiver-specific measures were administered from the TBI-CareQOL measurement system: (1) TBI-CareQOL Caregiver Strain short form (SF) [44, 56] assesses perceived feelings of feeling overwhelmed, stressed and “beat-down” related to the caregiver role; and (2) TBI-CareQOL Caregiver-Specific Anxiety SF [44, 57] assesses perceived feelings of worry and anxiety specific to the safety, health, and future well-being of the person with TBI. Items on these measures that referred to the “person with the injury” were modified to read “person with the illness” for use in the HD and HCT cohort. These measures are scored on a T metric (M = 50; SD = 10). Higher scores indicate more strain or caregiver-specific anxiety, respectively. Administration times for each of these measures is ~ 1 min.

TBI-CareQOL Mental Health Measures. Six caregiver-specific measures were administered from the TBI-CareQOL measurement system: (1) TBI-CareQOL PROMIS Anxiety SF [58] assesses self-reported feelings of fear, anxiety and hyperarousal; (2) TBI-CareQOL PROMIS Depression SF [58] assesses self-reported feelings of sadness and worthlessness; (3) TBI-CareQOL PROMIS Anger SF [58] assesses self-reported feelings of irritability and frustration; (4) TBI-CareQOL NIH Toolbox Self-Efficacy [59] assesses self-reported confidence in the ability to successfully perform specific tasks or behaviors related to one’s overall functioning; (5) TBI-CareQOL Neuro-QoL Positive Affect & Well-Being SF [60] assesses parts of an individual’s life that are related to overall life meaning and purpose, well-being and satisfaction; and (6) TBI-CareQOL NIH Toolbox Perceived Stress SF [59] assesses an individual’s feelings about the nature of events and individual coping resources. These measures are all scored on a T metric (M = 50; SD = 10). Higher scores indicate more of the named construct (i.e., worse HRQOL for negatively named constructs and better HRQOL for positively named constructs). Administration time for each measure is ~ 1 min.

TBI-CareQOL Social Health Measure. The PROMIS Ability to Participate in Social Roles and Activities SF [58] assesses involvement in one’s ability to participate in usual social roles and activities. This measure is scored on a T metric (M = 50; SD = 10). Higher scores indicate more ability to participate. Administration time is ~ 1 min.

TBI-CareQOL Physical Health Measures. Two TBI-CareQOL physical health measures were administered: (1) TBI-CareQOL PROMIS Sleep-Related Impairment SF[61] assesses the effect of poor sleep on daytime functioning; and (2) TBI-CareQOL PROMIS Fatigue SF [58] assesses self-reported symptoms of fatigue, ranging from mild subjective feelings of tiredness to overwhelming exhaustion that may decrease one’s ability to perform activities of daily living. These measures are also scored on a T metric (M = 50; SD = 10). Higher scores indicate more sleep-related impairment or fatigue, respectively. Administration time for each of these measures is ~ 1 min.

Convergent and discriminant validity measures

PROMIS Global Health v1.2 [62] is a 10-item patient-reported outcome measure that assesses overall physical, mental, and social health. This measure is scored on a T metric (M = 50; SD = 10); separate scores are generated for physical and mental health. Higher scores indicate better health. The administration time for this measure is ~ 3 min. Mental health scores were used to demonstrate convergent validity for 4 of the 11 TBI-CareQOL measures (Anxiety, Depression, Anger, and Positive Affect and Well-Being). Physical health scores were used to demonstrate convergent validity for 2 of the 11 TBI-CareQOL measures (Fatigue and Sleep-related Impairment). PROMIS Global Health has been used in different caregiver populations and has data to support its clinical utility in these cohorts [63,64,65].

The Caregiver Appraisal Scale [66] is a 47-item measure that is designed to capture the positive and negative aspects of caregiving. Sum scores are calculated to reflect four separate subdomain scores (perceived burden, caregiver relationship satisfaction, caregiving ideology, and caregiving mastery); higher scores indicating better functioning. This measure takes between 5 and 10 min to complete. Items and instructions for this measure that referred to the “person with the injury” were modified to read “person with the illness” for use in the HD and HCT cohort. Subdomain scores on Caregiver Burden were used to demonstrate convergent validity for 4 of the 11 TBI-CareQOL measures (Caregiver-Specific Anxiety, Caregiver Strain, Perceived Stress, and Ability to Participate in Social Roles and Activities) and subdomain scores on Ideology and Mastery were used to demonstrate discriminant validity of the CareQOL measures. The Caregiver Appraisal Scale has been used in different caregiver populations and has data to support the reliability and validity across these cohorts [66,67,68,69].

Statistical analyses

Analyses were conducted using SAS v9.4; analyses were run separately for each of the four caregiver groups, as well as for the combined sample.

Internal Consistency and Measurement Characteristics. Internal consistency reliability was examined using Cronbach’s alpha. Minimal acceptable reliability was specified as ≥ 0.70 [70, 71]. Measurement characteristics for floor and ceiling effects were also calculated (i.e., the percentage of participants who had the highest or lowest possible SF score respectively). The criterion for floor and ceiling rates was ≤ 20% [72, 73].

Convergent and Discriminant Validity. Pearson correlations among the different measures were used to examine convergent and discriminant validity. Convergent validity would be supported by moderate to strong correlations (“moderate” = r’s ≥ 0.36—0.67 and “high” = r’s between 0.68 and 0.89) between each TBI-CareQOL measure and its hypothesized comparator [74]. Discriminant validity would be supported by weak correlations (“low” = r’s ≤ 0.35) between each TBI-CareQOL measure and measures of caregiver mastery and caregiver ideology from the Caregiver Appraisal Scale [74].

Results

A total of 139 caregivers of persons with TBI, as well as 19 caregivers of persons with SCI, 21 caregivers of persons with HD, and 30 caregivers of persons with HCT were enrolled in this study. The sample characteristics are provided in Table 1.

Table 1 Sample characteristics

For the 11 TBI-CareQOL HRQOL measures, internal consistency reliability ranged from acceptable to excellent for the SCI and HCT samples, and from good to excellent for the HD and TBI samples; in all cases the a priori criterion for acceptable reliability was met (Table 2). There were no ceiling effects for any of the TBI-CareQOL measures for any of the cohorts (Table 2). There was a floor effect for Depression for all cohorts except TBI; there was also a slight floor effect for Caregiver-Specific Anxiety and Anxiety for the SCI sample.

Table 2 Descriptive information and reliability data for TBI-CareQOL measures

For all of the measures and across all of the samples, a priori hypotheses for convergent validity were met (see Table 3). With regard to discriminant validity (Table 3), the majority of findings were consistent with our hypothesized expectations. Exceptions included stronger relationships between Caregiver-Specific Anxiety and Caregiver Ideology for the SCI and HCT samples, between Strain and Caregiver Ideology for the HD sample, between Positive Affect and Well-being and Caregiver Mastery for the HD sample, the two physical function measures (Sleep-related Impairment and Fatigue) and Caregiver Mastery for the HD sample, and between Positive Affect and Well-Being and Caregiver Ideology for the HCT sample.

Table 3 Convergent and discriminant validity

Discussion

This report provides data to support the reliability and validity of scores on several HRQOL measures from the TBI-CareQOL measurement system (which was developed specifically for use in caregivers of people with TBI) in an independent sample of caregivers of people with TBI, as well as in three new caregiver populations: caregivers of people with SCI, caregivers of people with Huntington disease, and caregivers of people with cancer. Measurement validation is an ongoing process, and data are needed across multiple studies and multiple samples over time. These data provide the beginning of what will hopefully eventually become a large body of evidence to support the clinical utility of these measures across diverse caregiver populations. No individual finding (that either supports or refutes a priori hypotheses for different psychometric properties) is sufficient for establishing the clinical utility of a new measure, rather it is the cumulative body of evidence that provides support for the reliability and validity of the scores in any given population [75]. As is evident in this sample, measurement properties will vary by cohort, as well as by study, and an understanding of measurement properties, and of the strengths and weaknesses of a particular measure in a particular population, is critical to proper score interpretation.

In this report, the psychometric properties were the strongest (i.e., most consistent with our a priori hypotheses/criteria) for the cohort of caregivers with TBI, which was also, subsequently, the largest cohort in this report. This was not especially surprising given: (1) many of the TBI-CareQOL measures were developed and calibrated in caregivers of TBI, and (2) that the sample of this cohort was more than quadruple that of the other cohorts (larger samples result in more stable score estimates). There is almost always a loss of sensitivity and specificity the “further away” you get from the measurement development cohort. This loss can be greater or smaller depending on both the heterogeneity of the initial development sample, and the number of characteristics that the development cohort has in common with the new cohort. This issue is at the very heart of many debates about the clinical utility of generic measures (i.e., measures that can be used across populations and allow for cross-disease comparison), versus specific measures (i.e., measures developed specifically for a given population that include content that may or may not be relevant to other groups). Yet, it is also important to note that even though the sample sizes of the other three cohorts was substantially smaller, the pattern of findings is largely identical which is supportive of the clinical utility of the TBI-CareQOL measurement system more broadly across caregiver populations.

With regard to the individual measures and the subgroup analyses, there was consistent support for both the reliability and validity of the scores on these HRQOL measures for the three new caregiver cohorts. For all HRQOL measures and all four caregiver subgroups, internal consistency reliability was supported. For caregivers of people with SCI, two measures indicated acceptable reliability (depression and self-efficacy) whereas all other measures had either good or excellent reliability. For caregivers of people with HCT, there were also two measures with acceptable reliability (depression, as also seen in SCI, but also caregiver-specific anxiety); again, all other measures had either good or excellent reliability. For both HD and TBI all measures were in the good to excellent range.

With regard to other measurement properties, none of the measures had ceiling effects, and only a few had floor effects (and most of these were pretty small). The measures with evidence of a floor effect were specific to mental health concepts: specifically, for anxiety (there was a minimal effect for caregiver-specific anxiety and a slightly more substantial floor effect for anxiety in SCI) and depression (there was a substantial floor effect in SCI, HD, and HCT). Given that most clinical or research interventions are focused on mitigating negative symptoms (such as depression and anxiety) a floor effect is generally not especially problematic given that most interventions are focused on reducing symptoms when they are present, or on detecting people that may be experiencing clinically significant problems. Those individuals, at the floor, are not the focus of such inquiries.

In addition, all TBI-CareQOL measures had moderate to strong relationships with comparator measures across all the caregiver cohorts. In general, almost all of the hypothesized discriminant validity comparators (caregiver ideology and caregiver mastery) had small to negligible relationships with the TBI-CareQOL HRQOL measures. There were a couple of exceptions to our hypotheses: there was a moderate relationship between caregiver-specific anxiety and caregiver ideology for caregivers of people with SCI. There was also a moderate relationship between caregiver strain and caregiver ideology for caregivers of people with HD. While we did not anticipate these relationships, retrospective analysis of the literature provides some possible explanation. For example, even though there were very few significant differences among the groups for the different demographic variables, it is possible that the observed trends for demographic differences among the groups may partially explain these unanticipated findings. For example, the SCI caregivers reported the longest time in the caregiver role relative to the other groups and therefore may also have stronger ratings of caregiver ideology. Similarly, the HD group had the highest number of male caregivers and had the highest percentage of being single/divorced, the highest percentage being employed full-time, the oldest caregivers, and the highest percentage of spousal caregivers, which are all factors that could be associated with worse caregiver strain. In addition, caregivers who hold traditional ideologies, such as perceiving caregiving as a family obligation, may be less likely to experience strain and/or anxiety regarding the caregiver role. Prior research has demonstrated that a perception of benefit from providing support to others, including family members, is associated with lower mortality [76] and less depression [77]. Thus, it is also possible that caregiver ideology reflects underlying resilience, which has been found to impact risk of stress or burden for caregivers [78].

Study limitations include the secondary use of data from a randomized control trial that was not designed specifically to establish the psychometric properties of these new measures. In addition, the small sample size of the three new caregiver cohorts (SCI, HD, and HCT) precluded our ability to examine known groups validity, or responsiveness to change. Future work is needed to examine these additional indices of validity in these new cohorts. In addition, although rates for race/ethnicity in the HD cohort were consistent with established prevalence rates (i.e., HD is considered a euro-ethnic disease) [79,80,81,82] the absence of any racial or ethnic diversity in this group limits the generalizability of these findings.

Conclusion

Given that this sample represents four distinct caregiver cohorts—two cohorts of caregivers of people that have an injury caused by a traumatic event (either TBI or SCI), a cohort of caregivers of persons with a fatal neurodegenerative disease, and a cohort of caregivers of people with a relapsing and remitting cancer condition—these data would also suggest that these measures might also be extended for use in other caregiver cohorts with similar etiology/presentation (e.g., caregivers of people with Alzheimer’s disease, stroke, Parkinson’s disease, multiple sclerosis, or other cancer conditions) and used more broadly in the caregiver literature. While this does not preclude the need for additional reliability and validity data in new caregiver cohorts, they do provide evidence that would suggest a pattern of findings that is likely generalizable more broadly across caregiver groups beyond TBI, SCI, HD, and HCT.

Availability of data and materials

NCT04556591: Participant data collected during the trial, after de-identification, will be available for sharing with individuals in the scientific community, upon request from the study PI (Noelle E Carlozzi; PMR-CODAlab@med.umich.edu). The data is currently available. An institutional data use agreement will be required before data is shared. NCT04570930: Participant data collected during the trial, after de-identification, will be available for sharing with individuals in the scientific community, upon request from the study PI (Noelle E Carlozzi; PMR-CODAlab@med.umich.edu). The data will be available after the main findings are published; data is expected to be available in late 2024/early 2025. An institutional data use agreement will be required before data is shared.

Abbreviations

HCT:

Allogeneic hematopoietic cell transplantation

HD:

Huntington disease

HRQOL:

Health-related quality of life

NIH:

National Institutes of Health

PROMIS:

Patient-Reported Outcome Measurement Information System

SCI:

Spinal cord injury

References

  1. Kreutzer JS, Gervasio AH, Camplair PS (1994) Primary caregivers’ psychological status and family functioning after traumatic brain injury. Brain Inj 8(3):197–210

    Article  CAS  PubMed  Google Scholar 

  2. Hall KM, Karzmark P, Stevens M, Englander J, O’Hare P, Wright J (1994) Family stressors in traumatic brain injury: a two-year follow-up. Arch Phys Med Rehabil 75(8):876–884

    Article  CAS  PubMed  Google Scholar 

  3. Panting A, Merry P (1972) The long term rehabilitation of severe head injuries with particular reference to the need for social and medical support for the patient’s family. Rehabilitation 38:33–37

    Google Scholar 

  4. Marsh NV, Kersel DA, Havill JH, Sleigh JW (1998) Caregiver burden at 6 months following severe traumatic brain injury. Brain Inj 12(3):225–238

    Article  CAS  PubMed  Google Scholar 

  5. Livingston MG, Brooks DN, Bond MR (1985) Patient outcome in the year following severe head injury and relatives’ psychiatric and social functioning. J Neurol Neurosurg Psychiatry 48(9):876–881

    Article  CAS  PubMed Central  PubMed  Google Scholar 

  6. Saban KL, Griffin JM, Urban A, Janusek MA, Pape TLB, Collins E (2016) Perceived health, caregiver burden, and quality of life in women partners providing care to Veterans with traumatic brain injury. J Rehabil Res Dev 53(6):681–691

    Article  PubMed  Google Scholar 

  7. Carlozzi NE, Brickell TA, French LM, Sander A, Kratz AL, Tulsky DS, Chiaravalloti ND, Hahn EA, Kallen M, Austin AM, Miner JA, Lange RT (2016) Caring for our wounded warriors: a qualitative examination of health-related quality of life in caregivers of individuals with military-related traumatic brain injury. J Rehabil Res Dev 53(6):669–680

    Article  PubMed Central  PubMed  Google Scholar 

  8. Knight RG, Devereux R, Godfrey HP (1998) Caring for a family member with a traumatic brain injury. Brain Inj 12(6):467–481

    Article  CAS  PubMed  Google Scholar 

  9. Marsh NV, Kersel DA, Havill JA, Sleigh JW (2002) Caregiver burden during the year following severe traumatic brain injury. J Clin Exp Neuropsychol 24(4):434–447

    Article  PubMed  Google Scholar 

  10. Arango-Lasprilla JC, Nicholls E, Villasenor Cabrera T, Drew A, Jimenez-Maldonado M, Martinez-Cortes ML (2011) Health-related quality of life in caregivers of individuals with traumatic brain injury from Guadalajara. Mexico J Rehabil Med 43(11):983–986

    Article  PubMed  Google Scholar 

  11. McPherson KM, Pentland B, McNaughton HK (2000) Brain injury—the perceived health of carers. Disabil Rehabil 22(15):683–689

    Article  CAS  PubMed  Google Scholar 

  12. Carlozzi NE, Kratz AL, Sander AM, Chiaravalloti ND, Brickell TA, Lange RT, Hahn EA, Austin A, Miner JA, Tulsky DS (2015) Health-related quality of life in caregivers of individuals with traumatic brain injury: development of a conceptual model. Arch Phys Med Rehabil 96(1):105–113

    Article  PubMed  Google Scholar 

  13. Ponsford J, Schonberger M (2010) Family functioning and emotional state two and five years after traumatic brain injury. J Int Neuropsychol Soc 16(2):306–317

    Article  PubMed  Google Scholar 

  14. Brooks N, Campsie L, Symington C, Beattie A, McKinlay W (1986) The five year outcome of severe blunt head injury: a relative’s view. J Neurol Neurosurg Psychiatry 49(7):764–770

    Article  CAS  PubMed Central  PubMed  Google Scholar 

  15. Brooks N, Campsie L, Symington C, Beattie A, McKinlay W (1987) The effects of severe head injury on patient and relatives within seven years of injury. J Head Trauma Rehabil 2:1–13

    Article  Google Scholar 

  16. Kreutzer JS, Rapport LJ, Marwitz JH, Harrison-Felix C, Hart T, Glenn M, Hammond F (2009) Caregivers’ well-being after traumatic brain injury: a multicenter prospective investigation. Arch Phys Med Rehabil 90(6):939–946

    Article  PubMed  Google Scholar 

  17. Gillen R, Tennen H, Affleck G, Steinpreis R (1998) Distress, depressive symptoms, and depressive disorder among caregivers of patients with brain injury. J Head Trauma Rehabil 13(3):31–43

    Article  CAS  PubMed  Google Scholar 

  18. Winstanley J, Simpson G, Tate R, Myles B (2006) Early indicators and contributors to psychological distress in relatives during rehabilitation following severe traumatic brain injury: findings from the Brain Injury Outcomes Study. J Head Trauma Rehabil 21(6):453–466

    Article  PubMed  Google Scholar 

  19. Pickett T Jr, Altmaier E, Paulsen JS (2007) Caregiver burden in Huntington’s disease. Rehabil Psychol 52(3):311–318

    Article  Google Scholar 

  20. Bevans MF, Mitchell SA, Marden S (2008) The symptom experience in the first 100 days following allogeneic hematopoietic stem cell transplantation (HSCT). Support Care Cancer 16(11):1243–1254

    Article  PubMed Central  PubMed  Google Scholar 

  21. Simoneau TL, Mikulich-Gilbertson SK, Natvig C, Kilbourn K, Spradley J, Grzywa-Cobb R, Philips S, McSweeney P, Laudenslager ML (2013) Elevated peri-transplant distress in caregivers of allogeneic blood or marrow transplant patients. Psychooncology 22(9):2064–2070

    Article  PubMed Central  PubMed  Google Scholar 

  22. Applebaum AJ, Bevans M, Son T, Evans K, Hernandez M, Giralt S, DuHamel K (2016) A scoping review of caregiver burden during allogeneic HSCT: lessons learned and future directions. Bone Marrow Transplant 51(11):1416–1422

    Article  CAS  PubMed Central  PubMed  Google Scholar 

  23. Foxall MJ, Gaston-Johansson F (1996) Burden and health outcomes of family caregivers of hospitalized bone marrow transplant patients. J Adv Nurs 24(5):915–923

    Article  CAS  PubMed  Google Scholar 

  24. Smith AM, Schwirian PM (1998) The relationship between caregiver burden and TBI survivors’ cognition and functional ability after discharge. Rehabil Nurs 23(5):252–257

    Article  CAS  PubMed  Google Scholar 

  25. Vangel SJ Jr, Rapport LJ, Hanks RA (2011) Effects of family and caregiver psychosocial functioning on outcomes in persons with traumatic brain injury. J Head Trauma Rehabil 26(1):20–29

    Article  PubMed  Google Scholar 

  26. Florian V, Katz S, Lahav V (1989) Impact of traumatic brain damage on family dynamics and functioning: a review. Brain Inj 3(3):219–233

    Article  CAS  PubMed  Google Scholar 

  27. McLaughlin AM, Carey JL (1993) The adversarial alliance: developing therapeutic relationships between families and the team in brain injury rehabilitation. Brain Inj 7(1):45–51

    Article  CAS  PubMed  Google Scholar 

  28. Pelletier PM, Alfano DP (2000) Depression, social support, and family coping following traumatic brain injury. Brain Cogn 44(1):45–49

    Article  Google Scholar 

  29. Sander AM, Caroselli JS, High WM, Becker C, Neese L, Scheibel R (2002) Relationship of family functioning to progress in a post-acute rehabilitation programme following traumatic brain injury. Brain Inj 16(8):649–657

    Article  PubMed  Google Scholar 

  30. Sander AM, Maestas KL, Sherer M, Malec JF, Nakase-Richardson R (2012) Relationship of caregiver and family functioning to participation outcomes after postacute rehabilitation for traumatic brain injury: a multicenter investigation. Arch Phys Med Rehabil 93(5):842–848

    Article  PubMed  Google Scholar 

  31. Sady MD, Sander AM, Clark AN, Sherer M, Nakase-Richardson R, Malec JF (2010) Relationship of preinjury caregiver and family functioning to community integration in adults with traumatic brain injury. Arch Phys Med Rehabil 91(10):1542–1550

    Article  PubMed  Google Scholar 

  32. Shaffer KM, Kim Y, Carver CS, Cannady RS (2017) Effects of caregiving status and changes in depressive symptoms on development of physical morbidity among long-term cancer caregivers. Health Psychol 36(8):770–778

    Article  PubMed Central  PubMed  Google Scholar 

  33. Kent EE, Rowland JH, Northouse L, Litzelman K, Chou WYS, Shelburne N, Timura C, O’Mara A, Huss K (2016) Caring for caregivers and patients: research and clinical priorities for informal cancer caregiving. Cancer 122(13):1987–1995

    Article  PubMed  Google Scholar 

  34. National Alliance for Caregiving (2016). Cancer caregiving in the U.S.: an intense, episodic, and challenging care experience

  35. Ready RE, Mathews M, Leserman A, Paulsen JS (2008) Patient and caregiver quality of life in Huntington’s disease. Mov Disord 23(5):721–726

    Article  PubMed Central  PubMed  Google Scholar 

  36. Anderson V, Catroppa C, Haritou F, Morse S, Pentland L, Rosenfeld J, Stargatt R (2001) Predictors of acute child and family outcome following traumatic brain injury in children. Pediatr Neurosurg 34(3):138–148

    Article  CAS  PubMed  Google Scholar 

  37. Temple JL, Struchen MA, Pappadis MR (2016) Impact of pre-injury family functioning and resources on self-reported post-concussive symptoms and functional outcomes in persons with mild TBI. Brain Inj 30(13–14):1672–1682

    Article  PubMed  Google Scholar 

  38. Holland JN, Schmidt AT (2015) Static and dynamic factors promoting resilience following traumatic brain injury: a brief review. Neural Plast 2015:902802

    Article  PubMed Central  PubMed  Google Scholar 

  39. Schonberger M, Ponsford J, Olver J, Ponsford M (2010) A longitudinal study of family functioning after TBI and relatives’ emotional status. Neuropsychol Rehabil 20(6):813–829

    Article  PubMed  Google Scholar 

  40. Ramkumar NA, Elliott TR (2010) Family caregiving of persons following neurotrauma: issues in research, service and policy. NeuroRehabilitation 27(1):105–112

    Article  PubMed Central  PubMed  Google Scholar 

  41. Kreutzer JS, Marwitz JH, Godwin EE, Arango-Lasprilla JC (2010) Practical approaches to effective family intervention after brain injury. J Head Trauma Rehabil 25(2):113–120

    Article  PubMed  Google Scholar 

  42. Barata A, Wood WA, Choi SW, Jim HSL (2016) Unmet needs for psychosocial care in hematologic malignancies and hematopoietic cell transplant. Curr Hematol Malig Rep 11(4):280–287

    Article  PubMed  Google Scholar 

  43. Rohleder N, Marin TJ, Ma R, Miller GE (2009) Biologic cost of caring for a cancer patient: dysregulation of pro- and anti-inflammatory signaling pathways. J Clin Oncol 27(18):2909–2915

    Article  PubMed  Google Scholar 

  44. Carlozzi N, Kallen M, Hanks R, Hahn E, Brickell T, Lange R, French L, Kratz A, Tulsky D, Cella D, Sander A (2019) The TBI-CareQOL measurement system: development and preliminary validation of health-related quality of life measures for caregivers of civilians and service members/veterans with traumatic brain injury. Arch Phys Med Rehabil 100:S1–S12

    Article  PubMed  Google Scholar 

  45. Carlozzi N, Kallen M, Hanks R, Kratz A, Hahn E, Brickell T, Lange R, French L, Ianni P, Miner J (2019) The development of a new computer adaptive test to evaluate feelings of being trapped in caregivers of individuals with traumatic brain injury: TBI-CareQOL Feeling Trapped Item Bank. Arch Phys Med Rehabil 100:S43–S51

    Article  PubMed  Google Scholar 

  46. Carlozzi N, Kallen M, Ianni P, Hahn E, French L, Lange R, Brickell T, Hanks R, Sander A (2019) The development of a new computer-adaptive test to evaluate strain in caregivers of individuals with TBI: TBI-CareQOL caregiver strain. Arch Phys Med Rehabil 100(4S):S13–S21

    Article  PubMed  Google Scholar 

  47. Carlozzi N, Kallen M, Ianni P, Sander A, Hahn E, Lange R, Brickell T, French L, Miner J, Hanks R (2019) The development of two new computer adaptive tests to evaluate feelings of loss in caregivers of individuals with traumatic brain injury: TBI-CareQOL feelings of loss-self and feelings of loss-person with traumatic brain injury. Arch Phys Med Rehabil 100(4S):S31–S42

    Article  PubMed  Google Scholar 

  48. Carlozzi N, Kallen M, Sander A, Brickell T, Lange R, French L, Ianni P, Miner J, Hanks R (2019) The development of a new computer adaptive test to evaluate anxiety in caregivers of individuals with traumatic brain injury: TBI-CareQOL caregiver-specific anxiety. Arch Phys Med Rehabil 100(4S):S22–S30

    Article  PubMed  Google Scholar 

  49. Carlozzi N, Lange R, Boileau N, Kallen M, Sander A, Hanks R, Nakase-Richardson R, Tulsky D, Massengale J, French L, Brickell T (2020) TBI-CareQOL family disruption: family disruption in caregivers of persons with TBI. Rehabil Psychol 65(4):390–400

    Article  PubMed  Google Scholar 

  50. Carlozzi N, Lange R, French L, Kallen M, Boileau N, Hanks R, Nakase-Richardson R, Massengale J, Sander A, Hahn E, Miner J, Brickell T (2020) TBI-CareQOL military health care frustration in caregivers of service members/veterans with traumatic brain injury. Rehabil Psychol 65(4):360–376

    Article  PubMed  Google Scholar 

  51. Carlozzi N, Lange R, Kallen M, Boileau N, Sander A, Massengale J, Nakase-Richardson R, Tulsky D, French L, Hahn E, Ianni P, Miner J, Hanks R, Brickell T (2020) Assessing vigilance in caregivers after traumatic brain injury: TBI-CareQOL Caregiver Vigilance. Rehabil Psychol 65:418

    Article  PubMed Central  PubMed  Google Scholar 

  52. Sander A, Boileau N, Hanks R, Tulsky D, Carlozzi N (2020) Emotional suppression and hypervigilance in military caregivers: relationship to negative and positive affect. J Head Trauma Rehabil 35(1):E10–E20

    Article  PubMed Central  PubMed  Google Scholar 

  53. Carlozzi NE, Choi SW, Wu Z, Miner JA, Lyden AK, Graves C, Wang J, Sen S (2021) An app-based just-in-time adaptive self-management intervention for care partners (CareQOL): protocol for a pilot trial. JMIR Res Protoc 10(12):e32842

    Article  PubMed Central  PubMed  Google Scholar 

  54. Carlozzi NE, Sander AM, Choi SW, Wu Z, Miner JA, Lyden AK, Graves C, Sen S (2022) Improving outcomes for care partners of persons with traumatic brain injury: protocol for a randomized control trial of a just-in-time-adaptive self-management intervention. PLoS ONE 17(6):e0268726

    Article  CAS  PubMed Central  PubMed  Google Scholar 

  55. Hanauer DA, Mei Q, Law J, Khanna R, Zheng K (2015) Supporting information retrieval from electronic health records: a report of University of Michigan’s nine-year experience in developing and using the Electronic Medical Record Search Engine (EMERSE). J Biomed Inform 55:290–300

    Article  PubMed Central  PubMed  Google Scholar 

  56. Carlozzi NE, Kallen MA, Ianni PA, Hahn EA, French LM, Lange RT, Brickell TA, Hanks R, Sander AM (2018) The development of a new computer-adaptive test to evaluate strain in caregivers of individuals with TBI: TBI-CareQOL caregiver strain. Arch Phys Med Rehabil 100:S13–S21

    Article  PubMed Central  PubMed  Google Scholar 

  57. Carlozzi NE, Kallen MA, Sander AM, Brickell TA, Lange RT, French LM, Ianni PA, Miner JA, Hanks R (2018) The development of a new computer adaptive test to evaluate anxiety in caregivers of individuals with traumatic brain injury: TBI-CareQOL Caregiver-Specific Anxiety. Arch Phys Med Rehabil 100:S22–S30

    Article  PubMed Central  PubMed  Google Scholar 

  58. Cella D, Yount S, Rothrock N, Gershon R, Cook K, Reeve B, Ader D, Fries JF, Bruce B, Rose M (2007) The patient-reported outcomes measurement information system (PROMIS): progress of an NIH Roadmap cooperative group during its first two years. Med Care 45(5 Suppl 1):S3–S11

    Article  PubMed Central  PubMed  Google Scholar 

  59. Salsman JM, Butt Z, Pilkonis PA, Cyranowski JM, Zill N, Hendrie HC, Kupst MJ, Kelly MA, Bode RK, Choi SW, Lai JS, Griffith JW, Stoney CM, Brouwers P, Knox SS, Cella D (2013) Emotion assessment using the NIH Toolbox. Neurology 80(11 Suppl 3):S76-86

    Article  PubMed Central  PubMed  Google Scholar 

  60. Salsman JM, Victorson D, Choi SW, Peterman AH, Heinemann AW, Nowinski C, Cella D (2013) Development and validation of the positive affect and well-being scale for the neurology quality of life (Neuro-QOL) measurement system. Qual Life Res 22(9):2569–2580

    Article  PubMed  Google Scholar 

  61. Buysse DJ, Yu L, Moul DE, Germain A, Stover A, Dodds NE, Johnston KL, Shablesky-Cade MA, Pilkonis PA (2010) Development and validation of patient-reported outcome measures for sleep disturbance and sleep-related impairments. Sleep 33(6):781–792

    Article  PubMed Central  PubMed  Google Scholar 

  62. Hays RD, Bjorner JB, Revicki DA, Spritzer KL, Cella D (2009) Development of physical and mental health summary scores from the patient-reported outcomes measurement information system (PROMIS) global items. Qual Life Res 18(7):873–880

    Article  PubMed Central  PubMed  Google Scholar 

  63. Van Citters AD, Kennedy AM, Kirkland KB, Dragnev KH, Leach SD, Buus-Frank ME, Malcolm EF, Holthoff MM, Holmes AB, Nelson EC, Reeves SA, Tosteson ANA, Promise Partnership Delphi P (2022) Prioritizing measures that matter within a person-centered oncology learning health system. JNCI Cancer Spectr 6(3):037

    Google Scholar 

  64. Agarwal S, Jalan M, Wilcox HC, Sharma R, Hill R, Pantalone E, Thrul J, Rainey JC, Robinson KA (2022) Evaluation of mental health mobile applications. Rockville

  65. Baker E, Lester L, Mason K, Bentley R (2020) Mental health and prolonged exposure to unaffordable housing: a longitudinal analysis. Soc Psychiatry Psychiatr Epidemiol 55(6):715–721

    Article  PubMed  Google Scholar 

  66. Lawton MP, Kleban MH, Moss M, Rovine M, Glicksman A (1989) Measuring caregiving appraisal. J Gerontol 44(3):P61-71

    Article  CAS  PubMed  Google Scholar 

  67. Struchen MA, Atchison TB, Roebuck TM, Caroselli JS, Sander AM (2002) A multidimensional measure of caregiving appraisal: validation of the Caregiver Appraisal Scale in traumatic brain injury. J Head Trauma Rehabil 17(2):132–154

    Article  PubMed  Google Scholar 

  68. Brickell TA, Reid MW, French LM, Lippa SM, Sullivan JK, Wright MM, Driscoll AE, Gartner RL, Varbedian NV, Lange RT (2019) Factor analysis of the caregiver appraisal scale in military TBI. Rehabil Psychol 64(3):366–376

    Article  PubMed  Google Scholar 

  69. Lawton MP, Moss M, Kleban MH, Glicksman A, Rovine M (1991) A two-factor model of caregiving appraisal and psychological well-being. J Gerontol 46(4):P181-189

    Article  CAS  PubMed  Google Scholar 

  70. DeVellis R (2017) Scale development: theory and applications, 4th edn. Sage, Los angeles

    Google Scholar 

  71. Cohen J (1988) Statistical power analysis for the behavioral sciences, 2nd edn. Lawrence Erlbaum Associates, Hillsdale

    Google Scholar 

  72. Andresen EM (2000) Criteria for assessing the tools of disability outcomes research. Arch Phys Med Rehabil 81(12 Suppl 2):S15-20

    Article  CAS  PubMed  Google Scholar 

  73. Cramer D, Howitt DL (2004) The Sage disctionary of statistics. Sage, Thousand Oaks

    Book  Google Scholar 

  74. Taylor R (1990) Interpretation of the correlation coefficient: a basic review. J Diagn Med Sonogr 1:35–39

    Article  Google Scholar 

  75. Terwee CB, Bot SD, de Boer MR, van der Windt DA, Knol DL, Dekker J, Bouter LM, de Vet HC (2007) Quality criteria were proposed for measurement properties of health status questionnaires. J Clin Epidemiol 60(1):34–42

    Article  PubMed  Google Scholar 

  76. Brown SL, Nesse RM, Vinokur AD, Smith DM (2003) Providing social support may be more beneficial than receiving it: results from a prospective study of mortality. Psychol Sci 14(4):320–327

    Article  PubMed  Google Scholar 

  77. Haley WE, LaMonde LA, Han B, Burton AM, Schonwetter R (2003) Predictors of depression and life satisfaction among spousal caregivers in hospice: application of a stress process model. J Palliat Med 6(2):215–224

    Article  PubMed  Google Scholar 

  78. Palacio GC, Krikorian A, Gomez-Romero MJ, Limonero JT (2020) Resilience in caregivers: a systematic review. Am J Hosp Palliat Care 37(8):648–658

    Article  Google Scholar 

  79. Pringsheim T, Wiltshire K, Day L, Dykeman J, Steeves T, Jette N (2012) The incidence and prevalence of Huntington’s disease: a systematic review and meta-analysis. Mov Disord 27(9):1083–1091

    Article  PubMed  Google Scholar 

  80. Folstein SE (1989) Huntington’s disease: a disorder of families. Johns Hopkins University Press, Baltimore

    Google Scholar 

  81. Hayden MR, MacGregor JM, Beighton PH (1980) The prevalence of Huntington’s chorea in South Africa. S Afr Med J 58:193–196

    CAS  PubMed  Google Scholar 

  82. Narabayashi H (1973) Huntington’s chorea in Japan: review of the literature. Adv Neurol 1:253–259

    Google Scholar 

Download references

Acknowledgements

We thank the investigators, coordinators, and research associates/assistants who worked on this study, the study participants, and organizations who supported recruitment efforts. Site Investigators and Coordinators: ClinicalTrial.gov NCT04556591: Noelle Carlozzi, Sung Won Choi, Zhenke Wu, Srijan Sen, Jennifer Miner, Christopher Graves, Angela Lyden, Nikki Hubbard, Kaitlin Burgess, Christine Cislo, Caroline Clingan, Abigail Biddix, Jitao Wang, and Xinghui Yan. ClinicalTrial.gov NCT04570930: Noelle Carlozzi, Sung Won Choi, Zhenke Wu, Srijan Sen, Christopher Graves, Angela Lyden, Nikki Hubbard, Abigail Biddix, Aadi Nalla, Michelle Rozwadowski, Jennifer Miner (University of Michigan, Ann, Arbor, MI); Angelle Sander (Baylor College of Medicine and TIRR Memorial Hermann, Houston, TX), Jay Bogaards (TIRR Memorial Hermann, Houston, TX)

Funding

Work on this manuscript was supported by grant numbers R01NR013658 from the National Institutes of Health (NIH), National Institute of Nursing Research, R01HL146354 and K24HL156896 from the National Heart, Lung and Blood Institute, and UL1TR002240 from the National Center for Advancing Translational Sciences. This work was also supported by the University of Michigan Institute for Healthcare Policy and Innovation.

Author information

Authors and Affiliations

Authors

Contributions

NEC: Principal Investigator; data collection site; analysis design; initial draft of manuscript; incorporation of revisions. SWC: Study Co-Investigator; review and feedback on manuscript drafts (critical review of introduction and discussion and presentation of results). ZW: Study Co-Investigator and Statistician; review and feedback on manuscript drafts (critical review of presentation of analysis plan and results presentation). SS: Study Co-Investigator; review and feedback on manuscript drafts. JT: Study Data Analyst; conducted analyses; assistance writing analysis and results sections; review and feedback on manuscript drafts. AL: Study Data Manager; conducted preliminary analyses; review and feedback on manuscript drafts. JAM: Study Project Manager; critical review of the introduction, methods, and results; review and feedback on manuscript drafts. CG: Study Coordinator; responsible for data collection; review and feedback on manuscript drafts (critical review of methods). AS: Study Co-Investigator; review and feedback on manuscript drafts (critical review of introduction and discussion and presentation of results).

Corresponding author

Correspondence to Noelle E. Carlozzi.

Ethics declarations

Ethics approval and consent to participate

NCT04556591: All study procedures were conducted in accordance with the United States (US) Code of Federal Regulations (CFR) applicable to clinical studies (45 CFR Part 46, 21 CFR Part 50, 21 CFR Part 56, 21 CFR Part 312, and/or 21 CFR Part 812) and research best practices. Study procedures have been approved by IRBMED (Application Approval HUM00184455 and is registered with ClinicalTrials.gov (NCT04556591). NCT04570930: All study procedures are being conducted in accordance with the United States (US) Code of Federal Regulations (CFR) applicable to clinical studies (45 CFR Part 46, 21 CFR Part 50, 21 CFR Part 56, 21 CFR Part 312, and/or 21 CFR Part 812) and research best practices. The protocol, informed consent document, and all participant materials have received approval from IRBMED (9/18/2020), which is serving as the institutional review board (IRB) of record for both data collection sites (IRBMED Multi-site Application Approval HUM00181282; IRBMED University of Michigan Site Application Approval HUM00186921; IRBMED Baylor College of Medicine Site Application Approval SITE0000087; Baylor College of Medicine/Memorial Hermann IRB number H-48478. This trial is also registered with ClinicalTrials.gov (NCT04570930). Informed consent was obtained from all participants prior to their participation in either of the trials that supported the analyses provided in this manuscript.

Competing interests

The authors declare no competing interests.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Carlozzi, N.E., Choi, S.W., Wu, Z. et al. The reliability and validity of the TBI-CareQOL system in four diverse caregiver groups. J Patient Rep Outcomes 7, 57 (2023). https://doi.org/10.1186/s41687-023-00602-x

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1186/s41687-023-00602-x

Keywords