Skip to main content

Content validation of a self-report daily diary in patients with sickle cell disease

Abstract

Background

Sickle Cell Disease (SCD) is a genetic progressive vascular disease that impacts patients overall health and quality of life. Sickle-cell pain crises (SCPCs) are a hallmark clinical presentation of SCD and have been associated with increased morbidity and mortality. The Sickle Cell Pain Diary- Self Report (SCPD-S) was developed as a daily patient-reported outcome (PRO) measure primarily intended to capture the frequency and severity of SCD-related pain during and outside of a SCPC. The SCPD-S also examines the impact of the pain associated with an SCPC on other health-related quality of life concepts. The objective of this study was to investigate the content validity of the SCPD-S.

Methods

The content validation testing included 18 in-depth hybrid concept elicitation and cognitive debriefing interviews conducted with SCD patients in the US aged 12 years and older. Interviewers used a semi-structured interview guide and a think-aloud approach for the cognitive debriefing portion. All interviews were recorded, transcribed, coded and analyzed.

Results

Eighteen interviews across two rounds were conducted. Round 1 hybrid interviews (n = 12) resulted in the expansion of the SCPD-S from 13 to 19 items. Items on the impact of an SCPC on social and recreational activities, sleep, and emotional well-being were added. Five items were significantly revised, as were three response choice sets. Round 2 hybrid interviews (n = 6) confirmed the comprehensiveness of the revised diary, understandability of the wording, and appropriateness of the recall period and response sets. Saturation analyses specific to concept elicitation revealed that no additional interviews were needed.

Conclusions

This study provided evidence to support the content validity of the SCPD-S, a self-report daily diary. Data gathered during patient interviews indicated that the SCPD-S is a fit for purpose measure of SCD and SCPC-related pain frequency and severity and the impact of this pain on other health-related quality of life concepts including fatigue and emotional health. The numerous changes to the SCPD-S as a result of the study findings highlight the importance of the content validation process when developing a PRO measure.

Introduction

Sickle cell disease (SCD) is a genetic vascular disease that affects approximately 100,000 children and adults in the US. SCD imposes a significant burden on patients, impairing their ability to function, which can lead to an inability to maintain a consistent work or school schedule, keep social engagements, and participate fully in family life [1, 2]. In the United States, SCD primarily affects African-Americans: 1 out of every 365 African-Americans are born with SCD [3, 4]. Clinical features of SCD include pallor, jaundice, anemia, and recurrent episodes of severe pain, known as sickle cell pain crises (SCPCs; also referred to as vaso-occlusive crises (VOCs)) [5, 6].

SCPCs are characterized by acute, often debilitating pain that prevents normal functioning, and have been associated with an increased risk of morbidity and mortality. SCPCs can lead to life-threatening emergencies such as acute chest syndrome, and stroke [7,8,9,10]. In addition to the acute effects of SCPCs, the cumulative effects of vaso-occlusion, with or without pain, can lead to irreversible damage to bones, joints, and organs; in particular, damage to the spleen, liver, brain, lungs, and kidneys occurs over time. This damage compounds disease-related pain while increasing morbidity and mortality [1, 7, 10, 11]. SCPCs can be triggered by physiological, environmental, nutritional, and psychosocial issues and are the primary cause of healthcare utilization in patients with SCD [1, 5, 9, 12]. The duration of a SCPC is variable, and can range from several hours to more than a week [13].

As described in the US Food and Drug Administration’s Voice of the Patient Sickle Cell Disease report, patients rated pain as the most burdensome symptom they experience [5], underscoring the way in which SCPCs adversely affect their lives. Patients of all ages described a variety of ways in which SCPCs pain negatively impacted family, work/school, and emotional health, and also discussed how SCPC pain can worsen other problematic symptoms such as fatigue, insomnia, difficulty concentrating, and mobility [5, 14]. Given their far-reaching impacts, it is necessary to determine the best way to accurately assess the frequency, severity, and impact of SCPCs on patients’ lives.

Studies often rely on acute or emergency medical visits as a way to measure SCPC-related outcomes in the SCD population [15, 16]. These methods provide an understanding of healthcare resource utilization. But, they do not incorporate the breadth and depth of patients’ experience of the burden of SCD, and fail to adequately capture daily variations of pain and other health-related quality of life concepts. Evaluating healthcare resource utilization data alone underestimates the burden of SCD because patients who avoid seeking care outside the home are not represented [17, 18]. A previous study found that individuals with SCD experienced SCPCs on 13.5% of recorded days, but only sought out clinical care on 3.5% of days over a 6-month time period, emphasizing the potential shortcomings of measuring SCPCs through medical visits alone [18].

SCPCs can be assessed through patient self-report. However, identifying the optimal way in which to collect such patient-reported outcome (PRO) data can be challenging. A retrospective format, such as that used to assess chronic pain, asks patients to report on their pain over a one-week, 1 month, or longer recall period. Retrospective formats with longer recall periods, such as 7-day or longer, may be problematic for assessing sporadic events such as SCPCs because such longer recall periods can “wash out” the severity of pain and impacts when averaged over time. Using a shorter recall period, such as “in the past 24 hours,” may be more appropriate to measure sporadic events.

The Sickle Cell Pain Diary-Self Report (SCPD-S) was developed as a self-reported PRO measure that addresses these gaps and accurately captures SCD-related concepts on a daily basis. The SCPD-S was designed to be completed by patients with SCD aged 12 and older and is intended to be administered electronically. The purpose of this study was to evaluate the content validity of the SCPD-S using two rounds of qualitative hybrid concept elicitation (CE) and cognitive debriefing (CD) individual interview methods.

Methods

Origin of the SCPD-S

A draft version of the SCPD-S (v.01) was developed using a multifaceted approach including a review of the literature, PRO expert input, feedback collected during a day-long patient advisory board meeting that also included clinicians, and individual discussions with clinicians. The SCPD-S v.01 included 13 items related to daily pain severity and duration, fatigue, medication use, and the impact of SCD on work/ school, daily activities, and sleep.

Patient inclusion criteria, recruitment, and consent

Patients eligible to participate in the study were at least 12 years of age, had a self-reported diagnosis of SCD, experienced at least one SCPC in the 12 months prior to screening, and were willing and able to participate in a 90 min interview in English either in-person or via telephone. Patients were recruited by a company that specializes in recruitment for healthcare research using their proprietary patient database. Sampling procedures were designed to enroll patients diverse in demographic characteristics such as age and education level. Interested patients were directed to a brief online screening survey to provide initial confirmation of their eligibility. Telephone confirmation of eligibility was conducted prior to scheduling an interview. Patients provided written informed consent once enrolled. All study materials were approved by the New England Independent Review Board.

Design and procedure

An overview of the methods used for each type of interview is presented in Fig. 1 and the revision history of the SCPD-S is presented in Fig. 2. Interviews were conducted in two rounds in multiple US locations and via telephone. All interviews were completed by researchers with extensive experience and training in conducting qualitative interviews.

Fig. 1
figure 1

Description of Study Methodology, Divided by Interview Round. Abbreviations: SCD = sickle cell disease; SCPD-S = Sickle-Cell Pain Diary- Self Report; CE = concept elicitation; CD = cognitive debriefing

Fig. 2
figure 2

Revision History of the Sickle-Cell Pain Diary- Self Report (SCPD-S)

In round 1, hybrid interviews were conducted that included both concept elicitation and cognitive debriefing methods. In the concept elicitation segment of the interview, patients were asked about their daily experiences with SCD symptoms and the impact of those symptoms on aspects of their lives such as work, school, relationships, and social and recreational activities. They were then asked to discuss symptoms experienced during a SCPC, what a typical day looks like both during and outside of a crisis, and what treatment methods they seek when experiencing a crisis. This segment of the interview served to understand which concepts were important to include in the SCPD-S.

A cognitive debriefing approach was used in the second segment of the interview, during which each element of the diary (instructions, recall period, items, response sets, and skip patterns) was tested to evaluate the relevance and comprehensibility of the SCPD-S. The cognitive debriefing portion used a ‘think-aloud’ process: patients were asked to complete the SCPD-S while verbalizing their thoughts about how they answered each question [19]. Patients were then asked to describe any aspects of the diary that they found challenging or confusing. Next, the interviewer probed areas that appeared to be confusing based on patients’ facial expressions, pauses, or comments. Finally, patients were asked a set of structured queries to ensure that all elements of the daily diary were addressed.

The SCPD-S v.01 was revised based on patient feedback from round 1 interviews, resulting in v.02. Round 2 interviews used the same methodology as round 1 (hybrid concept elicitation and cognitive debriefing), with different patients. The SCPD-S v.02 was subsequently revised based on patient feedback from round 2 interviews, resulting in SCPD-S v1.0.

Data analysis

After transcription of audio-recordings, data were coded and analyzed using identical methodology for both rounds of interviews. Concept elicitation data were coded using NVivo software and analyzed using a content thematic analysis method [20]. This strategy is in accordance with the principles of grounded theory, an inductive methodology whereby concepts emerge from patients rather than researchers imposing an a priori hypothesis [21].

An analysis of saturation was also conducted on data from the concept elicitation portion of the interviews. Saturation is the point at which no new relevant information emerges, and provides evidence that enough interviews were completed to fully understand concepts important to patients. This strategy allows researchers to determine if new concepts are elicited as data analysis progresses, and can provide assurance that enough interviews have been conducted to fully capture the range of patient experiences [21,22,23]. Data were separated into groups of three interviews and an iterative approach was used for the evaluation of saturation, whereby initial interviews were analyzed and compared with subsequent interviews.

For the cognitive debriefing segment of the interviews, narrative data were coded using a series of ratings to systematically summarize feedback. Transcripts were reviewed and coded for content related to each element of the daily diary to determine whether patients found each element to be relevant and understandable. Coding was completed using NVivo software.

Results

Eighteen total interviews were conducted in two rounds. Results from the concept elicitation portions of all interviews (rounds 1 and 2 combined) are presented first. These results are separated to discuss concepts related to SCD in general first, and then present concepts related to SCPCs.

Results from the cognitive debriefing portions of interviews are separated into findings from each round of testing because patients responded to different versions of the diary in each round.

Patient characteristics

Twelve round 1 interviews were completed in-person in two US locations (n = 9, 75%) and via telephone (n = 3, 25%).Footnote 1 Round 2 interviews were conducted in-person in one location (n = 4, 67%) and via telephone (n = 2, 33%). Patients ranged from 12 to 50 years old (M = 29 years), and 72% (n = 13) of all patients were male. One patient in round 1 (8%) self-reported being of Hispanic descent, and all others across both rounds (n = 17 patients (92%) were of African American descent. Almost half of the patients had a ‘less than high school’ education level (n = 8, 44%); however, all 8 of these participants were 18 years or younger, indicating that they were still attending high school at the time of the interview. Five participants (28%) reported that they seek out clinical care every time or almost every time they experience an SCPC (Table 1).

Table 1 Patient characteristics

Concept elicitation: sickle cell disease

Symptoms and impacts related to SCD

The two most frequently reported symptoms were pain (n = 14, 78%) and fatigue (n = 11, 61%). Other commonly reported symptoms included: joint problems/stiffness (n = 6, 33%), shortness of breath (n = 4, 22%), and stress, headaches/migraines, and jaundice (all n = 3, 17%).

Patients talked about how their daily lives were affected by SCD, with most (n = 14, 78%) describing considerable impacts from daily SCD symptoms. Some impacts were the result of limitations imposed by symptoms, while others were the result of self-imposed limitations due to fear of triggering a pain crisis. Six areas of impact were described during interviews: social /recreational activities (n = 15, 83%), activities of daily living (such as dressing or grooming; n = 12, 67%), physical functioning (n = 12, 67%), work/school (n = 12, 67%), emotional health (n = 11, 61%), and relationships (n = 8, 44%). Table 2 provides quotes from patients related to daily impacts.

Table 2 Example Patient Quotes: Daily Impacts of Sickle Cell Disease (SCD)

Impacts on social and recreational activities related to SCD

Impacts on social and recreational activities were reported by 15 patients (83%). Patients described avoiding or making accommodations for activities due to symptoms or fear of triggering a pain crisis. In particular, seasonal conditions such as the weather or temperature fluctuations were reported as a major determinant of whether or not patients decided to leave their home for activities. Travel was also reportedly difficult due to concerns that the air pressure in airplanes could worsen symptoms and sitting for long periods of time could be painful.

Impacts on activities of daily living, physical functioning, work and school related to SCD

Many patients (n = 12; 67%) discussed impacts on activities of daily living, including getting dressed, going to the bathroom, running errands, and lifting heavy objects. Housework in particular required either assistance from others or modifications. Adolescent patients (aged 12–17) specifically noted limitations on physical functioning, as many were unable to participate in common school activities such as extracurricular sports.

Work and school activities were also significantly impacted by SCD. Half of all adult patients were not currently working due to SCD-related problems. Reasons given for leaving the workforce included stress, physical problems, and taking too much time out of work due to SCD. Adults who were currently working all reported work-related limitations and necessary modifications.

Adolescents noted an impact on school performance. In particular, two adolescent patients discussed getting behind on schoolwork due to difficulty concentrating and missed classes.

Impacts on emotional health and social relationships related to SCD

Patients reported that SCD took a toll on their emotional health and well-being (n = 12; 67%). Commonly reported emotional difficulties were sadness, anxiety, and stress. Emotional impacts were typically related to limitations they experienced due to SCD, uncertainty about the future, and helplessness in dealing with symptoms and impacts. Patients also reported impacts on their relationships. Some patients (n = 7, 39%) reported having one or more close friends or family members who “didn’t understand” the disease and either distanced themselves or shamed patients for needing accommodations.

Concept elicitation: sickle cell pain crises

Symptoms and impacts related to SCPCs

Patients described the pain sensation during an SCPC, using descriptors such as ‘sharp,’ ‘stabbing,’ ‘throbbing,’ ‘burning,’ ‘grinding,’ and ‘hammering.’ Patients’ experiences of pain crises varied both within and across individuals. Some reported that it was more typical to have frequent, intense, and long lasting SCPCs, and some reported that it was more typical to experience occasional, milder, and shorter crises. Patients reported experiencing a median of 5 SCPCs per year, with responses ranging from “1 - 4 per year” to as often as every 2 weeks. Across patients, the shortest SCPC lasted only a few hours and the longest crisis experienced lasted 8 weeks. Some individuals reported a tendency to experience longer crises and others reported having shorter crises, but all experienced variability in their own SCPC experiences. While some reported crises happening “out of nowhere,” others reported precursor symptoms that alerted them to the oncoming SCPC. Patients described multiple triggers believed to cause their SCPC.

SCPCs impacted many areas of life, including work and school (n = 16, 89%), emotional health (n = 15, 83%), sleep (n = 15, 83%), medication use (n = 14, 78%), physical functioning (n = 13, 72%), and activities of daily living (n = 13, 72%; Table 3).

Table 3 Example Patients Quotes: Sickle Cell Pain Crise is (SCPC)

Impacts of SCPCs on work and school, activities of daily living, and physical functioning

Most patients who were either currently employed or had been employed in the past reported having missed work due to an SCPC, and also having attended work during crises so they would not miss more days of work. Patients who attended work with an SCPC typically did not do so during the peak of pain, but still described attempting to “push through” the workday with accommodations such as modified duties, taking breaks, and consuming food/water. Most adolescent patients reported not attending school during a crisis – either staying home, or, if the crisis happened while attending classes, leaving early. Once an intense crisis was at a peak, the effects were described as debilitating across all patients. In these cases, patients typically reported confining themselves to a bed or couch all day and resting or, if the crisis lasted a particularly extended length of time, patients reported going to the hospital.

Impacts on emotional health, sleep, and medication use related to SCPCs

Patients reported experiencing effects on emotional health (n = 15, 83%), including stress, anxiety, and helplessness when experiencing an SCPC related to the pain and uncertainty about how long the crisis would last. Patients described difficulty sleeping during an SCPC due to the pain (n = 15, 83%). In some cases, pain medication was reported to improve sleep; other patients said that pain medication interfered with sleep. Most patients reported sometimes increasing the dose, frequency and types of medications they take when experiencing an SCPC (n = 14, 78%).

Concept elicitation: healthcare utilization during an SCPC

Only a small number of patients (n = 5, 28%) reported ultimately seeking care outside of the home for most pain crises. For these patients, seeking care was considered to be a last resort after the pain had reached a level (on a scale of 0–10) of “ten and higher.” Many patients reported distress related to making decisions about whether and when to go to the hospital. Patients reported using a variety of pain crisis prevention and minimization strategies to delay having to seek care outside the home for as long as possible. Strategies included: rest, hydration, breathing exercises, applying a heating pad, music, meditation, and increased medication use. Of the subset of patients who shared reasons for delaying seeking treatment outside the home, the most commonly reported reasons included: feeling stigmatized by doctors and other treatment professionals or not being believed about pain levels (n = 7, 39%) and long wait times in emergency rooms (n = 5, 28%; Table 4).

Table 4 Example Patient Quotes: Healthcare Utilization during SCPC

Concept elicitation: addition of new concepts

The findings from round 1 concept elicitation interviews resulted in the addition of six items, three of which were designed to assess an SCPC, and three of which were designed to assess impacts of SCD in the absence of an SCPC. One existing item related to SCPC impacts was split into two items to better reflect the experiences of patients. The revised version of the diary, which incorporated these additions, was named SCPD-S v.02. No new concepts emerged during round 2 concept elicitation interviews, and all of the added concepts were confirmed.

Multiple concepts emerged regarding patients’ experience of SCPCs that necessitated additions to the SCPD-S v0.1. First, because half of the patients in round 1 discussed emotional difficulties (n = 6, 50%), an item was added to assess the degree to which an SCPC resulted in such difficulties. Second, patients clearly reported that they experienced impacts on activities of daily living and social/recreational activities, and that these impacts are distinct from one another. As a result, one item of the SCPD-S v.01 that asked about general activities was split into two items (one on activities of daily living and one on social and recreational activities) to provide better and more precise coverage of these concepts. Third, two items were added because patients indicated the importance of the duration of SCPCs and healthcare utilization as a result of SCPCs.

Fourth, although the SCPD-S was developed specifically to assess the frequency, duration, and impacts of SCPCs, results of round 1 concept elicitation interviews provided evidence to suggest that additional items should be added to assess patients who experience SCD-related pain that is not due to an SCPC. Because patients discussed experiencing fatigue, difficulty sleeping, and emotional difficulties on a daily basis, even when not experiencing an SCPC, three additional items were added to the SCPD-S to assess these impacts in patients who had not experienced an SCPC in the past 24 h (Table 5).

Table 5 Samples of items added to the SCPD-S v.01

Concept elicitation: saturation

Saturation analyses revealed that minimal new concepts were added through later code sets, an indication that saturation was reached (Table 6). Specifically, in round one, 44 concepts were identified and labeled for coding; rounds 2 and 3 added 8 new codes each and rounds 4–6 each had between 0 and 2 new codes.

Table 6 Saturation Grid

Cognitive debriefing

Round 1 (n = 12)

Round 1 of interviews tested the SCPD-S v.01 which consisted of 13 total items with 12 participants. Overall, the SPCD-S was generally found to be easy to understand and complete. Also, patients were relieved to hear the finalized SCPD-S would be completed electronically (on a tablet, or smartphone) and they would not have to read and follow the skip pattern. Instructions were revised after round 1 to increase clarity. The recall period was endorsed as appropriate by most (n = 11, 92%) patients in round 1.

Eight of the items were found to be easy to understand and relevant to patient experiences with SCPCs. Modifications were made to 5 items, and one item was removed. The removed item, ‘Did you have pain today?’ was well understood by some patients (n = 7, 58%), but others found it difficult to distinguish sickle cell pain that was not crisis related from crisis-related pain. In general, the modifications made were minor wording improvements for clarity. However, misunderstandings on one item related to the duration of the pain crisis within the past 24 h required more significant modification.

Response options were rated as clear and easy to understand by patients in 11 of the 13 items. Response choice sets from 3 items were changed as well (see Table 7 for examples of changes made between v.01 and v.02 of the SCPD-S).

Table 7 Samples of items and response choices modified in the SCPD-S v.01

Summary of changes made to the diary before round 2

In summary, based on the concept elicitation and cognitive debriefing results from round 1, the following changes were made (see Table 7 for examples):

• 3 items were added to assess impacts in patients who had not experienced an SCPC in the past 24 h

• 3 items were added to address new concepts

• One question was split into two questions

• Additional response choices were added to one response set based on cognitive debriefing from round 1

• 5 items were modified to improve wording

• 1 item was removed

• The total # of questions was increased from 13 to 19

Round 2 (n = 6)

After revision based on results from round 1, the SCPD-S v.02 consisted of 19 items and was tested in round 2. Overall, patients found the SCPD-S easy to understand and complete. Instructions were confirmed as comprehensible. All patients (n = 6, 100%) agreed that the recall period was appropriate. Patients found the wording of items to be clear and well-written. One item was changed to include the addition of ‘specialist’ to a list of providers a patient might visit with during an emergency. Otherwise, no changes were made to items. Items were endorsed as relevant and patients confirmed the good fit of the response options. Patients endorsed the comprehensiveness of the diary and no additional items were added.

In sum, cognitive debriefing of round 2 interviews further confirmed the relevance of the concepts measured in the SCPD-S, and the comprehensibility of the instructions, recall period, items, response sets, and skip patterns for patients with SCD.

After edits from round 2 and additional minor changes as a result of proofreading and to improve adaptability to an electronic format, the SCPD-S version number was changed to 1.0, as a developed version that has evidence of content validity for clinical and research use with patients who have SCD and experience SCPCs. Contents of SCPD-S v1.0 are summarized in Table 8. This version will be used in future studies and evaluated for psychometric reliability and validity.

Table 8 Summary of contents of the SCPD-S

Discussion

Patients in this study described the immense impact SCD and SCPCs have on their health-related quality of life. SCD significantly impacted activities of daily living, work and school, and emotional health. SCPCs greatly affected sleep, medication use, and physical functioning. With this data as the backbone of important aspects for a PRO measure for patients with SCD to be used in clinical trials, other research studies, and as part of clinical practice, we significantly expanded the SCPD-S after the first round of interviews.

The SCPD-S underwent cognitive debriefing testing in two rounds of patient interviews, and the diary was revised after each round, so that the version reviewed in the second round incorporated feedback from the first round of interviews. Patients confirmed that the concepts in the SCPD-S are relevant to people who have SCD and experience SCPCs. The revised SCPD-S v.02 that was tested in the second round was well-understood by patients. Generally, the SCPD-S was regarded as appropriate, comprehensive, and true to patient experiences. The changes to the SCPD-S as a result of patient feedback highlight the importance of the content validation process when developing a PRO measure and of re-testing a PRO after modifications have been made [24]. Had the study ended after the first round of interviews, the opportunity to evaluate how changes made after the first round of interviews impacted content validity would have been missed. The use of an iterative approach follows best practice guidelines of contemporary validity testing theory standards, which impresses that validity goes beyond a single content validation study or examination of psychometric properties, and instead requires the ongoing accumulation and evaluation of sources of evidence, taking into account the purpose of the PRO measure and eventual interpretive framework [23, 24].

The SCPD-S was developed to fill three primary gaps in the ability to measure the patient experience and impact of SCPCs on patients’ health-related quality of life: (1) that research studies and clinical practice tend to rely heavily on capturing data on SCPCs requiring healthcare utilization (e.g. emergency room or hospital admissions), which does not fully capture burden of illness and misses SCPCs that are treated at home; (2) that SCPCs are of variable duration and may be associated with health-related quality of life impacts pre- and post- the acute phase requiring more granular data capture; and (3) no other daily diaries had been developed with a clear focus on the health-related quality of life of a patient before, during, after and between SCPC events. Existing PRO measures used longer recall periods (such as past week or past month) that required patients to consider their average experience during an SCPC, despite there being tremendous variation within individual (across separate pain crises) and across individual SCPCs. Further, the existing measures were not focused on measuring what would happen if the frequency of SCPCs changed. Developing the SCPD-S with a past 24 h recall period provides a significant improvement in the ability to measure the depth and breadth of patient experience including capturing at home SCPC care; critical for better understanding potential need for change in clinical care, and for research studies. Patients may also find it useful to use the SCPD-S on their smartphone, tablet, or computer to improve communications with their treatment providers about their experiences.

Study limitations include only using one mode of administration (paper). In addition, our sample was 72% male yet approximately 50% of SCD patients are female [25], and while our sample included individuals as young as age 12, the oldest patient was 50. In addition, our sample included primarily African-American participants (94%). While SCD is found primarily among African-Americans in the US, it does occur in other populations. Thus, future studies should aim to include a greater percentage of female patients, patients older than age 50, include some patients who are not African-American, and include usability testing of the programmed survey.

Planned future work on the SCPD-S includes development of interpretation guidelines for the SCPD-S, including a scoring algorithm and user’s manual. In addition, a research study is underway to examine tests of psychometric reliability and validity of the SCPD-S. Use of the SCPD-S is planned for use in future clinical trials enrolling patients who experience SCPCs as a way to capture the frequency, duration, severity, and health-related quality of life impacts of SCPCs whether the SCPC was treated at home or in an HCP office, SCD clinic, or an emergency room or hospital. Collecting more precise data on a daily basis may help to better define and measure clinically meaningful improvement as a result of treatment in an SCD population. The findings of this study provide evidence of content validity of the SCPD-S.

Conclusions

This study provided evidence to support the content validity of the SCPD-S, a self-report daily diary. Evidence gathered during two rounds of hybrid, individual, qualitative patient interviews indicated that the SCPD-S is a fit for purpose measure of SCPC-related pain frequency, severity, and impact on health-related quality of life, including fatigue and emotional health. The numerous changes to the SCPD-S as a result of the study findings highlight the importance of the content validation process when developing a PRO measure.

Availability of data and materials

The data sets analyzed in the current study are available from the corresponding author on reasonable request.

Notes

  1. 19 interviews were conducted; 1 interview from round 1 excluded due to low patient comprehension.

References

  1. Fuggle, P., Shand, P. A., Gill, L. J., … Davies, S. C. (1996). Pain, quality of life, and coping in sickle cell disease. Arch Dis Child, 75(3), 199–203. https://doi.org/10.1136/adc.75.3.199.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  2. Badawy, S. M., Thompson, A. A., Lai, J., et al. (2017). Adherence to hydroxyurea, health-related quality of life domains, and patients' perceptions of sickle cell disease and hydroxyurea: A cross-sectional study in adolescents and young adults. Health Qual Life Outcomes, 15(1), 136. https://doi.org/10.1186/s12955-017-0713-x.

    Article  PubMed  PubMed Central  Google Scholar 

  3. Brousseau, D. C., Panepinto, J. A., Nimmer, M., … Hoffmann, R. G. (2010). The number of people with sickle-cell disease in the United States: National and state estimates. Am J Hematol, 85(1), 77–78. https://doi.org/10.1002/ajh.21570.

    Article  PubMed  Google Scholar 

  4. Nelson, S. C., & Hackman, H. W. (2013). Race matters: Perceptions of race and racism in a sickle cell center. Pediatr Blood Cancer, 60(3), 451–454. https://doi.org/10.1002/pbc.24361.

    Article  PubMed  Google Scholar 

  5. Center for Drug Evaluation and Research, Center for Biologics Evaluation and Research, U.S. Food and Drug Administration (2014). The voice of the patient_ Sickle cell report: A series of reports from the U.S. food and drug Administrations's (FDA's) Patient-focused drug development initiative.

    Google Scholar 

  6. U.S. Food and Drug Administration (2014) The FDA Encourages New Treatments for Sickle Cell Disease. https://www.fda.gov/ForConsumers/ConsumerUpdates/ucm418232.htm.

  7. Kanter, J., & Kruse-Jarres, R. (2013). Management of sickle cell disease from childhood through adulthood. Blood Rev, 27(6), 279–287. https://doi.org/10.1016/j.blre.2013.09.001.

    Article  PubMed  Google Scholar 

  8. Munube, D., Katabira, E., Ndeezi, G., … Tumwine, J. K. (2016). Prevalence of stroke in children admitted with sickle cell anaemia to Mulago hospital. BMC Neurol, 16(1), 175. https://doi.org/10.1186/s12883-016-0704-2.

    Article  PubMed  PubMed Central  Google Scholar 

  9. Ballas, S. K., Kesen, M. R., Goldberg, M. F., … Malik, P. (2012). Beyond the definitions of the phenotypic complications of sickle cell disease: An update on management. ScientificWorldJournal, 2012, 949535–949555. https://doi.org/10.1100/2012/949535.

    Article  PubMed  PubMed Central  Google Scholar 

  10. Maitra, P., Caughey, M., Robinson, L., … Ataga, K. I. (2017). Risk factors for mortality in adult patients with sickle cell disease: A meta-analysis of studies in North America and Europe. Haematologica, 102(4), 626–636. https://doi.org/10.3324/haematol.2016.153791.

    Article  PubMed  PubMed Central  Google Scholar 

  11. Bender MA (1993-2017) Gene Reviews: Sickle Cell Disease. https://www.ncbi.nlm.nih.gov/books/NBK1377/.

  12. Ataga, K. I., Kutlar, A., Kanter, J., … Rother, R. P. (2017). Crizanlizumab for the prevention of pain crises in sickle cell disease. N Engl J Med, 376(5), 429–439. https://doi.org/10.1056/NEJMoa1611770.

    Article  CAS  PubMed  Google Scholar 

  13. Taylor, L. E. V., Stotts, N. A., Humphreys, J., et al. (2010). A review of the literature on the multiple dimensions of chronic pain in adults with sickle cell disease. J Pain Symptom Manag, 40(3), 416–435. https://doi.org/10.1016/j.jpainsymman.2009.12.027.

    Article  Google Scholar 

  14. Jenerette, C. M., & Brewer, C. (2010). Health-related stigma in young adults with sickle cell disease. J Natl Med Assoc, 102(11), 1050–1055. https://doi.org/10.1016/S0027-9684(15)30732-X.

    Article  PubMed  Google Scholar 

  15. Michalik, D. E., Taylor, B. W., & Panepinto, J. A. (2017). Identification and validation of a sickle cell disease cohort within electronic health records. Acad Pediatr, 17(3), 283–287. https://doi.org/10.1016/j.acap.2016.12.005.

    Article  PubMed  Google Scholar 

  16. Brousseau, D. C., Owens, P. L., Mosso, A. L., et al. (2010). Acute care utilization and rehospitalizations for sickle cell disease. JAMA, 303(13), 1288–1294. https://doi.org/10.1001/jama.2010.378.

    Article  CAS  PubMed  Google Scholar 

  17. Carroll, C. P. (2016). Chronic and noncrisis pain in sickle cell disease. South med J 109(9): 516–518. Doi: https://doi.org/10.14423/SMJ.0000000000000507.

  18. Smith, W. R. (2008). Daily assessment of pain in adults with sickle cell disease. Ann Intern Med, 148(2), 94–101. https://doi.org/10.7326/0003-4819-148-2-200801150-00004.

    Article  PubMed  Google Scholar 

  19. Charters, E. (2003). The use of think-aloud methods in qualitative research: An introduction to think-aloud methods. Brock Education, 12(2).

  20. Assarroudi, A., Heshmati Nabavi, F., Armat, M. R., … Vaismoradi, M. (2018). Directed qualitative content analysis: The description and elaboration of its underpinning methods and data analysis process. J Res Nurs, 23(1), 42–55. https://doi.org/10.1177/1744987117741667.

    Article  Google Scholar 

  21. Corbin, J. M., & Strauss, A. (2015). Basics of qualitative research: Techniques and procedures for developing grounded theory. Thousand Oaks, CA: Fourth. SAGE Publications, Inc.

    Google Scholar 

  22. Charmaz, K. (2014). Constructing grounded theory. Thousand Oaks, CA: Second. SAGE Publications, Inc.

    Google Scholar 

  23. Patrick, D. L., Burke, L. B., Gwaltney, C. J., … Ring, L. (2011). Content validity--establishing and reporting the evidence in newly developed patient-reported outcomes (PRO) instruments for medical product evaluation: ISPOR PRO good research practices task force report: Part 2--assessing respondent understanding. Value Health, 14(8), 978–988. https://doi.org/10.1016/j.jval.2011.06.013.

    Article  PubMed  Google Scholar 

  24. Hawkins, M., Elsworth, G. R., & Osborne, R. H. (2018). Application of validity theory and methodology to patient-reported outcome measures (PROMs): Building an argument for validity. Qual Life Res, 27(7), 1695–1710. https://doi.org/10.1007/s11136-018-1815-6.

    Article  PubMed  PubMed Central  Google Scholar 

  25. Ilesanmi, O. O. (2013). Gender differences in sickle cell crises: Implications for genetic counselling and psychotherapy. J Psychol Psychother, 3(123), 2161–0487.1000123.

    Google Scholar 

Download references

Acknowledgments

Not applicable.

Funding

This study was funded by Novartis Pharmaceuticals Corporation.

Author information

Authors and Affiliations

Authors

Contributions

MKW, CS, MB, DD, and KR conceived this study and made substantive contributions to the study design, analysis, and interpretation. MKW, CS, AF, and KR conducted interviews and coded interview data. All authors contributed to interpretation of results. MKW, CS, AF, and DS drafted the first version of the manuscript and all authors reviewed that version and later drafts. All authors read and approved the final manuscript.

Corresponding author

Correspondence to Michelle K. White.

Ethics declarations

Ethics approval and consent to participate

The study protocol, interview guide, informed consent form, and recruitment flyers were approved by the New England Independent Review Board, now part of WCG: WIRB Copernicus Group (IRB #120170305). All subjects completed and submitted a signed IRB-approved informed consent form prior to participation.

Consent for publication

Not applicable.

Competing interests

MKW, CS, AF, DS, and KR are full-time employees of Optum and received research funding from Novartis Pharmaceuticals Corporation to conduct the study. MB and DD are full-time employees of the study sponsor, Novartis Pharmaceuticals Corporation.

Additional information

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

White, M.K., Saucier, C., Bailey, M. et al. Content validation of a self-report daily diary in patients with sickle cell disease. J Patient Rep Outcomes 5, 63 (2021). https://doi.org/10.1186/s41687-021-00337-7

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1186/s41687-021-00337-7