The Severity of Chronic Cough Diary (SCCD): development and content validation of a novel patient-reported outcome instrument for evaluating the symptom experience of chronic cough

Abstract

Background

Refractory chronic cough (RCC), a cough lasting longer than 8 weeks with an unexplained underlying etiology and unresponsive to conventional treatment, can have substantial effects on patients’ quality of life. For assessment of the efficacy of antitussive medication in clinical trials in RCC, patient-reported outcome (PRO) instruments should be fit for purpose with appropriate content validity. Here we describe the qualitative testing of a newly developed PRO instrument: the Severity of Chronic Cough Diary (SCCD).

Methods

The SCCD was developed to assess patients’ symptom experience of cough in patients with RCC. A preliminary version was tested and refined based on an iterative process in a qualitative study. In total, three rounds of interviews were conducted with adult participants diagnosed with RCC in the USA (n = 19) and UK (n = 10). Rounds 1–3 consisted of hybrid concept elicitation (CE) interviews and cognitive interviews (CIs), with Round 3 also including interviews in a subset of participants (n = 5) about the usability of the SCCD as administered on an electronic handheld device.

Results

The CE interviews identified concepts important to patients’ experiences related to RCC that were broadly in line with the concepts in the preliminary version of the SCCD. Participants provided positive feedback on the draft SCCD across all CI rounds, reporting the instrument to be relevant and straightforward to complete, and containing a comprehensive set of concepts to evaluate their symptom experience of RCC. Participants demonstrated a good understanding of proposed item wording, response options, and the 24-hour recall period, and thought completion of the SCCD on the electronic device was easy. Following revisions based on results from each interview round, the SCCD at the end of this qualitative research study had 14 items assessing the concepts of: cough symptoms (five items), symptoms related to cough (four items), disruption to activities due to cough (three items), and disruption to sleep due to cough (two items).

Conclusions

The results of this study provide qualitative evidence supporting the content validity of the SCCD as a PRO instrument for evaluating outcomes of therapies for RCC in clinical trials.

Introduction

Refractory chronic cough (RCC)—defined here as a cough lasting longer than 8 weeks with an unexplained underlying etiology and which is unresponsive to conventional treatment [1]—is a significant cause of morbidity, affecting around 10% of adults globally [2]. In addition to physical effects, RCC can have a substantial impact on patients’ health-related quality of life (HRQoL) [3, 4]. Primary endpoints in RCC clinical trials typically evaluate change in the frequency of cough using objective monitoring devices [5,6,7]. Regulatory agencies such as the European Medicines Agency and the US Food and Drug Administration (FDA) emphasize the importance of patient perspectives in treatment evaluation [8,9,10,11]. As a prerequisite, fit-for-purpose patient-reported outcome (PRO) instruments have to be used to assess the frequency and severity of cough from the patient perspective for evaluating outcomes of novel targeted antitussive agents for RCC, such as purinergic P2X3 receptor antagonists [12]. For the development of these PRO instruments, qualitative research is an essential step to ensure the instrument captures and evaluates important aspects of patients’ experiences in clinical trials [8,9,10,11, 13].

PRO instruments, such as the Leicester Cough Questionnaire [14] and the Cough-Specific Quality of Life Questionnaire [15], have been used widely to assess patients’ experiences of cough and its impact on HRQoL for endpoints in RCC clinical trials [5,6,7, 16,17,18]. The Cough Severity Diary (CSD) was later developed to better quantify cough severity (frequency, intensity, and disruption related to cough) in order to evaluate the effects of new therapies [19]. The CSD has been used in clinical trials of gefapixant in RCC [6, 7]. However, as the CSD was not available for external commercial licensing, a new PRO instrument was required for investigating new therapeutic options for RCC, such as in clinical trials of the P2X3 antagonist eliapixant [20].

This article describes the development of a new PRO instrument, the Severity of Chronic Cough Diary (SCCD), that is designed to assess treatment efficacy in RCC clinical trials. We report the qualitative testing phase of SCCD development, with a brief overview of the preliminary development phases.

Methods

Overview of SCCD development

The SCCD was developed using an iterative process (Fig. 1). In line with FDA guidance on PRO development [8], a preliminary conceptual framework (Additional File 1: Supplemental Fig. S1) for measuring patient-reported frequency and severity of cough and related symptoms in a clinical trial setting was developed based on the results of a targeted literature review (Stage 1) and interviews with three clinical experts and one regulatory consultant (Stage 2) conducted in 2018. This preliminary conceptual framework guided the development of the first draft of the SCCD Version 0.1 (Stage 3). Stages 1–3 are briefly described in the Supplementary Information.

Fig. 1

Overview of the steps involved in the development of the SCCD

^aThis article focuses on Stage 4: assessing the content validity of the SCCD. The preceding Stages 1–3 of SCCD development are briefly described in the Supplementary Information

^bStage 2 clinical expert interviews were conducted with three clinicians who treat patients with RCC in order to understand the clinical practice experience of symptoms of RCC and to assess the concepts of interest identified in the literature review concepts. Relevant cough severity concepts were obtained and informed the development of the patient interview guide

^cClinical expert feedback from one of the three clinicians in Stage 2 was also obtained on the SCCD Version 0.1 and Version 0.3 to assess the clinical relevance of the concepts included in the SCCD before the patient interviews

CE concept elicitation, CI cognitive interview, RCC refractory chronic cough, SCCD Severity of Chronic Cough Diary

Revisions to the SCCD leading to Versions 0.2, 0.3, and 1.0 and the updated conceptual framework were based on participant feedback from the qualitative research study which is described here (Stage 4). Best practice methods were followed to ensure that robust evidence was collected to support the content validity of the SCCD [8, 21, 22].

Qualitative research study to assess the content validity of the SCCD

Study design

Stage 4 was a cross-sectional, non-interventional, qualitative interview study involving individual, in-person, and telephone interviews with adults with RCC in the USA and UK. This study was approved by a central institutional review board in the USA (Ethical & Independent Institutional Review Board [Study 19056-01]). Approval of this study was not required by the UK Health Research Authority because participants were not recruited via the National Health Service (NHS). All study participants provided written informed consent.

The three rounds of interviews were conducted with a planned total cohort of approximately 30 participants from the USA and UK (Fig. 1). Rounds 1 and 2 consisted of hybrid concept elicitation (CE) interviews and cognitive interviews (CIs) conducted via telephone and lasted approximately 90 min. For Round 3, half the participants took part in telephone interviews (60 min) and the other half took part in in-person interviews (75 min). The 60-min telephone interviews consisted of hybrid CE interviews and CIs. The 75-min in-person interviews utilized an electronic version of the SCCD and consisted of hybrid CE interviews and CIs (60 min) and usability testing (15 min). For all Round 3 interviews, the CE section could be shortened as concept saturation for cough severity and frequency concepts had already been achieved in Rounds 1 and 2.

Interviews were conducted by researchers experienced in qualitative interviewing techniques. The SCCD was completed by the study participants and all interviews followed a semi-structured interview guide and were audio recorded with participant permission. After each interview round, revisions to the SCCD were made based on participant feedback and input from the instrument development team (AH, AS, CH, HK, MdlOA). These revisions were documented in an item tracking matrix and were further tested in subsequent interview rounds. Additional feedback on SCCD Versions 0.1 and 0.3 was provided by one of the clinicians who previously took part in the Stage 2 interviews. The clinician had expertise in managing patients with RCC and evaluating the outcomes of interventions, and this feedback informed the clinical relevance of the concepts included in the first draft of the SCCD before the patient interviews were initiated. Also, a translatability assessment of the SCCD Version 0.2, including evaluation for neutrality or “universal” English so that the instrument would be appropriate for use across different English-speaking countries, was conducted by a translation expert. The SCCD Version 0.3 was adapted for administration on an electronic handheld device in a subset of participants. The combination of study participant and clinical expert feedback on the SCCD Version 0.3 led to the finalization of the SCCD Version 1.0.

Participant recruitment and eligibility

Participants were recruited to one of three rounds of interviews via convenience sampling that used a recruitment vendor’s proprietary database, social media, healthcare professional referrals (USA only), and patient associations. As this was a qualitative study, sample size determination was based on concept saturation with no formal calculation possible [11]; however, 85% of symptom concepts in qualitative research studies have been shown to emerge after 10 interviews [23].

Inclusion and exclusion criteria for the study were chosen to allow for a study population comparable to clinical trials in patients with RCC. Eligible participants were adults (aged ≥ 18 years) residing in the USA or UK with a self-reported diagnosis/history of chronic cough, defined as a cough lasting for ≥ 8 weeks that had persisted ≥ 1 year as refractory or idiopathic. Full inclusion and exclusion criteria can be found in the Supplementary Methods. Physician confirmation of RCC diagnosis was not an eligibility requirement in general. However, some USA study participants shared physician confirmation of diagnosis after screening.

Detailed description of the interview procedures

Concept elicitation

The objective of the CE part of the interviews was to investigate whether concepts in the SCCD Versions 0.1–0.3 were relevant and would comprehensively capture the experiences of patients with RCC. Participants were first asked open-ended questions about their experiences of RCC in terms of its symptoms and impacts. Participants were then asked to describe their cough on a typical day, a good day, and a bad day, and to provide a comprehensive description of their cough symptoms, symptoms related to cough, disruptions to daily life due to impacts of coughing, ability to control their cough, physical impacts of coughing, and their current experience of treatment and its effectiveness. The concepts and experiences spontaneously reported by patients were recorded. Participants were then probed by interviewers to determine whether concepts which had not been mentioned spontaneously by the participant (for example, physical discomfort due to cough was spontaneously mentioned by four [14%] participants across the interview rounds), but which were included in the preliminary conceptual framework, were relevant to their experience.

Cognitive interviewing

The primary objective of the CIs was to evaluate participants’ understanding of the item stems, recall period, and response options of the respective draft versions of the SCCD (Versions 0.1–0.3). In particular, participants were asked to complete the SCCD, to describe their initial impressions of the diary, and to provide feedback on each item stem and the response options. This was to ascertain the participants’ understanding and the relevance of each item to their experience of cough, and also to provide any suggestions for changes. The suitability and relevance of the 11-point numeric rating scale (NRS) and the five-point verbal rating scale (VRS) response options were also evaluated.

Usability testing

Once the suitability of the wording of the SCCD had been evaluated by participants in Round 1 and Round 2 interviews, usability testing was conducted in Round 3 with participants who were administered the SCCD loaded on an electronic handheld device (Bluebird Android handheld device; eResearch Technology, USA). Following a brief explanation of how the electronic diary was to be used during the study, participants were asked to complete the SCCD on the electronic handheld device and provide feedback on its usability.

Data analysis

Descriptive statistics of sociodemographic data and clinical characteristics were calculated using SAS 9.4 software. A codebook for both CE and CI qualitative data was developed for each round of interviews based on the interview discussion guide. After coding of the first transcript, the coding framework was revised as necessary, and the remaining transcripts were then coded accordingly using ATLAS.ti Version 8.0.

Content analysis of RCC symptoms and impacts reported during the CE part of the interviews was conducted using ATLAS.ti Version 8.0 to identify key concepts of interest. Concept saturation was determined using a deductive approach and documented using a saturation grid, iteratively evaluated over the three rounds of interviews. Concept saturation was evaluated by identifying the first instance a concept was mentioned within the chronologic order of data collection, and determined to be achieved if no new concepts were reported over two or more interviews.

For analyses of the CIs, the coding framework reported the participants’ feedback on the comprehension, relevance, and acceptability of items in the SCCD.

Results of the qualitative research study

Participant demographics

In total, 29 participants from the USA (n = 19) and UK (n = 10) were interviewed for the Stage 4 qualitative research study between May 14, 2019 and November 12, 2019. All interviews in Round 1 (n = 9) and Round 2 (n = 10) were conducted by telephone. In Round 3 (n = 10), five interviews using the paper-based version of the SCCD Version 0.3 were conducted by telephone and five interviews using the electronic version of the SCCD Version 0.3 were conducted in person. The self-reported sociodemographic characteristics of the participants are shown in Table 1.

Table 1 Self-reported demographics of participants

Participant clinical characteristics

Self-reported cough-related clinical characteristics of the participants are shown in Additional File 1: Supplemental Table S1. Participants were most commonly diagnosed with RCC at least 10 years before enrollment (n = 10; 34%) and most participants rated their cough as “moderate” (n = 13; 45%) or “severe” (n = 10; 34%).

Concept elicitation results

Concepts of interest reported during the concept elicitation part of the interviews

Concepts of interest related to patients’ symptom experience of RCC were spontaneously elicited during patient descriptions of typical days, good days, and bad days with RCC. The frequencies of the spontaneously described concepts mentioned during the three interview rounds and example participant quotes are shown in Table 2. Concept saturation for disruptions due to cough and cough symptoms/symptoms related to cough was achieved within Round 1 and Round 2 of CE interviews, respectively (Table 2).

Table 2 Concepts spontaneously reported by participants in the CE interviews and participant example quotes

Cough symptoms

Experiences related to the ability to control cough was the most common concept relating to cough symptoms. This concept was included in the preliminary version of the SCCD as an “ability to suppress cough,” but participants referred to this more as an “ability or inability to control” their cough. The vast majority of participants described their experience with cough in terms of frequency, ranging daily from “always,” “constantly,” “on and off,” “200 times,” and “a couple of times an hour” to “the whole day.” Accounts of the severity of cough were based on characteristics such as “bellowing,” “loudness,” and the “longevity” of cough and the “pain,” “choking feeling,” and “throwing up” associated with the constant coughing or cough episodes. Participants also provided clear descriptions of repeated coughing, most commonly referred to as “coughing fits” or “coughing spells.” Coughing fits were reported as lasting “20 to 30 seconds,” “10 to 15 mins,” or “20 mins,” or as happening “in bursts” or “all day,” and could be triggered by air temperature or quality. The urge to cough was described by participants as “something stuck in your throat,” a “tickle,” a “dryness,” an “irritation,” or a “lump” in the throat that would result in coughing if not remedied.

Symptoms related to cough

In total, eight participants experienced pain in their neck (n = 1), throat (n = 2), lungs (n = 1), chest (n = 1), stomach/belly/side (n = 3), muscles (n = 1), shoulder (n = 1), lower back (n = 2), and ribs (n = 1) as a result of coughing, as well as headaches (n = 2). Pain was associated with the level of intensity of cough occurring during “bad days” or a “coughing fit.” Additionally, some participants reported symptoms of physical discomfort related to coughing as “feeling drained,” having a sore throat, feeling “uncomfortable,” or having to sleep upright to avoid coughing or vomiting due to the coughing. Breathlessness due to cough was described as a “strangling” or “choking” feeling and as not being able to “catch your breath” or “not being able to breathe.”

In total, five participants described experiencing leaking urine (incontinence) due to cough. All five participants were women (22% of the women in the study), who reported that their weakened bladder muscles were the result of constant coughing. Although this concept was reported by a limited number of participants, incontinence was the most common symptom related to cough reported by all three clinical experts interviewed during Stage 2 of SCCD development. This was confirmed by the clinical expert during Stage 4 of SCCD development, and was therefore deemed important and clinically relevant to maintain in the conceptual framework.

Disruption to activities due to cough

Disruptions to daily activity due to cough were described by over half of the participants. This concept was included in the preliminary version of the SCCD as “usual activities,” but participants had variable interpretations of this wording. Participants distinguished between the disruptions to household activities and disruptions to strenuous activities; strenuous activities due to physical exertion from coughing included activities such as walking, exercise, and playing sports.

Emotional impacts due to cough

As emotional impacts were multidimensional and encompassed several psychological, emotional, and mood concepts, saturation was not reached at the symptom impact level (e.g., feeling sad, embarrassed, anxious, etc.) but only at the domain level. Given the context-specific nature of the emotional impacts, it was not possible to create an item that was clearly worded and still relevant to the majority of participants with RCC.

Disruption to sleep due to cough

Waking up from sleep due to coughing was reported by around three-quarters of participants, whereby a “sudden coughing fit” could “startle” them and wake them up. Disturbance of sleep due to coughing was described as having difficulty falling asleep and not being able to stay asleep, get back to sleep, or sleep soundly. Impacts on daytime performance resulting from sleeplessness from coughing the night before included: not going to work, being “not fully able to participate,” or having to “cut short” work due to difficulties with “focus” and feeling “uncoordinated” and “fatigued” the next day.

Support for recall period and response scale

Participants reported that their RCC could vary from day to day, supporting the 24-hour recall period for measuring symptom experiences of cough severity and the concept of a daily diary measurement. RCC on a “typical day” ranged from a predictable pattern of cough throughout the day to a changeable pattern of cough depending on the time of day. Participants described a “good day” and a “bad day” of cough in terms of the frequency of cough symptoms and their perception of severity.

Participants’ feedback on cough symptoms such as cough severity, pain, and discomfort supported the use of a severity scale, while cough frequency, urge to cough, and difficulty controlling cough appeared to be better measured with a frequency scale.

Cognitive interview results

Concept coverage and revisions

Across all interview rounds, participants provided positive feedback on the SCCD in general and found the instrument to be relevant, with a comprehensive set of concepts to evaluate the symptom experience of RCC. Further information can be found in Additional File 1: Supplemental Table S2.

After Round 1, the number of items in the SCCD was increased from 11 in Version 0.1 to 15 in Version 0.2; items on urinary incontinence, ability to do strenuous physical activities, impact on social interactions, and difficulty staying awake the next day due to coughing the night before were added for testing in Round 2 (SCCD Version 0.2). After Round 2, an item on breathlessness was added to the SCCD Version 0.3 (16 items) for evaluation in Round 3. After Round 3, two sleep items—frequency of waking from sleep and the impact of sleep disturbance on the ability to stay awake the next day—were removed, leaving 14 items in the final SCCD Version 1.0. The revised conceptual framework of the SCCD is shown in Fig. 2.

Fig. 2

Revised conceptual framework of the SCCD Version 1.0 following qualitative research

^aImportant for women only

RCC refractory chronic cough, SCCD Severity of Chronic Cough Diary

Understanding and interpretation of the SCCD instructions, recall period, and response options

Instructions and recall period

Throughout all three interview rounds, all participants (n = 29; 100%) found the instructions clear and easy to understand. The 24-hour recall period was clearly understood, with participants generally thinking back to the same time yesterday. Further information can be found in Additional File 1: Supplemental Table S2.

Response options

The 11-point NRS of the SCCD Version 0.1 was changed to a five-point VRS after Round 1 based on participant feedback. Both NRS and VRS options were tested for relevance in Round 2, with the VRS format generally being preferred over the NRS. After Round 2 a “no cough” option was added to items assessing the impact of cough in the previous 24 h (e.g., cough control, cough-related pain). Further information can be found in Additional File 1: Supplemental Table S2.

Understanding and interpretation of individual items

An overview of participants’ understanding of individual items and revisions to the SCCD based on CI feedback is shown in Table 3. Across the three rounds of CIs, participants demonstrated clear understanding of the item stems and interpreted them in a consistent manner. Participants’ symptom experience of RCC as measured by SCCD scores during each interview round is shown in Additional File 1: Supplemental Table S3.

Table 3 Participants’ understanding of individual items and revisions to the SCCD based on CI feedback

Electronic version of the SCCD usability study results

In Round 3, all five participants (female, n = 4; age range 31–62 years) who completed the SCCD on an electronic handheld device were asked about their user experience. None of these five participants had previously used an electronic PRO device, and one participant had not previously used a smartphone. All five participants (100%) thought the electronic handheld device was simple and easy to use and had no difficulty reading the text on the screen.

Discussion

In line with FDA guidance on PRO development [8], the SCCD was developed to evaluate patients’ symptom experiences of RCC, with the objective of assessing treatment efficacy in clinical trials. The de-novo development of the SCCD was necessary, as an alternative instrument was not available for external commercial licensing at the time of the current study. Overall, the concepts that emerged from the literature review and interview feedback from three clinical experts were found to be broadly relevant to the study cohort of 29 adults with RCC. Moreover, results from the qualitative research study, consisting of CE interviews, CIs, and usability testing of the electronic handheld device, as well as feedback from a clinical expert, supported the content validity of the SCCD among patients with RCC.

After Round 1 of CE interviews, the SCCD Version 0.1 was confirmed to evaluate concepts that are important to patients with RCC. Based on the additional symptoms related to cough (cough-induced incontinence) and its impacts (on strenuous physical activities, social interactions, and difficulty staying awake during the next day) that emerged from Round 1, items were developed and tested in subsequent rounds of interviews. One item (ability to “suppress” cough) was revised (ability to “control” cough) to better reflect participants’ experiences related to RCC. CIs to assess the SCCD suggested that the instrument was easy to complete and understand, with most participants not finding any aspect of the SCCD (i.e., instructions, item stems, response scale, and recall period) confusing. Those participants asked found the electronic assessment method of the SCCD easy to use.

The SCCD at the end of the qualitative research study (Version 1.0) included 14 items for evaluating key dimensions of participants’ experiences related to RCC: five items about cough symptoms, four items about symptoms related to cough, three items about the disruption to activities due to cough, and two items that capture the disruption to sleep due to cough. Although only five women out of 23 (22%) raised the issue of urinary incontinence during the study, incontinence was noted by clinicians participating in the development of the SCCD to be clinically relevant and therefore expected on an RCC questionnaire. However, based on participant feedback during this study it may be valuable to evaluate the inclusion of a “not applicable” response option, particularly for men, during further testing.

Compared with the more recently developed SCCD and CSD, older PROs such as the Leicester Cough Questionnaire and the Cough-Specific Quality of Life Questionnaire were developed before current best practice guidance [24] and were not designed to directly assess cough severity [14, 15, 19]. A benefit of the SCCD is that it includes items assessing symptom experience of cough, including cough severity, which were identified as important concepts of interest by qualitative research in the current study. Respective measures assessing these important concepts of interest might need to be added to alternative appropriate patient-focused measurement strategies. Compared with the 14 items and four domains of the SCCD Version 1.0, the CSD has seven items and three domains: three items assessing cough frequency, two items assessing cough intensity, and two items assessing the disruption due to cough [19]. The addition of concepts in the SCCD which patients felt were important to understand their experiences of RCC, such as cough-induced incontinence and impacts on sleep and social interactions, may be beneficial for capturing more information when evaluating the efficacy of interventions in clinical trials. The response options of the two diaries also differ, with the CSD using an 11-point NRS [19] compared with the VRS of the SCCD as a result of the qualitative research in this study.

The main strengths of the study are that the SCCD was developed using current best practice standards with robust and state-of-the-art methodology and reflects up-to-date understanding of RCC [21, 22, 24]. An additional strength of the study is that the patient population was broadly similar to patients recruited to recent clinical trials of antitussive therapies (e.g., enrollment of patients with RCC and exclusion of smokers and patients with significant lung disease or recent respiratory tract infections) [5,6,7, 20]. However, some participants reported low scores on the SCCD in the past 24 h. This could likely be explained by the reported day-to-day variability of cough and the nature of the interview participation; participants may have scheduled their interview on a day when they were not experiencing cough exacerbation, as noted by several participants who requested to reschedule their interview. Another limitation of the study is that the sample of participants did not represent individuals at lower education levels as in the current study most participants in the USA had at least some college education and most UK participants had a university degree. Additional testing in individuals with lower education levels is suggested. As physician confirmation of RCC diagnosis was not an eligibility requirement for this study, exit interviews with participants from phase 2 trials with clinically confirmed RCC should be considered for the future.

Psychometric analyses of the SCCD Version 1.0 are planned to provide evidence of construct validity, reliability, sensitivity to change, and interpretability of SCCD scores. The conceptual framework might be revised as the SCCD is tested in future research to make sure that the finalized versions of both the conceptual framework and the SCCD are accurately representing patients’ experiences of the frequency and severity of cough in the context of clinical trials.

Conclusions

The ability to assess the frequency and severity of RCC and its related symptoms together with the day-to-day disruptions that RCC imposes on patients’ lives is important for evaluating the efficacy of interventions for RCC in clinical trials. In this article, we described the development and refinement of a new PRO instrument—the SCCD—based on qualitative research with patients with RCC and continuous expert input. The results of the study provide evidence supporting the content validity of the SCCD for evaluating outcomes of therapies for RCC.