Skip to main content
Journal of Patient-Reported Outcomes
Download PDF
Download ePub

Psychometric validation of the Dysphagia Symptom Questionnaire in patients with eosinophilic esophagitis treated with budesonide oral suspension

Journal of Patient-Reported Outcomes volume 1, Article number: 3 (2017) Cite this article

Abstract

Background

Eosinophilic esophagitis (EoE) is characterized by high levels of eosinophils in the esophageal mucosa. Patients with the disease present with a range of symptoms, including dysphagia (difficulty swallowing). The aim of this analysis was to assess the psychometric properties of the Dysphagia Symptom Questionnaire (DSQ), a patient-reported outcome (PRO) measure of dysphagia associated with EoE. Psychometric properties of the DSQ were assessed using data collected from a 12-week, phase 2, multicenter, randomized, double-blind, placebo-controlled trial of budesonide oral suspension in adolescents and adults (11–40 years old) with EoE.

Results

The study population comprised 93 patients with EoE; 94.6% of whom were white, 68.8% were male and the mean age (standard deviation) was 21.6 (7.7) years. Patients had been diagnosed with EoE for a mean of 37.6 months before study initiation. The DSQ was feasible to implement with few item-level data missing at baseline. Item discrimination was high, with floor and ceiling effects below the predefined threshold (≤9%). Higher DSQ scores corresponded with presence and increased severity of dysphagia, indicative of strong item discrimination among patients at baseline (threshold >50%). The DSQ was able to detect changes in symptoms over time and produced similar outcomes to those from physician- and other patient-rated measures, supportive of construct validity. The DSQ had strong test–retest reliability (intraclass correlation coefficient, r = 0.82); and was also responsive to disease-level changes, with higher DSQ scores corresponding to increased esophageal eosinophilic burden. Lastly, the percentage changes in the minimal clinically important difference and clinically important difference in DSQ score were estimated at −27.4% and −55.4%, respectively.

Conclusions

These analyses support the DSQ as a valid and reliable measure of dysphagia in patients with EoE. Changes in DSQ scores suggest a level of agreement between clinician, patient and histologic response. The DSQ should therefore be considered a viable PRO measure of dysphagia for use in future therapeutic studies of EoE.

Background

Eosinophilic esophagitis (EoE) is a relatively newly described disease [1], and is defined as a chronic, allergen- and immune-mediated condition characterized by esophageal dysfunction with unusually high levels of eosinophilic infiltration of the esophageal mucosa (≥15 eosinophils/high-power field [eos/hpf]) [2]. Dysphagia (difficulty swallowing) and food impaction are the most common symptoms in adolescents and adults presenting with EoE [2]. In children, other symptoms, such as feeding intolerance, feeding refusal, heartburn and chest pain, are more common [2]. With increasing EoE disease duration and age, there is a concomitant and significant increase in dysphagia symptoms, esophageal strictures and risk of food impaction requiring interventional measures [3,4,5]. A recent meta-analysis of North American and European population-based studies of patients with EoE has estimated that the prevalence and incidence of this disease has been steadily increasing over time [6], with the healthcare-related cost of EoE estimated to be as high as $1.36 billion per annum in the USA (data collected from 1 January 2009 to 31 December 2010) [7].

The consensus recommendations for EoE advise that topical corticosteroid therapy be considered for children and adults after initial diagnosis and for the long-term maintenance of symptoms [8]; however, no therapies are currently approved by the US Food and Drug Administration (FDA) or the European Medicines Agency for this indication. Budesonide oral suspension (BOS), a novel muco-adherent, topical corticosteroid formulation designed specifically for the treatment of EoE, has been shown to induce a histologic response in children with this disease [9]. A recent phase 2 trial has also shown that treatment with BOS improves dysphagia, histologic and endoscopic features in adolescents and adults with EoE (ClinicalTrials.gov identifier: NCT01642212) [10, 11]. The ability to accurately quantify dysphagia symptoms in patients with EoE, using a validated patient-reported outcome (PRO) measure, would aid the development of new pharmacologic agents, such as BOS, for the treatment of EoE.

The aim of this analysis was to assess the psychometric properties of the Dysphagia Symptom Questionnaire (DSQ), a PRO symptom measure designed to specifically assess dysphagia frequency and severity in patients with EoE, using data from a phase 2 trial of BOS (ClinicalTrials.gov identifier: NCT01642212). The content validity of the DSQ is reported elsewhere [12].

Methods

Study design and study population

The psychometric properties of the DSQ were assessed using data collected from a 12-week, phase 2, multicenter, randomized, double-blind, placebo-controlled, parallel-arm trial of BOS; ClinicalTrials.gov identifier: NCT01642212 [10], which enrolled patients with EoE aged 11–40 years. The lower bound of this range was selected as the minimum age at which patients would be able to self-assess dysphagia and use the DSQ. The upper bound of this range was selected because older patients are more likely to develop fibrostenotic disease, which is typically refractory to anti-inflammatory treatment. Patients participated in a 6-week screening period, during which the DSQ was completed daily on an electronic hand-held device for at least 3 out of the 6 weeks. Patients with sufficient dysphagia (a minimum of 4 days with dysphagia and ≥70% compliance with the DSQ within any 2 of the first 3 weeks of screening) entered a 4-week, single-blind placebo run-in (baseline) period during which they received placebo twice daily and completed the DSQ once per day. The baseline period consisted of two visits: visit 1 (start of baseline period); and visit 2 (end of baseline period ±2 days). Patients who fulfilled the baseline eligibility criteria were randomized 1:1 to receive BOS (2.0 mg/10 mL) or placebo (10 mL) twice daily for 12 weeks, during which they were asked to complete the DSQ once per day. The inclusion criteria for the randomized phase included histologic evidence of EoE (≥15 eos/hpf) from at least two levels of the esophagus within 10 weeks of the baseline period; a minimum of 4 days with dysphagia within 2 weeks of randomization; acceptable diary compliance (≥70% of days within 2 weeks of randomization); and ≥70% compliance with placebo at randomization.

The Dysphagia Symptom Questionnaire

The DSQ was developed specifically to measure dysphagia associated with EoE [12]. The DSQ (version 4.0) uses a daily recall period and comprises three questions on the presence and severity of EoE dysphagia (questions 1–3) (Table 1). All patients respond to questions 1 and 2, and are required to have eaten solid foods (‘Yes’ to question 1) in order to proceed with the questionnaire. Patients who respond ‘No’ to question 2 are given a score of zero, and do not go on to answer question 3 (the diary is recorded as completed for that day). Those who respond ‘Yes’ to questions 1 and 2 move on to question 3, which is scored on a five-point scale that infers severity of dysphagia based on the patient’s action to alleviate symptoms, ranging from no action to seeking medical attention. Question 1 was not included in the scoring algorithm on the severity of dysphagia, as the incidence of solid food avoidance is thought to be low in patients with EoE [12]. In addition, if a patient answered ‘No’ to question 1, the remaining items on the DSQ were not scored. Although question 1 was not scored, the proportion of patients who reported avoiding solid foods is captured in the binary response to question 1 (response = ‘No’). A fourth question on pain related to dysphagia was included as a standalone item on the DSQ (Table 1). From interviews with adolescent and adult patients with EoE, pain was not highlighted as an important symptomatic factor and question 4 was thus considered an exploratory item and not included as part of the psychometric evaluation.

Table 1 The Dysphagia Symptom Questionnaire (version 4.0) and score for each response optiona
Full size table

The DSQ scoring algorithm (Table 1) was therefore constructed from the responses to questions 2 and 3, to ensure that the final score was driven by the frequency and severity of dysphagia. To calculate the DSQ score, a minimum of eight diary entries were required for each 14-day period. Baseline DSQ scores were recorded during the 14-day period before randomization. DSQ scores could theoretically range from 0 to 84, with a lower score indicating less frequent or less severe dysphagia. The DSQ score was calculated using the following equation:

$$ DSQ\ score=\frac{\left( sum\ of points from questions\ 2\ and\ 3\ from daily\ DSQ\ diary\right)\times 14\ days}{number of diary days reported with non- missing data} $$

Other physician- and patient-rated measures of disease activity

During the phase 2 trial, physicians were asked to complete the Physician Global Assessment (PGA) of disease activity (at the end of the baseline and treatment periods) using a visual analog scale (0–100 mm; ranging from no disease activity to worst possible disease activity) to provide a global assessment of EoE activity for each patient. Scores were categorized as follows: no disease to mild disease (0–30 mm); moderate disease (>30 to ≤70 mm); and worst possible disease (>70 to ≤100 mm). Patients were asked to complete the EoE Symptom Survey at the end of the baseline and treatment periods. The EoE Symptom Survey comprised a checklist of symptoms associated with EoE, and the options were phrased as follows: ‘heartburn (burning sensation in your chest)’; ‘chest pain (not heartburn or reflux related)’; ‘regurgitation (food coming back up into your mouth without vomiting/throwing up)’; ‘abdominal (stomach) pain’; ‘nausea (feeling sick to your stomach)’; and ‘vomiting (throwing up)’. Patients were asked to indicate, by ticking/checking, which symptoms they had experienced within the past 2 weeks. Patients were asked not to check symptoms that were unrelated to EoE. Patients were also asked to complete the Patient Global Impression of Change (PGIC) survey at the end of the treatment period, in which they were asked to rate the change in their dysphagia symptoms from baseline. Responses were: much better; better; a little better; no change; a little worse; worse; or much worse. EoE is a relatively newly described disease [1], and as such has not yet been formally assigned disease severity classifications. The above analyses are a first attempt to classify EoE disease severity using dysphagia symptoms.

Stage 1: Item analysis

This stage of the analysis was used to examine the quality of completion (patient compliance with the DSQ), item distribution (floor and ceiling effects) and item discrimination. The choice of constructs was limited by the data that were collected for this analysis. Quality of completion was monitored to measure patient compliance. Item-level and patient-level missing data are reported; instances of missing data exceeding 10% during each 14-day period during baseline and treatment intervals were investigated for item-wise quality of completion. Item-level missing data were treated as a random effect for each of the measures and an additional pattern analysis conducted, to identify patterns of missing data. Patient-level missing data were used to record the proportion of patients with at least one missing item over the course of the study. Floor and ceiling effects were considered to be acceptable if the upper limit of missing data for randomized patients, for either the lowest or highest possible score for question 3, did not exceed 9%. To evaluate individual item performance on the DSQ, an item discrimination index was calculated by categorizing patient responses during the last 14 days of the baseline period into the lower (25th percentile) and higher (75th percentile) ranges of dysphagia frequency and severity. Based on the 25th and 75th percentile distributions of the DSQ domain score, patients were assigned into three groups: patients who had high (>75th percentile), moderate (25th to 75th percentile) or low (<25th percentile) DSQ scores. Patients’ actions to alleviate dysphagia symptoms (question 3) were also categorized into three groups: no action taken (answer option 1), moderate action taken (answer options 2–4) and extreme action taken (answer option 5). The proportion of patients in each of these three categories who endorsed each item was also recorded. The threshold for acceptability for item discrimination was set at >50% [13].

Stage 2: Psychometric evaluation

This stage of the analysis was used to assess the construct validity, reliability and responsiveness of the DSQ. The subsequent results were used to provide recommendations for interpretability thresholds for minimal clinically important differences (MCIDs)/clinically important differences (CIDs).

Construct validity

Construct (concurrent) validity was assessed to determine if items within the DSQ conformed to previous knowledge of relationships between dysphagia severity and other clinical measures. Concurrent validity was measured by assessing the correlation between DSQ score and scores from the PGA of disease activity, a conceptually similar outcome measure. An additional analysis was performed to examine the relationship between DSQ score and esophageal peak eosinophil count (eos/hpf). Correlation coefficient thresholds were set at between 0.4 and 0.7, and below 0.4 for the PGA of disease activity and eosinophil count analysis [14], respectively. The hypothesis was that the correlation between DSQ score and PGA of disease activity response would be moderate (>0.4). In contrast, correlation between DSQ score and peak eosinophil count (histologic response) was expected to be low (<0.4), owing to the potential time delay between histologic response and symptom improvement. These analyses were conducted using data collected from the last 14 days of the baseline period. For the known-groups method, DSQ scores were compared with categorical responses from the PGA of disease activity and from the EoE Symptom Survey. The EoE Symptom Survey was included to assess change in the other, less common symptoms of EoE over the 12-week treatment period.

Test−retest reliability

The reliability of the DSQ was examined in patients who reported no change or minimal change in dysphagia symptoms on the PGIC survey. Patients were included if they completed the PGIC survey at the end of the treatment period (or earlier for patients who withdrew from the study) and recorded no change/minimal change in dysphagia symptoms. This analysis was performed using the intraclass correlation coefficient (ICC), calculated using Shrout–Fleiss reliability for a single score [14]. An ICC of 0.70 or above was considered acceptable [15].

Responsiveness (ability to detect change)

Absolute change in DSQ score from baseline (visit 2) to subsequent treatment visits was expressed in terms of standardized effect size (SES), which was calculated based on Cohen’s recommendations [16]; and was designated as small (SES = 0.20), moderate (SES = 0.50) or large (SES = 0.80) [17]. Patients were placed into three categories based on changes in their DSQ scores: improvement; no change; and decline. The data were analyzed using the χ 2 test to determine the significance of the relationship between each pair of change variables. Paired t-tests and one-way analysis of variance were used to evaluate differences between groups. The relationship between histologic response and patient-reported change was subsequently assessed. Patients were categorized as either responders (≤6 eos/hpf) or non-responders (>6 eos/hpf) based on their histologic response at the end of the treatment period.

Minimally important difference (meaningful change estimation)

Minimally important difference (MID) analyses were performed on the change in DSQ score from baseline (visit 2) to all available time points after baseline using distribution- and anchor-based methods. Distribution-based methods were used to estimate the MID based on the standard error of measurement. To calculate the standard error of measurement, the standard deviation (SD) of the DSQ score was multiplied by the square root of one minus its reliability coefficient (r):

$$ Standard\ err or of measurement= SD\times \sqrt{\Big(1}-r\Big) $$

Owing to the brevity of the scale, Cronbach’s alpha was not used for the reliability coefficient estimate. Rather, the Rasch person reliability, which is analogous to the Kuder–Richardson formula 20 [18], was used for each respective score.

Anchor-based methods were also used to determine the MCID and CID using absolute and percentage changes in mean DSQ score from baseline (visit 2). For this analysis, patients were grouped by PGIC score. The PGIC survey was selected to determine the anchor-based estimates for the MCID and CID because of the strong positive correlation observed between PGIC and DSQ scores (correlation coefficient >0.3) [19].

Statistical analysis

Psychometric analyses were performed in SAS (version 9.3) (SAS Institute Inc., Cary, NC) and Winsteps (version 3.75.0) (Winsteps, Inc., Beaverton, OR). All analyses were pre-specified with distribution-based data transformation.

For stage 1 analyses: the quality of completion was assessed at all available time points by day and week for the baseline and treatment periods; item distribution was examined at all available time points by day and week for the baseline and treatment periods; and item discrimination was assessed using data collected during the last 2 weeks of the baseline period. For stage 2 analyses: concurrent validity was assessed using data from the final 2 weeks of the baseline period; known-groups validity was assessed using data collected from the final 2 weeks of the baseline period and until the end of the treatment period; test–retest reliability examined patients who completed the PGIC survey at the end of the treatment period (or earlier for patients who withdrew from the study) and recorded no change/minimal change in dysphagia symptoms; responsiveness was examined using the difference in scores from the baseline period to all subsequent treatment visits; and both MID analyses were conducted using the change in DSQ scores from baseline (14-day average) to all available post-baseline time points.

Results

Study population

Of the 119 patients who entered the baseline period, 93 proceeded to the 12-week treatment period and were randomized to receive BOS (n = 51) or placebo (n = 42). Patients included in both the baseline and treatment periods were considered for this analysis. Patient characteristics at baseline are shown in Table 2; these were similar between treatment arms [10]. Patients aged 11–40 years were enrolled; however, exemptions were granted for three patients (<11 years, n = 2, were considered mature enough to self-assess dysphagia and use the DSQ; >40 years, n = 1, no evidence of fibrostenotic disease and met all other inclusion criteria).

Table 2 Demographic and baseline characteristics for all randomized patients who entered the 12-week treatment period
Full size table

Stage 1: Item analysis

Item-level missing data were low for the baseline period, with 15.1% (197/1302) of item responses missing; however, this increased to 33.6% (219/651) by week 12 of the treatment period. In contrast, patient-level missing data were high, with 76.3% (71/93) of patients missing at least one item of the questionnaire across all visits during the baseline period (Table 3). This was the same at the end of the study (during week 12: 76.3%).

Table 3 Stage 1: Item analysis of the DSQ (version 4.0) to assess quality of completion by patients, item score patterns, item distribution and item discrimination at baseline (visit 2) in patients with EoE. Floor and ceiling effects at the end of the 12-week treatment period are also reported
Full size table

Out of a possible 1302 responses, there were 1105 completed items and 197 missing items during the 14-day baseline period (visit 2). There were 804 instances where patients (n = 93) reported dysphagia (question 2: ‘Yes’), and 301 instances where patients reported no dysphagia (question 2: ‘No’). During this period, there were 238 instances where patients with dysphagia reported that it got better or cleared up on its own (question 2: ‘Yes’; question 3: response option 1); and 401 instances where patients with dysphagia reported that they had to drink liquid to get relief (question 2: ‘Yes’; question 3: response option 2). There were 133 and 31 instances where patients with dysphagia reported that they had to cough and/or gag or vomit, respectively in order to get relief (question 2: ‘Yes’; question 3: response option 3 or 4, respectively). Lastly, there was only one instance where a patient with dysphagia reported that they had sought medical attention to get relief (question 2: ‘Yes’; question 3: response option 5) (Table 3).

The DSQ measured the full range of dysphagia symptoms experienced by patients, with floor and ceiling effects below the pre-defined threshold (≤9%) at baseline (visit 2) (Table 3). However, by the end of the treatment period (week 12) the proportion of patients selecting the lowest DSQ scores had increased (54.8%); ceiling responses nonetheless remained below the threshold (8.3%). Overall, there was strong item discrimination among patients. Patients with more frequent dysphagia (question 2: ‘Yes’) (98.1%) during baseline (visit 2) reported within the highest (worst) range of DSQ scores (upper 25%) exceeding the >60% threshold for acceptability (Table 3). Similarly, patients who answered ‘Yes’ for question 2 were more likely to select the middle range of ‘symptom alleviation methods/moderate action’ (93.4%) for question 3, with only one patient selecting the highest category for this item (Table 3). Item characteristic curves at baseline (visit 2) showed a monotonically increasing function, with the steepness of the curve highlighting good item discrimination (data not shown).

Stage 2: Psychometric evaluation

Construct validity

A weak but significant positive correlation was seen between DSQ score and physician-rated scores (PGA of disease activity), as determined by Spearman’s correlation test (correlation coefficient = 0.2587). This is below the predefined acceptability threshold (0.4–0.7). The known-groups method was also used to assess the construct validity of the DSQ, by comparing groups of patients who were categorized based on their EoE Symptom Survey and PGA of disease activity data (Table 4). At baseline (visit 2), patients with heartburn, chest pain, regurgitation, nausea or vomiting had significantly higher (worse) mean DSQ scores than patients without these symptoms (all p < 0.05). Similarly, at baseline (visit 2), patients who scored lowest (‘none to mild disease’) on the PGA of disease activity also had the lowest mean DSQ scores (Table 4). Patients’ DSQ scores then increased stepwise with increasing disease activity (‘moderate disease’ and ‘worst possible disease’) (Table 4). Combined, these data support the known-groups validity of the DSQ. An additional, exploratory analysis of histologic response and patient-reported change in DSQ score suggests a weak association (correlation coefficient = 0.0337), which removes this variable from consideration as a meaningful anchor in this evaluation.

Table 4 Stage 2: Psychometric evaluation of the DSQ (version 4.0) to assess the construct validity, concurrent validity, reliability and responsiveness of the DSQ in patients with EoE at baseline (visit 2)
Full size table

Test−retest reliability

The test−retest reliability of the DSQ was measured to assess the stability of DSQ scores over time (when no change was expected), i.e. in those who reported no change or minimal changes on the PGIC survey from baseline (visit 2) to week 12 (or earlier). The ICC was 0.82, which met the threshold for acceptability (≥0.70), supporting the reliability of the DSQ (Table 4).

Responsiveness (ability to detect change)

Overall, there was a decrease in mean DSQ score from baseline (visit 2) to the end of the 12-week treatment period, and this correlated with histologic response (Table 4). Patients with a histologic response (≤6 eos/hpf) exhibited a greater improvement in DSQ scores from baseline (visit 2): mean change (±SD) [SES]: −16.2 (±14.3) [−1.09]; p < 0.0001 than those who did not have a histologic response (>6 eos/hpf): mean change: −9.9 (±11.6) [−0.67]; p < 0.0001 (Table 4).

Minimally important differences (meaningful change estimation)

Absolute and percentage distribution-based MIDs in DSQ score were estimated at 7.4 points and 8.9%, respectively (Table 5), and were driven by the overall distribution of DSQ scores at baseline (visit 2). Most (74.4% [67/90]) patients who reported an improvement using the PGIC survey (‘a little better’, ‘better’ and ‘much better’) also reported a concomitant improvement in dysphagia symptoms (lower DSQ scores) (Table 5). Using the anchor-based methods, the MCID and CID in DSQ score (mean absolute change) were estimated to be −6.5 points (‘a little better’) and −13.5 points (‘better’), respectively. The MCID and CID in DSQ score (mean percentage change) were estimated to be −27.4% (‘a little better’) and −55.4% (‘better’), respectively (Table 5).

Table 5 Estimates of meaningful change in DSQ score in patients with EoE at baseline and from baseline to week 12 of the treatment period
Full size table

Discussion

EoE is a chronic disease characterized by eosinophil-induced inflammation and symptoms of esophageal dysfunction, including dysphagia [1, 2]. EoE is a relatively newly described disease [1], and as such, has not yet been assigned disease severity classifications. There are currently no approved drugs indicated for EoE; however, treatment with a newly developed formulation of budesonide (BOS) has been shown to result in histologic improvements in pediatric patients [9] and histologic, endoscopic and symptom improvements in adolescents and adults with this disease [10, 20]. The primary objective of this analysis was to assess the psychometric properties of the DSQ, a PRO measure of dysphagia in patients with EoE, using data collected from a 12-week, phase 2, multicenter, randomized, double-blind, placebo-controlled trial of BOS in adolescents and adults with EoE [10].

Item characteristics showed that the DSQ measured the full range of dysphagia symptoms experienced by patients at baseline, with floor and ceiling effects below the predefined threshold, reflecting a high level of sensitivity. The proportion of patients with the lowest DSQ scores increased by week 12, indicative of an improvement in symptoms over time for all patients. Results from the DSQ were also consistent with data collected from a range of physician- and other patient-reported outcome measures (PGA of disease activity, EoE Symptom Survey and PGIC), providing evidence of good construct validity. The test–retest analysis highlighted that DSQ scores were consistent over time for patients who reported no change or minimal change in dysphagia symptoms. Similarly, patients who had a histologic response (≤6 eos/hpf) also reported a greater improvement in DSQ score (large SES; ≥0.80), compared with those who had a weaker histologic response (>6 eos/hpf; moderate SES; ≥0.50 to <0.80). These findings support the DSQ as a reliable measure of dysphagia in adolescents and adults with EoE.

A weak but positive association was observed between the change in DSQ score and peak eosinophil counts in the esophageal mucosa at the end of treatment. This was not unexpected; a number of previous studies of EoE have reported a lack of correlation between histologic findings and symptoms [9, 21, 22]. This may be explained by a potential time delay between histologic improvement and symptom improvement after treatment [12]. In addition, the magnitude of improvement in eosinophil density from baseline was not used for this analysis. Instead, the final absolute peak eosinophil count was described using the >6 eos/hpf and ≤6 eos/hpf cut-offs at the end of treatment. This may have also contributed to the weak association observed between change in DSQ score and peak eosinophil counts at the end of the study.

Using distribution-based methods, the absolute and percentage MID in DSQ score were estimated at 7.4 points and 8.9%, respectively. Using anchor-based methods, the MCID and CID in DSQ score (absolute change) were estimated to be −6.5 points and −13.5 points, respectively. The MCID and CID (percentage change) in DSQ score were estimated to be −27.4% and −55.4%, respectively. Percentage change in MCID and CID enable the comparison of data from different studies, in which baseline DSQ scores for the study populations may differ. These findings support the use of distribution- and anchor-based methods for the psychometric evaluation of the DSQ.

Despite the increasing prevalence of EoE worldwide [23], there have been very few randomized, controlled studies examining this disease [24,25,26,27]. The development of PRO measures for use in future studies of EoE would assist in the evaluation of new therapies. A number of other Clinical Outcome Assessments (COAs) are available or in development, including the Mayo Dysphagia Questionnaire-30 Day (MDQ-30) [28], the Pediatric EoE Symptom Score (PEESS) [22, 29], the Pediatric Quality of Life Inventory (PedsQL) [30] with the EoE-specific disease module (PedsQL EoE) [31], the Esophageal Symptom Questionnaire (ESQ) [32] and the Adult EoE Quality of Life questionnaire (EoE-QoL-A) [33]. However, the MDQ-30, to our knowledge, has not been validated among patients with EoE [12] and the other COAs specifically target either children or adults, respectively, and focus on a range of symptoms. The DSQ (version 4.0) therefore represents the first daily symptom diary to undergo structured psychometric validation specifically for EoE in both adolescents and adults with this disease.

The DSQ (version 4.0) has several strengths over other tools. First, the DSQ was designed and evaluated in accordance with current US FDA guidelines [12, 34], with the aim of developing a valid symptom measure for use in clinical trials. The DSQ also uses a daily recall period, allowing patients to remember and record their symptoms more clearly, rather than relying on longer recall periods. This short recall period was previously assessed and considered appropriate for this disease [12]. A short recall period is particularly useful for diseases in which symptoms can fluctuate [35]. Lastly, the DSQ is a disease-specific symptom measure developed to assess the most common symptom of EoE experienced by adult patients – dysphagia [5, 23], while other PRO measures attempt to consider a broader range of symptoms for EoE [9, 22]. Dysphagia was selected as the primary symptom measure based on a literature review, previous trials, existing symptom instruments, expert opinion and patient interviews, as part of the conceptual framework development (content validation) [12]. More recently, clinical features (e.g. peak eosinophil counts and eosinophil peroxidase levels) and gene expression profiles associated with EoE have been shown to correlate most strongly with dysphagia, as opposed to other symptoms, such as nausea/vomiting or pain [36].

With regard to limitations, levels of non-compliance with the DSQ (missing data) increased towards the end of the study (week 12); however, attempts were made to limit this by excluding patients who were highly non-compliant during the screening period. In addition, alerts were sent, in a blinded fashion, to center personnel at sites where consecutive non-compliance events were detected. Owing to the high level of patients missing at least one day during the data collection weeks, patient training should be enhanced in order to increase DSQ compliance rates for future studies. The handling of item-level missing data is a focus of statistical consideration in clinical trial analyses; in this study, item-level missing data were treated as a random effect for each of the measures and an additional pattern analysis was conducted, to account for this effect. The lack of reliable, objective clinical anchors for EoE was another limitation, which could have potentially introduced variation [37]; however, this analysis used recognized patient- and physician-rated measures of disease severity (PGIC and PGA, respectively) as anchors in this study. Lastly, in establishing patient selection and eligibility criteria for this randomized controlled trial, the randomized population may not represent the entire EoE population. Nevertheless, this group had similar demographic characteristics and the principle EoE symptom of dysphagia to those from a natural history study and are therefore representative of those real-life patients who may seek therapeutic treatment for their EoE symptoms [38].

Conclusions

The DSQ was able to reliably discriminate between levels of disease severity in patients with EoE, using dysphagia as the primary symptom measure. The DSQ also offered an acceptable level of agreement between clinician, patient and histologic responses. In summary, the DSQ has been shown to have good construct validity and to reliably measure frequency and severity of dysphagia. The DSQ should therefore be considered as a viable PRO measure for use in future therapeutic studies of EoE.

Abbreviations

BOS:

Budesonide oral suspension

CID:

Clinically important difference

COA:

Clinical Outcome Assessment

DSQ:

Dysphagia Symptom Questionnaire

EoE Symptom Survey:

Eosinophilic Esophagitis Symptom Survey

EoE-QoL-A:

Adult Eosinophilic Esophagitis Quality of Life questionnaire

ESQ:

Esophageal Symptom Questionnaire

FDA:

Food and Drug Administration

hpf:

High-power field

ICC:

Intra-class correlation coefficient

MCID:

Minimal clinically important difference

MDQ-30:

Mayo Dysphagia Questionnaire-30 Day

MID:

Minimally important difference

PedsQL:

Pediatric Quality of Life Inventory

PedsQL EoE:

Pediatric Quality of Life Inventory with the Eosinophilic Esophagitis-specific disease module

PEESS:

Pediatric Eosinophilic Esophagitis Symptom Score

PGA:

Physician Global Assessment

PGIC:

Patient Global Impression of Change

PRO:

Patient-reported outcome

SD:

Standard deviation

SES:

Standardized effect size

References

  1. Hirano, I. (2016). 2015 David Y. Graham Lecture: The first two decades of eosinophilic esophagitis – from acid reflux to food allergy. The American Journal of Gastroenterology, 111, 770–776.

  2. Furuta, G. T., Liacouras, C. A., Collins, M. H., Gupta, S. K., Justinich, C., Putnam, P. E., Bonis, P., Hassall, E., Straumann, A., & Rothenberg, M. E. (2007). Eosinophilic esophagitis in children and adults: A systematic review and consensus recommendations for diagnosis and treatment. Gastroenterology, 133, 1342–1363.

    CAS  Article  PubMed  Google Scholar 

  3. DeBrosse, C. W., Franciosi, J. P., King, E. C., Buckmeier Butz, B. K., Greenberg, A. B., Collins, M. H., Abonia, J. P., Assa'ad, A., Putnam, P. E., & Rothenberg, M. E. (2011). Long-term outcomes in pediatric-onset esophageal eosinophilia. The Journal of Allergy and Clinical Immunology, 128, 132–138.

    Article  PubMed  PubMed Central  Google Scholar 

  4. Schoepfer, A., Safroneeva, E., Bussmann, C., Kuchen, T., Portmann, S., Simon, H. U., & Straumann, A. (2013). Delay in diagnosis of eosinophilic esophagitis increases risk for stricture formation in a time-dependent manner. Gastroenterology, 145, 1230–1236.

    Article  PubMed  Google Scholar 

  5. Dellon, E. S., Jensen, E. T., Martin, C. F., Shaheen, N. J., & Kappelman, M. D. (2014). Prevalence of eosinophilic esophagitis in the United States. Clinical Gastroenterology and Hepatology, 12, 589–596.

    Article  PubMed  Google Scholar 

  6. Arias, A., Perez-Martinez, I., Tenias, J. M., & Lucendo, A. J. (2016). Systematic review with meta-analysis: The incidence and prevalence of eosinophilic oesophagitis in children and adults in population-based studies. Alimentary Pharmacology & Therapeutics, 43, 3–15.

    CAS  Article  Google Scholar 

  7. Jensen, E. T., Kappelman, M. D., Martin, C. F., & Dellon, E. S. (2015). Health-care utilization, costs, and the burden of disease related to eosinophilic esophagitis in the United States. The American Journal of Gastroenterology, 110, 626–632.

    Article  PubMed  Google Scholar 

  8. Liacouras, C. A., Furuta, G. T., Hirano, I., Atkins, D., Attwood, S. E., Bonis, P. A., Burks, A. W., Chehade, M., Collins, M. H., Dellon, E. S., et al. (2011). Eosinophilic esophagitis: Updated consensus recommendations for children and adults. The Journal of Allergy and Clinical Immunology, 128, 3–20 e26.

    Article  PubMed  Google Scholar 

  9. Gupta, S. K., Vitanza, J. M., & Collins, M. H. (2015). Efficacy and safety of oral budesonide suspension in pediatric patients with eosinophilic esophagitis. Clinical Gastroenterology and Hepatology, 13, 66–76 e63.

    CAS  Article  PubMed  Google Scholar 

  10. Dellon, E. S., Katzka, D. A., Collins, M. H., Hamdani, M., Gupta, S. K., & Hirano, I. (2017). Budesonide oral suspension improves symptomatic, endoscopic, and histologic parameters compared with placebo in patients with eosinophilic esophagitis. Gastroenterology, 152, 776–786.

  11. Dellon, E. S., Katzka, D. A., Collins, M. H., Hamdani, M., Gupta, S. K., & Hirano, I. (2016). Safety and efficacy of oral budesonide suspension for maintenance therapy in eosinophilic esophagitis: Results from a prospective open-label study of adolescents and adults. Gastroenterology, 150 (Supplement 1), S188.

  12. Dellon, E. S., Irani, A. M., Hill, M. R., & Hirano, I. (2013). Development and field testing of a novel patient-reported outcome measure of dysphagia in patients with eosinophilic esophagitis. Alimentary Pharmacology & Therapeutics, 38, 634–642.

    CAS  Article  Google Scholar 

  13. Cappelleri, J. C., Zou, K. H., Bushmakin, A. G., Alvir, J. M. J., Alemayehu, D., & Symonds, T. (2013). Patient-reported outcomes: Measurement, implementation and interpretation. Chapman and Hall/CRC.

  14. Bonett, D. G., & Wright, T. A. (2000). Sample size requirements for Pearson, Kendall, and Spearman correlations. Psychometrika, 65, 23–28.

  15. Nunnally, J. C., & Bernstein, I. H. (1994). Psychometric theory (pp. 248–292). New York: McGraw-Hill Inc.

    Google Scholar 

  16. Cohen, J. (1977). Statistical power analysis for the behavioural sciences. New York: Academic Press.

    Google Scholar 

  17. Hedges, L., & Olkin, I. (1985). Statistical methods for meta-analysis. Waltham, Massachusetts: Academic Press.

    Google Scholar 

  18. Kudar, G. F., & Richardson, M. W. (1937). The theory of the estimation of test reliability. Psychometrika, 2, 151–160.

    Article  Google Scholar 

  19. Revicki, D. A., Erickson, P. A., Sloan, J. A., Dueck, A., Guess, H., & Santanello, N. C. (2007). Interpreting and reporting results based on patient-reported outcomes. Value Health, 10 (Supplement 2), S116–S124.

  20. Hirano, I., Katzka, D. A., Collins, M. H., & Dellon, E. S. (2015). Randomized, double-blind, placebo controlled trial demonstrates the efficacy of oral budesonide suspension in improving endoscopically identified esophageal abnormalities in eosinophilic esophagitis. Gastroenterology, 148, S-29–S-30.

  21. Alexander, J. A., Jung, K. W., Arora, A. S., Enders, F. B., Katzka, D. A., Kephardt, G. M., Kita, H., Kryzer, L. A., Romero, Y., Smyrk, T. C., & Talley, N. J. (2012). Swallowed fluticasone improves histologic but not symptomatic response of adults with eosinophilic esophagitis. Clinical Gastroenterology and Hepatology, 10, 742–749 e741.

    CAS  Article  PubMed  Google Scholar 

  22. Pentiuk, S., Putnam, P. E., Collins, M. H., & Rothenberg, M. E. (2009). Dissociation between symptoms and histological severity in pediatric eosinophilic esophagitis. Journal of Pediatric Gastroenterology and Nutrition, 48, 152–160.

    Article  PubMed  PubMed Central  Google Scholar 

  23. Hruz, P. (2014). Epidemiology of eosinophilic esophagitis. Digestive Diseases, 32, 40–47.

  24. Konikoff, M. R., Noel, R. J., Blanchard, C., Kirby, C., Jameson, S. C., Buckmeier, B. K., Akers, R., Cohen, M. B., Collins, M. H., Assa'ad, A. H., et al. (2006). A randomized, double-blind, placebo-controlled trial of fluticasone propionate for pediatric eosinophilic esophagitis. Gastroenterology, 131, 1381–1391.

    CAS  Article  PubMed  Google Scholar 

  25. Dohil, R., Newbury, R., Fox, L., Bastian, J., & Aceves, S. (2010). Oral viscous budesonide is effective in children with eosinophilic esophagitis in a randomized, placebo-controlled trial. Gastroenterology, 139, 418–429.

    CAS  Article  PubMed  Google Scholar 

  26. Spergel, J. M., Rothenberg, M. E., Collins, M. H., Furuta, G. T., Markowitz, J. E., Fuchs, G., 3rd, O'Gorman, M. A., Abonia, J. P., Young, J., Henkel, T., et al. (2012). Reslizumab in children and adolescents with eosinophilic esophagitis: Results of a double-blind, randomized, placebo-controlled trial. The Journal of Allergy and Clinical Immunology, 129, 456–463 e451−453.

  27. Straumann, A., Conus, S., Grzonka, P., Kita, H., Kephart, G., Bussmann, C., Beglinger, C., Smith, D. A., Patel, J., Byrne, M., & Simon, H. U. (2010). Anti-interleukin-5 antibody treatment (mepolizumab) in active eosinophilic oesophagitis: A randomised, placebo-controlled, double-blind trial. Gut, 59, 21–30.

  28. McElhiney, J., Lohse, M. R., Arora, A. S., Peloquin, J. M., Geno, D. M., Kuntz, M. M., Enders, F. B., Fredericksen, M., Abdalla, A. A., Khan, Y., et al. (2010). The Mayo Dysphagia Questionnaire-30: Documentation of reliability and validity of a tool for interventional trials in adults with esophageal disease. Dysphagia, 25, 221–230.

  29. Franciosi, J. P., Hommel, K. A., DeBrosse, C. W., Greenberg, A. B., Greenler, A. J., Abonia, J. P., Rothenberg, M. E., & Varni, J. W. (2011). Development of a validated patient-reported symptom metric for pediatric eosinophilic esophagitis: Qualitative methods. BMC Gastroenterology, 11, 126.

    Article  PubMed  PubMed Central  Google Scholar 

  30. Varni, J. W., Seid, M., & Kurtin, P. S. (2001). PedsQL 4.0: Reliability and validity of the pediatric quality of life inventory version 4.0 generic core scales in healthy and patient populations. Medical Care, 39, 800–812.

    CAS  Article  PubMed  Google Scholar 

  31. Franciosi, J. P., Hommel, K. A., Bendo, C. B., King, E. C., Collins, M. H., Eby, M. D., Marsolo, K., Abonia, J. P., von Tiehl, K. F., Putnam, P. E., et al. (2013). PedsQL eosinophilic esophagitis module: Feasibility, reliability, and validity. Journal of Pediatric Gastroenterology and Nutrition, 57, 57–66.

    Article  PubMed  PubMed Central  Google Scholar 

  32. Kwiatek, M. A., Kiebles, J. L., Taft, T. H., Pandolfino, J. E., Bove, M. J., Kahrilas, P. J., & Keefer, L. (2011). Esophageal symptoms questionnaire for the assessment of dysphagia, globus, and reflux symptoms: Initial development and validation. Diseases of the Esophagus, 24, 550–559.

    CAS  Article  PubMed  Google Scholar 

  33. Taft, T. H., Kern, E., Kwiatek, M. A., Hirano, I., Gonsalves, N., & Keefer, L. (2011). The adult eosinophilic oesophagitis quality of life questionnaire: A new measure of health-related quality of life. Alimentary Pharmacology & Therapeutics, 34, 790–798.

    CAS  Article  Google Scholar 

  34. U.S. Department of Health and Human Services FDA (2009). Guidance for Industry: Patient-Reported Outcome Measures: Use in Medical Product Development to Support Labeling Claims. Available from: http://www.fda.gov/downloads/Drugs/Guidances/UCM193282.pdf. Accessed 1 Aug 2017.

  35. Stull, D. E., Leidy, N. K., Parasuraman, B., & Chassany, O. (2009). Optimal recall periods for patient-reported outcomes: Challenges and potential solutions. Current Medical Research and Opinion, 25, 929–942.

    Article  PubMed  Google Scholar 

  36. Martin, L. J., Franciosi, J. P., Collins, M. H., Abonia, J. P., Lee, J. J., Hommel, K. A., Varni, J. W., Grotjan, J. T., Eby, M., He, H., et al. (2015). Pediatric eosinophilic esophagitis symptom scores (PEESS v2.0) identify histologic and molecular correlates of the key clinical features of disease. The Journal of Allergy and Clinical Immunology, 135, 1519–1528 e1518.

    Article  PubMed  PubMed Central  Google Scholar 

  37. Wright, A., Hannon, J., Hegedus, E. J., & Kavchak, A. E. (2012). Clinimetrics corner: A closer look at the minimal clinically important difference (MCID). The Journal of Manual & Manipulative Therapy, 20, 160–166.

  38. Menard-Katcher, P., Marks, K. L., Liacouras, C. A., Spergel, J. M., Yang, Y. X., & Falk, G. W. (2013). The natural history of eosinophilic oesophagitis in the transition from childhood to adulthood. Alimentary Pharmacology & Therapeutics, 37, 114–121.

    CAS  Article  Google Scholar 

Download references

Acknowledgments

Medical writing support was provided by Luci Witcomb PhD, of PharmaGenesis London, London, UK, funded by Shire International GmbH.

Funding

SH was funded by Endpoint Outcomes to conduct the analysis. Endpoint Outcomes was funded by Meritage Pharma, Inc., now part of the Shire group of companies.

Availability of data and materials

The datasets used to generate the results presented here contain some patient-level information; for reasons of confidentiality we have presented only the relevant aggregate data required for the validation of the PRO. Results from the clinical trial are available at: ClinicalTrials.gov identifier: NCT01642212, and have been presented at congresses. A manuscript presenting the primary findings from this clinical trial has also been published [10].

Author information

Authors and Affiliations

  1. Clinical Outcome Solutions, 3709 North Campbell, Tucson, AZ, 85719, USA

    Stacie Hudgens

  2. Endpoint Outcomes, 11 Beacon Street, Suite 910, Boston, MA, 02108, USA

    Christopher Evans

  3. Formerly at Meritage Pharma, Inc., 12555 High Bluff Drive #385, San Diego, CA, 92130, USA

    Elaine Phillips & Malcolm Hill

Authors
  1. Stacie Hudgens
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Christopher Evans
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Elaine Phillips
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Malcolm Hill
    View author publications

    You can also search for this author in PubMed Google Scholar

Contributions

SH, CE, EP and MH worked on the development of the DSQ, the design of the psychometric analysis, interpretation of the results and review of the manuscript. SH conducted the psychometric analysis. All authors read and approved the final manuscript.

Corresponding author

Correspondence to Stacie Hudgens.

Ethics declarations

Authors’ information

SH is a Managing Partner and Strategic Lead at Clinical Outcome Solutions. CE is the Chief Executive Officer and Senior Research Leader at Endpoint Outcomes and Adjunct faculty at Tufts University School of Medicine, Boston, Massachusetts, USA. EP is the former President and Chief Executive Officer of Meritage Pharma, Inc. MH was an employee of Meritage Pharma, Inc. at the time of this study.

Ethics approval and consent to participate

The analysis presented here used data collected from a 12-week, phase 2 trial of budesonide oral suspension in patients with eosinophilic esophagitis, registered at ClinicalTrials.gov (identifier: NCT01642212). The study was approved by the Institutional Review Board at each center and was carried out in accordance with the International Conference on Harmonisation of Good Clinical Practice guidelines and the Declaration of Helsinki.

Consent for publication

Not applicable.

Competing interests

SH was funded by Endpoint Outcomes to conduct the analysis. CE received consulting fees from Meritage Pharma, Inc., now part of the Shire group of companies, to complete this work. EP and MH were employees of Meritage Pharma Inc. at the time the study was conducted.

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Open Access This article is distributed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made.

Reprints and Permissions

About this article

Verify currency and authenticity via CrossMark

Cite this article

Hudgens, S., Evans, C., Phillips, E. et al. Psychometric validation of the Dysphagia Symptom Questionnaire in patients with eosinophilic esophagitis treated with budesonide oral suspension. J Patient Rep Outcomes 1, 3 (2017). https://doi.org/10.1186/s41687-017-0006-5

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1186/s41687-017-0006-5

Keywords

  • Budesonide oral suspension
  • Dysphagia
  • Eosinophilic esophagitis
  • Minimal clinically important difference
  • Patient-reported outcome
  • Psychometric properties
  • Responsiveness
  • Validity