- Open Access
Development of the Diabetes Injection Device Experience Questionnaire (DID-EQ) and Diabetes Injection Device Preference Questionnaire (DID-PQ)
Journal of Patient-Reported Outcomes volume 2, Article number: 43 (2018)
Previous research has examined patient perceptions of insulin injection devices. However, injectable medications other than insulin are increasingly used to treat type 2 diabetes, including GLP-1 receptor agonists. No patient-reported outcome (PRO) instruments have been developed taking into account the experiences of patients using newer injection devices, which are often different from devices used for insulin. Therefore, the purpose of this qualitative study was to develop two draft PRO instruments focusing on patients’ experiences with these newer injection devices (one instrument assessing perceptions of a single injection device, and another assessing preferences between two devices).
Questionnaire development proceeded in six steps: literature review, interviews with six device experts, concept elicitation interviews with patients (N = 32), preliminary translatability assessment, cognitive interviews with patients (N = 20), and final translatability assessment.
Literature review and expert interviews were conducted to inform a concept elicitation interview guide. In concept elicitation in the US, UK, and Germany, patients with type 2 diabetes reported a range of injection features that influenced their perceptions of non-insulin injection devices (e.g., requirements for preparation of the medication/device, issues related to the needle, ease-of-use, portability). Two draft “item pools” were developed based on the literature review, expert interviews, and concept elicitation results. In cognitive interviews, patients recommended minor revisions and indicated that the draft instruments were generally clear, comprehensible, and relevant to their experience with non-insulin injectable medication. The instruments were refined based on the cognitive interviews and translatability assessment, resulting in two questionnaires.
The various steps of qualitative research support the content validity of these new PRO instruments, which are the first developed specifically to assess perceptions of non-insulin injection delivery systems. Despite some overlap with insulin-focused questionnaires, the new instruments are distinct from previous instruments (omitting content that would not be relevant to patients receiving non-insulin injectable treatment, while including content that is not included in the insulin focused instruments). This qualitative research yielded two draft questionnaires that are grounded in patient perceptions and ready for psychometric validation studies with larger samples of patients with type 2 diabetes.
A range of patient-reported outcomes instruments (PROs) are available for assessing patient perceptions of treatment for type 2 diabetes. When added to clinical outcomes such as HbA1c (average blood glucose level over the past 2 to 3 months), PROs can provide a more thorough picture of patients’ experience with type 2 diabetes and its treatments. In addition, it is important to understand the patient perspective because greater treatment satisfaction can lead to better treatment adherence [1,2,3,4], which has a positive impact on health outcomes [5, 6]. Several PRO measures have been developed specifically to assess perceptions of insulin treatment, including the injection process [7,8,9,10]. However, injectable medications other than insulin are increasingly used to treat type 2 diabetes [11,12,13]. PRO instruments designed to assess perceptions of insulin treatment are not necessarily appropriate for the newer treatments, which may differ from insulin in multiple aspects of treatment administration and the injection device.
Therefore, the purpose of this study was to conduct qualitative research to support the development of two new questionnaires focusing on patients’ perceptions of injection devices used with non-insulin treatments for type 2 diabetes. The available non-insulin injectable medications for type 2 diabetes include pramlintide  and several medications in the class of glucagon-like peptide-1 receptor agonists (GLP-1 RAs) . The GLP-1 RAs are often recommended as part of combination therapy when oral medication alone does not result in sufficient control of blood glucose levels [15,16,17]. GLP-1 RAs can be effective in lowering blood glucose levels and body weight, with a low risk of hypoglycemia [11, 18,19,20]. The most commonly reported adverse events are gastrointestinal side effects [19,20,21].
Despite these similarities in efficacy and safety, GLP-1 RAs vary in their injection devices and related treatment administration attributes. For example, the injection devices differ in size, requirements for needle handling, and multiple versus single use [22,23,24,25,26,27,28]. In addition, some GLP-1 RAs require the patient to reconstitute and/or mix the medication in the injection device prior to injection [23, 25] while others do not have these requirements [22, 24, 26,27,28]. Furthermore, the frequency varies widely as some GLP-1 RAs are injected every day [22, 26, 27] while others are injected once weekly [23,24,25, 28]. These differences in the injection device and injection process could impact patients’ quality of life and preference among treatments. Although these differences among treatments could be important to patients, there are no previously available questionnaires designed to assess patient experience or preference among these new injection devices.
Previous PRO instruments designed to assess treatment experiences among patients with type 2 diabetes were not developed while considering differences among these newer injectable treatments. The majority of the existing diabetes-specific measures are focused on insulin treatment and include concepts that are not applicable to treatment with most of the GLP-1 RAs, such as dose selection and adjustment, measuring blood glucose or glycemic control, and planning food or physical activities around treatment. Examples of these instruments include the Insulin Delivery System Rating Questionnaire (IDSRQ) , the Insulin Delivery System Questionnaire (IDSQ) [29, 30], Insulin Injection Preference Questionnaire (IIP-Q) , the Insulin Pens Questionnaire – Evaluation (IPQ-E) ; Insulin Treatment Satisfaction Questionnaire (ITSQ) , Patient Satisfaction with Insulin Therapy (PSIT) [32, 33], Treatment-Related Impact Measures for Diabetes and Diabetes Devices (TRIM-D and TRIM-D Device) [8, 34]. Previously existing measures also omit concepts that could be important when assessing patient experiences with injection devices such as preparing the device/medication for use (missing from IPQ-E, ITSQ, and PSIT), confidence in providing the correct dose (missing from ITSQ, PSIT), the size of the needle (missing from IDSQ, IPQ-E, TRIM-D/TRIM-D Device), or the time to prepare and inject the medication (missing from IDSQ, IIP-Q, IPQ-E, ITSQ, TRIM-D/TRIM-D Device). More general instruments, such as the Diabetes Treatment Satisfaction Questionnaire (DTSQ) , are useful across a wide range of treatments, but may not include specific injection device characteristics. Importantly, none of these measures were developed based on perceptions of patients treated with GLP-1 RAs, and therefore may not reflect the key features of these new treatments that are most important to patients treated with these newer injectable medications.
In contrast to these previously developed instruments, the content of the two PRO measures developed in the current study is derived directly from the input of patients who have experience with these newer treatments, including a range of the available GLP-1 RAs. This qualitative study included two phases of interviews with patients who had been treated with non-insulin injectable medication for type 2 diabetes. The aim of this qualitative research was to gain an understanding of patients’ experiences with these newer injection delivery systems, which would ensure that concepts important to these patients would be included in two new questionnaires. The first questionnaire was designed to assess perceptions of a single injection device, while the second asks patients to report preferences between two devices.
Development of these draft questionnaires proceeded in a series of six steps summarized in Fig. 1. The first step was literature review, designed to inform development of interview guides for use in subsequent discussions with clinicians, device experts, and patients. This literature review focused on identifying attributes of non-insulin injection devices that could be important to patients, as well as previously developed PRO instruments designed to assess content that could be relevant to diabetes injection devices. Sources of information included the instructions for use of every available non-insulin injection device, as well as published articles on these medications and diabetes-specific PRO measures identified via PubMed.
In step 2, six experts were interviewed about diabetes injection devices by telephone or in person. These experts included three clinicians who had worked with patients treated with non-insulin injectable medication (MD, MBBS, and RN) and three diabetes injection device engineers. These interviews focused on factors differentiating among diabetes injections devices; strengths and inconveniences of non-insulin injection devices that were available at the time; ways that injection devices may influence treatment decisions; device attributes clinicians consider when selecting a device; and execution for development of non-insulin injection devices in the future. Key factors said to differentiate among devices included device preparation requirements, reconstitution, adjustable dose selection (compared to fixed dose devices), patient confidence in using the device, needle handling requirements, needle visibility, needle safety, capping, disposal, overall ease of use, and single-use versus multiple-use devices. The results of steps 1 and 2 were used to develop a concept elicitation interview guide designed to elicit patient experiences with diabetes injection devices.
In step 3, concept elicitation interviews were conducted with patients in the US, UK, and Germany. Interviews focused on experiences with devices used to administer non-insulin injectable medication. Qualitative information gathered during these interviews was used to generate the initial item pools: one set of items for evaluating patient perceptions of a single injection device (“single device questionnaire”) and a parallel set of items for assessing preference between two injection devices (“preference questionnaire”). In step 4, the draft item pools were evaluated in a preliminary translatability assessment (performed by a member of the Leadership Team of the International Society for Pharmacoeconomics and Outcomes Research [ISPOR] Patient-Reported Outcomes [PRO] Task Force for Translation and Linguistic Validation), and edits were made to the word choice and item structure.
In step 5, the draft item pools were evaluated in cognitive interviews with type 2 diabetes patients in the US and UK. Each participant was asked to complete the single device questionnaire. Participants who had experience with more than one injection device were also asked to complete the preference questionnaire, while participants who had used only one injection device were asked to review (but not complete) the preference questionnaire. Respondents were queried on how they interpreted, understood, and responded to the questionnaires, with specific focus on interpretation of instructions, items, and response options. In addition to reviewing the content of the items, participants were asked if there were relevant attributes of their injection devices that were not addressed in the instrument. The item pools were edited based on patient feedback during the cognitive interviews and a subsequent final translatability assessment (step 6; performed by a member of the Leadership Team of the ISPOR PRO Task Force for Translation and Linguistic Validation), yielding two draft questionnaires ready for item reduction and psychometric validation in a subsequent study with a larger sample to be reported elsewhere.
Qualitative research participants
Patients with type 2 diabetes were interviewed for the concept elicitation and cognitive interview steps of instrument development. All participants in both of these steps were required to be (1) diagnosed with type 2 diabetes by a recognized medical professional; (2) at least 18 years of age at the time of the interview; (3) able to provide proof of type 2 diabetes diagnosis; (4) residing in the US or UK (or Germany for concept elicitation interviews); (5) able to read, speak, and understand the native language of their interview location; (6) able and willing to give written informed consent prior to study entry; and (7) able to complete the protocol requirements.
Participants in the concept elicitation interviews were required to be either currently treated for type 2 diabetes with a non-insulin injectable medication (i.e., one of the GLP-1 receptor agonists or pramlintide) or have discontinued treatment with one of these non-insulin injectable medications within the last 6 months. Participants in the cognitive interviews were required to be currently receiving treatment with a non-insulin injectable medication. Patients who had discontinued a non-insulin injectable medication were eligible for concept elicitation interviews because their perceptions of a previously used device could have provided useful insight, particularly if they discontinued the medication because of the device. However, for the cognitive interviews, it was important that patients were currently using a relevant device so that they could complete questionnaire items based on current perceptions, as indicated in the questionnaire instructions. Participants were eligible for either phase regardless of whether they received insulin in addition to the non-insulin medication.
Potential participants were excluded if the participant (1) had a cognitive impairment, hearing difficulty, visual impairment, acute psychopathology, or insufficient knowledge of the interview language that in the opinion of the investigator/interviewer could interfere with his or her ability to provide written consent and complete an interview; (2) was unable to recall any characteristics about their injection device; (3) was currently diagnosed with gestational diabetes instead of type 2 diabetes; and/or (4) receiving a GLP-1 receptor agonist for weight loss rather than type 2 diabetes.
All participants were recruited via newspaper and online advertisements. Concept elicitation participants were recruited in 15 cities across the United States (Washington, DC; Omaha, NE; Tampa, FL; Phoenix, AZ; San Diego, CA; San Antonio, TX; Dallas, TX; Houston, TX; Birmingham, AL; Atlanta, GA; and Indianapolis, IN), the UK (Edinburgh and London), and Germany (Hamburg and Berlin). Cognitive interview participants were recruited in 11 cities across the United States (Washington, DC; Baltimore, MD; Omaha, NE; San Diego, CA; San Antonio, TX; Dallas, TX; Houston, TX; Birmingham, AL; Atlanta, GA; Indianapolis, IN) and the UK (London). All potential participants who responded to the advertisements were screened by telephone using a standardized screening script.
Data collection: Two qualitative methods
This research followed standard methods for qualitative research used to support PRO instrument development, including both concept elicitation and cognitive interviews [36,37,38,39]. Concept elicitation interviews in step 3 were conducted with patients with type 2 diabetes to inform the content of the instrument. These interviews were conducted using a semi-structured interview guide developed based on the results of the literature review (step 1) and interviews with clinicians and injection device engineers (step 2). The interview focused on patients’ perceptions and experiences of non-insulin injection devices associated with treatment for type 2 diabetes. Each interview began with open-ended questions to elicit spontaneous comments unprompted by suggestions of any specific device attributes (e.g., Tell me about your experience with this device. What do/did you like/dislike about the device? Are there features of the device that make it convenient/inconvenient/easy/difficult to use?). After patients answered these open-ended questions, a series of targeted questions were asked about specific injection device attributes the patients had not yet mentioned (e.g., steps for preparing the medication/device prior to injection, frequency of injections, portability, comfort/discomfort, disposal, storage, issues associated with the needle, dose selection, time required for the injection process).
Cognitive interviews in step 5 evaluated the draft questionnaires in terms of ease of use, clarity, comprehensibility, comprehensiveness, redundancy, and relevance. Respondents first completed the draft questionnaires, and were then interviewed according to a structured interview guide that focused on evaluating patients’ understanding of the instructions, questions, response options, and recall period. The participants were asked to describe how they understood the instrument’s instructions, how they interpreted each item, and how they selected a response.
All methods and materials were approved by an Independent Review Board [Ethical and Independent Review Services (E&I), E&I study numbers 14173–01 and 15099–01], and all patients provided written informed consent prior to completing any study procedures. Interviews were audio recorded and transcribed so that the qualitative data could be coded and analyzed (and in the case of the German interviews, translated prior to coding).
Qualitative data analysis
Qualitative data from the concept elicitation and cognitive interviews were analyzed using ATLAS.ti software and a content analysis approach . A coding dictionary of themes, concepts, and terms was developed for use in the qualitative analysis. For concept elicitation interviews, the coding dictionary included concepts relating to participants’ experience with their injection devices and injection device attributes. For cognitive interviews, the dictionary included codes related to item clarity, item comprehension, ease of completing the items, comprehensiveness of the instrument, and appropriateness of the response scales.
For both concept elicitation and cognitive interviews, two staff members independently coded the first interview transcript from each interview step. A post-coding comparison and reconciliation occurred, and all codes were compared, discussed, and reconciled wherever differences occurred. After agreement between the two coders was sufficient based on determination by a senior staff member, one coder coded the remaining transcripts with a quality review by senior staff members.
Participant quotes were categorized by thematic code, and saturation was documented by tracking concepts in saturation grids. Saturation is defined as the point at which no substantially new themes, concepts, or terms are introduced as additional interviews are conducted .
Steps 1 and 2: Literature review and expert interviews
A total of eight injection devices were identified for non-insulin medications used to treat diabetes: exenatide extended release single-dose tray, exenatide once weekly pen, exenatide twice daily pen, dulaglutide pen, liraglutide pen, albiglutide pen, pramlintide pen, and lixisenatide pen. Based on published literature, drug labels, and device instructions for use, key attributes that differ among these eight non-insulin injection devices included frequency of injections, visibility of the needle, single use/reusable, requirements for reconstitution (i.e., mixing the medication), waiting time during reconstitution, wait time after removing from refrigerator, requirements for timing of administration (including with or without meals), and requirements for attaching/handling the needle [11, 17,18,19,20,21, 41].
The literature review also identified a range of PRO measures that were previously developed to assess perceptions of diabetes treatment. Some of these instruments include items assessing perceptions of the insulin injection process, and these items were considered relevant for development of the new questionnaires. Previous relevant PRO measures include the Diabetes Treatment Satisfaction Questionnaire (DTSQ) , Insulin Delivery System Questionnaire (IDSQ) , Insulin Injection Preference Questionnaire (IIP-Q) , Insulin Treatment Satisfaction Questionnaire (ITSQ) , and the Treatment Related Impact Measures for Diabetes and Diabetes Devices (TRIM-D) , among others.
Three clinicians and three injection device engineers also provided input regarding differences among available injections devices for non-insulin medications, including strengths and inconveniences of each injection process, device attributes that clinicians consider when choosing which medication to prescribe, and expectations for future non-insulin injection devices. Key factors suggested to differentiate among injection devices included device preparation requirements, reconstitution procedures, adjustable dose selection (compared to fixed dose devices), patient confidence in preparing and using the device, needle handling requirements, needle visibility, needle safety, capping of the devices, and disposal of the devices. The results of the literature review and expert interviews were used to inform the development of the concept elicitation interview guide for step 3.
Steps 3 and 4: Concept elicitation interviews and preliminary translatability assessment
A total of 32 patients completed concept elicitation interviews in the UK (n = 14), the US (n = 11), and Germany (n = 7) (see demographic and clinical characteristics in Table 1). Thirty participants discussed devices associated with GLP-1 receptor agonists that they were currently using. In addition to discussing current devices, two of these 30 participants also discussed a GLP-1 receptor agonist device that they had discontinued in the past 6 months. An additional two participants were not currently treated with a non-insulin injectable medication. Instead, these two participants discussed GLP-1 receptor agonists that they had discontinued within the past 6 months. The most commonly used GLP-1 receptor agonists in this sample were liraglutide (n = 11), exenatide (n = 5), exenatide extended release (n = 4), and exenatide extended release single-dose tray (n = 4).
During the interviews, the participants reported a wide range of attributes of injection devices and injection processes that they liked and disliked. Positive and negative injection attributes are listed in Tables 2 and 3, respectively, along with frequencies of participants reporting each attribute and examples of quotes for each attribute. The attributes included injection preparation, injection comfort, the needle, dose delivery confidence/confirmation, injection frequency, selecting a dose, disposal, time requirements, size, injection site, design/appearance, storage, portability, discreetness, and confidence in appropriate device use. Many of the attributes were viewed positively by some respondents and negatively by others. No new important concepts or themes emerged in the final five interviews. Therefore, it was determined that concept saturation was reached, and no additional concept elicitation interviews were needed. The concepts and terms identified in these interviews were used to develop item pools for the single device questionnaire and the preference questionnaire, thus ensuring that the content of the questionnaires was grounded in patients’ descriptions of their experience with non-insulin injectable medication and the associated injection devices. Instructions and response options were also drafted so that they could be tested in the subsequent cognitive interview study.
The draft item pools and instructions were reviewed in a preliminary translatability assessment (step 4), leading to minor wording revisions. The two resulting item pools (i.e., the single device questionnaire and the preference questionnaire) ready for the cognitive interviews each contained 16 items on specific attributes (injection preparation, comfort/pain, confidence in dose delivery, confidence in correct/appropriate use, needle size, needle use, injection frequency, injection timing/flexibility, time required for the injection process, size, portability, storage, selecting dose, disposal) and three global items assessing satisfaction, ease of use, and convenience. Depending on the phrasing, each item of the single device questionnaire was answered using a 4-point response option scale assessing satisfaction, ease of use, confidence, or agree/disagree. Each item of the preference questionnaire had a 5-point response scale on which respondents indicate which of two devices is preferred.
Steps 5 and 6: Cognitive interviews and final translatability assessment
A total of 20 patients with type 2 diabetes participated in cognitive interviews in the US (n = 15) and UK (n = 5) (see demographic and clinical characteristics in Table 4). Each participant was asked to complete the single device questionnaire. Participants who had experience with more than one non-insulin injection device were also asked to complete the preference questionnaire in order to compare two devices. Participants who had experience with only one non-insulin injection device were asked to review, but not complete, the preference questionnaire.
Most participants reported that the questionnaires were clear and easy to complete. Some minor revisions were made to specific items based on participant feedback. For example, participants had difficulty with the initial wording of the item on injection pain (originally phrased as “the injections are painful”) and offered suggestions for revisions. This item was re-worded twice during the cognitive interview phase. All participants completing the final version of the item (“How often do you experience pain when injecting medication with this device?”) demonstrated that they understood the item as intended without difficulty. The item on difficulty with dose selection (“How difficult is it to select the correct dose for each injection?”) was not applicable to all participants because many non-insulin injection devices do not require patients to select a dose. The phrasing of this item was revised to ask about frequency to allow participants to answer the item even if their device does not require dose selection (“How often do you have difficulty selecting the correct dose with your injection device?”). Feedback from participants suggested that the item on disposal of the device and its parts was confusing because it assessed two constructs. Therefore this item was split into separate questions asking about disposal of the injection device (“How difficult is it to dispose of the injection device?”) and disposal of the device parts (“How difficult is it to dispose of materials associated with the injection device, such as the cap and needle?”). Two items were added based on recommendations from participants. These additional items assessed anxiety and difficulty keeping the injection device and medication at the correct temperature when it is necessary to inject away from home.
The draft questionnaires were updated several times during the cognitive interview study based on this feedback from participants. In total, there were four rounds of interviews, each with slightly updated versions of the questionnaires. In the final round of interviews with three participants completing the final versions of the questionnaires, participants understood the questionnaire items as intended and were able to answer the items without difficulty.
A thorough translatability assessment was conducted after the cognitive interviews were completed. A small number of comments suggested minor wording changes to the questionnaire. None of these changes altered the content or meaning of the items. For example, the item “how often do you have anxiety about using your injection device?” was revised to “how often do you feel anxious about using your injection device?”, as this phrasing may be more culturally appropriate for some translations.
After edits based on the translatability assessment and cognitive interviews, the resulting versions of the single device questionnaire and preference questionnaire each contained 20 items assessing the following concepts: preparation for use, using the needle, disposal of injection device, disposal of materials associated with the injection device, fitting the injection into routine, storage, portability, storage temperature, confidence in dose delivery, confidence in device use, needle size, device size, injection frequency, time required for preparation and injection, selecting dose, pain, anxiety, and three global items on satisfaction, ease of use, and convenience.
In the instructions for a PRO instrument, the recall period is an important part of the instructions [43, 44]. Because these new questionnaires focus on perceptions of injectable treatment rather than symptoms or disease impact that tend to fluctuate over time, the items focus on current perceptions rather than an extended recall period. The instructions of the single device questionnaire begin with “Please select one response for each item to indicate how you currently feel...”. For the preference questionnaire, the word “currently” could have been confusing because respondents need to consider both a current and previous medication. Therefore, the instructions of the preference questionnaire do not use the word “currently,” but instead implicitly ask for current preference (“Please select one response for each item to indicate which of the two injection devices you prefer.”).
Taken together, the various steps of qualitative research support the content validity of these two new PRO instruments to assess perceptions of non-insulin injection devices and the injection process. In the multi-country concept elicitation study, patients who have been treated with non-insulin injectable medication for type 2 diabetes reported a wide range of injection device features that influenced their perceptions of the injection experience. The patient perspective elicited in these interviews, in combination with clinician input and published literature, was used to generate content of the instruments. Subsequent cognitive interviews with additional patients indicated that the draft instruments were clear, comprehensible, and relevant to patients who had been treated with non-insulin injectable medications. The questionnaires were then refined based on these cognitive interviews, as well as a translatability assessment. These steps of instrument development resulted in two draft questionnaires that are grounded in patient perceptions and ready for psychometric validation studies with larger samples of patients with type 2 diabetes.
In addition to supporting instrument development, results of the concept elicitation interviews highlight aspects of injectable treatment that are important to patients (listed in Tables 2 and 3). Nearly all injection device features were viewed favorably by some respondents and unfavorably by others, usually depending on whether the device features were perceived as contributing to ease-of-use. For example, some patients viewed the relatively simple injection preparation as a positive feature of their injection device (e.g., 301–025: “I get my device, put the needle in, click it to the dosage amount, and then inject. It’s very easy.”). However, other medications require more steps prior to injecting the medication, and patients receiving these treatments viewed injection preparation as a negative feature (e.g., 101–003: “I just wish it was already mixed up… I wish I didn’t have to go through the stages of mixing it and shaking the device, and making sure it’s well diluted. It’s a waste of time.”). While injection device features are likely to be a lower priority than efficacy and safety, these factors could contribute to patient satisfaction and adherence, which could have an impact on treatment outcomes . Therefore, in clinical settings, it may be important to consider these device and injection process features when considering treatments for individual patients.
Although these are the first PRO instruments developed based on perceptions of patients treated with non-insulin injectable medications for type 2 diabetes, there is overlap between these new instruments and instruments developed in samples of insulin-treated patients. Several constructs in the new instruments are also assessed by insulin-focused PRO measures (e.g., general ease-of-use, size of device, physical discomfort, confidence that the device delivers the correct dose) [7, 9, 10, 29, 33, 34]. Despite this overlap, the new instruments diverge from these previous insulin-focused instruments in important ways. A useful example is the 8-item TRIM-D Device instrument, which focuses on experiences with insulin injection devices .
Two of the items included in the new questionnaires are similar to TRIM-D Device items (confidence that the device provides the correct dose, and confidence that the device is being used correctly). However, the TRIM-D Device includes items that are not applicable to patients receiving non-insulin injectable treatment. For example, the item “adjust your medication for small dose changes” is not applicable to the GLP-1 RA injection devices that do not require dose adjustments. Similarly, the TRIM-D Device item “keep your device functioning properly” is not applicable to single use devices such as the dulaglutide pen. Also, the weekly GLP-1 RAs would not typically need to be injected in public. Therefore, the TRIM-D Device item on “using your device in public” would likely be irrelevant for patients treated with the longer acting GLP-1 RAs. Furthermore, some important features that differentiate among GLP-1 RA injection processes (e.g., injection preparation requirements relating to mixing the medication, variations in dose frequency, flexibility with regard to dose timing, requirements for needle handling) are not included in insulin-focused PRO instruments such as the TRIM-D Device. In sum, despite some overlap, the new PRO instruments are notably different from the previously available insulin-focused questionnaires.
Qualitative studies such as this one have several limitations that should be acknowledged. Items for the two new questionnaires were developed primarily based on the relatively small sample of 32 patients, and generalizability to other samples is not known. Although an effort was made to recruit a diverse group of patients from three countries, these 32 patients should not be considered completely representative of the broader population of individuals with type 2 diabetes. No cultural or geographic differences in perceptions of injection devices were apparent in the current sample. However, it is possible that samples with different demographic or clinical characteristics (e.g., age, geographic region, race/ethnicity, diabetes treatment history, symptom severity) could have different opinions and priorities relating to injection devices. For example, only two participants in this study were Asian (one in the concept elicitation and one in the cognitive interviews), and it is not known whether perceptions of non-insulin injection devices would be different in an Asian population. Future research in larger and more diverse samples may examine the broader generalizability of the resulting questionnaires.
Another limitation of the current study is that data were not collected on detailed clinical characteristics of the sample, such as diabetic complications, experience with disease self-management, detailed treatment history, and glycemic control. Therefore, it is not possible to know the extent to which this sample represents the broad range of diabetes severity. In addition, some clinical characteristics (e.g., peripheral neuropathy and loss of sensation in the fingers) could have a direct impact on one’s ability to use and prepare an injection device. The current results cannot provide insight into the impact of these clinical variables on perceptions of injection devices.
Furthermore, new non-insulin medications with new devices and treatment administration approaches will continue to be introduced [45, 46]. This study included patients treated with the full spectrum of non-insulin injectable medications for type 2 diabetes that were available at the time of data collection, including all GLP-1 RAs and pramlintide. However, it is possible that treatment administration devices used for future medications that have important characteristics that are not captured by the new questionnaires. Still, the final three global items were designed to be sufficiently general so that they could capture patients’ overall perspective of almost any diabetes injection device. Therefore, while these instruments were developed to assess perceptions of non-insulin injection devices, they may also be useful for assessing devices used to inject insulin or combinations of insulin and non-insulin medications.
It must also be emphasized that these 20-item questionnaires are draft versions, prior to psychometric validation. A follow-up study, to be reported in a subsequent article, focuses on item reduction in a larger sample, along with reliability and validity of the streamlined instruments, which are called the Diabetes Injection Device Experience Questionnaire (DID-EQ) and the Diabetes Injection Device Preference Questionnaire (DID-PQ). The qualitative research conducted in the current study is the first step toward improving measurement of patients’ experiences with devices and treatment administration approaches associated with the newer injectable medications for type 2 diabetes.
- DID-EQ :
Diabetes Injection Device Experience Questionnaire
- DID-PQ :
Diabetes Injection Device Preference Questionnaire
- DTSQ :
Diabetes treatment satisfaction questionnaire
- GLP-1 RA :
Glucagon-like peptide-1 receptor agonist
- IDSQ :
Insulin delivery system questionnaire
- IDSRQ :
Insulin delivery system rating questionnaire
- IIP-Q :
Insulin injection preference questionnaire
- IPQ-E :
Insulin pens questionnaire – evaluation
- ITSQ :
Insulin treatment satisfaction questionnaire
- PRO :
- PSIT :
Patient satisfaction with insulin therapy
- T2D :
Type 2 diabetes
- TRIM-D Device :
Treatment-related impact measures for diabetes and diabetes devices
- TRIM-D :
Treatment-related impact measures for diabetes
- UK :
- US :
Hixson-Wallace, J. A., Dotson, J. B., & Blakey, S. A. (2001). Effect of regimen complexity on patient satisfaction and compliance with warfarin therapy. Clin Appl Thromb Hemost, 7(1), 33–37.
Morris, L. S., & Schulz, R. M. (1993). Medication compliance: The patient's perspective. Clin Ther, 15(3), 593–606.
Raue, P. J., Schulberg, H. C., Heo, M., Klimstra, S., & Bruce, M. L. (2009). Patients’ depression treatment preferences and initiation, adherence, and outcome: A randomized primary care study. Psychiatr Serv, 60(3), 337–343.
Shikiar, R., Rentz, A., Barone, J., Duncanson, F., & Katz, E. (2002). Patient satisfaction with Ofloxacin (F) and Polymyxin B/neomycin/hydrocortisone (C) in the treatment of otitis externa: Results from two randomized clinical trials. Journal of Managed Care, 6(3), 24–27.
Express Scripts (2017). Report: Adherence to diabetes Rx, August 25, 2017:5 pages.
Khunti, K., Seidu, S., Kunutsor, S., & Davies, M. (2017). Association between adherence to pharmacotherapy and outcomes in type 2 diabetes: A meta-analysis. Diabetes Care, 40(11), 1588–1596.
Anderson, R. T., Skovlund, S. E., Marrero, D., et al. (2004). Development and validation of the insulin treatment satisfaction questionnaire. Clin Ther, 26(4), 565–578.
Brod, M., Christensen, T., Hammer, M., Busk, A. K., & Bushnell, D. M. (2011). Examining the ability to detect change using the TRIM-diabetes and TRIM-diabetes device measures. Qual Life Res, 20(9), 1513–1518.
Peyrot, M., & Rubin, R. R. (2005). Validity and reliability of an instrument for assessing health-related quality of life and treatment preferences: The insulin delivery system rating questionnaire. Diabetes Care, 28(1), 53–58.
Szeinbach, S. L., Barnes, J. H., Summers, K. H., & Lenox, S. M. (2004). Development of an instrument to assess expectations of and preference for an insulin injection pen compared with the vial and syringe. Clin Ther, 26(4), 590–597.
Aroda, V. R., Henry, R. R., Han, J., et al. (2012). Efficacy of GLP-1 receptor agonists and DPP-4 inhibitors: Meta-analysis and systematic review. Clin Ther, 34(6), 1247–1258 e22.
Pratley, R. E., & Gilbert, M. (2008). Targeting incretins in type 2 diabetes: Role of GLP-1 receptor agonists and DPP-4 inhibitors. Rev Diabet Stud, 5(2), 73–94.
Srinivasan, B. T., Jarvis, J., Khunti, K., & Davies, M. J. (2008). Recent advances in the management of type 2 diabetes mellitus: A review. Postgrad Med J, 84(996), 524–531.
Younk, L. M., Mikeladze, M., & Davis, S. N. (2011). Pramlintide and the treatment of diabetes: A review of the data since its introduction. Expert Opin Pharmacother, 12(9), 1439–1451.
American Diabetes Association. (2018). 8. Pharmacologic approaches to glycemic treatment: Standards of medical Care in Diabetes—2018. Diabetes Care, 41(Supplement 1), S73–S85.
Garber, A. J., Abrahamson, M. J., Barzilay, J. I., et al. (2017). Consensus statement by the American Association of Clinical Endocrinologists and American College of endocrinology on the comprehensive type 2 diabetes management algorithm - 2017 executive summary. Endocr Pract, 23(2), 207–238.
National Institute for Health and Care Excellence (NICE). Type 2 diabetes in adults: management (NG28). London, UK. Published: 02 December 2015; Last updated: May 2017:45 pages.
Htike, Z. Z., Zaccardi, F., Papamargaritis, D., Webb, D. R., Khunti, K., & Davies, M. J. (2017). Efficacy and safety of glucagon-like peptide-1 receptor agonists in type 2 diabetes: A systematic review and mixed-treatment comparison analysis. Diabetes Obes Metab, 19(4), 524–536.
Tran, L., Zielinski, A., Roach, A. H., et al. (2015). The pharmacologic treatment of type 2 diabetes: Injectable medications. Ann Pharmacother, 49(6), 700–714.
Trujillo, J. M., Nuffer, W., & Ellis, S. L. (2015). GLP-1 receptor agonists: A review of head-to-head clinical studies. Ther Adv Endocrinol Metab, 6(1), 19–28.
Aroda, V. R., & Ratner, R. (2011). The safety and tolerability of GLP-1 receptor agonists in the treatment of type 2 diabetes: A review. Diabetes Metab Res Rev, 27(6), 528–542.
AstraZeneca Pharmaceuticals. (2015a). Highlights of Prescribing Information 2005: Byetta (exenatide) injection. Secondary highlights of prescribing information: Byetta (exenatide) injection. Initial US Approval: February. https://www.azpicentral.com/byetta/pi_byetta.pdf#page=1.
AstraZeneca Pharmaceuticals. (2015b). Instructions for use - Bydureon single-dose tray (exenatide extended-release) for injectable suspension. In Secondary instructions for use - Bydureon single-dose tray (exenatide extended-release) for injectable suspension http://www.azpicentral.com/bydureon/ifu_bydureon.pdf#page=1.
Eli Lilly and Company. (2014). Instructions for Use: TRULICITY® (Trū-li-si-tee) (dulaglutide) injection, for subcutaneous use - 0.75 mg/0.5 mL Single-Dose Pen once weekly. Secondary Instructions for Use: TRULICITY® (Trū-li-si-tee) (dulaglutide) injection, for subcutaneous use - 0.75 mg/0.5 mL Single-Dose Pen once weekly. Original: 2014; Updated: June 22, 2017. http://pi.lilly.com/us/trulicity-lowdose-ai-ifu.pdf.
GlaxoSmithKline (GSK). 2015 Highlights of prescribing information: Tanzeum (albiglutide) for injection, for subcutaneous use. Secondary highlights of prescribing information: Tanzeum (albiglutide) for injection, For subcutaneous use. https://www.gsksource.com/pharma/content/dam/GlaxoSmithKline/US/en/Prescribing_Information/Tanzeum/pdf/TANZEUM-PI-MG-IFU-COMBINED.PDF.
Novo Nordisk A/S. (2010). VICTOZA® (liraglutide) injection, for subcutaneous use - 1.2 mg/1.8 mg Secondary VICTOZA® (liraglutide) injection, for subcutaneous use - 12 mg/18 mg. Original: 2010; Updated: August 25, 2017. http://www.novo-pi.com/victoza.pdf.
Sanofi Diabetes. Information for the user. (2017). Lyxumia® 10/20 micrograms solution for injection - lixisenatide. In Secondary information for the user: Lyxumia® 10/20 micrograms solution for injection - lixisenatide https://www.medicines.org.uk/emc/PIL.27399.latest.pdf.
Eli Lilly and Company. (2015). Instructions for Use: TRULICITY (dulaglutide) injection, for subcutaneous use 1.5 mg/0.5 mL Single-Dose Pen once weekly. Secondary Instructions for Use: TRULICITY (dulaglutide) injection, for subcutaneous use 1.5 mg/0.5 mL Single-Dose Pen once weekly. http://pi.lilly.com/us/trulicity-highdose-ai-ifu.pdf.
Hayes, R. P., Fitzgerald, J. T., Muchmore, D. B. (2006). 1229 - validation of the insulin delivery system questionnaire (IDSQ) in patients with type 1 diabetes (abstract). Quality of life research, A-22.
Hayes, R. P., Muchmore, D., & Schmitke, J. (2007). Effect of inhaled insulin on patient-reported outcomes and treatment preference in patients with type 1 diabetes. Curr Med Res Opin, 23(2), 435–442.
Heron, L., Reaney, M., Hermanns, N., Abetz, L., & Gregg, L. (2013). Perceptions of usability and Design for Prefilled Insulin Delivery Devices for patients with type 2 diabetes. Diabetes Spectrum, 26(1), 16–28.
Cappelleri, J. C., Cefalu, W. T., Rosenstock, J., Kourides, I. A., & Gerber, R. A. (2002). Treatment satisfaction in type 2 diabetes: A comparison between an inhaled insulin regimen and a subcutaneous insulin regimen. Clin Ther, 24(4), 552–564.
Cappelleri, J. C., Gerber, R. A., Kourides, I. A., & Gelfand, R. A. (2000). Development and factor analysis of a questionnaire to measure patient satisfaction with injected and inhaled insulin for type 1 diabetes. Diabetes Care, 23(12), 1799–1803.
Brod, M., Kongso, J. H., Lessard, S., & Christensen, T. L. (2009). Psychological insulin resistance: Patient beliefs and implications for diabetes management. Qual Life Res, 18(1), 23–32.
Bradley, C. Diabetes treatment satisfaction questionnaire (1999). Change version for use alongside status version provides appropriate solution where ceiling effects occur. Diabetes Care, 22(3), 530–532.
Food Drug Administration (FDA). (2009). Guidance for industry patient-reported outcome measures: Use in medical product development to support labeling claims. Fed Regist, 74(235), 65132–65133.
Leidy, N. K., & Vernon, M. (2008). Perspectives on patient-reported outcomes : Content validity and qualitative research in a changing clinical trial environment. Pharmacoeconomics, 26(5), 363–370.
Patrick, D. L., Burke, L. B., Gwaltney, C. J., et al. (2011). Content validity--establishing and reporting the evidence in newly developed patient-reported outcomes (PRO) instruments for medical product evaluation: ISPOR PRO good research practices task force report: Part 2--assessing respondent understanding. Value Health, 14(8), 978–988.
Patrick, D. L., Burke, L. B., Gwaltney, C. J., et al. (2011). Content validity--establishing and reporting the evidence in newly developed patient-reported outcomes (PRO) instruments for medical product evaluation: ISPOR PRO good research practices task force report: Part 1--eliciting concepts for a new PRO instrument. Value Health, 14(8), 967–977.
Hsieh, H. F., & Shannon, S. E. (2005). Three approaches to qualitative content analysis. Qual Health Res, 15(9), 1277–1288.
Inzucchi, S. E., Bergenstal, R. M., Buse, J. B., et al. (2012). Management of hyperglycemia in type 2 diabetes: A patient-centered approach: Position statement of the American Diabetes Association (ADA) and the European Association for the Study of diabetes (EASD). Diabetes Care, 35(6), 1364–1379.
Rubin, R. R., & Peyrot, M. (2010). Patient-reported outcomes and diabetes technology: A systematic review of the literature. Pediatr Endocrinol Rev, 7(Suppl 3), 405–412.
Norquist, J. M., Girman, C., Fehnel, S., DeMuro-Mercon, C., & Santanello, N. (2012). Choice of recall period for patient-reported outcome (PRO) measures: Criteria for consideration. Qual Life Res, 21(6), 1013–1020.
Stull, D. E., Leidy, N. K., Parasuraman, B., & Chassany, O. (2009). Optimal recall periods for patient-reported outcomes: Challenges and potential solutions. Curr Med Res Opin, 25(4), 929–942.
Henry, R. R., Logan, D., Alessi, T., & Baron, M. A. (2013). A randomized, open-label, multicenter, 4-week study to evaluate the tolerability and pharmacokinetics of ITCA 650 in patients with type 2 diabetes. Clin Ther, 35(5), 634–45 e1.
Sorli, C., Harashima, S. I., Tsoukas, G. M., et al. (2017). Efficacy and safety of once-weekly semaglutide monotherapy versus placebo in patients with type 2 diabetes (SUSTAIN 1): A double-blind, randomised, placebo-controlled, parallel-group, multinational, multicentre phase 3a trial. Lancet Diabetes Endocrinol, 5(4), 251–260.
The authors would like to thank Evan Davies and Julia Ingram for assistance with data collection; Amanda Landrian for assistance with qualitative analysis; Christine Thompson for statistical programming; and Amara Tiebout for production assistance.
Funding for this study was provided by Eli Lilly and Company, Indianapolis, IN, USA. All aspects of the study design, interpretation, and decision to submit for publication were determined by the authors.
Availability of data and materials
The data collected during this study is kept in a locked, secure facility and is unavailable to the public due to confidentiality concerns. Reasonable requests to review the data for scientific and/or research purposes may be considered.
Ethics approval and consent to participate
All methods and materials were approved by an Independent Review Board [Ethical and Independent Review Services (E&I), E&I study numbers 14173–01 and 15099–01], and all patients provided written informed consent prior to completing any study procedures.
Consent for publication
This study was funded by Eli Lilly and Company (Indianapolis, IN). Kristina S. Boye and Rosirene Paczkowski are employees of Eli Lilly, who provided funding for this study. Louis Matza, Katie Stewart, Jessica Jordan, and Lindsey Murray are employed by Evidera, a company that received funding from Lilly for time spent on this research. All aspects of the study design, interpretation, and manuscript were determined by the authors.
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
About this article
Cite this article
Matza, L.S., Boye, K.S., Stewart, K.D. et al. Development of the Diabetes Injection Device Experience Questionnaire (DID-EQ) and Diabetes Injection Device Preference Questionnaire (DID-PQ). J Patient Rep Outcomes 2, 43 (2018). https://doi.org/10.1186/s41687-018-0068-z
- Type 2 diabetes
- Injection device
- GLP-1 receptor agonist
- Patient-reported outcomes measures
- Concept elicitation
- Qualitative research
- Treatment satisfaction
- Treatment preference