Skip to main content

The Tardive Dyskinesia Impact Scale (TDIS), a novel patient-reported outcome measure in tardive dyskinesia: development and psychometric validation

Abstract

Background

Tardive dyskinesia (TD), a movement disorder in which patients experience abnormal involuntary movements, can have profound negative impacts on physical, cognitive, and psychosocial functioning. The Abnormal Involuntary Movement Scale (AIMS), a clinician-rated outcome, is considered the gold standard for evaluating treatment efficacy in TD clinical trials. However, it provides little information about the impacts of uncontrolled movements from a patient perspective and can be cumbersome to administer in clinical settings. The Tardive Dyskinesia Impact Scale (TDIS) was developed as a patient-reported outcome measure to fulfill the need for a disease-specific impact assessment in TD. The objective of the present study was to develop and evaluate the psychometric properties of the TDIS to determine whether it is fit-for-purpose to measure TD impact.

Methods

Data from qualitative studies and phase 3 trials of a VMAT2 inhibitor for the treatment of TD (KINECT3 and KINECT4) were used to determine the psychometric properties of the TDIS. Qualitative research included concept elicitation and cognitive debriefing interviews with TD patients and their caregivers in order to assess how well the TDIS captured key domains of TD impact. Quantitative analyses to examine the psychometric properties of the TDIS included assessing construct validity (factor structure, known groups, and predictive validity) and responsiveness to change.

Results

Qualitative results showed that the TDIS captures the key TD impacts reported by patients and caregivers and that the TDIS was interpreted as intended and relevant to patients’ experiences. Quantitative results found evidence of 2 underlying domains of the TDIS: physical and socioemotional (Comparative Fit Index > 0.9). Known groups and predictive validity indicated that, compared with the AIMS, the TDIS captures unique content (correlation between AIMS and TDIS = 0.2–0.28). The TDIS showed responsiveness to change in treatment, with TDIS scores improving over 48 weeks in the 2 phase 3 trials.

Conclusions

The TDIS captures relevant information about the impact of TD and is easily administered in a clinician’s office or patient’s home. It may be used longitudinally to show changes in TD burden over time. The TDIS complements the AIMS; using these assessments together provides a more holistic assessment of TD.

Plain English summary

Tardive dyskinesia is a condition where people have uncontrollable movements because of taking certain medications for a long time. It is still poorly understood how these uncontrollable movements affect a person’s everyday activities. We created a questionnaire called the Tardive Dyskinesia Impact Scale (TDIS). The TDIS is a questionnaire where people with tardive dyskinesia rate how their symptoms affect daily activities such as speaking and walking. People can also rate how the uncontrollable movements make them feel. We used specific tests called psychometric tests to see if the TDIS measures the correct information and if the information is reliable. Findings from this study show that the TDIS is a good way to measure how a person’s uncontrollable movements affect everyday activities. The results also show that when people take medicine to help with their symptoms, their TDIS scores are better. When patients stopped taking the medicine, their symptoms were worse, and their TDIS score was worse. The TDIS can help people explain how their uncontrollable movements affect their daily life. This can then help their doctors understand the person’s condition better.

Background

Tardive dyskinesia (TD) is an involuntary, hyperkinetic, and potentially disabling movement disorder in which patients experience abnormal involuntary movements. These movements are the result of long-term exposure to dopamine receptor-blocking agents used to treat psychiatric conditions such as schizophrenia, major depressive disorder, and bipolar disorder [1, 2]. These uncontrolled movements can have profound negative impacts on physical, cognitive, and psychosocial functioning [3].

The Abnormal Involuntary Movement Scale (AIMS), a clinician-reported outcome (ClinRO) measure, is considered the current gold standard for evaluating signs of TD in patients enrolled in clinical trials. The AIMS was originally developed for research purposes to measure the severity (frequency and amplitude) of observed abnormal or uncontrolled movements; however, its adoption for use in routine clinical practice has been limited [2, 4]. In clinical trials, the AIMS is often assessed by several raters following specific procedures. In a clinic setting, clinicians may not have a specific protocol and may measure the severity of TD differently [2]. Moreover, the AIMS score does not measure the functional and social/emotional impact of TD and only measures patient distress with a single item; therefore, it does not adequately capture the full patient burden of TD [2, 4]. In 2 separate advisory panels that provided consensus statements on the assessment of the impact of TD and on use of the AIMS in clinical practice, experts advised that the impact of TD on a patient’s life and functioning should be assessed regularly and that the AIMS may not suffice for understanding the severity and functional impact on patients [2, 3]. A validated, easy-to-use measure for assessing the impact of TD on daily functioning has been recommended to understand the social, physical, vocational, psychological, and psychiatric burden of TD [3]. In 2022, the same advisory panel that provided recommendations on assessing the impact of TD on patients’ lives developed a ClinRO to measure the patient’s experience with TD [3, 5]. The Impact-TD scale considers 4 functional domains: social, psychological/psychiatric, physical, and vocational/educational/recreational [5]. Each domain is scored from 0 (no impact) to 3 (severe impact, significant and detrimental impact) based on clinician observation and patient and caregiver input. This tool has not been validated psychometrically and is not a patient-reported outcome (PRO).

The purpose of this paper is to detail the development and qualitative and quantitative testing of a novel, TD-specific PRO, the Tardive Dyskinesia Impact Scale (TDIS). The methods used in the qualitative research and the psychometric validation of the TDIS are in line with the principles laid out in the Food and Drug Administration (FDA) PRO guidance of 2009 and subsequent patient-focused drug development guidances [6,7,8].

Methods

Background and history related to the TDIS

The TDIS evolved from the Tardive Dyskinesia Rating Scale (TDRS), which was an adaptation of both the Unified Dyskinesia Rating Scale (UDysRS) [9] and the AIMS [10]. The 23-item TDRS was adapted from the UDysRS to measure the severity of dyskinesia, impairment, and disability of the patient. The scale is first completed by the patient/caregiver and then by the clinician. It is similar to the UDysRS and the AIMS in that it attempts to capture the severity of symptoms and signs that are clinically pertinent to TD patients and physicians.

A limitation of the TDRS is that it is not specific to the impact of TD on patients’ lives. Because the TDRS was developed in part from the AIMS and UDysRS, it includes questions about signs of TD as well. These are already captured by the AIMS, which is likely to be used in studies of TD. Moreover, patients were not part of the concept development and item selection of the TDRS, and limited psychometric methods were applied to understand its measurement properties. Since the development of the TDRS, extensive qualitative work (concept elicitation and cognitive debriefing interviews) has been conducted to understand the relevance and interpretation of items and response options. Results of this qualitative work found that patients and caregivers had difficulties understanding the core concepts that were being measured, the instructions for completing the instrument, and the response options of the TDRS [22].

To focus the assessment on the most relevant impacts of TD (e.g. dexterity, mobility, socioemotional impacts), significant modifications to the TDRS were recommended following the results of the qualitative research. In contrast to the development of the TDRS, development of the TDIS was primarily based on patient and caregiver input. Items were selected based on frequently reported impacts, particularly those reported as most bothersome, as well as questions that were free of medical language. In addition, the instructions were simplified, and a reduced set of questions focused on most frequent TD impacts only. A conceptual model of the TDIS was generated as part of this qualitative work to modify and/or replace the TDRS.

Qualitative research

A literature review and qualitative research were conducted to understand the impact of TD on patients and to confirm the appropriateness of the TDIS as a PRO measure [22, 23]. This effort was accomplished through a targeted PubMed literature review and patient and caregiver interviews in 2 separate qualitative studies; results of the literature review were published in poster form [23]. The objective of the first study was to understand what signs, symptoms, and impacts of TD were relevant from a patient and caregiver perspective, which informed the second study. The second study interviewed patients to determine if the TDIS was interpreted as intended and relevant to patients’ experiences. For both studies, adult patients (aged 18–85 years) were included if they were diagnosed with schizophrenia, schizoaffective disorder, or a mood disorder and with dopamine receptor-blocking agent-induced TD and were aware of abnormal movements (score ≥ 1 [aware, no distress through severe distress] on the AIMS item #10; see Instruments section in Methods for additional details). Additionally for the first study, patients had to have a score of 3 to 4 on the AIMS item #8, and caregivers were included if they were caring for a patient with TD for at least 6 months. For both studies, audio recordings of the interviews were transcribed verbatim, anonymized, and coded and analyzed using Atlas.ti. Patients (and caregivers in the first study) had to provide written informed consent before completing the interviews and were compensated for their time. The studies were approved by the Copernicus Group Independent Review Board.

Quantitative research

Data from 2 studies (KINECT3 and KINECT4) were used to examine the psychometric properties of the TDIS. KINECT3 was a phase 3, randomized, double-blind, placebo-controlled 52-week trial [21], and KINECT4 was a long-term, open-label 52-week study [24] assessing the safety and efficacy of a VMAT2 inhibitor for the treatment for TD. The main efficacy endpoint in both KINECT3 and KINECT4 was change in total AIMS score from baseline over the study period [21, 24]. The AIMS was scored at Week 6 in KINECT3 and at Week 8 in KINECT4 by 2 central AIMS video raters who were blinded to treatment and time point. Additional efficacy analyses included Patient’s Global Impression of Change (PGIC) and the Clinician’s Global Impression of the Patient’s Change Specific to TD (CGIC-TD). In KINECT3, eligible patients received the VMAT2 inhibitor dosed at 40 mg or 80 mg or placebo for 6 weeks and entered a 42-week extension period, followed by a 4-week washout period [21]. A total of 227 patients (mean age: 56.1 years; 54.2% male) with moderate to severe TD (baseline AIMS score: 10.0) were assessed; approximately 65% of patients had schizophrenia or schizoaffective disorder and 35% had a mood disorder. In KINECT4, patients received the VMAT2 inhibitor dosed at 40 mg or 80 mg (dose escalated at Week 4) for 48 weeks followed by a 4-week washout period [24]. A total of 163 patients (mean age: 57.4 years; 52.8% male) with moderate to severe TD (baseline AIMS score: 10.0) were assessed; 73% of patients had schizophrenia or schizoaffective disorder and 27.0% had a mood disorder. The same analyses were conducted using data from both trials for the purpose of validating results of initial analyses (i.e. showing that the results from both analyses were consistent). Analyses included assessing internal consistency and test–retest reliability, construct validity (factor structure), known-groups validity, and responsiveness to change.

Instruments

Several different measurements were used in this analysis to evaluate the concurrent validity of the TDIS measurement.

As previously mentioned, AIMS is a ClinRO that is used to evaluate the severity of abnormal or involuntary movements. AIMS contains 12 items, including 3 items (AIMS 8–10) that require global judgment [10]. AIMS items 1–7 assess the severity of abnormal movements in 7 body regions including facial muscles, lips, jaw, tongue, upper and lower extremities, and trunk. Each item is measured on a 5-point scale (0 = none to 4 = severe), with higher scores indicating greater severity.

AIMS item 8 (AIMS 8) assesses overall TD severity, AIMS item 9 (AIMS 9) assesses TD incapacitation, and AIMS item 10 (AIMS 10) assesses patient awareness of TD symptoms and the distress caused by symptoms. Higher scores on AIMS 8 and 9 indicate greater disease severity and incapacitation (0 = none to 4 = severe), and higher scores on AIMS 10 indicate greater disease awareness/distress (0 = no awareness to 4 = aware, severe distress). AIMS item 10 was used in the qualitative research portion of the study to confirm patient awareness of abnormal movement. The single-item PGIC is a PRO that measures the patient’s perception of change related to their condition [28]. The single-item CGIC-TD is a ClinRO that assesses global improvement due to treatment [10]. Both measurements use a rating scale ranging from 0 to 7 as the following: not assessed (0); very much improved (1); much improved (2); minimally improved (3); no change (4); minimally worse (5); much worse (6); very much worse (7). The PGIC and CGIC-TD were used to examine the extent to which patients who showed an improvement in their TDIS total scores also self-identified or were evaluated by the clinician as experiencing a global improvement in their TD symptoms.

Psychometric validation concepts

Internal consistency and test–retest reliability

Internal consistency and test–retest reliability were performed to evaluate how well the items appeared to measure common underlying content and the extent to which the measurement of TD effects was consistent over time. Internal consistency reliability (Cronbach’s alpha) was calculated for the 11 TDIS items for both trials to assess the degree to which the TDIS items captured common underlying content as a total TD impact score. In general, values of coefficient alpha ≥ 0.7 are preferred [25].

Test–retest reliability was calculated for the period between the screening and baseline visits (1–7 days) for both trials. This period was prior to administration of treatment and patients were not expected to experience change in their TD. Calculations of intraclass correlation coefficients were based on Shrout and Fleiss [26].

Construct validity

Confirmatory factor analysis (CFA) was performed to evaluate the construct validity of the TDIS by examining its factor structure and gain insights into the degree to which each item loaded on a single factor. The CFA was conducted on the TDIS items for KINECT3 and KINECT4 to assess the hypothetical factor structure that the TDIS is composed of 2 dimensions: 1 set of items that assesses the physical impacts of TD and 1 set that captures the socioemotional impacts of TD. Key goodness-of-fit statistics indicating the fit of the hypothesized model to the actual, observed data included the comparative fit index (values ≥ 0.95 are preferred), the root mean square error of approximation (values ≤ 0.08 are preferred), and the standardized root mean square residual (values < 0.06 are preferred) [27].

Longitudinal construct validity was assessed by correlating change from baseline TDIS with change from baseline AIMS and the CGIC-TD and the PGIC. This included examining to what extent the patterns of TDIS scores are logically based on the response anchors of the PGIC and the CGIC-TD.

Known-groups validity

A series of analyses were performed to evaluate the known-groups validity of the TDIS. Known-groups validity was assessed 3 ways: (1) correlating the AIMS and TDIS; (2) comparing mean TDIS total scores for each level of CGIC-TD and PGIC; and (3) assessing mean TDIS total scores for each level of severity of the patient’s most bothersome movement at baseline.

Mean TDIS total scores for each level of severity of the patient’s most bothersome movement at baseline were examined. Each person who completed the TDIS was also asked, “Thinking about all of your uncontrollable movements, which one bothers you the most (e.g. facial muscle movement, lip, or mouth movement, etc.)?” A follow-up question then asked how bothersome the movement is to them on a 11-point scale from 0 (not at all bothersome) to 10 (extremely bothersome).

Responsiveness to change

To understand the responsiveness to change in TDIS, the extent of the change in the TDIS score from baseline to later visits in each trial and whether the change followed a similar pattern to that of the clinician-assessed AIMS was evaluated. Change was assessed from baseline to Week 52, which included a drug-free washout period from Weeks 48 to 52 in both KINECT3 and KINECT4.

All analyses were conducted using SAS Version 9.4 (Cary, NC) or Mplus Version 8.4 (Los Angeles, CA).

Results

Qualitative research

Twenty-two patients with TD and 11 caregivers from 5 clinical sites in the United States were interviewed to elicit the main signs, symptoms, and impacts of TD (concept elicitation) and subsequently interviewed to assess distinct parts of the TDRS (cognitive debriefing) in the first study. Cardinal signs, symptoms, and impacts achieved saturation, indicating that a sufficient number of interviews were conducted to inform the construction of the PRO. The most common movements reported were in the tongue (60.6%) and jaw (57.6%), which were also reported as the most bothersome movements [22]. The most common impacts of TD were unwanted social attention (75.8%), difficulty speaking (63.6%), and social isolation (54.5%). Concepts endorsed in the TDRS by more than half of the participants included difficulty chewing and swallowing, dressing, handwriting, participating in hobbies, hygiene, dyskinesia pain, difficulty in public/social settings, speech, and walking and balance. The concepts reported and endorsed in the concept elicitation and cognitive debriefing portion of the interviews helped inform the development of the TDIS items (Table 1).

Table 1 TDIS domains, TDIS items, and mapping to TDRS items

In the second study, which focused on cognitive debriefing of the TDIS with 20 patients from 4 US-based clinical sites, most patients (n = 18, 90.0%) interpreted the instructions as intended and indicated that the instructions were clear. The word “dyskinesias” in the instructions was considered difficult by 7 of the participants and as a result was changed to “uncontrollable movements.” Most patients (70%) could recall their experiences within the stated time period (over the past 7 days). Some patients (35%) reported it was difficult to think about the “past 7 days”; 3 patients suggested using a shorter time period. However, as most patients understood the intended recall period, no change was made. Participants were also asked which TDIS concepts they considered most relevant to their experience with TD. The concepts most highly endorsed by patients were receiving unwanted attention (n = 15, 75.0%), difficulty speaking (n = 14, 70.0%), and feeling embarrassed (n = 14, 70.0%). The most common issue was ensuring patients would focus on the core concept in each item and therefore bolded text was used to indicate the main concept of interest in each item; the most consistently challenging concept was self-consciousness, which is difficult to interpret across all populations. Because the concept of self-consciousness was considered highly relevant based on feedback from the concept elicitation of the TDRS, no changes were made to the question besides bolding the key concept. Based on the patient feedback, minor changes were made to the TDIS questions, including bolding the key concept in each question (Fig. 1), adding typing to item 5 (writing), including instructions for item 6 (walking), and generalizing pain (item 8) so it was not specific to legs or lower body.

Fig. 1
figure 1

Sample of TDIS questionnaire. TDIS Tardive Dyskinesia Impact Scale

The final TDIS is an 11-item questionnaire developed to understand how TD affects current daily functioning over the previous 7 days. Each question is scored on a 5-point Likert scale, ranging from 0 (no impact) to 4 (most impact). TDIS total score can range from 0 to 44, with higher scores representing greater TD impact. A sample of the TDIS questionnaire is shown in Fig. 1.

Quantitative research

Internal consistency and test–retest reliability

The alpha reliabilities were 0.88 for KINECT3 and 0.90 for KINECT4, indicating that these 11 items reliably measure common underlying content. In addition, none of the items were found to be problematic and thus did not need to be deleted to improve the overall alpha. The alpha-if-deleted ranged from 0.87 to 0.88 for KINECT3 and 0.89 to 0.90 for KINECT4. The intraclass correlation coefficients for both trials was 0.83, reflecting good test–retest reliability.

Construct validity: confirmatory factor analysis

The CFA was nearly identical for KINECT3 and KINECT4. While there appeared to be good support for a 2-factor solution to the underlying content of the TDIS, there was also evidence of a second-order factor (Fig. 2). The large correlation between the physical and the socioemotional factors in both trials suggested that one possible explanation accounting for this strong correlation was that the variability in each of the 2 factors was the result of another, higher-order factor. The goodness-of-fit results for KINECT3 were as follows: comparative fit index, 0.93; root mean square error of approximation, 0.084 (90% CI 0.07–0.10); and standardized root mean square residual, 0.069, which were similar for KINECT4. We obtained factor loadings for the paths between the second-order factor and the physical and socioemotional factors. For KINECT3, those loadings were 0.88 to physical and 0.72 to socioemotional. For KINECT4, the respective loadings were 0.82 and 0.91. This second-order factor would represent the total TD impact experienced by the patient.

Fig. 2
figure 2

KINECT3 CFA of the 11-Item TDIS. CFA Confirmatory factor analysis, TDIS Tardive Dyskinesia Impact Scale

The change from baseline in the AIMS and the TDIS showed weak correlations in KINECT3 but more mixed strengths of correlations in KINECT4 (Table 2). In KINECT3, the change from baseline in the AIMS was more strongly correlated with the CGIC-TD, while the change from baseline in the TDIS was more strongly correlated with the PGIC. In KINECT4, the change from baseline in the AIMS was more strongly associated with the CGIC-TD vs PGIC (0.65 vs 0.37), while change from baseline in the TDIS had a slightly stronger correlation with the CGIC-TD compared with that of the PGIC (0.34 vs 0.30). This may be due to differences in study designs of the trials (as KINECT3 was a randomized, double-blinded, placebo-controlled trial and KINECT4 was an open-label trial) and the time difference between the primary endpoint in each trial (KINECT3 was 6 weeks and KINECT4 was 8 weeks).

Table 2 Correlations between change in AIMS and TDIS to CGIC-TD and PGIC in KINECT3 and KINECT4

Known-groups validity

The correlation between AIMS and TDIS in KINECT3 at baseline was 0.26 and 0.28 at week 6 (end of the double-blind, placebo-controlled period). For KINECT4, the correlation between AIMS and TDIS at baseline was 0.31 and 0.21 at Week 8, which roughly corresponded to the end of the double-blind period in KINECT3 [29]. The correlations between the AIMS and the TDIS were weak in both trials, indicating that there is little overlap in content between the 2 measures.

Mean TDIS total scores were compared with each level of PGIC and CGIC-TD and change from baseline in TDIS total scores for each level of PGIC (Table 3). There was a significant difference in TDIS total score by PGIC score overall (P = 0.002); however, there was only a significant difference between PGIC score of 1 compared with scores 2–5 when TDIS scores were compared across individual PGIC scores. The results from KINECT3 and KINECT4 generally showed that for patients with an impression of improvement in their condition (PGIC score 1–3), their TDIS total scores were lower (i.e. less TD impact) than those who rated the change in their condition as worse. A similar pattern existed when examining change from baseline in TDIS total scores; those who rated their condition as improved had greater improvements in their TDIS total scores. Results were similar, although not as defined, when examining mean TDIS total scores and change from baseline in TDIS total scores relative to the CGIC-TD.

Table 3 Breakdown of mean TDIS total score by each PGIC score: End of double-blind KINECT3

Mean TDIS total scores were compared with each level of severity of the patient’s most bothersome movement at baseline. These results show that as a movement became more bothersome, TD impact worsened (i.e. greater TD impact). The baseline correlation between TDIS total score and how bothersome their most bothersome movement was 0.56 for KINECT3 and 0.57 for KINECT4.

Responsiveness to change

Mean TDIS total scores were plotted for the main patient visits from baseline to Week 52 for KINECT3 (Fig. 3) and KINECT4 (Fig. 4). On average, baseline TDIS total scores were only about one-third (16–17 points) of the maximum score possible (44 points) for both trials, indicating that at baseline, TD has a moderate impact on patients. By Week 48, mean scores were 6 to 7 points, showing that TD impact had improved to have little impact, on average. During the washout period in both trials, TDIS scores worsened, showing that the TDIS is responsive to change in treatment.

Fig. 3
figure 3

KINECT3 mean TDIS total score through Week 52. N = 233 at baseline to 129 at Week 52. TDIS Tardive Dyskinesia Impact Scale

Fig. 4
figure 4

KINECT4 mean TDIS total score through Week 52. N = 167 at baseline to 103 at Week 52. TDIS Tardive Dyskinesia Impact Scale

Discussion

Results from qualitative and quantitative research indicated that the TDIS is a valid and reliable measure of the impact of TD on patients. The TDIS evolved from the TDRS, which was an adaptation of the UDysRS and the AIMS. Thus, the TDIS has a good pedigree for capturing the severity of effects of TD from a patient’s perspective. Patient and caregiver interviews confirmed that the TDIS appropriately captured key patient experiences of the physical and socioemotional impacts of TD. In addition, most patients interpreted TDIS items as intended, and more than half of participants reported experiencing the concept measured in most items (e.g., speech, walking, leg pain; see Table 1 for all TDIS items).

Using data from KINECT3 and KINECT4 trials, results of numerous psychometric analyses, CFA, known-groups validity, internal consistency, test–retest reliability, and responsiveness to change consistently reflected robust psychometric qualities of the TDIS. Results of the CFA showed support for a 2-factor solution of the 11-item TDIS, with 1 factor capturing the physical impacts of TD and 1 factor representing the socioemotional effects of TD. In addition, there was empirical support for a second-order factor representing the overall TD impact experienced by patients. The results of the CFA suggested that researchers could examine patient responses on the TDIS either as a total score (based on the second-order factor) or on the individual first-order factors. This characteristic of the TDIS enables an assessment of the influence of different variables on the physical or socioemotional components of a patient’s TD experience or the consequences of these 2 components of the TDIS on other outcomes, such as depression. A separate manuscript is currently under way to better understand these results.

The correlations between the AIMS and the TDIS were weak in both trials, indicating that there is little overlap in content between the 2 measures. These 2 instruments are designed to measure different aspects of TD. The AIMS is designed to allow the clinician to assess the severity of signs of TD, while the TDIS is designed to allow the patient to report the difficulty and frequency of impacts of TD. The recently developed ClinRO instrument, the IMPACT-TD, was similarly designed to assist clinicians in measuring the functional impact of TD [5]. However, it was developed by a panel of clinicians and did not include patients or caregivers as part of the development process. As noted in the patient-focused drug development guidance 3, patient experience data should provide information about a patient’s experience with the disease, including the physical and psychosocial impact [8]. Additionally, the guidance suggests the status of a patient’s disease or health condition should come directly from the patient without influence from others, including clinicians [8]. In this manner, the TDIS can help fill a gap in understanding of TD from the patient perspective, as there is no other validated specific measure available to understand how TD affects patients’ physical and socioemotional quality of life.

The TDIS showed change over 48 weeks of treatment and 4 weeks of washout in the 2 trials, indicating that it is responsive to change. It is important to note the consistency of this change across 2 differently designed trials. Moreover, as time-on-treatment continued, TD impact decreased from the patient’s perspective, suggesting that the TDIS could be useful as a monitoring tool to evaluate changes in the patient’s TD impact resulting from treatment.

Some limitations exist for these analyses. First, no clinically important change value or responder definition was calculated since this current study was focused on the main measurement properties of the TDIS. The values associated with meaningful change or a responder definition are planned for a separate publication. Second, the current study does not evaluate the TDIS as an efficacy measure, and the clinical trials were not designed or powered to detect treatments effects on the TDIS. Results from the exploratory analysis of KINECT3 showed improvement in the TDIS from baseline to Weeks 2 and 4, but the changes were comparable for all 3 arms (i.e. 40 mg and 80 mg of VMAT2 inhibitor and placebo). Further examination of this is warranted. Lastly, TD is a heterogenous condition, and not all concepts included in the TDIS may be applicable for all patients and not all impacts reported by patients are included in the TDIS. The TDIS provides a starting point for understanding the impact of TD on the patient’s everyday life, which can be used along with clinician assessment and discussion of symptoms between the patient, clinician, and caregiver.

Conclusion

Scores from the AIMS represent a clinician’s assessment of the severity (frequency and amplitude) of observed abnormal or uncontrolled movements and provide little information from the patient’s perspective about the impacts of those uncontrolled movements in daily functioning. The results presented from these analyses indicate that the AIMS and the TDIS appear to capture different content and are differentially related to patient and clinician assessments of improvement in TD. The TDIS, as a PRO when implemented in practice, should complement the AIMS, as the measures together can provide a comprehensive picture of TD severity, signs, and impacts on TD patients.

The results from these analyses may be helpful in designing future studies by evaluating a patient’s perspective on the impact of TD and observing how the TDIS relates to the PGIC, the CGIC-TD, AIMS total score, and other PROs. The TDIS can be easily administered in a clinician’s office or at a patient’s home to provide insight about TD impact and whether the impact is lessening or increasing. Used together with ClinROs (e.g. AIMS, IMPACT-TD) and other PROs (e.g. quality of life measures), the TDIS could help clinicians gain important insights into patients’ daily experiences with TD and provide a more holistic assessment of this disorder.

Availability of data and materials

The datasets analyzed during the current study are not publicly available due to patient confidentiality.

Abbreviations

ΔAIMS:

Change from baseline to end of double-blind period in AIMS

ΔTDIS:

Change from baseline to end of double-blind period in TDIS

AIMS:

Abnormal Involuntary Movement Scale

CFA:

Confirmatory factor analysis

CGIC-TD:

Clinician’s Global Impression of the Patient’s Change Specific to Tardive Dyskinesia

ClinRO:

Clinician-reported outcome

FDA:

Food and Drug Administration

PGIC:

Patient Global Impression of Change

PRO:

Patient-reported outcome

TD:

Tardive dyskinesia

TDIS:

Tardive Dyskinesia Impact Scale

TDRS:

Tardive Dyskinesia Rating Scale

UDysRS:

Unified Dyskinesia Rating Scale

References

  1. Caroff SN (2019) Overcoming barriers to effective management of tardive dyskinesia. Neuropsychiatr Dis Treat 15:785–794. https://doi.org/10.2147/ndt.S196541

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  2. Kane JM, Correll CU, Nierenberg AA, Caroff SN, Sajatovic M (2018) Revisiting the abnormal involuntary movement scale: proceedings from the tardive dyskinesia assessment workshop. J Clin Psychiatry. https://doi.org/10.4088/JCP.17cs11959

    Article  PubMed  Google Scholar 

  3. Jackson R, Brams MN, Citrome L et al (2021) Assessment of the impact of tardive dyskinesia in clinical practice: consensus panel recommendations. Neuropsychiatr Dis Treat 17:1589–1597. https://doi.org/10.2147/ndt.S310605

    Article  PubMed  PubMed Central  Google Scholar 

  4. Stacy MD, Sajatovic M, Kane JM et al (2019) Abnormal involuntary movement scale in tardive dyskinesia: minimal clinically important difference. Mov Disord 34(8):1203–1209. https://doi.org/10.1002/mds.27769

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  5. Jackson R, Brams MN, Carlozzi NE et al (2022) Impact-tardive dyskinesia (impact-TD) scale: a clinical tool to assess the impact of tardive dyskinesia. J Clin Psychiatry. https://doi.org/10.4088/JCP.22cs14563

    Article  PubMed  Google Scholar 

  6. Food and drug administration (FDA) (2009)Guidance for industry. Patient-reported outcome measures: use in medical product development to support labeling claims. Secondary guidance for industry. Patient-reported outcome measures: use in medical product development to support labeling claims. https://www.fda.gov/media/77832/download

  7. Food and drug administration (FDA) (2022a) Patient-focused drug development: methods to identify what is important to patients guidance for industry, food and drug administration staff, and other stakeholders. Secondary patient-focused drug development: methods to identify what is important to patients guidance for industry, food and drug administration staff, and other stakeholders. https://www.fda.gov/media/131230/download

  8. Food and drug administration (FDA) (2022b) Patient-focused drug development: selecting, developing, or 1 modifying fit-for-purpose clinical outcome assessments. Guidance for industry, food and drug administration staff, and other stakeholders. Secondary patient-focused drug development: selecting, developing, or 1 modifying fit-for-purpose clinical outcome assessments. guidance for industry, food and drug administration staff, and other stakeholders. https://www.fda.gov/media/159500/download

  9. Goetz CG, Nutt JG, Stebbins GT (2008) The unified dyskinesia rating scale: presentation and clinimetric profile. Mov Disord 23(16):2398–2403. https://doi.org/10.1002/mds.22341

    Article  PubMed  Google Scholar 

  10. Guy W (1976) ECDEU assessment manual for psychopharmacology. In: national institute of mental health. Psychopharmacology research branch. division of extramural research P, ed. DHEW publication ; no. (ADM) 76–338. Rockville, Md: U.S. Dept. of health, education, and welfare, public health service, alcohol, drug abuse, and mental health administration, national institute of mental health, psychopharmacology research branch, division of extramural research programs, pp. 534–37.

  11. Goetz CG, Stebbins GT, Theeuwes A et al (2011) Temporal stability of the unified dyskinesia rating scale. Mov Disord 26(14):2556–2559. https://doi.org/10.1002/mds.23931

    Article  PubMed  Google Scholar 

  12. Guy W, Ban TA, Wilson WH (1985) An international survey of tardive dyskinesia. Prog Neuropsychopharmacol Biol Psychiatry 9(4):401–405. https://doi.org/10.1016/0278-5846(85)90193-9

    Article  CAS  PubMed  Google Scholar 

  13. Luo S, Liu Y, Teresi JA, Stebbins GT, Goetz CG (2017) Differential item functioning in the unified dyskinesia rating scale (UDysRS). Mov Disord 32(8):1244–1249. https://doi.org/10.1002/mds.27058

    Article  PubMed  PubMed Central  Google Scholar 

  14. Luo S, Ren X, Han W, Goetz CG, Stebbins GT (2018) Missing data in the unified dysksinesia rating scale (UDysRS). Mov Disord Clin Pract 5(5):523–526. https://doi.org/10.1002/mdc3.12642

    Article  PubMed  PubMed Central  Google Scholar 

  15. Tonelli H, Tonelli D, Poiani GR, Vital MA, Andreatini R (2003) Reliability and clinical utility of a Portuguese version of the abnormal involuntary movements scale (AIMS) for tardive dyskinesia in Brazilian patients. Braz J Med Biol Res 36(4):511–514. https://doi.org/10.1590/s0100-879x2003000400014

    Article  CAS  PubMed  Google Scholar 

  16. Rascol O, Tönges L, deVries T, Jaros M, Quartel A, Jacobs D (2022) Immediate-release/extended-release amantadine (OS320) to treat Parkinson’s disease with levodopa-induced dyskinesia: analysis of the randomized, controlled ALLAY-LID studies. Parkinsonism Relat Disord 96:65–73. https://doi.org/10.1016/j.parkreldis.2022.01.022

    Article  CAS  PubMed  Google Scholar 

  17. Corvol JC, Durif F, Meissner WG et al (2019) Naftazone in advanced Parkinson’s disease: an acute L-DOPA challenge randomized controlled trial. Parkinsonism Relat Disord 60:51–56. https://doi.org/10.1016/j.parkreldis.2018.10.005

    Article  PubMed  Google Scholar 

  18. Freire-Alvarez E, Kurča E, Lopez Manzanares L et al (2021) Levodopa-carbidopa intestinal gel reduces dyskinesia in Parkinson’s disease in a randomized trial. Mov Disord 36(11):2615–2623. https://doi.org/10.1002/mds.28703

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  19. Anderson KE, Stamler D, Davis MD et al (2017) Deutetrabenazine for treatment of involuntary movements in patients with tardive dyskinesia (AIM-TD): a double-blind, randomised, placebo-controlled, phase 3 trial. Lancet Psychiatry 4(8):595–604. https://doi.org/10.1016/s2215-0366(17)30236-5

    Article  PubMed  Google Scholar 

  20. Correll CU, Josiassen RC, Liang GS, Burke J, O’Brien CF (2017) Efficacy of valbenazine (NBI-98854) in treating subjects with tardive dyskinesia and mood disorder. Psychopharmacol Bull 47(3):53–60

    PubMed  PubMed Central  Google Scholar 

  21. Hauser RA, Factor SA, Marder SR et al (2017) KINECT 3: a phase 3 randomized, double-blind, placebo-controlled trial of valbenazine for tardive dyskinesia. Am J Psychiatry 174(5):476–484. https://doi.org/10.1176/appi.ajp.2017.16091037

    Article  PubMed  Google Scholar 

  22. Farber R SD, Gauthier M, Witherspoon B, O’Brien CF, Evans C. Tardive dyskinesia: patient and caregiver perspectives on signs, symptoms, and impact. Poster presented at: Psych Congress. New Orleans, LA.

  23. Stull DE BM, Bean S, Williams B, Farber RH, Franey E, Yonan C, Dhanda R. Impacts of tardive dyskinesia (TD) symptoms on patients: analysis of a TD-Specific patient-reported outcome. Poster presented at: 25th Annual International congress of Parkinson’s disease and movement disorders. Virtual.

  24. Marder SR, Singer C, Lindenmayer JP et al (2019) A phase 3, 1-Year, open-label trial of valbenazine in adults with tardive dyskinesia. J Clin Psychopharmacol 39(6):620–627. https://doi.org/10.1097/jcp.0000000000001111

    Article  CAS  PubMed  Google Scholar 

  25. Taber KS (2018) The use of Cronbach’s alpha when developing and reporting research instruments in science education. Res Sci Educ 48:1273–1296

    Article  Google Scholar 

  26. Shrout PE, Fleiss JL (1979) Intraclass correlations: uses in assessing rater reliability. Psychol Bull 86(2):420–428. https://doi.org/10.1037//0033-2909.86.2.420

    Article  CAS  PubMed  Google Scholar 

  27. Kline RB (2023) Principles and practice of structural equation modeling. Guildford Press, Guildford, pp 156–180

    Google Scholar 

  28. Hurst H, Bolton J (2004) Assessing the clinical significance of change scores recorded on subjective outcome measures. J Manipulative Physiol Ther 27(1):26–35. https://doi.org/10.1016/j.jmpt.2003.11.003

    Article  PubMed  Google Scholar 

  29. Perez-Rodriguez MM, Stull DE, Dhanda R, Bron M, Dunayevich E, Correll CU. Trajectories of tardive dyskinesia impact scale (TDIS) and abnormal involuntary movement scale (AIMS) over time with valbenazine treatment. Poster presented at: International congress of Parkinson’s disease and movement disorders. Copenhagen, Denmark.

Download references

Acknowledgements

The authors would like to thank the patients and their caregivers for participation in these studies. The authors would like to acknowledge Susan D. Mathias of Health Outcomes Solutions for her thoughtful and thorough review. We would also like to acknowledge Andi Gundlach, PharmD, MPH, CMPP, Bridgette Schroader, PharmD, MPA, BCOP, and Kylie Matthews, MS, of Xcenda LLC, supported by Neurocrine Biosciences Inc., for their aid in medical writing and editing and strategic support.

Funding

Neurocrine Biosciences Inc. provided funding for this study and development of the manuscript.

Author information

Authors and Affiliations

Authors

Contributions

RHF, CY, MB, EJ, and COB participated in the study’s conception and design. CJE and BW participated in analysis of qualitative data, interpretation, and reporting. DES and RD participated in analysis of quantitative data, interpretation, and reporting. All authors contributed to drafting and critically revising the manuscript. All authors are accountable for the work and provided their agreement for submission to the journal and approval for publication.

Corresponding author

Correspondence to Morgan Bron.

Ethics declarations

Ethics approval and consent to participate

All participants gave written informed consent to participate in the study, which was approved by the Copernicus Group Independent Review Board.

Consent for publication

As part of the study participation consent, participants gave written consent for their anonymized data to be published.

Competing interests

CJE, BW, and COB received consulting fees from Neurocrine for this study. DES is an employee of IQVIA, which provides consulting and other research services to pharmaceutical, device, government, and nongovernment organizations. In his salaried position, he works with a variety of companies and organizations. He receives no payment or honoraria directly from these organizations for services rendered. RHF, MB, and EJ are employees of Neurocrine Biosciences. CY and RD are former employees of Neurocrine Biosciences.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

*CY, RD, and COB were employees of Neurocrine Biosciences at the time of the analysis. CY is now an employee of Reneo Pharmaceuticals. RD is an employee of UT Health San Antonio.

Rights and permissions

Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Farber, R.H., Stull, D.E., Witherspoon, B. et al. The Tardive Dyskinesia Impact Scale (TDIS), a novel patient-reported outcome measure in tardive dyskinesia: development and psychometric validation. J Patient Rep Outcomes 8, 2 (2024). https://doi.org/10.1186/s41687-023-00679-4

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1186/s41687-023-00679-4

Keywords