Skip to main content
Journal of Patient-Reported Outcomes
Download PDF

Measurement properties of brief neuropathy screening items in cancer patients receiving taxanes, platinums, or proteasome inhibitors

Journal of Patient-Reported Outcomes volume 5, Article number: 101 (2021) Cite this article

Abstract

Background

Timely detection of chemotherapy-induced peripheral neuropathy (CIPN) is critical to effectively tailor chemotherapy dose levels and offer supportive care. The purpose of this secondary analysis was to determine the reliability and validity of the two Patient-Reported Outcomes Version of the Common Terminology Criteria for Adverse Events (PRO-CTCAE™) numbness and tingling severity and interference items to screen for CIPN in patients receiving taxanes, platinums, or proteasome inhibitors.

Methods

Participants (N = 142) completed the two PRO-CTCAE items, a 0–10 numerical rating scale of worst CIPN pain intensity, and the Quality of Life Questionnaire–CIPN20 (QLQ-CIPN20) prior to three clinical visits (T1, T2, T3) during neurotoxic chemotherapy. Participants completed the two PRO-CTCAE items again following the T3 clinical visit (T4). In addition, study staff administered the modified Total Neuropathy Score–Clinical Version (TNSc©) at T3. We examined floor (i.e., no CIPN severity or interference) and ceiling effects, test–retest reliability, concurrent validity, longitudinal validity, construct validity of the response categories, and sensitivity and specificity of the two PRO-CTCAE items.

Results

At T3, 29% of participants had PRO-CTCAE severity scores at the floor; 60.1% of participants reported interference item scores at the floor. Agreements between scores reported at T3 and T4 for PRO-CTCAE severity (ICC = 0.79) and interference (ICC = 0.73) were moderate to strong. The PRO-CTCAE severity and interference items correlated moderately-strongly with QLQ-CIPN20 sensory (Spearman’s ρ-range = 0.53–0.72) and motor (Spearman’s ρ-range = 0.50–0.58) subscale scores. The Cohen’s d from T1 to T3 for the PRO-CTCAE items were small (severity: d = 0.32, interference: d = 0.40) and comparable to the effect sizes for change observed with the QLQ-CIPN20. The PRO-CTCAE severity (0–3) and interference (0–2) response categories distinguished respondents with significantly different levels of QLQ-CIPN20 sensory and motor subscale scores (p < 0.001 via Jonckheere-Terpstra tests). The sensitivity and specificity of the PRO-CTCAE severity item (cutoff > 0) to detect probable sensory peripheral neuropathy were 95.83% and 65.22%, while the sensitivity and specificity of the PRO-CTCAE™ interference item (cutoff > 0) were 51.39% and 73.91%.

Conclusion

Preliminary evidence supports the reliability and validity of the PRO-CTCAE numbness and tingling items for CIPN screening, although there may be floor effects and limitations in the capacity of the PRO-CTCAE items to identify the full range of CIPN sensory and motor features beyond numbness and tingling.

Trial Registration ClinicalTrials.Gov, NCT03514680. Registered 21 April 2018. https://clinicaltrials.gov/ct2/show/NCT03514680

Introduction

Chemotherapy induced peripheral neuropathy (CIPN) is a dose-dependent side effect of taxanes, platinums, and proteasome inhibitors that may necessitate the reduction or withdrawal of chemotherapy [1, 2] due to sensory (e.g., numbness, tingling, or pain in a stocking-glove pattern) or motor symptoms (e.g., weakness or cramps in the extremities) [3]. Sensory or motor CIPN symptoms may interfere with activities of daily living (e.g., walking, driving, typing on a computer) [4, 5] and increase risk of falls [6]. Post-treatment, CIPN symptoms may linger for months to years after and in some cases become permanent. Currently, there is only one recommended treatment for the symptomatic management of established CIPN symptoms (i.e., duloxetine) and no recommended prevention modalities [7].

Due to the lack of recommended treatments, precise and timely detection of CIPN is critical during neurotoxic cancer therapy treatment to effectively tailor therapy dosages. CIPN is most commonly measured in practice and research [8] using clinician-rated grading scales such as the National Cancer Institute Common Terminology Criteria for Adverse Events (CTCAE, now in version 5.0) [9]. However, clinician grading of CIPN using the CTCAE has demonstrated floor effects [10, 11] and low concurrent validity with CIPN experiences captured using patient-reported outcome measures [10]. Further, while there are a plethora of CIPN measures available, burdensome administration procedures (e.g., long survey measures; skill and time required by clinicians to complete objective tests) often complicate their use in practice [8, 12,13,14]. The difficulties of consistent implementation of CIPN evaluation in practice is highlighted by evidence suggesting that CIPN assessments are documented by clinicians in only 46% to 58.3% of their clinical encounters with patients receiving neurotoxic chemotherapy [12, 15].

To address the limitations that may be associated with clinician-rated or lengthy self-report measures of CIPN, brief (≤ 3 items) CIPN instruments with strong measurement properties are needed to improve the identification of CIPN in clinical practice [8]. The Patient-Reported Outcomes version of the Common Terminology Criteria for Adverse Events (PRO-CTCAE™) [16] numbness and tingling severity item and PRO-CTCAE numbness and tingling interference item are promising CIPN screening tools. The psychometric properties of the PRO-CTCAE library (78 symptoms) has been extensively evaluated in patients with cancer undergoing chemotherapy and/or radiation [17,18,19]. In addition, several studies support the concurrent validity of the PRO-CTCAE numbness and tingling items with PRO measures that include the European Organisation for Research and Treatment of Cancer Quality of Life Questionnaire-CIPN20 (QLQ-CIPN20) [11, 20] (e.g., r ≥ 0.55 for all comparisons between PRO-CTCAE numbness and tingling items and the QLQ-CIPN20 sensory and motor subscales) [11]; the Functional Assessment of Cancer Therapy/Gynecologic Oncology Group-Neurotoxicity questionnaire (FACT/GOG-Ntx) (Spearman’s ρ = 0.75; severity item only) [21]; and with clinician-rated measures such as the Total Neuropathy Score©-Reduced (Spearman’s ρ = 0.56; severity item only) [21]. Moreover, the PRO-CTCAE numbness and tingling items have demonstrated the capacity to detect CIPN-related interference earlier in chemotherapy treatment than the CTCAE [20]. The PRO-CTCAE numbness and tingling severity item has also been shown to discriminate patients with mild/no neuropathy and moderate-severe (Grade 2/3) neuropathy [21].

While the PRO-CTCAE numbness and tingling items show promising measurement properties [17,18,19], to our knowledge, the test–retest reliability and longitudinal validity of the severity and interference items have had limited testing in individuals receiving neurotoxic cancer therapy. Further, psychometric testing of the interference item has been limited to concurrent validity with the QLQ-CIPN20 or CTCAE in patients receiving taxanes or platinums [11, 20]. The purpose of this analysis was to determine the reliability and validity of the PRO-CTCAE numbness and tingling items as screening measures of CIPN in practice. Specifically, we estimated the floor and ceiling effects, test–retest reliability, concurrent validity, longitudinal validity, construct validity of the response categories, and sensitivity and specificity of the PRO-CTCAE numbness and tingling severity and interference items in cancer patients receiving taxanes, platinums, or proteasome inhibitors.

Materials and methods

Design, sample, and setting

The data for this secondary analysis were derived from a two-phase, longitudinal trial designed to explore the impact of a clinician decision support algorithm on clinicians’ documentation of CIPN assessment and management [22]. The sample consisted of 142 English speaking patients with breast or gastrointestinal cancer, or multiple myeloma who had received ≥ one infusion of neurotoxic therapy (e.g., taxanes, platinums, or proteasome inhibitors) at the time of consent and were scheduled to receive ≥ three more cycles of neurotoxic therapy. Patients were excluded if they had pre-existing neuropathy unrelated to cancer therapy. All participants were recruited from a National Cancer Institute-Designated Cancer Center. Approximately half of the sample (n = 70) participated in the usual care phase and the other half of the sample participated in the algorithm phase (n = 72). Clinicians received a CIPN assessment and management algorithm prior to each clinical visit for all participants during the algorithm phase. The following describes the measures, procedures, and statistical analyses pertinent to this secondary analysis of the measurement properties of the two PRO-CTCAE numbness and tingling severity and interference items.

Measures

PRO-CTCAE Numbness and Tingling Severity and Interference Items The PRO-CTCAE Measurement System is comprised of an item library with 124 PRO items that evaluate the presence, frequency, severity, or interference of 78 cancer treatment-related symptomatic adverse events [16]. The two PRO-CTCAE items that pertain to CIPN evaluate the severity at its worst and the associated interference of numbness and tingling in the hands and feet over the past seven days. PRO-CTCAE numbness and tingling item responses are scored from 0 to 4 with higher scores reflecting greater severity and interference, respectively [17,18,19].

5-Item Total Neuropathy Score – Clinical (TNSc©) The 5-item TNSc© [23,24,25] is a measure that includes patient self-report of sensory (i.e., numbness, tingling, and pain [burning, aching, stabbing]) and motor (e.g., difficulty buttoning or climbing steps) neuropathy symptom severity and/or location questions. Both of these questions overlap with the numbness and tingling severity and interference items of the PRO-CTCAE, respectively. These self-reports are integrated with examiner-administered tests of vibration sensibility, strength, and deep tendon reflexes. Items are scored from 0 to 4 with total scores ranging from 0 to 20 (higher scores reflect more severe neuropathy). Several studies support the reliability and validity of the TNSc© to capture peripheral neuropathy in adults undergoing neurotoxic cancer treatment [26,27,28].

0–10 Numerical Rating Scale (NRS) of Worst CIPN Pain Intensity Worst CIPN pain intensity over the past seven days was quantified using a 0–10 NRS [29, 30]. Higher scores on the NRS represent more severe CIPN pain intensity.

European Organization of Research and Treatment of Cancer QLQ-CIPN20 Sensory and Motor Subscales The QLQ-CIPN20 sensory subscale consists of nine self-report items that measure on a four-point scale the severity of neuropathic symptoms in the hands or feet over the past seven days, while the motor subscale consists of eight-items that measure on a four-point scale CIPN-related functional deficits over the past seven days. Each subscale is summed and linearly transformed to a score that can range from 0 to 100, where higher scores represent greater CIPN symptom severity [31]. The QLQ-CIPN20 sensory subscale contains four questions (i.e., numbness or tingling in the hands and/or feet, respectively) that are similar in nature to the one-item PRO-CTCAE numbness and tingling severity item. The QLQ-CIPN20 motor subscale contains five questions that are similar in nature (e.g., ask about specific functional limitations associated with CIPN such as walking, holding a pen, opening jars) to the one-item PRO-CTCAE numbness and tingling interference item. Evidence supports the internal consistency reliability (e.g., Cronbach’s alpha: 0.88 for sensory and motor subscales, respectively), concurrent validity, and responsiveness to change of the QLQ-CIPN20 sensory and motor subscales [10, 32]. In this study, the three-item autonomic symptom subscale was not administered due to its low item-item correlations with the rest of the QLQ-CIPN20 [10].

Procedures

Participants completed the PRO-CTCAE numbness and tingling items, 0–10 NRS of worst CIPN pain intensity, and QLQ-CIPN20 using an iPad at the cancer center before each of three consecutive clinical visits (i.e., T1, T2, T3) during neurotoxic therapy or up to approximately one month after neurotoxic cancer therapy completion. In addition, a trained member of the study staff administered the TNSc© at T3. Four study staff members, including the principal investigator (RK) administered the TNSc©. On the same day as the T3 visit, the PRO-CTCAE numbness and tingling items were administered again (T4) to evaluate test–retest reliability. The T4 surveys were administered after the provider visit while the participants were in the waiting room prior to receiving chemotherapy or when the participants were actively receiving chemotherapy. At the conclusion of study-related procedures, study staff abstracted cancer treatment-related information from participants’ medical records.

Statistical analyses

Data from participants in both study phases were pooled for this psychometric analysis. Due to the dose-dependent nature of CIPN, unless otherwise specified, all analyses were evaluated using data from T3, the time point when participants were anticipated to have received the greatest cumulative dosage of neurotoxic therapy. Descriptive statistics were calculated, and distributions were inspected for proportions at floor and ceiling. Floor and ceiling effects were calculated by frequencies and proportions of respondents reporting the lowest or highest possible scores.

Test–retest reliability of PRO-CTCAE numbness and tingling items between T3 and T4 was calculated in a subset of participants using the intraclass correlation coefficient (ICC) based on a two-way mixed effects analysis of variance model with interaction for the absolute agreement between single scores [33]. Values less than 0.50, between 0.50 and 0.75, between 0.75 and 0.90, and greater than 0.90 were interpreted as poor, moderate, good, and excellent reliability, respectively [34]. Longitudinal validity refers to how sensitive a measure is in detecting the real underlying change in symptom severity over time [35]. To evaluate longitudinal validity, a Cohen’s d effect size was calculated reflecting changes from T1 to T3 in PRO-CTAE numbness and tingling items, 0–10 NRS of worst CIPN pain intensity, and QLQ-CIPN20 sensory and motor subscale scores.

Concurrent validity between the PRO-CTCAE numbness and tingling items, and the QLQ-CIPN20 sensory and motor subscales, the 0–10 NRS of worst CIPN pain intensity, and the TNSc© was assessed using Spearman’s correlation.

Construct validity of the PRO-CTCAE numbness and tingling item response categories was evaluated with a one-sided Jonckheere-Terpstra Test [36] for ordered differences. The purpose of this analysis was to determine if there was monotonic ordering of scores on the QLQ-CIPN20 sensory and motor subscale, 0–10 NRS of worst CIPN pain intensity, or TNSc© across the item response categories for the PRO-CTCAE severity (0, 1, 2, and ≥ 3, respectively) and interference (0, 1, and ≥ 2, respectively) items. PRO-CTCAE severity item scores ≥ 3 and PRO-CTCAE interference item scores ≥ 2 were collapsed as few individuals had scores at or near the top of the scoring range (0–4).

Sensitivity refers to a screening measure’s ability to accurately identify a patient with the disease, while specificity refers to a screening measure’s ability to accurately identify a participant without the disease (higher values of both metrics are desirable) [37]. The sensitivity and specificity of the PRO-CTCAE numbness and tingling items were evaluated at cutoff levels of zero for each item in comparison to the reference definition of “probable sensory peripheral neuropathy” that is used for diabetic peripheral neuropathy [38]. The definition of probable sensory peripheral neuropathy requires participants to have two of the following signs or symptoms: neuropathic symptoms (e.g., numbness, tingling, or pain), decreased distal sensation, and/or decreased ankle reflexes [38]. Thus, participants with TNSc© Sensory scores ≥ 1 and either TNSc© Sensory Function: Vibration Sensibility scores ≥ 1 or TNSc© Reflexes scores ≥ 1 were classified as exhibiting probable sensory peripheral neuropathy. The PRO-CTCAE numbness and tingling items also were evaluated for their sensitivity and specificity to detect painful CIPN at cutoff levels of zero for each item. For the reference measure, 0–10 NRS of worst CIPN pain intensity scores ≥ 4/10 were interpreted as indicating the presence of painful CIPN, while scores < 4/10 indicated the absence of painful CIPN [39]. All analyses were conducted with R Statistical Software and evaluated at a significance level of 0.05.

Results

Sample characteristics

Data from 142 participants were pooled for these psychometric analyses (n = 70 usual care phase, n = 72 algorithm phase). In summary, participants were a median of 57 (Range: 27–80) years old, and predominantly female (66%), Caucasian (90%), received undergraduate (33.1%) or post graduate degree training (32.4%), working full-time (38%), diagnosed with a gastrointestinal (51%) or breast (37%) malignancy or multiple myeloma (11%), and receiving platinum (50%) (e.g., common treatment for gastrointestinal malignancies), taxane (35.9%) (e.g., common treatment for breast cancer), or proteasome-inhibitor-based (11%) cancer therapy (e.g., common treatment for multiple myeloma). Approximately 56% of the sample had received ≥ two-thirds of their planned course of neurotoxic therapy by T3 [22].

Response distributions of the PRO-CTCAE numbness and tingling items

Table 1 presents the summary statistics for the QLQ-CIPN20 sensory and motor subscales, PRO-CTCAE™ numbness and tingling items, 0–10 NRS of worst CIPN pain intensity, and TNSc© (T3 only) from T1 to T3. Overall, mean scores for all CIPN measures increased over time reflecting worsening CIPN severity. At T3 (n = 138), approximately 29% of participants reported PRO-CTCAE™ severity item scores at the floor (score = 0) and approximately 60% of participants reported PRO-CTCAE™ interference item scores (score = 0) at the floor. Only one participant reported a PRO-CTCAE™ severity item score at the ceiling (severity = 4, interference = 2).

Table 1 QLQ-CIPN20, PRO-CTCAE™, and TNSc© Sample statistics at each study visit
Full size table

Test–retest reliability

The median time elapsed between the T3 and T4 administration of the PRO-CTCAE™ numbness and tingling items was 131 min (Range = 1–398). Agreement between T3 and T4 PRO-CTCAE™ numbness and tingling item scores was moderate to strong [40] (severity: Adjusted ICC = 0.79; interference: Adjusted ICC = 0.73, n = 123). Agreement between T3 and T4 PRO-CTCAE™ numbness and tingling item scores diminished when we restricted the sample to only individuals who scored a “1” or higher at T3 on either item (severity: Adjusted ICC = 0.52, n = 82; interference: Adjusted ICC = 0.50, n = 45).

Concurrent validity

Table 2 presents the bivariate correlations among PRO-CTCAE numbness and tingling items, QLQ-CIPN20 sensory and motor subscale, 0–10 NRS of worst CIPN pain intensity, and TNSc© scores at T3. PRO-CTCAE numbness and tingling severity and interference item scores showed only moderate correlation with one another (Spearman’s ρ = 0.59), suggesting that these two items evaluate different aspects of the symptom experience. PRO-CTCAE severity item scores were highly correlated (Spearman’s ρ = 0.72) with QLQ-CIPN20 sensory subscale scores, and moderately correlated with QLQ-CIPN20 motor subscale (Spearman’s ρ = 0.50) and 0–10 worst CIPN pain intensity scores (Spearman’s ρ = 0.65). Correlations were low between the TNSc© and the PRO-CTCAE severity (Spearman’s ρ = 0.48) and interference (Spearman’s ρ = 0.30) items. PRO-CTCAE interference item scores were moderately correlated with QLQ-CIPN20 sensory (Spearman’s ρ = 0.53) and motor subscales (Spearman’s ρ = 0.58), and with the 0–10 worst CIPN pain intensity NRS scores (Spearman’s ρ = 0.55).

Table 2 Correlations among QLQ-CIPN20, PRO-CTCAE numbness and tingling items, TNSc©, and worst CIPN pain intensity scores
Full size table

Longitudinal validity

The average time elapsed between T1 and T3 was 41.43 days (Range = 14–149). The Cohen’s d for change in PRO-CTCAE numbness and tingling item scores (severity: d = 0.32, 95% CI = -0.02, 0.66); interference: d = 0.40, 95% CI = 0.06, 0.75) and QLQ-CIPN20 sensory (d = 0.41, 95% CI = 0.07, 0.76) and motor (d = 0.38, 95% CI = 0.04, 0.72) subscale scores from T1 to T3 were small. The Cohen’s d for change in 0–10 NRS of worst CIPN pain intensity scores was the smallest (d = 0.28, 95% CI = − 0.07, 0.62).

Construct validity of PRO-CTCAE numbness and tingling items’ response categories

Figure 1 displays median QLQ-CIPN20 sensory and motor subscale, 0–10 worst CIPN pain intensity, and TNSc© scores, by increasing PRO-CTCAE numbness and tingling item scores at T3. The response categories of the PRO-CTCAE severity (i.e., 0 to ≥ 3 categories) and interference (i.e., 0 to ≥ 2 categories) items demonstrated strong construct validity. Increasing score levels of PRO-CTCAE severity and interference discriminated respondents with statistically significantly different QLQ-CIPN20 sensory subscale scores (severity: JT = 5644.5, p < 0.0001, interference: JT = 4255.5, p < 0.0001), and QLQ-CIPN20 motor subscale scores (severity: JT = 4550, p < 0.0001, interference: JT = 4177, p < 0.0001), as well as greater CIPN pain intensity (Severity: JT = 5338, p < 0.0001; interference: JT = 4248, p < 0.0001), and higher TNSc© scores (severity: JT = 3396.5, p < 0.0001; interference: JT = 2544, p = 0.0008).

Fig. 1
figure 1

Median CIPN patient-reported and composite measure scores by PRO-CTCAE item response category at T3. a PRO-CTCAE numbness and tingling severity item. a Differences in median QLQ-CIPN20 Sensory, QLQ-CIPN20 Motor, 0–10 worst CIPN pain intensity NRS (n = 138), and TNSc© scores (n = 118) by PRO-CTCAE Numbness and Tingling Severity Item Score at T3. Severity = 0; TNSc© n = 33; QLQ-CIPN20 and worst pain measures n = 40. Severity = 1; TNSc© n = 49; QLQ-CIPN20 and worst pain measures n = 54. Severity = 2; TNSc© n = 33; QLQ-CIPN20 and worst pain measures n = 38. Severity ≥ 3; TNSc© n = 3; QLQ-CIPN20 and worst pain measures n = 6. b PRO-CTCAE Numbness and Tingling Interference Item. b Differences in median QLQ-CIPN20 Sensory, QLQ-CIPN20 Motor, 0–10 worst CIPN pain intensity NRS (n = 138), and TNSc© scores (n = 118) by PRO-CTCAE Numbness and Tingling Interference Item Score at T3. Interference = 0; TNSc© n = 69; QLQ-CIPN20 and worst pain measures n = 83. Interference = 1; TNSc© n = 34; QLQ-CIPN20 and worst pain measures n = 36. Interference ≥ 2; TNSc© n = 15; QLQ-CIPN20 and worst pain measures n = 19

Full size image

Sensitivity and specificity

Table 3 presents the sensitivity and specificity of the PRO-CTCAE numbness and tingling items to detect probable sensory peripheral neuropathy and painful CIPN. In discriminating probable sensory peripheral neuropathy, the PRO-CTCAE severity item demonstrated a sensitivity of 95.83% and a specificity of 65.22%, while the interference item demonstrated a sensitivity of 51.39% and specificity of 73.91%. The sensitivity and specificity of the PRO-CTCAE severity item to detect painful CIPN were 100% and 38.46%, respectively, while the sensitivity and specificity of the interference item for painful neuropathy were 76.47% and 72.12%.

Table 3 Sensitivity and specificity of the PRO-CTCAE items to probable sensory peripheral neuropathy and painful chemotherapy-induced peripheral neuropathy (CIPN)
Full size table

Discussion

The purpose of this study was to evaluate the measurement properties of the PRO-CTCAE numbness and tingling severity and interference items for use in screening for CIPN in patients receiving taxanes, platinum-based agents, or proteasome inhibitors. Our results demonstrate several psychometric strengths of the PRO-CTCAE items to screen for CIPN, but also suggest areas where precision, sensitivity and specificity might be improved. The PRO-CTCAE severity item, but not the interference item, identified 95.83% of individuals with probable sensory peripheral neuropathy, although both items demonstrated only modest specificity [37]. For the detection of probable sensory peripheral neuropathy, our observations about the high sensitivity and modest specificity of the PRO-CTCAE items are encouraging. The adverse consequences of a false negative (i.e., low sensitivity) of mild CIPN may be considerable as the earliest detection of the onset or worsening of CIPN directs clinical management. A false positive (i.e., low specificity) in the setting of mild CIPN is not concerning as only continued close monitoring is warranted for mild CIPN. Further research to evaluate the sensitivity and specificity of PRO-CTCAE numbness and tingling item cutoff scores associated with more severe neuropathy is needed because a false positive of more severe CIPN during active treatment may prompt clinicians to dose-reduce neurotoxic chemotherapy to prevent worsening symptoms.

Although the test–retest reliabilities of the PRO-CTCAE numbness and tingling items were moderate to strong, these results should be interpreted with caution and replication in future studies is recommended. In sensitivity analyses, the test–retest reliability of the items decreased when participants who did not report CIPN (i.e., scores of 0) were excluded, suggesting limited variability in the sample. In addition, the test–retest reliability estimates may also have been inflated given the short duration between T3 and T4 survey administration. The PRO-CTCAE and QLQ-CIPN20 effect size estimates for change across three clinical visits were small and comparable. While the Cohen’s d observed for the QLQ-CIPN20 sensory and motor subscales in this study were lower than previously reported in patients receiving neurotoxic chemotherapy (i.e., d = 0.82 QLQ-CIPN20 sensory, d = 0.48 QLQ-CIPN20 motor) [10], our observations support a conclusion that the two PRO-CTCAE items have similar sensitivity in detecting changes in CIPN severity and interference between visits, compared to the sensory and motor subscales of the QLQ-CIPN20 measure.

Study results highlight several potential considerations in the implementation of the PRO-CTCAE numbness and tingling items for CIPN screening and evaluation in patients on cancer therapy. While there were no observed ceiling effects for PRO-CTCAE severity or interference item scores, at the same time, we did observe floor effects in the PRO-CTCAE severity and interference items scores, with proportions at the floor exceeding the threshold of 15% or more of the sample [41]. A similar observation has recently been reported by Nyrop et al. [1] who found that approximately 27% and 55% of women with breast cancer receiving neurotoxic chemotherapy reported scores (maximum at any point during treatment) at the floor of the Patient-Reported Symptom monitoring system form severity and interference item score ranges (similar format to PRO-CTCAE scoring system) (N = 184) [1]. It is possible that these observed floor effects are sample dependent. Consistent with that possibility, we noted that the response distributions for PRO-CTCAE and QLQ-CIPN20 scores were comparable. As CIPN is a dose-dependent phenomena, one possibility for the low CIPN severity observed in our sample is that only about half of the sample received at least 2/3 of their planned neurotoxic chemotherapy at T3. Replication in a larger and more diverse sample of patients receiving cancer treatments associated with CIPN is needed to confirm whether our observations are durable. Additional research may be conducted to test the content validity of the PRO-CTCAE numbness and tingling items in a sample of patients with CIPN to determine if changes to the terminology of the measure may be required for patients to more readily report mild CIPN. While we await the results of additional research, the interpretation of studies that utilize PRO-CTCAE should keep in mind that the two CIPN items may be unable to differentiate among respondents at the low end of the severity spectrum. Continued research to develop and test new approaches to screening for CIPN, particularly at its earliest onset, also appear warranted.

The correlations reported by Knoerl et al. [11] between the PRO-CTCAE severity and interference item scores and QLQ-CIPN20 sensory (r = 0.76, r = 0.78) and motor (r = 0.55, r = 0.77) subscale scores in a sample of women receiving paclitaxel [11] were higher than those observed in this study. The less favorable metrics of concurrent validity observed in this analysis may indicate that the phrasing of the PRO-CTCAE numbness and tingling items may not fully capture variability in the range of sensory experiences and functional limitations experienced by individuals with oxaliplatin-induced peripheral neuropathy (which often presents with increased muscle weakness or sensitivity to cold objects) [42] or bortezomib-induced peripheral neuropathy (which typically presents with neuropathic pain) [43]. At the same time, there is evidence that the PRO-CTCAE response categories distinguish respondents with significantly different levels of CIPN symptom severity. Our observations extend the results of McCrary et al. [21] who demonstrated that the PRO-CTCAE severity item response categories (i.e., 0– ≥ 3) were able to discriminate worsening FACT/GOG-Ntx (p < 0.001) scores [21].

Opportunities to improve the precision of the PRO-CTCAE items represent an important future direction. The modest correlations observed between the PRO-CTCAE items and the measures of painful neuropathy and motor weakness also suggest that the capacity of the PRO-CTCAE to distinguish CIPN features beyond numbness and tingling, including pain or motor weakness, may be constrained. Clinicians should assess CIPN pain intensity and motor weakness separately because the PRO-CTCAE severity and interference items do not contain phrasing specific to neuropathic pain or motor weakness. Similarly, PRO-CTCAE numbness and tingling item scores should not be used to guide management decisions for patients with painful CIPN. Future consideration should be given to expanding the PRO-CTCAE numbness and tingling items to include questions that reflect neuropathic pain to improve the precision and discrimination of the measure, as this is a common feature of CIPN during and following neurotoxic cancer therapy [44].

Several caveats should be considered in interpreting our findings. Power analyses were not conducted for the exploratory analyses described in this research. As such, some of our analyses may have been underpowered, and these analyses should be replicated in future samples. Our single-institution sample was also predominantly white, non-Hispanic, female, and older in age, thereby decreasing the external generalizability of our findings. At the same time, the diversity of the neurotoxic agents administered in this study strengthens the generalizability of our observations. Observations in this sample were obtained from participants who were at varying points in their course of neurotoxic therapy, and only about 56% of the sample had completed a majority of the treatment cycles in their planned course of therapy. As such, effect size estimates with respect to changes in CIPN symptom severity over time should be interpreted cautiously. In addition, CIPN symptom severity remained generally low, requiring us to collapse score categories for many of our analyses. While four different study staff members administered the TNSc©, methods to assess inter-rater reliability among the four raters were not implemented. The test–retest reliability analyses are limited by the short time period between survey administration. Lastly, the sensitivity and specificity analyses are limited by the lack of a gold standard measure as the reference measure of CIPN and by the low prevalence of severe CIPN among the sample [37]. At the same time, the case definition of probable sensory peripheral neuropathy used in our examination of sensitivity and specificity was derived from case definitions used for the identification of diabetic neuropathy [38] and emphasized the detection of mild symptoms.

Conclusion

The results of this analysis contribute to the evidence base about the measurement properties of the PRO-CTCAE numbness and tingling severity and interference items in patients receiving neurotoxic cancer therapy. Preliminary evidence supports the reliability and validity of the PRO-CTCAE numbness and tingling items as screening measures of CIPN, although there may be opportunities to improve the precision and discrimination of the items to capture the earliest onset of CIPN and to reflect the full range of CIPN features.

Availability of data and materials

The datasets used and/or analyzed during the current study are available from the corresponding author on reasonable request.

Abbreviations

CIPN:

Chemotherapy-induced peripheral neuropathy

CTCAE:

Common terminology criteria for adverse events

FACT/GOG- Ntx:

Functional Assessment of Cancer Therapy/Gynecological Cancer Group Neurotoxicity Questionnaire

NRS:

Numerical Rating Scale

PRO:

Patient reported outcomes

PRO-CTCAE™:

Patient-Reported Outcomes Version of the Common Terminology Criteria for Adverse Events

QLQ-CIPN20:

Quality of Life Questionnaire-Chemotherapy-Induced Peripheral Neuropathy Scale

TNSc©:

Total neuropathy score-clinical version

References

  1. Nyrop KA, Deal AM, Reeder‐Hayes KE et al (2019) Patient‐reported and clinician‐reported chemotherapy‐induced peripheral neuropathy in patients with early breast cancer: current clinical practice. Cancer. https://doi.org/10.1002/cncr.32175

  2. Shah A, Hoffman EM, Mauermann ML et al (2018) Incidence and disease burden of chemotherapy-induced peripheral neuropathy in a population-based cohort. J Neurol Neurosurg Psychiatry. https://doi.org/10.1136/jnnp-2017-317215

  3. Kerckhove N, Collin A, Condé S, Chaleteix C, Pezet D, Balayssac D (2017) Long-term effects, pathophysiological mechanisms, and risk factors of chemotherapy-induced peripheral neuropathies: a comprehensive literature review. Front Pharmacol 8:86. https://doi.org/10.3389/fphar.2017.00086

    CAS  Article  PubMed  PubMed Central  Google Scholar 

  4. Tanay MAL, Armes J, Ream E (2017) The experience of chemotherapy-induced peripheral neuropathy in adult cancer patients: a qualitative thematic synthesis. Eur J Cancer Care (Engl) 26(5):e12443. https://doi.org/10.1111/ecc.12443

    Article  Google Scholar 

  5. Tanay MA, Armes J (2019) Lived experiences and support needs of women who developed chemotherapy-induced peripheral neuropathy following treatment for breast and ovarian cancer. Eur J Cancer Care (Engl). https://doi.org/10.1111/ecc.13011

  6. Winters-Stone KM, Horak F, Jacobs PG et al (2017) Falls, functioning, and disability among women with persistent symptoms of chemotherapy-induced peripheral neuropathy. J Clin Oncol 35(23):2604–2612. https://doi.org/10.1200/JCO.2016.71.3552

    Article  PubMed  PubMed Central  Google Scholar 

  7. Loprinzi CL, Lacchetti C, Bleeker J et al (2020) Prevention and management of chemotherapy-induced peripheral neuropathy in survivors of adult cancers: ASCO guideline update. J Clin Oncol. https://doi.org/10.1200/JCO.20.01399

  8. McCrary JMM, Goldstein D, Boyle F et al (2017) Optimal clinical assessment strategies for chemotherapy-induced peripheral neuropathy (CIPN): a systematic review and Delphi survey. https://doi.org/10.1007/s00520-017-3772-y

  9. Trotti A, Colevas A, Setser A et al (2003) CTCAE v3.0: development of a comprehensive grading system for the adverse effects of cancer treatment. Semin Radiat Oncol 13(3):176–181. https://doi.org/10.1016/S1053-4296(03)00031-6

    Article  PubMed  Google Scholar 

  10. Smith EML, Barton DL, Qin R, Steen PD, Aaronson NK, Loprinzi CL (2013) Assessing patient-reported peripheral neuropathy: the reliability and validity of the European Organization for Research and Treatment of Cancer QLQ-CIPN20 Questionnaire. Qual Life Res 22(10):2787–2799. https://doi.org/10.1007/s11136-013-0379-8

    Article  Google Scholar 

  11. Knoerl R, Gray E, Stricker C et al (2017) Electronic versus paper-pencil methods for assessing chemotherapy-induced peripheral neuropathy. Support Care Cancer 25(11):3437–3446. https://doi.org/10.1007/s00520-017-3764-y

    Article  PubMed  Google Scholar 

  12. Knoerl R, Bridges C, Smith G, Yang J, Kanzawa-Lee G, Smith E (2018) Chemotherapy-induced peripheral neuropathy: use of an electronic care planning system to improve adherence to recommended assessment and management practices. Clin J Oncol Nurs 22(5):E134–E140. https://doi.org/10.1188/18.CJON.E134-E140

    Article  PubMed  Google Scholar 

  13. Griffith KA, Merkies IS, Hill EE, Cornblath DR (2010) Measures of chemotherapy-induced peripheral neuropathy: a systematic review of psychometric properties. J Peripher Nerv Syst 15(4):314–325. https://doi.org/10.1111/j.1529-8027.2010.00292.x

    Article  PubMed  Google Scholar 

  14. Cavaletti G, Frigeni B, Lanzani F et al (2010) Chemotherapy-Induced Peripheral Neurotoxicity assessment: a critical revision of the currently available tools. Eur J Cancer 46(3):479–494. https://doi.org/10.1016/j.ejca.2009.12.008

    CAS  Article  PubMed  Google Scholar 

  15. Knoerl R, Smith EML, Han A, Doe A, Scott K, Berry DL (2019) Characterizing patient-clinician chemotherapy-induced peripheral neuropathy assessment and management communication approaches. Patient Educ Couns 102(9):1636–1643. https://doi.org/10.1016/j.pec.2019.04.012

    Article  PubMed  PubMed Central  Google Scholar 

  16. National Cancer Institute (2021) Patient-reported outcomes version of the common terminology criteria for adverse events (PRO-CTCAETM). https://healthcaredelivery.cancer.gov/pro-ctcae/

  17. Basch E, Reeve BB, Mitchell SA et al (2014) Development of the National Cancer Institute’s patient-reported outcomes version of the common terminology criteria for adverse events (PRO-CTCAE). J Natl Cancer Inst. https://doi.org/10.1093/jnci/dju244

    Article  PubMed  PubMed Central  Google Scholar 

  18. Dueck AC, Mendoza TR, Mitchell SA et al (2015) Validity and reliability of the US National Cancer Institute’s patient-reported outcomes version of the common terminology criteria for adverse events (PRO-CTCAE). JAMA Oncol 1(8):1051–1059. https://doi.org/10.1001/jamaoncol.2015.2639

    Article  PubMed  PubMed Central  Google Scholar 

  19. Hay JL, Atkinson TM, Reeve BB et al (2014) Cognitive interviewing of the US National Cancer Institute’s patient-reported outcomes version of the common terminology criteria for adverse events (PRO-CTCAE). Qual Life Res 23(1):257–269. https://doi.org/10.1007/s11136-013-0470-1

    Article  PubMed  Google Scholar 

  20. Tan AC, McCrary JM, Park SB, Trinh T, Goldstein D (2019) Chemotherapy-induced peripheral neuropathy—patient-reported outcomes compared with NCI-CTCAE grade. Support Care Cancer. https://doi.org/10.1007/s00520-019-04781-6

    Article  PubMed  PubMed Central  Google Scholar 

  21. McCrary JM, Goldstein D, Trinh T et al (2019) Optimising clinical screening for chemotherapy-induced peripheral neuropathy. J Pain Symptom Manag. https://doi.org/10.1016/j.jpainsymman.2019.07.021

    Article  Google Scholar 

  22. Knoerl R, Mazzola E, Hong F et al (2021) Exploring the impact of a decision support algorithm to improve clinicians’ chemotherapy-induced peripheral neuropathy assessment and management practices: a two-phase, longitudinal study. BMC Cancer 21(1):236. https://doi.org/10.1186/s12885-021-07965-8

    CAS  Article  PubMed  PubMed Central  Google Scholar 

  23. Chaudhry V, Rowinsky EK, Sartorius SE, Donehower RC, Cornblath DR (1994) Peripheral neuropathy from taxol and cisplatin combination chemotherapy: clinical and electrophysiological studies. Ann Neurol 35(3):304–311. https://doi.org/10.1002/ana.410350310

    CAS  Article  PubMed  Google Scholar 

  24. Cornblath DR, Chaudhry V, Carter K et al (1999) Total neuropathy score: validation and reliability study. Neurology 53(8):1660–1664

    CAS  Article  Google Scholar 

  25. Smith EML, Knoerl R, Yang JJ, Kanzawa-Lee G, Lee D, Bridges CM (2018) In search of a gold standard patient-reported outcome measure for use in chemotherapy-induced peripheral neuropathy clinical trials. Cancer Control. https://doi.org/10.1177/1073274818756608

    Article  PubMed  PubMed Central  Google Scholar 

  26. Lavoie Smith EM, Cohen JA, Pett MA et al (2011) The validity of neuropathy and neuropathic pain measures in patients with cancer receiving taxanes and platinums. Oncol Nurs Forum 38(2):133–142. https://doi.org/10.1188/11.ONF.133-142

    Article  PubMed  Google Scholar 

  27. Smith EML, Beck SL, Cohen J (2008) The total neuropathy score: a tool for measuring chemotherapy-induced peripheral neuropathy. Oncol Nurs Forum 35(1):96–102. https://doi.org/10.1188/08.ONF.96-102

    Article  PubMed  Google Scholar 

  28. Smith EML, Cohen JA, Pett MA, Beck SL (2010) The reliability and validity of a modified total neuropathy score-reduced and neuropathic pain severity items when used to measure chemotherapy-induced peripheral neuropathy in patients receiving taxanes and platinums. Cancer Nurs 33(3):173–183. https://doi.org/10.1097/NCC.0b013e3181c989a3

    Article  PubMed  Google Scholar 

  29. Dworkin RH, Turk DC, Farrar JT et al (2005) Core outcome measures for chronic pain clinical trials: IMMPACT recommendations. Pain 113(1–2):9–19. https://doi.org/10.1016/j.pain.2004.09.012

    Article  PubMed  Google Scholar 

  30. Cleeland CS, Ryan KM (1994) Pain assessment: global use of the Brief Pain Inventory. Ann Acad Med Singap 23(2):129–138

    CAS  PubMed  Google Scholar 

  31. Postma TJ, Aaronson NK, Heimans JJ et al (2005) The development of an EORTC quality of life questionnaire to assess chemotherapy-induced peripheral neuropathy: the QLQ-CIPN20. Eur J Cancer 41(8):1135–1139

    CAS  Article  Google Scholar 

  32. Le-Rademacher J, Kanwar R, Seisler D et al (2017) Patient-reported (EORTC QLQ-CIPN20) versus physician-reported (CTCAE) quantification of oxaliplatin- and paclitaxel/carboplatin-induced peripheral neuropathy in NCCTG/Alliance clinical trials. Support Care Cancer 25(11):3537–3544. https://doi.org/10.1007/s00520-017-3780-y

    Article  PubMed  PubMed Central  Google Scholar 

  33. Qin S, Nelson L, McLeod L, Eremenco S, Coons SJ (2019) Assessing test–retest reliability of patient-reported outcome measures using intraclass correlation coefficients: recommendations for selecting and documenting the analytical formula. Qual Life Res 28(4):1029–1033. https://doi.org/10.1007/s11136-018-2076-0

    Article  PubMed  Google Scholar 

  34. Hinkle DE, Wiersma W, Jurs SG (2003). Applied statistics for the behavioral sciences, 5th edn. Houghton Mifflin. https://books.google.com/books?id=7tntAAAAMAAJ

  35. Liang MH (2000) Longitudinal construct validity: establishment of clinical meaning in patient evaluative instruments. Med Care 38(9 Suppl)

  36. Ferdhiana R, Terpstra J, Magel RC (2008) A nonparametric test for the ordered alternative based on Kendall’s correlation coefficient. Commun Stat Simul Comput 37(6):1117–1128. https://doi.org/10.1080/03610910801894870

    Article  Google Scholar 

  37. Maxim LD, Niebo R, Utell MJ (2014) Screening tests: a review with examples. Inhal Toxicol 26(13):811–828. https://doi.org/10.3109/08958378.2014.955932

    CAS  Article  PubMed  PubMed Central  Google Scholar 

  38. Tesfaye S, Boulton AJM, Dyck PJ et al (2010) Diabetic neuropathies: update on definitions, diagnostic criteria, estimation of severity, and treatments. Diabetes Care 33(10):2285–2293. https://doi.org/10.2337/dc10-1303

    Article  PubMed  PubMed Central  Google Scholar 

  39. Dworkin RH, Turk DC, Peirce-Sandner S et al (2012) Considerations for improving assay sensitivity in chronic pain clinical trials: IMMPACT recommendations. Pain 153(6):1148–1158

    CAS  Article  Google Scholar 

  40. Koo TK, Li MY (2016) A guideline of selecting and reporting intraclass correlation coefficients for reliability research. J Chiropr Med 15(2):155–163. https://doi.org/10.1016/j.jcm.2016.02.012

    Article  PubMed  PubMed Central  Google Scholar 

  41. Terwee CB, Bot SDM, de Boer MR et al (2007) Quality criteria were proposed for measurement properties of health status questionnaires. J Clin Epidemiol 60(1):34–42. https://doi.org/10.1016/j.jclinepi.2006.03.012

    Article  PubMed  Google Scholar 

  42. Staff NP, Cavaletti G, Islam B, Lustberg M, Psimaras D, Tamburin S (2019) Platinum-induced peripheral neurotoxicity: from pathogenesis to treatment. J Peripher Nerv Syst. https://doi.org/10.1111/jns.12335

    Article  PubMed  PubMed Central  Google Scholar 

  43. Velasco R, Alberti P, Bruna J, Psimaras D, Argyriou AA (2019) Bortezomib and other proteosome inhibitors-induced peripheral neurotoxicity: from pathogenesis to treatment. J Peripher Nerv Syst. https://doi.org/10.1111/jns.12338

    Article  PubMed  Google Scholar 

  44. Ventzel L, Jensen AB, Jensen AR, Jensen TS, Finnerup NB (2016) Chemotherapy-induced pain and neuropathy: a prospective study in patients treated with adjuvant oxaliplatin or docetaxel. Pain 157(3):560–568. https://doi.org/10.1097/j.pain.0000000000000404

    CAS  Article  PubMed  Google Scholar 

Download references

Acknowledgements

The Total Neuropathy Score measure was provided to Dana-Farber Cancer Institute and Dr. Robert Knoerl by Johns Hopkins University and Professor David Cornblath. We acknowledge Erica Fox, Kristina Italiano, Jessica Wallar, Beatrice Benjamin, Xiaohui Yu, and Barbara Halpenny for their assistance in participant recruitment, participant data collection, and/or study management. We acknowledge the clinic assistants working at the breast oncology, gastrointestinal oncology, and multiple myeloma disease centers at Dana-Farber Cancer Institute for their support with implementing the primary study. We acknowledge Cindy Tofthagen for her permission to revise and test the Algorithm for Nursing Assessment and Management of Chemotherapy-Induced Peripheral Neuropathy in this study. We acknowledge Traci Blonquist for her biostatistical support at the beginning of the trial. Finally, we acknowledge Justin McReynolds for his technical support of the software responsible for data capture and the generation of the CIPN algorithm and patient summary.

Funding

Mittelman Integrative Oncology Family Fund.

Author information

Author notes

  1. Robert Knoerl

    Present address: University of Michigan School of Nursing, Ann Arbor, MI, USA

Authors and Affiliations

  1. Phyllis F. Cantor Center for Research in Nursing and Patient Care Services, Dana-Farber Cancer Institute, Boston, MA, USA

    Robert Knoerl

  2. University of Michigan School of Nursing, Ann Arbor, MI, USA

    Fangxin Hong

  3. Department of Data Sciences, Dana-Farber Cancer Institute, Boston, MA, USA

    Emanuele Mazzola

  4. Outcomes Research Branch, Division of Cancer Control and Population Sciences, National Cancer Institute, Rockville, MD, USA

    Sandra A. Mitchell

  5. Medical Oncology, Dana-Farber Cancer Institute, Boston, MA, USA

    Elahe Salehi, Nadine McCleary, Jennifer A. Ligibel & Kaitlen Reyes

  6. Biobehavioral Nursing and Health Informatics, University of Washington, Seattle, WA, USA

    Donna L. Berry

Authors
  1. Robert Knoerl
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Emanuele Mazzola
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Sandra A. Mitchell
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Fangxin Hong
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Elahe Salehi
    View author publications

    You can also search for this author in PubMed Google Scholar

  6. Nadine McCleary
    View author publications

    You can also search for this author in PubMed Google Scholar

  7. Jennifer A. Ligibel
    View author publications

    You can also search for this author in PubMed Google Scholar

  8. Kaitlen Reyes
    View author publications

    You can also search for this author in PubMed Google Scholar

  9. Donna L. Berry
    View author publications

    You can also search for this author in PubMed Google Scholar

Contributions

RK (Principal Investigator) was primarily responsible for the design and conduct of the study, interpretation of the data, and writing of the manuscript. SAM contributed to the design of the planned analyses, interpretation of the data, and writing of the manuscript. EM and FH contributed to the analysis of the data. ES, JL, NM, KR, DB, and FH were all involved in the design and conception of the study. All authors read and approved the final manuscript.

Corresponding author

Correspondence to Robert Knoerl.

Ethics declarations

Ethics approval and consent to participate

Study oversight and ethics approval was provided by the Dana-Farber/Harvard Cancer Center Office for Human Research Studies (18-049). All study participants provided written consent to participate in the trial.

Consent for publication

Not applicable.

Competing interests

RK has received personal fees (consulting) from Strategy Inc, Spark Healthcare, and System Analytic; and serves on the scientific advisory board of Wellium.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/.

Reprints and Permissions

About this article

Verify currency and authenticity via CrossMark

Cite this article

Knoerl, R., Mazzola, E., Mitchell, S.A. et al. Measurement properties of brief neuropathy screening items in cancer patients receiving taxanes, platinums, or proteasome inhibitors. J Patient Rep Outcomes 5, 101 (2021). https://doi.org/10.1186/s41687-021-00377-z

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1186/s41687-021-00377-z

Keywords

  • Patient-reported outcome measures
  • Chemotherapy-induced peripheral neuropathy
  • Psychometrics
  • Reliability
  • Validity
  • Patient-Reported Outcomes Version of the Common Terminology Criteria for Adverse Events