- Open Access
RETRACTED ARTICLE: Content validity and psychometric evaluation of Functional Assessment of Chronic Illness Therapy-Fatigue in patients with psoriatic arthritis
Journal of Patient-Reported Outcomes volume 3, Article number: 5 (2019)
- The Retraction Note to this article has been published in Journal of Patient-Reported Outcomes 2019 3:32
To evaluate the measurement properties (e.g. content validity, reliability and ability to detect change) of the Functional Assessment of Chronic Illness Therapy (FACIT)-Fatigue scale in patients with active psoriatic arthritis (PsA).
One-on-one semi-structured qualitative interviews with adult patients with active PsA evaluated the content validity of FACIT-Fatigue. Quantitative measurement properties were evaluated using data from phase III tofacitinib randomized controlled trials (RCTs) in PsA: OPAL Broaden (NCT01877668) and OPAL Beyond (NCT01882439).
Of 12 patients included in the qualitative study, 2 (17%) had mild, 8 (67%) had moderate, and 2 (17%) had severe PsA disease activity; 7 (58%) attributed fatigue to PsA, and 7 (58%) rated fatigue as important or extremely important. Most patients considered the FACIT-Fatigue items relevant to their PsA experience and understood item content and response options as intended. In the psychometric analysis of RCT data, a second-order confirmatory factor model fit the data well (Bentler’s Comparative Fit Index ≥0.92). FACIT-Fatigue demonstrated good internal consistency (Cronbach’s coefficient α ≥ 0.90), test-retest reliability (Intraclass Correlation Coefficient ≥ 0.80) and a strong correlation with SF-36 Vitality (r > 0.80). A robust relationship between disease activity (based on Patient’s Global Assessment of Psoriasis and Arthritis) and FACIT-Fatigue was observed (effect sizes > 1.4), with clinically important difference for the FACIT-Fatigue total score estimated as 3.1 points, and the responder definition estimated as a 4-point improvement for FACIT-Fatigue total score.
Fatigue was confirmed to be an important symptom to patients with PsA, and FACIT-Fatigue was found to be a reliable and valid measure in this population.
Psoriatic arthritis (PsA) is a chronic inflammatory disease occurring in 6–42% of patients with psoriasis . It is characterized by joint inflammation, enthesitis, dactylitis, and spondylitis, and is often associated with generalized fatigue [1,2,3].
Fatigue was recently added to the core domain set for PsA randomized controlled trials (RCTs) [4, 5], due to the impact that it has on a patient’s quality of life. Patients with PsA have noted statistically significant improvements in fatigue following treatment with newer agents such as certolizumab, secukinumab, and apremilast [6,7,8], suggesting it is modifiable with treatment. For example, intravenous secukinumab 150 mg led to a least squares mean change from baseline in fatigue of 6.74 (P < 0.05 vs. placebo) .
Although recognized as a core domain for assessment in RCTs, there is currently no universally accepted measure of fatigue recommended to evaluate this construct in patients with PsA. When measuring a construct within the RCT setting, it is important to ensure the relevance and comprehension of a questionnaire to the target population, and its reliability, validity, and ability to detect change [9,10,11].
The Functional Assessment of Chronic Illness Therapy–Fatigue (FACIT-Fatigue) scale  (Additional file 1) is a 13-item questionnaire originally designed to assess fatigue/tiredness and its impact on daily functioning in people with cancer; it has now been evaluated in other chronic diseases [12,13,14,15]. Each item’s response option uses a 5-point scale ranging from “not at all” to “very much.” The total FACIT-Fatigue score ranges from 0 to 52, where higher scores represent less fatigue [13, 14]. While commonly applied as a unidimensional measure, previous work has shown that FACIT-Fatigue can also be considered as a multidimensional measure, with the impact and experience of fatigue considered separately .
Psychometric data in patients with RA suggest that FACIT-Fatigue (total score; baseline, Week 12, and Week 24 assessments) has good internal consistency (α = 0.86 to 0.87) and the ability to differentiate patients according to clinical change using the American College of Rheumatology response criteria, . FACIT-Fatigue also showed a strong association with the longer, 16-item Multidimensional Assessment of Fatigue scale (r = − 0.84 to − 0.88), implying a redundancy between these two measures. However, this study also reported that FACIT-Fatigue captured a broader distribution of patients and wider range of self-reported fatigue concepts. A qualitative study of 17 patients with moderate to highly active RA found FACIT-Fatigue to have high content validity; 10 of the 13 items had “high” content validity (determined by the relationship between the intended measurement concept and the methods used ), with three having “low to moderate” (“I feel weak all over”, “I feel listless [washed out]”) or “low” (“I am too tired to eat”) content validity . This study also concluded that FACIT-Fatigue captured most fatigue-related, patient-reported concepts. Chandran and colleagues also showed FACIT-Fatigue to have good internal consistency (α = 0.96) and significant correlation with actively inflamed joint count (r = − 0.43) in patients with PsA . However, there is currently no qualitative evidence to support content validity in patients with PsA, and no quantitative evidence supporting other measurement properties specifically in an RCT.
We designed a mixed-methods approach to further evaluate the qualitative and quantitative measurement properties of FACIT-Fatigue in patients with PsA. For the former, a qualitative study was designed to: 1) elicit concepts important to patients with PsA regarding the signs, symptoms, and impact of PsA on daily functioning, focusing on the experience and impact of fatigue; and 2) evaluate the content validity of the FACIT-Fatigue scale. For the latter, a secondary analysis of two phase III RCTs of tofacitinib assessed FACIT-Fatigue in patients with moderate to severe PsA.
Patients and methods
Qualitative FACIT-fatigue study
The qualitative assessment was carried out prior to the quantitative analysis and included one-on-one semi-structured interviews with 12 adult patients (aged ≥18 years) who had a confirmed diagnosis and presence of active PsA (full details in Additional file 2a). Interviews were conducted in-person at two clinical sites in the United States (Florida and Pennsylvania), by two experts (research associates, Evidera) who were trained and experienced in qualitative interviewing methods.
Prior to the start of each interview, the interviewers fully explained the study to the patient and obtained written, informed consent. Interviewers led the discussion using a standardized, semi-structured interview guide (full guide in Additional file 2b), divided into two parts. Part 1, an open-ended concept elicitation, was designed to assess relevant symptom and impact concepts (e.g. self-reported PsA severity), and understand the relative importance and patients’ experience of fatigue. Detailed questions related to fatigue were followed by general questions about patients’ overall symptoms and impact on functioning.
In part 2, patients completed the Functional Assessment of Chronic Illness Therapy–Fatigue (FACIT-Fatigue) questionnaire and were asked to provide feedback on overall comprehension, relevance, and content validity. Questions were designed to assess the interpretation of items, thoughts about the relevant recall period, and feedback regarding the content in relation to their most important symptoms and overall symptoms and impacts. Following the interview, patients completed a sociodemographic and clinical questionnaire. Qualitative data were then analyzed using ATLAS.ti qualitative data analysis software version 7.5.15 , using a coding dictionary and thematic analysis techniques, as commonly described, to assess content validity [20,21,22,23,24,25] (further information provided in Additional file 2a).
Psychometric analysis of FACIT-fatigue in PsA
Subsequently to the qualitative assessment, a series of analyses assessed the quantitative psychometric properties of the FACIT-Fatigue scale, based on data from the phase III RCTs OPAL Broaden (NCT01877668)  and OPAL Beyond (NCT01882439) . These analyses were pre-specified in a psychometric statistical analysis plan.
OPAL Broaden was a 12-month RCT in patients with an inadequate response to ≥1 conventional synthetic disease-modifying antirheumatic drug (csDMARD) and who were tumor necrosis factor inhibitor (TNFi)-naive. Patients (n = 422) were randomized 2:2:2:1:1 to tofacitinib 5 mg twice daily (BID; n = 107), tofacitinib 10 mg BID (n = 104), adalimumab 40 mg once every 2 weeks (n = 106), placebo advancing to tofacitinib 5 mg BID at Month 3 (n = 52), or placebo advancing to tofacitinib 10 mg BID at Month 3 (n = 53) . OPAL Beyond was a 6-month RCT in patients who had an inadequate response to ≥1 TNFi (TNFi-IR). Patients (n = 395) were randomized 2:2:1:1 (394 patients received treatment) to tofacitinib 5 mg BID (n = 131; one patient randomized but not treated), tofacitinib 10 mg BID (n = 132), placebo advancing to tofacitinib 5 mg BID at Month 3 (n = 66), or placebo advancing to tofacitinib 10 mg BID at Month 3 (n = 65) . In both RCTs, patients received a stable background dose of one csDMARD.
FACIT-Fatigue data from both RCTs were pooled across all treatment groups to provide the largest sample size and response range to the individual items. Two different pooling strategies were used. Strategy 1: Pooled Data 1 (PD1; OPAL Beyond baseline data pooled with OPAL Broaden Month 12 [last study visit]; number of observations = 760, one observation per patient) and Pooled Data 2 (PD2; OPAL Broaden baseline data pooled with OPAL Beyond Month 6 [last study visit]; number of observations = 766, one observation per patient) were used in the cross-sectional analyses (i.e., internal consistency reliability, confirmatory analyses, and correlations). Strategy 2: for longitudinal analyses (i.e., test-retest, clinically important difference [CID], and responder definition [RD]), Pooled Data 3 (PD3) was used, corresponding to all available data from OPAL Broaden pooled longitudinally with all available data from OPAL Beyond.
Confirmatory factor analysis model
The FACIT-Fatigue measurement model was based on the conceptual framework and was represented by a second-order confirmatory factor analysis. This measurement model was evaluated using PD1 and PD2 and included the two FACIT-Fatigue scale scores and the total score. It was assumed that the latent construct “Experience” (represented by the first-order factor f1) affects items 1, 2, 3, 4, and 7 of FACIT-Fatigue and the latent construct “Impact” (represented by the first-order factor f2) affects all other nine items. The latent aggregated factor (represented by the second-order factor f3) affects “Experience” and “Impact” domains (Additional file 2: Figure S2 and factor loadings shown in Additional file 2: Figure S3).
Bentler’s Comparative Fit Index (CFI) was used to measure the fit of the model with the data. An acceptable fit was defined as: 1) CFI > 0.90; 2) unstandardized path coefficients are statistically significant (P value < 0.05); and 3) standardized path coefficients are > 0.40 and are statistically significant.
Internal consistency reliability
Cronbach’s Coefficient α assessed internal consistency reliability of FACIT-Fatigue, with good internal consistency defined as a Cronbach’s coefficient α ≥ 0.90 (Additional file 2d details FACIT-Fatigue conceptual framework).
Intraclass Correlation Coefficients (ICC) estimated test-retest reliability using baseline and Month 1 data. Because of the treatment intervention, a subgroup of “stable” patients was used in the analysis, with an ICC ≥ 0.70 defined as acceptable . To define a stable subgroup, the Patient’s Global Assessment (PtGA; a component of the Patient’s Global Joint and Skin Assessment) was used. PtGA was formulated as follows: “In all the ways in which your psoriasis and arthritis, as a whole, affects you, how would you rate the way you felt over the past week?”. PtGA is a Visual Analog Scale (VAS) from 0 mm (poor) to 100 mm (excellent). To estimate ICC in this analysis, it was assumed that a less than 10 mm difference at Month 1 from baseline represents a “stable” patient.
Evidence of convergent validity (the extent to which two concepts are related to one another ) was evaluated by correlation of the FACIT-Fatigue domain scores with other outcomes from the same studies (SF-36 domains, Itch Severity Item [ISI], Dermatology Life Quality Index [DLQI] total score, and Patient’s Global Assessment of Psoriasis and Arthritis [PtGA], Patient’s Skin Assessment [PtSA], and Patient’s Joint Assessment [PtJA], which are components of the Patient’s Global Joint and Skin Assessment – Visual Analog Scale [PtGJS-VAS]). Correlations of FACIT-Fatigue with these outcomes were expected to be ≥0.40, previously considered a moderate correlation .
Defining the clinically important difference for FACIT-fatigue domains
Clinically important difference (CID), the difference in scores between two treatment groups that is considered clinically relevant, was estimated using a repeated measures model (RMM), assessing the relationship between the PtGA score and FACIT-Fatigue domains in PD3. A domain (Impact or Experience) of FACIT-Fatigue (including total score) is the outcome, and PtGA is a continuous or categorical anchor (RMM-CID). SF-36 Vitality domain was also used as an anchor in additional sensitivity analyses.
When using PtGA as an anchor, it is important to note that it is a VAS; hence, there are no clear patient-selected categories to use as a basis to define a CID. If it is assumed that 100 mm VAS PtGA (used in OPAL Broaden and OPAL Beyond) can be linearly approximated by a 7-point scale (e.g., Patient Global Impression-Severity), then it can be assumed that a value of 17 mm could be representative of the one-category difference and could be used to estimate the CID for a FACIT-Fatigue domain (note that 17 mm = 100 mm/6, where 6 is the number of pairwise adjacent categories) (further details in Additional file 2a) [31, 32].
Defining the responder definition for FACIT-fatigue domains
Responder definition (RD), the amount of change an individual patient would have to report to indicate that a relevant treatment benefit has been experienced, was estimated using a RMM to assess the relationship between a new anchor, the “Subject Global Impression of Change” (SGIC) score with just three categories (“better”, “the same”, and “worse”), and FACIT-Fatigue domains in PD3 (RMM-RD) (further details in Additional file 2a).
Known-groups validity was evaluated based on a RMM-CID model by comparing FACIT-Fatigue scores between groups known to be different based on PtGA as the criteria. Ability to detect change was based on a RMM-CID model by examining the relationship between FACIT-Fatigue scores and PtGA. Patients were classified as “in remission/low disease” if they reported a score of 0 mm on the PtGA, and patients were classified as “active disease” if they reported a score of 100 mm.
Effect sizes were estimated by dividing the difference in score by standard deviation at baseline, and provide a general set of thresholds or benchmarks through adjectival descriptors on the difference between groups or impact of an intervention, with values of 0.2 generally regarded as “small,” 0.5 as “medium,” and 0.8 as “large”.
OPAL Broaden (NCT01877668)  and OPAL Beyond (NCT01882439)  were conducted in accordance with the International Conference on Harmonisation Good Clinical Practice Guidelines and the Declaration of Helsinki. The study protocols and all documentation were approved by the Institutional Review Boards or Independent Ethics Committees at each investigational site. All study procedures complied with current Health Insurance Portability and Accountability Act of 1996 (HIPAA) regulations. All recruitment locations were approved by a central institutional review board (E&I IRB #2 – IRB00007807), and all recruitment procedures adhered to the IRB-approved study protocol. All patients provided written informed consent.
Qualitative FACIT-fatigue study
In total, 12 interviews were conducted in February 2017 at two clinical sites (Florida, n = 7; Pennsylvania, n = 5). The mean age (standard deviation; SD [range]) of patients was 53 (14 [27–80]) years, 6 (50%) patients were male, and 11 (92%) were white. The mean time since diagnosis of PsA (SD [range]) was approximately 10 (9 [1–29]) years. Most patients (n = 10, 83%) were currently taking medication/treatment for PsA, including methotrexate (n = 5, 42%), adalimumab, etanercept, secukinumab (each n = 2, 17%), and others (n = 3, 30%).
PsA symptoms, concept elicitation
As part of the concept elicitation portion of the interview (part 1; Additional file 2b), patients were asked to rate the severity of their PsA and then to rank the importance of their symptoms.
PsA severity was highly variable, described by patients as mild (n = 3, 25%), mild to moderate (n = 1, 7%), moderate (n = 3, 25%), moderate to severe (n = 2, 17%), sometimes moderate and sometimes severe (n = 1, 7%), severe at first but diminished (n = 1, 7%), or severe (n = 1, 8%). PsA signs/symptoms experienced over the past 7 days were fatigue (n = 12, 100%), pain (in joints, tendons, or entheses; n = 11, 92%), skin-related symptoms (itch, dryness, scaling, redness, bleeding, inflammation, or painful skin; n = 9, 75%), joint stiffness (any part of body; n = 7, 58%), dactylitis (swelling of entire fingers or toes; n = 6, 50%), swelling in other parts of body (n = 4, 33%), and other symptoms (n = 7, 58%). Seven patients (58%) decisively attributed fatigue to PsA.
Patients ranked each symptom relative to their other symptoms from 0 to 4 (0 is “not important at all”; 4 is “extremely important”). Symptoms rated as “important” or “extremely important” are presented in Table 1.
FACIT-fatigue qualitative interview
Subsequently to the concept elicitation portion of the interview, the cognitive portion of the interview (part 2) asked patients to complete the FACIT-Fatigue questionnaire and to provide feedback.
Mean total FACIT-Fatigue score (SD [range]) was 27.1 (10.8 [13–44]) out of a possible maximum score of 52, with this low value, relative to the total score, indicating higher fatigue. Mean Experience domain (SD [range]) score was 7.4 (4.4 [1–15]; highest possible score 20), and average Impact domain score (SD [range]) was 19.7 (6.8 [12–29]; highest possible score 32). During the FACIT-Fatigue interview, patients with PsA generally provided positive feedback on the instrument. All 12 patients commented that completing the questionnaire was “quick,” “easy,” “straightforward,” and “fine” and found the instructions, item wording, and response options clear and easily understood. Overall impressions of the items were favorable, although one patient indicated that the first four items were repetitive (fatigued, weak all over, listless [washed out], tired).
The recall period (past 7 days) was correctly understood by most patients (n = 7, 58%); however, other patients (n = 5, 42%) did not use the correct recall period, instead reporting their fatigue experiences over the “past month”, “in general”, “today”, “yesterday”, “all the time”, and “during the day”. Two of these patients reported that they read the instructions but decided to consider a different recall period for their answers. Most patients considered FACIT-Fatigue items 1–9 and 12 (range n = 10 [83%] to n = 12 [100%]) to be relevant to their experience with PsA. Items 11 “I need help doing my usual activities” and 13 “I have to limit my social activity because I am tired” were considered relevant by nine patients each (75%). Item 10 “I am too tired to eat” was not considered relevant by eight patients (67%).
Most patients (n = 9, 75%) reported that there were no important fatigue-related concepts missing from the questionnaire. The remaining three patients (25%) provided suggestions for improvements to existing items, and for additional items/concepts, including making a distinction between physical and mental fatigue (n = 2) and asking patients how they relieve their fatigue. One patient suggested incorporating questions that addressed the mental and emotional aspect of PsA.
As most patients reported that no important fatigue-related concepts were missing and did not suggest any additional items to be assessed, no changes to the FACIT-Fatigue items and response options were recommended.
Psychometric analysis of FACIT-fatigue in PsA
Confirmatory analysis model
The FACIT-Fatigue measurement model was tested using confirmatory factor analysis, which included two first-order factors (representing Experience and Impact domains) and one aggregated second-order factor (representing total score). CFI indices were 0.92 and 0.93 for PD1 and PD2, respectively, and standardized factor loadings were > 0.4 for all items.
Internal consistency reliability
Cronbach’s Coefficient α was ≥0.90 for the FACIT-Fatigue total score, Impact domain, and Experience domain for both PD1 and PD2 (Table 2). All corrected item-to-total correlations were > 0.40 (range 0.42–0.89).
An acceptable test-retest reliability was observed for FACIT-Fatigue Experience domain (ICC = 0.80), Impact domain (0.83), and total score (0.83) using pooled data from the OPAL Broaden and OPAL Beyond RCTs. Test-retest reliability assessments for each separate RCT were also acceptable (Additional file 3).
The correlation between the FACIT-Fatigue domains and other scales used in phase III RCTs was estimated using PD1 and PD2. With the exception of the Health Transition Item (which has a recall period of 1 year), correlations between FACIT-Fatigue and SF-36 domains generally exceeded 0.60 (all were > 0.50; P < 0.0001; Table 3). The correlation between FACIT-Fatigue total score and Experience domain and SF-36 Vitality domain was > 0.80 (P < 0.0001). FACIT-Fatigue domain scores also correlated with ISI, DLQI total score, PtGA, PtSA, and PtJA (correlations > 0.4).
Defining the clinically important difference for FACIT-fatigue domains
CID for FACIT-Fatigue was defined by employing a longitudinal RMM to estimate the relationship between PtGA score and FACIT-Fatigue domains, and linked to a 17 mm change (one category difference on a 7-point scale) on the PtGA. Pooled data showed that PtGA had a substantial correlation with FACIT-Fatigue domains at all time points (with values between 0.5 and 0.7 for post-treatment time points) and with correlations < 0.5 at baseline.
The CID for the FACIT-Fatigue total score was 3.1, and for FACIT-Fatigue Experience and Impact domains was estimated to be 1.5 and 1.7, respectively (Table 4). In the sensitivity analysis, CIDs for each RCT were similar.
Estimation of the responder definition for FACIT-fatigue domains
A RMM was applied to estimate RD and examine the relationship between FACIT-Fatigue domains and SGIC score as the anchor (see Additional file 2a). SGIC is based on PtGA change from baseline, but has only three categories: “worse” (change from baseline ≥10 mm; value of − 1), “the same” (change from baseline < 10 mm; value of 0), and “better” (change from baseline ≤ − 10 mm; value of + 1).
RD for the FACIT-Fatigue total score was 3.8, and estimated to be 1.7 and 2.1 for FACIT-Fatigue Experience and Impact domains, respectively. In the sensitivity analysis, RDs for the individual RCTs were similar (Table 4). As a whole number would need to be assigned to denote improvement in an individual, this would therefore appear as 4 points for the FACIT-Fatigue total score, and 2 points for each of the domain scores.
The known-groups validity analysis was based on a RMM-CID model and evaluated by analyzing the differences in mean FACIT-Fatigue domain scores between the “remission/low disease activity group” (PtGA score of 0 mm, i.e., “excellent”) and the “active disease group” (PtGA score of 100 mm, i.e., “poor”). Differences in the FACIT-Fatigue domain scores and total score between “remission/low disease activity group” and the “active disease group” were statistically different; effect sizes of all differences considered large (all > 1.4), constituting a significant and considerable difference between the groups (Table 5).
Ability to detect change
The ability to detect change analysis was based on a RMM-CID model. Figure 1 compares changes in FACIT-Fatigue total scores with changes in the PtGA scores, and indicates that a patient’s state (as measured by FACIT-Fatigue) changes with respect to the PtGA.
Fatigue is recommended as a core domain to measure in RCTs evaluating treatment effects for psoriatic arthritis . This study evaluated the content validity and quantitative measurement properties to assess whether FACIT-Fatigue is fit for purpose as a measure to evaluate this important domain in RCTs in patients with PsA. The US Food and Drug Administration (FDA) patient-reported outcome (PRO) guidance adds that for labeling claims, adequate evidence is required to support the content validity, construct validity, reliability, and ability of the measure to detect change in the target population of interest . This mixed-methods study evaluated these qualitative and quantitative measurement properties of the FACIT-Fatigue in patients with PsA.
All patients reported experiencing several factors related to their fatigue, which impacted their daily life (e.g., social, psychological, and physical function). This confirms the importance of fatigue symptoms in patients with PsA, consistent with other studies that identify improvements in fatigue as a key outcome signifying improvement in their condition [4, 33, 34]. Furthermore, the reliability of reporting the physical and mental concepts of FACIT-Fatigue (Impact and Experience domains) is also consistent with the reliability of these concepts in other patients with other conditions, such as spinal cord injuries .
Overall, patients provided positive feedback on the FACIT-Fatigue questionnaire, believing it was comprehensive and relevant to their experience of fatigue with PsA. Results were similar to a study in patients with RA, where 15 of 17 patients stated that FACIT-Fatigue items were relevant to them.  Notably, item 10 “I am too tired to eat” was considered the least relevant item in both this study (8/12 patients, 67%) and the study in RA (9/17 patients, 53%) . In this study, the instructions, item concepts, and response options were well-understood by most patients. Most correctly understood the recall period; however, some did not use the correct recall period. Overall, no changes to the FACIT-Fatigue items and response options were recommended.
In the psychometric analysis of RCT data in patients with PsA, the second-order confirmatory factor analysis model supported the measurement model of the FACIT-Fatigue scale. Good internal consistency reliability was seen in FACIT-Fatigue; Cronbach’s Coefficient α’s were ≥ 0.90, and all corrected item-to-total correlations were > 0.4. The ability to detect change, while part of instrument validity , is of sufficient importance to PRO measurement in longitudinal studies that it may be analyzed separately [28, 37], as done here. These findings demonstrated the sensitivity of FACIT-Fatigue to changes in PtGA scores. Results provided evidence that FACIT-Fatigue is equally sensitive to increases and decreases in PtGA scores, showing that when a patient’s experience of fatigue is predicted to change (i.e., change in severity of illness measured by PtGA), the values for FACIT-Fatigue also change. The test-retest reliability analysis observed an acceptable ICC (≥ 0.80) for all FACIT-Fatigue domains.
FACIT-Fatigue Impact and Experience domains were observed to correlate with almost all measured outcomes, suggesting that the physical and mental impacts of fatigue are closely linked to patient perception of PsA. Furthermore, FACIT-Fatigue total score was observed to correlate strongly (r > 0.80) with the SF-36 Vitality domain. As both fatigue and dermatological symptoms improve with PsA therapies (e.g., etanercept or adalimumab) [38, 39], it was expected here that FACIT-Fatigue scores would correlate with dermatological scores. However, ISI, DLQI, and PtSA scores (− 0.37 to − 0.48) were numerically lower than the correlations of FACIT-Fatigue scores with PtJA scores (− 0.57 to − 0.65), potentially indicating that FACIT-Fatigue is more related and sensitive to the effects of arthritis than psoriasis.
Different terms and approaches have been used to characterize and formulate a CID (between-group difference) and RD (within-individual or within-group change) for PROs [40, 41], and some have been used in rheumatology [42, 43]. Here, the CID of FACIT-Fatigue is the clinically relevant difference in scores between two treatment groups, and the RD is the amount of improvement an individual patient would have to report to indicate experience of a relevant treatment benefit. It is therefore akin to a CID that has been reported in rheumatology [42, 43]. RD was estimated using a RMM, based on the algorithm recommended in the FDA guidance .
FACIT-Fatigue domain scores were significantly different between the “remission/low disease activity group” and the “active disease group”, corroborating known-groups validity. The CID was defined using PtGA as an anchor and for the FACIT-Fatigue total score was 3.1. This is consistent with the value of 3–4 points reported in patients with other diseases, including cancer and RA [12, 44]. The RD for the FACIT-Fatigue total score was estimated to be a 4-point improvement, based on the average 3.8-point improvement associated with SGIC improvement. Overall, results were highly consistent with previous findings for FACIT-Fatigue [12, 15].
The 13 items of FACIT-Fatigue are also embedded in the Patient-Reported Outcomes Measurement Information System® (PROMIS®) Fatigue item bank, a 95-item fatigue assessment tool. This can be used as either a computerized adaptive test or a fixed-length short form, and was designed to compare differences across a range of chronic conditions, enabling comparative effectiveness research . The use of fatigue short forms from PROMIS has been validated in RA , and the current research provides strong evidence supporting the validity of the FACIT-Fatigue scale and its measurement properties in patients with PsA, which opens up the possibility for including PsA data in the unifying PROMIS metric.
Advantages/strengths of this study included the self-reported nature of the PRO measures, and the systematic collection of clinical and PRO data. Moreover, patients’ demographic and disease characteristics were well balanced. However, as data were taken from RCTs with specific eligibility criteria, generalizing these data to real-world populations may not be possible. Test-retest reliability, performed separately for OPAL Broaden and OPAL Beyond, confirmed the acceptability of the test-retest reliability from the pooled results.
Limitations of these analyses include that estimated CID (between-group difference) and RD (within-individual or within-group change) may vary due to different methodology and natural sampling variation, along with other considerations, and may not necessarily represent a minimal value . Furthermore, changes in the anchor measures may not fully reflect CID in FACIT-Fatigue. Moreover, it would have been desirable to perform test-retest reliability assessments before treatment (i.e., during the screening [test] visit, and baseline [retest] visit); however, as these assessments were not available, test-retest reliability was performed in a stable group of patients at baseline and Month 1 (based on a < 10 mm difference in PtGA from baseline to Month 1), and provided the largest number of patients within the shortest possible time period.
It should be noted that in the qualitative interviews, the reported range of scores (range 13–44) did not include those for the most severe fatigue; therefore, concepts considered not relevant (e.g., “I’m too tired to eat”) may remain relevant in patients with more severe fatigue. It also remains unclear how specific the patient feedback reported in this study is to the FACIT-Fatigue measure, or if this is also applicable to similar measures (e.g., Multidimensional Assessment of Fatigue). Furthermore, use of pooled data from two RCTs with different eligibility criteria, and use of different time points from each study, may confound the results.
In summary, the findings of this study, including analyses performed for the first time using data from RCTs in PsA, suggest that the content of the FACIT-Fatigue scale is valid for use as an endpoint to measure fatigue in PsA RCTs. Qualitative interviews demonstrated that fatigue was an important symptom to patients with PsA, and the FACIT-Fatigue scale was capable of effectively capturing the relevant and important concepts of fatigue in this patient population. Analysis of FACIT-Fatigue data from two PsA RCTs showed good content validity and reliability, and a strong correlation with other disease measures. These conclusions, in conjunction with confirmations of CID and RD consistent with previous findings, support the use of FACIT-Fatigue in PsA RCTs.
ClASsification criteria for psoriatic arthritis
Comparative fit index
Clinically important difference
Conventional synthetic disease-modifying antirheumatic drug
Dermatology life quality index
Functional Assessment of Chronic Illness Therapy-Fatigue
US food and drug administration
Health insurance portability and accountability act of 1996
Intraclass correlation coefficients
Institutional review board
Itch severity item
- PROMIS® :
Patient-reported outcomes measurement information system®
Patient’s global assessment of psoriasis and arthritis
Patient’s global joint and skin assessment – visual analog scale
Patient’s joint assessment
Patient’s skin assessment
Randomized controlled trial
Short form survey-36
Subject global impression of change
Tumor necrosis factor inhibitor
Gladman, D. D., Antoni, C., Mease, P., Clegg, D. O., & Nash, P. (2005). Psoriatic arthritis: Epidemiology, clinical features, course, and outcome. Annals of the Rheumatic Diseases, 64(Suppl 2), ii14–ii17.
Coates, L. C., Kavanaugh, A., Mease, P. J., Soriano, E. R., Laura Acosta-Felquer, M., Armstrong, A. W., et al. (2016). Group for Research and Assessment of psoriasis and psoriatic arthritis 2015 treatment recommendations for psoriatic arthritis. Arthritis & Rhematology, 68(5), 1060–1071.
Gudu, T., Etcheto, A., de Wit, M., Heiberg, T., Maccarone, M., Balanescu, A., et al. (2016). Fatigue in psoriatic arthritis - a cross-sectional study of 246 patients from 13 countries. Joint, Bone, Spine, 83(4), 439–443. https://doi.org/10.1016/j.jbspin.2015.07.017.
Orbai, A. M., de Wit, M., Mease, P., Shea, J. A., Gossec, L., Leung, Y. Y., et al. (2017). International patient and physician consensus on a psoriatic arthritis core outcome set for clinical trials. Annals of the Rheumatic Diseases, 76(4), 673–680.
Orbai, A. M., de Wit, M., Mease, P. J., Callis Duffin, K., Elmamoun, M., Tillett, W., et al. (2017). Updating the psoriatic arthritis (PsA) Core domain set: A report from the PsA workshop at OMERACT 2016. The Journal of Rheumatology, 44(10), 1522–1528.
Gladman, D., Fleischmann, R., Coteur, G., Woltering, F., & Mease, P. J. (2014). Effect of certolizumab pegol on multiple facets of psoriatic arthritis as reported by patients: 24-week patient-reported outcome results of a phase III, multicenter study. Arthritis Care and Research, 66(7), 1085–1092.
Strand, V., Schett, G., Hu, C., & Stevens, R. M. (2013). Patient-reported health-related quality of life with apremilast for psoriatic arthritis: A phase II, randomized, controlled study. The Journal of Rheumatology, 40(7), 1158–1165.
Strand, V., Mease, P., Gossec, L., Elkayam, O., van den Bosch, F., Zuazo, J., et al. (2017). Secukinumab improves patient-reported outcomes in subjects with active psoriatic arthritis: Results from a randomised phase III trial (FUTURE 1). Annals of the Rheumatic Diseases, 76(1), 203–207.
FDA. Guidance for industry patient-reported outcome measures: Use in medical product development to support labeling claims. 2009. https://www.fda.gov/downloads/drugs/guidances/ucm193282.pdf. Accessed 18 Jan 2019.
Revicki, D., Cella, D., Hays, R., Sloan, J., Lenderking, W., Aaronson, N. (2006) Responsiveness and minimal important differences for patient reported outcomes. Health and Quality of Life Outcomes, 4(70). http://www.hqlo.com/content/4/1/70
Revicki, D. A., Osoba, D., Fairclough, D., Barofsky, I., Berzon, R., Leidy, N. K., et al. (2000). Recommendations on health-related quality of life research to support labeling and promotional claims in the United States. Quality of Life Research, 9(8), 887–900.
Cella, D., Yount, S., Sorensen, M., Chartash, E., Sengupta, N., & Grober, J. (2005). Validation of the functional assessment of chronic illness therapy fatigue scale relative to other instrumentation in patients with rheumatoid arthritis. The Journal of Rheumatology, 32(5), 811–819.
Pouchot, J., Kherani, R. B., Brant, R., Lacaille, D., Lehman, A. J., Ensworth, S., et al. (2008). Determination of the minimal clinically important difference for seven fatigue measures in rheumatoid arthritis. Journal of Clinical Epidemiology, 61(7), 705–713.
Chandran, V., Bhella, S., Schentag, C., & Gladman, D. D. (2007). Functional Assessment of Chronic Illness Therapy-Fatigue scale is valid in patients with psoriatic arthritis. Annals of the Rheumatic Diseases, 66(7), 936–939.
Yellen, S. B., Cella, D. F., Webster, K., Blendowski, C., & Kaplan, E. (1997). Measuring fatigue and other anemia-related symptoms with the functional assessment of Cancer therapy (FACT) measurement system. Journal of Pain and Symptom Management, 13(2), 63–74.
Cella, D., Lai, J. S., & Stone, A. (2011). Self-reported fatigue: One dimension or more? Lessons from the functional assessment of chronic illness therapy--fatigue (FACIT-F) questionnaire. Supportive Care in Cancer: Official Journal of the Multinational Association of Supportive Care in Cancer, 19(9), 1441–1450. https://doi.org/10.1007/s00520-010-0971-1.
Rothman, M., Burke, L., Erickson, P., Leidy, N. K., Patrick, D. L., & Petrie, C. D. (2009). Use of existing patient-reported outcome (PRO) instruments and their modification: The ISPOR good research practices for evaluating and documenting content validity for the use of existing instruments and their modification PRO task force report. Value in Health, 12(8), 1075–1083. https://doi.org/10.1111/j.1524-4733.2009.00603.x.
Kaiser, K., Shaunfield, S., Clayman, M. L., Ruderman, E., & Cella, A. (2016). Content validation of the functional assessment of chronic illness therapy (FACIT)-fatigue scale in moderately to highly active rheumatoid arthritis. Rheumatology Current Research, 6(2). https://doi.org/10.4172/2161-1149.1000193
Friese, S., & Ringmayr, T. (2013). ATLAS.ti 7 user guide and reference. Berlin: ATLAS.ti Scientific Software Development GmBH.
Willis, G. (2015). Analysis of the cognitive interview in questionnaire design. Understanding qualitative research. New York: Oxford University Press.
Welch, L. C., Trudeau, J. J., Silverstein, S. M., Sand, M., Henderson, D. C., & Rosen, R. C. (2017). Initial development of a patient-reported outcome measure of experience with cognitive impairment associated with schizophrenia. Patient Related Outcome Measures, 8, 71–81. https://doi.org/10.2147/PROM.S123266.
Patrick, D. L., Burke, L. B., Gwaltney, C. J., Leidy, N. K., Martin, M. L., Molsen, E., et al. (2011). Content validity—Establishing and reporting the evidence in newly developed patient-reported outcomes (PRO) instruments for medical product evaluation: ISPOR PRO good research practices task force report: Part 1—Eliciting concepts for a new PRO instrument. Value in Health, 14(8), 967–977. https://doi.org/10.1016/j.jval.2011.06.014.
Patrick, D. L., Burke, L. B., Gwaltney, C. J., Leidy, N. K., Martin, M. L., Molsen, E., et al. (2011). Content validity—Establishing and reporting the evidence in newly developed patient-reported outcomes (PRO) instruments for medical product evaluation: ISPOR PRO good research practices task force report: Part 2—Assessing respondent understanding. Value in Health, 14(8), 978–988. https://doi.org/10.1016/j.jval.2011.06.013.
Boeije, H. (2002). A purposeful approach to the constant comparative method in the analysis of qualitative interviews. Quality and Quantity, 36(4), 391–409. https://doi.org/10.1023/A:1020909529486.
Leidy, N. K., & Vernon, M. (2008). Perspectives on patient-reported outcomes : Content validity and qualitative research in a changing clinical trial environment. Pharmacoeconomics, 26(5), 363–370.
Mease, P., Hall, S., Fitzgerald, O., van der Heijde, D., Merola, J. F., Avila-Zapata, F., et al. (2017). Tofacitinib or adalimumab versus placebo for psoriatic arthritis. The New England Journal of Medicine, 377(16), 1537–1550.
Gladman, D., Rigby, W., Azevedo, V. F., Behrens, F., Blanco, R., Kaszuba, A., et al. (2017). Tofacitinib for psoriatic arthritis in patients with an inadequate response to TNF inhibitors. The New England Journal of Medicine, 377(16), 1525–1536.
Reeve, B. B., Wyrwich, K. W., Wu, A. W., Velikova, G., Terwee, C. B., Snyder, C. F., et al. (2013). ISOQOL recommends minimum standards for patient-reported outcome measures used in patient-centered outcomes and comparative effectiveness research. Quality of Life Research, 22(8), 1889–1905. https://doi.org/10.1007/s11136-012-0344-y.
McDowell, I. (2006). Measuring health: A guide to rating scales and questionnaires. USA: Oxford University Press.
Tveter, A. T., Dagfinrud, H., Moseng, T., & Holm, I. (2014). Measuring health-related physical fitness in physiotherapy practice: Reliability, validity, and feasibility of clinical field tests and a patient-reported measure. The Journal of Orthopaedic and Sports Physical Therapy, 44(3), 206–216. https://doi.org/10.2519/jospt.2014.5042.
Norman, G. R., Sloan, J. A., & Wyrwich, K. W. (2003). Interpretation of changes in health-related quality of life: The remarkable universality of half a standard deviation. Medical Care, 41(5), 582–592. https://doi.org/10.1097/01.Mlr.0000062554.74615.4c.
Norman, G. R., Sloan, J. A., & Wyrwich, K. W. (2004). The truly remarkable universality of half a standard deviation: Confirmation through another look. Expert Review of Pharmacoeconomics & Outcomes Research, 4(5), 581–585. https://doi.org/10.1586/1473718.104.22.1681.
Overman, C. L., Kool, M. B., da Silva, J. A., & Geenen, R. (2016). The prevalence of severe fatigue in rheumatic diseases: An international study. Clinical Rheumatology, 35(2), 409–415.
Gossec, L., de Wit, M., Kiltz, U., Braun, J., Kalyoncu, U., Scrivo, R., et al. (2014). A patient-derived and patient-reported outcome measure for assessing psoriatic arthritis: Elaboration and preliminary validation of the psoriatic arthritis impact of disease (PsAID) questionnaire, a 13-country EULAR initiative. Annals of the Rheumatic Diseases, 73(6), 1012–1019.
Palimaru, A. I., Cunningham, W. E., Dillistone, M., Vargas-Bustamante, A., Liu, H., & Hays, R. D. (2018). Development and psychometric evaluation of a fatigability index for full-time wheelchair users with spinal cord injury. Archives of Physical Medicine and Rehabilitation. https://doi.org/10.1016/j.apmr.2018.04.003.
Hays, R. D., & Hadorn, D. (1992). Responsiveness to change: An aspect of validity, not a separate dimension. Quality of Life Research, 1(1), 73–75.
Mokkink, L. B., Terwee, C. B., Patrick, D. L., Alonso, J., Stratford, P. W., Knol, D. L., et al. (2010). The COSMIN study reached international consensus on taxonomy, terminology, and definitions of measurement properties for health-related patient-reported outcomes. Journal of Clinical Epidemiology, 63(7), 737–745. https://doi.org/10.1016/j.jclinepi.2010.02.006.
Gladman, D. D., Bombardier, C., Thorne, C., Haraoui, B., Khraishi, M., Rahman, P., et al. (2011). Effectiveness and safety of etanercept in patients with psoriatic arthritis in a Canadian clinical practice setting: The REPArE trial. The Journal of Rheumatology, 38(7), 1355–1362. https://doi.org/10.3899/jrheum.100698.
Paul, C., van de Kerkhof, P., Puig, L., Unnebrink, K., Goldblum, O., & Thaci, D. (2012). Influence of psoriatic arthritis on the efficacy of adalimumab and on the treatment response of other markers of psoriasis burden: Subanalysis of the BELIEVE study. European Journal of Dermatology, 22(6), 762–769. https://doi.org/10.1684/ejd.2012.1863.
Sloan, J. A., Cella, D., & Hays, R. D. (2005). Clinical significance of patient-reported questionnaire data: Another step toward consensus. Journal of Clinical Epidemiology, 58(12), 1217–1219.
Revicki, D., Hays, R. D., Cella, D., & Sloan, J. (2008). Recommended methods for determining responsiveness and minimally important differences for patient-reported outcomes. Journal of Clinical Epidemiology, 61(2), 102–109.
Beaton, D. E., Bombardier, C., Katz, J. N., Wright, J. G., Wells, G., Boers, M., et al. (2001). Looking for important change/differences in studies of responsiveness. OMERACT MCID working group. Outcome measures in rheumatology. Minimal clinically important difference. The Journal of Rheumatology, 28(2), 400–405.
Wells, G., Beaton, D., Shea, B., Boers, M., Simon, L., Strand, V., et al. (2001). Minimal clinically important differences: Review of methods. The Journal of Rheumatology, 28(2), 406–412.
Cella, D., Eton, D. T., Lai, J. S., Peterman, A. H., & Merkel, D. E. (2002). Combining anchor and distribution-based methods to derive minimal clinically important differences on the functional assessment of Cancer therapy (FACT) anemia and fatigue scales. Journal of Pain and Symptom Management, 24(6), 547–561.
Cella, D., Lai, J. S., Jensen, S. E., Christodoulou, C., Junghaenel, D. U., Reeve, B. B., et al. (2016). PROMIS fatigue item Bank had clinical validity across diverse chronic conditions. Journal of Clinical Epidemiology, 73, 128–134.
Bartlett, S. J., Gutierrez, A. K., Butanis, A., Bykerk, V. P., Curtis, J. R., Ginsberg, S., et al. (2018). Combining online and in-person methods to evaluate the content validity of PROMIS fatigue short forms in rheumatoid arthritis. Quality of Life Research. https://doi.org/10.1007/s11136-018-1880-x.
Editorial support under the guidance of the authors was provided by Paul Scutt, PhD, of CMC Connect, a division of Complete Medical Communications Ltd., Macclesfield, UK and was funded by Pfizer Inc., New York, NY, USA in accordance with Good Publication Practice (GPP3) guidelines (Ann Intern Med 2015;163:461–464). The authors would like to thank Dr. Vibeke Strand for her critical review of this manuscript.
This study was funded by Pfizer Inc.
Availability of data and materials
The data collected during this study is kept in a locked, secure facility and is unavailable to the public due to confidentiality concerns. Reasonable requests to review the data for scientific and/or research purposes may be considered.
Ethics approval and consent to participate. Ethical & Independent Review (E&I) Services approved the research study (study #16154) on January 24th, 2017. IRB Approval number #IRB00007807. Written informed consent was obtained for all study participants prior to participation in the research.
No consent for publication is required.
Ethics approval and consent to participate
The study protocols and all documentation were approved by the Institutional Review Boards or Independent Ethics Committees at each investigational site. All patients provided written informed consent.
Consent for publication
David Cella has served on the board of directors for Cancer Wellness Center, and PROMIS Health Organization, has received consultancy fees of <$10,000 from AbbVie, Alexion Pharmaceuticals, Astellas Pharma, Bayer AG, Bristol-Myers Squibb, Celgene Corporation, Clovis Oncology Inc., Evidera, Exelixis Inc., FibroGen Inc., Helsinn Therapeutics (U.S.) Inc., Horizon Pharma Inc., ImmunoGen Inc., Janssen Pharmaceuticals Inc., Merck/Schering-Plough Pharmaceuticals, National Academy of Sciences, Novartis Pharma K.K. (Japan), PatientsLikeMe, Pfizer Inc., Pled Pharma, Puma Biotechnology Inc., Regeneron Pharmaceuticals Inc., and Shire PLC, and has ownership or investment interests in FACITtrans LLC (FACIT.org), and Functional Assessment of Chronic Illness Therapy (FACIT.org). Hilary Wilson, Huda Shalhoub and Dennis A. Revicki are employees of Evidera Inc. Joseph C. Cappelleri, Andrew G. Bushmakin, Elizabeth Kudlacz and Ming-Ann Hsu are employees of Pfizer Inc. and own stock in Pfizer Inc.
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
The publisher has retracted this article because the incorrect version of the article was published in error. The manuscript has been republished. The republished article includes links to this retraction. Springer Nature apologises to readers. All authors agree to this retraction.
About this article
Cite this article
Cella, D., Wilson, H., Shalhoub, H. et al. RETRACTED ARTICLE: Content validity and psychometric evaluation of Functional Assessment of Chronic Illness Therapy-Fatigue in patients with psoriatic arthritis. J Patient Rep Outcomes 3, 5 (2019). https://doi.org/10.1186/s41687-019-0094-5
- Psoriatic arthritis
- Content validity
- Psychometric properties