Skip to content

Advertisement

  • Research
  • Open Access

Patient experience in systemic lupus erythematosus: development of novel patient-reported symptom and patient-reported impact measures

  • 1Email author,
  • 2,
  • 3,
  • 3,
  • 1,
  • 2 and
  • 4
Journal of Patient-Reported Outcomes20182:11

https://doi.org/10.1186/s41687-018-0028-7

  • Received: 8 February 2017
  • Accepted: 4 October 2017
  • Published:

Abstract

Background

Comprehensive assessment of systemic lupus erythematosus (SLE) and its treatment requires patient-reported outcome (PRO) measures to capture impacts and fluctuating symptoms. The objective of this study was to develop PROs, in accordance with the Food and Drug Administration (FDA) PRO Guidance, to assess fluctuations in SLE symptoms and its impact.

Methods

Following independent review board approval, six US rheumatology practices recruited patients with SLE to participate in concept elicitation (CE) interviews, in order to identify important SLE symptoms and their impacts. The SLE Symptom Severity Diary (SSD) and SLE Impact Questionnaire (SIQ) were drafted based on CE interview results and clinician input. The PROs were revised based on patient feedback from cognitive debriefing (CD) interviews, clinician feedback, and a translatability assessment.

Results

Forty-one patients completed CE interviews. Commonly-reported symptoms included fatigue (98%), joint pain (93%), and rash (88%). The most frequently reported impact was difficulty with chores/housework (61%). Eighteen patients completed CD interviews. The PROs were considered comprehensive, clear, and relevant.

The SSD contains 17 items assessing energy/vitality, joint and muscle pain/stiffness/swelling, flu-like symptoms, cognition, numbness/tingling, skin symptoms and hair loss using an 11-point numeric response scale and a 24-h recall period (with the exception of hair loss). It also evaluates steroid status and dose. The SIQ contains 50 items, uses a 5-point Likert scale and a 7-day recall period, to assess disease impacts including patients’ ability to make plans, work, and physical/social/emotional functioning.

Conclusion

The SSD and SIQ are comprehensive SLE-specific PROs developed in accordance with the FDA PRO Guidance. Following assessment of their measurement properties, they may be useful in clinical studies and clinical practice to measure fluctuations in, and the impact of, symptoms in patients with SLE.

Keywords

  • Patient experience
  • Patient-reported outcomes
  • Questionnaire
  • Systemic lupus erythematosus
  • Symptoms

Background

Systemic lupus erythematosus (SLE) is a complex, chronic disease characterized by fluctuating symptoms, flares and remissions [1]. As recognized by the Food and Drug Administration (FDA) [2] and European Medicines Agency (EMA) [3], clinical and laboratory measures of SLE disease severity do not assess the impact of symptom- and treatment-related effects of SLE on patients’ daily lives. Therefore, reliable patient-reported outcome (PRO) measures are important tools in both SLE clinical studies and clinical practice to enable comprehensive assessment of the disease and its treatments.

The FDA PRO Guidance recommends using an iterative process, including concept elicitation (CE) and cognitive debriefing (CD) interviews, in order to gain substantial input from patients who are representative of the target population in which the tool is intended to be used [4]. To determine the content of the PRO, CE interviews assist in identifying the concepts that are most important and relevant to the target population [5]. Through CD interviews, drafts of the PRO should be evaluated by patients to assess their understanding of the PRO and to gain feedback on the content, format, recall period, and response options [6]. In combination with results from CD interviews, clinician assessment of the PRO should be used to revise and refine the PRO.

When using a PRO endpoint in a clinical trial as an assessment of treatment benefit, the FDA requires extensive documented evidence that clearly demonstrates the PRO development process followed best measurement science, that the tool is content valid in the target population, and that it has adequate measurement properties, a scoring algorithm and a responder definition (i.e., the individual patient PRO score change over a predetermined time period that should be interpreted as a treatment benefit) [46]. The required evidence can be summarized in a PRO Evidence Dossier, the elements of which have been described previously [47]. For our intended clinical trial, a PRO measure of SLE symptoms and impacts is required, which includes concepts that are evaluative in nature, and could potentially be impacted by treatment during the course of an interventional clinical trial. Therefore, this study aimed to develop comprehensive PRO measures, primarily for use in clinical research and, following further development, for use in clinical practice to assess symptoms and impacts of SLE.

In the first part of this study, a detailed literature review identified numerous generic and disease-specific PROs used in patients with SLE; however, none were found to meet our needs, either due to a lack of evidence to satisfy the FDA requirements (many were developed prior to the FDA PRO Guidance) or due to inadequate assessment of all symptoms and impacts of SLE that are likely to be impacted by treatment. Therefore, the second part of this study aimed to develop comprehensive PRO measures to assess symptoms and impacts of SLE.

Methods

Study design

A detailed research protocol was developed in accordance with best measurement science (Fig. 1) [46]. Independent review board (IRB) approval (Copernicus Group) was obtained.
Fig. 1
Fig. 1

PRO development process. aDistinct groups of patients participated in the CE and CD interviews. CD, cognitive debriefing; CE, concept elicitation; ePRO, electronic patient reported outcome; FDA, Food and Drug Administration; IRB, internal review board; PRO, patient-reported outcome; SIQ, SLE Impact Questionnaire; SSD, SLE Symptom Severity Diary

Literature review

A comprehensive literature review was undertaken in 2012 (and updated in 2013) to determine if there was an available PRO developed with significant input from patients with SLE that would capture the daily variability in symptoms and disease impacts (data on file). The literature search identified published articles (PubMed, EMBASE), conference abstracts (scientific meeting abstracts from the American College of Rheumatology [ACR] and International Society for Quality of Life Research annual scientific meetings from the previous 2 years) and clinical studies from the previous 5 years (ClinicalTrials.gov database) that included a PRO or disease activity index and patients with SLE. Since the initial literature search was undertaken, PubMed had been monitored (2013–present) for any new, relevant articles.

Study population

Between May and July 2014, a convenience sample of patients was recruited from six rheumatology practices from a wide geographic area of the US (California, New Jersey, Michigan, Georgia, Florida, and Virginia); recruitment took place at the clinic or via telephone. Patients were US residents, 18–75 years of age, had a clinical diagnosis of SLE according to the ACR classification criteria [8, 9], were able to speak and read English, and provided written informed consent. Patients with a medical or psychiatric condition or those receiving treatment for a condition that causes cognitive or other impairments, which the investigator judged would interfere with study participation, were excluded. Patients were screened and selected to ensure a diverse population was recruited in terms of demographic and clinical characteristics, including African Americans, males, individuals in paid employment, and with a wide range of age, Safety of Estrogens in Lupus Erythematosus National Assessment-Systemic Lupus Erythematosus Disease Activity Index (SELENA-SLEDAI) scores, and organ involvement. Patients took part in either the CE or CD interviews, but not both.

Physicians completed a clinical case report form for each patient enrolled to provide their clinical status and details of the patient’s current and previous (past 2 years) SLE treatments. Physicians determined the patient’s SLE disease severity based in part on SELENA-SLEDAI scores, Systemic Lupus International Collaborating Clinics/ACR (SLICC/ACR) damage index, or both (when available), and rated it (mild, moderate, or severe) over the previous 6 months.

All practices received an honorarium, and upon completion of the interview each patient received a gift card for their participation.

Patient interviews and PRO development

CE and CD interviews were conducted separately, using two separate samples of patients with SLE.

CE interviews

CE interviews elicited important concepts from individuals with SLE, specifically about SLE-related symptoms and impacts. Face-to-face interviews were conducted by trained interviewers using a semi-structured interview guide developed for this study. To ensure all relevant topics were discussed, the interview guide included broad, open-ended questions such as, ‘What symptoms, if any, do you ever experience as a result of your lupus?’ and ‘How does having lupus affect your day-to-day life?’ Patients were questioned on the overall impact of SLE, symptoms of SLE, day-to-day impacts of SLE, and their experience taking steroids (if recently or currently receiving steroids). Development of the accompanying steroid-specific PRO measure is reported elsewhere [10]. Interviews were conducted until concept saturation (the point at which no new concepts emerged from the interviews) was reached. Based on analysis of the CE interview transcripts and clinician input, the SLE Symptom Severity Diary (SSD) and the SLE Impact Questionnaire (SIQ) were drafted.

CD interviews

CD interviews, using both debriefing and a “think aloud” approach, assessed patient understanding of the draft PROs and evaluated the content, clarity and relevance of the questions, response options and recall periods. A second sample of eligible patients with SLE was recruited from four of the six practices. Just prior to the face-to-face interviews, patients completed paper versions of the PROs, formatted to look like electronic screen shots, as future administration of the tools using an electronic device (ePRO) is planned. CD interviews were conducted using a semi-structured interview guide developed for the study, with questions such as, ‘Looking at question 1 (feeling tired or lacking energy), how do you define feeling tired? What about lacking energy? What is the difference between these terms? Why would you say that? Do you think we need to include both terms or would you delete one? (If delete one), Which would you omit? Why? Do you have any other suggestions about how this question could be revised? If yes, please describe. Why do you think that is clearer?’ All patients (with the exception of one) were asked about both PROs, but they were not asked to evaluate every item; the items perceived to be the most challenging were tested and to avoid the interviews becoming tedious for the patients, they were not asked to evaluate questions that were very similar to each other. Multiple rounds of CD interviews were conducted. After each round of interviews, the responses were reviewed and the PROs were modified accordingly. The revised drafts were then used in the next round of interviews.

To enable worldwide use of the PROs, translators assessed whether the questionnaires could be readily translated into three etymologically distinct languages (German, Japanese, and Portuguese). Based on the CD interviews, clinician input, and the translatability assessment, both PROs were revised.

Data analyses

All interviews were recorded and transcribed for analysis; patient identifiable information was not included in any transcripts or analyses to ensure patient confidentiality. All data were held in strict confidence in accordance with local, state, and federal law.

Interview data were coded using MAXQDA (Verbi GmbH, Berlin, Germany). A coding dictionary was developed and used in the thematic analysis. Each transcript was coded by one coder, then reviewed, summarized, and analyzed by a second coder. Similar concepts/themes were grouped together to allow for quantitative analysis. In addition to analyzing the data from the code book, representative quotes were reviewed. To the extent possible, language provided by patients was utilized to develop the items in both the SSD and SIQ. In this way, the rich patient narratives were converted into the final list of symptoms included in the SSD and the impacts described in the SIQ.

Safety was not assessed in the study; however, if patients reported an adverse event during the interview, they were instructed to report it to their healthcare provider; if relevant this was also reported to the study sponsor.

Results

Literature review

The literature review identified 68 PROs that had previously been used for evaluating patients with SLE; Table 1 summarizes the characteristics of PROs that matched some of the desired criteria for this study. The most commonly-cited PRO was the Medical Outcomes Short Form-36 (SF-36), which is a generic measure of health-related quality of life (HRQoL), provides a broad measure of functioning and well-being, but was not developed in an SLE population and does not assess all concepts that are important to patients with SLE [11]. Symptom-specific measures such as the Functional Assessment of Chronic Illness Therapy-Fatigue (FACIT-Fatigue) [12], the Beck Depression Inventory [13], and the Brief Pain Inventory [14] were used to measure commonly-reported symptoms of SLE [15]. However, these measures were not developed in an SLE population and do not include all relevant SLE symptoms. Existing SLE-specific PRO measures such as the Lupus Quality of Life questionnaire (LupusQoL) [16] and the Lupus Patient Reported Outcome questionnaire (LupusPRO) [17] can be used to measure HRQoL, but may not be suitable for frequent self-administration and do not include a comprehensive assessment of symptoms. The Lupus Impact Tracker (LIT) [18] was developed for use in clinical practice, from the LupusPRO, as a brief measure to assess the impact of SLE. The Systemic Lupus Activity Questionnaire (SLAQ) [19], which was developed as a self-report version of the Systemic Lupus Activity Measure (SLAM), is used to screen for possible flares requiring further evaluation. Most SLE-specific PROs utilize a relatively long recall period of at least 4 weeks, so are unlikely to capture daily variability in symptoms and may have a greater risk of recall bias [1618]. The SLE-specific Quality of Life (SLEQOL) instrument was developed by health professionals and only subsequently was the content assessed by patients [20].
Table 1

Summary of commonly used SLE PROs and characteristics of the SSD and SIQ

PRO

Concept measured

Intended use

Content

Recall period

SF-36a [11]

HRQoL

General population surveys and clinical trials to estimate disease burden and compare disease-specific benchmarks with general population norms

Generic measure of physical and mental functioning with 36 items contributing to 8 subscales: physical functioning, role-physical, bodily pain, general health, vitality, social functioning, role-emotional, and mental health

Standard version: 4 weeks; acute version: 1 week

LupusQoL [16]

HRQoL

Adults with SLE in clinical trials and clinical practice

34 items in 8 domains: physical health, pain, planning, body image, burden to others, intimate relationships, emotional health, and fatigue

4 weeks

LupusPRO [17]

HRQoL

US patients with SLE in clinical trials and clinical practice

30 items in 8 HRQoL domains: lupus symptoms, lupus medications, cognition, procreation, physical health, emotional health, pain-vitality and body image. 13 items in 3 non-HRQoL domains: desires goals, available social support and coping and satisfaction with medical care

4 weeks

L-QoL [29, 32]

HRQoL, impacts

Patients with SLE in clinical trials and clinical practice

25 items investigating fatigue and impacts including daily activities, emotional/psychological, social functioning, and relationships

At the moment

SLEQOL [33]

HRQoL

Patients with SLE in clinical trials and clinical practice

40 items in 6 subsections: physical functioning, activities, symptoms, treatment, mood and self-image

1 week

SSC [21]

Symptoms

Patients with SLE in clinical trials and clinical practice

38 items measuring disease-related and treatment-related symptoms and their burden

1 month

SLAQb [19]

Symptoms

Tracking and screening of patients with SLE in epidemiologic studies

24 items measuring symptoms of disease activity

3 months

Lup-QOL [32, 33]

HRQoL

Patients with SLE in clinical trials and clinical practice

Incorporates the Medical Outcomes Study SF-36 and FACIT-Fatigue. Includes 19 items with generic and disease-specific components including symptoms and interference, cognitive and confidence and planning

Varies according to the item

SSD

Symptoms

Patients with SLE in clinical trials and practice

17 items measuring SLE symptoms (including: energy/vitality, joint or muscle pain/stiffness/swelling, cognition and skin symptoms), and current steroid dose

1 day

SIQ

Impact

Patients with SLE in clinical trials and practice

50 items measuring SLE impacts including daily activities; social, physical and emotional functioning; and work productivity

7 days

aWith the exception of the SF-36 and Lup-QOL, all other measures utilized input from patients with SLE in their development; bSLAQ is the only screener developed for use in the US with English-speaking patients

L-QoL Systemic Lupus Erythematosus Quality of Life Questionnaire, Lup-QOL Lupus-Quality of Life, PRO patient-reported outcome, SF-36 Short Form-36, SIQ SLE Impact Questionnaire, SLAQ Systemic Lupus Activity Questionnaire, SLE systemic lupus erythematosus, SLEQOL Systemic Lupus Erythematosus Quality of life Instrument, SSC SLE Symptom Checklist, SSD Symptom Severity Diary

Many of the PROs were developed prior to the release of the FDA PRO Guidance (2009) [4] and therefore the required documented evidence of their development is not available. Existing measures were also found to be insufficient as their development lacked substantial, documented input from patients with SLE (e.g., SF-36, FACIT-Fatigue), their content focused on HRQoL or concepts not expected to be directly impacted by treatment (such as body image) instead of symptoms and impacts (e.g., LupusQoL, LupusPRO), and/or their structure and recall period were not suitable for capturing the frequently fluctuating nature of SLE. Recently, the use of items in the Patient Reported Outcomes Measurement Information System (PROMIS®) item bank [21, 22] has been explored in studies of SLE [23, 24]. Although the PROMIS item bank contains items that are relevant to SLE (e.g., fatigue and pain), it is not comprehensive, and further work is needed to evaluate the specific items and associated measurement properties for use in patients with SLE. It was, therefore, concluded that the development of novel measures to evaluate symptoms and impacts would be of value for both clinical research and clinical practice.

CE interviews

CE interviews were completed by 41 patients (3–10 patients from each study site): 95% female, 55% Caucasian, 25% African American (Table 2). Mean (standard deviation [SD]) time since SLE diagnosis was 8.56 (8.13) years; according to physician assessment, 54%, 44%, and 2% of patients had mild, moderate, and severe disease, respectively.
Table 2

Demographic and clinical characteristics of patients

 

CE interviews (n = 41)

CD interviews (n = 18)

Gender, n (%)

 Male

2 (5)

1 (6)

 Female

39 (95)

17 (94)

Mean age, years (SD)

47.7 (12.6)

50.8 (14.4)

Ethnicity, n (%)

 Caucasian

22 (55)

7 (39)

 African American

10 (25)

11 (61)

 Latino/Hispanic

5 (12)

0

 Other

2 (5)

0

 Asian

1 (2)

0

Marital status, n (%)

 Married

16 (39)

5 (28)

 Lives with partner

0

1 (6)

 Widowed/divorced/separated

8 (19)

6 (33)

 Single/never married

17 (42)

5 (28)

 No response

0

1 (6)

Employment, n (%)

 Not currently working for pay

11 (27)

2 (11)

 Working full time

11 (27)

4 (22)

 Working part time

1 (2)

2 (11)a

 Retired

6 (15)

5 (28)

 Disabled

0

5 (28)

 Other

12 (29)

0

Mean time since SLE diagnosis, years (SD)b

8.56 (8.13), range < 1–35 (n = 38)

11.28 (10.38), range 1–38 (n = 14)

Mean SELENA-SLEDAIc (SD)

6.02 (3.60) (n = 37)

6.06 (2.53)

Mean SLICC/ACR damage indexc (SD)

5.96 (1.74) (n = 25)

6.00 (1.83) (n = 10)

SLE severity, n (%)

 Mild

22 (54)

9 (50)

 Moderate

18 (44)

9 (50)

 Severe

1 (2)

0

Current SLE treatmentd, n (%)

 Hydroxychloroquine

29 (71)

14 (78)

 Corticosteroids

19 (46)

10 (56)

 NSAIDs

7 (17)

2 (11)

 Belimumab

6 (15)

2 (11)

 Methotrexate

4 (10)

3 (17)

Concomitant conditione, n (%)

 Fibromyalgia

10 (24)

4 (22)

 Osteopenia/osteoporosis

9 (22)

5 (28)

 Anxiety

9 (22)

3 (17)

 Hypertension

8 (20)

4 (22)

 Depression

7 (17)

2 (11)

 Rheumatoid arthritis

5 (12)

1 (6)

 Asthma

4 (10)

2 (11)

 Osteoarthritis

4 (10)

4 (22)

 Sjögren’s syndrome

4 (10)

2 (11)

 Lupus nephritis

3 (7)

4 (22)

 Hyperlipidemia/hypercholesterolemia

2 (5)

3 (17)

 Vasculitis

2 (5)

2 (11)

 Other renal diseases (non-lupus)/ESRD

1 (2)

2 (11)

 Congestive heart failure

0

2 (11)

aOne patient was also a student; bif patients had moved practice since initial SLE diagnosis it was not always possible to precisely determine their date of diagnosis; cwhen data were available; dsome patients were receiving more than 1 treatment; ereported by ≥10% of patients

CE concept elicitation, CD cognitive debriefing, ESRD end stage renal disease, NSAIDs non-steroidal anti-inflammatories, SD standard deviation, SELENA-SLEDAI Safety of Estrogens in Lupus Erythematosus National Assessment-Systemic Lupus Erythematosus Disease Activity Index, SLE systemic lupus erythematosus, SLICC/ACR Systemic Lupus International Collaborating Clinics/American College of Rheumatology

The most frequently-reported symptoms were fatigue (98%, n = 40/41), joint pain (93%, n = 38/41), rash (88%, n = 36/41), swelling of hands, fingers, feet or legs (80%, n = 33/41), and joint stiffness/cramps (80%, n = 33/41) (Table 3). One patient described fatigue as, “It’s a feeling inside, where sometimes you’re so tired you just don’t want to even breathe. It’s just an effort to move your arms.” Concept saturation, the point at which no new concepts are mentioned by subsequent patients, was reached by the 26th of 41 interviews.
Table 3

Frequency of symptoms reported during CE interviews (n = 41) when patients were asked to describe what symptoms they experience as a result of lupus

Symptom

Reported spontaneously, n (%)

Reported in response to specific probing, n (%)

Total, n (%)a

Fatigue

35 (85)

5 (12)

40 (98)

Joint pain

34 (83)

4 (10)

38 (93)

Rash

19 (46)

17 (41)

36 (88)

Swelling of hand, fingers, feet or legs

16 (39)

17 (41)

33 (80)

Joint stiffness/cramps

21 (51)

12 (29)

33 (80)

Cognitive/focus/memory issues

9 (22)

17 (41)

26 (63)

Headaches

9 (22)

14 (34)

23 (56)

Muscle pain/achiness

15 (37)

0

15 (37)

Fevers/hot flashes

14 (34)

0

14 (34)

Dry/itchy skin

9 (22)

0

9 (22)

Chills

9 (22)

0

9 (22)

Decreased appetite/weight loss

8 (20)

0

8 (20)

Hair loss

8 (20)

0

8 (20)

Raynaud’s

8 (20)

0

8 (20)

Mouth sores

7 (17)

0

7 (17)

Numbness/tingling

7 (17)

0

7 (17)

Weakness/decreased muscle strength

3 (7)

4 (10)

7 (17)

Dry eyes/vision issues

6 (15)

0

6 (15)

Nausea/vomiting

6 (15)

0

6 (15)

Shortness of breath

6 (15)

0

6 (15)

Coughing/wheezing

4 (10)

0

4 (10)

High blood pressure

3 (7)

1 (2)

4 (10)

Muscle stiffness/cramps

4 (10)

0

4 (10)

Rapid heart rate

4 (10)

0

4 (10)

Weight gain

0

4 (10)

4 (10)

Dizziness

3 (7)

0

3 (7)

Bladder issues

2 (5)

0

2 (5)

Insomnia

2 (5)

0

2 (5)

Night sweats

2 (5)

0

2 (5)

Nose bleeds

2 (5)

0

2 (5)

Tremors/twitching

2 (5)

0

2 (5)

Bone pain

1 (2)

0

1 (2)

Dry mouth

1 (2)

0

1 (2)

Panic attacks

1 (2)

0

1 (2)

Seizures

1 (2)

0

1 (2)

aTotal % may be higher due to rounding

CE concept elicitation

When asked how SLE impacts their day-to-day life, patients reported difficulty with chores/housework (61%, n = 22/36), leisure activities (39%, n = 14/36), driving (39%, n = 14/36), sleeping (39%, n = 14/36), cooking (31%, n = 11/36), taking care of children (22%, n = 8/36), and washing, brushing, or drying their hair (22%, n = 8/36). SLE was also found to impact patients’ ability to work. Of the patients not currently working outside the home (62%, n = 24/39), 91% (n = 20/22 asked) reported that they did not work because of SLE. Of those who currently worked for pay, 33% (n = 5/15) reported missing work due to SLE, and 80% (n = 12/15) stated that SLE had an impact on work productivity.

The most commonly-reported impacts on physical, emotional, and social functioning were decreased ability to walk (66%, n = 27/41), feeling sad/depressed (61%, n = 23/38), and decreased ability to date or be intimate with a partner (61%, n = 19/31) (Fig. 2). Representative patient quotes include, “I can’t do as much as I used to do. I can’t walk as far as I used to. You know I have to park like in the disabled parking”; “I think the depression is definitely due to lupus. I don’t think in general I am depressed. I’m positive about most things. I enjoy company of other people. What depresses me is when I just can’t move and then I’m more isolated”; “I was very social. I ran organizations. I had a lot of friends. I will say I have three friends who contact me consistently now, that’s it” and “Well, that’s why I’m getting the divorce. Because of the impact, I don’t feel sexual”.
Fig. 2
Fig. 2

Patient-reported impact of SLE on functioning according to the CE interviews. A. Physical functioning (n=41); B. Emotional functioning (n=38); C. Social functioning (n=31).

When asked what the single worst thing about having SLE is, the most common answers were the inability to do what they wanted to do (44%, n = 17/39), that there is no cure (13%, n = 5/39), fatigue 10% (n = 4/39), pain (10%, n = 4/39), rash (8%, n = 3/39), and the unpredictable nature of lupus (8%, n = 3/39).

Drafting of the PROs, CD interviews, and questionnaire revisions

Based on analyses of the CE interview transcripts, draft versions of the SSD and SIQ were developed and reviewed by two rheumatologists.

CD interviews to assess the content and clarity of the draft questionnaires were completed by a second group of 18 patients with SLE: 94% female, 39% Caucasian, and 61% African American (Table 2). The mean (SD) time since SLE diagnosis was 11.28 (10.38) years; 50% of patients had mild SLE and 50% had moderate SLE. At the final round of CD interviews there was little new information gained.

SLE symptom severity diary

The majority of instructions and questions were found to be clear and concise and could be paraphrased correctly by most patients. All patients asked (n = 14/14) reported it was easy to complete the questionnaire, and that the ordering of the items was appropriate. On average, it took 6 min (range 2–15 min) to complete the questionnaire.

Eighty-two percent (n = 14/17) of patients asked thought all items were relevant to patients with SLE. Forty-three percent (n = 3/7) of patients asked did not think there were any missing symptoms. Additional symptoms identified as missing were muscle cramps (n = 2), shortness of breath, heart palpitations, dry mouth, difficulty hearing, not feeling attractive, and emotional/physical stress (all n = 1); due to the low rate of endorsement these were not included in the questionnaires.

The draft SSD used an 11-point (0–10) numeric rating scale (NRS; with 0 being “Absent/Did not have” and 10 being “Worst imaginable”). All patients asked (15/15) were able to correctly paraphrase “absent/did not have,” and “Worst imaginable.” All patients asked (10/10) were also able to find an appropriate response to the questions, and 93% (13/14) thought the number of response options was appropriate; one patient suggested using a scale of 0–5 as they thought 0–10 was too broad. As the majority of patients thought the 0–10 response scale was appropriate, and no patients indicated they would prefer a different set of response options, the 11-point NRS was retained.

One of the few substantial changes made to the SSD was that two questions relating to muscle pain/achiness and muscle stiffness were combined and replaced with, “Rate the severity of muscle pain or stiffness at its worst in the past 24 hours?” Other minor changes included making selected words bold to improve the clarity.

As a result of the translatability assessment, minor revisions were made to some questions and the instructions. For example, “achiness” does not translate in German or Portuguese so it was removed (e.g., “Rate the severity of joint pain or achiness at its worst in the past 24 hours?” was revised to “Rate the severity of joint pain at its worst in the past 24 hours?”). Also, the use of “individuals” was replaced with “people” to enable translation into German and Japanese.

The revised SSD contains 17 items that investigate energy/vitality, joint or muscle pain/stiffness/swelling, flu-like symptoms, cognition, numbness/tingling, skin symptoms, hair loss, and steroid status/dose (descriptive only). Sample items are provided in Table 4. In the CE interviews, patients reported daily fluctuations in symptoms. Therefore, a recall period of 24 h was considered to be optimal and was used in the draft measure. During the CD interviews, 77% of patients asked (n = 10/13) felt the 24-h recall period was appropriate for all symptoms except hair loss, where a recall period of 4 weeks was used (Table 1). Selection of the 24-h recall period was supported by the FDA PRO Guidance, which states “PRO instruments that call for patients to rely on memory, especially if they must recall over a long period of time, compare their current state with an earlier period, or average their response over a period of time, are likely to undermine content validity. Response is likely to be influenced by the patient’s state at the time of recall. For these reasons, items with short recall periods or items that ask patients to describe their current or recent state are usually preferable.” [4] The SSD utilizes an 11-point NRS, which is preferred over a 5- or 7-point Likert scale, as the measure is intended to be administered daily, and as there is some evidence that suggests the NRS is more sensitive than a verbal rating scale in the assessment of pain intensity and hence may be more likely to capture small daily changes in the severity of SLE symptoms [25].
Table 4

Sample questions from the SSD and SIQ

Sample questions from the SSD:

People with lupus may experience a variety of symptoms. Please indicate how severe the following lupus symptoms were at their worst in the past 24 hours by selecting one number.

Rate the severity of feeling tired OR lacking energy at its worst in the past 24 h?

0

Absent/Did not have

1

2

3

4

5

6

7

8

9

10

Worst imaginable

Rate the severity of joint pain at its worst in the past 24 h?

0

Absent/Did not have

1

2

3

4

5

6

7

8

9

10

Worst imaginable

Rate the severity of swelling of joints including fingers, hands, elbows, feet or ankles at its worst in the past 24 h?

0

Absent/Did not have

1

2

3

4

5

6

7

8

9

10

Worst imaginable

Rate the severity of rash at its worst in the past 24 h?

0

Absent/Did not have

1

2

3

4

5

6

7

8

9

10

Worst imaginable

Sample questions from the SIQ:

In the past 7 days, how much did lupus impact your ability to make plans in advance? (select one response)

Not at all

A little bit

Somewhat

Quite a bit

Very much

In the past 7 days, how much did lupus impact your ability to participate in leisure activities or hobbies that require you to leave your house (such as going to a park, going shopping, going to a restaurant, or going to the movies)? (select one response)

Not at all

A little bit

Somewhat

Quite a bit

Very much

In the past 7 days, how much did lupus impact your ability to get together with friends?

(select one response)

Not at all

A little bit

Somewhat

Quite a bit

Very much

In the past 7 days, how much did lupus impact your ability to walk a short distance (approximately one block)? (select one response)

Not at all

A little bit

Somewhat

Quite a bit

Very much

In the past 7 days, how much did lupus impact your ability to feel rested enough to get out of bed in the morning? (select one response)

Not at all

A little bit

Somewhat

Quite a bit

Very much

SIQ SLE Impact Questionnaire, SSD SLE Symptom Severity DiaryThe actual questionnaire uses some bolding and underlining

SLE impact questionnaire

Seventeen patients completed CD interviews of the SIQ; due to the length of the questionnaire, it was not feasible to cognitively debrief all items, therefore, items with words or terms that were more complex or could potentially have more than one interpretation were focused upon. For example, patients were debriefed on whether they considered the terms joint pain and joint stiffness to be the same, whether questions referring to both symptoms should be included, whether they should be kept as separate items and if they answered questions referring to them differently.

All patients asked (n = 9) were able to correctly paraphrase the instructions, and 89% of patients (n = 8/9) had no suggestions to improve their clarity. The majority of patients asked (78%, n = 7/9) did not think any questions were unclear. On average, it took 12 min (n = 10; range 5–40 min) to complete the questionnaire; 87% of patients asked (n = 13/15) felt the questionnaire was easy to complete, and all patients (n = 9/9) felt the question order was appropriate.

Based on clinician input, a recall period of 7 days was chosen for the first draft of the SIQ. During debriefing, 75% (n = 6/8) of patients asked reported that they thought about the past 7 days when answering the questions, and 25% (n = 2/8) thought about the entire time since they had been diagnosed with SLE. Thus, it was decided that a recall period of the past 7 days would be most appropriate for the SIQ.

Most revisions to the SIQ involved combining similar items or making minor wording changes to enhance translatability. For example, “In the past 7 days, how much did lupus impact your ability to make plans 2–3 days in advance?” and “In the past 7 days, how much did lupus impact your ability to make plans for the future (more than 2–3 days in advance)?” were combined to read, ‘In the past 7 days, how much did lupus impact your ability to make plans in advance?’

The refined SIQ includes 50 items assessing ability to make plans; take care of yourself/others; leisure activities; social functioning; physical functioning; sleep; memory/cognitive issues; work; and emotional functioning (Table 1), using a 5-point Likert-type response scale. The questionnaire assesses the degree of impact SLE has on various aspects of an individual’s life. As such, a numeric rating of this impact would not necessarily be familiar or meaningful to patients. The response options utilized are standard response options that are used in many PRO questionnaires including the FACIT measurement system [12]. In addition, unlike the SSD, which is administered daily, the SIQ is administered weekly, as symptom impacts are less likely to change on a daily basis. Sixty-nine percent of patients asked (n = 9/13) thought the time frame of the past 7 days was appropriate. A Likert-type scale is appropriate for detecting these changes in impacts, as it is easy for respondents to understand and still sensitive enough to detect subtle changes [26]. For the majority of items, the response scale ranges from “Not at all” to “Very much”; three items have responses ranging from “None of the time” to “All of the time”. Sample items are provided in Table 4.

Discussion

Although the literature review identified numerous PROs used in patients with SLE, it identified a need for PROs developed in alignment with the FDA PRO Guidance to assess the fluctuations in symptoms and impacts experienced by patients with SLE. Existing PROs were either designed for different purposes (e.g., assessing HRQoL on a monthly basis, [16, 17] or to screen for possible flares requiring further evaluation [19]), were not developed specifically for patients with SLE [1114], or did not provide sufficient evidence of development in line with best measurement science. Although the LupusPRO and LIT may have been developed in alignment with best measurement science, with content validity in the target population of interest and adequate measurement properties as required by the FDA, to the best of our knowledge, at the time of this study there was not comprehensive, publicly available, documented evidence that demonstrated this. Furthermore, they were not developed with the intention to support FDA label claims [17, 18]; however, subsequent to the development of the SSD and SIQ the developers of the LupusPRO and LIT have begun the process of submitting an application to the FDA to qualify these measures.

Two PROs, the SSD and SIQ, were developed based on information from literature and patient and clinician input. Patient input obtained during CE interviews regarding the most common symptoms was aligned with current literature; fatigue and joint pain were most common, reported by over 90% of patients [2729]. The CE interviews also revealed how SLE impacts patients’ physical, emotional, and social functioning; the themes identified formed the basis of the SIQ.

Drafts of the PROs were evaluated by patients through CD interviews. Patients reported that the PROs were clear, comprehensive, and relevant. Patients were able to complete the questionnaires in 6–12 min, which supports their routine use. Minor modifications to the draft PROs were made based on patient feedback, further clinician input, and an assessment of translatability.

Best scientific practices, as described in the FDA PRO Guidance [4], were followed throughout the development of both PROs, including an iterative development methodology and substantial patient input. Sample sizes were sufficient to support their development. Concept saturation was achieved by the 26th CE interview; this demonstrates that no important concepts are missing since no new concepts were raised during the final 15 CE interviews. We are confident that the CD sample size was sufficient and all items were evaluated satisfactorily; by the final round of reviewing there was little new information gained from the interviews.

Both Caucasian and African American patients were interviewed, and patients with a wide range of disease duration were included. However, only one patient with severe SLE completed the CE interview, and no patients with severe SLE completed CD interviews. There were some instances where patients with mild SLE did not believe an item was relevant because they had not experienced it; therefore, it is important that future evaluation of the PROs includes patients with severe SLE. There were only a few male participants enrolled (5% of the CE and 6% of the CD patients), though this is not unexpected, as SLE is approximately nine times more common in women than men [30]. Further, there was no representation of Hispanic or Asian patients with SLE in the CD sample. It may have been possible to obtain a more representative sample if a larger number of patients had been recruited instead of purposely selecting patients to generate a diverse sample for characteristics including age, race, disease severity and time since diagnosis. Background demographic and clinical information was not collected from patients not eligible to participate or who declined to participate in the study, so it is unclear whether our patient population is representative of the total population approached. Another potential limitation of this study is that not all questions were asked of all patients during the cognitive debriefing of the instruments, therefore in some cases the sample size was smaller.

Despite some limitations, primarily related to the characteristics of the study participants, using patient input to inform the content of the PROs enabled the inclusion of concepts that are most important and relevant to patients.

Compared with existing PROs used for patients with SLE, the SSD and SIQ have a number of novel features that will enhance their utility following confirmation of their measurement properties. Importantly they were developed in accordance with the FDA PRO Guidance [4] and may be appropriate in a specified context to support claims in approved medical product labelling. With the exception of the LupusPRO and LIT, many of the existing PROs used by patients with SLE were developed prior to the publication of the FDA PRO Guidance. Compared with generic PROs such as the SF-36, the SSD and SIQ have been specifically developed for patients with SLE; therefore, they are more comprehensive as they capture the full range of impacts and symptoms that are relevant to patients with SLE. Furthermore, as recommended by the FDA PRO Guidance [4] and endorsed by patients in this study, the short recall periods (24 h for the SSD and 7 days for the SIQ) should enable accurate reporting of fluctuations in SLE symptoms and impacts of the disease. Also, both PROs have been developed for electronic administration to enable patients to complete them regularly and with ease, and ensure more accurate reporting while minimizing missing data. Previously, ePROs have been demonstrated to be a feasible and convenient tool for patients with chronic inflammatory disease [31]. Prior to use, it will be necessary to perform exploratory factor analysis for both PROs, in order to confirm the structure of each scale and develop scoring algorithms. Without this information, only item level data can be presented descriptively. In addition, the measurement properties of the questionnaires, including internal consistency reliability, test-retest reliability, construct validity, known groups validity, responsiveness to change over time, and an estimation of what change is clinically meaningful should be evaluated. Development of a responder definition will support the interpretation of scale scores. We assessed the translatability of the PROs into three distinct languages; if it becomes necessary to translate the PROs in to other languages, further modifications may be required to ensure conceptual equivalence.

Conclusion

In summary, two new PROs, the SSD and the SIQ, have been developed using a robust methodology. Following psychometric testing and adequate demonstration of the required measurement properties, these tools can be used in clinical research and clinical practice to assess the symptoms and impacts experienced by patients with SLE.

Abbreviations

ACR: 

American College of Rheumatology

CD: 

cognitive debriefing

CE: 

concept elicitation

EMA: 

European Medicines Agency

ePRO: 

electronic patient-reported outcome

FACIT-Fatigue: 

Functional Assessment of Chronic Illness Therapy-Fatigue

FDA: 

Food and Drug Administration

HRQoL: 

health-related quality of life

IRB: 

internal review board

LIT: 

Lupus Impact Tracker

LupusPRO: 

Lupus Patient Reported Outcome questionnaire

LupusQoL: 

Lupus Quality of Life questionnaire

PRO: 

patient-reported outcome

PROMIS®

Patient Reported Outcomes Measurement Information System

SD: 

standard deviation

SELENA-SLEDAI: 

Safety of Estrogens in Lupus Erythematosus National Assessment-Systemic Lupus Erythematosus Disease Activity Index

SF-36: 

Short Form-36

SIQ: 

SLE Impact questionnaire

SLAQ: 

Systemic Lupus Activity Questionnaire

SLE: 

systemic lupus erythematosus

SLEQOL: 

SLE-specific Quality of Life

SLICC/ACR: 

Systemic Lupus International Collaborating Clinics/American College of Rheumatology

SSD: 

SLE Symptom Severity Diary

Declarations

Acknowledgements

This study (HO-13-13424) was conducted by Health Outcomes Solutions, which received funding from GSK. Medical writing assistance was provided by Katie White, PhD, of Fishawack Indicia Ltd., and was funded by GSK.

Funding

The study was funded by GSK plc. GSK contributed to the development of the study concept and design, conducted the study, and contributed to the interpretation of the data. GSK supported the authors in development of the manuscript.

Availability of data and materials

At this time, no additional data will be shared as the tools were developed to generate evidence to demonstrate treatment benefits of GlaxoSmithKline (GSK) therapies for SLE (that are still in development) and to differentiate them from competitor treatments.

Authors’ contributions

SDM, JDV, HHC, DJC, and AA contributed to the conception, acquisition, analysis and interpretation of this study. PB contributed to the conception and interpretation of this study. KP contributed to the analysis and interpretation of the study. All authors contributed to the drafting and revising of this manuscript and have approved the final version for publication.

Authors’ information

DJC holds an Adjunct Associate Professor position in the Division of Rheumatology at the Perelman School of Medicine at the University of Pennsylvania.

Ethics approval and consent to participate

Independent review board approval (Copernicus Group; reference number: HOS1–13-550) was obtained. All patients provided written informed consent to participate in the study.

Consent for publication

Not applicable.

Competing interests

SDM, AA, and HHC are consultants for GSK. PB, JDV, and DJC are shareholders of GSK and were employees of GSK at the time of the study. KP is an employee of GSK.

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Open AccessThis article is distributed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made.

Authors’ Affiliations

(1)
Health Outcomes Solutions, PO Box 2343, Winter Park, FL 32790, USA
(2)
GlaxoSmithKline, Philadelphia, PA, USA
(3)
GlaxoSmithKline, London, UK
(4)
Columbia University Medical Center, New York, NY, USA

References

  1. American College of Rheumatology Ad Hoc Committee on Systemic Lupus Erythematosus. (1999). Guidelines for referral and management of systemic lupus erythematosus in adults. American College of Rheumatology ad hoc Committee on systemic lupus erythematosus guidelines. Arthritis Rheum, 42, 1785–1796.View ArticleGoogle Scholar
  2. Food and Drug Administration (2010) Guidance for Industry: Systemic Lupus Erythematosus - Developing Medical Products for Treatment. https://www.fda.gov/downloads/Drugs/GuidanceComplianceRegulatoryInformation/Guidances/UCM072063.pdf (Accessed May 2015).
  3. European Medicines Agency (2015) Guideline on clinical investigation of medicinal products for the treatment of systemic lupus erythematosus and lupus nephritis. http://www.ema.europa.eu/docs/en_GB/document_library/Scientific_guideline/2015/03/WC500184889.pdf (Accessed May 2015).
  4. Food and Drug Administration. (2009). Guidance for industry on patient-reported outcome measures: Use in medical product development to support labeling claims. Fed Regist, 74, 65132–65133.Google Scholar
  5. Patrick, D. L., Burke, L. B., Gwaltney, C. J., et al. (2011). Content validity--establishing and reporting the evidence in newly developed patient-reported outcomes (PRO) instruments for medical product evaluation: ISPOR PRO good research practices task force report: Part 1--eliciting concepts for a new PRO instrument. Value Health, 14, 967–977.View ArticleGoogle Scholar
  6. Patrick, D. L., Burke, L. B., Gwaltney, C. J., et al. (2011). Content validity--establishing and reporting the evidence in newly developed patient-reported outcomes (PRO) instruments for medical product evaluation: ISPOR PRO good research practices task force report: Part 2--assessing respondent understanding. Value Health, 14, 978–988.View ArticleGoogle Scholar
  7. Revicki, D. A., Gnanasakthy, A., & Weinfurt, K. (2007). Documenting the rationale and psychometric characteristics of patient reported outcomes for labeling and promotional claims: The PRO evidence dossier. Qual Life Res, 16, 717.View ArticleGoogle Scholar
  8. Hochberg, M. C. (1997). Updating the American college of rheumatology revised criteria for the classification of systemic lupus erythematosus. Arthritis Rheum, 40, 1725–1725.View ArticleGoogle Scholar
  9. Tan, E. M., Cohen, A. S., Fries, J. F., et al. (1982). The 1982 revised criteria for the classification of systemic lupus erythematosus. Arthritis Rheum, 25, 1271–1277.View ArticleGoogle Scholar
  10. Mathias, S. D., Berry, P., De Vries, J., et al. (2017). Development of the systemic lupus erythematosus steroid questionnaire (SSQ): A novel patient-reported outcome tool to assess the impact of oral steroid treatment. Health Qual Life Outcomes, 15, 43.View ArticleGoogle Scholar
  11. Ware J SF-36® Health Survey Update. Available from http://www.sf-36.org/tools/SF36shtml#LIT (accessed April 2015).
  12. Yellen, S. B., Cella, D. F., Webster, K., Blendowski, C., & Kaplan, E. Measuring fatigue and other anemia-related symptoms with the Functional Assessment of Cancer Therapy (FACT) measurement system. Journal Pain Symptom Manage, 13, 63–74.View ArticleGoogle Scholar
  13. Beck, A., Steer, R., Ball, R., & Ranieri, W. (1996). Comparison of Beck depression inventories -IA and -II in psychiatric outpatients. J Pers Assess, 67, 588–597.View ArticleGoogle Scholar
  14. Cleeland, C. S., & KM, R. (1994). Pain assessment: Global use of the brief pain inventory. Ann Acad Med Singap, 23, 129–138.PubMedGoogle Scholar
  15. Manson, J., & Rahman, A. (2006). Systemic lupus erythematosus. Orphanet J Rare Dis, 1, 6.View ArticleGoogle Scholar
  16. McElhone, K., Abbott, J., Shelmerdine, J., et al. (2007). Development and validation of a disease-specific health-related quality of life measure, the LupusQol, for adults with systemic lupus erythematosus. Arthritis Care Res, 57, 972–979.View ArticleGoogle Scholar
  17. Jolly, M., Pickard, A. S., Block, J. A., et al. (2012). Disease-Specific Patient Reported Outcome Tools for Systemic Lupus Erythematosus. Semin Arthritis Rheum, 42, 56–65.View ArticleGoogle Scholar
  18. Jolly, M., Garris, C. P., Mikolaitis, R. A., et al. (2014). Development and validation of the lupus impact tracker: A patient-completed tool for clinical practice to assess and monitor the impact of systemic lupus erythematosus. Arthritis Care Res, 66, 1542–1550.View ArticleGoogle Scholar
  19. Karlson, E. W., Daltroy, L. H., Rivest, C., et al. (2003). Validation of a systemic lupus activity questionnaire (SLAQ) for population studies. Lupus, 12, 280–286.View ArticleGoogle Scholar
  20. Leong, K. P., Kong, K. O., Thong, B. Y. H., et al. (2005). Development and preliminary validation of a systemic lupus erythematosus-specific quality-of-life instrument (SLEQOL). Rheumatology, 44, 1267–1276.View ArticleGoogle Scholar
  21. National Institues of Health, USA (2017). “PROMIS”. http://www.healthmeasures.net/explore-measurement-systems/promis#5 (Accessed January 2017).
  22. Cella, D., Riley, W., Stone, A., et al. (2010). Initial adult health item banks and first wave testing of the patient-reported outcomes measurement information system (PROMIS(™)) network: 2005–2008. J Clin Epidemiol, 63, 1179–1194.View ArticleGoogle Scholar
  23. Mahieu, M. A., Ahn, G. E., Chmiel, J. S., et al. (2016). Fatigue, patient reported outcomes, and objective measurement of physical activity in systemic lupus erythematosus. Lupus, 25(11), 1190–1199.View ArticleGoogle Scholar
  24. Ow, YLM., Thumboo, J., Cella, D., et al. (2011). Domains of health-related quality of life important and relevant to multiethnic English-speaking Asian systemic lupus erythematosus patients: A focus group study. Arthritis Care Res, 63, 899–908.View ArticleGoogle Scholar
  25. Breivik, E. K., Björnsson, G. A., & Skovlund, E. (2000). A comparison of pain rating scales by sampling from clinical trial data. Clin J Pain, 16, 22–28.View ArticleGoogle Scholar
  26. Bolognese, J. A., Schnitzer, T. J., & Ehrich, E. W. Response relationship of VAS and Likert scales in osteoarthritis efficacy measurement. Osteoarth Cartil, 11, 499–507.View ArticleGoogle Scholar
  27. Tench, C. M., McCurdie, I., White, P. D., & D'Cruz, D. P. (2000). The prevalence and associations of fatigue in systemic lupus erythematosus. Rheumatology, 39, 1249–1254.View ArticleGoogle Scholar
  28. Pettersson, S., Lövgren, M., Eriksson, L., et al. (2012). An exploration of patient-reported symptoms in systemic lupus erythematosus and the relationship to health-related quality of life. Scand J Rheumatol, 41, 383–390.View ArticleGoogle Scholar
  29. Holloway, L., Humphrey, L., Heron, L., et al. (2014). Patient-reported outcome measures for systemic lupus erythematosus clinical trials: A review of content validity, face validity and psychometric performance. Health Qual Life Outcomes, 12, 116.View ArticleGoogle Scholar
  30. Helmick, C. G., Felson, D. T., Lawrence, R. C., et al. (2008). Estimates of the prevalence of arthritis and other rheumatic conditions in the United States: Part I. Arthritis Rheum, 58, 15–25.View ArticleGoogle Scholar
  31. Jamilloux, Y., Sarabi, M., Kérever, S., et al. (2015). Adherence to online monitoring of patient-reported outcomes by patients with chronic inflammatory diseases: A feasibility study. Lupus, 24, 1429–1436.View ArticleGoogle Scholar
  32. Yu, E. B., Shikiar, R., Howard, K., et al. (2006). Validation of Lup-QoL: A lupus specific measure of health-related quality of life. Ann Rheum Dis, 65, 601.View ArticleGoogle Scholar
  33. Williams, E. M., Penfield, M., Kamen, D., & Oates, J. C. (2014). An intervention to reduce psychosocial and biological indicators of stress in African American lupus patients: The balancing lupus experiences with stress strategies study. Open J Prev Med, 4, 22–31.View ArticleGoogle Scholar

Copyright

© The Author(s) 2018

Advertisement