- Research
- Open Access
The measurement of physical functioning among patients with Tenosynovial Giant Cell Tumor (TGCT) using the Patient-Reported Outcomes Measurement Information System (PROMIS)
https://doi.org/10.1186/s41687-019-0099-0
© The Author(s) 2019
- Received: 10 May 2018
- Accepted: 16 January 2019
- Published: 4 February 2019
Abstract
Background
Tenosynovial giant cell tumor (TGCT), a rare, locally aggressive neoplasm of the synovium of joints and tendon sheaths, is associated with joint destruction, pain and swelling. Impacts on physical function (PF) vary depending on tumor size and location. The aim of this study was to identify relevant items, and demonstrate the content validity of custom measures of lower extremity PF from the Patient-Reported Outcomes Measurement Information System Physical Function Physical Function (PROMIS-PF) item bank among patients with TGCT.
Methods
Patients were recruited for qualitative research interviews to identify predominant TGCT symptoms and impacts. Patients completed a checklist to evaluate the relevance of each PROMIS-PF item. The publicly available PROMIS-PF item response theory (IRT) parameters were used to select items representing the range of the latent PF trait.
Results
Participants (n = 20) were 75% female, mean age 42.5 years. TGCTs were located in the knee (n = 15), hip (n = 3), and ankle (n = 2). Fifty-four PROMIS-PF items were identified as relevant by ≥20% of the participants. PF concepts discussed by participants during the qualitative interviews were also used to select relevant items. Selected items (n = 13) were used to create a physical function subscale specific to lower extremity tumors.
Conclusions
We describe a novel method of combining qualitative research and IRT-based item information to select a relevant and content valid subset of PROMIS-PF items to assess heterogeneous impacts on PF in TGCT, a rare disease population.
Keywords
- Qualitative
- Item response theory
- Physical functioning
- Rare disease
- TGCT
- PROMIS
Background
Pigmented villonodular synovitis (PVNS) and giant cell tumors of the tendon sheath (GCT-TS) are members of a single condition referred to as “tenosynovial giant cell tumor (TGCT), diffuse and localized type” and have a common pathogenesis. TGCT are rare neoplasms that may result in life-altering functional limitations, morbidity, and diminished patient quality of life (QOL), particularly in recurrent or refractory disease [1, 2]. The current standard of care for TGCT is surgical resection of the tumor as completely as possible in order to (i) reduce symptoms and joint destruction, (ii) improve function, and (iii) minimize the risk of recurrence [3]. However, medical therapies may be on the horizon. It has been observed that most TGCT tumors are associated with elevated expression of the colony-stimulating factor 1 (CSF1) gene [4] and may be driven by a CSF1 gene translocation [5, 6]. This has led to the development of non-surgical, targeted therapies against the CSF1 receptor (CSF1R) where regression in tumor volume is the primary indicator of response, and chronic therapy and monitoring may be indicated [2, 7].
Patient-reported outcome (PRO) assessments of symptoms and health-related quality of life (HRQL) are important in order to support the relevance of primary endpoints which are clinical in nature [8], such as the tumor volume response studied in TGCT. In addition, the Food and Drug Administration (FDA) has explicitly asked for endpoints, like PRO assessments, to support the relevance of progression-free survival [9]. This may be particularly pertinent to TGCT, where chronic therapy with systemic drugs may be accompanied by prolonged risk for potential drug-related toxicities. In contrast, duration of exposure to systemic agents is limited by a patient’s lifespan when treating tumors with high mortality [10].
Due to the dearth of research in the area, a qualitative interview study was conducted to identify and characterize the symptoms of TGCT from the patient perspective [11]. In addition, the content validity of several PRO instruments that might appropriately assess these symptoms in the context of a subsequent clinical trial was evaluated. Hypothesizing that physical functioning would be important and relevant, a primary instrument selected for content validation in the qualitative interview study included the Patient-Reported Outcomes Measurement Information System Physical Function (PROMIS-PF) items. The PROMIS-PF scale emerged as the most appropriate for evaluation of physical functioning in the TGCT population primarily because it includes a wide range of relevant items that target both upper and lower extremity limitations [11].
PROMIS instrument
The PROMIS-PF is a self-administered 121 item bank that includes questions to assess physical functioning. This PROMIS PF item bank served as the source of items that were selected for the measurement of physical functioning in this study. This approach was taken because PROMIS offers a breadth of item options, and these items were developed and validated using very rigorous methods.
The process for the development of all PROMIS items, including the PROMIS-PF item bank, has been well documented [12–15]. Six phases of Qualitative Item Review for item development were undertaken and included: identification of extant items, item classification and selection, item review and revision, focus group input on domain coverage, cognitive interviews on individual items, and final revision before field testing [13]. Item response theory (IRT)-based analysis of 11 large datasets supplemented and informed item-level qualitative review of nearly 7000 items from available PRO measures in the item library [12]. The details pertaining to the development of the PROMIS-PF item bank, have been described elsewhere [14, 15]. There are four domains in the PROMIS PF item bank: mobility (lower extremity), dexterity (upper extremity), axial (neck and back function) and complex activities that involve more than one subdomain. All items include a Likert response scale with higher scores representing better physical functioning.
There have been no prior studies on the use of PROMIS-PF items among patients with TGCT. However, there are some peer-reviewed publications describing content validity work in lower extremity orthopedic [16, 17] and arthritis patient populations [18]. This prior work is relevant because patients with these diseases experience similar symptoms and impacts to those experienced by patients with TGCT. Hung and colleagues [16] enrolled 382 outpatient orthopedic patients with lower extremity disorders with a goal of developing a lower extremity physical functioning computer adaptive test (CAT) based on the PROMIS-PF item bank. Methods included a qualitative review and psychometric analyses, including real data CAT simulations [16]. The resulting 79-item lower extremity physical function item bank was found to be unidimensional and free of item bias, demonstrating high reliability, and content and construct validity. Another study to evaluate the generalizability and relevance of the PROMIS-PF item bank involved the recruitment of 288 patients undergoing surgery for common foot and ankle problems [17]. Face validity was demonstrated through expert review by a panel of 6 foot and ankle surgeons. Construct validity was demonstrated through correlation analysis between PROMIS-PF and PROMIS-Pain scores and t-tests between groups of patients classified by disease severity [17]. Finally, a study by Voshaar and colleagues [18] assessed the content and construct validity of the PROMIS-PF item bank and 20-item short form in patients (N = 690) with rheumatoid arthritis. Content validity was established by linking the PROMIS-PF items to the International Classification of Functioning, Disability and Health (ICF) core set for rheumatoid arthritis. Construct validity was demonstrated by correlating PROMIS-PF scores with other clinical and patient-reported outcome measures (HAQ-Disability Index and SF-36).
The aim of this study was to summarize the evidence gained from qualitative patient interviews [11] to select the relevant items and demonstrate the content validity of a customized PROMIS-PF short form for patients with TGCT. This work supports the selection and relevance of the PF lower extremity scale as an endpoint for clinical trials of treatments for TGCT.
Methods
The study included two primary components: (i) a qualitative study to gather input directly from patients on the impacts of their disease, and (ii) identification and selection of the key items to be used to measure physical functioning, sourced from the PROMIS-PF item database. Each of these components is described in greater detail below. As described in a previous publication, clinical experts (SB, JH, RL, WT) provided helpful input throughout the study [11].
Patient interviews
This was a cross-sectional, qualitative interview study involving semi-structured interviews and completion of self-administered questionnaires [11]. Participants were recruited from private clinical sites, online blogs communicating their TGCT diagnosis, or via disease-related websites. Participants were eligible if they were able to participate in a one-on-one interview over the phone or in-person, male or female ≥18 years old, had histologically confirmed TGCT, able to read and speak English, and were willing and able to provide written informed consent prior to the interview. Participants were excluded if they had significant cognitive impairment, hearing difficulty, visual impairment, severe psychopathology, or any systemic or local illness or medical condition that could significantly interfere with the participant’s perception of TGCT specific symptoms.
Interview procedures
The semi-structured interview guide included two main parts. The first part involved concept elicitation to identify the key relevant symptom concepts and the impacts of these symptoms as experienced by patients. The initial open-ended questions asked participants to talk about the location of their tumor, the diagnostic process, treatments, symptoms they had experienced (description, frequency, variability, relationship with pain), and impacts they had noticed. The second part included a cognitive interview that allowed the patient to provide feedback on the content and their understanding of the PROMIS-PF items. This included questions about the relevance, instructions, item content, recall period, and response options.
As part of the cognitive debriefing, participants were provided with two checklists of items from the PROMIS-PF item bank, and they were asked to review each list and indicate which of the PROMIS-PF items were relevant to them in the context of their tumor-related impacts. The first checklist included items that were potentially relevant only to those with lower extremity tumors, and the second checklist included items potentially relevant to those with a tumor in any location. The purpose of completing these checklists was to quickly and easily identify key PROMIS-PF items that were relevant to a substantial number of the participants.
Analysis
Descriptive statistics (mean, standard deviation, frequency) for sociodemographic and clinical data were used to characterize the sample. Qualitative data collected in both the concept elicitation and cognitive interviewing portions of the one-on-one semi-structured patient interviews was reviewed, and any information related to physical functioning as described by the patients was extracted. Finally, the frequency and proportion of participants that endorsed items on the PROMIS-PF checklists were calculated. Based on the qualitative results and the PROMIS-PF checklist results, the most relevant PROMIS-PF items were selected for further evaluation. Considerations for narrowing the list of candidate items included: (i) relevance of the target concept for each item as evidenced by direct patient quotes, (ii) items that are frequently performed (e.g., daily) were preferred as the PROMIS-PF items do not include a recall period, and (iii) items that were specific were preferred (e.g., “stand unsupported for 10 minutes” would be selected over “stand for short periods of time).”
Review of IRT-based PROMIS-PF item parameters
Based on the results of the qualitative interviews (i.e., patient input and checklist results), key PROMIS-PF items of interest were considered further. The statistical properties (i.e., the item-response theory based item slope and thresholds) of the PROMIS-PF candidate items were reviewed in order to identify item overlap or redundancy. The item-specific parameters are available on the PROMIS website and were estimated by the PROMIS developers using IRT. IRT models assume that a person’s level of physical function (e.g., high vs. low) will predict that person’s probability of endorsing each specific item. Once these item parameters are calibrated for each item in an item bank, they can be used to score any new response data from any subset of items.
The slope parameter (i.e., discrimination) refers to the ability of an item to differentiate between different levels of the latent trait. Generally, the higher the discrimination the better the item. Threshold describes the level of the latent trait at which the person is more likely to respond in the higher category than in the lower category. For example, threshold 2 is the level of the latent trait at which the person is likely to respond 2 (or higher) vs. 1. Each PROMIS item has five response options so there are four thresholds. Generally, while a wider spread of thresholds for an individual item is desirable, a range of thresholds across the whole instrument is best.
Results
Patient interviews
Face-to-face and telephone interviews were conducted with N = 20 participants (n = 15 females; n = 5 males). The mean age was 42.5, and ranged from 27 to 56 years. The locations of the participants’ tumors included the knee (n = 15; 75%), hip (n = 3; 15%), and ankle (n = 2; 10%). Patient-reported sociodemographic and clinical characteristics have been reported previously [11].
Participants described a range of symptoms in the concept elicitation portion of the interviews, many of them spontaneously. Pain and swelling were the most commonly reported symptoms, each mentioned by a large majority of the participants; 80% and 85%, respectively [11]. Stiffness, reduced range of motion, and instability or giving out/giving way were also commonly reported symptoms: 75%, 65%, and 65%, respectively [11]. Participants consistently reported that their symptom experiences impacted their physical functioning.
Selected patient quotes targeting PROMIS-PF item concepts
Are you able to go for a walk of at least 15 min? | 101–004: I used to be a pretty athletic person and it got to the point where even just walking a block, by the end of that time it just got so sore and the stiffness kind of got in. |
101–014: I’d like to do more walks. That isn’t going to happen, long distance walks or even for extended period of time. | |
101–017: If I walk, you know, if I do a lot of walking, say like I’m at the store with my kids or something and I get into the car just from walking and then sitting, it, it will swell up right then, right then and there. | |
Are you able to dress yourself, including tying shoelaces and buttoning up your clothes? | 101–016: If I’m trying to put shoes on or put pants on, um, just bending that knee to get the pants on or the boots, just a little stiff with a little bit of pain. |
101–017: Yeah I’m not wearing socks…in the winter time honestly I would have like my boyfriend, take my socks off for me, please. Yeah, so I mean, you know pretty much would help, you’re a child help me put them on. Can you help me put my socks on? Could you help me take ‘em off. | |
101–021: It’s easy to put on my sock on my right foot, always has been, but the left foot—I mean, I—I’d like reach up and bend my leg and put on my sock on my right foot, kind of with my leg crossed over my other knee, but as that hip was giving me trouble, I couldn’t lift up, and I still can’t because of the fake joint. I can’t put that leg over to—to reach and put the sock on, so I would have to try to prop it up on the bed and then reach over to get the sock on, so it was a—it was a more involved process to put the sock on the foot with the PVNS going on on that side of my body. | |
Does your health now limit you in going OUTSIDE the home, for example to shop or visit a doctor’s office? | 101–011: I guess the worst part is, you know, if we do have to drive somewhere, um, I am not going to be able to go and do something right away if we, you know, once we get somewhere because it can take several hours until I’m really able to walk well if it gets bad. |
101–017: If I do any walking, you know, grocery store, by the time I finish with the grocery store I’m pretty much, burning up I would say. I’m not as active as I used to be at one time, I—I’m just, my activity level has really been limited since all this came about. | |
101–019: I can’t do—I can’t do biking on a bicycle, I can’t go hiking, I can’t do anything that I used to do. I am just—going to the mall, I can’t even do that, it’s just—sorry. I tried to go to the mall twice and I—I just am in so much pain, I just have to leave. | |
Does your health now limit you in doing heavy work around the house like scrubbing floors, or lifting or moving heavy furniture? | 101–001: I don’t do heavy household chores now because I can’t handle it pain wise because I have to have the energy for my daughter. So I conserve my energy and my pain. So I’m not doing that. |
101–011: I definitely have more problems, especially doing yard work kind of things. Um, the heavier type stuff. | |
101–021: If I’m out mowing the yard, it’s—it’s a challenge as the old mower bag gets full of grass for me to push it. I definitely can’t push it as fast as I used to. I cannot finish the yard in 20–25 min. It takes me 45 now, and I think some of that has to do with the musculature around where that tumor was | |
Are you able to push open a heavy door? | 101–004: Right before the surgery. I just wouldn’t do anything that required pushing or pulling. |
101–019: Any pushing—pulling is very painful. It just feels like, like I know using that part of my leg it just is—it just can be so painful. | |
Are you able to carry a heavy object (over 10 pounds/5 kg)? | 101–001: This morning I was on the fourth floor of the building and it had a false fire alarm, so I had to walk down four flights of stairs and walk back up four flights of stairs. …..It was very, very, very painful and I was carrying my daughter, which she weighs 25 pounds, so – |
101–004: My daughter was young enough that she wanted to be held and carried and I couldn’t because it would shift my balance off so much that if I did have any sort of, you know, instability, I was terrified that I would drop her. | |
Does your health now limit you in doing moderate work around the house like vacuuming, sweeping floors or carrying in groceries? | 101–002: My house is [number] square foot and I have to stop and I only have carpeting in – I have carpeting everywhere but two rooms, so I have to do it in sections. I can’t do it continuously. I have to stop and rest in between. |
101–012: I knew it was happening a lot. I--actually after it healed about two weeks later it--I—that really showed me how much I was compensating because the little things like bending down in the grocery store to get a product off the lower shelf, um, and cleaning around the house. I just didn’t realize I was compensating for the knee. | |
101–014: Ah, like vacuuming. That doesn’t work too well because you plant yourself and you kind of twist to do that. At times like after surgeries and for quite some time, I will wear like my heavy duty boot which does not let me bend it. I ask other people to do it or I stand and plant myself and do more with like my arms instead of my legs. And I have compensated or get other people to do it. | |
Does your health now limit you in lifting or carrying groceries? | 101–004: So, you know, even with grocery shopping, I really have to watch where my center of gravity is and, you know, again, pivoting on the bad leg, um, try to avoid doing that, especially carrying the extra weight of the groceries. |
Are you able to go up and down stairs at a normal pace? | 101–001: I have a pretty hard time going down stairs…. And, I mean, just going down just a couple stairs gives me difficulty because if my pain is enough, I have to take one like just one stair at a time, you know what I mean?.... I do have difficulty going up the stairs. Um, unless I have a rail to hang onto, and then maybe it would be a little lower. |
101–008: I can climb them and I can climb them one foot after the other, but I can feel the pain in the knee when I do that…. Stairs are probably one of the things where I notice it a lot. | |
101–019: I’ve been trying to walk up and down the stairs like, you know, like normal. You know, like you go your left foot, then your right foot – that kind of thing, instead of just going one leg, one leg, one leg, up and down. And going down has the tendency to uh—I just have difficulty bending my leg. I just think it’s worse going down, trying to with my leg. | |
Are you able to carry a laundry basket up a flight of stairs? | 101–004: Um, a lot of times you’re carrying or pushing a cart or carrying a basket, and anytime I have to kind of, not just me, but I have to like push a cart or carry a basket, it just adds a little bit more, um, so it is just – I don’t want to say it is exceedingly difficult, but I definitely am more focused to make sure that I don’t shift my weight wrong or do something like that. |
101–011: Carrying laundry up and, you know, carrying loads of laundry up and down the stairs that type of thing…. I definitely have issues, um, doing those types of things. | |
Are you able to stand for one hour? | 101–001: My biggest issue is just standing still, you know, just putting all my weight…. It’s just – it happens all the time if I stand in one spot for more than like a couple minutes. I mean, probably within 30 s of standing – just standing, I start feeling like major discomfort. |
101–005: I mean, I could stand for 30 min at a time, but it was not comfortable and I – it would, um, be painful and be a lot more swollen and full of fluid and all of that. | |
101–019: You know I can’t even stand for very long. When I go to church, I stand for a little bit and then I just have to sit down. | |
Does your health now limit you in bending, kneeling, or stooping? | 101–010: If I drop something on the floor I will try to find a way to pick it up with my toes. You know, bending at the hips instead of the knee because if I—if I bend with the knee that hurts a lot. |
101–017: So I don’t have a lot or range of motion on my knee, so I can’t bend down on my knees or get on my knees and, you know, kneel down or anything like that. I’m not able to do that. I can’t put any pressure on my knees and bending it, you know, the range of motion on my knee is not very good at all. | |
101–018: I would never think of bending to the floor using my hips so I think of bending to the floor as squatting down, bending my knees to the floor and that is extremely painful or probably the most painful. | |
Are you able to exercise for an hour? | 101–001: I had to stop, um, running. I had to put it up as much as I could when I wasn’t working. So basically like as soon as I got home from work, I’d just sit on the couch and have it elevated, so I couldn’t do much. Definitely limited my activity. |
101–010: I used to work out on my light elliptical machine and, uh, exercise bikes and stuff. I can’t do that anymore just because—well for the exercise bike that much movement makes the knee hurt. | |
101–011: I mean, I can’t run, I can’t, do any, you know, high impact kind of activities. I have a hard time even bicycling because of the range of motion, so, but I can ride a bike if I’m really careful, then I can ride. Um, but yeah, it affects my things I can do every single day. |
Results of the PROMIS-PF checklist exercise were complementary to the descriptions provided by patients (Additional file 1: Table S1). Of the 48 items on the list of items potentially relevant to individuals with a tumor of any location, 10 items were endorsed by the majority of participants (range: 50%—80%). The two most commonly endorsed items (80%) were Participate in active sports? and Doing vigorous activities, such as run.
Among the 39 items administered to the participants with lower extremity tumors, 20 items were endorsed by the majority of participants (50% - 90%). Some common items among the lower extremity participants included: Are you able to go up and down stairs at a normal pace? (85%); Does your health now limit you in bending, kneeling, or stooping? (80%); Are you able to stand for 1 hour? (80%).
Review of IRT-based PROMIS-PF item parameters
PROMIS-PF items and parameters
PROMIS Physical Functioning Item | Item Wording | IRT Parametersa,b | ||||
|---|---|---|---|---|---|---|
Slope | Threshold 1 | Threshold 2 | Threshold 3 | Threshold 4 | ||
Lower Extremity | ||||||
PFA23 | Are you able to go for a walk of at least 15 min? | 4.28753 | − 1.9146 | − 1.5792 | − 1.1944 | − 0.6814 |
PFA21 | Are you able to go up and down stairs at a normal pace? | 4.23685 | −1.885 | −1.4805 | − 1.0464 | − 0.3953 |
PFA10 | Are you able to stand for one hour? | 3.37529 | −1.7469 | −1.3522 | − 0.9182 | − 0.3361 |
PFA3 | Does your health now limit you in bending, kneeling, or stooping? | 2.94958 | −2.25 | −1.2635 | − 0.563 | 0.029 |
PFA42 | Are you able to carry a laundry basket up a flight of stairs? | 4.39902 | −1.8357 | −1.4509 | − 1.0267 | − 0.4249 |
PFB1 | Does your health now limit you in doing moderate work around the house like vacuuming, sweeping floors or carrying in groceries? | 4.38889 | −2.4474 | −1.6384 | −1.076 | −0.632 |
PFA5 | Does your health now limit you in lifting or carrying groceries? | 4.13549 | −2.3684 | −1.6186 | −1.0365 | −0.5334 |
PFA12 | Are you able to push open a heavy door? | 3.45638 | −2.7039 | −2.0429 | −1.52 | −0.7504 |
PFA14r1 | Are you able to carry a heavy object (over 10 pounds/5 kg)? | 3.43 | −2.21 | −1.74 | −1.25 | −0.66 |
PFB54 | Does your health now limit you in going OUTSIDE the home, for example to shop or visit a doctor’s office? | 3.39556 | −3.286 | −2.2698 | −1.6877 | −1.1944 |
PFA16r1 | Are you able to dress yourself, including tying shoelaces and buttoning up your clothes? | 3.37 | −3.14 | −2.56 | −1.91 | −1.24 |
PF4 | Does your health now limit you in doing heavy work around the house like scrubbing floors, or lifting or moving heavy furniture? | 4.39902 | −1.5594 | −0.9773 | −0.4150 | 0.0586 |
PFA13 | Are you able to exercise for an hour? | 2.95971 | −1.4114 | −0.9872 | −0.415 | 0.3052 |
Discussion
The PROMIS-PF items identified for inclusion in the lower extremity scale were selected based on the combined evidence across all areas of research used in this study. Input from clinical experts [11], direct patient interviews, the results of a PROMIS-PF checklist exercise, and information on the individual PROMIS-PF item properties were used to identify the most relevant, broadly applicable and appropriate items with which to measure impacts on physical functioning in patients with lower extremity TGCT tumors. The use of the PROMIS-PF IRT parameters in particular, is a novel application of instrument methodology which enhances confidence in the validity of instruments in rare diseases such as TGCT where it might be difficult to recruit sufficient patients for traditional validation.
This study did seek to gain input from individuals with upper extremity tumors. However, as the majority of TGCT tumors occur in the lower extremities, recruitment of individuals with upper extremity tumors was challenging, and only two participants were enrolled. Though input from participants with upper extremity tumors was limited, and the results of the PROMIS-PF checklist exercise was only marginally informative among these patients, it is important to note that the review of the qualitative interview transcripts from these upper extremity patients provided highly specific and relevant information that was consistent across the two. For example, there were five PROMIS-PF concepts that were discussed as PF impacts by both upper extremity participants (i.e., exercise for an hour, moderate work around the house, lifting or carrying groceries, carry a heavy object, and push open a heavy door). These limited data represent a valuable contribution to our knowledge on this important subgroup from a rare disease population, however, additional studies of patients with upper extremity tumors is an area for future research.
There are multiple strengths in the use of the PROMIS-PF scales in the TGCT patient population. First, TGCT tumors can be found in either the upper extremities or lower extremities, and the PROMIS-PF item bank provides the opportunity to include measurement of the impacts of tumors regardless of location in a way that is not possible with other measures. Second, the IRT scoring approach of PROMIS allows for item reduction and customization of scales that are unidimensional and not excessively redundant. In addition, because the PROMIS-PF items were calibrated together, the validity of the item bank has been established, all items are considered to be on the same metric, and item parameters do not have to be recalibrated in each patient population [19, 20]. The physical functioning scores for each participant, regardless of tumor location, can be scored on the same physical functioning metric and analyzed together.
The content validity work reported herein is consistent with an important goal of the PROMIS initiative, which is application of the PROMIS item banks across patient populations [12]. A perspective paper by Magasi and colleagues [21], emphasized the importance of content validity in the PROMIS items across patient populations. In this paper, the working group advocated for meticulously documented qualitative and quantitative methods for the evaluation of content validity. Further, the group recommended empirical evaluation of generalizability of content validity across applications, and use of generic measures (i.e., PROMIS item banks) as the foundation for PRO assessment [21].
In addition to the work done in lower extremity orthopedic [16, 17] and arthritis patient populations [18], Garcia and colleagues [22] have highlighted actions of the National Cancer Institute (NCI) to assure content validity and application of the PROMIS item banks to cancer patients and survivors. NCI supported the data collection for item calibration and norming from 2000 patients with cancers of various types. Data collection included administration of the PROMIS item banks to 500 patients recruited from cancer clinics and tumor registries, and 1500 patients across the continuum of cancer care [22]. In addition, NCI placed an emphasis on the achievement of content and construct validity through the inclusion of domain expert and patient input via focus groups or cognitive interviews to enhance the cancer relevance of the five PROMIS domains [23].
There are limitations to the work herein that deserve mention. Recruitment of patients with a rare disease can be extremely challenging. This study was unable to recruit a sample of patients representing all bodily locations that can be affected by TGCT. For example, no participants experienced a tumor in the jaw or spine, and only two participants had tumors located in the upper extremities. As a consequence, there are some assumptions made about the nature and extent of the impacts of TGCT on physical functioning for patients with tumors in those locations. In addition, our analysis of the qualitative interview data relevant to the specific PROMIS-PF items was not an a priori goal of this work. Had we specifically probed during the interviews on all concepts in the PROMIS-PF it is possible that participant feedback would have been supportive of fewer or more items, yet those results would have arguably been vulnerable to investigator/interviewer and responder bias [24]. It is important to note that this study demonstrates the content validity of the lower extremity items that were included in the short forms; it does not address whether any additional items should have been included. In other words, the data demonstrate the relevance of the included items, but whether other additional items of relevance should have been included is not directly addressed by the study design. Finally, the PROMIS items are not presented with a specific recall period (e.g., 7-day recall) [15]. This was addressed in candidate item selection for this study by focusing on generalizable, common, daily activities and tasks, but may be viewed by some as a limitation of the PROMIS-PF item bank.
The PROMIS-PF items identified through this study were included as outcome measures in a Phase III clinical trial of pexidartinib (a small molecule kinase inhibitor of CSF1R) in patients with TGCT (NCT02371369). The process to identify these subscales was consistent with guidance on PRO measures issued by the FDA and European Medicines Agency (EMA) [25, 26]. The methods reported in this study are recommended for those aiming to identify relevant PROMIS-PF items for other disease indications where patients may be difficult to recruit and/or the patient population may have heterogeneous manifestations in the concept being measured. The use of the PROMIS item banks to develop and score custom forms based on the IRT-item parameters estimated during the development and calibration of the PROMIS item banks assumes that there are no condition-by-item interactions (i.e., measurement invariance). Prior research across several other disease areas has shown instances of differential item functioning to be fairly rare, and to have negligible effects on the calculated scores [27, 28].
Conclusions
Considerable background and qualitative research among patients with TGCT was undertaken to identify impacts on physical functioning. The results of clinician interviews, a qualitative interview study, and review of PROMIS-PF item parameters were used to identify relevant items for the measurement of physical functioning among patients with this rare disease. Two PROMIS-PF scales were created, tailored to patients with either upper or lower extremity tumors respectively, with overlap in items across the two scales. These scales were incorporated into a phase III clinical trial (ENLIVEN; NCT02371369). There is substantial evidence from prior research to support the content validity of the PROMIS-PF items generally. The qualitative study conducted among patients with TGCT [11] further supports the content validity of the PROMIS-PF items in this patient population specifically.
Abbreviations
- BPI:
-
Brief Pain Inventory
- CAT:
-
Computer adaptive test
- CSF1:
-
Colony-stimulating factor 1
- CSF1R:
-
Colony-stimulating factor 1 receptor
- EMA:
-
European Medicines Agency
- FDA:
-
Food and Drug Administration
- GCT-TS:
-
Giant cell tumors of the tendon sheath
- HAQ:
-
Health Assessment Questionnaire
- HRQL:
-
Health-related quality of life
- ICF:
-
International Classification of Functioning, Disability and Health
- IRT:
-
Item response theory
- NCI:
-
National Cancer Institute
- NRS:
-
Numerical rating scale
- PF:
-
Physical function
- PRO:
-
Patient-reported outcome
- PROMIS:
-
Patient-Reported Outcomes Measurement Information System
- PVNS:
-
Pigmented villonodular synovitis
- QOL:
-
Quality of life
- SF-36:
-
36-Item Short Form Health Survey
- TGCT:
-
Tenosynovial giant cell tumor
- UE:
-
upper extremity
- WOMAC:
-
Western Ontario and McMaster Universities Osteoarthritis Index
Declarations
Acknowledgements
The authors acknowledge Fritz Hamme and Karen Trewick for their assistance in preparing the manuscript for publication and assisting with the submission process.
Funding
This study was funded by Plexxikon and Daiichi-Sankyo.
Availability of data and materials
Data will not be shared as consent to do so was not obtained from participants during the informed consent process.
Authors’ contributions
Study Conception: HG; ST; HH; PL; Study Design: HG; ST; JH; SB; RL; WT; Data Collection: HG; Data Analysis: HG; LM; RS; Data Interpretation: HG; XY, RS; ST, JH; SB; RL; LM; GM; WL; HH; PL; WT; Manuscript Development: HG; RS; Manuscript Review and Approval: HG; XY, RS; ST, JH; SB; RL; LM; GM; WL; HH; PL; WT.
Ethics approval and consent to participate
All procedures performed in studies involving human participants were in accordance with the ethical standards of the institutional and/or national research committee and with the 1964 Helsinki declaration and its later amendments or comparable ethical standards.
Informed consent was obtained from all individual participants included in the study.
Consent for publication
Not applicable
Competing interests
H. Gelhorn, R. Speck, W. R. Lenderking, and L. Murray participated in this project as employees of Evidera, a company which performs work for hire for multiple pharmaceutical and device companies in outcomes research. S. Tong, and P. Lin are employees of Plexxikon Inc.; H. Hsu is a medical consultant for Plexxikon Inc.; G. Maclaine is an employee of Daiichi Sankyo UK Ltd.; W. Tap and J. Healey have previously consulted for Daiichi Sankyo and Plexxikon. Xin Ye is an employee of Daiichi Sankyo Inc. which provided funding for this study. S. Bukata and R. Lackman have no conflicts of interest to report.
Publisher’s Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Open AccessThis article is distributed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made.
Authors’ Affiliations
References
- Verspoor, F. G., Zee, A. A., Hannink, G., et al. (2014). Long-term follow-up results of primary and recurrent pigmented villonodular synovitis. Rheumatology, 53(11), 2063–2070. https://doi.org/10.1093/rheumatology/keu230 PubMed PMID: 24917565.View ArticlePubMedGoogle Scholar
- Brahmi, M., Vinceneux, A., & Cassier, P. A. (2016). Current systemic treatment options for tenosynovial giant cell tumor/pigmented villodular synovitis: Targeting CSF1/CSF1R Axis. Curr Treat Options in Oncol, 17(2), 10.View ArticleGoogle Scholar
- Ravi, V., Wang, W. L., & Lewis, V. O. (2011). Treatment of tenosynovial giant cell tumor and pigmented villonodular synovitis. Curr Opin Oncol, 23(4), 361–366. https://doi.org/10.1097/CCO.0b013e328347e1e3 PubMed PMID: 21577109.View ArticlePubMedGoogle Scholar
- Molena, B., Sfriso, P., Oliviero, F., et al. (2011). Synovial colony-stimulating factor-1 mRNA expression in diffuse pigmented villonodular synovitis. Clin Exp Rheumatol, 29(3), 547–550 PubMed PMID: 21640049.PubMedGoogle Scholar
- West, R. B., Rubin, B. P., Miller, M. A., et al. (2006). A landscape effect in tenosynovial giant-cell tumor from activation of CSF1 expression by a translocation in a minority of tumor cells. Proc Natl Acad Sci U S A, 103(3), 690–695. https://doi.org/10.1073/pnas.0507321103 PubMed PMID: 16407111; PubMed Central PMCID: PMC1325107.View ArticlePubMedPubMed CentralGoogle Scholar
- Cupp, J. S., Miller, M. A., Montgomery, K. D., et al. (2007). Translocation and expression of CSF1 in pigmented villonodular synovitis, tenosynovial giant cell tumor, rheumatoid arthritis and other reactive synovitides. Am J Surg Pathol, 31(6), 970–976. https://doi.org/10.1097/PAS.0b013e31802b86f8 PubMed PMID: 17527089.View ArticlePubMedGoogle Scholar
- Tap, W. D., Wainberg, Z. A., Anthony, S. P., et al. (2015). Structure-guided blockade of CSF1R kinase in Tenosynovial Giant-cell tumor. N Engl J Med, 373(5), 428–437. https://doi.org/10.1056/NEJMoa1411366 PubMed PMID: 26222558.View ArticlePubMedGoogle Scholar
- Eckhardt, S. G., De Porre, P., Smith, D., et al. (2009). Patient-reported outcomes as a component of the primary endpoint in a double-blind, placebo-controlled trial in advanced pancreatic cancer. J Pain Symptom Manag, 37(2), 135–143. https://doi.org/10.1016/j.jpainsymman.2008.02.007 PubMed PMID: 18723314; PubMed Central PMCID: PMC2856704.View ArticleGoogle Scholar
- Food and Drug Administration. Clinical Trial Endpoints for the Approval of Non-Small Cell Lung Cancer Drugs and Biologics Guidance for Industry 2015 [February 14, 2017]. Available from: http://www.fda.gov/downloads/Drugs/Guidances/UCM259421.pdf
- Thomas, D. M. (2015). The growing problem of benign connective tissue tumours. The Lancet Oncology, 16(8), 879–880. https://doi.org/10.1016/S1470-2045(15)00147-3 PubMed PMID: 26179199.View ArticlePubMedGoogle Scholar
- Gelhorn, H. L., Tong, S., McQuarrie, K., et al. (2016). Patient-reported symptoms of Tenosynovial Giant cell tumors. Clin Ther, 38(4), 778–793. https://doi.org/10.1016/j.clinthera.2016.03.008 PubMed PMID: 27041409.View ArticlePubMedPubMed CentralGoogle Scholar
- Cella, D., Yount, S., Rothrock, N., et al. (2007). The patient-reported outcomes measurement information system (PROMIS): Progress of an NIH roadmap cooperative group during its first two years. Med Care, 45(5 Suppl 1), S3–S11. https://doi.org/10.1097/01.mlr.0000258615.42478.55 PubMed PMID: 17443116; PubMed Central PMCID: PMC2829758.View ArticlePubMedPubMed CentralGoogle Scholar
- DeWalt, D. A., Rothrock, N., Yount, S., et al. (2007). Evaluation of item candidates: The PROMIS qualitative item review. Med Care, 45(5 Suppl 1), S12–S21. https://doi.org/10.1097/01.mlr.0000254567.79743.e2 PubMed PMID: 17443114; PubMed Central PMCID: PMC2810630.View ArticlePubMedPubMed CentralGoogle Scholar
- Rose, M., Bjorner, J. B., Becker, J., et al. (2008). Evaluation of a preliminary physical function item bank supported the expected advantages of the patient-reported outcomes measurement information system (PROMIS). J Clin Epidemiol, 61(1), 17–33. https://doi.org/10.1016/j.jclinepi.2006.06.025 PubMed PMID: 18083459.View ArticlePubMedGoogle Scholar
- Bruce, B., Fries, J. F., Ambrosini, D., et al. (2009). Better assessment of physical function: Item improvement is neglected but essential. Arthritis research & therapy, 11(6), R191. https://doi.org/10.1186/ar2890 PubMed PMID: 20015354; PubMed Central PMCID: PMC3003539.View ArticleGoogle Scholar
- Hung, M., Clegg, D. O., Greene, T., et al. (2012). A lower extremity physical function computerized adaptive testing instrument for orthopaedic patients. Foot & ankle international, 33(4), 326–335. https://doi.org/10.3113/FAI.2012.0326 PubMed PMID: 22735205.View ArticleGoogle Scholar
- Hung, M., Baumhauer, J. F., Latt, L. D., et al. (2013). Validation of PROMIS (R) Physical Function computerized adaptive tests for orthopaedic foot and ankle outcome research. Clin Orthop Relat Res, 471(11), 3466–3474. https://doi.org/10.1007/s11999-013-3097-1 PubMed PMID: 23749433; PubMed Central PMCID: PMC3792246.View ArticlePubMedPubMed CentralGoogle Scholar
- Oude Voshaar, M. A., Ten Klooster, P. M., Glas, C. A., et al. (2015). Validity and measurement precision of the PROMIS physical function item bank and a content validity-driven 20-item short form in rheumatoid arthritis compared with traditional measures. Rheumatology, 54(12), 2221–2229. https://doi.org/10.1093/rheumatology/kev265 PubMed PMID: 26224306.View ArticlePubMedGoogle Scholar
- Hays, R. D., Spritzer, K. L., Fries, J. F., et al. (2015). Responsiveness and minimally important difference for the patient-reported outcomes measurement information system (PROMIS) 20-item physical functioning short form in a prospective observational study of rheumatoid arthritis. Ann Rheum Dis, 74(1), 104–107. https://doi.org/10.1136/annrheumdis-2013-204053 PubMed PMID: 24095937; PubMed Central PMCID: PMC3976454.View ArticlePubMedGoogle Scholar
- PROMIS. Physical Function, a brief guide to the PROMIS Physical Function instruments September 9, 2015 [March 9, 2017]. Available from: https://www.assessmentcenter.net/documents/PROMIS%20Physical%20Function%20Scoring%20Manual.pdf
- Magasi, S., Ryan, G., Revicki, D., et al. (2012). Content validity of patient-reported outcome measures: Perspectives from a PROMIS meeting. Qual Life Res, 21(5), 739–746. https://doi.org/10.1007/s11136-011-9990-8 PubMed PMID: 21866374.View ArticlePubMedGoogle Scholar
- Garcia, S. F., Cella, D., Clauser, S. B., et al. (2007a). Standardizing patient-reported outcomes assessment in cancer clinical trials: A patient-reported outcomes measurement information system initiative. J Clin Oncol, 25(32), 5106–5112. https://doi.org/10.1200/JCO.2007.12.2341 PubMed PMID: 17991929.View ArticlePubMedGoogle Scholar
- Garcia SF, George J, Rosenbloom SK, et al. Adapting chronic illness health related quality of life item banks for cancer populations. Budapest: Poster presented at the International Society for Quality of Life Research Conference on Patient-Reported Outcomes in Clinical Practice; 2007.Google Scholar
- Wynder, E. L. (1994). Investigator bias and interviewer bias: The problem of reporting systematic error in epidemiology. J Clin Epidemiol, 47(8), 825–827 PubMed PMID: 7730884.View ArticleGoogle Scholar
- European Medicines Agency. Reflection Paper on the Regulatory Guidance for the use of Health Related Quality of Life (HRQL) Measure in the Evaluation of Medicinal Products 2005 [March 9, 2017]. Available from: https://www.ema.europa.eu/documents/scientific-guideline/reflection-paper-regulatory-guidance-use-healthrelated-quality-life-hrql-measures-evaluation_en.pdf.
- Food and Drug Administration. (2009). Guidance for industry on patient-reported outcome measures: Use in medical product development to support labeling claims. Fed Regist, 74(235), 65132–65133.Google Scholar
- Chung, H., Kim, J., Cook, K. F., et al. (2014). Testing measurement invariance of the patient-reported outcomes measurement information system pain behaviors score between the US general population sample and a sample of individuals with chronic pain. Qual Life Res, 23(1), 239–244. https://doi.org/10.1007/s11136-013-0463-0 PubMed PMID: 23824606; PubMed Central PMCID: PMCPMC3883886.View ArticlePubMedGoogle Scholar
- Cook, K. F., Bamer, A. M., Amtmann, D., et al. (2012). Six patient-reported outcome measurement information system short form measures have negligible age- or diagnosis-related differential item functioning in individuals with disabilities. Arch Phys Med Rehabil, 93(7), 1289–1291. https://doi.org/10.1016/j.apmr.2011.11.022 PubMed PMID: 22386213.View ArticlePubMedGoogle Scholar
