Skip to main content
Journal of Patient-Reported Outcomes
Download PDF

Development and content validation of the Satisfaction and Experience Questionnaire for Granulocyte Colony-Stimulating Factor (SEQ-G-CSF)

Journal of Patient-Reported Outcomes volume 5, Article number: 10 (2021) Cite this article

Abstract

Background

Several options for granulocyte colony-stimulating factor (G-CSF) prophylaxis of chemotherapy-induced febrile neutropenia are available to patients worldwide. We have developed a novel patient-reported outcome measure, the Satisfaction and Experience Questionnaire for G-CSF (SEQ-G-CSF), to help understand patients’ perspectives of and satisfaction with different G-CSF options.

Results

Three oncology nurses and 40 adult oncology patients in the United States were enrolled and participated in focus group discussions to develop and refine the SEQ-G-CSF. Nurses had ≥ 5 years of experience treating oncology patients and were currently involved in the management of oncology patients receiving G-CSF prophylaxis. The patients had breast cancer, lung cancer, non-Hodgkin lymphoma, or prostate cancer (10 patients in each group) and were receiving G-CSF prophylaxis via injection or the on-body injector (OBI) device. The preliminary SEQ-G-CSF contained an item relevance questionnaire and three SEQ modules (sociodemographic, medical history, and G-CSF–related healthcare characteristics questionnaires). Twenty-one patients (53% of total sample size) discussed their experience and satisfaction with G-CSF. Their most common experiences were G-CSF effectiveness, convenience and benefits of the OBI, and relationships with healthcare providers. Side effects and having to undergo additional treatment were also reported. Satisfaction with aspects of G-CSF included the OBI and effectiveness of G-CSF treatment; dissatisfaction included inconvenience (having to return to the clinic the next day and administration of the injection) and the insurance approval process. The SEQ-G-CSF was finalized after three rounds of cognitive interviews and includes five domains related to general satisfaction (one item), treatment burden (four items), travel burden (two items), time burden (four items), and treatment compliance (two items).

Conclusions

The SEQ-G-CSF is a novel instrument that quantifies a patient’s experience and satisfaction with different G-CSF options using 13 easy-to-understand items. This study provides evidence for the content validity of SEQ-G-CSF. Although further psychometric testing is required, the SEQ-G-CSF may be a useful addition to clinical trials, observational studies, and clinical practice.

Plain English summary

What is the key problem/issue/question this manuscript addresses?

One of the side effects of chemotherapy is febrile neutropenia (FN), a condition associated with fever and low numbers of certain white blood cells. Granulocyte colony-stimulating factors (G-CSF) are recommended as a preventive treatment for chemotherapy-induced FN for many types of cancer. With different types of G-CSFs as well as different administration modes of G-CSFs, and currently no available valid method to quantify patients’ experience with G-CSF, the study objective was to develop an instrument to assess the chemotherapy patient’s satisfaction and experience with these different G-CSF treatment options.

Why is this study needed?

The recommendation of G-CSF use by physicians and hospitals varies based on preference, and there is currently no valid method to quantify patients’ experience with G-CSF. Thus, it is important to have an established metric for measuring satisfaction in patients who have received G-CSF treatment, to help understand their perspective.

What is the main point of your study?

We developed a novel questionnaire (SEQ-G-CSF) to quantify a patient’s experience and satisfaction with different G-CSF options, using 13 easy-to-understand items. The questionnaire was developed with input from patients and nurses to ensure that it fully captures their experience.

Provide a brief overview of your results and what they mean

This study has provided evidence of content validity for the SEQ-G-CSF, and our results indicate that patients understand the items in the questionnaire. While additional testing of other forms of validity and reliability is required, the SEQ-G-CSF may be a useful addition to clinical trials, observational studies, and clinical practice. Results of studies including this new tool will provide information to help patients and providers make an educated decision on their treatment, when there are multiple options for preventing FN.

Background

Chemotherapy-induced febrile neutropenia (FN) is associated with negative outcomes such as extended hospital stays, higher medical costs, dose reductions, dose delays, poorer treatment response, and higher risk of mortality [1]. Current guidelines recommend the use of granulocyte colony-stimulating factor (G-CSF) as prophylaxis of chemotherapy-induced febrile neutropenia when the risk of febrile neutropenia is ≥ 20% and to consider its use when the risk is 10%–20% [2,3,4,5]. Some of the most common tumor types that utilize the G-CSF particularly as primary prophylaxis are breast cancer, lung cancer, non-Hodgkin lymphoma, and prostate cancer [6,7,8,9] with an average of about 20% across various metastatic cancers in the US [10]. In the US, the prevalence of patients with metastatic cancer (having high risk of FN at > 20% and intermediate risk of FN at 10–20%) requiring G-CSF is about 45% [11]. G-CSFs are either short- or long-acting, and when administered as multiple injections per chemotherapy cycle (eg, filgrastim) or as a single injection administered once per chemotherapy cycle (eg, pegfilgrastim), they reduce the risk of febrile neutropenia and infection-related mortality [12,13,14,15].

Although pegfilgrastim is administered once per chemotherapy cycle, offering increased convenience to patients and caregivers, it should be administered the day after chemotherapy [16]. It is often inconvenient for patients to return to the clinic; therefore, the pegfilgrastim on-body injector (OBI) was developed to deliver pegfilgrastim approximately 27 h after its application [17, 18].

Factors that could influence use of G-CSF include clinical guidelines, hospital protocol, inclusion of G-CSF on drug formularies and physician and patient preference [19] as well as patient experience. Despite the availability of several options for prophylaxis of chemotherapy-induced febrile neutropenia, there is currently no valid method to quantify patients’ experience with G-CSF. We have developed a novel patient-reported outcome (PRO) measure, the Satisfaction and Experience Questionnaire for G-CSF (SEQ-G-CSF), to help understand patients’ perspectives of and satisfaction with different G-CSF options. Results of studies using this novel PRO measure may provide useful information on patient treatment experience to help with patient and clinician decision making.

Methods

The SEQ-G-CSF instrument was developed using an iterative process (Fig. 1). The concept identification stage (identification of applicable outcome measures from the literature) and the concept elicitation and confirmation stage (focus group discussions with oncology nurses and oncology patients) informed the content of the initial version of the SEQ-G-CSF.

Fig. 1
figure 1

Project flow

Full size image

Stage I concept identification: development and refinement of the SEQ-G-CSF

Prior to initiation of the study, we were unable to identify a fit-for-purpose PRO measure relevant for understanding patients’ experience and satisfaction with different G-CSF options. We therefore developed a de novo measure based on desk research with a preliminary conceptual framework that adapted relevant concepts from several existing treatment satisfaction tools [20,21,22,23]. Preliminary drafts of the SEQ-G-CSF were modified by the study staff based on accepted best practices and guidance for PRO development [24,25,26,27]. All pertinent feedback or recommendations were considered, including a Flesch-Kincaid readability assessment, to reduce the grade-level of items [28]; the conceptual framework and related items were revised accordingly.

Nurse focus groups

Oncology nurses were screened for eligibility and recruited through a third-party recruitment vendor to participate in focus group discussions conducted through an online platform. Eligible oncology nurses had ≥ 5 years of experience with treating oncology patients and were currently involved in the management of oncology patients receiving G-CSF prophylaxis. The 60-min nurse focus group discussion took place via a webcam link. A semi-structured, standardized discussion guide was used in the focus group discussions with oncology nurses. The purpose of the focus groups was to assess the patient experience and satisfaction with G-CSF. Topics included their background and experience as well as their assessment of patient experience and satisfaction with oncology treatment and G-CSF prophylaxis (Table 1). Nurses also answered several closed- and open-ended questions using polling software. Nurse focus groups discussions were conducted before patient focus group discussions, and findings from the nurse discussions informed development of the patient concept elicitation discussion guides.

Table 1 Concept elicitation and cognitive interview discussion topics
Full size table

Patient focus groups

Breast cancer, lung cancer, non-Hodgkin lymphoma, and prostate cancer patients were screened for eligibility and recruited through a third-party recruitment vendor to participate in focus group discussions on an online platform.

Oncology patients were required to submit proof of a physician’s verification of cancer diagnosis and chemotherapy medication. Other eligibility criteria included: patients aged ≥ 18 years old with a self-report of breast cancer, lung cancer, non-Hodgkin lymphoma, or prostate cancer as well as current or recent (< 6 months from screening date) chemotherapy and prophylaxis with G-CSF. In addition, patients were required to be US residents, have access to the internet, have sufficient proficiency in the English language to complete the consent process and participate in focus group discussions, and be willing to be audio-recorded during discussions.

Based on the types of concepts being explored, it was estimated that a minimum of 10 patients were required per group to achieve saturation [29]. Quota sampling was utilized to recruit 40 patients from four cancer groups (breast cancer, lung cancer, non-Hodgkin lymphoma, and prostate cancer; n = 10 in each group) and two subgroups (OBI-naive: patients who had never used the OBI; OBI-experienced: patients who had used or are currently using the OBI; n = 20 in each group). The target quotas were to recruit ten patients per cancer type: five who were OBI-naive and five who were OBI-experienced. The goal was to conduct up to three rounds of focus groups; a minimum of two to three focus groups per round.

The study protocol was reviewed and approved by Quorum Review Institutional Review Board (approval number 33649), and all participants provided their written informed consent before the start of each interview discussion.

Patient experience and satisfaction with G-CSF: concept elicitation

The objective of the concept elicitation portion of the patient focus group was to elicit patients’ experience with G-CSF prophylaxis (Table 1). Semi-structured discussion guides were developed with specific questions for OBI-naive and OBI-experienced patient groups. A Microsoft PowerPoint presentation based on the semi-structured patient discussion guide was developed for use during focus group discussions and telephone interviews. The presentation allowed patients to view the treatment satisfaction and experience topics. Individual interviews took place when patients were not available for group discussions.

Focus group discussions took place via a webcam link; 90 min for Round 1 and 2 participants and 60 min for Round 3 and individual interviews. Each focus group discussion was audio- and video-recorded, and transcripts from audio data were de-identified and coded. All participants were compensated for their time based on an assessment of the fair market value and length of focus group discussion.

Based on results from round 1 concept elicitation focus group discussions, the initial version of the SEQ-G-CSF was revised, and additional hybrid concept elicitation and cognitive interview focus groups were planned as needed to support attainment of concept saturation.

Content confirmation of SEQ-G-CSF: cognitive interview

The objective of the cognitive interview portion of the patient focus group was to elicit patients’ experience with G-CSF prophylaxis and assess comprehension whether the instructions, items, response options, and terminology in the SEQ-G-CSF were understandable and relevant (Table 1). The initial version of the SEQ-G-CSF was shared with oncology patients during each of the three rounds of focus groups. Patients completed draft SEQ-G-CSF and then participated in a group cognitive interview. The PowerPoint presentation, which included the initial SEQ-G-CSF items and response options alongside alternative items and response options, was used during the cognitive interview portion for patient review and discussion.

After the cognitive interview portion, patients completed three additional SEQ modules, including an SEQ-G-CSF item relevance questionnaire (Supplementary Materials). The item relevance questionnaire obtained relevance ratings for each item of the SEQ-G-CSF. Patients rated the relevance of each SEQ-G-CSF item based on their medical condition and treatment, and responses were recorded on a five-point verbal rating scale. The three SEQ modules were used for collecting descriptive information: sociodemographic (SEQ module 1), medical history (SEQ module 2), and G-CSF-related healthcare characteristics (SEQ module 3) questionnaires. Patients provided feedback on the SEQ-G-CSF.

Data analysis

Saturation was defined as the point at which no substantially new themes, descriptions of a concept, or terms were introduced as additional rounds of focus group discussions were being conducted. The concepts arising from the concept elicitation sessions were evaluated for saturation as the discussions were being conducted. No further additional interviews were considered if saturation was achieved.

During focus group discussions, structured counts were taken for each treatment experience and satisfaction concept to document saturation using a saturation grid that displayed the first mention of emerging concepts. For the concept elicitation portion, a coding framework was developed related to the meaning of treatment experience and satisfaction. The preliminary conceptual framework was imported into ATLAS.ti v8 to code the concept elicitation portion of the focus group transcripts. A content analysis approach was used to analyze and interpret the concept elicitation–coded data [30]. For the cognitive interview portion, a coding framework was developed to document focus group discussions specific to the SEQ-G-CSF instructions, original items and response options, alternative items and response options, and any spontaneous feedback related to missing concepts or suggested wording changes.

Quantitative data from case report forms were descriptive (n, mean, standard deviation, and/or frequency); analyses were done using SAS version 9.4 [31].

Results

Nurse characteristics

Four oncology nurses were screened and were eligible to participate in the focus group discussions; however, one nurse was unable to participate on the scheduled date. On average, each of the three nurses who participated in the study saw 118 oncology patients per week across the four cancer groups, had experience administering G-CSF (filgrastim and pegfilgrastim, an average of 13 patients per week), and had provided the OBI to patients in each of the four cancer groups (an average of six patients per week).

Patient characteristics

A total of 40 patients who were receiving G-CSF, 19 OBI-experienced and 21 OBI-naive, were enrolled. Between December 06, 2018, and January 17, 2019, 10 focus group discussions were conducted with 36 patients, and individual interviews were conducted with four patients. All 40 patients completed the questionnaires and participated in the cognitive interview portion; data were collected from three rounds of focus groups. Fifty-three percent of the participants (n = 21/40) participated in the concept elicitation portion of the focus groups.

Two patients with prostate cancer did not return all the required study forms, and they were not included in all quantitative analyses; they did, however, contribute qualitative data and were included in those analyses. Patient characteristics and medical histories are shown in Table 2.

Table 2 Patient characteristics and medical history
Full size table

The proportion of male and female patients was the same, and the median age was 52 (range: 30–90) years. Overall, 40% of patients had metastatic cancer, 83% had completed chemotherapy within 6 months of enrollment, 75% had received their last G-CSF treatment within 6 months of enrollment, and 48% had received pegfilgrastim for febrile neutropenia prophylaxis.

Nurse concept elicitation

Oncology nurses described patients’ satisfaction and tolerability with chemotherapy and G-CSF treatment based on their own clinical practice experience. Nurses reported that patients receiving chemotherapy and G-CSF derive satisfaction from experiencing a treatment response (an indication that the treatment is working), minimal hospital stays and co-pays, and good communication with their cancer care team. Nurses also stated that patients tend to tolerate treatment side effects if they see a treatment response or if their quality of life is not significantly impacted.

Patient concept elicitation

The concept elicitation portion of the patient focus groups identified patients’ experience and satisfaction with chemotherapy and G-CSF prophylaxis, including side effects, treatment effect, and the treatment process and setting.

Patient experience and satisfaction with chemotherapy

Eighteen patients (45% of total sample size) discussed their experience and satisfaction with chemotherapy. The most common positive aspects related to patients’ experience with chemotherapy were treatment effectiveness (50%), relationships with healthcare providers (39%), and having supportive relationships (22%). The most common negative aspects were side effects of chemotherapy (56%); emotional burden, including fear and feelings of vulnerability (33%); time burden due to frequent treatment visits, follow-up visits, and time spent waiting for and receiving treatment (33%); concerns over drug safety (33%); and treatment burden (22%).

Satisfaction with aspects of chemotherapy included positive interactions with healthcare providers (33%), treatment effectiveness (28%), minimal time burden (17%), and having insurance and minimal paperwork (11%). Dissatisfaction with aspects of chemotherapy were health outcomes after chemotherapy (33%), disease course (22%), treatment burden (22%), and side effects (17%).

Patient experience and satisfaction with G-CSF

Twenty-one patients (53% of total sample size) discussed their experience and satisfaction with G-CSF. The most common positive experiences were G-CSF effectiveness (90%), convenience (43%, only reported by patients who had used the OBI), relationships with healthcare providers (38%), and benefits of the OBI (29%), including convenience, ease of use, available support, and reduced travel and time burden (Table 3). The most common negative experiences were side effects (33%, lethargy and fatigue) and having to undergo additional treatment (19%, more medication). Additional concerns with G-CSF were injection discomfort (10%), sleep interruption (10%), increased emotional stress (5%), G-CSF not being a cure (5%), inadequate G-CSF knowledge (5%), missing work (5%), and insufficient monitoring for subcutaneous G-CSF users (5%).

Table 3 Patient experience and satisfaction with G-CSFa
Full size table

Satisfaction with aspects of G-CSF were the OBI (13%, among those who used the device) and effectiveness of G-CSF treatment (47%). Dissatisfaction with aspects of G-CSF were inconvenience (24%, having to return to the clinic the next day and administration of the injection) and dose regulation (14%, not seeing dramatic effects of the G-CSF treatment or not being weaned off their current dose) (Table 3).

SEQ-G-CSF cognitive interview results

A total of 10 focus group discussions with 36 patients and individual interviews with four patients were conducted: four focus group discussions in round 1 (n = 15), four focus group discussions in round 2 (n = 15), and two focus group discussions (n = 6) and four individual interviews in round 3. Of the 40 patients who participated, 65% provided their overall impression of the SEQ-G-CSF item relevance questionnaire, 20% stated that questions should be removed, 18% stated that questions should be changed, 13% stated that the length of the questionnaire was appropriate, and 13% stated that additional questions were needed.

Mean relevancy scores for each item in the initial SEQ-G-CSF item relevance questionnaire are shown in Fig. 2. Based on participant feedback after round 1 of focus group discussions, some items were revised. The original and alternative items were then reviewed in round 2 of discussions. Finally, all iterations (original item and alternative item) were reviewed in round 3 of discussions. The final version of each item was based on the summary of all feedback received from participants in rounds 1, 2, and 3; item-level feedback is presented in Table 4.

Fig. 2
figure 2

Mean relevancy scores for each item in the initial SEQ-G-CSF item relevance questionnaire (response scale: 1=not important, 2=slightly important, 3=moderately important, 4=very important, 5=extremely important). The question “Did you take the most recent prescribed G-CSF treatment?” is not scored, as it was specifically designed to determine how many patients were non-adherent to their recent G-CSF treatment

Full size image
Table 4 SEQ-G-CSF Item History
Full size table

Final SEQ-G-CSF and revised conceptual framework

The final SEQ-G-CSF comprises 13 items, including two items (1 and 2 in the final version) that are not scored. The conceptual framework was revised to link individual items to hypothesized PRO domains and overall summary scores (as applicable) based on findings from the focus group discussions. The final conceptual framework includes five domains related to general satisfaction (one item), treatment burden (four items), travel burden (two items), time burden (four items), and treatment compliance (two items) (Fig. 3).

Fig. 3
figure 3

Final conceptual framework

Full size image

Discussion

The SEQ-G-CSF was developed and tested using a systematic, iterative process to confirm content validity based on accepted best practices and guidance for PRO development [24,25,26,27]. The SEQ-G-CSF is the first PRO instrument designed specifically to measure patients’ satisfaction and experience with different G-CSF prophylaxis options. Its inclusion in research studies, as a part of a comprehensive evaluation of different treatment options, would add important information to support patient and clinician decision making.

Several treatment satisfaction instruments were available prior to development of the SEQ-G-CSF, including those that assess satisfaction with medication delivery via injections [32,33,34] or satisfaction with treatment in general [23, 35, 36]. None, however, assess satisfaction and experience with prophylactic treatments administered via an injection or a device. The SEQ-G-CSF fills this gap by including five domains related to general satisfaction, treatment burden, travel burden, time burden, and treatment compliance.

The economic burden of clinic visits to receive G-CSF therapy after chemotherapy is substantial [37]. In addition, these clinic visits may be logistically challenging, requiring patients to reschedule their daily activities, arrange transportation and family care, and be absent from work [37,38,39,40,41]. Given these challenges, receiving pegfilgrastim 24 h after chemotherapy or multiple administrations of filgrastim every chemotherapy cycle may lead to suboptimal administration and loss of treatment benefit, ie, increased risk of FN [42, 43]. Survey results from 151 physicians who prescribed pegfilgrastim the same day as chemotherapy (suboptimal administration) provided insights into patient burden associated with optimal use. When asked to consider the importance of various patient or caregiver preferences when deciding to administer pegfilgrastim the same day as chemotherapy, most physicians considered travel distance, method or availability of transportation, understanding of and/or compliance with instructions for preparation and administration, and patient/caregiver request to avoid additional copays/office visits as moderately or very important [40].

In our study, patients most commonly rated G-CSF effectiveness, convenience and benefits of the OBI, and relationships with healthcare providers as positive experiences, whereas side effects, undergoing additional treatment, injection discomfort, and sleep interruption were the most common negative experiences. Surprisingly, economic burden did not factor into patients’ satisfaction with G-CSF treatment. The SEQ-G-CSF can help clinicians assess the quality of G-CSF treatment in terms of process, which is one of the three pillars of healthcare quality [44]. In addition, it will help to anticipate patients’ needs—according to the Institute of Medicine, patient-centered healthcare should be an integral part of the healthcare system [45]. Despite the potential response burden of completing such a measure in oncology trials, patients with cancer may not perceive the experience as overly burdensome [46].

Our study has several limitations. The overall small sample size makes it difficult to generalize patients’ treatment experience and satisfaction to the broader oncology patient population. In addition, there was heterogeneity in G-CSF prophylaxis experiences; participants received several types of G-CSF prophylaxis with varying modes of delivery, frequency, and duration of treatment. Furthermore, in the event of time limitations during each focus group discussion, the interviewer prioritized the review of SEQ-G-CSF items for which participants had proposed changes in prior discussions.

Conclusions

With the availability of different options for administering G-CSF prophylaxis, it is important to support decision making with patients’ perspectives of and satisfaction with their treatment experience. The SEQ-G-CSF is a novel PRO measure that quantifies a patient’s experience and satisfaction with different G-CSF options, using 13 easy-to-understand items. While additional testing is required, this study provides evidence of content validity. The use of SEQ-G-CSF in further studies may provide an opportunity for further psychometric testing, including item reduction, scoring, reliability, and construct validity assessment, which is necessary to support the use of the SEQ-G-CSF in scientific studies and clinical practice. After additional testing, the SEQ-G-CSF may be a useful addition to clinical trials, observational studies, and clinical practice.

Availability of data and materials

Qualified researchers may request data from Amgen clinical studies. Complete details are available at http://www.amgen.com/datasharing.

Abbreviations

G-CSF:

Granulocyte colony-stimulating factor

NHL:

Non-Hodgkin lymphoma

OBI:

On-body injector

PRO:

Patient-reported outcome

SEQ-G-CSF:

Satisfaction and Experience Questionnaire for G-CSF

References

  1. Barnes, G., Pathak, A., & Schwartzberg, L. (2014). G-CSF utilization rate and prescribing patterns in United States: Associations between physician and patient factors and GCSF use. Cancer Medicine, 3(6), 1477–1484. https://doi.org/10.1002/cam4.344.

    CAS  Article  PubMed  PubMed Central  Google Scholar 

  2. Crawford, J., Althaus, B., Armitage, J., Balducci, L., Bennett, C., Blayney, D. W., et al. (2007). Myeloid growth factors. Clinical practice guidelines in oncology. Journal of the National Comprehensive Cancer Network, 5(2), 188–202. https://doi.org/10.6004/jnccn.2007.0019.

    CAS  Article  PubMed  Google Scholar 

  3. Crawford, J., Caserta, C., & Roila, F. (2010). Hematopoietic growth factors: ESMO clinical practice guidelines for the applications. Annals of Oncology, 21(Suppl 5), v248–v251. https://doi.org/10.1093/annonc/mdq195.

    Article  PubMed  Google Scholar 

  4. Smith, T. J., Bohlke, K., Lyman, G. H., Carson, K. R., Crawford, J., Cross, S. J., et al. (2015). Recommendations for the use of WBC growth factors: American Society of Clinical Oncology clinical practice guideline update. Journal of Clinical Oncology, 33(28), 3199–3212. https://doi.org/10.1200/jco.2015.62.3488.

    CAS  Article  PubMed  Google Scholar 

  5. The National Comprehensive Cancer Network (NCCN). NCCN Clinical Practice Guidelines in Oncology®: Myeloid Growth Factors (V.2). 2016. https://www.nccn.org/professionals/default.aspx. Accessed 30 Nov 2016.

    Google Scholar 

  6. Krzemieniecki, K., Sevelda, P., Erdkamp, F., Smakal, M., Schwenkglenks, M., Puertas, J., et al. (2014). Neutropenia management and granulocyte colony-stimulating factor use in patients with solid tumours receiving myelotoxic chemotherapy--findings from clinical practice. Support Care Cancer, 22(3), 667–677. https://doi.org/10.1007/s00520-013-2021-2.

    CAS  Article  PubMed  Google Scholar 

  7. Weycker, D., Malin, J., Kim, J., Barron, R., Edelsberg, J., Kartashov, A., et al. (2009). Risk of hospitalization for neutropenic complications of chemotherapy in patients with primary solid tumors receiving pegfilgrastim or filgrastim prophylaxis: A retrospective cohort study. Clinical Therapeutics, 31(5), 1069–1081. https://doi.org/10.1016/j.clinthera.2009.05.019.

    CAS  Article  PubMed  Google Scholar 

  8. Morrison, V. A., Wong, M., Hershman, D., Campos, L. T., Ding, B., & Malin, J. (2007). Observational study of the prevalence of febrile neutropenia in patients who received filgrastim or pegfilgrastim associated with 3–4 week chemotherapy regimens in community oncology practices. Journal of Managed Care Pharmacy, 13(4), 337–348. https://doi.org/10.18553/jmcp.2007.13.4.337.

    Article  PubMed  Google Scholar 

  9. National Comprehensive Cancer Network. NCCN Clinical Practice Guidelines in Oncology (NCCN Guidelines®) for Hematopoietic Growth Factors. Version 2.2020—January 27, 2020. 2020. https://www.nccn.org/professionals/physician_gls/pdf/growthfactors.pdf. Accessed 8 Oct 2020.

    Google Scholar 

  10. Averin, A., Silvia, A., Lamerato, L., Richert-Boe, K., Kaur, M., Sundaresan, D., et al. (2020). Risk of chemotherapy-induced febrile neutropenia in patients with metastatic cancer not receiving granulocyte colony-stimulating factor prophylaxis in US clinical practice. Support Care Cancer. https://doi.org/10.1007/s00520-020-05715-3.

  11. Baig, H., Somlo, B., Eisen, M., Stryker, S., Bensink, M., & Morrow, P. K. (2019). Appropriateness of granulocyte colony-stimulating factor use in patients receiving chemotherapy by febrile neutropenia risk level. Journal of Oncology Pharmacy Practice, 25(7), 1576–1585. https://doi.org/10.1177/1078155218799859.

    CAS  Article  PubMed  Google Scholar 

  12. Clark, O. A., Lyman, G. H., Castro, A. A., Clark, L. G., & Djulbegovic, B. (2005). Colony-stimulating factors for chemotherapy-induced febrile neutropenia: A meta-analysis of randomized controlled trials. Journal of Clinical Oncology, 23(18), 4198–4214. https://doi.org/10.1200/jco.2005.05.645.

    CAS  Article  PubMed  Google Scholar 

  13. Kuderer, N. M., Dale, D. C., Crawford, J., & Lyman, G. H. (2007). Impact of primary prophylaxis with granulocyte colony-stimulating factor on febrile neutropenia and mortality in adult cancer patients receiving chemotherapy: A systematic review. Journal of Clinical Oncology, 25(21), 3158–3167. https://doi.org/10.1200/jco.2006.08.8823.

    CAS  Article  PubMed  Google Scholar 

  14. Sung, L., Nathan, P. C., Alibhai, S. M., Tomlinson, G. A., & Beyene, J. (2007). Meta-analysis: Effect of prophylactic hematopoietic colony-stimulating factors on mortality and outcomes of infection. Annals of Internal Medicine, 147(6), 400–411. https://doi.org/10.7326/0003-4819-147-6-200709180-00010.

    Article  PubMed  Google Scholar 

  15. Mhaskar, R., Clark, O. A., Lyman, G., Engel Ayer Botrel, T., Morganti Paladini, L. & Djulbegovic, B. (2014). Colony-stimulating factors for chemotherapy-induced febrile neutropenia. Cochrane Database of Systematic Reviews, 10, CD003039. https://doi.org/10.1002/14651858.CD003039.pub2.

  16. Lyman, G. H., Allcott, K., Garcia, J., Stryker, S., Li, Y., Reiner, M. T., et al. (2017). The effectiveness and safety of same-day versus next-day administration of long-acting granulocyte colony-stimulating factors for the prophylaxis of chemotherapy-induced neutropenia: A systematic review. Support Care Cancer, 25(8), 2619–2629. https://doi.org/10.1007/s00520-017-3703-y.

    Article  PubMed  Google Scholar 

  17. Joshi, R. S., Egbuna, O. I., Cairns, A. S., Friedman, M. J., Abosaleem, B., Reiner, M. T., et al. (2017). Performance of the pegfilgrastim on-body injector as studied with placebo buffer in healthy volunteers. Current Medical Research and Opinion, 33(2), 379–384. https://doi.org/10.1080/03007995.2016.1257980.

    Article  PubMed  Google Scholar 

  18. Yang, B. B., Morrow, P. K., Wu, X., Moxness, M., & Padhi, D. (2015). Comparison of pharmacokinetics and safety of pegfilgrastim administered by two delivery methods: On-body injector and manual injection with a prefilled syringe. Cancer Chemotherapy and Pharmacology, 75(6), 1199–1206. https://doi.org/10.1007/s00280-015-2731-x.

    CAS  Article  PubMed  Google Scholar 

  19. Fine, S., Koo, M., Gill, T., Marin, M., Poulin-Costello, M., Barron, R., et al. (2014). The use of granulocyte colony-stimulating factors in a Canadian outpatient setting. Current Oncology, 21(2), e229–e240. https://doi.org/10.3747/co.21.1575.

    CAS  Article  PubMed  PubMed Central  Google Scholar 

  20. Atkinson, M. J., Stewart, W. C., Fain, J. M., Stewart, J. A., Dhawan, R., Mozaffari, E., et al. (2003). A new measure of patient satisfaction with ocular hypotensive medications: The Treatment Satisfaction Survey for Intraocular Pressure (TSS-IOP). Health and Quality of Life Outcomes, 1, 67. https://doi.org/10.1186/1477-7525-1-67.

  21. Theodore-Oklota, C., Humphrey, L., Wiesner, C., Schnetzler, G., Hudgens, S., & Campbell, A. (2016). Validation of a treatment satisfaction questionnaire in non-Hodgkin lymphoma: Assessing the change from intravenous to subcutaneous administration of rituximab. Patient Preference and Adherence, 10, 1767–1776. https://doi.org/10.2147/ppa.S108489.

    Article  PubMed  PubMed Central  Google Scholar 

  22. Basch, E., Reeve, B. B., Mitchell, S. A., Clauser, S. B., Minasian, L. M., Dueck, A. C., et al. (2014). Development of the National Cancer Institute's patient-reported outcomes version of the common terminology criteria for adverse events (PRO-CTCAE). Journal of the National Cancer Institute, 106(9). https://doi.org/10.1093/jnci/dju244.

  23. Abetz, L., Coombs, J. H., Keininger, D. L., Earle, C. C., Wade, C., Bury-Maynard, D., et al. (2005). Development of the cancer therapy satisfaction questionnaire: Item generation and content validity testing. Value in Health, 8(Suppl 1), S41–S53. https://doi.org/10.1111/j.1524-4733.2005.00073.x.

    Article  PubMed  Google Scholar 

  24. Streiner, D. L., & Norman, G. R. (2016). Health measurement scales: A practical guide to their development and use (5th edition). Australian and New Zealand Journal of Public Health, 40(3), 294–295. https://doi.org/10.1111/1753-6405.12484.

    Article  Google Scholar 

  25. Patrick, D. L., Burke, L. B., Gwaltney, C. J., Leidy, N. K., Martin, M. L., Molsen, E., et al. (2011). Content validity--establishing and reporting the evidence in newly developed patient-reported outcomes (PRO) instruments for medical product evaluation: ISPOR PRO good research practices task force report: Part 2--assessing respondent understanding. Value in Health, 14(8), 978–988. https://doi.org/10.1016/j.jval.2011.06.013.

    Article  PubMed  Google Scholar 

  26. Patrick, D. L., Burke, L. B., Gwaltney, C. J., Leidy, N. K., Martin, M. L., Molsen, E., et al. (2011). Content validity--establishing and reporting the evidence in newly developed patient-reported outcomes (PRO) instruments for medical product evaluation: ISPOR PRO good research practices task force report: Part 1--eliciting concepts for a new PRO instrument. Value in Health, 14(8), 967–977. https://doi.org/10.1016/j.jval.2011.06.014.

    Article  PubMed  Google Scholar 

  27. U.S. Food and Drug Administration (FDA). Patient-reported outcome measures: use in medical product development to support labeling claims. 2009. https://www.fda.gov/downloads/drugs/guidances/UCM193282.pdf. Accessed 02 Aug 2018.

    Google Scholar 

  28. Kincaid JP, Fishburne Jr RP, Rogers RL, Chissom BS. Derivation of new readability formulas (automated readability index, fog count and flesch reading ease formula) for navy enlisted personnel. 1975. https://stars.library.ucf.edu/istlibrary/56/.

    Book  Google Scholar 

  29. Turner-Bowker, D. M., Lamoureux, R. E., Stokes, J., Litcher-Kelly, L., Galipeau, N., Yaworsky, A., et al. (2018). Informing a priori sample size estimation in qualitative concept elicitation interview studies for clinical outcome assessment instrument development. Value in Health, 21(7), 839–842. https://doi.org/10.1016/j.jval.2017.11.014.

    Article  PubMed  Google Scholar 

  30. Friese, S., & Ringmayr, T. G. (2019). ATLAS.ti 8 Windows User Manual. Berlin: ATLAS.ti. Scientific Software Develpoment GmbH. http://downloads.atlasti.com/docs/manual/manual_a8_mac_en.pdf.

  31. SAS Institute Inc. (2018). SAS/GRAPH 9.4 Reference. SAS/STAT Software, Version 9.4. SAS Institute Inc. Raleigh, NC. 1979-2018;27605:237–41. https://documentation.sas.com/?cdcId=pgmsascdc&cdcVersion=9.4_3.5&docsetId=graphref&docsetTarget=titlepage.htm&locale=en.

  32. Tatlock, S., Grant, L., Spertus, J. A., Khan, I., Arbuckle, R., Manvelian, G., et al. (2015). Development and content validity testing of a patient-reported treatment acceptance measure for use in patients receiving treatment via subcutaneous injection. Value in Health, 18(8), 1000–1007. https://doi.org/10.1016/j.jval.2015.09.2937.

    Article  PubMed  Google Scholar 

  33. Tatlock, S., Arbuckle, R., Sanchez, R., Grant, L., Khan, I., Manvelian, G., et al. (2017). Psychometric evaluation of a treatment acceptance measure for use in patients receiving treatment via subcutaneous injection. Value in Health, 20(3), 430–440. https://doi.org/10.1016/j.jval.2016.09.2410.

    Article  PubMed  Google Scholar 

  34. Keininger, D., & Coteur, G. (2011). Assessment of self-injection experience in patients with rheumatoid arthritis: Psychometric validation of the Self-Injection Assessment Questionnaire (SIAQ). Health and Quality of Life Outcomes, 9, 2. https://doi.org/10.1186/1477-7525-9-2.

  35. Ruiz, M. A., Pardo, A., Rejas, J., Soto, J., Villasante, F., & Aranguren, J. L. (2008). Development and validation of the “Treatment Satisfaction With Medicines Questionnaire” (SATMED-Q). Value in Health, 11(5), 913–926. https://doi.org/10.1111/j.1524-4733.2008.00323.x.

  36. Trask, P. C., Tellefsen, C., Espindle, D., Getter, C., & Hsu, M. A. (2008). Psychometric validation of the cancer therapy satisfaction questionnaire. Value in Health, 11(4), 669–679. https://doi.org/10.1111/j.1524-4733.2007.00310.x.

    Article  PubMed  Google Scholar 

  37. Stephens, J. M., Li, X., Reiner, M., & Tzivelekis, S. (2016). Annual patient and caregiver burden of oncology clinic visits for granulocyte-colony stimulating factor therapy in the US. Journal of Medical Economics, 19(5), 537–547. https://doi.org/10.3111/13696998.2016.1140052.

    Article  PubMed  Google Scholar 

  38. Bennett, C. L., & Calhoun, E. A. (2007). Evaluating the total costs of chemotherapy-induced febrile neutropenia: Results from a pilot study with community oncology cancer patients. Oncologist., 12(4), 478–483. https://doi.org/10.1634/theoncologist.12-4-478.

    Article  PubMed  Google Scholar 

  39. Beveridge, R. A., Rifkin, R. M., Moleski, R. J., Milkovich, G., Reitan, J. F., Paivanas, T. A., et al. (2003). Impact of long-acting growth factors on practice dynamics and patient satisfaction. Pharmacotherapy, 23(12 Pt 2), 101s–109s. https://doi.org/10.1592/phco.23.16.101s.31971.

    CAS  Article  PubMed  Google Scholar 

  40. Marion, S., Tzivelekis, S., Darden, C., Price, M. A., Sherif, B., Garcia, J., et al. (2016). “Same-day” administration of pegfilgrastim following myelosuppressive chemotherapy: Clinical practice and provider rationale. Support Care Cancer, 24(9), 3889–3896. https://doi.org/10.1007/s00520-016-3193-3.

    Article  PubMed  Google Scholar 

  41. Fortner, B. V., Tauer, K., Zhu, L., Okon, T. A., Moore, K., Templeton, D., et al. (2004). Medical visits for chemotherapy and chemotherapy-induced neutropenia: A survey of the impact on patient time and activities. BMC Cancer, 4, 22. https://doi.org/10.1186/1471-2407-4-22.

    Article  PubMed  PubMed Central  Google Scholar 

  42. Weycker, D., Bensink, M., Wu, H., Doroff, R., & Chandler, D. (2017). Risk of chemotherapy-induced febrile neutropenia with early discontinuation of pegfilgrastim prophylaxis based on real-world data from 2010 to 2015. Current Medical Research and Opinion, 33(12), 2115–2120. https://doi.org/10.1080/03007995.2017.1386638.

    Article  PubMed  Google Scholar 

  43. Weycker, D., Li, X., Figueredo, J., Barron, R., Tzivelekis, S., & Hagiwara, M. (2016). Risk of chemotherapy-induced febrile neutropenia in cancer patients receiving pegfilgrastim prophylaxis: Does timing of administration matter? Support Care Cancer, 24(5), 2309–2316. https://doi.org/10.1007/s00520-015-3036-7.

    Article  PubMed  Google Scholar 

  44. Donabedian, A. (1988). The quality of care. How can it be assessed? JAMA., 260(12), 1743–1748. https://doi.org/10.1001/jama.260.12.1743.

  45. Institute of Medicine Committee on Quality of Health Care in America (2001). Crossing the Quality Chasm: A New Health System for the 21st Century. Washington (DC): National Academies Press (US).

    Google Scholar 

  46. Atkinson, T. M., Schwartz, C. E., Goldstein, L., Garcia, I., Storfer, D. F., Li, Y., et al. (2019). Perceptions of response burden associated with completion of patient-reported outcome assessments in oncology. Value in Health, 22(2), 225–230. https://doi.org/10.1016/j.jval.2018.07.875.

    Article  PubMed  Google Scholar 

Download references

Acknowledgments

Writing support was funded by Amgen Inc. and was provided by Kathryn J Boorer, PhD, of KB Scientific Communications, LLC. Resubmission writing support was provided by Vicky Kanta, PhD, and Rick Davis, MS, RPh (ICON, North Wales, PA).

Funding

This study was funded by Amgen Inc. The funder contributed to study design, data collection, data analysis, and data interpretation and funded a professional medical writer to assist with writing the report.

Author information

Authors and Affiliations

  1. Amgen Inc., One Amgen Center Drive, Thousand Oaks, CA, USA

    Aylin Yucel, Emre Yucel, Rajesh Belani & Mark Bensink

  2. Evidera, Seattle, WA, USA

    Anne Skalicky

  3. Evidera, Bethesda, MD, USA

    Olabimpe Ruth Eseyin

Authors
  1. Aylin Yucel
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Anne Skalicky
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Olabimpe Ruth Eseyin
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Emre Yucel
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Rajesh Belani
    View author publications

    You can also search for this author in PubMed Google Scholar

  6. Mark Bensink
    View author publications

    You can also search for this author in PubMed Google Scholar

Contributions

AY, EY, RB, MB: Study concept and design, data analysis, interpretation of data, report writing. AS, ORE: Study concept and design, data acquisition, data analysis, interpretation of data, report writing. The corresponding author had full access to all data in the study and had the final responsibility for the decision to submit for publication. The author(s) read and approved the final manuscript.

Corresponding author

Correspondence to Anne Skalicky.

Ethics declarations

Ethics approval and consent to participate

This study was reviewed and approved by Quorum Review Institutional Review Board (approval number 33649). All participants signed an informed consent form before any study-related interviews were conducted.

Consent for publication

Not applicable.

Competing interests

AY, EY, and MB were employees and stockholders of Amgen at the time of this research; RB is an employee and stockholder of Amgen; AS and ORE are employees of Evidera Inc.; KJB is an ex-employee and stockholder of Amgen Inc.; Evidera Inc. received funding from Amgen Inc. for this research.

Additional information

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Supplementary Information

Rights and permissions

Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/.

Reprints and Permissions

About this article

Verify currency and authenticity via CrossMark

Cite this article

Yucel, A., Skalicky, A., Eseyin, O.R. et al. Development and content validation of the Satisfaction and Experience Questionnaire for Granulocyte Colony-Stimulating Factor (SEQ-G-CSF). J Patient Rep Outcomes 5, 10 (2021). https://doi.org/10.1186/s41687-020-00277-8

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1186/s41687-020-00277-8

Keywords

  • Myelosuppressive chemotherapy
  • Febrile neutropenia
  • G-CSF
  • On-body injector
  • OBI
  • Content validation
  • Satisfaction and Experience Questionnaire for Granulocyte Colony-Stimulating Factor
  • SEQ-G-CSF