Skip to main content
Journal of Patient-Reported Outcomes
Download PDF
Download ePub

Selection of patient reported outcomes questions reflecting symptoms for patients with metastatic melanoma receiving immunotherapy

Journal of Patient-Reported Outcomes volume 3, Article number: 19 (2019) Cite this article

Abstract

Context

Toxicity-monitoring plays an important role in all cancer treatment, however, early recognition is vital for detecting and treating immune-related symptoms. Preparing a Patient Reported Outcomes tool and including melanoma patients receiving immunotherapy in the reporting of symptoms, may optimize toxicity-monitoring.

Objectives

The objective of this study was to identify the symptoms and their equivalent questions to include from the Patient-Reported Outcomes Common Terminology Criteria for Adverse Events (PRO-CTCAE) library for melanoma patients, receiving immunotherapy and, further, to evaluate if all relevant symptoms are covered by this tool.

Methods

To establish the relevant symptoms, three measures were taken. First, a literature search was carried out in three databases. Second, a chart audit was performed including medical records from melanoma patients receiving immunotherapy. Finally, the product information for the relevant immunotherapies was studied.

Results

Ten articles were included as a result of the literature search. As for the chart audit, a total of 37 patients (48 treatments with immunotherapy) were included. Overall, the reported symptoms from the literature review aligned with those identified in the chart audit. The examination of the product information supported the findings from review and chart audit, revealing only one additional symptom. In total, 28 PRO-CTCAE symptoms were selected comprising of 56 PRO-questions plus an additional question on blood in stool.

Conclusion

When preparing a Patient Reported Outcomes tool it is important that the preparatory work of selecting questions is done properly. By going through the literature, performing a chart audit, and examining the product information, the most important and relevant symptoms have been uncovered, facilitating the design of a PROquestionnaire, based on PRO-CTCAE, that fits the patient population under investigation.

Introduction

The number of Danes who are diagnosed with malignant melanoma have increased significantly during the last 50 years. Approximately 2200 new cases are reported every year. Malignant melanoma is the most common cancer form in the 15–34 year old and more than 400 persons are diagnosed with metastatic disease each year [1]. This development aligns with the development worldwide [2]. When metastatic, the majority of patients are treated with immunotherapy, using checkpoint inhibitors either as monotherapy or in combination [3]. Survival has improved significantly with these new treatment strategies. However, the adverse events (AEs) that patients may experience can be severe and potentially life-threatening [4,5,6,7]. Studies report that 16% of patients treated with immunotherapy targeting PD-1 experience CTC > = grade 3 AEs measured by the Common Criteria for Adverse Events (CTCAE). With immunotherapy targeting CTLA-4, the number is 27%, and when the drugs are combined, the frequency is 55% [6]. With all cancer drugs, toxicity-monitoring plays an important role, however, early recognition is vital for detecting and treating immune-related AEs. If symptoms are discovered early, relevant treatment can be initiated in time, and major complications avoided [8].

CTCAE is widely used when it comes to toxicity-monitoring in oncological, clinical trials and in routine cancer care. The CTCAE consists of 790 AEs and is divided into three categories: laboratory-based events, physical examination findings and symptomatic adverse events [9]. Physicians perform a systematic evaluation using the CTCAE to describe the severity of organ toxicity for patients receiving cancer therapy. In Denmark, a melanoma patient who receives immunotherapy will be clinically evaluated every third week prior to treatment. Consequently, there is a risk that a symptom may go from mild to severe in the time span. Moreover, evidence suggests that clinicians may underestimate symptom onset and severity compared to patient report [10]. It may be hypothesized that including patients in the reporting of symptoms - and more frequently [11] - can optimize symptom monitoring.

One way to increase patient involvement is to use patient reported outcomes (PROs). Applying a PRO-tool which resembles the well-known CTCAE grading scale seems advantageous. For this purpose, the National Cancer Institute has developed a tool appropriate for patient self-reporting. A total of 78 symptoms, approximately 10%, in the CTCAE guidelines have been found appropriate for self-monitoring and now constitute what has been labeled as the PRO-CTCAE [10, 12]. As each adverse event is elicited using between one to three questions on frequency, severity and interference with daily activities, there are 124 individual questions representing the 78 symptoms. From this question library and its attached form builder, it is possible for researchers and oncologists to choose relevant symptoms and create a questionnaire [13]. The PRO-CTCAE is translated and validated in a Danish version [14], and a Danish feasibility study has recently been carried out [15], demonstrating that the tool is feasible in a prostate cancer population receiving chemotherapy. However, no guidelines exist on how to select the relevant PRO-items representing expected symptoms in different disease and treatment situations.

The advantages of using PROs in cancer treatment and care are debated [16, 17]. Current data suggests that physical symptoms are more likely to improve after PRO interventions compared to quality of life (QoL), supportive care needs or psychological symptoms [16]. More evidence is needed, however, to determine if the implementation of PROs in relation to, for example, symptom reporting is worthwhile. So far, research involving PRO-CTCAE has focused on toxicity monitoring associated with other cancer therapies [10]. The tool has not been reported as used by patients receiving immunotherapy. The pattern of symptoms with this treatment modality differs considerably from the one patients experience when they receive chemotherapy [8]. Thus, it is highly relevant to select the symptoms that fit the toxicity-profile and provide and an unbiased presentation when designing a PRO-tool for melanoma patients receiving immunotherapy [18].

The objective of this study was to identify the symptoms appropriate for patient self-reporting and their equivalent PRO-questions to include from the PRO-CTCAE library for melanoma patients receiving immunotherapy and, further, to evaluate if all relevant symptoms can be covered by the tool.

Material and methods

To establish the relevant symptoms to include in a subsequent randomized trial, a project group was formed. Besides the project manager, the group consisted of two physicians who were experts in handling immune-related symptoms. Moreover, one had experience with selecting relevant PRO-CTCAE-items. It was decided in advance that due to the purpose of the study i.e. to identify symptoms appropriate for self-reporting, labatory based events and physical examination findings would be excluded during the selection process. Only symptomatic AEs that the patients would meaningfully be able to report were to be included.

Literature search

A literature search was performed in the three literature databases Pubmed, Embase, and Cinahl in June 2016 using the Boolean logical operators AND/OR to combine the search terms. A combination of keywords for cancer, immunotherapy, adverse events and melanoma was combined. Before doing the final search, the search terms were monitored by an expert on literature searches which resulted in minor changes. Articles were included if the studies described were randomized clinical trials that i) compared immunotherapy with chemotherapy or placebo, ii) compared immunotherapy in different doses, iii) compared different immunotherapies, or iv) compared immunotherapy with other cancer therapies. Articles not written in English were excluded. Articles were eligible if indexed between January 1, 1996 and June 22, 2016.

First, one reviewer screened the titles and abstracts to eliminate all irrelevant references. Second, another reviewer took part in determining the references relevant for full text review. Hereafter, both reviewers jointly decided which articles should be included.

Chart audit

In addition to the literature review, a chart audit was performed to examine if the AEs found in the international literature were consistent with symptoms melanoma patients treated with immunotherapy experienced in daily practice. The chart audit was performed at the Department of Oncology at Odense University Hospital in the Region of Southern Denmark. Permission was granted from the head of department. Thirty-seven medical records were examined with oral and written informed consent from patients between June and August 2016. No selection criteria was applied and all melanoma patients treated with immunotherapy were asked to participate. No patients refused, however, due to administrative errors, a few patients were not recruited. The patients included in the chart audit had received either anti-PD-1 or anti-CTLA-4. The AEs identified in the medical records were primarily found in a prespecified toxicity-monitoring form build upon the CTCAE grading scale v4 for physicians to register the severity of AEs. In addition, the free text notes in the medical records were included. If a health professional had noted, for example, that a patient suffered from taste changes, the term was translated into the CTCAE term dysgeusia, making it possible to align all the patients´ AEs.

Product information

Finally, the product information from the European Medicines Agency (EMA) for Yervoy (Ipilimumab), Keytruda (Pembrolizumab) and Opdivo (Nivolumab) [19] were studied to ensure that no adverse events had been overlooked. If an AE was reported in one of the EMA sources - and not already identified by the two other data souces - it was included if it affected more than 10% of the patients.

After the construction of the PRO-CTCAE questionnaire, the instrument was pilot-tested by four patients and five healthcare professionals to ensure face validity.

Results

Literature search

Initial literature searches retrieved 3.165 titles from the databases. After title and abstract screening and full text screening had been performed, ten articles fulfilled the inclusion criteria and were extracted (Fig. 1). The articles were randomized, clinical trials including a total of 5.706 patients (Table 1). Thus, the number of trial participants were judged sufficient to satisfy the trial objective of identifying relevant AEs. Only two trials had a sample size of less than 400 patients and were not multi-center trials. The immunotherapy in the trials was either compared to placebo, other immunotherapy, or other anti-cancer drugs. The studies tested Ipilimumab [4,5,6, 20, 21], Pembrolizumab [7, 21, 22] or Nivolumab [6, 23, 24] as monotherapy or a combination [6, 20] of two of the drugs. One study [25] evaluated sequential single-drug therapy with Ipilimumab followed by Nivolumab (or the reverse sequence). One article evaluated Ipilimumab given as adjuvant therapy, whereas the remaining nine were all concerned with treatment of metastatic disease. Some of the articles, including supplementary material, decribed the most common AEs, occurring in at least 5–10% of patients, while others also reported AEs that occurred in as few as 1–2% of the patients.

Fig. 1
figure 1

Article selection flowchart. Articles on immune-related adverse events identified in melanoma patients treated with immunotherapy

Full size image
Table 1 Characteristics of studies included to determine which AEs to include in the PRO-CTCAE for melanoma patients
Full size table

Chart audit

Among the 37 patients, 23 received Pembrolizumab, three Ipilimumab and 11 received both immunotherapies in sequence. All patients received at least one dose of immunotherapy. In total, the 37 patients received 48 treatments which were included in evaluation of AEs. None of the patients received combination immunotherapy.

Product information

One additional AE, injection site reaction, was identified as being very common from the European Medicines Agency (EMA) product information on the three drugs. The AE had also occurred in one of the articles, however, since it was only identified in one data source and not being very common, it had not been initially included.

Adverse events to be included in the PRO-CTCA for melanoma patients

After thorough investigation of the literature, patients´ medical records and the product information 28 AEs were identified as relevant to include from the PRO-CTCAE-library (Table 2). Overall, there was great conformity between the three data sources.

Table 2 Adverse events included in the PRO-CTCAE for melanoma patients receiving immunotherapy based on findings in medical records, literature review and product information
Full size table

Fifteen AEs were very common (may affect at least 10% of the patients). Eight of these (nausea, anorexia, diarrhea, abdominal pain, rash, pruritus, arthralgia, fatigue) were found common in all three data sources. The remaining seven (vomiting, constipation, dyspnea, myalgia, injection site reaction, headache and chills) were found very common in at least one or two of the data sources. The AE asthenia was also very common in both scientific papers and product information, however, since it was not found in the CTCAE or the PRO-CTCAE library, it was not included. This did not constitute a problem since the symptom was covered by the term fatigue which was found in the PRO-CTCAE-library. Fatigue is preferentially used in NCI’s toxicity grading scale that covers fatigue, asthenia, and malaise [26].

Eleven toxicities were found to be common (may affect up to 10% of patients) in two or three of the three data sources and were therefore included (Table 2). Other AEs which were also common such as flu-like symptoms, pain in extremity, and back pain were not included since they were not items in the PRO-CTCAE library. These terms seem adequately covered by muscle pain, joint pain, chills and the more general AE pain and thus, it was justifiable to exclude them.

Although the AE depression was uncommon [19] it was included as it was the only symptom dealing with mental health. Albeit rare, these symptoms can become very severe. Accordingly, two items from the PRO-CTCAE library concerning depression were selected. Despite the fact that the toxicity blood in stool was neither present in the PRO-CTCAE nor common, it was included as it may be a sign of colitis, a severe immune-related AE [27]. The question was placed at the end of the questionnaire as it was not a PRO-CTCAE item.

At face value, the questionnaire appeared to be a good instrument that adequately covered the relevant adverse events. Moreover, filling it out seemed to be uncomplicated and quick.

Discussion

It was found that the AEs identified in the chart audit were consistent with the ones found in the literature search and the product information. This indicates that the information collected from these three sources was representative for melanoma patients receiving immunotherapy and usable when selecting relevant symptoms from the PRO-CTCAE library. The three information sources provided a clear picture of which symptoms to include in a questionnaire. Based on these findings, 28 PRO-CTCAE symptoms have been selected comprising of 56 PRO-questions plus an additional question on blood in stool.

It may be argued that having to leave a few symptoms out because they are not present in the PRO-CTCAE-library is a limitation. On the other hand, it is our belief that as long as these items are adequately covered by other items, the decision is justifiable. As the two PRO-CTCAE items dealing with depression can become very severe and may be hard to detect in a consultation at the outpatient clinic, it is vital that they are discovered as they arise. Increased attention, for example through frequent patient reporting, may be the way forward. When the study was designed, it was discussed whether or not to carry out focus group interviews with patients to further qualify the selection of items. We decided against it due to the fact it would not be possible to include all the experienced AEs anyway, however releveant to the individual patient. The same experience has been reported in other cancer poulations [28].

A special challenge in AE registration within immunotherapy may be that some symptoms occur rarely but can be life-threatening if detected too late. This may be an argument for including less frequent symptoms. On the other hand, a subtle balance exists between including the relevant symptoms while at the same time not exhausting the patients with too many questions [29]. In a previous study, it has been shown that a questionnaire containing a similar number of PRO-CTCAE questions (41 questions reflecting 22 symptomatic toxicities) has proven feasible in a Danish prostate cancer population receiving chemotherapy [15]. The patients found the questionnaire easy to fill out and not too time consuming (mean < 7 min.). In addition, 40% reported that it increased their focus on side effects. Others have demonstrated similar results [12] which supports the clinical feasibility of our suggested questionnaire for melanoma patients. Moreover, the fact that patients have the opportunity of adding other symptoms decreases the risk of infrequent AEs not being reported. When designing the study, it could have been considered to include a generic questionnaire that also deals with patients´ health related QoL such as the EORTC QLC-30 or the EQ-5D – used in most melanoma studies [30]. However, the present study focuses on detecting AEs early, and the PRO-CTCAE is specifically developed to enable patients to report on experienced AEs. Based on findings from Basch et al. [31] demonstrating improvement of QoL following PRO as intervention future studies should be designed with the inclusion of Qol measurement.

Furthermore, the material included in our analysis could be perceived as too comprehensive. Additional research has been warranted, however, to qualify the selection ofPRO-CTCAE items for given populations and contexts [32]. It was the purpose of this study to develop a PRO-CTCAE questionnaire for use in patients with metastatic melanoma who are treated with immunotherapy in the future. Consequently, three of the ten articles included described studies using the combination of two immunotherapies. This treatment was not standard treatment at the time of the review, however, it was introduced in Denmark in 2017, justifying the inclusion of studies testing the combination. Additionally, an article dealing with Ipilimumab as adjuvant treatment was included because the toxicity profile was evaluated as being identical to the profile seen in metastatic disease. Thus, the questionnaire can also be used for melanoma patients who receive adjuvant therapy.

Conclusion

When melanoma patients receive immunotherapy, close monitoring of symptoms is crucial. One of the ways to detect AEs early may be to have the patients self-report the symptoms they experience, using PRO-questions. In this regard, it is important that the preparatory work to select questions is done properly. By going through the literature, examining the product information, and performing a chart audit, the most important and relevant symptoms have been uncovered, making it possible to design a PRO-questionnaire based on PRO-CTCAE that fits the patient population under investigation. This questionnaire is applied in an ongoing randomized clinical trial (ClinicalTrials.gov. NCT03073031) where melanoma patients treated with immunotherapy self-report the symptoms they experience.

Abbreviations

AEs:

Adverse events

CTCAE:

Common Terminology Criteria for Adverse Events

EMA:

European Medicines Agency

PROs:

Patient-reported Outcomes

QoL:

Quality of life

References

  1. Kræftens Bekæmpelse. Modermærkekræft. Statistik. Available at: https://www.cancer.dk/modermaerkekraeft-malignt-melanom/ Accessed Feb. 2019.

  2. Matthews NH LW, Qureshi AA, et al. Epidemiology of Melanoma In: Ward WH, Farma JM, editors. Cutaneous Melanoma: Etiology and Therapy [Internet]. Brisbane (AU): Codon Publications; 2017 Dec 21. Chapter 1. 2017.

  3. Garbe, C., Peris, K., Hauschild, A., Saiag, P., Middleton, M., Bastholt, L., et al. (2016). Diagnosis and treatment of melanoma. European consensus-based interdisciplinary guideline - Update 2016. European journal of cancer (Oxford, England : 1990), 63, 201–217.

    Article  Google Scholar 

  4. Hodi, F. S., O'Day, S. J., McDermott, D. F., Weber, R. W., Sosman, J. A., Haanen, J. B., et al. (2010). Improved survival with ipilimumab in patients with metastatic melanoma. New England Journal of Medicine, 363(8), 711–23 13.

    Article  CAS  Google Scholar 

  5. Eggermont, A. M. M., Chiarion-Sileni, V., Grob, J.-J., Dummer, R., Wolchok, J. D., Schmidt, H., et al. (2015). Adjuvant ipilimumab versus placebo after complete resection of high-risk stage III melanoma (EORTC 18071): a randomised, double-blind, phase 3 trial. Lancet Oncology, 16(5), 522–30 9.

    Article  CAS  Google Scholar 

  6. Larkin, J., Chiarion-Sileni, V., Gonzalez, R., Grob, J. J., Cowey, C. L., Lao, C. D., et al. (2015). Combined Nivolumab and Ipilimumab or monotherapy in untreated melanoma. The New England Journal of Medicine, 373(1), 23–34.

    Article  Google Scholar 

  7. Ribas, A., Puzanov, I., Dummer, R., Schadendorf, D., Hamid, O., Robert, C., et al. (2015). Pembrolizumab versus investigator-choice chemotherapy for ipilimumab-refractory melanoma (KEYNOTE-002): A randomised, controlled, phase 2 trial. The Lancet Oncology., 16(8), 908–918.

    Article  CAS  Google Scholar 

  8. Postow, M. A., Callahan, M. K., & Wolchok, J. D. (2015). Immune checkpoint blockade in Cancer therapy. Journal of Clinical Oncology : Official Journal of the American Society of Clinical Oncology, 33(17), 1974–1982.

    Article  CAS  Google Scholar 

  9. National Cancer Institute NIoH USDoHaHS. Common Terminology Criteria for Adverse Events (CTCAE) Version 4.0. (available at https://ctep.cancer.gov/protocolDevelopment/electronic_applications/ctc.htm#ctc_50, last accessed Feb., 2019) 2016.

  10. Basch, E., Reeve, B. B., Mitchell, S. A., Clauser, S. B., Minasian, L. M., Dueck, A. C., et al. (2014). Development of the National Cancer Institute's patient-reported outcomes version of the common terminology criteria for adverse events (PRO-CTCAE). Journal of the National Cancer Institute, 106(9), 1–11.

  11. Mendoza, T. R., Dueck, A. C., Bennett, A. V., Mitchell, S. A., Reeve, B. B., Atkinson, T. M., et al. (2017). Evaluation of different recall periods for the US National Cancer Institute's PRO-CTCAE. Clinical trials (London, England), 14(3), 255–263.

    Article  Google Scholar 

  12. Basch, E., Pugh, S. L., Dueck, A. C., Mitchell, S. A., Berk, L., Fogh, S., et al. (2017). Feasibility of patient reporting of symptomatic adverse events via the patient-reported outcomes version of the common terminology criteria for adverse events (PRO-CTCAE) in a Chemoradiotherapy cooperative group multicenter clinical trial. International Journal of Radiation Oncology, Biology, Physics, 98(2), 409–418.

    Article  Google Scholar 

  13. National Cancer Institute NIoH USDoHaHS. Patient-Reported Outcomes version of the Common Terminology Criteria for Adverse Events (PRO-CTCAE), available at https://healthcaredelivery.cancer.gov/pro-ctcae/, last accessed February 2019.

  14. Baeksted, C., Nissen, A., Pappot, H., Bidstrup, P. E., Mitchell, S. A., Basch, E., et al. (2016). Danish translation and linguistic validation of the U.S. National Cancer Institute's patient-reported outcomes version of the common terminology criteria for adverse events (PRO-CTCAE). Journal of Pain and Symptom Management, 52(2), 292–297.

    Article  Google Scholar 

  15. Bæksted C, Pappot H, Nissen A, Henrik Hjollund N, Mitchell S A., Basch E, et al. Feasibility and acceptability of electronic symptom surveillance with clinician feedback using the Patient-Reported Outcomes version of Common Terminology Criteria for Adverse Events (PRO-CTCAE) in Danish prostate cancer patients 2017.

  16. Kotronoulas, G., Kearney, N., Maguire, R., Harrow, A., Di Domenico, D., Croy, S., et al. (2014). What is the value of the routine use of patient-reported outcome measures toward improvement of patient outcomes, processes of care, and health service outcomes in cancer care? A systematic review of controlled trials. Journal of clinical oncology : official journal of the American Society of Clinical Oncology., 32(14), 1480–1501.

    Article  Google Scholar 

  17. Howell, D., Molloy, S., Wilkinson, K., Green, E., Orchard, K., Wang, K., et al. (2015). Patient-reported outcomes in routine cancer clinical practice: A scoping review of use, impact on health outcomes, and implementation factors. Annals of oncology : official journal of the European Society for Medical Oncology/ESMO, 26(9), 1846–1858.

    Article  CAS  Google Scholar 

  18. Kluetz, P. G., Slagle, A., Papadopoulos, E. J., Johnson, L. L., Donoghue, M., Kwitkowski, V. E., et al. (2016). Focusing on Core patient-reported outcomes in Cancer clinical trials: Symptomatic adverse events, physical function, and disease-related symptoms. Clinical cancer research : an official journal of the American Association for Cancer Research, 22(7), 1553–1558.

    Article  CAS  Google Scholar 

  19. European Medicines Agency. Find medicine. Available at: http://www.ema.europa.eu/ema/ Accessed June 2016. 2016.

  20. Postow, M. A., Chesney, J., Pavlick, A. C., Robert, C., Grossmann, K., McDermott, D., et al. (2015). Nivolumab and ipilimumab versus ipilimumab in untreated melanoma. New England Journal of Medicine, 372(21), 2006–17 12.

    Article  Google Scholar 

  21. Robert, C., Schachter, J., Long, G. V., Arance, A., Grob, J. J., Mortier, L., et al. (2015). Pembrolizumab versus Ipilimumab in Advanced Melanoma. New England Journal of Medicine, 372(26), 2521–32 12.

    Article  CAS  Google Scholar 

  22. Ribas, A., Hamid, O., Daud, A., Hodi, F. S., Wolchok, J. D., Kefford, R., et al. (2016). Association of Pembrolizumab with Tumor Response and Survival among Patients with Advanced Melanoma. Jama., 315(15), 1600–1609.

    Article  CAS  Google Scholar 

  23. Robert, C., Long, G. V., Brady, B., Dutriaux, C., Maio, M., Mortier, L., et al. (2015). Nivolumab in previously untreated melanoma without BRAF mutation. New England Journal of Medicine, 372(4), 320–30 11.

    Article  CAS  Google Scholar 

  24. Weber, J. S., D'Angelo, S. P., Minor, D., Hodi, F. S., Gutzmer, R., Neyns, B., et al. (2015). Nivolumab versus chemotherapy in patients with advanced melanoma who progressed after anti-CTLA-4 treatment (CheckMate 037): A randomised, controlled, open-label, phase 3 trial. The Lancet Oncology, 16(4), 375–384.

    Article  CAS  Google Scholar 

  25. Weber, J. S., Gibney, G., Sullivan, R. J., Sosman, J. A., Slingluff, C. L., Jr., Lawrence, D. P., et al. (2016). Sequential administration of nivolumab and ipilimumab with a planned switch in patients with advanced melanoma (CheckMate 064): An open-label, randomised, phase 2 trial. The Lancet Oncology.

  26. Bruera EY, S. Palliative care: Overview of fatigue, weakness, and asthenia. UpToDate.

  27. Verschuren, E. C., van den Eertwegh, A. J., Wonders, J., Slangen, R. M., van Delft, F., van Bodegraven, A., et al. (2016). Clinical, endoscopic, and histologic characteristics of Ipilimumab-associated colitis. Clinical gastroenterology and hepatology : the official clinical practice journal of the American Gastroenterological Association, 14(6), 836–842.

    Article  Google Scholar 

  28. Nissen, A., Bager, L., & Pappot, H. (2019). The use of PRO in adverse event identification during cancer therapy – Choosing the right questions to ask. Acta Oncologica, 1–7.

  29. Rolstad, S., Adler, J., & Rydén, A. (2011). Response burden and questionnaire length: Is shorter better? A review and meta-analysis. Value in Health, 14(8), 1101–1108.

    Article  Google Scholar 

  30. Malkhasyan, K. A., Zakharia, Y., & Milhem, M. (2017). Quality-of-life outcomes in patients with advanced melanoma: A review of the literature. Pigment Cell & Melanoma Research, 30(6), 511–520.

    Article  Google Scholar 

  31. Basch, E., Deal, A. M., Kris, M. G., Scher, H. I., Hudis, C. A., Sabbatini, P., et al. (2016). Symptom monitoring with patient-reported outcomes during routine Cancer treatment: A randomized controlled trial. Journal of clinical oncology : official journal of the American Society of Clinical Oncology., 34(6), 557–565.

    Article  CAS  Google Scholar 

  32. Di Maio, M., Basch, E., Bryce, J., & Perrone, F. (2016). Patient-reported outcomes in the evaluation of toxicity of anticancer treatments. Nature Reviews. Clinical Oncology, 13(5), 319–325.

    Article  Google Scholar 

Download references

Acknowledgements

We thank International Communication A/S for providing language revisions - permission granted.

Funding

The study was supported by Partnership on PRO (The Danish Cancer Society) and the Region of Southern Denmark. The organizations had no role in designing the study, collecting, analysing and interpreting of data or writing the manuscript.

Availability of data and materials

Literature search string and notes from chart audit and are stored at the Department of Oncology, Odense University Hospital, DK and are available from the corresponding author on reasonable request.

Authors´ contributions

Design of the study: LKT, LB, HP Literature search, chart audit and selection of articles: LKT, LB, HP Item selection: LKT, LB, HP. Manuscript writing: LKT, LB, KBD, ADZ, HP. Final approval: LKT, LB, KBD, ADZ, HP. Our manuscript has not been published elsewhere, and is not under consideration by another journal.

Author information

Authors and Affiliations

  1. Department of Oncology, Odense University Hospital, Odense, Denmark

    Lærke K. Tolstrup, Lars Bastholt, Ann-Dorthe Zwisler & Karin B. Dieperink

  2. REHPA –The Danish Knowledge Center for Rehabilitation and Palliative Care, University of Southern Denmark, Odense, Denmark

    Lærke K. Tolstrup, Ann-Dorthe Zwisler & Karin B. Dieperink

  3. Institute of Clinical Research, University of Southern Denmark, Odense, Denmark

    Lærke K. Tolstrup, Lars Bastholt, Ann-Dorthe Zwisler & Karin B. Dieperink

  4. Department of Oncology, Copenhagen University Hospital, Rigshospitalet, Copenhagen, Denmark

    Helle Pappot

Authors
  1. Lærke K. Tolstrup
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Lars Bastholt
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Ann-Dorthe Zwisler
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Karin B. Dieperink
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Helle Pappot
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Lærke K. Tolstrup.

Ethics declarations

Ethics approval and consent to participate

According to Danish law, approval from the ethical committee was not required, but the study was registered with the Danish Data Protection Agency (16/13968).

Consent for publication

Not applicable

Competing interests

The authors declare that they have no competing interests.

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Open Access This article is distributed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Tolstrup, L.K., Bastholt, L., Zwisler, AD. et al. Selection of patient reported outcomes questions reflecting symptoms for patients with metastatic melanoma receiving immunotherapy. J Patient Rep Outcomes 3, 19 (2019). https://doi.org/10.1186/s41687-019-0111-8

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1186/s41687-019-0111-8

Keywords