Skip to main content
Journal of Patient-Reported Outcomes
Download PDF
Download ePub

Development of patient-reported outcomes item set to evaluate acute treatment toxicity to pelvic online magnetic resonance-guided radiotherapy

Journal of Patient-Reported Outcomes volume 5, Article number: 47 (2021) Cite this article

A Correction to this article was published on 27 July 2021

This article has been updated

Abstract

Background

A new technology in cancer treatment, the MR-linac, provides online magnetic resonance-guided radiotherapy (MRgRT) that combines real-time visualization of the tumor and surrounding tissue with radiation therapy to deliver treatment more accurately. Online MRgRT makes it possible to minimize treatment volume, potentially reducing acute treatment toxicity. Patient-reported outcomes (PRO) add the patient perspective to evaluating treatment toxicity related to new technology. The objective of this mixed-methods study was to develop and explore the content validity of a set of PRO items to evaluate acute pelvic toxicity to radiotherapy including online MRgRT.

Methods

A literature review and chart audit were conducted to identify symptomatic adverse events (AEs) to be selected from the Patient-Reported Outcomes Version of the Common Terminology Criteria for Adverse Events (PRO-CTCAE) library and European Organisation for Research and Treatment of Cancer (EORTC) item library. To validate the content, the item set was applied in a prospective pilot cohort of patients referred for primary pelvic RT with curative intent. Patients reported symptoms weekly during RT (4–8 weeks) and the subsequent 4 weeks. Follow-up reports were collected at 8, 12, and 24 weeks after RT. To ensure symptom coverage clinician-reported toxicity and individual patient interviews were conducted. The symptomatic AEs were included in the final item set if ≥20% of patients reported them.

Results

Eighteen acute symptomatic AEs were selected for the initial item set. Forty patients (32 prostate cancer, 8 cervical cancer) were included in the pilot study. Patients with prostate cancer and those with cervical cancer both reported all 18 acute AEs. However, vomiting was not reported by > 20% of patients thus excluded from the item set. Adding a few diagnosis-specific AEs to the final item set was required for both prostate and cervical cancer patients.

Conclusions

A PRO item set for patients with pelvic cancer treated with radiotherapy with a curative intent was developed and content validity explored. In the pilot study, the item set captured the most common acute symptomatic AEs for patients with prostate and cervical cancer related to pelvic RT including online MRgRT. Further validation of the content in broader disease sites would be needed in future studies.

Background

Radiotherapy has advanced considerably during the past decades, improving survival and quality of life for cancer patients. Online magnetic resonance-guided radiotherapy (MRgRT), a recent innovation in radiation oncology, provides real-time visualization of the tumor and surrounding tissue during radiotherapy. It can increase disease control and survival with equivalent or decreased toxicity rates [1,2,3]. In 2018, the 1.5 T MR-linac (Unity, Elekta AB, Stockholm, Sweden) providing online MRgRT was ready for clinical use [4].

Until recently, external-beam radiotherapy for patients with pelvic cancer was guided by computed tomography (CT-guided) [3]. Online MRgRT is advantageous for these patients because the superior soft tissue differentiation of magnetic resonance imaging [5] in the pelvic area can reduce radiation exposure in healthy tissue [3, 6]. Treatment toxicity experienced by patients with pelvic cancer depends on the dose received and volume of irradiated healthy tissue [7,8,9,10].

Toxicity monitoring in cancer clinical trials is standardized prospective clinician reporting of the National Cancer Institute’s Common Terminology Criteria for Adverse Events (CTCAE), grading adverse events (AEs) on a scale from 0 to 5 [11]. CTCAE grading, as well as patient-reported outcomes [12], is part of the proposed standard assessment methodology for clinical evaluation of radiotherapy innovations like online MRgRT [13]. However, several studies have identified discrepancies between clinician and patient reporting in general oncology treatment. Clinicians appear to underreport the rate and severity of treatment toxicity, compared to patient-reported severity [14,15,16,17,18]. Patient self-reports are an important supplement to evaluating online MRgRT treatment tolerability, as in other oncological settings where they have been used as direct indicators of worsening, persistence or improvement of symptoms and general well-being [19,20,21]. Patient self-reports add a patient perspective to dose selection and may reduce the risk of undisclosed treatment toxicities.

Only four studies conducted in two sites have investigated patient-reported toxicity during and after online pelvic MRgRT [22,23,24,25]. All four studies used standardized validated questionnaires to measure acute PRO at predetermined time points: baseline, end of treatment and follow-up at week 6. Thus, assessment over time was based on few time points with a substantial gap from the end of treatment to 6 weeks after treatment completion, creating a risk of undetected increases in acute treatment toxicity. The authors recommended that future trials include earlier data collection points to map the trajectory of acute treatment toxicity [22]. They also called for a consensus on questionnaires used to capture radiotherapy treatment toxicity for prostate cancer patients because some relevant symptomatic AEs are missing in the standardized PRO questionnaires [23].

To capture the patient perspectives related to online MRgRT, it is important to ensure the right questions are asked. Questions reflecting relevant expected symptoms that are meaningful to the patients [26, 27]. A systematic selection of symptomatic AEs tailors the PRO questionnaire to the right purpose, population and treatment [28]. Selecting items addressing the identified symptomatic AEs is a way of choosing a minimum requirement of outcomes for a specific diagnosis and treatment [29]. Several core outcome set have been developed for pelvic cancer patients; however, the targeted treatment was not always specified nor were instruments for measuring core outcomes often addressed [29]. A previous study developed separate item sets for male and female pelvic radiotherapy patients targeted CT-guided radiotherapy based on interviews with a heterogeneous patient population including patients receiving palliative treatment [30]. Since online MRgRT allows us to enable dose escalation and reduce the treatment volume the incidence and severity of symptoms during the treatment trajectory may differ from standard treatment regimens [31,32,33]. As a consequence, a short, comprehensive item set is needed to capture weekly changes in the most common symptomatic AEs for patients throughout the treatment course. Symptoms that are not necessarily reported by clinicians, thus being valuable evidence in the evaluation of patient tolerance to online MRgRT. To our knowledge, no PRO item set is available to support the purpose of weekly monitoring of acute symptomatic AES to pelvic radiotherapy with a curative intent including online MRgRT. The objectives of this study were to: 1) identify symptomatic AEs for self-reporting for patients receiving primary pelvic radiotherapy with a curative intent and select equivalent items in validated item libraries and 2) evaluate the content validity of the prospective pilot study to ensure the item set covers the most common symptomatic AEs to pelvic radiotherapy including online MRgRT.

Methods

Study design

A mixed-methods approach included two phases: 1) initial item selection of relevant acute symptomatic AEs for primary pelvic radiotherapy and 2) a prospective pilot study applying the items selected in the first phase (Fig. 1). Methods used in the item selection process were inspired by systematic item selection as previously used [27, 30, 34,35,36]. A parallel mixed-methods approach was used to validate the content of the pelvic item set in phase 2 [37]. Data collection and analysis of qualitative and quantitative data occurred simultaneously, with findings synthesized in the final item selection.

Fig. 1
figure 1

The item selection process

Full size image

Phase 1: initial item selection

The initial item selection in phase 1 inspired by Tolstrup et al. [35] consisted of a literature review of acute toxicity to pelvic radiotherapy (rectal, cervical, urinary bladder and prostate cancer) and a chart audit of acute toxicity in patients treated with online MRgRT in the 1.5 T MR-linac at Odense University Hospital from the first patient in October 2018 until May 2019. The objective of the review and chart audit was to identify and map the most common acute symptomatic AEs among patients receiving primary pelvic radiotherapy from the start of radiotherapy until 6 months after completion.

A comprehensive literature search was carried out in June 2019 in the Cochrane, PubMed and Embase (Ovid) (Embase Classic+Embase 1947 to 2019 May 13), using Covidence to manage and sort references [38]. The search was guided by PRISMA guidelines [39] and an expert on literature searches reviewed the search terms. The literature search strategy is available in Additional file 1.

The purpose of the chart audit was to investigate acute symptoms reported by physicians, nurses and radiotherapists to supplement the literature review and assess the consistency of clinical reports with symptoms identified in review. Clinicians documented AEs in a pre-specified CTCAE form at fixed time points, and patient EHRs were searched to find additional symptoms reported at other times.

Acute symptomatic AEs found in the literature review and chart audit were included in the initial item set if they were reported: 1) in the literature for all four pelvic cancer diagnoses or 2) in the MRgRT EHR audit or the two clinical trials with online MRgRT and in the literature review for at least two diagnoses. After identifying initial prevalent symptomatic AEs, corresponding items were selected from validated item libraries. The Patient-Reported Outcomes version of Common Terminology Criteria of Adverse Events (PRO-CTCAE) developed by the National Cancer Institute (NCI) [40] and the European Organisation for Research and Treatment of Cancer (EORTC) item library provides a flexible collection of items [41]. The PRO-CTCAE item library comprises 124 items representing 78 symptomatic toxicities [40]. Some symptoms are not included in the PRO-CTCAE library, thus items were drawn from the EORTC item library to capture all relevant symptoms [41]. These two item libraries were used as they contain multiple items for patient self-reports of symptomatic AEs translated into Danish and tested for construct validity and reliability [41, 42]. When symptoms are available in both item libraries the wording of the item may influence the item selected.

Phase 2: pilot study

The initial set of PRO items representing symptomatic AEs were applied in a prospective pilot study with patients treated at the Department of Oncology at Odense University Hospital in Denmark. The pilot study aimed to evaluate whether the pelvic item set addressed all relevant symptomatic AEs to pelvic radiotherapy including online MRgRT.

Eligibility

All patients aged ≥18 years referred to the department for primary pelvic CT-guided RT or online MRgRT with a curative intent (rectal, cervical, urinary bladder or prostate cancer) in October 2019–June 2020 were eligible for inclusion. Patients were excluded if they were unable to give informed consent or to read, understand and respond to PRO questionnaires in Danish in electronic or paper formats. Sample size for the pilot study was set at 40 patients, based on sample sizes from previous pilot studies testing the integration of a PRO instrument into clinical cancer therapy [34, 43].

Data collection period

Patients reported symptoms weekly during their four- to eight-week courses of radiotherapy and the subsequent 4 weeks. Seven days is the preferred recall period for the PRO-CTCAE items [44]. Follow-up reports were collected at 8, 12 and 24 weeks after completing radiotherapy. Data were collected from October 2019 to October 2020, at which time the study group completed the final item selection process. The patients were informed that their responses were not available for the clinicians in the pilot study.

Variables

Demographic data on age and Eastern Cooperative Oncology Group/World Health Organization Performance Status (ECOG/WHO PS) [45] were obtained from the EHR, along with data on diagnoses, concomitant treatments, prostate risk group for patients with prostate cancer and the 2018 International Federation of Gynecology and Obstetrics (FIGO) staging system for patients with cervical cancer. In addition, data were collected on radiotherapy: dose absorbed in gray (Gy), number of radiotherapy fractions and whether online MRgRT was used.

Questionnaires and semi-structured interviews

The initial item set was supplemented by five questions for patient free text reporting of other symptoms experienced during treatment. The questions for free-text reporting of symptoms were available for patient-initiated reporting at any time.

The questionnaire was administered electronically through My Hospital or paper-based as an alternative. My Hospital is an app for patients at hospitals in the Region of Southern Denmark that enables patient-entered data to be shared with hospital clinicians through the EHR [46]. The app was used for data collection to support patient adherence to the reporting schedule because it was already in use in the oncology department to provide an overview of appointments and information about treatment. Patients received verbal and written instructions for reporting PRO in My Hospital. A paper-format questionnaire was offered to those not having a device or technical skills to report electronically.

The main investigator (PKM) obtained clinician-reported toxicity reported in the EHR by physicians and radiotherapists during radiotherapy and the subsequent 4 weeks. Individual interviews with patients were conducted using a convenience sampling method 1 month after treatment completion. The patients were interviewed in the chronological order they attended their 4-week follow-up continuing recruitment until no new information or themes emerged from the data and data saturation was reached [47]. A semi-structured interview guide was used to investigate whether the questions were clear and easy to respond to and whether all relevant symptoms they experienced were addressed by the questionnaire. To validate the content of the item set, patients were asked about any symptomatic AEs they experienced but not report in the electronic questionnaire. The symptomatic AEs were included in the final item set if ≥20% of patients reported them inspired by Sandler et al. [30].

Statistical analyses

Sociodemographic and clinical characteristics of all patients were analyzed descriptively, as were the prevalence of items reported post-baseline and the proportion of other symptoms reported in scheduled and patient-initiated reports. All patients with pelvic cancer were included in the analysis. Study analyses were performed using STATA IC 15. Interview data were analyzed with systematic text condensation [48].

Results

Phase 1

In the initial item selection, 6182 articles were screened and 46 reports representing all four pelvic cancers were included in the final review (Fig. 2).

Fig. 2
figure 2

PRISMA diagram for literature review of acute toxicity to primary pelvic radiotherapy

Full size image

In addition, EHRs were reviewed for 18 patients with prostate cancer treated with online MRgRT (Fig. 1). No patients with other pelvic cancers were treated with online MRgRT. Two clinical trials published after the literature search on acute toxicity to online MRgRT in the pelvic region were added [22, 49] (Fig. 2). Thirty five acute symptomatic AEs that appeared in included literature, EHRs and trials were listed by the related CTCAE v. 5.0 term [50] (Additional file 2).

Ten symptomatic AEs reported by patients with each of the four types of pelvic cancer were selected as core symptoms for the item set. In addition, eight symptomatic AEs were reported by patients with at least two of the included cancer types and by patients receiving online MRgRT and/or in the two clinical MRgRT trials. Nine of the 10 core symptomatic AEs were available in the PRO-CTCAE item library; Fatigue, anorexia, radiation dermatitis, abdominal pain, constipation, diarrhea, nausea, urinary frequency and dysuria. Rectal pain was not in the PRO-CTCAE item library as well as three of the eight additional pelvic symptomatic AEs (urinary retention, nocturia, and rectal hemorrhage). A decision was made to select all supplemental items from the EORTC item library as these items covered the content of the identified symptoms better using a more plain language; Rectal pain, urinary retention, urinary incontinence, urinary urge, nocturia, vomiting, fecal incontinence, rectal hemorrhage and bloating. For some of the symptoms between one to three items were developed in the PRO-CTCAE library reflecting frequency, severity and interference. Consequently, the initial item set comprised 24 items from the PRO-CTCAE and EORTC item libraries addressing 18 symptomatic AEs.

Phase 2

A total of 53 patients were eligible for inclusion in the pilot study after three patients were dismissed based on clinician assessment. Six patients were excluded due to starting RT during the lockdown of clinical trials because of COVID-19. Forty-seven patients were informed about the study. Six patients declined participation because they felt they lacked the resources to join a research study, and 41 patients agreed to participate. No patients with rectal cancer were referred to primary radiotherapy during the study period. One patient with bladder cancer was eligible and enrolled in the pilot study but excluded from the analysis due to this unique status. Forty patients were enrolled and included in the analysis: 32 with prostate cancer and eight with cervical cancer (Fig. 1). Thirty seven patients (93%) reported electronically. Median age was a little lower and with a wider range among the patients with cervical cancer compared to prostate cancer (Table 1). Compared to patients with prostate cancer, a smaller proportion of patients with cervical cancer scored zero (“fully active”) on ECOG/WHO performance status. Four patients with cervical cancer (50%) were also treated with weekly concomitant chemotherapy (Cisplatin) and 26 patients with prostate cancer (81%) were simultaneously treated with androgen deprivation therapy (ADT) (Table 1). In addition, 75% of the women (n = 6) had brachytherapy in their final week of external radiotherapy and again 1 or 2 weeks after radiotherapy completion (PDR-BT, 2 × 17.5 Gy/20 pulses). Of patients with prostate cancer, 13 (41%) were treated with online MRgRT. This treatment option was not yet available for patients with cervical cancer (Table 1).

Table 1 Characteristics of patients with pelvic cancer enrolled in the pilot study (n = 40)
Full size table

Compliance was high as 85% of the patients responded to > 80% of the weekly questionnaires. Reasons for non-compliance were the patients forgetting or not having the resources in that particular week due to fatigue or having many appointments in the clinic.

All 18 acute AEs were reported at some point during the weekly responses by patients with prostate cancer (Table 2) and those with cervical cancer (Table 3). Only one of the 18 symptoms, vomiting, had ≤20% prevalence among patients with prostate cancer (Table 2). No additional symptoms were reported by ≥20% of the patients or by clinicians for ≥20% of patients with either diagnosis. Therefore, only the symptomatic AE of vomiting was removed from the initial pelvic item set.

Table 2 Proportion of symptoms reported by patients with prostate cancer (n = 32)
Full size table
Table 3 Proportion of symptoms reported by patients with cervical cancer (n = 8)
Full size table

Diagnosis-specific additions were needed for both prostate and cervical cancer patients. Clinicians reported inflammation of the rectum (proctitis) for 19% of patients with prostate cancer at the end of treatment or 4 weeks later. Interviews revealed that patient-reported diarrhea arose from proctitis in some cases. Consequently, an item from the EORTC Proctitis module must be added when using the item set for patients with prostate cancer. For patients with cervical cancer, additional items were needed for symptoms of vaginal bleeding, vaginal pain and hemorrhoids and chemotherapy-related symptoms like vomiting if relevant. Abdominal pain was used to capture pain in the pelvic area. In addition, pain in the specific irradiated area was reported in free-text responses by 25% of patients with cervical cancer and 9% of patients with prostate cancer.

The 14 semi-structured interviews (11 patients with prostate cancer and three with cervical cancer) confirmed that the most relevant symptomatic AEs for their respective diagnosis were addressed by the pelvic item set. When directly asked about symptoms other than those included in the questionnaire, only a few additional symptoms were mentioned by < 20% of interview participants: memory loss and confusion, cystitis, weight gain/weight loss and symptoms related to systemic treatment.

Discussion

To the best of our knowledge, this is the first study to define and test a PRO item set to assess weekly symptomatic AEs related to primary pelvic RT including online MRgRT. Literature review and patient charts were consistent in identifying the 18 most common acute symptomatic AEs. To capture all relevant symptomatic AEs, items were selected from two item libraries: PRO-CTCAE and EORTC item library. Previous studies have selected items from a single library [30, 34, 35], adding one or two items from other questionnaires. Our decision was based on the need to include all identified symptoms relevant to evaluating MRgRT treatment using items with a plain wording covering the content of the identified symptoms.

The international MR-linac Consortium has recommended using PRO-CTCAE for future prospective clinical trials to estimate treatment-induced toxicity; however, no specific items were suggested [13]. The pelvic item set follows the recommendation of being intended for the specific population investigated with the specific purpose of having a tool for prospective evaluation of acute treatment toxicity to online MRgRT [28].

The benefit of using an item set specifically developed for this purpose is that it captures the acute symptomatic AEs to RT with a 7 days recall period. In addition, using a simple item set for weekly PRO covering the most common symptomatic AEs rather than using several standardized questionnaires minimizes patient burden [51]. It ensures symptom coverage and relevance for this specific population in pelvic radiotherapy. Few proposals exist for measuring PRO when recommending symptomatic AEs in core outcome sets [29]. As a result, the pelvic item set reported here, tailored to the properties of online MRgRT, may enhance consistency in the measurement of identified acute symptomatic AEs. Tetar et al. [23] investigated PRO in online MRgRT and similarly pointed out that the standardized questionnaires they used were not developed for external radiotherapy and did not evaluate all relevant symptoms.

A single previous study defined disease site-specific item sets for PRO in pelvic radiotherapy [30]. Sandler et al. defined male and female pelvis item sets based on patient interviews. Among female patients, 10% had cervical cancer and 14% were in palliative treatment; among male patients, 30% had diagnoses other than prostate cancer [30]. We ended up including prostate and cervical cancer patients only, a rather homogenous group that was uniformly treated with curative intent. We experienced that the 17 most common symptomatic adverse events in the item set were similar for patients treated for prostate and cervical cancer. The additional symptomatic adverse events needed were related to the specific irradiated areas. Therefore, we find it relevant to have a generic pelvic item set supplemented by diagnosis-specific additions related to the irradiated area for the specific patient-group investigated rather than having gender-specific item set.

In Sandler et al. [30], item selection was based on interviews and a checklist of 40 items presented to patients during their last week of radiotherapy. Patients were asked to recall all symptoms they had experienced during radiotherapy. In contrast, we based the final item set on prospective weekly reports from baseline to 4 weeks after radiotherapy completion, limiting the risk of recall bias.

Clinicians reported proctitis for 19% of the patients with prostate cancer and interviews supported the need for a broader interpretation of proctitis without multiple proctitis symptoms being included in the item set. A review by Atkinson et al. investigating the association between CTCAE and PRO found poor agreement between well-validated PRO measures and clinician rating (CTCAE) for proctitis among patients with rectal or anal cancer [52]. A few years later, EORTC validated the first radiation proctitis-specific quality-of-life module (QLQ-PRT20) [53]. It comprises 21 items, some of which (i.e., rectal pain, diarrhea and rectal bleeding) were already included in the pelvic item set. To minimize response burden, we added one additional item (feeling unable to completely empty bowels) from this module. It is arguable whether these items accurately identify the prevalence of proctitis. However, if patients’ self-reports are used in communicating with clinicians during the course of radiotherapy, these symptomatic AEs may contribute to the assessment of proctitis [54].

Differences between female patients in the Sandler et al. study [30] and ours could potentially account for discrepancies in selected items. However, we agree with Sandler et al. that an additional PRO-CTCAE item covering pain in the irradiated area is relevant for patients undergoing radiotherapy as e.g. abdominal pain is not covering pain in different anatomical irradiated sites in the abdominal or pelvic area. The symptom nocturia was omitted by Sandler et al. [30] even though thirty-nine (98%) patients in our pilot study reported nocturia at some point during radiotherapy. However, this item is not in the PRO-CTCAE item library and would have needed to be selected from another item library or questionnaire, which may have led to its omission in the previous study. Another item omitted from the Sandler et al. female item set was urinary urgency, which was reported by 88% of cervical cancer patients in our pilot study. This illustrates why selecting PRO for a purpose is important [28].

As six women in the current study received brachytherapy parallel to external radiotherapy, this may have affected the severity of symptoms like vaginal pain among these patients in the weeks following radiotherapy completion. Since the purpose of this study was to validate if the item set captures the most common symptoms for patients with pelvic cancer during radiotherapy this does not affect the outcome, however, the need for diagnosis-specific additions for cervical cancer patients also receiving chemotherapy or brachytherapy should be investigated further in future studies.

Sexual health is relevant for patients with prostate cancer and Sandler et al. included three items related to sexual health in their male pelvic item set [30]. However, the site-specific item set was empirically established and validated for assessment of radiation-induced toxicity but not for weekly reporting during radiotherapy. The majority of patients with prostate cancer in the present pilot study had concomitant androgen deprivation therapy (ADT) for at least 6 months and also mentioned symptoms about sexual health in the weekly free-text responses, thus being constant throughout radiotherapy. In the following prospective study two PRO-CTCAE items covering sexual health will be added to baseline and follow-up PRO measures.

Study strengths included the systematic item selection process based on existing literature and the health records of the first patients receiving pelvic online MRgRT at our institution. Items were selected from item libraries to cover all relevant symptomatic AEs using items assessed for construct validity and reliability. Validating the content of the item set among members of the target population in a prospective pilot study is a major strength and is bolstered by the opportunity for patients and clinicians to add other symptoms. The multiple and regular scheduled assessment time points reflected the intended use of the PRO measures, providing optimal informational value [29].

Several limitations deserve mention. First, a limited number of patient charts were reviewed during initial item selection; however, they accounted for all the pelvic cancer patients being treated with online MRgRT at our institution at the time. To some extent, the use of mixed methods enhances the reliability of our findings. However, interviews were analyzed relatively superficially for the purpose of ensuring AE symptom coverage for the target patient population. An opportunity was missed to synthesize the quantitative findings with more detailed qualitative findings [37]. Further interview data analysis must be conducted to explore patient experience, acceptability and usability of integrating electronic PRO during radiotherapy. Finally, the content of the pelvic item set is validated only for patients with prostate cancer and a small sample of patients with cervical cancer. Only eight cervical cancer patients were enrolled, mainly due to Covid-19 enrollment restrictions and other competing research protocols. Inclusion of broader disease sites (bladder, vulvar, rectal and anal cancer) and higher sample sizes would be needed in future studies.

In future prospective clinical trials of online pelvic MRgRT, replacing standardized questionnaires with a rigorous pelvic PRO item set will support measuring the most relevant acute symptomatic AEs [23]. PRO-CTCAE free-text response options are available to capture unsolicited and unexpected symptoms that may occur due to differences in tumor size, radiotherapy dose or fractionation [40]. Using a systematic approach to item selection helps to ensure that the right questions are asked for the right purpose. Future trials must ensure that patient responses are acknowledged and used for individual symptom management in radiotherapy [55].

Conclusion

A PRO item set for patients with pelvic cancer receiving radiotherapy with a curative intent was developed to capture expected and unanticipated symptoms of acute treatment toxicity related to online MRgRT in future prospective trials. Further validation of the content in broader disease sites would be needed in future studies. Diagnosis-specific items must be added to address all patient-reported symptoms.

Availability of data and materials

The data supporting the findings presented in this article are available from Pia Krause Møller. However, data use was restricted to the current study and data are not publicly available. Literature search strings and chart audit notes are stored at the Department of Oncology at Odense University Hospital in Denmark and available from the corresponding author on reasonable request.

Change history

Abbreviations

AE:

Adverse event

CTCAE:

Common Terminology Criteria of Adverse Events

PRO-CTCAE:

Patient-Reported Outcomes Version of the Common Terminology Criteria for Adverse Events

PRO:

Patient-Reported Outcome

ePRO:

Electronic Patient-Reported Outcome

NCI:

National Cancer Institute

EORTC:

European Organization for Research and Treatment of Cancer

QLQ-C30:

EORTC general core module

QoL:

Quality of life

MR:

Magnetic resonance

RT:

Radiotherapy

MRgRT:

Magnetic resonance guided radiotherapy

Gy:

Gray

ECOG:

Eastern Cooperative Oncology Group

WHO:

World Health Organization Performance Status

FIGO:

2018 International Federation of Gynecology and Obstetrics staging

References

  1. Kerkmeijer, L. G., Fuller, C. D., Verkooijen, H. M., et al. (2016). The MRI-linear accelerator consortium: Evidence-based clinical introduction of an innovation in radiation oncology connecting researchers, methodology, data collection, quality assurance, and technical development. Frontiers in Oncology, 6, 215. https://doi.org/10.3389/fonc.2016.00215.

    Article  PubMed  PubMed Central  Google Scholar 

  2. Lagendijk, J. J., Raaymakers, B. W., Raaijmakers, A. J., et al. (2008). MRI/linac integration. Radiotherapy and oncology : Journal of the European Society for Therapeutic Radiology and Oncology, 86, 25–29. https://doi.org/10.1016/j.radonc.2007.10.034.

    Article  Google Scholar 

  3. Pathmanathan, A. U., van As, N. J., Kerkmeijer, L. G. W., et al. (2018). Magnetic resonance imaging-guided adaptive radiation therapy: A "game changer" for prostate treatment? International Journal of Radiation Oncology, Biology, Physics, 100, 361–373. https://doi.org/10.1016/j.ijrobp.2017.10.020.

    Article  PubMed  Google Scholar 

  4. Bertelsen, A. S., Schytte, T., Møller, P. K., Mahmood, F., Riis, H. L., Gottlieb, K. L., … Bernchou, U. (2019). First clinical experiences with a high field 1.5 T MR linac. Acta oncologica (Stockholm, Sweden), 58(10), 1352–1357. https://doi.org/10.1080/0284186x.2019.1627417.

    Article  Google Scholar 

  5. Dueck, A. C., Becker, C. C., Rogak, L. J., et al. (2020). Composite grading algorithm for National Cancer Institute’s PRO-CTCAE. Journal of Clinical Oncology, 38, 7018–7018. https://doi.org/10.1200/JCO.2020.38.15_suppl.7018.

    Article  Google Scholar 

  6. Cree, A., Livsey, J., Barraclough, L., et al. (2018). The potential value of MRI in external-beam radiotherapy for cervical cancer. Clinical Oncology (Royal College of Radiologists), 30, 737–750. https://doi.org/10.1016/j.clon.2018.08.002.

    Article  CAS  Google Scholar 

  7. Andreyev, J. (2007). Gastrointestinal symptoms after pelvic radiotherapy: A new understanding to improve management of symptomatic patients. The Lancet Oncology, 8, 1007–1017. https://doi.org/10.1016/s1470-2045(07)70341-8.

    Article  PubMed  Google Scholar 

  8. Nicholas, S., Chen, L., Choflet, A., et al. (2017). Pelvic radiation and Normal tissue toxicity. Seminars in Radiation Oncology, 27, 358–369. https://doi.org/10.1016/j.semradonc.2017.04.010.

    Article  PubMed  Google Scholar 

  9. Stone, H. B., Coleman, C. N., Anscher, M. S., & McBride, W. H. (2003). Effects of radiation on normal tissue: Consequences and mechanisms. The Lancet Oncology, 4(9), 529–536. https://doi.org/10.1016/S1470-2045(03)01191-4.

    Article  CAS  PubMed  Google Scholar 

  10. White, K. L., Varrassi, E., Routledge, J. A., et al. (2018). Does the use of volumetric modulated arc therapy reduce gastrointestinal symptoms after pelvic radiotherapy? Clinical Oncology (Royal College of Radiologists), 30, e22–e28. https://doi.org/10.1016/j.clon.2017.10.016.

    Article  CAS  Google Scholar 

  11. Trotti, A., Colevas, A. D., Setser, A., et al. (2007). Patient-reported outcomes and the evolution of adverse event reporting in oncology. Journal of Clinical Oncology : Official Journal of the American Society of Clinical Oncology, 25, 5121–5127. https://doi.org/10.1200/jco.2007.12.4784.

    Article  Google Scholar 

  12. Aapro, M., Bossi, P., Dasari, A., et al. (2020). Digital health for optimal supportive care in oncology: Benefits, limits, and future perspectives. Supportive Care in Cancer: Official Journal of the Multinational Association of Supportive Care in Cancer, 28, 4589–4612. https://doi.org/10.1007/s00520-020-05539-1.

    Article  CAS  Google Scholar 

  13. Verkooijen, H. M., Kerkmeijer, L. G. W., Fuller, C. D., Huddart, R., Faivre-Finn, C., Verheij, M., … Schultz, C. (2017). R-IDEAL: A framework for systematic clinical evaluation of technical innovations in radiation oncology. Frontiers in Oncology, 7, 59. https://doi.org/10.3389/fonc.2017.00059.

    Article  PubMed  PubMed Central  Google Scholar 

  14. Di Maio, M., Gallo, C., Leighl, N. B., et al. (2015). Symptomatic toxicities experienced during anticancer treatment: Agreement between patient and physician reporting in three randomized trials. Journal of Clinical Oncology : Official Journal of the American Society of Clinical Oncology, 33, 910–915. https://doi.org/10.1200/jco.2014.57.9334.

    Article  Google Scholar 

  15. Falchook, A. D., Green, R., Knowles, M. E., et al. (2016). Comparison of patient- and practitioner-reported toxic effects associated with Chemoradiotherapy for head and neck cancer. JAMA Otolaryngology. Head & Neck Surgery, 142, 517–523. https://doi.org/10.1001/jamaoto.2016.0656.

    Article  Google Scholar 

  16. Basch, E., Iasonos, A., McDonough, T., et al. (2006). Patient versus clinician symptom reporting using the National Cancer Institute common terminology criteria for adverse events: Results of a questionnaire-based study. The Lancet Oncology, 7, 903–909. https://doi.org/10.1016/s1470-2045(06)70910-x.

    Article  PubMed  Google Scholar 

  17. Gilbert, A., Ziegler, L., Martland, M., et al. (2015). Systematic review of radiation therapy toxicity reporting in randomized controlled trials of rectal cancer: A comparison of patient-reported outcomes and clinician toxicity reporting. International Journal of Radiation Oncology, Biology, Physics, 92, 555–567. https://doi.org/10.1016/j.ijrobp.2015.02.021.

    Article  PubMed  Google Scholar 

  18. Tom, A., Bennett, A. V., Rothenstein, D., et al. (2018). Prevalence of patient-reported gastrointestinal symptoms and agreement with clinician toxicity assessments in radiation therapy for anal cancer. Quality of Life Research: an International Journal of Quality of Life Aspects of Treatment, Care and Rehabilitation, 27, 97–103. https://doi.org/10.1007/s11136-017-1700-8.

    Article  Google Scholar 

  19. Fokdal, L., Potter, R., Kirchheiner, K., et al. (2018). Physician assessed and patient reported urinary morbidity after radio-chemotherapy and image guided adaptive brachytherapy for locally advanced cervical cancer. Radiotherapy and oncology : Journal of the European Society for Therapeutic Radiology and Oncology. https://doi.org/10.1016/j.radonc.2018.05.002.

  20. Hoffman, K. E., Penson, D. F., Zhao, Z., et al. (2020). Patient-reported outcomes through 5 years for active surveillance, surgery, brachytherapy, or external beam radiation with or without androgen deprivation therapy for localized prostate cancer. Jama, 323, 149–163. https://doi.org/10.1001/jama.2019.20675.

    Article  PubMed  PubMed Central  Google Scholar 

  21. Petrella, T. M., Robert, C., Richtig, E., Miller Jr., W. H., Masucci, G. V., Walpole, E., … Cebon, J. (2017). Patient-reported outcomes in KEYNOTE-006, a randomised study of pembrolizumab versus ipilimumab in patients with advanced melanoma. European Journal of Cancer, 86, 115–124. https://doi.org/10.1016/j.ejca.2017.08.032.

    Article  CAS  PubMed  Google Scholar 

  22. Bruynzeel, A. M. E., Tetar, S. U., Oei, S. S., et al. (2019). A prospective single-arm phase 2 study of stereotactic magnetic resonance guided adaptive radiation therapy for prostate cancer: Early toxicity results. International Journal of Radiation Oncology, Biology, Physics, 105, 1086–1094. https://doi.org/10.1016/j.ijrobp.2019.08.007.

    Article  CAS  PubMed  Google Scholar 

  23. Tetar, S. U., Bruynzeel, A. M. E., Oei, S. S., et al. (2020). Magnetic resonance-guided stereotactic radiotherapy for localized prostate cancer: Final results on patient-reported outcomes of a prospective phase 2 study. European rology oncology. https://doi.org/10.1016/j.euo.2020.05.007.

  24. Alongi, F., Rigo, M., Figlia, V., et al. (2020). 1.5 T MR-guided and daily adapted SBRT for prostate cancer: Feasibility, preliminary clinical tolerability, quality of life and patient-reported outcomes during treatment. Radiation ncology (London, England), 15, 69. https://doi.org/10.1186/s13014-020-01510-w.

    Article  CAS  Google Scholar 

  25. Mazzola, R., Figlia, V., Rigo, M., et al. (2020). Feasibility and safety of 1.5 T MR-guided and daily adapted abdominal-pelvic SBRT for elderly cancer patients: Geriatric assessment tools and preliminary patient-reported outcomes. Journal of Cancer Research and Clinical Oncology. https://doi.org/10.1007/s00432-020-03230-w.

  26. Pappot, H., & Taarnhøj, G. A. (2020). Expectations to patient-reported outcome (PRO) in oncology - PRO for a purpose, when and how? Acta oncologica (Stockholm, Sweden), 59, 611–612. https://doi.org/10.1080/0284186x.2020.1749880.

    Article  Google Scholar 

  27. Nissen, A., Bager, L., & Pappot, H. (2019). The use of PRO in adverse event identification during cancer therapy - choosing the right questions to ask. Acta oncologica (Stockholm, Sweden), 58, 596–602. https://doi.org/10.1080/0284186x.2018.1560496.

    Article  Google Scholar 

  28. Pappot, H., & Taarnhøj, G. A. (2020). Expectations to Patient-Reported Outcome (PRO) in oncology-PRO for a purpose, when and how? Acta oncologica, 1–2. https://doi.org/10.1080/0284186X.2020.1749880.

  29. Ramsey, I., Eckert, M., Hutchinson, A. D., et al. (2020). Core outcome sets in cancer and their approaches to identifying and selecting patient-reported outcome measures: A systematic review. Journal of Patient-reported Outcomes, 4, 77. https://doi.org/10.1186/s41687-020-00244-3.

    Article  PubMed  PubMed Central  Google Scholar 

  30. Sandler, K. A., Mitchell, S. A., Basch, E., et al. (2018). Content validity of anatomic site-specific patient-reported outcomes version of the common terminology criteria for adverse events (PRO-CTCAE) item sets for assessment of acute symptomatic toxicities in radiation oncology. International Journal of Radiation Oncology, Biology, Physics, 102, 44–52. https://doi.org/10.1016/j.ijrobp.2018.04.048.

    Article  PubMed  Google Scholar 

  31. Winkel, D., Kroon, P. S., Werensteijn-Honingh, A. M., et al. (2018). Simulated dosimetric impact of online replanning for stereotactic body radiation therapy of lymph node oligometastases on the 1.5T MR-linac. Acta oncologica (Stockholm, Sweden), 57, 1705–1712. https://doi.org/10.1080/0284186x.2018.1512152.

    Article  CAS  Google Scholar 

  32. Nachbar, M., Mönnich, D., Kalwa, P., et al. (2019). Comparison of treatment plans for a high-field MRI-linac and a conventional linac for esophageal cancer. Strahlentherapie und Onkologie, 195, 327–334. https://doi.org/10.1007/s00066-018-1386-z.

    Article  PubMed  Google Scholar 

  33. Bainbridge, H. E., Menten, M. J., Fast, M. F., Nill, S., Oelfke, U., & McDonald, F. (2017). Treating locally advanced lung cancer with a 1.5T MR-Linac - effects of the magnetic field and irradiation geometry on conventionally fractionated and isotoxic dose-escalated radiotherapy. Radiotherapy and oncology : journal of the European Society for Therapeutic Radiology and Oncology, 125(2), 280–285. https://doi.org/10.1016/j.radonc.2017.09.009.

    Article  Google Scholar 

  34. Taarnhøj, G. A., Lindberg, H., Johansen, C., & Pappot, H. (2019). Patient-reported outcomes item selection for bladder cancer patients in chemo-or immunotherapy. Journal of Patient-reported Outcomes, 3(1), 56. https://doi.org/10.1186/s41687-019-0141-2.

    Article  PubMed  PubMed Central  Google Scholar 

  35. Tolstrup, L. K., Bastholt, L., Zwisler, A.-D., Dieperink, K. B., & Pappot, H. (2019). Selection of patient reported outcomes questions reflecting symptoms for patients with metastatic melanoma receiving immunotherapy. Journal of Patient-reported Outcomes, 3(1), 19. https://doi.org/10.1186/s41687-019-0111-8.

    Article  PubMed  PubMed Central  Google Scholar 

  36. Holch, P., Warrington, L., Potrata, B., et al. (2016). Asking the right questions to get the right answers: Using cognitive interviews to review the acceptability, comprehension and clinical meaningfulness of patient self-report adverse event items in oncology patients. Acta Oncologica (Stockholm, Sweden), 55, 1220–1226. https://doi.org/10.1080/0284186x.2016.1213878.

    Article  Google Scholar 

  37. Chiang-Hanisko, L., Newman, D., Dyess, S., et al. (2016). Guidance for using mixed methods design in nursing practice research. Applied Nursing Research, 31, 1–5. https://doi.org/10.1016/j.apnr.2015.12.006.

    Article  PubMed  Google Scholar 

  38. Veritas Health Innovation, M, Australia. Covidence systematic review software. In. www.covidence.org. Accessed 2 July 2019.

  39. Moher, D., Liberati, A., Tetzlaff, J., et al. (2009). Preferred reporting items for systematic reviews and meta-analyses: The PRISMA statement. Journal of Clinical Epidemiology, 62, 1006–1012. https://doi.org/10.1016/j.jclinepi.2009.06.005.

    Article  PubMed  Google Scholar 

  40. Basch, E., Reeve, B. B., Mitchell, S. A., et al. (2014). Development of the National Cancer Institute's patient-reported outcomes version of the common terminology criteria for adverse events (PRO-CTCAE). Journal of the National Cancer Institute, 106. https://doi.org/10.1093/jnci/dju244.

  41. Kulis, D., Bottomley, A., Whittaker, C., et al. (2017). The use of the Eortc item library to supplement Eortc quality of life instruments. Value in Health, 20, A775. https://doi.org/10.1016/j.jval.2017.08.2236.

    Article  Google Scholar 

  42. Dueck, A. C., Mendoza, T. R., Mitchell, S. A., et al. (2015). Validity and reliability of the US National Cancer Institute's patient-reported outcomes version of the common terminology criteria for adverse events (PRO-CTCAE). JAMA Oncology, 1, 1051–1059. https://doi.org/10.1001/jamaoncol.2015.2639.

    Article  PubMed  PubMed Central  Google Scholar 

  43. Baeksted, C., Pappot, H., Nissen, A., et al. (2016). Feasibility of an electronic patient-reported outcome intervention based on the patient-reported outcomes version of common terminology criteria for adverse events ( PRO-CTCAE) in Danish prostate cancer patients. Quality of Life Research, 25, 40–40.

    Google Scholar 

  44. Mendoza, T. R., Dueck, A. C., Bennett, A. V., Mitchell, S. A., Reeve, B. B., Atkinson, T. M., … Basch, E. (2017). Evaluation of different recall periods for the US National Cancer Institute's PRO-CTCAE. Clinical Trials (London, England), 14(3), 255–263. https://doi.org/10.1177/1740774517698645.

    Article  Google Scholar 

  45. Oken, M. M., Creech, R. H., Tormey, D. C., Horton, J., Davis, T. E., McFadden, E. T., & Carbone, P. P. (1982). Toxicity and response criteria of the eastern cooperative oncology group. American Journal of Clinical Oncology, 5(6), 649–655. https://doi.org/10.1097/00000421-198212000-00014.

    Article  CAS  PubMed  Google Scholar 

  46. CIMT (2021). My hospital (Centre for Innovative Medical Technology). https://cimt.dk/gb/mit-sygehus/.

    Google Scholar 

  47. Guest, G., Bunce, A., & Johnson, L. (2006). How many interviews are enough?: An experiment with data saturation and variability. Field Methods, 18(1), 59–82. https://doi.org/10.1177/1525822x05279903.

    Article  Google Scholar 

  48. Malterud, K. (2012). Systematic text condensation: A strategy for qualitative analysis. Scandinavian Journal of Public Health, 40(8), 795–805.10.1177/1403494812465030. https://doi.org/10.1177/1403494812465030.

    Article  PubMed  Google Scholar 

  49. Chiloiro, G., Boldrini, L., Meldolesi, E., et al. (2019). MR-guided radiotherapy in rectal cancer: First clinical experience of an innovative technology. Clinical Translational of Radiation Oncology, 18, 80–86. https://doi.org/10.1016/j.ctro.2019.04.006.

    Article  Google Scholar 

  50. Institute, NNC (2019). Common terminology criteria for adverse events (CTCAE).

    Google Scholar 

  51. Taarnhøj, G. A., Kennedy, F. R., Absolom, K. L., Bæksted, C., Vogelius, I. R., Johansen, C., … Pappot, H. (2018). Comparison of EORTC QLQ-C30 and PRO-CTCAE™ questionnaires on six symptom items. Journal of Pain and Symptom Management, 56(3), 421–429. https://doi.org/10.1016/j.jpainsymman.2018.05.017.

    Article  PubMed  Google Scholar 

  52. Atkinson, T. M., Ryan, S. J., Bennett, A. V., et al. (2016). The association between clinician-based common terminology criteria for adverse events (CTCAE) and patient-reported outcomes (PRO): A systematic review. Support Care Cancer, 24, 3669–3676. https://doi.org/10.1007/s00520-016-3297-9.

    Article  PubMed  PubMed Central  Google Scholar 

  53. Halkett, G. K. B., Wigley, C. A., Aoun, S. M., et al. (2018). International validation of the EORTC QLQ-PRT20 module for assessment of quality of life symptoms relating to radiation proctitis: A phase IV study. Radiation ncology (London, England), 13, 162. https://doi.org/10.1186/s13014-018-1107-x.

    Article  Google Scholar 

  54. Kotronoulas, G., Kearney, N., Maguire, R., et al. (2014). What is the value of the routine use of patient-reported outcome measures toward improvement of patient outcomes, processes of care, and health service outcomes in cancer care? A systematic review of controlled trials. Journal of Clinical Oncology : Official Journal of the American Society of Clinical Oncology, 32, 1480–1501. https://doi.org/10.1200/jco.2013.53.5948.

    Article  Google Scholar 

  55. Bottomley, A., Reijneveld, J. C., Koller, M., et al. (2019). Current state of quality of life and patient-reported outcomes research. European Journal of Cancer, 121, 55–63. https://doi.org/10.1016/j.ejca.2019.08.016.

    Article  PubMed  Google Scholar 

Download references

Acknowledgements

We would like to acknowledge the patients participating in the study for their time and valuable feedback. A special thanks also to the Department of Oncology at Odense University Hospital for allowing the study to be conducted in the department and to the clinicians in the Radiotherapy Department for helping with input, support and great clinical knowledge. In addition, we acknowledge Open Patient data Explorative Network (OPEN) for support and data management and MANTRA (New MAgNetic resonance Technology for Response Adapted radiotherapy) Frontline Research Center for the funding of UB. A thank you to Jennifer Green for language editing.

Funding

The study was supported by the Novo Nordisk Foundation and AgeCare, Academy of Geriatric Cancer Research. The organizations had no role designing the study, nor collecting, analyzing or interpreting the data or the manuscript.

Author information

Authors and Affiliations

  1. Department of Oncology, Odense University Hospital, AgeCare, Academy of Geriatric Cancer Research, Odense University Hospital, Odense, Denmark

    P. K. Møller & K. B. Dieperink

  2. Department of Clinical Research, University of Southern Denmark, Odense, Denmark

    P. K. Møller, U. Bernchou, T. Schytte & K. B. Dieperink

  3. Department of Oncology, Rigshospitalet, University Hospital of Copenhagen, Copenhagen, Denmark

    H. Pappot

  4. Department of Clinical Medicine, University of Copenhagen, Copenhagen, Denmark

    H. Pappot

  5. Laboratory of Radiation Physics, Odense University Hospital, Odense, Denmark

    U. Bernchou

  6. Department of Oncology, Odense University Hospital, Odense, Denmark

    T. Schytte

Authors
  1. P. K. Møller
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. H. Pappot
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. U. Bernchou
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. T. Schytte
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. K. B. Dieperink
    View author publications

    You can also search for this author in PubMed Google Scholar

Contributions

Planning and designing the study: PKM, KBD, HP, UB, TS. Literature review, chart audit and initial item selection: PKM, KBD, HP. Data collection: PKM. Data analysis: PKM, UB, KBD. Manuscript drafting: PKM, KBD, HP, UB, TS. All authors read and approved the final version of the manuscript.

Corresponding author

Correspondence to P. K. Møller.

Ethics declarations

Ethics approval and consent to participate

The Danish National Data Protection Agency approved the conduction of the studies included in this manuscript (file no 18/51369). All participants in the chart review and the prospective pilot study provided written and oral informed consent. In Denmark, no ethical approval is necessary for studies collecting questionnaire and interview data only.

Consent for publication

Not applicable.

Competing interests

The authors declare that they have no competing interests.

Additional information

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

The authors identified an error in the authors and affiliations lists. The correct authors and affiliations lists should read. P. K. Møller1,2, H. Pappot3,4, U. Bernchou2,5, T. Schytte2,6, K. B. Dieperink1,21. Department of Oncology, Odense University Hospital, AgeCare, Academy of Geriatric Cancer Research, Odense University Hospital, Odense, Denmark. 2 Department of Clinical Research, University of Southern Denmark, Odense, Denmark. 3 Department of Oncology, Rigshospitalet, University Hospital of Copenhagen, Copenhagen, Denmark. 4 Department of Clinical Medicine, University of Copenhagen, Copenhagen, Denmark. 5 Laboratory of Radiation Physics, Odense University Hospital, Odense, Denmark. 6 Department of Oncology, Odense University Hospital, Odense, Denmark.The author group has been updated above and the original article [1] has been corrected.

Supplementary Information

Rights and permissions

Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Møller, P.K., Pappot, H., Bernchou, U. et al. Development of patient-reported outcomes item set to evaluate acute treatment toxicity to pelvic online magnetic resonance-guided radiotherapy. J Patient Rep Outcomes 5, 47 (2021). https://doi.org/10.1186/s41687-021-00326-w

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1186/s41687-021-00326-w

Keywords