Skip to main content

Patient and clinician-reported experiences of using electronic patient reported outcome measures (ePROMs) as part of routine cancer care

Abstract

Background

Cancer and its treatment can have significant impacts on health status, quality of life and functioning of patients. Direct information from patients regarding these aspects can be collected via electronic platforms in the form of electronic Patient Reported Outcome Measures (ePROMs). Research has shown that the use of ePROMS in cancer care leads to improved communication, better symptom control, prolonged survival and a reduction in hospital admissions and emergency department attendance. Acceptability and feasibility of routine ePROM collection has been reported by both patients and clinicians but to date their use has predominantly been limited to clinical trials. MyChristie-MyHealth is an initiative from a UK comprehensive cancer centre The Christie NHS Foundation Trust which incorporates the regular collection of ePROMs into routine cancer care. This study, carried out as part of a service evaluation, explores patient and clinician experiences of using the MyChristie-MyHealth ePROMs service.

Results

100 patients with lung and head and neck cancers completed a Patient Reported Experience questionnaire. All patients reported that MyChristie-MyHealth was easy to understand and, almost all found it timely to complete and easy to follow. Most patients (82%) reported it improved their communication with their oncology team and helped them to feel more involved with their care (88%). A large proportion of clinicians (8/11) felt ePROMs helped communication with their patients and over half (6/10) felt they led to consultations being more patient focused. Clinicians also felt that the use of ePROMs resulted in patients being more engaged in consultations (7/11) and their cancer care in general (5/11). Five clinicians reported that the use of ePROMs altered their clinical decision making.

Conclusions

Regular ePROMs collection as part of routine cancer care is acceptable to both patients and clinicians. Both patients and clinicians feel their use improved communication and increased the feeling of patient involvement with their care. Further work is needed to explore the experiences of patients that did not complete the ePROMs as part of the initiative and to continue to optimize the service for both patients and clinicians.

Background

There are over two and a half million people in the UK currently living with cancer and this number is set to increase to 4 million by 2030 [1]. The symptom burden for these patients can be high [2, 3] and even mild side-effects can impact quality of life (QoL) and lead to cessation of treatment, especially with prolonged treatment regimes [4]. The effective management of cancer symptoms or treatment-related side-effects is integral to maintaining a good QoL in patients living with cancer.

Patient Reported Outcome Measures (PROMs) are used to gather information about health status, QoL and functioning directly from patients, without any interpretation from a member of clinical staff [5]. PROMs allow patients to report on symptom severity as well as the impact of these symptoms on QoL, functioning and overall well-being. The benefits of integrating remotely-reported PROMs using electronic platforms (ePROMs) within the clinical pathways are well documented [6,7,8,9,10,11]. Randomised controlled trials have demonstrated that the use of ePROMs lead to improvements in the doctor/patient relationship as a result of enhanced communication and clinical efficiency, better symptom control, reduced emergency department attendance, reduced hospitalisation and improved survival. ePROMs have also been shown to lead to earlier detection [12] and management [13, 14] of symptoms as well as earlier detection of tumour recurrence [15]. Furthermore, automated feedback to patients on completing ePROMs can identify milder symptoms which do not necessarily need clinician involvement and can be managed at home [4]. On the whole, the routine collection of ePROMs can enable a more holistic and patient-centred approach to clinical care [16,17,18]. This high level evidence has been invaluable in this arena for informing shared decision-making as well as economic and regulatory analyses [6,7,8].

To date, the implementation of ePROMs in oncology has mostly occurred in the context of clinical trials while their integration into routine cancer care is still to be established. Patients and clinicians report high satisfaction and acceptability when ePROMs are used as part of routine cancer care [19]. However, a number of patient, clinician and logistical barriers to ePROMs integration in this setting should be taken into consideration in order to make the routine implementation of ePROMs a reality [19,20,21,22,23,24,25,26,27].

‘MyChristie-MyHealth’ was launched in January 2019, integrating ePROM questionnaires routinely into patient care pathways [28]. As part of the evaluation of the ePROMs service, we aimed to assess the acceptability and feasibility of regular ePROMs collection in routine cancer care and explore patient and clinician experiences of the service.

Methods

Study design

This was a single-centre, questionnaire-based study which formed part of a service evaluation of the MyChristie-MyHealth initiative. The study focused on patients with lung cancer and head and neck cancer, the two main disease groups in which this service was initially introduced.

The aim was to demonstrate the feasibility of ePROMs collection in routine cancer care and to explore patient and clinician experiences of the service. This service evaluation was reviewed and approved by the Christie NHS Foundation Trust Governance Panel.

MyChristie-MyHealth ePROMs service

Patients with an outpatient consultation automatically receive a text message or email containing a personalised link to access the MyChristie-MyHealth platform the day before their first clinic appointment or three days prior to a scheduled follow-up appointment. Patients then log onto the ePROM platform using their personal details (surname, date of birth and postcode) to complete the questionnaire. Patients were able to seek assistance to complete ePROMs via a proxy (e.g. family member) or a member of the Christie ePROM team. This help was solely of a technical nature, such as logging on to the MyChristie-MyHealth platform, and all ePROMS responses were entirely the patient’s own (Figs. 1 and 2).

Fig. 1
figure 1

Example of ePROM questions

Fig. 2
figure 2

Schematic of patient alert messages

The ePROMs questionnaire consist of symptom items written in lay language, adapted from the Common Terminology Criteria for Adverse Events (v5.0) [29] and quality of life items (using the EuroQol EQ-5D-5L quality of life (QoL) tool [30]. Symptom items were chosen by the relevant clinical teams. Patients and specialist nurses were involved with the development of the MyChristie-MyHealth ePROM questionnaire. The type and number of symptom items is dependent on prior treatment received, e.g., systemic anticancer therapy or radiotherapy. Examples of the ePROMs questionnaires used in the lung and head and neck patient groups are provided in Additional file 1: Appendix 1 and Additional file 2: Appendix 2.

Following completion of an ePROMs questionnaire, patients are presented with colour-coded advice dependent on symptom severity. Patients without any symptoms receive a message reassuring them that no action is required (green). Those with mild symptoms receive an alert with a link to the Macmillan website [31] that includes self-care advice (blue). Moderate symptoms elicit advice to seek medical attention from their oncology team or their General Practitioner within a week (orange). Finally, those with severe symptoms receive an alert advising them to seek urgent medical advice within 24 h (red). Each advice alert was accompanied by the hospital’s 24/7 hotline contact details.

For the purposes of this report, data regarding demographics, disease stage, performance status and comorbidity burden (Adult Comorbidity Evaluation (ACE) score) were collected prospectively at the time of consultations by the clinical teams. Missing data was collected by the first author from the electronic patient record.

At the time when this study was conducted, the results of the ePROMs questionnaires were not integrated into the institution’s electronic patient record. In order to view the completed ePROMS questionnaires clinicians logged into a separate electronic platform, which was provided by a digital health company (DrDoctor®), and they were encouraged to do so prior to each clinical encounter. Clinicians were reminded by members of the ePROM team to log onto the platform and review responses, at the start of each clinic.

Patient experience

Participants

Patients who attended lung cancer or head and neck cancer clinics between May 2019 and June 2019 and had completed at least one ePROMs questionnaire were invited to complete a Patient Reported Experience Measure (PREM) questionnaire. All consecutive patients who attended these clinics were approached to complete the questionnaire.

Participants were excluded if they had not completed an ePROMs questionnaire prior to the assessment period, if they had completed the questionnaire on the day of PREM collection with the help of a member of the ePROMs team, or if they had completed the questionnaire with the assistance of a proxy who was not present at the time of PREM collection.

Questionnaire development and content

The PREM questionnaire was developed in collaboration with the Christie ePROMs Steering Group. Questions were chosen by the ePROMs steering group and formed into draft questionnaires. Clinicians, clinical nurse specialists and patient representatives were asked to review the questionnaires to ensure they were relevant and understandable, and provided modifications where needed. The final questionnaires were reviewed and approved by the ePROMs steering group prior to roll-out.

The questionnaire consisted of six questions exploring the usability of the ePROMs questionnaire, the timing of the text messages and the impact on clinical care. These questions were answered using a 4 point Likert scale (from 1 ‘strongly agree’ to 4 ‘strongly disagree’). A neutral option was omitted as research has suggested that 10–20% of those who answer with a neutral option tend to have a preference either favourably or unfavourably [32]. After discussion within the ePROM steering group the neutral option was omitted for this reason.

A further two dichotomous (‘yes/no’) questions with free text boxes were added to gain information regarding the advice messages and the frequency of questionnaire administration. A final free text box was added at the end for further comments about the MyChristie-MyHealth service (Fig. 3).

Fig. 3
figure 3figure 3

Patient experience measure (PREM) questionnaire

Both paper and electronic versions were available to allow as many patients as possible to participate. All paper versions were anonymised, entered onto the ePROMs platform and subsequently disposed of securely.

Clinician experience

Participants

All clinicians involved in lung and head and neck cancer clinics between May 2019 and July 2019, were invited to complete a clinician experience questionnaire. Participants were approached in person and via email.

Questionnaire development and content

The clinician questionnaire was also developed with input from the Christie ePROMs steering committee Potential questions to be included were discussed with steering group, these were then constructed into a questionnaire that was reviewed and adapted by the steering group. After final review and approval this was uploaded and distributed using an online platform.

It included six questions using a 4 point Likert scale, as outlined above. These questions explored the impact of the service on clinical decision making, communication with patients, duration of consultations and patient engagement in their consultation and their clinical care as a whole. The clinician questionnaire is shown in Fig. 4 below.

Fig. 4
figure 4

Clinician experience questionnaire

Results

Patient experience

Study population

Between May and July 2019 107 patients were approached to complete a PREM. Of these 100 PREMs were returned completed. Two patients declined due to anxiety around upcoming appointment, 1 completed the ePROM with a proxy who was not present at the time of PREM collection and four were returned with incomplete data that was insufficient of analysis. The median patient age was 67 years (range 30–80 years) and 50% were female. 78 patients had lung cancer and 22 had a head and neck cancer (Table 1). Most patients had an ECOG performance status of 0–1 (86%) and the remainder (14%) had a performance status of 2. Seventy-five percent of patients had an ACE-27 score of 0–1. Almost half (49%) of patients had non-metastatic disease, 42% had metastatic or extensive stage disease and for the remainder, the extent of disease was not documented (Table 1).

Table 1 Patient demographic data

Patient experience data

All patients either strongly agreed or agreed that they found the ePROMs service (MyChristie-MyHealth) easy to understand. Almost all (99%) felt ePROMs were easy to access and that the time taken to complete the questionnaires was appropriate. Finally, 97% reported that the timing of the text or email prompt to complete the questionnaires was appropriate.

When investigating the perceived impact of ePROMs on clinical care, 82% stated that using ePROMs improved communication with their oncology team and 88% agreed or strongly agreed that using ePROMs made them feel more involved in their care. Eighty-one participants felt that using ePROMs prompted them to seek medical advice sooner.

Eighteen patients reported receiving self-care advice through the MyChristie-MyHealth portal of which 14 said they found this advice helpful.

An evaluation of the of the free-text comment boxes found that the patients considered the questionnaire to be helpful, easy to use and a good method to aid communication with their clinical team. Some patients highlighted that they thought it was important that clinicians mentioned and demonstrated that they used the ePROMs responses during the clinical consultations. Other patients reported that the questions included were too rigid and suggested the inclusion of a free-text box at the end of the ePROM questionnaire so that they could add other comments on their health (Table 2).

Table 2 Patient reported experience measure (PREM) questionnaire responses

Clinician experience

Study population

Between June 2019 and July 2019, 11 oncologists specializing in lung and head and neck cancer completed the clinician experience questionnaire. Due to the set-up of the online platform, demographic data could not be collected. One questionnaire was returned with incomplete data (one question unanswered) but was felt to be sufficiently completed to be included in the analysis.

Clinician experience data

Eight clinicians (72.2%) reported that using ePROMs supported communication with their patients and six noted their use made consultations more patient-focused. Seven clinicians (63.6%) felt that ePROMs use had led to patients being more engaged during their consultations and 5 (45.5%) believed that patients using ePROMs were more engaged with their care as a whole.

Five clinicians (45.5%) felt that using ePROMs had contributed to their clinical decision making. Only one clinician reported that using ePROMs shortened their consultation time.

Some clinicians commented that whilst they thought the inclusion of ePROMs into clinical care was useful, integration into the electronic patient record would be a valuable step in ensuring that ePROMs were easier to use. Clinicians also commented that due to the lack of integration into the electronic patient record accessing and reviewing ePROMs was time consuming and frequently forgotten (Table 3).

Table 3 Clinician experience questionnaire responses

Discussion

Historically, the use of PROMs in oncology care has been largely undertaken in the context of clinical research. Recently there has been a drive to incorporate regular ePROMs collection into routine cancer care [33, 34]. This study shows that the real-world collection of ePROMs as part of routine cancer care is acceptable to patients and clinicians and can have a positive impact on patient attitudes towards engagement with their care.

In this study, nearly all patients found ePROMs easy to use and understand which is similar to the findings from published literature on the use of PROMs in cancer care. Studies in a range of cancer sites and also in a palliative care setting have found that between 78.2% and 100% of patients found ePROMs easy to use [13, 35,36,37,38,39,40,41] and 97%-100% found them easy to understand [36,37,38]. It is worth noting that these studies have all used different electronic platforms to the current study but these findings support the idea that routine collection of ePROMs is acceptable to patients.

Our study found that 95% of patients surveyed were happy to continue completing ePROMs at every clinic visit which is higher than in previously published studies. In a study by Boyes et al., 75% of patients wished to complete a PROM questionnaire at each clinic visit [13] whilst only 60% of those in a study by Kallen et al. wanted to continue using ePROMs regularly as part of their clinical care [36]. The higher willingness to complete regular ePROMs in our evaluation may reflect the fact that only patients who had filled in at least one ePROMs questionnaire, and therefore more likely to continue to be compliant, were approached in this study, potentially introducing bias to the results. Furthermore, in the current evaluation the ePROMs initiative had been running for less than a year meaning patients may be less likely to have experienced questionnaire fatigue than in longer running studies. Another important finding is that over 80% of patients reported that completing the ePROMs questionnaires helped them to feel more involved in their care. Previous studies by Basch et al. demonstrated that 60–77% of patients felt more in control of their cancer care as a result of using ePROMs [40, 42]. It is possible that the different wording of the question in this study, using ‘involved’ rather than ‘in control’, may have led to the slightly increased agreement with this statement as patients have been found to experience a ‘lack of control’ whilst undergoing their treatment [40]. One limitation of this study is that it did not specifically investigate the barriers related to the routine collection of PROMs using an electronic platform.

Current literature is mixed when looking at the impact of the use of PROMs use on patient-clinician communication. Eighty-two percent of patients in our study felt that using ePROMs improved communication with their clinical team which is similar to a number of studies which have shown that between 51 and 95% of participants felt that the use of PROMs supported communication with their clinical team [36, 40, 42, 44, 45]. However, only 37% of respondents in a study by McLachlan et al. reported that PROMs improved communication with their clinical team [46] and Rosenbloom et al. did not find any statistically significant changes in patient satisfaction regarding communication when using PROMs as part of clinical care [47]. Reasons for this difference may be that the patients in the study by McLaughlin et al. were not undergoing treatment and only a small proportion were found to have high cancer needs which may have limited the effect. Furthermore, baseline satisfaction with communication was high prior to the implementation of PROMs in the Rosenbloom et al. study, which may have led to an element of ceiling effect.

Existing literature on PROMs echoes the comments made by patients in this study. The use of PROMs has been shown to help reassure patients [48] and better focus their thoughts on health related issues and symptoms during consultations [37, 44, 49, 50]. Patients in this study commented that clinicians were not systematically discussing their ePROMs questionnaire responses during consultations which has been found to be an issue in other studies. Boyes et al. found that only 3 of the 40 patients in their study recalled clinicians specifically mentioning PROMs responses during their consultations [13]. An important aim of ePROMs service improvement is therefore to raise the awareness of the importance of clinician’s review of the questionnaire and feedback to patients.

Most clinicians in this study reported that the use of ePROMs supported communication with patients (8/11) whilst just over half (6/10) reported that they led to consults being more patient focused. Interestingly although seven clinicians reported that the use of ePROMs led to patients being more involved in the consultation only five reported it improved engagement with their overall care. The current literature regarding the role of PROMs in supporting communication is very mixed [13, 51,52,53,54] and it appears that whilst 70%-100% of clinicians from a nursing or allied health care professional background feel that PROMs support communication [51, 52], only 50–67% of doctors agree with this statement [13, 53, 54].

To our knowledge, no previous literature has looked directly at the impact of ePROMs on making consultations more ‘patient-centred’. However 60% of clinicians in a study by Berry et al. found that the use of PROMs helped to guide consultations [53] and 67% in a study by Mark et al. reported that PROMs helped to focus consultations [37].

This study found that 45% of clinicians reported that patients’ ePROMs responses contributed to their decision-making. A study by Moore et al. [45] looking at using ePROMs as part of routine cancer care in haematological malignancies found similar results to this study in that just over 40% of clinicians reported taking action after looking at the results of ePROMs. However, an earlier study conducted at the Christie showed this percentage to be much higher (79.5%) [38]. It is important to note that in the earlier study, patient responses to the ePROMs questionnaires were available within the electronic patient record rather than on a separate platform as was the case in this study. This was reported by clinicians as a potential barrier to accessing ePROMs responses prior to the consultation and could contribute to the difference in the results. This issue has since been rectified. The ePROMs responses have been available in the electronic patient record for the clinical team to review since March 2020.

Approximately two-thirds of the patients in this study who stated they received advice to seek urgent medical help reported that they did not heed this advice. Reasons given by patients for not seeking urgent help were that the patient was due to see their oncology team in the very near future or that the symptom was long-standing and being managed. This has highlighted an important area for ongoing study to explore further patients’ reasons for not heeding the urgent medical advice prompts and whether there needs to be alterations in the threshold for the alerts.

One limitation of this study is that the clinician experience questionnaire was not completed by all clinicians involved in clinics using ePROMs, again potentially leading to bias in the results. Another area for potential bias was noted as all questions were phrased in a positive way and no negative phrasing was used. This was primarily to ensure they were easy to understand and to keep the number of questions as low as possible to avoid questionnaire fatigue but it is acknowledged that this could lead to more positive responses. In the same vein, although the PREM questionnaires were collected anonymously the patients were approached to complete the questionnaire by a member of the MyChristie-MyHealth team. This could therefore introduce potential bias as patients may not want to respond negatively about a service that is providing their cancer care.

Future directions for the project include gaining experience data from non-completers as well as the continued review of patient and clinician experience to aid future development of the MyChristie-MyHealth service. A further roll out of the initiative to all patient groups and the development of ad-hoc and responsive ePROMs service can help create an adaptive, patient-centred approach to routine cancer care (Table 4).

Table 4 Future directions for the MyChristie-MyHealth project

Conclusion

This study has shown that the use of regular ePROMs collection in routine cancer care is not only feasible and acceptable to patients and clinicians alike, but can also lead to improved communication between patients and their oncology teams. Furthermore, ePROMs can help to make patients feel more involved in their care and be more engaged in consultations. Our findings will help other centres who may be considering the implementation of ePROM into routine care and provide some ideas of further work that is required in this setting. Further research looking specifically at patients who did not complete the ePROMs, enhancing engagement of clinicians with the service and constant review and evaluation of the MyChristie-MyHealth initiative is needed moving forward to optimize the benefits to patients.

Availability of data and materials

he datasets used in the current study are available on request from the corresponding author.

Abbreviations

ACE:

Adult comorbidity evaluation

ePROM:

Electronic patient reported outcome measure

EQ-5D-5L:

European quality of Life- 5 dimensions-5 levels

H&N:

Head and neck

PREM:

Patient reported experience measure

PROM(s):

Patient reported outcome measure(s)

PS:

Performance status

QoL:

Quality of life

References

  1. MacMillan. Cancer Statistics Fact Sheet. Macmillan Cancer Support [Internet]. 2015; (January):1–10. https://www.macmillan.org.uk/_images/cancer-statistics-factsheet_tcm9-260514.pdfhttp://www.macmillan.org.uk/Documents/AboutUs/Research/Keystats/StatisticsFactsheet.pdf

  2. Deshields TL, Potter P, Olsen S, Liu J (2014) The persistence of symptom burden: symptom experience and quality of life of cancer patients across one year. Support Care Cancer 22(4):1089–1096

    Article  PubMed  Google Scholar 

  3. Esther Kim JE, Dodd MJ, Aouizerat BE, Jahan T, Miaskowski C (2009) A review of the prevalence and impact of multiple symptoms in oncology patients. J Pain Symptom Manage 37(4):715–736

    Article  PubMed  Google Scholar 

  4. Di Maio M, Basch E, Denis F, Fallowfield LJ, Ganz PA, Howell D, et al. The role of patient-reported outcome measures in the continuum of cancer clinical care: ESMO Clinical Practice Guideline. Ann Oncol. 2022

  5. Weldring T, Smith SMS (2013) Article commentary: patient-reported outcomes (PROs) and patient-reported outcome measures (PROMs). Heal Serv Insights 6:61–68

    Google Scholar 

  6. Basch E, Deal AM, Dueck AC, Scher HI, Kris MG, Hudis C et al (2017) Overall survival results of a trial assessing patient-reported outcomes for symptom monitoring during routine cancer treatment. JAMA - J Am Med Assoc 318(2):197–198

    Article  Google Scholar 

  7. Basch E, Deal AM, Kris MG, Scher HI, Hudis CA, Sabbatini P et al (2016) Symptom monitoring with patient-reported outcomes during routine cancer treatment: a randomized controlled trial. J Clin Oncol 34(6):557–565

    Article  CAS  PubMed  Google Scholar 

  8. Denis F, Basch E, Septans AL, Bennouna J, Urban T, Dueck AC et al (2019) Two-Year Survival Comparing Web-Based Symptom Monitoring vs Routine Surveillance Following Treatment for Lung Cancer. JAMA 321(3):306–307

    Article  PubMed  PubMed Central  Google Scholar 

  9. Rotenstein LS, Huckman RS, Wagle NW (2017) Making patients and doctors happier — the potential of patient-reported outcomes. N Engl J Med 377(14):1309–1312

    Article  PubMed  Google Scholar 

  10. Girgis A, Durcinoska I, Arnold A, Descallar J, Kaadan N, Koh ES et al (2020) Web-based patient-reported outcome measures for personalized treatment and care (PROMPT-Care): Multicenter Pragmatic Nonrandomized Trial. J Med Internet Res 22(10):e19685

    Article  PubMed  PubMed Central  Google Scholar 

  11. Maguire R, McCann L, Kotronoulas G, Kearney N, Ream E, Armes J et al (2021) Real time remote symptom monitoring during chemotherapy for cancer: European multicentre randomised controlled trial (eSMART). BMJ 21:374

    Google Scholar 

  12. Fromme EK, Eilers KM, Mori M, Hsieh YC, Beer TM (2004) How accurate is clinician reporting of chemotherapy adverse effects? A comparison with patient-reported symptoms from the Quality-of-Life Questionnaire C30. J Clin Oncol 22(17):3485–3490

    Article  PubMed  Google Scholar 

  13. Boyes A, Newell S, Girgis A, McElduff P, Sanson-Fisher R (2006) Does routine assessment and real-time feedback improve cancer patients’ psychosocial well-being? Eur J Cancer Care (Engl) 15(2):163–171

    Article  CAS  PubMed  Google Scholar 

  14. Trowbridge R, Dugan W, Jay SJ, Littrell D, Casebeer LL, Edgerton S et al (1997) Determining the effectiveness of a clinical-practice intervention in improving the control of pain in outpatients with cancer. Acad Med 72(9):798–800

    Article  CAS  PubMed  Google Scholar 

  15. Denis F, Viger L, Charron A, Voog E, Letellier C (2014) Detecting lung cancer relapse using self-evaluation forms weekly filled at home: the sentinel follow-up. Support Care Cancer 22(1):79–85

    Article  PubMed  Google Scholar 

  16. Black N. Patient reported outcome measures could help transform healthcare. BMJ. 2013; 346(7896).

  17. Black N, Jenkinson C. Measuring patients’ experiences and outcomes. BMJ. 2009;339.

  18. Fung CH, Hays RD (2008) Prospects and challenges in using patient-reported outcomes in clinical practice. Qual Life Res 17(10):1297

    Article  PubMed  PubMed Central  Google Scholar 

  19. Howell D, Molloy S, Wilkinson K, Green E, Orchard K, Wang K et al (2015) Patient-reported outcomes in routine cancer clinical practice: a scoping review of use, impact on health outcomes, and implementation factors. Ann Oncol 26(9):1846–1858

    Article  CAS  PubMed  Google Scholar 

  20. Jensen RE, Snyder CF (2016) PRO-cision medicine: personalizing patient care using patient-reported outcomes. J Clin Oncol 34(6):527–529

    Article  PubMed  Google Scholar 

  21. Luckett T, Butow PN, King MT (2009) Improving patient outcomes through the routine use of patient-reported data in cancer clinics: Future directions. Psychooncology 18(11):1129–1138

    Article  CAS  PubMed  Google Scholar 

  22. Nelson TA, Anderson B, Bian J, Boyd AD, Burton SV, Davis K et al (2020) Planning for patient-reported outcome implementation: development of decision tools and practical experience across four clinics. J Clin Transl Sci 4(6):498–507

    Article  PubMed  PubMed Central  Google Scholar 

  23. Duncan EAS, Murray J. The barriers and facilitators to routine outcome measurement by allied health professionals in practice: a systematic review. BMC Health Serv Res. 2012;12(1).

  24. Foster A, Croot L, Brazier J, Harris J, O’cathain A (2018) The facilitators and barriers to implementing patient reported outcome measures in organisations delivering health related services: a systematic review of reviews. J Patient Rep Outcomes 2:1–14

    Article  Google Scholar 

  25. Addario B, Geissler J, Horn MK, Krebs LU, Maskens D, Oliver K et al (2020) Including the patient voice in the development and implementation of patient-reported outcomes in cancer clinical trials. Heal Expect 23(1):41–51

    Article  Google Scholar 

  26. Basch E (2019) High compliance rates with patient-reported outcomes in oncology trials submitted to the US food and drug administration. J Natl Cancer Inst 111(5):437–439

    Article  PubMed  Google Scholar 

  27. Boyce M, Browne J, Greenhalgh J (2014) The experiences of professionals with using information from patient-reported outcome measures to improve the quality of healthcare: a systematic review of qualitative research. BMJ Qual Saf 23(6):508–518

    Article  PubMed  Google Scholar 

  28. Crockett C, Gomes F, Faivre-Finn C, Howell S, Kasipandian V, Smith E et al (2021) The routine clinical implementation of electronic patient-reported outcome measures (ePROMs) at the christie NHS foundation trust. Clin Oncol 33(12):761–764

    Article  CAS  Google Scholar 

  29. U.S. Department of Health and Human Services. Common Terminology Criteria for Adverse Events (CTCAE).v.5.0. Cancer Ther Eval Progr [Internet]. 2017;155. http://upen.terengganu.gov.my/index.php/2017

  30. EuroQol. EQ-5D [Internet]. 2022 [cited 2022 May 31]. https://euroqol.org/eq-5d-instruments/

  31. Physical impacts of cancer and treatment- Macmillan Cancer Support [Internet]. [cited 2022 Aug 13]. https://www.macmillan.org.uk/cancer-information-and-support/treatment/physical-impacts-of-cancer-and-treatment

  32. Presser S, Schuman H (1980) The measurement of a middle position in attitude surveys. Undefined. 44(1):70–85

    Google Scholar 

  33. Stewart E, Tavabie S, White N, Appleyard S, Bass S, Gilbert D et al (2022) A short report examining the introduction of routine use of patient-reported outcome measures in a mixed oncology population. Clin Oncol 34(4):241–246

    Article  CAS  Google Scholar 

  34. Macnair A, Sharkey A, Le Calvez K, Walters R, Smith L, Nelson A et al (2020) The trigger project: the challenge of introducing electronic patient-reported outcome measures into a radiotherapy service. Clin Oncol 32(2):e76–e79

    Article  CAS  Google Scholar 

  35. Abernethy A, Herndon J, Wheeler J, Day J, Hood L, Patwardhan M et al (2009) Feasibility and acceptability to patients of a longitudinal system for evaluating cancer-related symptoms and quality of life: pilot study of an e/Tablet data-collection system in academic oncology. J Pain Symptom Manage 37(6):1027–1038

    Article  PubMed  Google Scholar 

  36. Kallen M, Yang D, Haas N (2012) A technical solution to improving palliative and hospice care. Support Care Cancer 20(1):167–174

    Article  PubMed  Google Scholar 

  37. Mark TL, Fortner B, Johnson G (2008) Evaluation of a tablet PC technology to screen and educate oncology patients. Support Care Cancer 16(4):371–378

    Article  PubMed  Google Scholar 

  38. Shears A, Barker-Hewitt M, Bayman N, Mrcp M, Harris M, Mbbs B, et al. Electronic patient reported outcomes ( e-PROs ) significantly improved toxicity data collection and were acceptable to both patients and clinicians in lung cancer radiotherapy outpatient clinics. 2017; 5(2):178–83.

  39. Basch E, Artz D, Dulko D, Scher K, Sabbatini P, Hensley M et al (2005) Patient online self-reporting of toxicity symptoms during chemotherapy. J Clin Oncol 23(15):3552–3561

    Article  PubMed  Google Scholar 

  40. Basch E, Iasonos A, Barz A, Culkin A, Kris M, Artz D et al (2007) Long-term toxicity monitoring via electronic patient-reported outcomes in patients receiving chemotherapy. J Clin Oncol 25(34):5374–5380

    Article  PubMed  Google Scholar 

  41. Zylla DM, Gilmore GE, Steele GL, Eklund JP, Wood CM, Stover AM et al (2020) Collection of electronic patient-reported symptoms in patients with advanced cancer using Epic MyChart surveys. Supp Care Cancer 28(7):3153–3163

    Article  Google Scholar 

  42. Basch E, Artz D, Dulko D, Scher K, Sabbatini P, Hensley M et al (2005) Patient online self-reporting of toxicity symptoms during chemotherapy. J Clin Oncol 23(15):3552–3561

    Article  PubMed  Google Scholar 

  43. Adler N, Page, AEK E. Institute of Medicine (US) Committee on Psychosocial Services to Cancer Patients/Families in a Community Setting. Cancer Care for the Whole Patient: Meeting Psychosocial Health Needs. Washington DC; 2010.

  44. Velikova G, Keding A, Harley C, Cocks K, Booth L, Smith AB et al (2010) Patients report improvements in continuity of care when quality of life assessments are used routinely in oncology practice: Secondary outcomes of a randomised controlled trial. Eur J Cancer 46(13):2381–2388

    Article  PubMed  Google Scholar 

  45. Moore EM, King TA, Wood EM, Ruseckaite R, Klarica D, Spencer A et al (2020) Patient-reported outcome measures in multiple myeloma: Real-time reporting to improve care (My-PROMPT) - a pilot randomized controlled trial. Am J Hematol 95(7):E178–E181

    Article  PubMed  Google Scholar 

  46. McLachlan SA, Allenby A, Matthews J, Wirth A, Kissane D, Bishop M et al (2001) Randomized trial of coordinated psychosocial interventions based on patient self-assessments versus standard care to improve the psychosocial functioning of patients with cancer. J Clin Oncol 19(21):4117–4125

    Article  CAS  PubMed  Google Scholar 

  47. Rosenbloom SK, Victorson DE, Hahn EA, Peterman AH, Cella D (2007) Assessment is not enough: a randomized controlled trial of the effects of HRQL assessment on quality of life and satisfaction in oncology clinical practice. Psychooncology 16(12):1069–1079

    Article  PubMed  Google Scholar 

  48. Denis F, Lethrosne C, Pourel N, Molinier O, Pointreau Y, Domont J et al (2017) Randomized trial comparing a web-mediated follow-up with routine surveillance in lung cancer patients. J Natl Cancer Inst 109(9):1–8

    Article  Google Scholar 

  49. Snyder CF, Aaronson NK, Choucair AK, Elliott TE, Greenhalgh J, Halyard MY et al (2012) Implementing patient-reported outcomes assessment in clinical practice: a review of the options and considerations. Qual Life Res 21(8):1305–1314

    Article  PubMed  Google Scholar 

  50. Warrington L, Absolom K, Holch P, Gibson A, Clayton B, Velikova G. Online tool for monitoring adverse events in patients with cancer during treatment (eRAPID): field testing in a clinical setting. BMJ Open. 2019 Jan 1;9(1).

  51. Hilarius D, Kloeg P, Gundy C, Aaronson N (2008) Use of health-related quality-of-life assessments in daily clinical oncology nursing practice: a community hospital-based intervention study. Cancer 113(3):628–637

    Article  PubMed  Google Scholar 

  52. Stover A, Irwin D, Chen R, Chera B, Mayer D, Muss H et al (2015) Integrating patient-reported outcome measures into routine cancer care: cancer patients’ and clinicians’ perceptions of acceptability and value. EGEMS (Washington, DC) 3(1):17

    Google Scholar 

  53. Berry D, Blumenstein B, Halpenny B, Wolpin S, Fann J, Austin-Seymour M et al (2011) Enhancing patient-provider communication with the electronic self-report assessment for cancer: a randomized trial. J Clin Oncol 29(8):1029–1035

    Article  PubMed  PubMed Central  Google Scholar 

  54. Bainbridge D, Seow H, Sussman J, Pond G, Martelli-Reid L, Herbert C et al (2011) Multidisciplinary health care professionals’ perceptions of the use and utility of a symptom assessment system for oncology patients. J Oncol Pract 7(1):19–23

    Article  PubMed  PubMed Central  Google Scholar 

Download references

Acknowledgements

Prof Corinne Faivre-Finn and Prof Janelle Yorke are supported by NIHR Manchester Biomedical Research Centre.

Funding

My Christie-MyHealth is funded by the Christie Charitable Fund. This work was supported by Cancer Research UK via funding to the Cancer Research Manchester Centre [CTRQQR-2021\100010]. Prof Corinne Faivre-Finn and Prof Janelle Yorke are supported by NIHR Manchester Biomedical Research Centre and the CRUK Manchester Major Centre.

Author information

Authors and Affiliations

Authors

Contributions

AP collected, analysed and interpreted the data. AP and CFF wrote the first draft. All authors read and approved the final manuscript.

Corresponding author

Correspondence to Amelia Payne.

Ethics declarations

Ethics approval and consent to participate

The study was approved as part of a service evaluation of the MyChristie-MyHealth ePROMs initiative by the Quality, Improvement Audit Committee at The Christie NHS Foundation Trust.

Consent for publication

Not applicable.

Competing interests

The authors declare that they have no competing interests.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Supplementary Information

Additional file 1.

Examples of lung cancer ePROMs questions

Additional file 2.

Examples of head and neck cancer ePROMs questions

Rights and permissions

Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Payne, A., Horne, A., Bayman, N. et al. Patient and clinician-reported experiences of using electronic patient reported outcome measures (ePROMs) as part of routine cancer care. J Patient Rep Outcomes 7, 42 (2023). https://doi.org/10.1186/s41687-023-00544-4

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1186/s41687-023-00544-4

Keywords