- Open Access
Inclusion of information technology-based assessments of health-related quality of life in routine oncology practice in Uruguay
Journal of Patient-Reported Outcomes volume 6, Article number: 65 (2022)
Previous research has shown that the inclusion of patient-reported outcomes measures in the patient’s visit to the oncologists might improve the quality of global health care. The aim of the study was to assess the feasibility, acceptance, and utility perceived by patients and oncologists of health-related quality of life (HRQL) assessments obtained prior to clinical visits, and to evaluate if this has an impact on patient’s well-being in a sample of Spanish-speaking patients from Uruguay.
Patients assisted regularly in the Oncology Clinic were randomized into two groups: an intervention group that completed a set of questionnaires (European Organisation for Research and Treatment of Cancer-Quality of Life Questionnaire-C30 (EORTC QLQ-C30) and Hospital Anxiety and Depression Scale using a touch screen device and a control group that did not respond to these questionnaires. At 2 months, the responses of all the participants to the Functional Assessment of Cancer Therapy-General (FACT-G) were collected over a telephone to determine whether there were differences in the HRQL between the intervention and control groups. The graphed scores of the intervention group were included in the clinical history of the patient during consultation. Patients and physicians completed the questionnaires on the usefulness of these measurements.
In total, 58 patients participated in this study: 36 in the intervention group and 22 in the control group; 65% of the participants were female, and median age was 59 years (18–79). Regarding patients, 97% found the questionnaires easy to complete and thought that they included important questions. As for oncologists, 68.8% used the information and 87.5% found it useful for the consultation. There were no significant differences in the FACT-G scores between the intervention and control groups.
The routine HRQL assessments using an electronic device prior to the consultations were positively valued by almost all patients and physicians. This could significantly contribute to a better understanding of the patient's overall problems during consultation. These results confirm the benefits of integrating the patient’s self-reported quality of life outcomes into consultations.
Health related quality of life (HRQL) research in oncology has rapidly evolved in the last decades from the initial efforts to develop reliable and well validated measures of symptom burden, well-being, and quality of life, to the inclusion of patient-reported outcomes measures (PROs) in clinical trials, and more recently to the application of PROs in daily clinical practice.
Several studies demonstrated that PROs obtained in an individual level can be used in the patient’s visit to the oncologists to facilitate the detection of physical or psychosocial problems, to monitor disease progression, treatment effectiveness and side effects, to improve patient-doctor communication and to improve the quality of global health care [1,2,3]. Self-reports obtained prior to the consultation may increase the number of topics discussed as well as the quality of global health care even when it may not have a demonstrated impact on the decision-making process [4,5,6,7].
Therefore, the inclusion of standardized questionnaires on the quality of life in clinical practice can help health professionals become acquainted with the assessment of functional and psychosocial problems, thereby contributing to the better management of these issues. Monitoring adverse effects has been highlighted as another source of valuable information from patient reports that can improve the treatment adequacy .
Some critical aspects need to be solved when including PROs in daily clinical practice such as the development of computer-assisted data collecting procedures, including the use of portable devices with audio-visual testing available for patients with visual or reading disabilities, real-time data capture and processing, generation of graphic outputs easily comprehensible to physicians, that can be printed and included in the medical chart during the short period of time that spans from the patient arrival to the clinic to the moment he or she enters the doctor’s office .
The use of computerized patient data collection methods has enabled real-time HRQL measurements and presentation of the results to clinicians, which is a feasible approach in busy daily clinical practice [1, 3, 4, 6]. The patient feedback on the use of these methods has revealed a high degree of acceptance . Chen et al., conducted a review on the implementation of PRO measures in routine oncology practice based on the identification of a set of outcomes . They concluded that there is growing evidence supporting the routine collection of PRO to enable better and patient-centered care, patient-provider communication and improves patient satisfaction, improves the monitoring of treatment response and the detection of the unrecognised problems. However, the evidence was weak for its impact on changes to patient management and improved health outcomes and non-existent for changes to patient health behavior, strong and effective quality improvement, increased transparency, accountability, public reporting and better health care system performance. They suggested that these evidence gaps require further research. In addition to the well-accepted PROs, the application of computer adapted testing, the acceptance of information technology by patients and health professionals, the real-time and routinely collected PROs might enable a more patient-centered health care system.
Another important research gap, as shown in the review, is that the 27 articles identified had been conducted in referral cancer centers in North America, Europe, or Australia, in populations with high socioeconomic status. Therefore, it is very relevant to know how electronic data collection procedures behave in a sample of low-income patients treated at a public university hospital in a South American country. It is highly relevant to include audiovisual evidence of PRO in populations historically excluded from HRQL studies, who are the ones who will experience the impact of cancer and treatments on their general well-being to a greater extent .
The aim of this research was to study, as a primary outcome, the feasibility, acceptance, and utility perceived by patients and oncologists of the inclusion of the patient’s assessments of their HRQL obtained immediately prior to the routine clinical visit, and as a secondary outcome, to evaluate if this information provided to the oncologist may have an impact on the patient’s well-being and the satisfaction with care two months after the first assessment.
It was hypothesized that the application and inclusion of serial HRQL measurements in the oncology clinical practice would be well accepted and considered useful by both patients and oncologists. Secondly, it could cause positive changes in the quality of care, leading to greater patient satisfaction with medical care as well as greater adequacy of medical decisions, better control of symptoms, and better perception of quality of life.
Therefore, we intended to provide a tool to our oncologists for the convenient and reliable measurement of the quality of life of their patients that can be incorporated into their clinical evaluations.
We designed a longitudinal study following the methodology and recommendations proposed by Galina Velikova [4, 6] modified to make it feasible for our medical setting. It included the randomization of patients in two groups, the intervention group consisting of the completion of quality of life questionnaires and providing feedback to doctors as part of medical notes, and a control group that will not complete the quality of life questionnaires in the clinic.
All patients assisted at the Clinical Oncology Department of the Hospital de Clínicas – Universidad de la República, Uruguay between March and July 2017 were invited to participate. The eligibility criteria were patients aged 18 years or older, those with a diagnosis of cancer that could be treated systemically (chemotherapy, hormone therapy, or biological therapies) with a life expectancy of at least 6 months, and those who were starting such treatment or had started it in the last 3 months. Patients with a concurrent medical disease, with cognitive deficits, dementia or with a severe persistent mental illness were excluded.
Sample size calculation was based on a minimal important difference in the FACT-G total score of 10 points (range 0–108 points), an expected standard deviation in each arm of 9 points, a sample size ratio of 1, with 95% confidence interval, and 80% statistical power. Estimated sample size was 41 patients for each study arm.
The following instruments were included in the initial clinical assessment using an electronic device.
The European Organisation for Research and Treatment of Cancer-Quality of Life Questionnaire-C30 (EORTC QLQ-C30) [10, 11] is the HRQL measurement instrument of the European Organization for Research and Treatment of Cancer considered reliable and valid in various linguistic and cultural contexts . It includes 30 items divided into five functional scales (physical, role, emotional, social, and cognitive functioning), three symptom scales (fatigue, pain, and nausea/vomiting), overall health/quality of life scale, and several items assessing additional symptoms (dyspnea, loss of appetite, insomnia, etc.) and the financial impact. The measurement scale ranges from 0 to 100. For the five functional scales and overall quality of life scale, a higher score represents a better level of functioning, whereas for the symptom scales, a higher score indicates a higher level of symptoms.
The Hospital Anxiety and Depression Scale (HADS) [13,14,15] is a brief and reliable self-reported measure of anxiety and depression in hospitalized and ambulatory medical patients, also used in primary care and research, consisting of seven items for anxiety (HADS-A) and seven for depression (HADS-D). The Spanish version of the HADS is available from the publisher (GL Assessement, www.gl-assessment.co.uk).
During the follow-up, The Functional Assessment of Cancer Therapy Questionnaire Spanish Version 4 (FACT-G) was completed through a telephone interview. The FACT-G [16, 17] is comprised of 27 items measuring four dimensions of HRQL using 5-point Likert-type response categories ranging from 0 = 'not at all' to 4 = 'very much’: physical well-being (PWB, 7 items, range 0–28 points), social and family well-being (SFWB, 7 items, range 0–28 points), emotional well-being (EWB, 6 items, range 0–24 points), and functional well-being (FWB, 7 items, range 0–28 points). It provides a FACT-G Total that is the summation of the subscale scores (range 0–108), and a Total Outcome Index score (TOI) that summarizes the PWB and FWB scores. The FACT-G was validated in Uruguay . Higher total and subscale scores represent better quality of life and well-being.
The Visit Specific Doctor Questionnaire and End of Study Doctor Questionnaire (VSD1), a self-reported questionnaire developed by Prof. Galina Velikova from the University of Leeds School of Medicine (personal communication) was used to evaluate the oncologists' perception of the clinical utility of having the patient’s self-reported HRQL information during consultation. It assesses the oncologists’ perception on the utility of the testing in the following areas, providing overall assessment of the patient, providing additional information, confirming knowledge of patient’s problems, identifying issues/problems to be discussed, starting/stopping/changing symptomatic drugs, ordering tests, starting/stopping chemotherapy, referral to psychologist, counselling about lifestyle. All the members of the Oncology Department were invited to participate. The physicians worked in 8 teams with a total of 20 physicians including residents. Different physicians attended the patients during the follow up, so the patients saw different physicians over time.
The battery included an ad-hoc test on patients' satisfaction and potential benefits of the procedure, considering how easy or difficult it was to complete, how time consuming they considered the procedure, whether they were willing to complete the tests at each visit, if the questions were relevant, if they would prefer to answer using the touch screen device or to have the questions read out in an interview. It also included a list of clinical and sociodemographic data.
The research design made necessary to develop two software applications. One uses an iPad® device that captures the information from patients (audiovisual computer-assisted testing software or AVCT) and send it through the Internet, and a web-based application. Screenshots of how the questions looked from the patient’s perspective are shown as Additional File 2, Additional File 3 and Additional File 4. The graphical presentation of results to the clinicians are shown in detail as Additional File 1.
The software also includes optional audio recordings to be used by people with low reading skills or visual limitations. The web application used PHP5 as programming language, PostgreSQL for database, and Apache2 as web server. This application receives the information from patients and doctors, calculate scores, generate graphic reports on PDF format of the several indicator or dimensions of the questionnaires.
To ensure variability, data collection was performed on two different days of the week. The patients approached were cared for by different treatment teams that included members of the teaching staff and residents. The patients were randomized into two groups: an intervention group that completed a set of HRQL questionnaires using a touch-screen device with a telephone follow-up and a control group that did not respond to any questionnaires at the start of the study but only to a telephonic follow-up survey.
The measurements for the patients in the intervention group were conducted in the waiting room before the consultation with the oncologist on two different occasions: at the time of inclusion in the study (T1) and at 2 months (T2). The EORTC QLQ C-30 and the HADS were responded at every time.
The follow-up measurement was conducted over the telephone for both groups using the FACT-G questionnaire. It was conducted within 48 h after the measurement at T2 for the intervention group and 2 months after signing the informed consent form for the control group.
A descriptive analysis was performed to calculate the frequencies for the qualitative variables and measures of dispersion for the continuous variables. The statistical t-test for paired samples was applied to study the differences between the two measurement times in the intervention group. The difference in the means of the measurements of the quality of life between the intervention and control groups (FACT-G) was studied using the t-test for independent samples. All analyses were evaluated at a significance level of 0.05.
The number of patients approached and the description of the sample at baseline and follow-up are shown in Fig. 1. In total, 58 patients participated in this study: 36 in the intervention group at the time of recruitment and 22 in the control group at the follow up (Time 2). Of the total participants, 65.5% (n = 38) were female, with mean age of 59 years, range: 18–79. The sociodemographic and clinical characteristics of the sample are presented in Table 1.
Regarding the utility and acceptance of the use of the touch screen by patients at T1, 97.1% of the patients considered it “easy” and “very easy” and that the questions were important, 48.6% supported the use of the touch screen, 31.4% responded that the methods were “the same,” and 20% preferred having a person read the questions to them.
The VSD1 questionnaire was completed by 16 physicians (oncologists and residents) at T1 and T2. The responses are presented in Table 2. Notably, 75% of the physicians did not know or only partly knew the patient at the time of the first interview, 68.8% used the questionnaire information, and 87.5% responded that they found the information useful during the consultation.
When asked in what aspects was the survey useful, the best ratings were obtained by: providing overall assessment of the patient (93%), and providing additional information (62.5%); the best rated contribution to management was the request for mental health consultation by psychologist (31.3%) followed by stopping or changing symptomatic drugs (18.7%) (Table 2). Almost 69% considered that the survey did not prolonged the interview or even helped to shortened it. Comparing the first and second evaluation, the survey was still considered useful by the majority of doctors (68.8%) and provided significant clinical information for 75% of them.
The scores of the questionnaires are presented in Tables 3 and 4. No significant differences were observed in the EORTC QLQ-C30 Global Health Index, subscale and symptom scores at T1 versus T2. Similar results were observed in the HADS Anxiety and Depression mean scores.
The results of the FACT-G questionnaire are presented in Table 4. Higher scores in the FACT-G Subscale and Total Scores were observed in the ratings of the intervention group compared with the controls, but these differences were not statistically significant.
Several studies have shown that an electronic data collection method is easy, fast, reliable, and acceptable to patients, which are all important factors for integrating the measurements of the quality of life into daily oncology practice [8, 19,20,21]. Most, if not all, of these studies have conducted in references centers of high income countries. To our knowledge this is the first study of its kind in a middle-income South-American country, addressing Spanish-speaking patients of a public hospital.
In our study, the patients showed high compliance with the assessment of the HRQL aspects during routine medical consultations, and the patients appreciated that the physicians consider such assessments. More than 95% of the patients considered that the questionnaires included important questions and were willing to complete them prior to each medical consultation. Moreover, there was good acceptance for completing the questionnaires using a touch screen, which the patients found easy and convenient. However, 20% of the patients still preferred having another person read the questions to them. This could be attributed to the high percentage of elderly people in our population with no previous experience of using this type of portable equipment.
In general, the physicians showed very good acceptance for incorporating the HRQL into their daily clinical practice. The use of the HRQL information contributed to a better understanding of the patients and their problems, supporting decision-making in the consultation for treatment changes, and referral to mental health specialists. The time of consultation was not measured in our study, only the physician’s perception on the length of the consultation was registered. However, the majority of the oncologists perceived that having the graphical output of the measures did not prolonged the consultation time, specially at T2. For these doctors having PRO results might improve the effectiveness and efficiency of the consultation. However, a substantial proportion of oncologists reported it lengthened the encounter (31.3% at T1 and 25.4% at T2). This is a relevant issue since the acceptance by physicians is a key aspect for the implementation of the PROs, and probably requires more training for the rapid reading and interpretation of the results in easy-to-use graphic formats and with clear criteria on the clinical significance of the scores.
The results of the physician questionnaires showed that the HRQL information during the consultation was more useful in T1 than in T2. Although physicians knew their patients better in the second interview, previous studies also showed a positive impact on the doctor-patient relationship [3, 6, 22].
Regarding the second hypothesis, the intervention based on the HRQL assessments included in daily clinical practice did not have a positive impact on the patients’ quality of life as measured by the FACT-G questionnaire two months after the first assessment. However, it is expected that changes in the quality of life appear later over the course of treatment, especially after completing the active treatment; hence, it would be necessary to extend the follow-up time and conduct new assessments.
As proposed by different HRQL researchers worldwide, future efforts should be directed at improving the flexibility and accuracy of the HRQL assessments and at linking patients' HRQL scores to specific treatment and care strategies. In this sense, some centers have described their experiences on how to integrate the quality of life outcomes that are regularly self-reported by oncology patients through a web application or telephone system [23,24,25]. Furthermore, a randomized study of patients with disseminated disease undergoing chemotherapy suggests a positive impact on patient survival upon integration of such outcomes . Despite the potential benefits, there are several challenges for integrating this information into clinical practice as with any other change in the existing clinical processes .
This study has several limitations, such as the small sample size of a single cancer center, diversity of patients in terms of diagnosis and stage, and short follow-up period, and infrequent measurements. The sample size was not reached due to difficulties in the logistics of the data collection procedure during the planned time of the investigation, such as a slower accrual of patients than anticipated, that exceeded the possibilities of control of the research team. We agree that this is a limitation of the study, as it could have an impact on the significance of the results at Time 2. However, we believe that these results provide clear guidance on the design and implementation of future studies in this area. As the intervention measurements were made only at two points two months apart, and not at each chemotherapy visit that is expected to be every three to four weeks. Since the outcome measure, FACT-G, was completed only at time 2, two months after study entry, and there is no baseline data, it is possible that the two groups of patients had different baseline measures, despite randomization. This is one potential explanation to the lack of effect on patient well-being.
However, it should be noted that as a result of our study, a computer application was developed consisting of a program for computerized audiovisual testing using a touch-sensitive screen, which included validated instruments for measuring the quality of life. This program can be implemented for clinical evaluation in other cancer centers in the country, as well as in clinical research that includes the patient's perspective as an additional outcome variable.
The inclusion of routine HRQL assessments in daily oncology practice using a touch screen was positively valued by almost all patients and a majority of oncologists. Moreover, it had a favorable impact during the consultations by providing the physician with information about the general problems of the patient, regarding the effect of the oncological disease and its treatments on the physical, functional, psychological and social wellbeing of the patient. Using this measurement procedure on a regular basis may lead to improved therapeutic interventions in our clinical setting as was reported in major western cancer centers.
Availability of data and materials
The datasets used and/or analyzed during the current study are available from the corresponding author on reasonable request.
- EORTC QLQ-C30:
European Organisation for Research and Treatment of Cancer-Quality of Life Questionnaire
- FACT G:
Functional Assessment of Cancer Therapy Questionnaire Spanish Version 4
Hospital anxiety and depression
Velikova’s Visit Specific Doctor Questionnaire and End of Study Doctor Questionnaire
Velikova G, Wright P, Smith AB, Stark D, Perren T, Brown J et al (2001) Self-reported quality of life of individual cancer patients: Concordance of results with disease course and medical records. J Clin Oncol 19(7):2064–2073
Velikova G, Brown JM, Smith AB, Selby PJ (2002) Computer-based quality of life questionnaires may contribute to doctor-patient interactions in oncology. Br J Cancer 86(1):51–59
Detmar SB, Muller MJ, Schornagel JH, Wever LDV, Aaronson NK (2002) Health-related quality-of-life assessments and patient-physician communication: a randomized controlled trial. J Am Med Assoc 288(23):3027–3034
Espallargues M, Valderas JM, Alonso J (2000) Provision of feedback on perceived health status to health care professionals: a systematic review of its impact. Med Care 38(2):175–186
Detmar SB, Muller MJ, Schornagel JH, Wever LDV, Aaronson NK (2002) Role of health-related quality of life in palliative chemotherapy treatment decisions. J Clin Oncol 20(4):1056–1062
Velikova G, Booth L, Smith AB, Brown PM, Lynch P, Brown JM et al (2004) Measuring quality of life in routine oncology practice improves communication and patient well-being: a randomized controlled trial. J Clin Oncol 22(4):714–724
Velikova G, Awad N, Coles-Gale R, Wright EP, Brown JM, Selby PJ (2008) The clinical value of quality of life assessment in oncology practice: a qualitative study of patient and physician views. Psychooncology 17(7):690–698
Chen J, Ou L, Hollis SJ (2013) A systematic review of the impact of routine collection of patient reported outcome measures on patients, providers and health organisations in an oncologic setting. BMC Health Serv Res 13:211
Hahn EA, Cella D (2003) Health outcomes assessment in vulnerable populations: Measurement challenges and recommendations. Arch Phys Med Rehabilitat 84:S35–S42. https://doi.org/10.1053/apmr.2003.50245
Aaronson NK, Ahmedzai S, Bergman B, Bullinger M, Cull A, Duez NJ et al (1993) The European organization for research and treatment of cancer QLQ-C30: a quality-of-life instrument for use in international clinical trials in oncology. J Natl Cancer Inst 85(5):365–376
Groenvold M, Klee MC, Sprangers MAG, Aaronson NK (1997) Validation of the EORTC QLQ-C30 quality of life questionnaire through combined qualitative and quantitative assessment of patient-observer agreement. J Clin Epidemiol 50(4):441–450
Wintner LM, Sztankay M, Aaronson N, Bottomley A, Giesinger JM, Groenvold M et al (2016) The use of EORTC measures in daily clinical practice: a synopsis of a newly developed manual. Eur J Cancer 68:73–81
Zigmond AS, Snaith RP (1983) The hospital anxiety and depression scale. Acta Psychiatr Scand 67(6):361–370
Snaith RP, Zigmond AS (1986) The hospital anxiety and depression scale. Br Med J 292(6516):344–344. https://doi.org/10.1136/bmj.292.6516.344
Bjelland I, Dahl AA, Haug TT, Neckelmann D (2002) The validity of the hospital anxiety and depression scale: an updated literature review. J Psychosom Res 52(2):69–77
Cella DF, Tulsky DS, Gray G, Sarafian B, Linn E, Bonomi A et al (1993) The functional assessment of cancer therapy scale: development and validation of the general measure. J Clin Oncol 11(3):570–579
Cella D, Hernandez L, Bonomi AE, Corona M, Vaquero M, Shiomoto G et al (1998) spanish language translation and initial validation of the functional assessment of cancer therapy quality-of-life instrument. Med Care 36(9):1407–1418
Dapueto JJ, Francolino C, Servente L, Chang C-H, Gotta I, Levin R et al (2003) Evaluation of the functional assessment of cancer therapy-general (FACT-G) Spanish Version 4 in South America: classic psychometric and item response theory analyses. Health Qual Life Outcomes 20(1):32
Velikova G, Wright EP, Smith AB, Cull A, Gould A, Forman D et al (1999) Automated collection of quality-of-life data: a comparison of paper and computer touch-screen questionnaires. J Clin Oncol 17(3):998–1007
Taenzer PA, Speca M, Atkinson MJ, Bultz BD, Page S, Harasym P et al (1997) Computerized quality-of-life screening in an oncology clinic. Cancer Pract 5(3):168–175
Taenzer P, Bultz BD, Carlson LE, Speca M, DeGagne T, Olson K et al (2000) Impact of computerized quality of life screening on physician behaviour and patient satisfaction in lung cancer outpatients. Psychooncology 9(3):203–213
McLachlan SA, Allenby A, Matthews J, Wirth A, Kissane D, Bishop M et al (2001) Randomized trial of coordinated psychosocial interventions based on patient self-assessments versus standard care to improve the psychosocial functioning of patients with cancer. J Clin Oncol 19(21):4117–4125
Snyder C, Smith K, Holzner B, Rivera YM, Bantug E, Brundage M et al (2019) Making a picture worth a thousand numbers: recommendations for graphically displaying patient-reported outcomes data. Qual Life Res 28(2):345–356
Basch E, Barbera L, Kerrigan CL, Velikova G (2018) Implementation of patient-reported outcomes in routine medical care. Am Soc Clin Oncol Educ B 38:122–134
Furlong E, Darley A, Fox P, Buick A, Kotronoulas G, Miller M et al (2019) Adaptation and implementation of a mobile phone–based remote symptom monitoring system for people with cancer in Europe. JMIR Cancer 5(1):e10813. https://doi.org/10.2196/10813
Basch E, Deal AM, Dueck AC, Scher HI, Kris MG, Hudis C et al (2017) Overall survival results of a trial assessing patient-reported outcomes for symptom monitoring during routine cancer treatment. JAMA 318(2):197–198
Kotronoulas G, Kearney N, Maguire R, Harrow A, Di Domenico D, Croy S et al (2014) What is the value of the routine use of patient-reported outcome measures toward improvement of patient outcomes, processes of care, and health service outcomes in cancer care? A systematic review of controlled trials. J Clin Oncol 32(14):1480–1501
We thank Dr. Ramón Álvarez, and the nursing and administration staff of the Department of Oncology, Hospital de Clínicas, Udelar for their support.
The study was partially supported by the Honorary Commission Against Cancer–Uuguay (Comisión Honoraria de Lucha contra el Cáncer–Uruguay).
Ethics approval and consent to participate
The study was approved by the Ethics Committee of the Hospital de Clínicas, Udelar. All participants signed an informed consent form before being included in the study. All procedures followed were in accordance with the ethical standards of the responsible committee on human experimentation (institutional and national) and with the Helsinki Declaration of 1975, as revised in 2008.
Consent for publication
The co-authors have no competing interests to declare.
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
About this article
Cite this article
Castillo, C., Alfonso, A.L., Dapueto, J.J. et al. Inclusion of information technology-based assessments of health-related quality of life in routine oncology practice in Uruguay. J Patient Rep Outcomes 6, 65 (2022). https://doi.org/10.1186/s41687-022-00458-7
- Quality of life
- Patient reported outcomes
- Clinical practice