Skip to main content

Patient motivators of postoperative electronic patient-reported outcome symptom monitoring use in thoracic surgery patients: a qualitative study

Abstract

Background

Electronic patient-reported outcome (ePRO) systems can be used to engage patients in remote symptom monitoring to support postoperative care. We interviewed thoracic surgery patients with ePRO experience to identify factors that influenced use of ePROs to report their symptoms post-discharge.

Method

This qualitative study used semi-structured telephone interviews with adults who underwent major thoracic surgery at an academic medical center in North Carolina. Individuals who enrolled in symptom monitoring, completed at least one ePRO survey, and were reachable by phone for the interview were included. The ePRO surveys assessed 10 symptoms, including validated Patient-Reported Outcome Common Terminology Criteria for Adverse Events (PRO-CTCAE) measures and thoracic surgery-specific questions. Surveys, offered via web-based and automated telephone options, were administered for four weeks post-discharge with alerts sent to clinicians for concerning symptoms. The interviews were guided by the Capability, Opportunity, Motivation model for behavior change (COM-B) and examined factors that influenced patients’ completion of ePRO surveys post-discharge. Team members independently coded interviews and identified themes, informed by COM-B. We report descriptive statistics (demographics, number of surveys completed) and themes organized by COM-B components.

Results

Of 28 patients invited, 25 (89%) completed interviews from July to October 2022. Participants were a median 58 years, 56% female, 80% White, and 56% had a history of malignancy. They completed 131/150 (87%) possible ePRO surveys. For capability, participants reported building ePROs into their routine and having the skills and knowledge, but lacking physical and emotional energy, to complete ePROs. For opportunity, participants identified the ease and convenience of accessing ePROs and providers’ validation of ePROs. Motivators were perceived benefits of a deepening connection to their clinical team, improved symptom management for themselves and others, and self-reflection about their recovery. Factors limiting motivation included lack of clarity about the purpose of ePROs and a disconnect between symptom items and individual recovery experience.

Conclusions

Patients described being motivated to complete ePROs when reinforced by clinicians and considered ePROs as valuable to their post-discharge experience. Future work should enhance ePRO patient education, improve provider alerts and communications about ePROs, and integrate options to capture patients’ complex health journeys.

Plain English summary

People who undergo thoracic surgery often experience pain and other symptoms while recovering at home. These symptoms can be severe and may reduce overall quality of life and potentially result in some patients returning to the hospital for future treatment. Electronic Patient-Reported Outcomes can be used as a method for having patients regularly track and report any symptoms they experience while at home, and how severe those symptoms are, using digital technology such as an online survey or automated phone survey. Surgical care team members may then follow up with patients about their symptoms. More information was needed about the patient experience with completing these surveys about their symptoms. In this study, we interviewed patients who had completed Electronic Patient-Reported Outcomes after thoracic surgery to understand what may (or may not) have impelled them to participate and to learn how to improve the use of these surveys for patients. This study found that patients generally felt they were able to complete the symptom surveys. Key motivators included feeling more connected to their surgeon by completing the symptom surveys and having the opportunity to reflect on how their recovery was going at home. However, patients also discussed not having a clear understanding of the purpose of the symptom surveys and how their responses might affect their care. The study findings highlight the need for improved patient education and indicate that improvements to the survey questions and to how surgeons review patients’ responses may be needed.

Background

Thoracic surgery, which is performed approximately 530,000 times annually in the United States, is associated with high symptom burden that may persist beyond the acute postoperative recovery period, including pain, fatigue, and dyspnea [1,2,3,4,5,6]. For example, an estimated one-third of patients experience chronic pain following minimally-invasive thoracic surgery [5], and approximately 60% of patients report dyspnea following lung cancer resection, with persistently more severe dyspnea one year post-surgery [67]. Failure to promptly manage symptoms during the postoperative period may lead to diminished quality of life or increased readmission rates [2, 8].

Digital health technologies, such as electronic patient-reported outcome (ePRO) systems, can be used to engage patients in remote symptom monitoring to support their postoperative care [10]. Extensive prior research has generated a set of valid and reliable PRO measures [11,12,13,14]. Earlier research has demonstrated the clinical utility of ePRO systems [1516] and the potential for improved data quality with ePROs compared to paper and pen [17]. Documented benefits of ePRO symptom monitoring include symptom control, reduced complications, fewer emergency room visits and hospitalizations, and improved health-related quality of life among diverse surgical and cancer patient populations [9, 16, 18,19,20,21]. Additional advantages include improved patient-provider communication and increased patient agency in their recovery process [15].

In a previous study on the impact of ePRO monitoring on quality of life (“Thoracic Surgery Patient-Reported Outcomes,” [TSPRO 1.0, NCT04342260]), we enrolled thoracic surgery patients in postoperative symptom monitoring via a web-based ePRO platform and qualitatively assessed a subset of patients’ barriers and facilitators to survey completion [22]. Facilitators included the ease of using the platform and increased awareness of their own symptoms. Barriers to ePRO use included lack of email access, poor physical and mental health particularly in the early days after returning home, and lack of clarity about the value of ePRO use within clinical care.

In the current study (TSPRO 2.0; NCT05311670) [23], we implemented four types of design changes to address these barriers to completing ePROs. First, while surveys were previously administered via a web-based platform alone, we added an automated telephone option (interactive voice response or IVR) to minimize digital technology and connectivity gaps [14]. Second, we revised the survey schedule to be less frequent, changing from daily surveys to twice a week, to minimize patient burden and nonadherence in a period characterized by high pain and symptoms. Third, we reduced the number of survey items from 15 to 10 to minimize burden and eliminate symptoms with low prevalence. Lastly, we disseminated brochures to patients about why ePROs are collected.

Here, we build on our prior work and use interviews with patients to learn about their experiences with our design changes. Guided by the Capability, Opportunity, and Motivation Model for Behavior Change (COM-B) [24], we explored the factors influencing their initial uptake of and ongoing engagement with ePRO symptom monitoring.

Methods

The parent study, TSPRO 2.0, evaluated the implementation of ePROs postoperatively as part of research tied to routine care delivery. In this study, we qualitatively assessed patient motivators of ePRO use in the context of a large academic public hospital in North Carolina. The University of North Carolina at Chapel Hill (UNC) Institutional Review Board approved these studies.

Inclusion/exclusion criteria

Inclusion criteria were having recently undergone a major thoracic surgery including chest wall incisions and overnight admission and being 18 years or older, able to understand and speak English, and able to complete web-based or telephonic symptom surveys postoperatively. Exclusion criteria were being pregnant or currently incarcerated, planning to undergo foregut surgery, and being unable to provide informed consent due to dementia, altered mental status, or a psychiatric condition. Recruitment occurred in-person in the postoperative wards or clinic. For this qualitative analysis, we added the inclusion criteria of completing at least one (out of six) postoperative ePROs and being reachable by phone.

ePRO symptom monitoring

Figure 1 summarizes study participation for the parent study and patient interviews. Forty (74%) of 56 eligible patients who were invited to participate enrolled in the parent study and were administered six ePRO symptom surveys over a four-week period during recovery, twice weekly for two weeks and then once weekly for two weeks. We selected this schedule to capture symptoms more frequently during the first two weeks post-discharge, while reducing the overall number of surveys in response to patient feedback on survey burden.

Fig. 1
figure 1

Schematic of recruitment and study activities for TSPRO 2.0 parent study and qualitative sub-study. We report the number of individual patients who participated in each of these activities. Fifty-six patients were invited to participate in remote symptom monitoring via ePRO symptom surveys in our TSPRO 2.0 parent study. Of the 56 invited patients, 40 consented to participate in TSPRO 2.0. Of the 40 enrolled patients, 25 completed an individual interview about their experience with ePRO symptom monitoring.

Participants had two options for completing ePROs: (1) an existing web-based platform accessed via computer or smartphone or (2) IVR (automated telephone calls). Automated reminders were sent via email to those who selected the web-based option and by scheduled, automated phone call for those who selected IVR. A study coordinator followed up with patients who missed two surveys.

Each ePRO symptom survey contained 10 items assessing the frequency and severity of symptoms associated with thoracic surgery including pain, shortness of breath, and cough, along with an option to write-in additional concerns. Most items were selected from validated and reliable National Institutes of Health (NIH) Patient-Reported Outcome Common Terminology Criteria for Adverse Events (PRO-CTCAE) measures [11,12,13,14]. To tailor symptom monitoring to our population, we included a few items specific to post-surgical care such as redness or discharge at the incision site. We collaborated with UNC’s Patient-Reported Outcomes Core (PRO Core), which provides scientific support with administering and managing ePROs within cancer research, to program the selected symptom items into their PRO Core system [25]. While ePROs were not integrated into the electronic health records (EHR), alerts were generated if the patient reported severe or worsening symptoms, or utilized the free-text field, and sent electronically to the patient’s surgical team via the EHR. The surgical team was directed to review and contact the patient as needed per routine clinical workflow.

Interviews

Interview participants were considered if they had completed at least one of six ePROs. Because there was relatively high adherence, we defined low adherence as completing less than 80% of offered surveys, and ensured representation of patients with low adherence among those interviewed. Interviews were conducted until thematic saturation was achieved.

The study team contacted participants by phone to invite them to participate in an individual interview about their symptom monitoring experience. Interviews, which lasted approximately 30–45 min, were conducted by phone to improve ease for patients who were in the postoperative recovery period and, thus, potentially still experiencing high symptom burden. We used semi-structured interviews to gain an in-depth understanding of factors that influenced patients’ engagement with ePRO symptom monitoring from when they were approached about symptom monitoring through completion of ePROs. Qualitative researchers (MBV, JC) from the UNC Connected Health for Applications & Interventions (CHAI) Core conducted interviews. Participants received a $25 gift card for their time.

Frameworks

The interview guide (Supplemental File 1) was informed by the COM-B framework [24]. Questions focused on patients’ experiences completing the symptom surveys (which we considered a type of behavior change), including whether they had the knowledge and abilities to complete ePROs (capability), what factors supported ePRO completion (opportunity), and what impelled them to complete (or not complete) ePROs (motivation). Additionally, we had an emerging theme code for topics that were most important to patients.

In the analysis phase, we integrated the Theoretical Domains Framework (TDF) [26], a framework for understanding barriers and facilitators to behavior change that has previously been used with COM-B [27,28,29]. We added this framework to establish continuity in how we defined the COM-B components (Fig. 2).

Fig. 2
figure 2

Integration of COM-B Components and TDF Domains. This figure shows how our identified themes (see Table 2) map onto the COM-B components and TDF domains.

Qualitative analysis

Interviews were audio-recorded, transcribed by a professional transcription service, and de-identified. We (MCO, MBV, JC, JL, GNM) co-developed an initial codebook based on the interview questions and data collection notes, and pilot-tested it by independently coding a subset of transcripts. During this iterative process, we fine-tuned concept definitions, revised decision rules, and ensured replicability across coders. We (MCO, MBV, JC) then applied the final codebook (Supplemental File 2) to the remaining transcripts. Coding was performed using the software Dedoose. Standard consensus coding guidelines [30, 31] were followed, where any emerging theme or discrepancy was captured and reconciled through discussion. We (MCO, MBV, JC) reviewed individual Dedoose-generated code reports and, for each code, prepared a narrative description of the identified themes and subthemes and included illustrative quotes. Finally, using our combined COM-B/TDF framework, we (MCO, GNM, JL) further refined and organized themes and subthemes by COM-B component.

Quantitative analysis

We report descriptive statistics including patient demographics (age, sex, race/ethnicity), surgical history (surgery type, history of malignancy), postoperative events (complications or readmissions within 30 days), and ePRO completion (modality, number of symptom surveys completed). Demographic and clinical variables were determined using EHR data with clinical outcomes reviewed by the surgeon on our team. Median and interquartile ranges are reported where applicable.

Results

Demographic and clinical characteristics

Table 1 summarizes the characteristics of the 25 thoracic surgery patients who completed interviews. Participants had a median age of 59 (interquartile range: 20.5). The cohort was comprised of 56% females, 80% non-Hispanic White individuals, and 12% non-Hispanic Black individuals. More than half (56%) had a history of lung cancer or another type of malignancy. More participants had completed minimally invasive surgery (60%) than open surgery (40%). Twenty (80%) participants completed ePROs via the web-based platform and 5 (20%) via IVR. Of the 150 possible surveys offered, 131 (87%) were completed across participants, a median of 6 surveys per interviewee (interquartile range: 1).

Table 1 Characteristics of interview participants

Interview themes

Nine themes were identified related to the capability, opportunity, and motivation to engage in symptom monitoring postoperatively. Table 2 provides additional quotes by theme. Figure 2 illustrates how each theme aligns with the COM-B components and corresponding TDF domains.

Table 2 Themes related to the capability, opportunity, and motivation for ePRO symptom monitoring among postoperative thoracic surgery patients (n = 25)

Capability

Participants overwhelmingly described having the knowledge and skills to complete the surveys (theme 1). Describing the surveys as “straightforward” and “easy” to complete, participants generally reported being able to understand the symptom questions and how to respond. One participant explained, “It’s just multiple choice, very easy. It’s focused on my symptoms, my particular situation, so no challenges completing the survey itself” (Patient 20). Participants reported knowing how to access new surveys, and remembering to complete them on their own or with the help of automated reminders. Most participants recalled receiving at least one reminder about the surveys and indicated that the reminder did typically nudge them to complete the survey. Seven participants reported that they either did not receive a reminder, likely because they promptly completed each survey, or found them unnecessary because they could remember on their own or did not want additional emails.

While participants largely agreed they were capable of completing surveys, a few shared that survey completion required emotional and physical energy (theme 2). This included the emotional toll of being reminded about their surgical experience. One participant said completing ePROs “was a constant reminder of what I’ve been through…I had my moments where I felt depressed…I went through all those emotions while being in the hospital…to have to keep reliving what I’ve been through was torture at times” (Patient 17). Completing ePROs also required patients to expend time and energy that could otherwise be focused on recovery. “I had increased pain issues post-op, so my goal was to focus on my own physical symptoms and managing those day-to-day, not completing the questionnaire” (Patient 14). Although this theme was mentioned by a small subset of participants, it was salient to those who reported needing to prioritize between completing the surveys and focusing on their recovery in other ways.

Participants reported being able to build ePRO symptom monitoring into their regular routines (theme 3). One participant explained, “I accepted it as part of my routine, so there wasn’t any issue with doing it. It wasn’t a burden for me” (Patient 15). This routinization of symptom monitoring included integrating the surveys into morning routines or regular screen time.

Opportunity

With respect to the social and environmental factors that facilitated survey completion, participants acknowledged the ease of the ePRO interface and format (theme 4). Participants pointed to the multiple-choice format of the survey items, low number of survey questions, and consistency of questions across surveys as facilitators. Several participants stated that this structure allowed each survey to be completed quickly (usually 5 minutes or less). Web-based survey users noted the convenience of accessing the survey via the online platform when they were ready. One participant explained, “When I was havin’ a good moment, I would fill out that survey. Convenience was a great thing with that” (Patient 21). However, one participant experienced some local connectivity issues, and another experienced a challenge distinguishing between new versus previously completed surveys. IVR users reported no connectivity issues. One explained: “[IVR] was easier for me because I can use a computer, but sometime, when I’m usin’ it, I get most of my stuff wrong, incorrect…the phone was easier” (Patient 19).

In terms of social influences, participants described their providers’ involvement as helping to legitimize the importance of ePRO completion (theme 5). This included any type of acknowledgement of symptom monitoring by a member of the clinical team. Even when participants were unclear on how their surgeon and other clinicians were directly involved with ePROs, having an understanding that they were supportive of ePROs made participants feel comfortable completing the surveys. “The way I felt about [my doctor] and the way I felt comfortable with [them and their] whole staff, I felt comfortable to…do the questionnaire” (Patient 16). In this way, ePROs were viewed as connected to routine care because they were endorsed in some way by providers.

Motivatio

Participants described three ways that they benefited from ePRO monitoring and that motivated them to complete symptom surveys (theme 6). First, many participants were motivated by a deepening connection with their surgical team that they experienced by engaging in ePROs (theme 6a). They described feeling less alone and “being seen” by their providers after receiving follow-ups to their survey responses. One patient said, “Even though I wasn’t there, they were still monitoring me through whatever I had answered…I felt that they were always there at my fingertips to help me” (Patient 24). Having a way to experience the care they previously received in the hospital in their own homes motivated patients. “…it was like having my medical team still asking, is this okay? Is that okay? Are you doing this? Are you doing that? Having that continuation gave me a sense of security” (Patient 3). This sense of accompaniment was identified as a strong motivator for ongoing ePRO participation among those who received a direct follow-up.

Second, several participants provided specific examples of how symptom monitoring improved their care—whether by addressing a complication or managing a particular symptom (theme 6b). For example, one participant shared that a member of their clinical team located them in the hospital waiting for an unrelated appointment to inspect their incision, which they had reported some concerns about via a symptom survey. Other participants recalled talking through a particular symptom, such as pain or shortness of breath, with a clinician by phone in response to their survey. “What I did like that happened a couple times, depending on the answers I put down—somebody from the thoracic team did call me to follow up on my symptoms” (Patient 13). Participants described these calls as an opportunity to elaborate on and receive support with their symptom burden.

Third, participants reported being motivated to engage in the self-reflection afforded by symptom monitoring (theme 6c). Completing the surveys at multiple time points allowed patients to track their recovery progress over time and have dedicated time to reflect on how their symptoms were changing. One participant noted that symptom monitoring was “just helping keep me honest to look out for symptoms and me being aware” (Patient 11). Participants described setting expectations for recovery based on the symptoms included in ePROs. The surveys acted as a type of checklist for common symptoms to watch out for during recovery and a way to self-assess whether their symptoms were improving or declining.

In addition to the individual benefit of ePROs, participants were motivated by the potential to improve care for thoracic surgery patients more broadly (theme 7). Some participants described wanting to ensure that their providers understood the full health journeys that patients experience at home during recovery. One participant explained, “I just think it’s important for a doctor or whoever to know what you go through when you go home and what symptoms you’re having and whatnot, so they can better understand” (Patient 25). Others described being motivated to complete the surveys so that their providers could use the information learned about symptom trajectories and complications to improve treatment and better set expectations for other patients. Even outside of the research context, participants viewed symptom monitoring as an opportunity to contribute to healthcare innovation to improve surgical care for all patients.

Participants also reported factors that made them less motivated to complete symptom monitoring. Some participants found that the survey items failed to capture their individual experiences (theme 8). “I think some of the answers that choices could have been a little more fine-tuned…I had to just sort of pick the best one, but it wasn’t necessarily the best one for me.” (Patient 12). This was due, in part, to limited response options for each survey item (e.g., 4-point Likert scales ranking symptom severity) or inclusion of symptoms that participants had not experienced during recovery. Another participant noted that the ePROs generated follow-ups from the clinical team for symptoms they did not perceive to be of concern. Participants also perceived less value in the surveys for addressing more complex health experiences.

Motivation was also hindered when participants were unclear about the purpose of completing ePROs and how their responses would be used (theme 9). Multiple participants reported that they did not know whether or how their clinical team might use the information reported in their surveys. Some expected their responses to be used for research purposes only and were unaware of their connection to clinical care. A participant explained, “I would have been more detailed and provided more information and maybe not have clicked through them as quickly if I knew that somebody was really monitoring that and would act based on what I was putting in there” (Patient 23). A patient who completed only one of the surveys described difficulty in understanding and remembering the objective: “I can’t remember no one talkin’…I can’t say that they didn’t call or they did. I just can’t really remember” (Patient 4). Regardless of level of ePRO adherence, participants commonly reported a need for improved education about the purpose of remote symptom monitoring upfront to improve motivation.

Discussion

In this qualitative analysis, we found that thoracic surgery patients generally felt they had the capability, opportunity, and motivation to complete ePROs post-discharge. Participants appreciated being more connected to the surgical team while recovering at home, the attention to their concerning symptoms (whether through self-reflection or clinician follow-up), and found the process of completing ePRO symptom surveys to be relatively simple. Challenges affecting capability and motivation for some patients to complete ePROs included the added effort during a difficult recovery process, lack of fit of the symptom items assessed, and uncertainty about the intent.

Participants who were contacted by a provider following an alert overwhelmingly identified this as a positive experience that fostered their relationship with the care team and provided them with clinical benefit. This experience reinforced their motivation to complete subsequent ePROs because they had seen the value of ePROs to their care experience. Notably, while the benefits of PRO-based care, such as helping to improve patient-provider consultations during future visits, have been documented in other settings [3233], studies have also shown that some patients felt a disconnect from the health system when they received no response or a superficial response [34] and concern that they would be forgotten in the digital system [35]. In our study, patients who did not receive a clinician follow-up, likely because they did not have alert-generating symptoms, did not report this type of disconnect. However, they commonly reported not knowing if or how their responses were reviewed or used by their clinical team. Improved education is needed upfront to set clearer expectations about how ePRO survey responses may be used, by whom, and under which circumstances they may receive a follow-up contact from their providers. Design changes like providing feedback to patients that their ePROs have been reviewed may also be considered.

This study was designed to iteratively assess design changes informed by our prior qualitative inquiries in ePRO patient participants. Adding the IVR modality appeared to reduce a previously reported connectivity barrier, as those who selected this option did not report issues accessing the surveys and lack of technology access was no longer a reported reason for ineligibility to the parent study. Excluding survey items shown to be uncommon for generating alerts among thoracic surgery ePRO participants seemed to reduce reports of redundancy in the ePRO questions. However, despite reducing the survey frequency and length, participants continued to report a barrier of diminished energy during the postoperative recovery process.

This analysis raises some important considerations regarding scalability of postoperative ePROs. For example, we found that reminders were an important facilitator of ePRO completion, echoing prior research [3637]. Most participants were responsive to ePRO reminders, but some required a follow-up call from the study coordinator and implementing these direct, personalized reminders may be difficult on a larger scale. We think it will be important to use automated responses to increase adherence as a first attempt and identify who on the clinical team might be tasked with direct reminders. Patient navigators may be uniquely positioned for this activity, as ePROs are one way to get a better sense of how patients are doing and personalize their care [3839]. For patients who are non-responsive to ePROs, navigator calls may provide a critical touchpoint.

More consideration is needed regarding the level of integration of ePROs within our health system’s EHR. We used an external system for ePROs requiring program staff to ensure alerts were sent to clinicians. This approach is potentially less efficient as we work to scale up the use of ePROs within clinical care. However, it allows for increased customization of the ePROs and reports, which is important as we learned in this study the need for an adaptive ePRO process that best fits individuals’ unique recovery experiences. To address these types of tradeoffs, the Symptom Management Implementation of Patient-Reported Outcomes in Oncology (SIMPRO) consortium summarized the advantages and disadvantages of freestanding ePRO systems, external systems that interface with the EHR, or fully integrated ePRO/EHR systems [40]. We are currently exploring avenues with respect to the level of integration of ePROs within our EHR, recognizing that there is still uncertainty in the preferred approach.

Patients’ feedback on their experiences completing ePROs suggests opportunities to improve remote symptom monitoring. Despite introducing brochures intended to improve patients’ understanding of the purpose of ePROs, participants discussed their lack of clarity about the use of ePROs in routine care. This finding aligns with prior research [34] highlighting uncertainty or misunderstanding among patients regarding how information collected with ePROs will be used outside of a research context and identifies a need for improved educational materials such as provider scripts about the intervention and its connection to their clinical care [41]. Patient education could also be built into the ePRO itself to reinforce the purpose of completing the surveys at each touchpoint with the patient.

Enhanced provider education about ePROs and communications about symptom monitoring with patients may also be needed. Consistent with prior research [35], participants reported that any type of validation of the importance of ePROs from their clinical team, even if a small acknowledgement, increased their willingness and motivation to participate. Despite these endorsements, there remained uncertainty about whether their providers would use the collected symptom information. Clinical teams implementing ePROs may wish to use PROmunication strategies [42], a theory-driven manual for guiding dialogue about PROs, for example, to improve patient understanding and engage patients in conversations around their reported symptoms. Offering ongoing provider trainings may help providers to learn, practice, and remember to use the recommended language in interactions with patients [43].

Another recommendation is to explore ways to allow for more tailored symptom content while still maintaining the simplicity of the symptom survey format. The content of the standardized survey items did not always reflect patients’ individual health journeys, for example if they experienced different types of complications than those assessed, if the answer options were not nuanced enough to describe the burden, or if the symptoms were relevant but chronic and not in need of acute management. There may be a disconnect between what patients consider to be important or burdensome symptoms and what providers perceive to be most important or alert-worthy [44]. These are areas for future research.

It is important to consider how our study design may have affected findings. Interviews occurred a median of 22 days after participants’ last completed survey, with all participants completing the interview within three months. This relatively recent recall time likely allowed patients to more easily remember and reflect on their ePRO experiences; however, recall bias may have been an issue for some patients, particularly postoperatively. Additionally, it is possible that our use of a theoretical framework to inform our interview guide and analysis may have unintentionally prioritized certain aspects of patients’ experiences. However, we wanted to understand the combination of factors that influence uptake and ongoing completion of surveys by including questions relevant to COM-B. To mitigate potential biases, we provided opportunities throughout the interviews for patients to address aspects of the ePRO experience that were salient to them and ways to improve their experiences. We included emergent codes and conducted interviews until no new topics were generated, and we integrated the TDF into our analysis to be intentional about carefully considering multiple aspects of each COM-B component.

This study has limitations. Despite our efforts to recruit a diverse mix of participants, those interviewed are not representative of the demographic diversity of the health system’s patient population. Nonresponse bias was likely an issue, as patients who initially declined to participate in ePROs were not included. It will be important to consider their perspectives as these patients may experience additional barriers to ePRO participation (e.g., more health complications, etc.). Additionally, most participants were highly adherent with the intended ePRO survey schedule and, thus, may have been more willing to complete an interview than those who were less motivated or faced more challenges completing ePROs. Lastly, it was challenging at times to disentangle findings specific to being involved in a research study versus use of ePROs as part of routine care, but we attempted to prioritize the latter during our coding process.

Conclusions

As the implementation of ePROs grows as part of postoperative care, we found promising results that thoracic surgery patients with postoperative symptom monitoring experience largely reported having the capabilities, opportunities, and motivators to complete ePROs. We identified several patient-informed recommendations that may help to improve the implementation and effectiveness of ePROs within routine care.

Data availability

The datasets used and analyzed during the current study are available from the corresponding author upon reasonable request.

Abbreviations

CHAI:

Connected Health for Applications & Interventions

COM-B:

Capability, Opportunity, Motivation model for behavior change

EHR:

Electronic health record

ePRO:

Electronic patient-reported outcome

IVR:

Interactive voice response

NIH:

National Institutes of Health

PRO:

Patient-Reported Outcomes

PRO-CTCAE:

Patient-Reported Outcome Common Terminology Criteria for Adverse Events

SIMPRO:

Symptom Management Implementation of Patient-Reported Outcomes in Oncology

TDF:

Theoretical Domains Framework

UNC:

University of North Carolina at Chapel Hill

References

  1. Marshall K, McLaughlin K (2020) Pain management in thoracic surgery. Thorac Surg Clin 30(3):339–346. https://doi.org/10.1016/j.thorsurg.2020.03.001. PMID: 32593366

  2. Pompili C, Absolom K, Velikova G, Backhus L (2018) Patients reported outcomes in thoracic surgery. J Thorac Dis 10(2):703–706. https://doi.org/10.21037/jtd.2018.01.140. PMID: 29607138. PMCID: PMC5864594

    Article  PubMed  PubMed Central  Google Scholar 

  3. Kneuertz PJ, McAlearney AS, Moffatt-Bruce SD (2020) Patient-reported outcomes in thoracic surgery-opportunities and current challenges. J Thorac Dis 12(11):6880–6882. https://doi.org/10.21037/jtd.2019.12.139. PMID: 33282390. PMCID: PMC7711410

    Article  PubMed  PubMed Central  Google Scholar 

  4. Byrd CT, Williams KM, Backhus LM (2022) A brief overview of thoracic surgery in the United States. J Thorac Dis 14(1):218–226. https://doi.org/10.21037/jtd-21-1504. PMID: 35242386; PMCID: PMC8828520

    Article  PubMed  PubMed Central  Google Scholar 

  5. Brown LM, Kratz A, Verba S, Tancredi D, Clauw DJ, Palmieri T, Williams D (2020) Pain and opioid use after thoracic surgery: where we are and where we need to go. Ann Thorac Surg 109(6):1638–1645. https://doi.org/10.1016/j.athoracsur.2020.01.056. PMID: 32142814

  6. Feinstein MB, Krebs P, Coups EJ, Park BJ, Steingart RM, Burkhalter J et al (2010) Current dyspnea among long-term survivors of early-stage non-small cell lung cancer. J Thorac Oncol 5(8):1221–1226. https://doi.org/10.1097/JTO.0b013e3181df61c8. PMID: 20592631. PMCID: PMC4515574

    Article  PubMed  PubMed Central  Google Scholar 

  7. Heiden BT, Subramanian MP, Liu J, Keith A, Engelhardt KE, Meyers BF, Puri V, Kozower BD (2022) Long-term patient-reported outcomes after non-small cell lung cancer resection. J Thorac Cardiovasc Surg 164(3):615–626.e3. https://doi.org/10.1016/j.jtcvs.2021.11.100. PMID: 35430080

  8. Van Haren RM, Correa AM, Sepesi B, Rice DC, Hofstetter WL, Roth JA et al (2020) Hospital readmissions after pulmonary resection: post-discharge nursing telephone assessment identifies high risk patients. J Thorac Dis 12(3):184–190. https://doi.org/10.21037/jtd.2020.02.08. PMID: 32274083; PMCID: PMC7139035

    Article  PubMed  PubMed Central  Google Scholar 

  9. Aapro M, Bossi P, Dasari A, Fallowfield L, Gascón P, Geller M et al (2020) Digital health for optimal supportive care in oncology: benefits, limits, and future perspectives. Support Care Cancer 28(10):4589–4612. https://doi.org/10.1007/s00520-020-05539-1. PMID: 32533435; PMCID: PMC7447627

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  10. Parikh RB, Basen-Enquist KM, Bradley C, Estrin D, Levy M, Lichtenfeld JL et al (2022) Digital health applications in oncology: an opportunity to seize. J Natl Cancer Inst 114(10):1338–1339. https://doi.org/10.1093/jnci/djac108. PMID: 35640986; PMCID: PMC9384132

    Article  PubMed  PubMed Central  Google Scholar 

  11. Dueck AC, Mendoza TR, Mitchell SA, Reeve BB, Castro KM, Rogak LJ, Atkinson TM, Bennett AV, Denicoff AM, O’Mara AM, Li Y, Clauser SB, Bryant DM, Bearden JD 3rd, Gillis TA, Harness JK, Siegel RD, Paul DB, Cleeland CS, Schrag D, Sloan JA, Abernethy AP, Bruner DW, Minasian LM, Basch E, National Cancer Institute PRO-CTCAE Study Group (2015) Validity and reliability of the US National Cancer Institute’s patient-reported outcomes version of the common terminology criteria for adverse events (PRO-CTCAE). JAMA Oncol 1(8):1051–1059. https://doi.org/10.1001/jamaoncol.2015.2639. Erratum in: JAMA Oncol. 2016;2(1):146. PMID: 26270597; PMCID: PMC4857599

  12. Basch E, Reeve BB, Mitchell SA, Clauser SB, Minasian LM, Dueck AC, Mendoza TR, Hay J, Atkinson TM, Abernethy AP, Bruner DW, Cleeland CS, Sloan JA, Chilukuri R, Baumgartner P, Denicoff A, St Germain D, O’Mara AM, Chen A, Kelaghan J, Bennett AV, Sit L, Rogak L, Barz A, Paul DB, Schrag D (2014) Development of the National Cancer Institute’s patient-reported outcomes version of the common terminology criteria for adverse events (PRO-CTCAE). J Natl Cancer Inst 106(9):dju244. https://doi.org/10.1093/jnci/dju244. PMID: 25265940; PMCID: PMC4200059

    Article  PubMed  PubMed Central  Google Scholar 

  13. National Cancer Institute Division of Cancer Control & Population Sciences (2023) Patient-reported outcomes version of the common terminology criteria for adverse events (PRO-CTCAE®). https://healthcaredelivery.cancer.gov/pro-ctcae/. Accessed 28 Feb 2024

  14. Mody GN, Stover AM, Wang M, King-Kallimanis BL, Jansen J, Henson S, Chung AE, Jonsson M, Bennett A, Smith AB, Wood WA, Deal A, Ginos B, Dueck AC, Schrag D, Basch E (2021) Electronic patient-reported outcomes monitoring during lung cancer chemotherapy: a nested cohort within the PRO-TECT pragmatic trial (AFT-39). Lung Cancer 162:1–8. Epub 2021 Sep 30. PMID: 34634754

    Article  PubMed  Google Scholar 

  15. Basch E, Stover AM, Schrag D, Chung A, Jansen J, Henson S, Carr P, Ginos B, Deal A, Spears PA, Jonsson M, Bennett AV, Mody G, Thanarajasingam G, Rogak LJ, Reeve BB, Snyder C, Kottschade LA, Charlot M, Weiss A, Bruner D, Dueck AC (2020) Clinical utility and user perceptions of a digital system for electronic patient-reported symptom monitoring during routine cancer care: findings from the PRO-TECT trial. JCO Clin Cancer Inf 4:947–957. https://doi.org/10.1200/CCI.20.00081. PMID: 33112661; PMCID: PMC7768331

    Article  Google Scholar 

  16. Basch E, Schrag D, Henson S, Jansen J, Ginos B, Stover AM et al (2022) Effect of electronic symptom monitoring on patient-reported outcomes among patients with metastatic cancer: a randomized clinical trial. JAMA 327(24):2413–2422. https://doi.org/10.1001/jama.2022.9265. PMID: 35661856; PMCID: PMC9168923

    Article  PubMed  PubMed Central  Google Scholar 

  17. Yu H, Yu Q, Nie Y, Xu W, Pu Y, Dai W et al (2021) Data quality of longitudinally collected patient-reported outcomes after thoracic surgery: comparison of paper- and web-based assessments. J Med Internet Res 23(11):e28915. https://doi.org/10.2196/28915. PMID: 34751657; PMCID: PMC8663677

    Article  PubMed  PubMed Central  Google Scholar 

  18. Dai W, Feng W, Zhang Y, Wang XS, Liu Y, Pompili C et al (2022) Patient-reported outcome-based symptom management versus usual care after lung cancer surgery: a multicenter randomized controlled trial. J Clin Oncol 40(9):988–996. https://doi.org/10.1200/JCO.21.01344. PMID: 34995100. PMCID: PMC8937008

    Article  PubMed  PubMed Central  Google Scholar 

  19. Cleeland CS, Wang XS, Shi Q, Mendoza TR, Wright SL, Berry MD et al (2011) Automated symptom alerts reduce postoperative symptom severity after cancer surgery: a randomized controlled clinical trial. J Clin Oncol 29(8):994–1000. PMID: 21282546; PMCID: PMC3068055

    Article  PubMed  PubMed Central  Google Scholar 

  20. Basch E, Deal AM, Kris MG, Scher HI, Hudis CA, Sabbatini P et al (2016) Symptom monitoring with patient-reported outcomes during routine cancer treatment: a randomized controlled trial. J Clin Oncol 34(6):557–565. PMID: 26644527. PMCID: PMC4872028

    Article  CAS  PubMed  Google Scholar 

  21. van den Hurk CJG, Mols F, Eicher M, Chan RJ, Becker A, Geleijnse G et al (2022) A narrative review on the collection and use of electronic patient-reported outcomes in cancer survivorship care with emphasis on symptom monitoring. Curr Oncol 29(6):4370–4385. https://doi.org/10.3390/curroncol29060349. PMID: 35735458; PMCID: PMC9222072

    Article  PubMed  PubMed Central  Google Scholar 

  22. U.S. National Library of Medicine (2024) Improving quality of life after thoracic surgery using patient-reported outcomes. https://classic.clinicaltrials.gov/ct2/show/NCT04342260. Accessed 28 Feb 2024

  23. Clinical Trials Veeva (2023) Pre-implementation study of improving thoracic surgical care using electronic patient-reported outcomes (ePROS) (TSPRO2). https://ctv.veeva.com/study/pre-implementation-study-of-improving-thoracic-surgical-care-using-electronic-patient-reported-outco. Accessed 28 Feb 2024

  24. The Decision Lab (2023) The COM-B model for behavior change. https://thedecisionlab.com/reference-guide/organizational-behavior/the-com-b-model-for-behavior-change. Accessed 28 Feb 2024

  25. University of North Carolina Lineberger Comprehensive Cancer Center Patient-Reported Outcomes Core (PRO Core). https://pro.unc.edu. Accessed 13 Mar 2024

  26. Atkins L, Francis J, Islam R, O’Connor D, Patey A, Ivers N et al (2017) A guide to using the theoretical domains framework of behaviour change to investigate implementation problems. Implement Sci 12(1):77. https://doi.org/10.1186/s13012-017-0605-9. PMID: 28637486; PMCID: PMC5480145

    Article  PubMed  PubMed Central  Google Scholar 

  27. De Leo A, Bayes S, Bloxsome D et al (2021) Exploring the usability of the COM-B model and theoretical domains Framework (TDF) to define the helpers of and hindrances to evidence-based practice in midwifery. Implement Sci Commun 2(7). https://doi.org/10.1186/s43058-020-00100-x

  28. Pearse BL, Keogh S, Rickard CM, Fung YL (2021) Barriers and facilitators to implementing evidence based bleeding management in Australian cardiac surgery units: a qualitative interview study analysed with the theoretical domains framework and COM-B model. BMC Health Serv Res 21(1):550. https://doi.org/10.1186/s12913-021-06269-8. PMID: 34090421. PMCID: PMC8178922

    Article  PubMed  PubMed Central  Google Scholar 

  29. Alhusein N, Scott J, Neale J, Chater A, Family H (2021) Community pharmacists’ views on providing a reproductive health service to women receiving opioid substitution treatment: A qualitative study using the TDF and COM-B. Explor Res Clin Soc Pharm 4. https://doi.org/10.1016/j.rcsop.2021.100071. PMID: 34870263. PMCID: PMC8626316

  30. Assarroudi A, Heshmati Nabavi F, Armat MR, Ebadi A, Vaismoradi M (2018) Directed qualitative content analysis: the description and elaboration of its underpinning methods and data analysis process. J Res Nurs 23(1):42–55. https://doi.org/10.1177/1744987117741667

    Article  PubMed  PubMed Central  Google Scholar 

  31. Hsieh H-F, Shannon SE (2005) Three approaches to qualitative content analysis. Qual Health Res 15(9):1277–1288. https://doi.org/10.1177/1049732305276687

    Article  PubMed  Google Scholar 

  32. Eriksen J, Bygholm A, Nielsen SH, Bertelsen P (2022) The experiences of community-dwelling individuals with newly diagnosed type-2 diabetes in using patient-reported outcomes in a municipal setting. Digit Health 8:20552076221089792. https://doi.org/10.1177/20552076221089792. PMID: 35386954; PMCID: PMC8977707

    Article  PubMed  PubMed Central  Google Scholar 

  33. Nelson EC, Hvitfeldt H, Reid R, Grossman D, Lindblad S, Mastanduno MP (2012) Using patient-reported information to improve health outcomes and health care value: case studies from Dartmouth, Karolinska and Group Health. The Dartmouth Institute for Health Policy and Clinical Practice and Centre for Population Health, Darmount, NS, Canada, pp 1–54

  34. Mejdahl CT, Schougaard LMV, Hjollund NH, Riiskjær E, Thorne S, Lomborg K (2018) PRO-based follow-up as a means of self-management support - an interpretive description of the patient perspective. J Patient Rep Outcomes 2:38. https://doi.org/10.1186/s41687-018-0067-0. PMID: 30238083; PMCID: PMC6125260

    Article  PubMed  PubMed Central  Google Scholar 

  35. Nielsen AS, Appel CW, Larsen BF, Kayser L, Hanna L (2021) Patient perspectives on digital patient reported outcomes in routine care of inflammatory bowel disease. J Patient Rep Outcomes 5(1):92. https://doi.org/10.1186/s41687-021-00366-2. PMID: 34533682; PMCID: PMC8448812

    Article  PubMed  PubMed Central  Google Scholar 

  36. Tang L, He Y, Pang Y, Su Z, Li J, Zhang Y, Wang X, Han X, Wang Y, Li Z, He S, Song L, Zhou Y, Wang B, Li X (2022) Implementing symptom management follow-up using an electronic patient-reported outcome platform in outpatients with advanced cancer: longitudinal single-center prospective study. JMIR Form Res 6(5):e21458. https://doi.org/10.2196/21458. PMID: 35536608; PMCID: PMC9131147

    Article  PubMed  PubMed Central  Google Scholar 

  37. Patt D, Wilfong L, Hudson KE, Patel A, Books H, Pearson B, Boren R, Patil S, Olson-Celli K, Basch E (2021) Implementation of electronic patient-reported outcomes for symptom monitoring in a large multisite community oncology practice: dancing the Texas two-step through a pandemic. JCO Clin Cancer Inform 5:615–621. https://doi.org/10.1200/CCI.21.00063. PMID: 34085537

  38. Rocque GB, Dionne-Odom JN, Stover AM, Daniel CL, Azuero A, Huang CS, Ingram SA, Franks JA, Caston NE, Dent AN, Basch EM, Jackson BE, Howell D, Weiner BJ, Pierce JY (2022) Evaluating the implementation and impact of navigator-supported remote symptom monitoring and management: a protocol for a hybrid type 2 clinical trial. BMC Health Serv Res 22(1):538. https://doi.org/10.1186/s12913-022-07914-6. PMID: 35459238; PMCID: PMC9027833

    Article  PubMed  PubMed Central  Google Scholar 

  39. Basch E, Hudson K, Rocque G (2023) Implementation of electronic patient-reported outcomes for symptom monitoring during cancer treatment: the importance of getting it right. J Comp Eff Res 12(12):e230157. https://doi.org/10.57264/cer-2023-0157. Epub 2023 Nov 14. PMID: 37961992; PMCID: PMC10734319

    Article  PubMed  PubMed Central  Google Scholar 

  40. Hassett MJ, Cronin C, Tsou TC, Wedge J, Bian J, Dizon DS, Hazard-Jenkins H, Osarogiagbon RU, Wong S, Basch E, Austin T, McCleary N, Schrag D (2022) eSyM: an electronic health record-integrated patient-reported outcomes-based cancer symptom management program used by six diverse health systems. JCO Clin Cancer Inf 6:e2100137. https://doi.org/10.1200/CCI.21.00137. PMID: 34985914; PMCID: PMC9848544

  41. Powell BJ, Waltz TJ, Chinman MJ, Damschroder LJ, Smith JL, Matthieu MM, Proctor EK, Kirchner JE (2015) A refined compilation of implementation strategies: results from the expert recommendations for implementing change (ERIC) project. Implement Sci 10:21. https://doi.org/10.1186/s13012-015-0209-1. PMID: 25889199; PMCID: PMC4328074

    Article  PubMed  PubMed Central  Google Scholar 

  42. Skovlund PC, Ravn S, Seibaek L et al (2020) The development of PROmunication: a training-tool for clinicians using patient-reported outcomes to promote patient-centred communication in clinical cancer settings. J Patient Rep Outcomes 4(1):10. https://doi.org/10.1186/s41687-020-0174-6. PMID: 32048085; PMCID: PMC7013008

    Article  PubMed  PubMed Central  Google Scholar 

  43. Crossnohere NL, Anderson N, Baumhauer J, Calvert M, Esparza R, Gulbransen S, Haverman L, Li Y, Petersen C, Retzer A, Sidey-Gibbons C, Stover AM, Thorner E, Ursin G, Velikova G, Walker ES, Brundage M, Snyder C (2024) A framework for implementing patient-reported outcomes in clinical care: the PROTEUS-practice guide. Nat Med. https://doi.org/10.1038/s41591-024-02909-8. PMID: 38627558

  44. Mazza GL, Dueck AC, Ginos B, Jansen J, Deal AM, Carr P, Blinder VS, Thanarajasingam G, Jonsson M, Lee MK, Rogak LJ, Mody GN, Schrag D, Basch E (2024) Optimization of alert notifications in electronic patient-reported outcome (ePRO) remote symptom monitoring systems (AFT-39). Qual Life Res 33(7):1985–1995. https://doi.org/10.1007/s11136-024-03675-3. Epub 2024 May 21. PMID: 38771558

    Article  PubMed  Google Scholar 

Download references

Acknowledgements

We would like to acknowledge the clinical contributions of Julia Coleman, Benjamin E. Haithcock, Lauren R. Hill, Jason M. Long, and Bernice S. Newsome. We also thank Caroline Hoch, Mattias Jonsson, and Randall Teal for their support with our Thoracic Surgery Patient-Reported Outcomes (TSPRO) studies. This project also made use of systems and services provided by the Patient-Reported Outcomes Core (PRO Core) and the Connected Health for Applications & Interventions Core (CHAI Core) at the Lineberger Comprehensive Cancer Center at the University of North Carolina at Chapel Hill. PRO Core and CHAI Core are funded in part by a National Cancer Institute Cancer Center Core Support Grant (5-P30-CA016086) and the University Cancer Research Fund of North Carolina. The LCCC Bioinformatics Core provides the computational infrastructure for the PRO Core system.

Funding

Research reported in this publication was supported by the National Heart, Lung, and Blood Institute of the National Institutes of Health under Award Number K23HL157765 and by the American College of Surgeons Faculty Research Fellowship Award. The funding agencies were not involved in the design of the study, the collection, analysis or interpretation of data, or the writing of the manuscript.

Author information

Authors and Affiliations

Authors

Contributions

A.M.S., J.L., and G.N.M. designed the study. M.B.V., J.C., and G.N.M. collected the data. M.C.O., A.L.G., M.B.V., J.C., J.L., and G.N.M. analyzed the data. M.C.O., E.K., C.C., A.L.G., A.M.S., J.L., and G.N.M. interpreted the data. M.C.O. and G.N.M. prepared the first draft of the manuscript. All authors read and approved the final manuscript.

Corresponding author

Correspondence to Meghan C. O’Leary.

Ethics declarations

Ethics approval and consent to participate

This study was approved by the University of North Carolina at Chapel Hill Institutional Review Board. All participants consented to participate in remote symptom monitoring using ePROs and to participate in an interview about their experience.

Consent for publication

Not applicable.

Competing interests

AMS has received unrelated research funding administered through her institution in the past two years from PCORI, NIH, AHRQ, Bladder Cancer Advocacy Network, Hematology/Oncology Pharmacy Association, Cancer and Aging Research Group (CARG), Sivan Innovation, UroGen Pharma Ltd., American Society of Clinical Oncology, and Pfizer Global. All other authors declare that they have no competing interests.

Additional information

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Electronic supplementary material

Below is the link to the electronic supplementary material.

Supplementary Material 1

Rights and permissions

Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article’s Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article’s Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

O’Leary, M.C., Kwong, E., Cox, C. et al. Patient motivators of postoperative electronic patient-reported outcome symptom monitoring use in thoracic surgery patients: a qualitative study. J Patient Rep Outcomes 8, 81 (2024). https://doi.org/10.1186/s41687-024-00766-0

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1186/s41687-024-00766-0

Keywords