Skip to main content

Table 1 Components of RE-AIM evaluation framework

From: Stepping into the real world: a mixed-methods evaluation of the implementation of electronic patient reported outcomes in routine lung cancer care

Constructs and definitions applied for this study

Questions addressed

Data sources used (# aligns with the # for each question addressed)

Timepoint

Reach

1. What is the number and proportion of patients in clinic

1. Clinical audit log completed over a 3-month period

Baseline (pre-implementation)

The number, proportion and representativeness of people who attend lung cancer clinic

(a) with internet/mobile phone access at home

(b) capable of completing assessment in English vs other native language

(c) who require assistance to complete assessments

(d) who prefer to complete PROs on paper vs electronic device?

2. What is the number and proportion of patients completing assessment screening including the number and proportion of those systemically missed and why?

2. Oncology Information System (OIS)—MOSAIQ records

At first assessment timepoint in clinic

Effectiveness

Compared to a historical control cohort:

1. Electronic medical records (eMR)

Historical control and throughout implementation period

The effectiveness of ePROs in improving lung cancer care

1. What is the impact of ePROs on the number of admissions to hospital due to ED presentations?

2. What is the impact of ePROs on the use of the cancer assessment unit?

3. What is the impact of ePROs on care coordinator referral rates?

2 and 3. OIS (MOSAIQ) records

Adoption

1. What is the extent to which the new model of care and implementation strategies are considered feasible and appropriate among HCPs, given the different needs and resources of each hospital?

1 and 2. Organizational readiness for implementing change (ORIC) survey

Baseline and at 5-months

The development of organizational support to deliver ePROs

2. What is the number, proportion and representation of HCP (change agents) implementing ePROs?

1 and 2. ePROM HCP Survey

Baseline and at 5-months

3. What is the number and proportion of all cancer services staff completing ePROM orientation?

1. Field notes and recordings of HCP feedback during MDT meetings and workshops

Throughout implementation period

2 and 3. Orientation attendance logs

Implementation

1. What is the number and proportion of patients screened at each hospital?

1 and 2. OIS (MOSAIQ) records

Throughout implementation period

The extent of ePROM implementation at each hospital. i.e. the degree to which each hospital receives the planned implementation strategies, and success of implementation processes

2. What is the number and proportion of clinical alerts actioned or followed up by HCP?

3. What is number of HCPs receiving orientation and implementation resources?

3. Orientation attendance logs

3. PROMs website views

Maintenance

1. What is the number and proportion of staff who maintain ePROM engagement over a 5-month implementation?

1. HCP survey (baseline and follow-up)

Baseline and follow-up

Incorporating ePROs in routine care to ensure sustainability over time

2. What is staff feedback on ePROs implementation in routine clinical practice?

1. OIS (MOSAIQ) records

Throughout implementation period

2. Interviews with HCP and field notes

Post-implementation