Skip to main content

Feasibility of Goal Attainment Scaling as a patient-reported outcome measure for older patients in primary care

Abstract

Background

Goal Attainment Scaling (GAS) is an outcome measure that reflects the perspectives and experiences of patients, consistent with patient-centred care approaches and with the aims of patient-reported outcome measures (PROMs). GAS has been used in a variety of clinical settings, including in geriatric care, but research on its feasibility in primary care practice has been limited. The time required to complete GAS is a barrier to its use by busy primary care clinicians. In this study, we explored the feasibility of lay interviewers completing GAS with older primary care patients.

Methods

Older adults were recruited from participants of a larger study in five primary care clinics in Alberta and Ontario, Canada. GAS guides were developed based on semi-structured telephone interviews completed by a non-clinician lay interviewer; goals were reviewed in a follow-up interview after six months.

Results

Goal-setting interviews were conducted with 41 participants. GAS follow-up guides could be developed for 40 patients (mean of two goals/patient); follow-up interviews were completed with 29 patients. Mobility-focused goals were the most common goal areas identified.

Conclusions

Study results suggest that it is feasible for lay interviewers to conduct GAS over the telephone with older primary care patients. This study yielded an inventory of patient goal areas that could be used as a starting point for future goal-setting interviews in primary care. Recommendations are made for use of GAS and for future research in the primary care context.

Background

Patients’ priorities and needs are central to the provision of quality care [1, 2]. Patient-centred or person-centred care aims to emphasize the role of the patient in their healthcare journey and to place their needs, opinions, and involvement at the centre of care planning and decision-making [3]. This can be supported by increasing the participation of patients in care planning and by supporting the implementation of self-management initiatives to increase the control that a patient has over their care [4]. Collaborative goal setting can increase the participation of patients and caregivers and facilitate their engagement in self-management [4]. It can also promote trust between providers and patients (and their caregivers) because providers are actively seeking the needs and priorities of the patients and incorporating these into their care plans [4]. A shared understanding of goals between providers and patients is associated with better health outcomes and experiences [5,6,7]. A recent review of goal-oriented care for primary care patients identified elicitation of patient goals as the first step in the process of goal-oriented care, with patients as active partners [8]. While goal-oriented care is recognized as good practice, especially for patients with multiple health conditions, it is often not part of routine care planning [9,10,11].

Patient-reported outcome measures (PROMs) “directly assess the lived experiences of service users, capturing their perspectives on their health status and essential subjective constructs such as goal attainment, quality of life and social inclusion” [12, p. 57]. Roe and colleagues argue that PROMs should be co-developed and user-selected, with meaningful involvement of patients/people with lived experience in their development and use. Goal Attainment Scaling (GAS) [12, 13] is an approach that can incorporate goals identified by individual patients within a measure co-developed with a clinician or evaluator, in a manner consistent with the aims expressed by Roe and colleagues. GAS is a measurement approach that involves patients selecting personalized goals that are relevant for them and creating individualized scales to measure the attainment of these goals [13, 14]. GAS was originally developed to evaluate community mental health programs [13] but has since been applied in many program evaluation, research, and clinical contexts [15,16,17,18,19], and has been extensively validated [20, 21]. A number of studies have assessed the test-retest or inter-rater reliability of GAS; these studies have primarily focused on the reliability of the GAS follow-up score assessed by clinicians [22, 23]; Stolee et al. [24] and May-Benson et al. [25] also examined the inter-rater reliability of scale construction.

GAS may be a particularly appropriate PROM approach for use with older patients, who often present with multiple, complex and highly individualized health problems which are often not well accommodated with standardized measures [26]. Studies in geriatric care contexts have found GAS to have construct validity [24, 27], to be responsive to change [27,28,29], and to be a practical approach to guide patient-centred care [19, 30, 31].

Research on the feasibility of GAS specifically for use in primary care for older adults has been limited. Geriatric care settings commonly involve comprehensive approaches to assessment, specialist physicians, and interdisciplinary teams [26], offering greater time and opportunities for careful and comprehensive consideration of patient goals. While primary care settings also serve many older patients, team-based care is limited and, appointment times are shorter [32]. These factors limit opportunities for engaging patients in goal setting and decision-making, which has been identified as a key element of an effective model of care for older complex patients in primary care [33]. The time required to identify and scale individual goals for each patient is recognized as a barrier to implementation of GAS [19, 28, 31,32,33,34,35,36,37]. Previous investigations of the feasibility of GAS in primary care have included extensive clinician involvement and complex goal-setting processes. Toto and colleagues [31] conducted a feasibility study of GAS with older adults in geriatric primary care; their goal-setting process involved a lengthy (up to one hour) home visit by a rehabilitation professional. Javadi and colleagues [35] completed GAS with patients at a family health team; goal-setting involved a computerized goal-setting survey completed by volunteers, with follow-up review and discussion by interprofessional teams. Ford and colleagues [11] investigated the feasibility of a goal-setting intervention for patients in primary care (mean age 80.4); their investigation incorporated a modified version of GAS as an aspect of the intervention, which also included extensive practitioner training and a structured goal-setting consultation.

In a number of studies, researchers have investigated the feasibility of lay interviewers (as opposed to medical/clinical interviewers) administering a range of clinical assessments and diagnostic tools (e.g., [38,39,40,41]). In many instances (e.g., [38, 39]), lay interviewers were found to be an acceptable mode of data collection, with some training. We were interested to determine whether the GAS process in primary care might be facilitated by non-clinicians, and thus investigated the feasibility of implementing GAS for older patients in primary care using telephone interviews completed by lay interviewers.

Methods

Study design

This study was a sub-project of a larger study aimed at enhancing screening and care planning for older adults in team-based primary care practices in Canada; methods for the larger study are reported in detail elsewhere [42]. This study used a sequential mixed method design [43] in which qualitative interviews were used to guide development of GAS follow-up guides which could generate quantitative measures of goal attainment. Data for this study were collected prior to implementation of the study interventions.

Setting and participants

All participants in this study were part of the larger multi-site study and were recruited from three primary care clinics in Ontario and two Primary Care Networks in Alberta. Patients were included if they were aged 70 or older and living in the community. Individuals living in long-term care homes and patients who had not been rostered with the practice for more than six months were excluded.

Recruitment followed a stratified purposeful sampling approach [44]. Data from the larger study were used to guide selection of participants with varying levels of health or health risk; these included scores on the EQ-5D-5L (the EuroQol Five Dimensions, Five Levels) health status measure [45], a five-point self-rated global health question, and the number of self-reported chronic illnesses. Components of these scores were used to describe each participant’s overall health status as either low risk, medium risk or high risk. Those with low risk health status were defined as those who rated their health as very good or excellent (4 or 5/5), had two or fewer chronic diseases, and an EQ-5D-5L score between 80 and 100. Moderate risk health status participants had rated their health as good (3/5), had two to three chronic diseases, and an EQ-5D-5L score between 60 and 79. Finally, high risk participants were those who rated their health as poor or fair (1 or 2/5), had three or more chronic diseases, and an EQ-5D-5L score between 30 and 59. At each site, we selected two to three patients from each risk group to participate in the study. Demographic characteristics of the participants were collected on a standard data collection form and are provided in Table 1 (all participants) and Table 2 (participants for whom follow-up was completed).

Table 1 Demographics of All Participants at Initial Interview
Table 2 Demographics of Follow-up Participants

Goal Attainment Scaling procedure

One GAS follow-up guide was created for each patient (“follow-up guide” is the term commonly used to describe the form completed upon initial assessment and then used to guide follow-up assessments). A GAS follow-up guide consists of a table in which the goals identified by each patient are scaled in terms of their level of attainment. Goal attainment is scored on individualized five-point scales, from − 2, much less than expected, to + 2, much better than expected. The expected level of goal attainment, or program goal, is scored as 0. GAS differs from other individualized goal setting tools (e.g., the Canadian Occupational Performance Measure [46]) in that the expected outcomes are defined and operationalized on an a priori basis. A sample follow-up guide is provided in Fig. 1.

Fig. 1
figure 1

Sample GAS Follow-up Guide

GAS follow-up guides were created based on individual interviews completed with each patient; interviews were conducted by members of a non-clinician research team. Before interviews began, all interviewers received comprehensive training on constructing GAS guides; training included team members constructing follow-up guides based on case scenarios. Training was led by a researcher (PS), with extensive experience using GAS in clinical settings and research studies, and included a two-hour training session and an in-depth written guide that detailed how to identify goal topics and set attainment levels with participants. The training was delivered to researchers from all sites and the methods and techniques outlined in the guide were consistently applied during all interviews. Consistency in goal-setting was also aided by weekly meetings between the Alberta and Ontario teams. The first set of patient interviews was completed within a month of the initial clinic appointment during which patients were recruited. The interview followed a semi-structured interview guide with the first portion (approximately two-thirds of the interview) related to general study questions about care experiences (completed as part of data collection for the larger study), and the remaining portion related to health goals and priorities of the patient. The language used while questioning and prompting participants was neutral in order to limit any bias in patient responses. The four interviewers (two in Alberta, two in Ontario) are lay, non-clinicians, and Master’s or PhD-level trained qualitative researchers. After the goals were recorded, interviewers verbally confirmed the wording of these with participants to ensure they were an accurate representation of the patient’s goals. All interviews were recorded and transcribed verbatim.

Two GAS guides were constructed for a sample of patients (n = 8) from three sites (in Ontario), as a check on the inter-rater reliability of GAS guide construction, including goal-identification and scaling, similar to the approach used by Stolee et al. [24] and May-Benson et al. [25]. One guide was developed by the interviewer and a second guide was developed by a second researcher based on the audio-recording and transcript. The researchers then reviewed both GAS guides to identify similarities and differences and agreed on one consensus guide to be used for follow-up. In the two primary care networks in Alberta, the interviewer took the lead on drafting the GAS guides and this was then independently checked by two members of the study team. Researchers connected with patients for a follow-up interview after six months to discuss their progress on their goals.

Assessment of feasibility

As this was an initial exploratory study, our criteria for feasibility were limited:

  1. 1.

    Individual patient goals can be elicited from older primary care patients, at varying levels of health or risk, in a telephone interview conducted by a lay interviewer;

  2. 2.

    Two laypersons will record similar goals based on the same patient interview;

  3. 3.

    The interview will generate an average of three goals per patient; and.

  4. 4.

    Patients can be followed up to review their goals, after six months.

While not explicitly a feasibility criterion, we were interested in the types of goal areas identified, to allow comparison with goal areas identified in other applications of GAS with older patients (e.g., [11, 19, 33, 34]) and to provide an inventory of goals that might serve as a starting point for future applications of GAS in primary care.

To provide data that might be helpful for future research or clinical applications of GAS in primary care, we intended to calculate the means and standard deviations of the initial and follow-up GAS scores. We did not anticipate statistically significant differences between initial and follow-up scores, as no interventions other than usual practice were implemented during this period.

Statistical analysis

GAS scores were calculated for each patient using their initial and follow-up goal attainment levels. The formula used to calculate GAS scores produces an overall score adjusted for the number of goals, the expected inter-correlation of the goal scales (conventionally assigned a value of 0.3), and the relative weighting of the goals [13]. Current practice favours assigning goals equal weights [47]; this simplifies the calculation of the GAS score, which can then be taken from a published scoring key [48]. The GAS formula generates a T-score; scores for a sufficiently large sample are expected to form a normal distribution with a mean of 50 ± 10. Microsoft Excel was used for organizing and analyzing data.

Qualitative analysis of administration observations & notes

After the initial and follow-up interviews, interviewers recorded their observations and experiences in field notes; some field notes included verbatim quotes from participants, which were captured during administration of the GAS. Field notes and team debriefs also captured the interviewers’ experiences and impressions during administration of the instrument. These data were entered into NVivo 12, and analyzed inductively; the identification of emergent themes was supported by team discussions.

Ethics

Prior to the interview, all participants provided informed consent. This study received ethics clearance from the offices of research ethics at the University of Waterloo and the University of Calgary.

Results

In total, 41 patients across the five primary care networks were recruited and interviewed. Forty GAS guides were created with a total of 85 goals (one to four goals/patient; mean = 2.1 goals/patient); one patient from the moderate risk category was unable to identify a goal and thus was not followed through the rest of the study. Of the 40 patients who identified goals, 29 were successfully contacted after 6-months to review their goals and determine a follow-up GAS score. Participants who did not complete a follow-up interview either could not be reached by telephone, after at least two attempts (n = 8), or had a change of circumstances (new caregiving duties that took up spare time; communication issues due to worsening chronic disease) that caused them to withdraw from the study (n = 2); one participant had died. The mean duration of the complete initial interview (including the portion completed for the larger study) was 19 min (min = 9; max = 47). In general, the last third of the interview (avg: 5:38 min, min: 1:40 min, max 15:00 min) was used to discuss health goals and develop the GAS guide. Brief follow-up interviews consisted only of GAS discussions and lasted a mean of three minutes (min = 1; max = 4).

There was complete agreement between the interviewer and second researcher in Ontario with the identified goal areas; discussion resulted in minor changes in wording and scale definitions on two of the eight guides. In Alberta, the team verification of the GAS guide resulted in very minor wording changes, suggesting good consensus in goal expression and scaling. Of the 29 participants who completed a follow-up GAS guide, 12 were low-risk, eight were moderate-risk, and nine were high-risk. Between one and four goals were set for these followed up patients (mean of two goals/patient), thus the number of goals set was similar to that for the full sample. Mobility-focused goals were the most common, with 27 (31.8% of total goals) goals addressing exercise, step count, or rehabilitation. Other goals related to leisure activities (e.g., able to travel in the car for longer periods of time, able to play the piano), nutrition, weight management, instrumental activities of daily living (IADLs) or tasks for living independently (e.g., cooking, house cleaning) [49], pain management, overall health, physical health, medication use (specifically a reduction in medication use), and mental health. Goal types for all participants and for each risk group are shown in Table 3 (all participants at initial interview) and Table 4 (follow-up participants).

Table 3 Goal Types for All Participants at Initial Interview
Table 4 Goal Types for Follow-up Participants

The mean initial GAS score for all patients was 43.6 ± 7.2. For patients who completed follow-up interviews, the mean initial GAS score was 43.9 ± 7.5; the mean follow-up score was 45.9 ± 11.7. Pre-post change in goal attainment score (mean change of 2.4 ± 13.4) was not statistically significant (p = .37) in this pre-intervention phase of the study (i.e., none of the planned study interventions had yet been implemented, so any change in goal attainment would have resulted from “usual care”, patient-initiated actions, or the passage of time). Change in GAS score varied widely over the follow-up period, ranging from − 20.0 to + 41.1 points, suggesting that some patients experienced substantial gains or declines in their identified goals. The mean initial, follow-up, and change in GAS scores for patients in the low, moderate and high risk categories are depicted in Table 5. There was modest upward (but not statistically significant) movement between initial and final GAS scores for the low and high risk patients; the initial and follow-up scores for moderate risk patients were similar (mean change of -0.6 ± 12.6). Compared to the high and low risk participants, moderate risk participants had fewer goals overall (14), and slightly fewer goals per patient (1.8/patient, compared to 2.2 and 2.1, respectively). The types of goals identified by the moderate risk participants differed from the other groups, with a lower proportion of mobility goals and a higher proportion of goals in the IADL, pain management, and medication categories.

Table 5 Summarized GAS results and significance of findings

Observations and reflections on the administration of GAS

In Table 6, below, we summarize our team’s reflections and lessons learned from our approach to completing GAS guides with older adult participants, over the phone, using non-clinician interviewers. We found that robust and consistent training across sites was essential; there were limitations to completing this work over the phone; patients often struggled with the notion of “health goals”; and, that it was important to be mindful of potential sensitive goals.

Table 6 Reflections on the administration of GAS

Discussion

Processes for collaborative goal-setting with patients are the focus of ongoing research. Various approaches have been explored. Several studies have described primary care clinicians administering goal-setting sessions with patients (e.g., [11, 50, 51]). While these approaches have merit, they require the participation and time of busy clinicians which may not always be available. Boeykens et al. [8] concluded their review of goal-oriented care with a recommendation for further research on “how and what goals are set by the patient” and “how this knowledge could be translated into a tangible workflow”. Our study yielded insights into these two questions, with a focus on the use of GAS for older patients in primary care. If GAS can be feasibly administered by non-clinicians to facilitate goal identification by patients in primary care, at least as an initial step in a goal setting process, this may alleviate some concerns about the time that may be required to incorporate GAS as a PROM in routine clinical practice.

This study suggests that GAS can be used by non-clinicians to facilitate the selection of goals by older primary care patients and for measuring their progress over time. All but one (moderate risk) patient was able to identify at least one personal goal related to their health; 76% were able to identify more than one goal. Thus, it is possible for community-dwelling older adults to develop personal goals using the GAS procedure. While mean change in goal attainment was not statistically significant, nor expected given that there was no intervention, our results indicate that many patients experienced change in their goal attainment levels. Other studies have suggested an association between the act of personal goal setting and the motivation to achieve goals [31, 52, 53].

We found good agreement between laypersons on the goals that were set based on the same patient interview. As displayed in Tables 4 and 5, the most common goal areas were mobility, leisure, nutrition, and weight management. In total, 31.8% of the developed goals focused on mobility. The second most common goal category was leisure, which represented 12.9% of the goals. This is consistent with some previous studies that used GAS with older adult patients, which also identified mobility and leisure as common goals in this population [54]. Toto et al. [31] reported that 50% of goals in their study related to leisure; mobility and other self-care goals were less common. In the study conducted by Ford et al. [11], in which clinicians led goal-setting consultations, management of chronic conditions was a common goal, this may have resulted from a greater clinical emphasis in these interviews. Mobility goals (including walking and balance) were also common. Leisure goals were not specifically identified, but may have been captured in “maintain interests”, “social participation” and “gardening-related” categories. We note that Haladay et al. [55] used qualitative methods (focus group interviews) to develop an inventory of important and measurable goals with the intention of using this inventory to provide prompts to assist patients in identifying GAS goals in the context of outpatient physical therapy for low back pain. In our study, such a list was identified through individual interviews, but we suggest that our inventory of goals (Tables 4 and 5), could be used similarly as a starting point for future goal-setting interviews in primary care, potentially making the process more time-efficient. Haladay and colleagues [55] saw that GAS had advantages over standardized fixed-item PROMs in its ability to reflect goals of importance to patients. This is consistent with the recent findings of Lauritzson and colleagues [56] that the individualized Canadian Occupational Performance Measure was more responsive to clinically important change than the fixed-item PROM used as a comparator.

Although many participants were able to improve their GAS score between initial and follow-up interviews, the individual change varied widely, with some scores showing decline, some remaining the same, and some showing improvement. This variation could be a result of the different amount and types of goals identified among the three groups. IADL goals had an average negative GAS change of about − 7.83 points, while mobility goals had an average positive GAS change of 5.03; this could contribute to the discrepancy in mean score change between these patient groups.

Kiresuk, Smith and Cardillo [14] recommended the identification of at least three GAS goals/patient for optimal reliability, which was the reason we selected three goals as our target. While fewer goals/patient (mean of 2.1) were identified in this study, a target of three may not have been necessary or realistic. McGarrigle et al. [57] suggest that the use of one-goal and two-goal GAS can be clinically responsive, although that research group found that one-goal GAS is ultimately less responsive to clinical interventions than multi-goal GAS [17]. The primary care goal-setting process studied by Ford et al. [11] set between one to three goals/participant with a mean of 2.3 goals, similar to our results.

Training has been long recognized as important in successful use of GAS, although how this is done is often not reported [58, 59]. Our team of researchers received training from a recognized GAS expert (PS), and we had strong alignment between different goal-setters. This success in GAS scale construction may be primarily attributed to good training, consistent processes for interviewing and documentation, ongoing team discussions related to administration of GAS guides, and confirmation of the wording of goals by the patients themselves. We suggest that some review process to confirm GAS guide construction is worthwhile, but likely needed only in the initial learning or implementation stages (and perhaps intermittently thereafter).

While our team completed the interviews over the phone, using video calls would make it easier for interviewers to read body language and provide comfort, support, and empathy when difficult topics are being discussed. In our ongoing work and research with older adults, we have found that many are comfortable using video-conference software [60]. The COVID-19 pandemic prompted the increased use of technology of older adults, so more older adults are likely to be confident in the use of video-conferencing software [61]. In-person interviews would also have advantages, though would require additional time and resources, as was found by Toto et al. [31].

Finally, drawing on our teams’ experience, we emphasize the need for GAS interviewers to have a strong sense of empathy and sensitivity – a need that has been suggested in previous studies [62]. We recommend that data collectors approach these conversations with tact and sensitivity, and that they highlight the potentially sensitive nature of GAS discussions in recruitment materials and interview introductions.

Interviews can have an impact on relationship building with patients, and consequently the rapport needed to set meaningful goals. Mallinson [63] has described the “interactional strangeness” of standardised survey interviews which can limit sense making, potentially constraining effective communication. Nevertheless, as Greenhalgh and colleagues [64] note, standardized interviews, particularly with the objective of creating individualized PROMs, can still support better communication with patients. Lewis and colleagues [65] have proposed that Goal Attainment Scaling be used in combination with motivational interviewing in a process to set and monitor client-centred goals.

Strengths & limitations

Our study has a number of strengths and limitations. Our sample size was small, and most of the participants were of North American or European origin, thus results are not necessarily generalizable to a larger more diverse population. In future GAS studies for older adults, it is recommended that a larger and more diverse sample of older adults is recruited. We were unable to contact 11/40 patients for follow-up interview. More sustained efforts may have resulted in lower attrition, but we note that our attrition rate was fairly close to that experienced by Ford et al. [11], who were unable to obtain follow-up data on 11/52 participants.

The use of GAS by a non-clinician interviewer rather than by a clinician may make regular use of GAS more feasible in that it could be done routinely by non-clinical members of a primary care team. A strength of this study was that, due to our use of telephone interviews, we were able to recruit patients from a larger geographic region. This was more cost-effective and avoided the efforts that would have been required for participants to transport themselves to a clinic. Although the personal nature of GAS discussions may have been more comfortable in-person, it was feasible to conduct interviews by phone. By checking-in and re-interviewing the participants over time, relationships between the participants and the interviewers were developed that could have the potential to create continuity and make the experience more enjoyable for the participant. On the other hand, while we do not have specific reasons for our inability to contact some participants, in some cases calls may not have been returned because these patients did not value the process.

We found that the interviewer and a second researcher constructed similar GAS follow-up guides from the same interview. Comparison of two independent goal-setting interviews might have produced guides with greater differences.

This study involved non-clinician interviewers conducting interviews to facilitate goal-identification by patients, and we were unable to compare these goals with ones that had been identified by clinicians. GAS goals that are developed by regular health care providers may be informed by a stronger clinical understanding of the patient’s history and health conditions, but there is also evidence that clinicians do not always engage patients effectively in decision-making around their care [6]. A goal-setting process involving non-clinicians might add information to the care planning process that might otherwise have been missed, for example in identifying quality of life goals (such as maintaining leisure interests) that might not be considered in a typical clinical assessment. Future research could compare goals set independently by clinicians and non-clinician interviewers; this research could investigate whether patients were more or less comfortable speaking with a non-clinician about their goals than with a clinician.

We characterize GAS as a PROM, as have others [12, 66, 67]. We should note however that others may categorize GAS differently. Reuben and Jennings [37] differentiate GAS from PROMs in terms of the types of goals considered by each approach; they suggest the use of GAS for objective goals and PROMs for subjective goals involving patients’ expressions of their feelings and perceptions. In our view, both approaches can accommodate patients’ reports of objective goals or outcomes as well as their subjective expressions of outcomes such as anxiety or depression. We also acknowledge that GAS could be applied in a manner in which patient perspectives or outcome goals were NOT considered, for example if goals were set by clinicians without consultation with their patients. In our view however, such an application would not realize much of the potential benefits of individualized outcome measurement.

Conclusions

In terms of the criteria we had set for the feasibility of GAS as a PROM for older patients in primary care, we found that individual goals could be elicited in a telephone interview by a lay interviewer (criterion 1), and that there was good agreement between laypersons on the goals that were set based on the same patient interview (criterion 2). Criteria 3 and 4 – a targeted average of three goals per patient, and follow-up reviews completed after six months - were not completely achieved, though our results (average of 2.2 goals per patient, and 72.5% follow-up) were similar to results achieved by Ford et al. [11]. Our study also yielded an inventory of patient goal areas that could be used as a starting point for future goal-setting interviews in primary care.

Goal Attainment Scaling is a tool that can be used to support engagement in health care decision making in a variety of settings by encouraging patients to take an active role in developing their care plans by identifying their own goals and priorities. Overall, we found promising evidence of the feasibility of administration of GAS in primary care by non-clinician interviewers, as well as limitations and a need for further research in this context. Building on the results of this study, we see potential applications of GAS as a PROM in both clinical practice and clinical research. In clinical practice, completion of GAS by non-clinician interviewers may facilitate greater engagement of older patients in goal setting and decision-making in primary care settings where the time available for health care professionals to participate in these activities is constrained. A telephone-based approach holds promise with the experience of the COVID-19 pandemic in mind. Clinical research applications could include use of GAS to gain insight into the goals and priorities of older patients and to assess the effectiveness of treatment approaches aimed at achieving these outcomes. In this study, we found GAS to be feasible with older patients at varying levels of health risk, but we note that patients seemed more comfortable discussing some types of goals (e.g., physical activity) than others (e.g., mental health). Future research should continue to investigate for which older patients and treatment goals GAS might be best targeted in primary care settings.

Data Availability

Under the terms of the ethics clearance received for this project, our data are unavailable for sharing.

Abbreviations

EQ-5D-5L:

The EuroQol five dimensions, five levels

GAS:

Goal Attainment Scaling

PROMs:

Patient reported outcome measures

References

  1. Institute of Medicine (US) Committee on Quality of Health Care in America (2001) Crossing the quality chasm: a new health system for the 21st century. National Academies Press (US). https://doi.org/10.17226/10027. Washington (DC)

  2. Agency for Healthcare Research and Quality (2018) Six domains of health care quality. https://www.ahrq.gov/talkingquality/measures/six-domains.html. Accessed 26 Jan 2023

  3. Santana MJ, Manalili K, Jolley RJ, Zelinsky S, Quan H, Lu M (2017) How to practice person-centred care: a conceptual framework. Health Expect 21(2):429–440. https://doi.org/10.1111/hex.12640

    Article  PubMed  PubMed Central  Google Scholar 

  4. Bergeson SC, Dean JD (2006) A systems approach to patient-centered care. JAMA 296(23):2848–2851. https://doi.org/10.1001/jama.296.23.2848

    Article  CAS  PubMed  Google Scholar 

  5. Bernacki RE, Block SD (2014) Communication about serious illness care goals: a review and synthesis of best practices. JAMA Intern Med 174(12):1994–2003. https://doi.org/10.1001/jamainternmed.2014.5271

    Article  PubMed  Google Scholar 

  6. Elliott J, McNeil H, Ashbourne J, Huson K, Boscart V, Stolee P (2016) Engaging older adults in health care decision-making: a realist synthesis. Patient 9(5):383–393. https://doi.org/10.1007/s40271-016-0168-x

    Article  PubMed  PubMed Central  Google Scholar 

  7. Starfield B, Wray C, Hess K, Gross R, Birk PS, D’lugoff BC (1981) The influence of patient-practitioner agreement on outcome of care. Am J Public Health 71(2):127–131. https://doi.org/10.2105/AJPH.71.2.127

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  8. Boeykens D, Boeckxstaens P, De Sutter A, Lahousse L, Pype P, De Vriendt P et al (2022) Goal-oriented care for patients with chronic conditions or multimorbidity in primary care: a scoping review and concept analysis. PLoS ONE 17(2):e0262843. https://doi.org/10.1371/journal.pone.0262843

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  9. Reuben DB, Tinetti ME (2012) Goal-oriented patient care–an alternative health outcomes paradigm. N Engl J Med 366(9):777–779. https://doi.org/10.1056/NEJMp1113631

    Article  CAS  PubMed  Google Scholar 

  10. National Institute for Health and Care Excellence (2016) Multimorbidity: clinical assessment and management NICE guideline [NG56]. https://www.nice.org.uk/guidance/ng56. Accessed 26 Jan 2023

  11. Ford JA, Lenaghan E, Salter C, Turner D, Shiner A, Clark AB et al (2019) Can goal-setting for patients with multimorbidity improve outcomes in primary care? Cluster randomised feasibility trial. BMJ Open 9(6):e025332. https://doi.org/10.1136/bmjopen-2018-025332

    Article  PubMed  PubMed Central  Google Scholar 

  12. Roe D, Slade M, Jones N (2022) The utility of patient-reported outcome measures in mental health. World Psychiatry 21(1):56–57. https://doi.org/10.1002/wps.20924

    Article  PubMed  PubMed Central  Google Scholar 

  13. Kiresuk TJ, Sherman RE (1968) Goal attainment scaling: a general method for evaluating comprehensive community mental health programs. Community Ment Health J 4(6):443–453. https://doi.org/10.1007/BF01530764

    Article  CAS  PubMed  Google Scholar 

  14. Kiresuk TJ, Smith A, Cardillo JE (1994) Goal attainment scaling: applications, theory, and measurement, 1E. Psychology press, New York

    Google Scholar 

  15. Kiresuk TJ, Choate RO (1994) Applications of goal attainment scaling. In: Kiresuk TJ, Smith A, Cardillo JE (eds) Goal attainment scaling: applications, theory, and measurement, 1E. Psychology press, New York, pp 61–104

    Google Scholar 

  16. Krasny-Pacini A, Hiebel J, Pauly F, Godon S, Chevignard M (2013) Goal attainment scaling in rehabilitation: a literature-based update. An Phys Rehabil Med 56:212–230. https://doi.org/10.1016/j.rehab.2013.02.002

    Article  CAS  Google Scholar 

  17. McGarrigle L, Rockwood K (2020) The responsiveness of goal attainment scaling using just one goal in controlled clinical trials: an exploratory analysis. J Patient Rep Outcomes 4(1). https://doi.org/10.1186/s41687-020-00196-8

  18. Rabheru K, Conn D, Parsons D, Massie AS, Mitchell J, Vallis M et al (2021) Promoting health behavior change in Canada: a quality improvement project integrating prevention and wellness in frontline care. Open J Psychiatr 11(3):125–137. https://doi.org/10.4236/ojpsych.2021.113011

    Article  Google Scholar 

  19. Stolee P, Awad M, Byrne K, Deforge R, Clements S, Glenny C (2012) A multi-site study of the feasibility and clinical utility of goal attainment scaling in geriatric day hospitals. Disabil Rehabil 34(20):1716–1726. https://doi.org/10.3109/09638288.2012.660600

    Article  PubMed  Google Scholar 

  20. Gaasterland CM, Jansen-van der Weide MC, Weinreich SS, van der Lee JH (2016) A systematic review to investigate the measurement properties of goal attainment scaling, towards use in drug trials. BMC Med Res Methodol 16:99. https://doi.org/10.1186/s12874-016-0205-4

    Article  PubMed  PubMed Central  Google Scholar 

  21. Smith A, Cardillo JE (1994) Perspectives on validity. In: Kiresuk TJ, Smith A, Cardillo JE (eds) Goal attainment scaling: applications, theory, and measurement, 1E. Psychology press, New York, pp 243–272

    Google Scholar 

  22. Cardillo JE, Smith A (1994b) Reliability of goal attainment scores. In: Kiresuk TJ, Smith A, Cardillo JE (eds) Goal attainment scaling: applications, theory, and measurement, 1E. Psychology press, New York, pp 213–241

    Google Scholar 

  23. Koski J, Richards LG (2015) Reliability and sensitivity to change of goal attainment scaling in occupational therapy nonclassroom educational experiences. Am J Occup Ther 69 Suppl. https://doi.org/10.5014/ajot.2015.016535. 2:6912350030p1-6912350030p5

    Article  Google Scholar 

  24. Stolee P, Rockwood K, Fox RA, Streiner DL (1992) The use of goal attainment scaling in a geriatric care setting. J Am Geriatr Soc 40(6):574–578. https://doi.org/10.1111/j.1532-5415.1992.tb02105.x

    Article  CAS  PubMed  Google Scholar 

  25. May-Benson TA, Schoen SA, Teasdale A, Koomar J (2021) Inter-rater reliability of goal attainment scaling with children with sensory processing disorder. Open J Occup Ther 9(1):1–13. https://doi.org/10.15453/2168-6408.1693

    Article  Google Scholar 

  26. Stolee P (2016) Measuring outcomes of multidimensional geriatric assessment programs. In: Fillitt HM, Rockwood K, Young J (eds) Brocklehurst’s text Book of Geriatric Medicine and Gerontology, 8E. Saunders Elsevier, Philadelphia, pp 241–264

    Google Scholar 

  27. Stolee P, Stadnyk K, Myers AM, Rockwood K (1999) An individualized approach to outcome measurement in geriatric rehabilitation. J Gerontol A Biol Sci Med Sci 54(12):M641–M647. https://doi.org/10.1093/gerona/54.12.M641

    Article  CAS  PubMed  Google Scholar 

  28. Rockwood K, Howlett S, Stadnyk K, Carver D, Powell C, Stolee P (2003) Responsiveness of goal attainment scaling in a randomized controlled trial of comprehensive geriatric assessment. J Clin Epidemiol 56(8):736–743. https://doi.org/10.1016/s0895-4356(03)00132-x

    Article  PubMed  Google Scholar 

  29. Rockwood K, Stolee P, Fox RA (1993) Use of goal attainment scaling in measuring clinically important change in the frail elderly. J Clin Epidemiol 46(10):1113–1118. https://doi.org/10.1016/0895-4356(93)90110-m

    Article  CAS  PubMed  Google Scholar 

  30. Giovannetti ER, Clair CA, Jennings LA, Sandberg SF, Bowman A, Reuben DB et al (2021) Standardised approach to measuring goal-based outcomes among older disabled adults: results from a multisite pilot. BMJ Qual Saf 30(2):157–166. https://doi.org/10.1136/bmjqs-2019-010742

    Article  PubMed  Google Scholar 

  31. Toto PE, Skidmore ER, Terhorst L, Rosen J, Weiner DK (2015) Goal attainment scaling (GAS) in geriatric primary care: a feasibility study. Arch Gerontol Geriatr 60(1):16–21. https://doi.org/10.1016/j.archger.2014.10.022

    Article  PubMed  Google Scholar 

  32. Lafortune C, Huson K, Santi S, Stolee P (2015) Community-based primary health care for older adults: a qualitative study of the perceptions of clients, caregivers and health care providers. BMC Geriatr 15:57. https://doi.org/10.1186/s12877-015-0052-x

    Article  PubMed  PubMed Central  Google Scholar 

  33. McCarthy D, Ryan J, Klein S (2015) Models of care for high-need, high-cost patients: An evidence synthesis. Commonwealth Fund Publications, 31. Retrieved from http://www.commonwealthfund.org/~/media/files/publications/issue-brief/2015/oct/1843_mccarthy_models_care_high_need_high_cost_patients_ib.pdf

  34. Stolee P, Zaza C, Pedlar A, Myers AM (1999) Clinical experience with goal attainment scaling in geriatric care. J Aging Health 11(1):96–124. https://doi.org/10.1177/089826439901100106

    Article  CAS  PubMed  Google Scholar 

  35. Javadi D, Lamarche L, Avilla E, Siddiqui R, Gaber J, Bhamani M et al (2018) Feasibility study of goal setting discussions between older adults and volunteers facilitated by an eHealth application: development of the Health TAPESTRY approach. Pilot Feasibility Stud 4(1). https://doi.org/10.1186/s40814-018-0377-2

  36. Clair CA, Sandberg SF, Scholle SH, Willits J, Jennings LA, Giovannetti ER (2022) Patient and provider perspectives on using goal attainment scaling in care planning for older adults with complex needs. J Patient Rep Outcomes 6(1):37. https://doi.org/10.1186/s41687-022-00445-y

    Article  PubMed  PubMed Central  Google Scholar 

  37. Reuben DB, Jennings LA (2019) Putting goal-oriented patient care into practice. J Am Geriatr Soc 67(7):1342–1344. https://doi.org/10.1111/jgs.15885

    Article  PubMed  Google Scholar 

  38. Amstadter AB, Richardson L, Acierno R, Kilpatrick DG, Gaboury MT, Tran TL et al (2010) Does interviewer status matter? An examination of lay interviewers and medical doctor interviewers in an epidemiological study in Vietnam. Int Perspect Vict 5(1):55

    PubMed  PubMed Central  Google Scholar 

  39. Helzer JE, Robins LN, Croughan JL, Welner A (1981) Renard diagnostic interview: its reliability and procedural validity with physicians and lay interviewers. Arch Gen Psychiatry 38(4):393–398. https://doi.org/10.1001/archpsyc.1981.01780290027002

    Article  CAS  PubMed  Google Scholar 

  40. Rodgers B, Mann SA (1986) The reliability and validity of PSE assessments by lay interviewers: a national population survey. Psychol Med 16(3):689–700. https://doi.org/10.1017/s0033291700010436

    Article  CAS  PubMed  Google Scholar 

  41. Tzourio C, Gagniere B, El Amrani M, Bousser MG, Alpérovitch A (2003) Lay versus expert interviewers for the diagnosis of migraine in a large sample of elderly people. J Neurol Neurosurg Psychiatry 74(2):238–241

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  42. Stolee P, Elliott J, Giguere AM, Mallinson S, Rockwood K, Sims-Gould J et al (2021) Transforming primary care for older Canadians living with frailty: mixed methods study protocol for a complex primary care intervention. BMJ Open 11(5), e042911. https://doi.org/10.1136/bmjopen-2020-042911

  43. Tashakkori A, Teddlie C (eds) (2003) (eds.) Handbook of mixed methods in social & behavioral research. Sage Publications, Thousand Oaks, CA

    Google Scholar 

  44. Patton MQ (2003) Qualitative evaluation and research methods, 3rd edn. Sage Publications, Inc., Thousand Oaks, CA

    Google Scholar 

  45. Herdman M, Gudex C, Lloyd A, Janssen M, Kind P, Parkin D et al (2011) Development and preliminary testing of the new five-level version of EQ-5D (EQ-5D-5L). Qual Life Res 20(10):1727–1736. https://doi.org/10.1007/s11136-011-9903-x

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  46. Law M, Baptiste S, McColl M, Opzoomer A, Polatajko H, Pollock N (1990) The canadian occupational performance measure: an outcome measure for occupational therapy. Can J Occup Ther 57(2):82–87. https://doi.org/10.1177/00084174900570020

    Article  CAS  PubMed  Google Scholar 

  47. Cardillo JE, Smith A (1994a) Psychometric issues. In: Kiresuk TJ, Smith A, Cardillo JE (eds) Goal attainment scaling: applications, theory, and measurement, 1E. Psychology press, New York, pp 173–212

    Google Scholar 

  48. Zaza C, Stolee P, Prkachin K (1999) The application of goal attainment scaling in chronic pain settings. J Pain Symptom Manage 17(1):55–64. https://doi.org/10.1016/S0885-3924(98)00106-7

    Article  CAS  PubMed  Google Scholar 

  49. Guo HJ, Sapra A (2022) Instrumental activity of daily living. In StatPearls [Internet]. StatPearls Publishing, Treasure Island (FL). 2022 Jan. https://pubmed.ncbi.nlm.nih.gov/31985920/

  50. Kangovi S, Mitra N, Smith RA, Kulkarni R, Turr L, Huo H et al (2017) Decision-making and goal-setting in chronic disease management: baseline findings of a randomized controlled trial. Patient Educ Couns 100(3):449–455. https://doi.org/10.1016/j.pec.2016.09.019

    Article  PubMed  Google Scholar 

  51. Salter C, Shiner A, Lenaghan E, Murdoch J, Ford JA, Winterburn S et al (2019) Setting goals with patients living with multimorbidity: qualitative analysis of general practice consultations. Br J Gen Pract 69(684):e479–e488. https://doi.org/10.3399/bjgp19X704129

    Article  PubMed  PubMed Central  Google Scholar 

  52. Hurn J, Kneebone I, Cropley M (2006) Goal setting as an outcome measure: a systematic review. Clin Rehabil 20(9):756–772. https://doi.org/10.1177/0269215506070793

    Article  PubMed  Google Scholar 

  53. Locke EA, Latham GP (2002) Building a practically useful theory of goal setting and task motivation: a 35-year odyssey. Am Psychol 57(9):705–717. https://doi.org/10.1037/0003-066X.57.9.705

    Article  PubMed  Google Scholar 

  54. Rietkerk W, Uittenbroek RJ, Gerritsen DL, Slaets JP, Zuidema SU, Wynia K (2021) Goal planning in person-centred care supports older adults receiving case management to attain their health-related goals. Disabil Rehabil 43(12):1682–1691. https://doi.org/10.1080/09638288.2019.1672813

    Article  PubMed  Google Scholar 

  55. Haladay D, Ditwiler RE, Klein AB, Miro R, Lazinski M, Swisher LL et al (2022) Goal attainment scaling in outpatient physical therapy for chronic low back pain: protocol for a mixed methods study. JMIR Res Protoc 11(3):e32457. https://doi.org/10.2196/32457

    Article  PubMed  PubMed Central  Google Scholar 

  56. Lauritzson A, Eckerdal D, Atroshi I (2023) Responsiveness of the patient-specific canadian occupational performance measure and a fixed-items activity limitations measure in patients with dupuytren disease. J Patient Rep Outcomes 7(1):38. https://doi.org/10.1186/s41687-023-00579-7

    Article  PubMed  PubMed Central  Google Scholar 

  57. McGarrigle L, Roberts JC, Denne M, Rockwood K (2019) Exploring the responsiveness of goal attainment scaling in relation to number of goals set in a sample of hemophilia-A patients. J Patient Rep Outcomes 3(1). https://doi.org/10.1186/s41687-019-0110-9

  58. Cytrynbaum S, Ginath Y, Birdwell J, Brandt L (1979) Goal attainment scaling: a critical review. Eval Q 3:4–20. https://doi.org/10.1177/0193841X7900300102

    Article  Google Scholar 

  59. Kiresuk TJ, Choate RO, Cardillo JE, Larsen N (1994) In: Kiresuk TJ, Smith A, Cardillo JE (eds) Goal attainment scaling: applications, theory, and measurement, 1E. Psychology press, New York, pp 105–117

    Google Scholar 

  60. Abdallah L, Stolee P, Lopez KJ, Whate A, Boger J, Tong C (2022) The Impact of COVID-19 on Older Adults’ Perceptions of Virtual Care: Qualitative Study.JMIR aging 5(4), e38546. https://doi.org/10.2196/38546. Accessed 26 Jan 2023

  61. AGE-WELL (2020) COVID-19 has significantly increased the use of many technologies among older Canadians: Poll. https://agewell-nce.ca/archives/10884. Accessed 26 Jan 2023

  62. Colistro FP (1977) Empathy, client depth of experiencing, and goal attainment scaling: A within-session examination of the client-centred therapy process. Dissertation, University of British Columbia. https://open.library.ubc.ca/soa/cIRcle/collections/ubctheses/831/items/1.0054605

  63. Mallinson S (2002) Listening to respondents: a qualitative assessment of the short-form 36 Health Status Questionnaire. Social Sci Med 54(1):11–21. https://doi.org/10.1016/s0277-9536(01)00003-x

    Article  Google Scholar 

  64. Greenhalgh J, Gooding K, Gibbons E, Dalkin S, Wright J, Valderas J et al (2018) How do patient reported outcome measures (PROMs) support clinician-patient communication and patient care? A realist synthesis. J Patient Rep Outcomes 2:1–28. https://doi.org/10.1186/s41687-018-0061-6

    Article  Google Scholar 

  65. Lewis TF, Larson MF, Korcuska JS (2017) Strengthening the planning process of motivational interviewing using goal attainment scaling. J Ment Health Couns 39(3):195–210. https://doi.org/10.17744/mehc.39.3.02

    Article  Google Scholar 

  66. Schick-Makaroff K, Karimi-Dehkordi M, Cuthbertson L, Dixon D, Cohen SR, Hilliard N et al (2021) Using patient- and family-reported outcome and experience measures across transitions of care for frail older adults living at home: a meta-narrative synthesis. Gerontologist 61(3):e23–e38. https://doi.org/10.1093/geront/gnz162

    Article  PubMed  Google Scholar 

  67. Stanley J, Howlett SE, Dunn T, Rockwood K (2021) The Clinician’s interview-based impression of change (plus caregiver input) and goal attainment in two dementia drug trials: clinical meaningfulness and the initial treatment response. Alzheimers Dement 17(5):856–865. https://doi.org/10.1002/alz.12242

    Article  CAS  PubMed  Google Scholar 

Download references

Acknowledgements

We thank the research participants for their contributions to this project, and for sharing their health care goals with our team.

Funding

This project is funded by the Canadian Frailty Network (CFN), grant (blinded for review), which is funded by the Government of Canada’s Networks of Centres of Excellence (NCE) program. This research was completed independently from the funding agency, CFN had no role in determining the study design, analysis, results or discussion.

Author information

Authors and Affiliations

Authors

Contributions

PS, JE conceived of the study, JE, SM, MB, AK & CT collected data and, with LA, analyzed the data. PS & LA drafted the manuscript, with support and input from all co-authors. All authors reviewed the manuscript. The authors read and approved the final manuscript.

Corresponding author

Correspondence to Paul Stolee.

Ethics declarations

Ethics approval and consent to participate

Ethics approvals were obtained from the University of Waterloo, and the University of Calgary. All participants provided informed consent.

Consent for publication

Not applicable.

Competing interests

The authors declare that they have no competing interests.

Additional information

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article’s Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article’s Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Stolee, P., Mallinson, S., Kernoghan, A. et al. Feasibility of Goal Attainment Scaling as a patient-reported outcome measure for older patients in primary care. J Patient Rep Outcomes 7, 78 (2023). https://doi.org/10.1186/s41687-023-00615-6

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1186/s41687-023-00615-6

Keywords