Skip to main content
Journal of Patient-Reported Outcomes
Download PDF
Download ePub

A systematic review of goal attainment scaling implementation practices by caregivers in randomized controlled trials

Journal of Patient-Reported Outcomes volume 8, Article number: 37 (2024) Cite this article

Abstract

Background

Goal attainment scaling (GAS), an established individualized, patient-centred outcome measure, is used to capture the patient’s voice. Although first introduced ~60 years ago, there are few published guidelines for implementing GAS, and almost none for its use when caregivers GAS is implemented with caregiver input. We conducted a systematic review of studies that implemented GAS with caregiver input; and examined variations in GAS implementation, analysis, and reporting.

Methods

Literature was retrieved from Medline, Embase, Cochrane, PsycInfo and CINAHL databases. We included randomized controlled trials (published between 1968 and November 2022) that used GAS as an outcome measure and involved caregiver input during goal setting.

Results

Of the 2610 studies imported for screening, 21 met the inclusion criteria. Most studies employed GAS as a primary outcome. The majority (76%) had children as study participants. The most common disorders represented were cerebral palsy, developmental disorders, and dementia/Alzheimer’s disease. The traditional five-point GAS scale, with levels from −2 to +2, was most often implemented, with −1 level typically being the baseline. However, most studies omitted essential GAS details from their reports including the number of goals set, number of attainment levels and whether any training was given to GAS facilitators.

Conclusions

GAS with caregiver input has been used in a limited number of randomized controlled trials, primarily in pediatric patients and adults with dementia. There is a variability in GAS implementation and many crucial details related to the specifics of GAS implementation are omitted from reports, which may limit reproducibility. Here we propose catalog that may be utilized when reporting research results pertaining to GAS with caregivers to enhance the application of this patient-centered outcome measure.

Background

Goal attainment scaling (GAS), an established individualized, patient-centered outcome measure, has been applied across multiple disciplines to capture the patient voice [1,2,3,4,5]. This outcome measure provides both qualitative and quantitative information on progress towards goal attainment after an intervention or treatment and allows assessment of clinically meaningful change that is unique to each patient. The individualized nature of GAS makes it suitable for use in disorders with heterogeneous symptoms and disease progression [2], especially where generic outcome measures fail to achieve the required sensitivity and specificity [6].

GAS was first introduced by Kiresuk and Sherman in 1968 to evaluate outcomes in a mental health setting [7]. Since then, it has been successfully adapted for use in many other domains, including stroke rehabilitation [8, 9], drug trials [2], back pain [10], rehabilitation [3], communication disorders [11], and in other older adults with dementia [1], and complex needs [12]. There is growing evidence that GAS is sensitive to change and can capture clinically meaningful changes that often are ignored or are not elicited by standardized tests [6]. For instance, in an investigation of the feasibility, validity and responsiveness of GAS in long-term care, researchers reported that among several other measures, GAS was the most responsive measure, with an effect size of 1.29 and a relative efficiency of 53.7 [13]. Several other reports have also emphasized its responsiveness in capturing treatment effects [14,15,16,17,18,19].

The goal setting process starts with an interview between the patient (and/or caregiver) and an interviewer to identify those goals that are most important to each individual patient. For each unique goal, typically a baseline level at −1 and four other attainment levels are set, ranging from +2 (much better than the goal, best-expected outcome) to −2 (worst than the goal, worst expected outcome) [7]. A post-intervention assessment is performed where the goal rater (e.g. the patient or caregiver and/or clinician) describes the level of attainment achieved for each goal. Then for each participant a GAS score, called the T-score, is calculated based on the formula proposed by Kiresuk and Sherman [7]:

$${\text{T}} = {50 + (10\sum {({{\text{w}}_i}{{\text{x}}_i})})}/\surd\,((1 - \rho)\sum {{\text{w}}_i^2} + \rho\,{(\sum {{\text{w}}{{\text{i}}_i}})^2})$$

wi = weight assigned to the ith goal

xi = numerical value of the goal attainment achieved (between −2 and +2)

ρ = expected correlation of the goal scales.

The T-score allows an expression of goal attainment in multiple goal scales in a single score for each patient. The formula assumes scales to be normally distributed, and usually, a mean T-score of 50 indicates that all goals were attained.

GAS goals are often identified and set by the patient to reflect their own personal goals of treatment with input from clinicians or other trained personnel [3]. However, in many circumstances, patients may be unable or minimally able to participate in goal setting. Patient input may be inadequate to set treatment goals and/or to assess attainment levels in studies of interventions in children or in people who live with cognitive impairment. Under these circumstances, caregivers, in partnership with the patient and/or clinician, can help with individualized goal setting, and evaluation of goal attainment after an intervention. In this context, caregivers are defined as those individuals that provide support and are close to the patients so that they are attuned to the patient’s challenges and needs. They provide input to goal scale development and assessment when the patients lack cognitive (i.e. older adults with dementia) and/or communicative capacity (children with severe developmental delay).

Several reviews have addressed aspects of GAS including its reliability [20], validity [21], and utility in specific disorders [1,22,23]. In addition, Logan et al. [4] recently reviewed GAS implementation practices when it is used as an outcome measure in randomized controlled trials. They reported that GAS implemented by patients provides data on individualized outcomes in a wide range of disorders [4]. However, much less is known about GAS implementation when caregivers take part in setting goals and assessment of attainment levels. The objectives of this review are to determine the most common GAS implementation practices with caregiver input in the context of clinical trials, and assess variations in the implementation, analysis, and reporting.

Methods

Protocol and registration

We conducted a systematic review search according to the PRISMA guidelines [24]. The search protocol was registered in PROSPERO in October 2021.

Databases and searches

We searched Medline, Embase, Cochrane, PsycInfo and CINAHL databases for literature on GAS. The included studies needed were from 1968 (the year when GAS was first introduced; [7]) to Nov 27, 2022. Searches of the following keywords were performed:

Randomized controlled trials, family care*, carer*, caregiver*, prox*, parent*, goal set*, goal plan*, goal attain*, goal achiev*, care* goal*. The full search strategy is included as a supplementary materials file (Supplementary File 1). The PRISMA flowchart is illustrated in Fig. 1.

Fig. 1
figure 1

The PRISMA 2020 flow diagram for new systematic reviews. This includes searches of databases and registries only. From Page MJ, McKenzie JE, Bossuyt PM, Boutron I, Hoffmann TC, Mulrow CD, et al. The PRISMA 2020 statement: an updated guideline for reporting systematic reviews. BMJ 2021;372:n71. doi: 10.1136/bmj.n71. For more information, visit: http://www.prisma-statement.org/

Full size image

The reference lists of the articles that were included in the full-text screening stage were also consulted to find additional articles eligible for this study. The inclusion criteria were:

  1. 1.

    Randomized controlled studies

  2. 2.

    A caregiver (or a proxy or a parent) was involved in the goal setting process, with or without the input of patients through an interview with a GAS rater (or clinician).

  3. 3.

    The goals are personalized for each subject

  4. 4.

    Published in English

  5. 5.

    Published after 1968.

Studies were excluded if they mentioned the concept of goal attainment but did not use any scaling procedure to evaluate goal achievement, or when goal setting was used as an intervention and not as outcome measure. Additionally, any reports that were simply conference abstracts or narrative reviews were excluded.

Data extraction and quality assessment

Three researchers teamed up to screen and review the articles, of whom one (KC) screened all the abstracts and full texts. To ensure consistency of the abstract selection process by a single screener, 25% of the abstracts were screened by a second reviewer. In case of disagreement, a third reviewer (SH) was consulted to resolve the conflicts. This additional step was used to increase the confidence in having a single screener. The third reviewer (SH) was also consulted on the inclusion criteria at the full-text stage. Covidence software (Covidence.org) was used to perform the screening and data extraction. A standard data extraction form was created in the Covidence program.

We extracted information on study characteristics (number of sites, sample size, intervention details), and on risk of bias for randomized controlled trials (allocation sequence use, allocation sequence concealment, blinding of the participants and personnel, blinding of outcome assessment, completion rate of outcome assessments, reporting of all outcome assessments), GAS implementation details (number of goals set, number of levels set, personnel performing goal setting and attainment, quality assurance details, use of goal menu, weighting of goals, goal calibration) and GAS analysis details (types of treatment effects, effect sizes reported, statistical tests used). The full list of extracted variables is included in Supplementary File 2.

Analysis

A descriptive and narrative synthesis of the implementation practices of goal attainment scaling was performed. This included synthesizing information on the most common approaches to goal setting, interview process, use of goal menus and different approaches to GAS score calculation.

We also reported and summarized effect size values as Cohen’s d. For the studies that did not report Cohen’s d, we calculated Cohen’s d where possible with the following formula:

$${\text{Cohen's}}\,d = {\text{M}}_{1}-{\text{M}}_{2}/{\text{pooled}}\,{\text{SD}}$$

where M = mean, SD = standard deviation.

The pooled standard deviation was calculated with the following formula:

$${\text{Pooled}}\,{\text{SD}} = \surd\, (({{\rm n}_1} - 1){\text{S}}{{\text{D}}_{\text{1}}}^2 + ({{\rm n}_2} - 1){\text{S}}{{\text{D}}_{\text{2}}}^2/({\rm n}_1 + {\rm n}_2 - 2)$$

n = sample size; SD = standard deviation

In cases of multiple effect sizes (i.e. multiple treatment groups or follow-up times), only the effect sizes for the highest dose and the final endpoint were reported. Two studies did not have sufficient information to calculate Cohen’s d [25, 26].

Results

Search results

The search resulted in 623, 964, 425, 129 and 469 abstracts from Embase, Cochrane, Medline, PsychInfo and CINAHL databases, respectively. Duplicate records (N = 731) were removed. The resulting articles (N = 1879) were screened at the abstract and title level. This excluded 1388 articles, leaving 491 for full-text review. The reasons for exclusion at the full-text review were the following: incorrect study design; abstract only; caregivers were not involved in goal setting; GAS was not an outcome measure; the work was simply a study protocol; or GAS was used as an intervention (Fig. 1). Based on this screening a further 470 studies were excluded, leaving 21 studies that were included in this review.

Study characteristics

Most of the studies were conducted in Australia, followed by the US and Canada (Table 1). The most common disorders in the review were cerebral palsy (38%), developmental delay (23%) and dementia/Alzheimer’s disease (19%); other disorders were less common (Table 1; Fig. 2A). The total sample sizes varied from 20 to 1533, with a median sample of 41 (The sample sizes from Rockwood [27, 28] were excluded from this calculation as they are from the same study). Sixteen studies (76%) had children as the study participants. The rest were adults. Eleven studies (52%) had GAS as a primary outcome, with 8 studies using the Canadian Occupational Performance Measure (COPM) as an additional patient reported outcome measure used in conjunction with GAS.

Table 1 Study and participant characteristics
Full size table
Fig. 2
figure 2

Characteristics of the GAS studies reviewed. A Most studies reviewed considered children with cerebral palsy or developmental delay. B, C The GAS raters were most often the clinician or researcher alone, while patients and caregivers together were most likely to set goals. D, E The most common baseline level was −1, and most studies used five attainment levels. Bar graphs depict the number of studies with each characteristic

Full size image

Risk of bias

Risk of bias was assessed using Cochrane’s risk assessment tool (version 1) and included the following criteria: allocation sequence use, allocation sequence concealment, blinding of the participant and personnel, blinding of outcome assessment, completion rate of outcome assessments, and reporting of all outcome assessments. Most studies utilized a generated allocation sequence in a sufficient manner (72%) and concealed it appropriately to prevent selection bias (57%). However, the participants and personnel were blinded to the intervention in only a few studies (14%), and the outcome assessment was conducted in a blinded manner to prevent performance bias and detection bias (19%). On the other hand, the majority of studies reported the completion rate of outcome assessment to prevent attrition bias (76%) and included all outcome assessments in their reports to prevent reporting bias (76%). The results of the risk assessment are visualized using robvis [44] and are included in Supplementary File 3.

Application of GAS used by caregivers in clinical trials

Several different approaches were used in employing GAS with caregiver input during goal setting (Figs. 2 and 3). Most studies (76%) reported that both the patient and the caregiver set goals collaboratively (76% of studies; Fig. 2C). In the remaining studies, only the caregiver was involved in goal setting. While caregiver input was utilized in setting goals, they were not always included in the assessment of attainment levels. In many cases the clinicians and/or researchers were the most likely to be involved in such assessment (e.g. GAS raters), followed by caregivers (Fig. 2B). Two studies noted that independent raters scored goal attainment (Fig. 2C). Most studies reported the use of −1 as the baseline, with 0 level being the next most used baseline (Fig. 2D). The traditional five-point GAS scale from −2 to +2 was most often implemented, with 10 studies (48%) using the classic 5 attainment levels (Fig. 2E). Two studies reported the use of a 7-point GAS scale ranging from −3 to +3; one study used a 6-point scale (from −2 to +3) (Fig. 2E).

Fig. 3
figure 3

The number of studies that reported or did not report specific details used in GAS analysis. A–F Studies that used GAS did not routinely report many aspects of their GAS methodology and analysis. Bar graphs depict the number of studies with each characteristic that was either reported or not reported in the study reviewed. The sample size in each panel was 21

Full size image

Most studies did not report the number of goals set. Six studies (29%) specified the total number of goals set (Fig. 3A). The mean number of total goals set across all studies was 287 (median number of goals = 300.5; range = 30 to 516). The range of goals or mean/median number of goals set was rarely reported, with 3 studies reporting the mean and 1 study reporting the median number of goals set for each patient group. The mean number of goals per participant ranged from 2.2 to 3.7 (median number = 3 goals per participant). Under-reporting of the baseline level was also common, with 12 studies not reporting this information (Fig. 3B). Most studies (n = 14) reported the number of GAS attainment levels used (Fig. 3C). Five studies weighted the goals, and all were based on how important the goals were to the patient and/or caregivers (Fig. 3D).

Very few studies reported whether any training was given to the personnel conducting GAS, with only 3 out of the 21 studies (15%) reviewed indicating that GAS raters were trained (Fig. 3E). One study (5%) reported that GAS raters completed a 4-h training program [45] while another (5%) reported that raters completed an 8-h training program [9]. None of the studies reviewed stated that they used a formal goal menu or goal inventory during the goal setting process. The occupational therapy-based patient-reported outcome measure (COPM), was collected along with GAS in 8 studies. There was a mix of approaches with these measures, where some studies used GAS and COPM separately, while others used these measures in a complementary fashion. In this latter case, the goal categories in the COPM were used to help patients and caregivers with goal setting.

GAS analysis

Figure 4 illustrates the approaches used for GAS analysis. T-tests were generally used to analyze between-group treatment effects, with a Student’s t-test or an unequal variance t-test being the most common. This was followed by non-parametric tests, with the Wilcoxon Mann-Whitney and chi-square tests most often employed. Other statistical tests included regression analysis, analysis of variance and paired-sample t-tests (Fig. 4A, B).

Fig. 4
figure 4

Analysis techniques used in the GAS studies reviewed. A All but one study calculated the GAS score with the traditional T-score formula. B Different statistical tests of significance were used, with the Student’s or unequal variance t-test being the most common. C Effect sizes were measured as the mean change score, Cohen’s d or the standardized response mean. Bar graphs depict the number of studies with each analytic technique. Where the sample size was greater than 21 (panel B), more than one analysis technique was used

Full size image

All studies used the T-score formula originally proposed by Kiresuk & Sherman [23] to summarize the GAS scores. One study reported the mean of raw goal scores and divided participants in terms of those who responded to treatment and those who did not (Fig. 4A). Studies generally reported some measure of effect size (Fig. 3F), including mean change scores, standardized response means, and Cohen’s d (Fig. 4C). The most common effect size measure reported was mean change scores, with 8 out of 21 studies (39%) reporting this measure. We also summarized Cohen’s d values from all the studies included in this review to investigate the responsiveness of GAS. We found that Cohen’s d values ranged from −0.015 to 2.56 with a median effect size of 0.52. Most studies had medium to high effect sizes (e.g. effects sizes between 0.5 and 0.8), with the 4 studies showing small effect sizes (e.g. effects sizes between 0.1 and 0.4) [45].

Discussion

Here we systematically investigated GAS implementation practices with caregiver input during goal setting in randomized controlled trials; and observed that GAS was employed in a limited number of randomized controlled trials, primarily in pediatric patients and adults with dementia. We also found out that the implementation and reporting of GAS implementation practices was inconsistent and often incomplete, which may affect assessments of GAS validity and may also hinder replication efforts.

Common practices for GAS were identified across the 21 studies. Both patients and caregivers were consulted for goal setting, with few studies including only the caregivers. The inclusion of caregivers along with the patient may help preserve the patient-centered nature of GAS, while allowing a caregiver to contribute to the treatment plan. While patient and/or caregiver input was utilized in setting goals, the clinicians and/or researchers were the most likely to be involved in the assessment of goal attainment, followed by caregivers, and independent assessors. There are multiple ways to include caregivers in the GAS process (only during goal setting, only during the assessment of goal attainment, or during both; with or without patient involvement) and best practices for caregiver involvement in GAS are yet to be developed.

The results of this review suggest that within the context of GAS, caregiver input is typically utilized not as proxy, but to complement patient input and, in line with the occasional appearance of term ‘proxy’ in the identified studies (only in [31, 40]), caregiver input is used as a substitute for patient input only when it is necessary to do so (i.e. patients with severe cognitive impairment and/or very young children). Yet, this warrants an examination of the association between patient and proxy (caregiver-as-proxy) responses. Researcher examining the accuracy of proxy reports indicated a differentiation between subjective and objective domains; and that the proxies had higher accuracy in objective domains such mobility, self-care, and activities, as opposed to more objective domains such as pain and emotional state, or other psychosocial domains [46, 47]. Other researchers examining accuracy of proxy-report indicated that they may be a reasonable alternative when patient self-report cannot be obtained and when group mean scores are averaged across individuals [48]. Yet, the researchers suggested that the proxy report should be interpreted more cautiously [49,50,51], especially when used to assess meaningful change at the individual level [48]. Additional research that explores potential divergence between patient and caregiver priorities during goal setting, and the impact of caregiver involvement on specific goal domains could be illuminating.

For the majority of studies, the quality assessment indicated a lower risk for selection, attrition, and reporting bias, with a higher risk for performance and detection biases. While a considerable number of studies reported medium to large effect sizes, the high risk in performance and detection bias and absence of blinding might have an influence on reported medium-to-high effect sizes. Future studies might benefit from minimizing such risk in the design execution, analysis, and reporting of randomised trials.

The recommendations for implementing GAS proposed by Kiresuk and Sherman [7] were followed by most researchers/clinicians including the use of a five-point scale, a value of −1 for the baseline and the use of the GAS T-score formula. The most common statistical test used to compare between-group treatment effects was a t-test. These details are critical for the use of GAS as an outcome measure and this suggests that, in general, these practices are being followed by most researchers. As the naming T-score may wrongly give the impression of truly standardized interval scale, application of quality appraisal criteria during goal scale development (e.g. [52, 53]), and testing for statistical assumptions is recommended (see [3] for a review).

In addition to documenting how GAS with caregiver input is deployed, we draw to attention the inconsistent and incomplete reporting of many details with respect to the GAS implementation. These include the failure to report the number of goals set, number of attainment levels set, and whether any training was given to GAS facilitators. Reporting these details would not only help in the assessment of the validity of the measure, but also will help in the replication of GAS by different investigators, across multiple disorders and in different contexts.

Similarly, information on the type of GAS training could also help to evaluate the quality of goal setting in studies. Three studies reported the type of training provided to GAS personnel [18, 30, 43]. Even in these studies, there were few details provided about the training, with two studies reporting the duration of the training, which ranged from 4 to 8 h. The description of the training also was vague. Cusick et al. [30] reported a training programme that included “GAS development, administration and scoring; reading, modelling, in-situ practice, feedback on administration and practice scales,” while Tilton et al. [43] noted that “Injectors were trained in applying GAS methodology and set SMART (Specific, Measurable, Achievable, Relevant, and Time-Bound) goals through series of workshops.” None of these articles referenced the use of any previous studies or guides on GAS training, despite published procedures for GAS rater training [54] and for writing SMART rehabilitation goals [55]. In addition, reviews and guides that describe how to implement GAS and goal setting across in different contexts [3, 55,56,57,58,59] and conditions such as dementia [60] could have been referenced as well. However, most of these guides are related to rehabilitation work, which might have inhibited investigators from other fields from consulting this literature.

Most studies with caregivers had children as the patient population. This is not surprising considering the critical role of caregivers in populations who require advocacy and help. This is important, as GAS has been recommended to improve the transparency and tuning of rehabilitation goals with parents during a child’s rehabilitation process [61]. Our review highlights the relevance of this measure to children as well. However, we have not examined whether the nature of the relationship within different patient-caregiver dyads (i.e. children and their parents, residential care workers or other paid care providers as caregivers), or patient population (i.e. children versus older adults) impacts GAS implementation. Future research the impact of this relationship on the type and number of goals set, assessment of attainment levels or other GAS-related criterion would be of interest.

Our review identified a relatively small number of clinical trials that used caregiver input to deploy GAS when compared to results of a recent review that examined the use of GAS in clinical trials in general [4]. This suggests that caregivers are used less frequently than the patients themselves, primarily in pediatric patients and adults with dementia. While all studies reviewed here had caregivers involved in goal setting (i.e. caregiver GAS), two studies had an additional GAS measurement performed by a clinician. In Rockwood et al. [18], the end-point standardized response mean was 0.22 for caregiver GAS and 0.38 for clinician GAS. In Lowe et al. [36], Cohen’s d was 2.56 for caregivers and 3.32 for clinicians. In both instances, the effect sizes between the clinician and caregiver GAS were close, although GAS attainment was rated higher by the clinician than by the caregiver. While these authors did not discuss any reasons for this difference, it is possible that this might be due to the clinician’s experience with goal attainment. Clinicians have access to other patients in the group, so their assessment might have been made in comparison to other patients. On the other hand, higher ratings might be due to the clinicians having an altered sense of a treatment effect with patient/caregiver perspectives providing a more realistic view of treatment effects, or due to the lack of unblinding. There is a need for more studies to compare caregiver and clinician perspectives to try to identify the reasons for these discrepancies.

Interestingly, no study reported using a specific goal inventory or goal menu to assist in goal setting. In some of the studies the categories in the COPM were used to complimentary fashion to help patients and caregivers with goal setting. Goal-menus or inventories have been used in goal setting in various disorders including hemophilia [62], neurogenic bladder [63], elder mistreatment [64, 65] and dementia [66] to aid in goal setting. The goal inventory can be prepared with input from patients [67], disease experts [66], and/or both [63], with special consideration given to the conceptual model of the disease and/or the product’s proposed mechanism of action. This may enhance detection of clinically meaningful results [68]. The inventory includes a list of common challenges that can be mapped to various domains and are realistically achievable following an intervention. This makes the goal setting process easier; and helps in standardizing goals, which might be of interest to regulators, as it conforms more with most standardized measures. Furthermore, analyzing the frequency with which specific goals occur or cluster by domain can potentially help elucidate the processes by which a drug leads to the desired pharmacological effects. On the other hand, when used rigidly, it might reduce sensitivity to novel treatment effects, especially early in the course of treatments being developed [69].

As many essential details of GAS implementation do not find their way into current reports, the reproducibility of GAS may be limited. A standardized approach for consistent reporting of GAS is one remedy. Therefore, in addition to using a quality appraisal criterion during the implementation of GAS (see [53] for an example of comprehensive quality appraisal criteria in rehabilitation), we propose a catalog (Table 2) to assist researchers and clinicians in reporting the important details of GAS. The catalog lists potential items to consider when reporting GAS implementation details and is divided into two categories: GAS administration and GAS analysis, with items identified as either suggested or optional. The suggested information includes critical details to be reported related to GAS application and analysis to facilitate study replication. For example, reporting the mean change score, sample size and standard deviation of GAS scores is suggested but calculating Cohen’s d is listed as optional as Cohen’s d can be calculated from the mean and standard deviation scores.

Table 2 Catalog of potential items to include when reporting GAS implementation details
Full size table

This systematic review has potential limitations. The initial literature screening was conducted by only one reviewer during the title/abstract screening and the full-text screening stages. This may have decreased the number of relevant studies identified for use in the systematic review. As highlighted by Rachel and colleagues [70], GAS is heterogeneous group of methodologies, and lack of GAS details included in published reports poses challenges into to a synthesis of most common GAS implementation practices.

Conclusions

In summary, GAS with caregiver input during goal setting was utilized in a limited number of randomized controlled trials, primarily in pediatric patients and adults with dementia. A large majority of the studies did not report the specifics of how GAS was implemented, and this may compromise the ability of others to reproduce work or deploy GAS in new studies. While this systematic review has some limitations, such as having one reviewer during the identification and screening of the literature, given the significant heterogeneity in the design and implementation of GAS with caregiver input during goal setting, we believe a consensus on GAS methods and best practices, with input from both clinicians and patients, is warranted.

Data availability

All data generated or analyzed during this study are included in this published article.

Abbreviations

COPM:

Canadian Occupational Performance Measure

GAS:

Goal attainment scaling

SMART:

Specific, Measurable, Achievable, Relevant, and Time-Bound

References

  1. Bouwens SF, van Heugten CM, Verhey FR (2008) Review of goal attainment scaling as a useful outcome measure in psychogeriatric patients with cognitive disorders. Dement Geriatr Cognit Disord 26:528–540

    Article  Google Scholar 

  2. Gaasterland CM, Jansen-van der Weide MC, Weinreich SS, van der Lee JH (2016) A systematic review to investigate the measurement properties of goal attainment scaling, towards use in drug trials. BMC Med Res Methodol 16(1):1–22

    Article  Google Scholar 

  3. Krasny-Pacini A, Hiebel J, Pauly F, Godon S, Chevignard M (2013) Goal attainment scaling in rehabilitation: a literature-based update. Ann Phys Rehabil Med 56(3):212–230

    Article  CAS  PubMed  Google Scholar 

  4. Logan B, Jegatheesan D, Viecelli A, Pascoe E, Hubbard R (2022) Goal attainment scaling as an outcome measure for randomised controlled trials: a scoping review. BMJ Open 12(7):e063061

    Article  PubMed  PubMed Central  Google Scholar 

  5. Vu M, Law AV (2012) Goal-attainment scaling: a review and applications to pharmacy practice. Res Social Adm Pharm 8(2):102–121

    Article  PubMed  Google Scholar 

  6. Rockwood K, Howlett S, Stadnyk K, Carver D, Powell C, Stolee P (2003) Responsiveness of goal attainment scaling in a randomized controlled trial of comprehensive geriatric assessment. J Clin Epidemiol 56(8):736–743

    Article  PubMed  Google Scholar 

  7. Kiresuk TJ, Sherman RE (1968) Goal attainment scaling: a general method for evaluating comprehensive community mental health programs. Community Ment Health J 4(6):443–453

    Article  CAS  PubMed  Google Scholar 

  8. Debreceni-Nagy A, Horváth J, Nagy S, Bajusz-Leny Á, Jenei Z (2019) Feasibility of six-point goal attainment scale among subacute and chronic stroke patients. Int J Rehabil Res 42(4):365–370

    Article  PubMed  Google Scholar 

  9. Fheodoroff K, Ashford S, Jacinto J, Maisonobe P, Balcaitiene J, Turner-Stokes L (2015) Factors influencing goal attainment in patients with post-stroke upper limb spasticity following treatment with botulinum toxin A in real-life clinical practice: sub-analyses from the Upper Limb International Spasticity (ULIS)-II Study. Toxins 7(4):1192–1205

  10. Haladay D, Swisher L, Hardwick D (2021) Goal attainment scaling for patients with low back pain in rehabilitation: a systematic review. Health Sci Rep 4(3):e378

    Article  PubMed  PubMed Central  Google Scholar 

  11. Schlosser RW (2004) Goal attainment scaling as a clinical measurement technique in communication disorders: a critical review. J Commun Disord 37(3):217–239

    Article  PubMed  Google Scholar 

  12. Clair CA, Sandberg SF, Scholle SH, Willits J, Jennings LA, Giovannetti ER (2022) Patient and provider perspectives on using goal attainment scaling in care planning for older adults with complex needs. J Patient Rep Outcomes 6(1):37

    Article  PubMed  PubMed Central  Google Scholar 

  13. Gordon JE, Powell C, Rockwood K (1999) Goal attainment scaling as a measure of clinically important change in nursing-home patients. Age Ageing 28(3):275–281

    Article  CAS  PubMed  Google Scholar 

  14. Rockwood K, Stolee P, Fox PRA (1993) Use of goal attainment scaling in measuring clinically important change in the frail elderly. J Clin Epidemiol 46(10):1113–1118

  15. Rockwood K, Stolee P, Howard K, Mallery L (1996) Use of goal attainment scaling to measure treatment effects in an anti-dementia drug trial. Neuroepidemiology 15(6):330–338

  16. Hartman D, Borrie MJ, Davison E, Stolee P (1997) Use of goal attainment scaling in a dementia special care unit. Am J Alzheimer’s Disease 12(3):111–116

  17. Stolee P, Zaza C, Pedlar A, Myers AM (1999) Clinical experience with goal attainment scaling in geriatric care. J Aging Health 11(1):96–124

  18. Rockwood K, Fay S, Song X, MacKnight C, Gorman M (2006) Attainment of treatment goals by people with Alzheimer’s disease receiving galantamine: a randomized controlled trial. CMAJ 174(8):1099–1105

    Article  PubMed  PubMed Central  Google Scholar 

  19. Chew J, Chong MS, Fong YL, Tay L (2015) Outcomes of a multimodal cognitive and physical rehabilitation program for persons with mild dementia and their caregivers: a goal-oriented approach. In: Clinical interventions in aging, pp 1687–1694

  20. May-Benson TA, Schoen SA, Teasdale A, Koomar J (2021) Inter-rater reliability of goal attainment scaling with children with sensory processing disorder. Open J Occup Ther 9(1):1–13

    Article  Google Scholar 

  21. Bowman J, Mogensen L, Marsland E, Lannin N (2015) The development, content validity and inter-rater reliability of the SMART-goal evaluation method: a standardised method for evaluating clinical goals. Aust Occup Ther J 62(6):420–427

    Article  PubMed  Google Scholar 

  22. Ruble L, McGrew JH, Toland MD (2012) Goal attainment scaling as an outcome measure in randomized controlled trials of psychosocial interventions in autism. J Autism Dev Disord 42:1974–1983

    Article  PubMed  PubMed Central  Google Scholar 

  23. Wilz G, Weise L, Reiter C, Reder M, Machmer A, Soellner R (2018) Intervention helps family caregivers of people with dementia attain own therapy goals. Am J Alzheimers Dis Other Demen 33(5):301–308

    Article  PubMed  Google Scholar 

  24. Page MJ, McKenzie JE, Bossuyt PM, Boutron I, Hoffmann TC, Mulrow CD, Shamseer L, Tetzlaff JM, Akl EA, Brennan SE, Chou R, Glanville J, Grimshaw JM, Hróbjartsson A, Lalu MM, Li T, Loder EW, Mayo-Wilson E, McDonald S, McGuinness LA, Stewart LA, Thomas J, Tricco AC, Welch VA, Whiting P, Moher D (2021) The PRISMA 2020 statement: an updated guideline for reporting systematic reviews. Int J Surg 88:105906

    Article  PubMed  Google Scholar 

  25. Hoare B, Imms C, Villanueva E, Rawicki HB, Matyas T, Carey L (2013) Intensive therapy following upper limb botulinum toxin A injection in young children with unilateral cerebral palsy: a randomized trial. Dev Med Child Neurol 55(3):238–247

    Article  PubMed  Google Scholar 

  26. McMorran D, Robinson LW, Henderson G, Herman J, Robb JE, Gaston MS (2016) Using a goal attainment scale in the evaluation of outcomes in patients with diplegic cerebral palsy. Gait Posture 44:168–171

    Article  CAS  PubMed  Google Scholar 

  27. Rockwood K, Fay S, Jarrett P, Asp E (2007) Effect of galantamine on verbal repetition in AD: a secondary analysis of the VISTA trial. Neurology 68(14):1116–1121

    Article  CAS  PubMed  Google Scholar 

  28. Rockwood K, Fay S, Gorman M (2010) The ADAS-cog and clinically meaningful change in the VISTA clinical trial of galantamine for Alzheimer’s disease. Int J Geriatr Psychiatry 25(2):191–201

    Article  PubMed  Google Scholar 

  29. Armstrong J, Girdler S, Davidson E, Mizen J, Bear N, Wray J, Elliott C (2021) Randomised controlled trial of a therapeutic playgroup for children with developmental delays. J Autism Dev Disord 51:1039–1053

    Article  PubMed  Google Scholar 

  30. Cusick A, McIntyre S, Novak I, Lannin N, Lowe K (2006) A comparison of goal attainment scaling and the Canadian occupational performance measure for paediatric rehabilitation research. Pediatr Rehabil 9:149–157

    Article  CAS  PubMed  Google Scholar 

  31. Cusick A, Lannin NA, Lowe K (2007) Adapting the Canadian Occupational Performance Measure for use in a paediatric clinical trial. Disab Rehabil 29(10):761–766

  32. De Joode EA, Van Heugten CM, Verhey FR, Van Boxtel MP (2013) Effectiveness of an electronic cognitive aid in patients with acquired brain injury: a multicentre randomised parallel-group study. Neuropsychol Rehabil 23:133–156

    Article  CAS  PubMed  Google Scholar 

  33. Dimitrova R, McCusker E, Gormley M, Fehlings D, Alter KE, Greaves S, Liu C, Brin MF (2021) Efficacy and safety of onabotulinumtoxinA with standardized occupational therapy for treatment of pediatric upper limb spasticity: phase III placebo-controlled randomized trial. NeuroRehabilitation 49:469–479

    Article  PubMed  PubMed Central  Google Scholar 

  34. Huang HH, Hsieh YH, Chang CH, Tsai WY, Huang CK, Chen CL (2022) Ride-on car training using sitting and standing postures for mobility and socialization in young children with motor delays: a randomized controlled trial. Disabil Rehabil 1–8

  35. Leroi I, Atkinson R, Overshott R (2014) Memantine improves goal attainment and reduces caregiver burden in Parkinson’s disease with dementia. Int J Geriatr Psychiatry 29(9):899–905

    Article  PubMed  Google Scholar 

  36. Lowe K, Novak I, Cusick A (2006) Low-dose/high-concentration localized botulinum toxin A improves upper limb movement and function in children with hemiplegic cerebral palsy. Dev Med Child Neurol 48(3):170–175

    Article  PubMed  Google Scholar 

  37. Lowe K, Novak I, Cusick A (2007) Repeat injection of botulinum toxin A is safe and effective for upper limb movement and function in children with cerebral palsy. Dev Med Child Neurol 49(11):823–829

    Article  PubMed  Google Scholar 

  38. McKean K, Phillips B, Thompson A (2012) A family-centred model of care in paediatric speech-language pathology. Int J Speech Lang Pathol 14(3):235–246

    Article  PubMed  Google Scholar 

  39. Mills CJ, Chapparo C, Hinitt J (2020) The impact of sensory activity schedule (SAS) intervention on classroom task performance in students with autism–a pilot randomised controlled trial. Adv Autism 6(3):179–193

    Article  Google Scholar 

  40. Olesch CA, Greaves S, Imms C, Reid SM, Graham HK (2010) Repeat botulinum toxin-A injections in the upper limb of children with hemiplegia: a randomized controlled trial. Dev Med Child Neurol 52(1):79–86

    Article  PubMed  Google Scholar 

  41. Schaaf RC, Benevides T, Mailloux Z, Faller P, Hunt J, van Hooydonk E, Freeman R, Leiby B, Sendecki J, Kelly D (2014) An intervention for sensory difficulties in children with autism: a randomized trial. J Autism Dev Disord 44(7):1493–1506

    PubMed  Google Scholar 

  42. Schasfoort F, Pangalila R, Sneekes EM, Catsman C, Becher J, Horemans H, Stam HJ, Dallmeijer AJ, Bussmann J (2018) Intramuscular botulinum toxin prior to comprehensive rehabilitation has no added value for improving motor impairments, gait kinematics and goal attainment in walking children with spastic cerebral palsy. J Rehabil Med 50(8):732–742

    Article  PubMed  Google Scholar 

  43. Tilton A, Russman B, Aydin R, Dincer U, Escobar RG, Kutlay S, Lipczyk Z, Velez JC, Grandoulier A-S, Tse A, Picaut P, Delgado MR (2017) AbobotulinumtoxinA (Dysport®) improves function according to goal attainment in children with dynamic equinus due to cerebral palsy. J Child Neurol 32(5):482–487

    Article  PubMed  PubMed Central  Google Scholar 

  44. McGuinness LA, Higgins JP (2021) Risk‐of‐bias VISualization (robvis): an R package and Shiny web app for visualizing risk‐of‐bias assessments. Res Synth Methods 12(1):55–61

  45. Cohen J (1988) Statistical power analysis for the behavioral sciences, 2nd edn. Erlbaum, Hillsdale, NJ

  46. Sneeuw KC, Sprangers MA, Aaronson NK (2002) The role of health care providers and significant others in evaluating the quality of life of patients with chronic disease. J Clin Epidemiol 55(11):1130–1143

    Article  PubMed  Google Scholar 

  47. von Essen L (2004) Proxy ratings of patient quality of life. Acta Oncol 43(3)

  48. Kroenke K, Stump TE, Monahan PO (2022) Agreement between older adult patient and caregiver proxy symptom reports. J Patient Rep Outcomes 6(1):1–12

    Article  Google Scholar 

  49. Eiser C, Varni JW (2013) Health-related quality of life and symptom reporting: similarities and differences between children and their parents. Eur J Pediatr 172:1299–1304

    Article  PubMed  Google Scholar 

  50. Magaziner J, Zimmerman SI, Gruber-Baldini AL, Hebel JR, Fox KM (1997) Proxy reporting in five areas of functional status: comparison with self-reports and observations of performance. Am J Epidemiol 146(5):418–428

    Article  CAS  PubMed  Google Scholar 

  51. Oczkowski C, O’Donnell M (2010) Reliability of proxy respondents for patients with stroke: a systematic review. J Stroke Cerebrovasc Dis 19(5):410–416

    Article  PubMed  Google Scholar 

  52. Chapman CA, George M, Knox K, Rockwood K, Howlett SE, Sevinc G (2023) CO27 the feasibility of systematic goal quality assurance during goal attainment scaling in a rare disease. Value Health 26(12):S19

    Article  Google Scholar 

  53. Krasny-Pacini A, Evans J, Sohlberg MM, Chevignard M (2016) Proposed criteria for appraising goal attainment scales used as outcome measures in rehabilitation research. Arch Phys Med Rehabil 97(1):157–170

    Article  PubMed  Google Scholar 

  54. Steenbeek D, Ketelaar M, Galama K, Gorter JW (2008) Goal attainment scaling in paediatric rehabilitation: a report on the clinical training of an interdisciplinary team. Child Care Health Dev 34(4):521–529

    Article  CAS  PubMed  Google Scholar 

  55. Bovend’Eerdt TJ, Botell RE, Wade DT (2009) Writing SMART rehabilitation goals and achieving goal attainment scaling: a practical guide. Clin Rehab 23:352–361

    Article  Google Scholar 

  56. Choate R, Smith A, Cardillo JE, Thompson L (1981) Training in the use of goal attainment scaling. Commun Mental Health J 17(2):171–181

  57. de Beurs E, Lange A, Blonk RW, Koele P, van Balkom AJ, Van Dyck R (1993) Goal attainment scaling: an idiosyncratic method to assess treatment effectiveness in agoraphobia. J Psychopathol Behav Assess 15:357–373

    Article  Google Scholar 

  58. Ertzgaard P, Ward AB, Wissel J, Borg J (2011) Practical considerations for goal attainment scaling during rehabilitation following acquired brain injury. J Rehabil Med 43(1):8–14

    Article  PubMed  Google Scholar 

  59. Turner-Stokes L (2009) Goal attainment scaling (GAS) in rehabilitation: a practical guide. Clin Rehabil 23(4):362–370

    Article  PubMed  Google Scholar 

  60. O’Connor CM, Rowlands A, Poulos CJ (2021) Development of an assessment guide to evaluate meaningful outcomes for people living with dementia who are engaged in reablement programs. Disabil Rehabil 1–13

  61. Siebes RC, Ketelaar M, Gorter JW, Wijnroks L, De Blécourt AC, Reinders-Messelink HA, Van Schie PE, Vermeer A (2007) Transparency and tuning of rehabilitation care for children with cerebral palsy: a multiple case study in five children with complex needs. Dev Neurorehabil 10(3):193–204

    Article  CAS  PubMed  Google Scholar 

  62. Roberts JC, Lattimore S, Recht M, Jackson S, Gue D, Squire S, Robinson KS, Price V, Denne M, Richardson S, Rockwood K (2018) Goal attainment scaling for haemophilia (GAS-Hēm): testing the feasibility of a new patient-centric outcome measure in people with haemophilia. Haemophilia 24(4):e199–e206

    Article  CAS  PubMed  Google Scholar 

  63. Goldstine J, Knox K, Beekman J, Cobussen-Boekhorst H, Conti A, Gray M, Inglese G, England A, Rodriguez G, Stanley J, Vaughn S, Howlett SE, Rockwood K (2021) A patient-centric tool to facilitate goal attainment scaling in neurogenic bladder and bowel dysfunction: path to individualization. Value Health 24(3):413–420

    Article  PubMed  Google Scholar 

  64. Burnes D, Connolly MT, Hamilton R, Lachs MS (2018) The feasibility of goal attainment scaling to measure case resolution in elder abuse and neglect adult protective services intervention. J Elder Abuse Negl 30:209–222

    Article  PubMed  Google Scholar 

  65. Yip AM, Gorman MC, Stadnyk K, Mills WG, MacPherson KM, Rockwood K (1998) A standardized menu for goal attainment scaling in the care of frail elders. Gerontologist 38(6):735–742

    Article  CAS  PubMed  Google Scholar 

  66. Knox K, Stanley J, Hendrix JA, Hillerstrom H, Dunn T, Achenbach J, Chicoine BA, Lai F, Lott I, Stanojevic S, Howlett SE, Rockwood K (2021) Development of a symptom menu to facilitate Goal Attainment Scaling in adults with Down syndrome-associated Alzheimer’s disease: a qualitative study to identify meaningful symptoms. J Patient Rep Outcomes 5(1):5

    Article  PubMed  PubMed Central  Google Scholar 

  67. Clair CA, Henry M, Jennings LA, Reuben DB, Sandberg SF, Giovannetti ER (2021) Refining a taxonomy of goals for older adults with functional limitations and their caregivers to inform care planning. J Appl Gerontol 40(9):1008–1019

    Article  PubMed  Google Scholar 

  68. Roberts JC, Richardson S, Miles ME, Stanley J, Chapman CA, Denne M, Caicedo J, Rockwood K, Recht M (2022) The GOAL-Hēm journey: shared decision making and patient-centred outcomes. Haemophilia 28(5):784–795

    Article  PubMed  PubMed Central  Google Scholar 

  69. Rockwood K (1994) Use of global assessment measures in dementia drug trials. J Clin Epidemiol 47(1):101–103

    Article  CAS  PubMed  Google Scholar 

  70. Rachel BP, Villepinte C, Roumenoff F, Lebrault H, Bonnyaud C, Pradeau C, Bensmail D, Isner-Horobeti ME, Krasny-Pacini A (2023) Goal attainment scaling in rehabilitation: an educational review providing a comprehensive didactical tool box for implementing goal attainment scaling. J Rehabil Med 55

Download references

Acknowledgements

Not applicable.

Funding

This study was jointly sponsored by Ardea Outcomes and MITACS. Manuscript writing, study conceptualization, study design, data collection, and data analysis and interpretation were performed by Ardea Outcomes.

Author information

Authors and Affiliations

  1. Ardea Outcomes, Halifax, NS, Canada

    Kulpreet Cheema, Taylor Dunn, Chere Chapman, Kenneth Rockwood, Susan E. Howlett & Gunes Sevinc

  2. Department of Pharmacology, Dalhousie University, Halifax, NS, Canada

    Susan E. Howlett

  3. Division of Geriatric Medicine, Dalhousie University, Halifax, NS, Canada

    Kenneth Rockwood & Susan E. Howlett

  4. Geriatric Medicine Research Unit, Nova Scotia Health Authority, Halifax, NS, Canada

    Kenneth Rockwood

  5. Neuroscience and Mental Health Institute, Faculty of Medicine and Dentistry, University of Alberta, Edmonton, AB, Canada

    Kulpreet Cheema

Authors
  1. Kulpreet Cheema
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Taylor Dunn
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Chere Chapman
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Kenneth Rockwood
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Susan E. Howlett
    View author publications

    You can also search for this author in PubMed Google Scholar

  6. Gunes Sevinc
    View author publications

    You can also search for this author in PubMed Google Scholar

Contributions

KC contributed to the design of the study, acquired the data, and contributed to the interpretation of data. TD contributed to statistical analysis and the interpretation of data. All authors participated in the drafting or the critical review of the article; read and approved the final manuscript; and agree to be accountable for all aspects of the work. All authors read and approved the final manuscript.

Corresponding author

Correspondence to Gunes Sevinc.

Ethics declarations

Ethical approval

Not applicable.

Consent for publication

Not applicable.

Competing interests

KR is the President, Chief Science Officer, and a shareholder of Ardea Outcomes. In the past 3 years, KR has also been a part of an advisory board for Roche and Genentech and has delivered 2 talks sponsored by Nutricia.

Additional information

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Electronic supplementary material

Rights and permissions

Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Cheema, K., Dunn, T., Chapman, C. et al. A systematic review of goal attainment scaling implementation practices by caregivers in randomized controlled trials. J Patient Rep Outcomes 8, 37 (2024). https://doi.org/10.1186/s41687-024-00716-w

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1186/s41687-024-00716-w

Keywords