Skip to main content

Advertisement

Journal of Patient-Reported Outcomes
Journal of Patient-Reported Outcomes Cover Image

Exploring the responsiveness of goal attainment scaling in relation to number of goals set in a sample of hemophilia-A patients

Journal of Patient-Reported Outcomes volume 3, Article number: 20 (2019) | Download Citation

Article metrics

Abstract

Purpose

Guidelines for the use of goal attainment scaling (GAS) recommend that the patient specify at least three goals. Even so, this may not always be feasible or align with patient preferences. Investigations into the psychometric properties of GAS using three or more goals largely support its reliability, validity, and responsiveness compared with standard measures. As evaluations of responsiveness rely on variability estimates, this metric may be impacted when GAS is based on fewer than three goals. For this reason, we investigated the responsiveness of one- and two-goal GAS.

Methods

Secondary analyses were conducted on data from a mixed sample of pediatric, adolescent and adult subjects with hemophilia A. The standardized response mean (SRM) and its 95% confidence intervals (CI) were used to assess responsiveness of one- and two-goal GAS at six and twelve weeks.

Results

Both one-goal and two-goal GAS demonstrated similar responsiveness to change at 6-week (Patient-Rated GAS: one-goal SRM [95% CI] = 0.70 [0.45–1.08], two-goal = 0.96 [0.68–1.30]; Clinician-Rated GAS: one-goal = 1.26 [0.81–1.77], two-goal = 1.01 [0.73–1.32]) and 12-week follow-up (Patient-Rated GAS: one-goal SRM [95% CI] = 1.14 [0.53–1.71], two-goal = 1.35 [0.92–1.82]; Clinician-Rated GAS: one-goal = 1.71 [1.12–2.30], two-goal = 1.48 [1.02–2.02]). Larger SRMs were observed for clinician-rated GAS, but all were within the rubric of a large effect size.

Conclusions

One-goal GAS is responsive to change in a clinical population. Further research is recommended in a larger sample where responsiveness of one- and multiple-goal GAS can be compared

Introduction

In the evaluation of clinical meaningfulness, individualized outcome measures, paired with standardized assessments, allow valid evaluations that combine reproducibility and inherent patient -centeredness. Individualization self-consciously aims to incorporate patient preferences, an important step in understanding clinical meaningfulness [1]. Well-developed patient-reported outcome measures provide essential information to enhance patient healthcare and quality of life [2]. Sometimes, however, what patients prefer might not extend to methods by which their preferences are elucidated. We have encountered such an example in relation to goal attainment scaling (GAS). GAS [3] allows the patient, usually in consultation with their clinician, to set personalized treatment goals. In contrast with psychometric measures which specify domains or symptoms to be evaluated, GAS allows people to select goals according to their individual needs, thus maximizing the relevance to the patient and the non-arbitrariness of symptom measurement. GAS can be viewed as a standardized approach to the measurement of change in response to patient -centered and solution-focused care. Goal-setting is usually conducted in consultation with a clinician, and so can facilitate shared decision-making about treatment. The key feature of GAS is its ability to detect clinically meaningful change due to its focus on outcomes that are important to the individual [4].

The extent of goal attainment is rated on a 5-point scale ranging from + 2 (much better than expected) to − 2 (much worse than expected). Baseline status is generally set at − 1 and a follow-up attainment score at this level is considered somewhat worse than expected. The expected outcome, or “goal”, is set as 0. GAS is frequently used to track symptom changes due to a therapeutic intervention, and often operates as a co-intervention; formal goal-setting inherent in GAS may in itself encourage progress in specified goal areas [5]. This can be especially useful in dementia [6] and traumatic brain injury [7] in which goal-setting ability is compromised.

GAS guidelines recommend that patients set at least three goals, generally weighted in order of importance to the patient [8]. In practice this might not always be feasible – or appropriate, especially when it does not accord with patient preferences. When GAS is being used with an intervention designed to address a range of problems, it is likely the number of goals specified will be multiple. In observational/non-interventional studies that capture change over the course of usual care, patients might wish to set only one or two goals based on the symptoms most relevant to them.

Investigations of the reliability, validity, and responsiveness of three-goal GAS have supported the psychometric properties of the tool, particularly its responsiveness compared with standard measures [9, 10]. The psychometric properties of one-goal GAS have not yet been investigated. It is likely that having only one goal will have the most impact on measures where variability is key, e.g., effect size. The number of goals a patient specifies will affect the GAS formula which is calculated as follows:

$$ T=50+\frac{10\sum {w}_i{x}_i}{\sqrt{\left(1-\rho \right)\sum {w}_i^2+\rho {\left(\sum {w}_i\right)}^2}} $$

where T is the composite score, wi is the weight assigned to the ith goal, x i is the numerical value (− 2 to + 2) of the attainment level of the ith goal, and ρ is the estimated correlation between goal scores (assumed to be constant and set at .3) [3]. With one goal, the scale can only produce one of five distinct values (− 2 to + 2), whereas with three goals the sum of the scale scores will have a range of thirteen distinct values (− 6 to + 6), so that a summary GAS score will have a 13-point scale [8]. Briefly, the consequence of having only one goal is that responsiveness may be particularly impacted when GAS is based on one goal as evaluations of responsiveness rely on variability estimates. Our objective was to conduct a first investigation into the responsiveness of one-goal GAS.

Methods

Participants

Secondary analyses were conducted on data from the standardized Goal Attainment Scaling menu for Hemophilia (GAS-Hēm) study, a 12-week, prospective study of the feasibility of using a standardized GAS menu to track clinical change in a mixed sample of pediatric, adolescent and adult subjects with hemophilia A [11]. Participants were recruited through four clinical sites in the USA (n = 2) and Canada (n = 2) between December 2015 and August 2016. Participants were eligible if they were aged between 5 and 65 years, had a diagnosis of hemophilia A with clotting factor levels of 5% or less, were on a prescribed regimen of continuous prophylaxis, and were proficient in English. Forty-four participants and/or their legal guardians provided informed consent and were screened for study participation. Two participants were excluded (one did not meet the eligibility criteria; one did not return for the baseline visit). A further two participants were excluded as they did not provide follow-up data. Of 40 participants included in the analysis sample, 7 were pediatrics (aged 5–12 years), 9 were adolescents (13–18 years), and 24 were adults (19–65 years). As expected - hemophilia A is very rare in females - all participants save one were male.

GAS-Hēm

GAS-Hēm is an online instrument developed with input from hemophilia A patients and expert practitioners. It consists of 29 goal areas that reflect challenges frequently encountered by people with hemophilia A. Participants had the option to define their own goals, with 59% opting to do so. GAS involves formal setting of appropriate goal attainment levels, which can prove challenging and time-consuming to healthcare professionals. GAS-Hēm was designed to facilitate the goal-setting process using Web-enabled software initially developed by our group for use in dementia [12]. Findings from the GAS-Hēm feasibility study suggest that GAS-Hēm can enhance patient-centered care and compliment standard measures of clinically meaningful change [11]. At baseline, participants underwent a clinician-facilitated goal-setting session using the GAS-Hem tool. Follow-up assessments were conducted at six and 12 weeks. Participants were encouraged to set three goals, however, half chose to set one goal, and half set two. When participants set two goals, goals were ranked in order of importance. Clinicians also scored participants’ goal attainment at follow-up visits.

Data analysis

With only one goal, there is no intercorrelation between goals, and no weighting, so the GAS formula simplifies as follows:

$$ GAS=50+(10x) $$

where x is the numerical value (− 2 to + 2) of the attainment level. This impacts the estimation of responsiveness, in which the variability of scores is key. We estimated responsiveness using standardized response means (SRMs) [13]. SRMs were calculated for one- and two-goal GAS at six and 12 weeks by dividing the mean change (follow-up minus baseline) by the standard deviation of the change. SRMs are considered to be a relatively unbiased measure of effect size [14] and were interpreted using Cohen’s effect size criteria, where a value of 0.2 was considered “small”, 0.5 “medium”, and 0.8 “large” [15]. Independent t-tests were conducted to compare change scores for one- and two-goal GAS. SRMs and their bootstrap confidence intervals (CIs) were calculated using MedCalc for Windows, version 18.6 [16].

Results

Sample characteristics

Half the patients were aged 23 years or less, and most were adults. The people who set one GAS goal most often were children or adolescents (Table 1).

Table 1 Sample characteristics at baseline
Full size table

Responsiveness results

Baseline and follow-up GAS scores and SRMs are presented in Table 2. Patient-rated one-goal and two-goal GAS demonstrated similar responsiveness to change at 6-week (one-goal SRM [95% CI] = 0.70 [0.45–1.08]; two-goal SRM [95% CI] = 0.96 [0.68–1.30]) and 12-week follow-up (one-goal SRM [95%CI] = 1.14 [0.53–1.71]; two-goal SRM [95% CI] = 1.35 [0.92–1.82]). There were no significant differences in mean change scores between patient-rated one- and two-goal GAS at 6-weeks (mean difference = 3.7, p > .05) and 12-weeks (mean difference = 4.7, p > .05). For clinicians, SRMs for one-goal and two-goal GAS were of similar magnitude at 6-week (one-goal SRM [95% CI] = 1.26 [0.81–1.77]; two-goal SRM [95% CI] = 1.01 [0.73–1.32]) and 12-week follow-up (one-goal SRM [95% CI] = 1.71 [1.12–2.30]; two-goal SRM [95% CI] = 1.48 [1.02–2.02]). There were no significant differences in mean change scores between clinician-rated one- and two-goal GAS at 6-weeks (absolute difference = 1.1, p > .05) and 12 weeks (absolute difference = 3.8, p > .05).

Table 2 Patient and clinician GAS scores and SRM for one- and two-goal GAS
Full size table

Discussion

SRM values at 6- and 12-week follow-up support the responsiveness of one-goal GAS in a sample of participants with hemophilia A. In participants who set only one goal, SRMs at 6- and 12-weeks were moderate to large. For clinician-rated one-goal GAS, SRMs at both time-points were large. A similar trend was observed for two-goal GAS, and all effect sizes can be considered large according to Cohen’s criteria. This suggests that GAS is responsive, even when participants set only one goal. The slightly larger SRMs for two-goal patient-rated GAS may be due to larger mean differences in scores. Although mean change was not significantly different for one- and two-goal GAS, it is possible that an increased number of goals provides greater opportunity to detect change. Even so, the opposite trend was observed for clinician-rated GAS with slightly larger SRMs for one-goal compared to two-goal GAS. Overall, findings support previous studies where large SRMs were observed for GAS [17, 18].

Establishing the responsiveness of one-goal GAS has implications for the use of this tool in that even greater individualization can be achieved if participants are not restricted by a minimum goal number. Here, participants were encouraged to set three goals, however in practice this did not occur. This may reflect the fact that GAS-Hēm was non-interventional and not designed to target numerous problem areas, unlike many interventional studies that have incorporated GAS [9, 17, 19].

The lower number of goals set may also be due to the unique aspects of hemophilia A and its impact on patients’ lives. Hemophilia A is a genetic disorder characterized by deficiency in coagulation factor VIII (FVIII), and modern therapy revolves around prophylactic FVIII replacement [20]. In understanding clinical meaningfulness for this patient population, goals tended to encompass optimizing prophylaxis to positively impact goal areas such as joint problems, leisure activities, being able to administer factor, weight, exercise and nutrition. In this sense, improved adherence acts as a means to an end, and from the perspective of many people living with hemophilia, can be viewed as a summative measure that integrates a range of outcomes. If individuals with hemophilia are not adherent to prophylaxis, they will be at increased risk for bleeding events with their proposed physical or leisure activities and unlikely to achieve their goal. Further, some individuals with hemophilia who have successfully integrated prophylaxis into their routine have stated it is a prerequisite for “normal life” [21]. As nonadherence to prophylaxis therapy is associated with worse outcomes in hemophilia [22] it is not surprising that improving this aspect of hemophilia patients’ lives may be important to them [21].

The small sample size in this study limits the generalizability of findings and results are suggestive. GAS-Hēm was also limited as comparative responsiveness with the recommended three or more goals was not possible. Additionally, the fact that younger participants tended to set one goal presents a potential confound as it is unclear whether the responsiveness of one-goal GAS is influenced by age. Of those who set one goal, 60% (12/20) were children/adolescents, whereas only 20% (4/20) of those who set two goals were children/adolescents. As such, groups which set one vs. two goals are somewhat heterogenous, rendering comparisons of SRMs problematic. Even so, one of the major advantages of GAS is its ability to produce standardized scores reflecting the degree of goal attainment across a range of disease areas and ability levels [8]. Given the individualized nature of GAS, not everyone is expected to set goals in the same areas nor to have the same baseline description for similar goals. Rather, the key inference in GAS is the extent to which participants attained their own personal goals at follow -up. Here, goal-setting was facilitated by a trained professional to ensure that goals were age-appropriate and sufficiently challenging for all participants and a graded series of likely outcomes was constructed in a systematic way (the 5-point goal attainment scale). This may have contributed towards minimizing any potential age confounds, but even so, the impact of age on GAS responsiveness can only be firmly established through further research in homogenous groups. Future research should also investigate inter-rater reliability and/or validity of one-goal GAS in relation to comparative measures targeting changes or improvement. Additionally, the generalizability of findings across disease areas, such as dementia, is unclear. Our findings raise interesting questions which need to be explored across disease areas and in larger samples in which more goals have been set.

Conclusion

These preliminary findings highlight the potential for further individualization of GAS by allowing participants to select fewer goals than are currently imposed by standard GAS guidelines. SRMs suggest that one-goal GAS is responsive to change in a clinical population. Further research is recommended in a larger sample where responsiveness of one- and multiple-goal GAS can be compared.

Abbreviations

CI:

Confidence Interval

GAS:

Goal Attainment Scaling

GAS-Hēm:

Goal Attainment Scaling menu for Hemophilia

SRM:

Standardized Response Mean

References

  1. 1.

    Reuben, D. B., & Tinetti, M. E. (2012). Goal-oriented patient care—An alternative health outcomes paradigm. N Engl J Med, 366(9), 777–779.

  2. 2.

    Blome, C., von Usslar, K., & Augustin, M. (2016). Feasibility of using qualitative interviews to explore patients’ treatment goals: Experience from dermatology. Patient Patient Cent Outcomes Res, 9(3), 261–269.

  3. 3.

    Kiresuk, T. J., & Sherman, R. E. (1968). Goal attainment scaling: A general method for evaluating comprehensive community mental health programs. Community Ment Health J, 4(6), 443–453. https://doi.org/10.1007/BF01530764.

  4. 4.

    Recht, M., Konkle, B. A., Jackson, S., Neufeld, J., Rockwood, K., & Pipe, S. (2016). Recognizing the need for personalization of haemophilia patient-reported outcomes in the prophylaxis era. Haemophilia., 22, 825–832. https://doi.org/10.1111/hae.13066.

  5. 5.

    Rannisto, M., Rosti-Otajärvi, E., Mäntynen, A., Koivisto, K., Huhtala, H., & Hämäläinen, P. (2015). The use of goal attainment scaling in neuropsychological rehabilitation in multiple sclerosis. Disabil Rehabil, 37(21), 1984–1991.

  6. 6.

    Bouwens, S. F., Van Heugten, C. M., & Verhey, F. R. (2008). Review of goal attainment scaling as a useful outcome measure in psychogeriatric patients with cognitive disorders. Dement Geriatr Cogn Disord, 26(6), 528–540.

  7. 7.

    Rockwood, K., Joyce, B., & Stolee, P. (1997). Use of goal attainment scaling in measuring clinically important change in cognitive rehabilitation patients. J Clin Epidemiol, 50(5), 581–588. https://doi.org/10.1016/S0895-4356(97)00014-0.

  8. 8.

    Kiresuk, T. J., Smith, A., & Cardillo, J. E. (2013). Goal attainment scaling: Applications, theory, and measurement. New York: Psychology Press.

  9. 9.

    Rockwood, K., Fay, S., Song, X., MacKnight, C., & Gorman, M. (2006). Attainment of treatment goals by people with Alzheimer’s disease receiving galantamine: A randomized controlled trial. CMAJ, 174(8), 1099–1105.

  10. 10.

    van Seben, R., Reichardt, L., Smorenburg, S., & Buurman, B. (2017). Goal-setting instruments in geriatric rehabilitation: A systematic review. J Frailty Aging, 6(1), 37.

  11. 11.

    Roberts, J. C., Lattimore, S., Recht, M., Jackson, S., Gue, D., Squire, S., et al. (2018). Goal attainment scaling for haemophilia (GAS-Hēm): Testing the feasibility of a new patient-centric outcome measure in people with haemophilia. Haemophilia., 1–8. https://doi.org/10.1111/hae.13454.

  12. 12.

    Rockwood, K. (2010). An individualized approach to tracking and treating Alzheimer’s disease. Clin Pharmacol Ther, 88, 446–449.

  13. 13.

    Liang, M. H., Fossel, A. H., & Larson, M. G. (1990). Comparisons of five health status instruments for orthopedic evaluation. Med Care, 28 (7), 632–642.

  14. 14.

    Norman, G. R., Wyrwich, K. W., & Patrick, D. L. (2007). The mathematical relationship among different forms of responsiveness coefficients. Qual Life Res, 16(5), 815–822. https://doi.org/10.1007/s11136-007-9180-x.

  15. 15.

    Cohen, J. (1988). Statistical power analysis for the behavioral sciences. 2nd ed. Jersey: Lawrence Erlbaum Associates.

  16. 16.

    MedCalc Software. (2018). MedCalc for Windows. Belgium: Ostend.

  17. 17.

    Rockwood, K., Howlett, S., Stadnyk, K., Carver, D., Powell, C., & Stolee, P. (2003). Responsiveness of goal attainment scaling in a randomized controlled trial of comprehensive geriatric assessment. J Clin Epidemiol, 56(8), 736–743.

  18. 18.

    Turner-Stokes, L., Williams, H., & Johnson, J. (2009). Goal attainment scaling: Does it provide added value as a person-centred measure for evaluation of outcome in neurorehabilitation following acquired brain injury? J Rehabil Med, 41(7), 528–535. https://doi.org/10.2340/16501977-0383.

  19. 19.

    Rushton, P. W., & Miller, W. C. (2002). Goal attainment scaling in the rehabilitation of patients with lower-extremity amputations: A pilot study. Arch Phys Med Rehabil, 83(6), 771–775.

  20. 20.

    Srivastava, A., Brewer, A. K., Mauser-Bunschoten, E. P., Key, N. S., Kichen, S., Llinas, A., et al. (2013). Guidelines for the management of hemophilia. Haemophilia., 19(1), e1–e47.

  21. 21.

    Schrijvers, L. H., Kars, M. C., Beijlevelt-van der Zande, M., et al. (2015). Unravelling adherence to prophylaxis in haemophilia: A patients' perspective. Haemophilia., 21, 612–621.

  22. 22.

    Duncan, N., Shapiro, A., Ye, X., Epstein, J., & Luo, M. P. (2012). Treatment patterns, health-related quality of life and adherence to prophylaxis among haemophilia a patients in the United States. Haemophilia., 18(5), 760–765.

Download references

Acknowledgements

Not applicable.

Funding

KR receives career support from the Dalhousie Medical Research Foundation as the Kathryn Allen Weldon Professor of Alzheimer Research at Dalhousie University Halifax, Nova Scotia, Canada, and receives research support from the Canadian Institutes of Health Research (grant no. PJT-156114). LM received a postdoctoral fellowship from the Mitacs Elevate program (Ref: IT09427). The data related to one-goal GAS is sourced from a study funded by Shire.

Availability of data and materials

The data that support the findings of this study are available from Shire but restrictions apply to the availability of these data, which were used under license for the current study, and so are not publicly available. Data are however available from the authors upon reasonable request and with permission of Shire.

Author information

Affiliations

  1. Division of Geriatric Medicine, Department of Medicine, Dalhousie University and Nova Scotia Health Authority, 5955 Veterans’ Memorial Lane, Halifax, NS, B3H 2E1, Canada

    • Lisa McGarrigle
    •  & Kenneth Rockwood

  2. DGI Clinical Inc, 1730 Market St, Halifax, NS, B3J 3N9, Canada

    • Lisa McGarrigle
    •  & Kenneth Rockwood

  3. Bleeding & Clotting Disorders Institute, Peoria, IL, USA

    • Jonathan C. Roberts

  4. Shire, US Medical Affairs, Chicago, IL, USA

    • Michael Denne

  5. Centre for Health Care of the Elderly, Nova Scotia Health Authority, 1421-5955 Veterans’ Memorial Lane, Halifax, Nova Scotia, B3H 2E9, Canada

    • Kenneth Rockwood

Authors

  1. Search for Lisa McGarrigle in:

  2. Search for Jonathan C. Roberts in:

  3. Search for Michael Denne in:

  4. Search for Kenneth Rockwood in:

Contributions

LM analyzed the data, and both LM and KR interpreted the results and were involved in writing the manuscript. KR, JCR and MD conceived and designed the study, contributed to interpreting the results, and critically reviewed the manuscript. All authors read and approved the final manuscript.

Corresponding author

Correspondence to Kenneth Rockwood.

Ethics declarations

Ethics approval and consent to participate

All procedures performed in studies involving human participants were in accordance with the ethical standards of the institutional and/or national research committee and with the 1964 Helsinki declaration and its later amendments or comparable ethical standards. For this type of secondary analysis formal consent is not required.

Consent for publication

Not applicable.

Competing interests

KR is the founder, President, Chief Science Officer and majority shareholder of DGI Clinical Inc., a company that had a contractual agreement with Baxalta US Inc., now part of Shire, to study individualized outcome measures in haemophilia. LM is a Mitacs postdoctoral fellow whose industrial co-sponsor is DGI Clinical, Halifax, Nova Scotia, Canada. JCR has received investigator-initiated research grant support, has served as a consultant, received travel support, and served on a speaker’s bureau for Baxalta US Inc. and Shire. MD is an employee and shareholder of Shire.

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Open Access This article is distributed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made.

Reprints and Permissions

About this article

Verify currency and authenticity via CrossMark

Keywords

  • Patient
  • Goal attainment
  • Responsiveness
  • Hemophilia