Skip to main content
Journal of Patient-Reported Outcomes
Download PDF

Development of a symptom menu to facilitate Goal Attainment Scaling in adults with Down syndrome-associated Alzheimer’s disease: a qualitative study to identify meaningful symptoms

Journal of Patient-Reported Outcomes volume 5, Article number: 5 (2021) Cite this article

Abstract

Background

As life expectancy of people with Down syndrome (DS) increases, so does the risk of Alzheimer’s disease (AD). Identifying symptoms and tracking disease progression is especially challenging whenever levels of function vary before the onset of dementia. Goal Attainment Scaling (GAS), an individualized patient-reported outcome, can aid in monitoring disease progression and treatment effectiveness in adults with DS. Here, with clinical input, a validated dementia symptom menu was revised to facilitate GAS in adults living with Down Syndrome-associated Alzheimer’s disease (DS-AD).

Methods

Four clinicians with expertise in DS-AD and ten caregivers of adults living with DS-AD participated in semi-structured interviews to review the menu. Each participant reviewed 9–15 goal areas to assess their clarity and comprehensiveness. Responses were systematically and independently coded by two researchers as ‘clear’, ‘modify’, ‘remove’ or ‘new’. Caregivers were encouraged to suggest additional items and recommend changes to clarify items.

Results

Median caregiver age was 65 years (range 54–77). Most were female (9/10) with ≥15 years of education (10/10). Adults with DS-AD had a median age of 58 years (range 52–61) and either a formal diagnosis (6/10) or clinical suspicion (4/10) of dementia. The initial symptom menu consisted of 67 symptoms each with 2–12 descriptors (589 total). The clinicians’ adaptation yielded 58 symptoms each with 4–17 descriptors (580 total). Of these 580 descriptors, caregivers identified 37 (6%) as unclear; these were reworded, and one goal area (4 descriptors) was removed. A further 47 descriptors and one goal area were added to include caregiver-identified concepts. The final menu contained 58 goal areas, each with 7–17 descriptors (623 total).

Conclusions

A comprehensive symptom menu for adults living with DS-AD was developed to facilitate GAS. Incorporating expert clinician opinion and input from caregivers of adults with DS-AD identified meaningful items that incorporate patient/caregiver perspectives.

Plain English summary

The prevalence of Alzheimer’s disease is above 75% in people with Down syndrome aged 60 years or older. There is a need for novel methods to evaluate disease presentation and progression that are applicable to people with intellectual or developmental disabilities. Identifying and tracking dementia symptoms is difficult and even more so in people with Down syndrome.

In this study, we developed a dementia symptom menu specific to people with Down syndrome to make symptom tracking easier in this population. We interviewed caregivers and doctors who have expertise in Down syndrome-associated Alzheimer’s disease to develop a comprehensive symptom menu specific to people with Down syndrome and dementia. The menu consisted of 58 symptoms related to different areas such as cognitive decline (e.g. recent memory), behavioural changes (e.g. irritability/frustration), and physical changes (e.g. incontinence). Each symptom also included about a dozen plain language descriptions of possible symptom presentations.

By including both clinical opinion and input from caregivers of adults with Down syndrome-associated Alzheimer’s disease, we were able to identify a list of meaningful symptoms that include patient and caregiver viewpoints.

Background

People with Down syndrome (DS) are living well into their 50s and 60s with the median life expectancy having risen to 58 years in the US [1]. This increased life expectancy comes with an increased, age-related risk of developing Alzheimer’s disease (AD) [2]. Current estimates place the prevalence of AD above 75% in people with DS aged 60 years or older [3,4,5,6]. Evaluating health outcomes in people with DS is already difficult due to varying levels of baseline function and cognition [7]. This complexity is further exacerbated by the onset of dementia [8]. For example, managing finances and driving are commonly assessed activities of daily living in dementia but a person with DS might not ever have been able to perform such a task [7]. It is therefore important to consider baseline performance in these individuals [7, 8]. There is also growing evidence that adults with Down syndrome-associated Alzheimer’s disease (DS-AD) respond differently to treatment when compared to people with dementia who do not have DS [9]. In consequence, there is a need for measures that capture heterogeneous disease presentation and treatment response in those with DS and dementia [10,11,12,13]. For this, individualized patient-reported outcomes are well-suited [14, 15].

Goal Attainment Scaling (GAS) is an individualized outcome measure initially established for mental health disorders [16]. GAS has been applied to various conditions and disease states including dementia [15,16,17,18,19]. It enables patients and their caregivers to identify and track goals of treatment that are meaningful to them and are related to their condition. GAS is feasible in a variety of applications [20,21,22,23,24,25,26,27,28,29,30,31], even though the goal-setting process is sometimes described as difficult and time-consuming [32,33,34,35]. It can sometimes be difficult to be both patient-centred, and to make explicit clinical judgments about the attainability of goals. These issues are often addressed through training programs designed for clinicians administering GAS [34, 36]. A complementary approach develops condition-specific goal menus to facilitate goal setting by patients, their caregivers and/or clinicians [30, 37, 38].

One such menu is available in SymptomGuide®-dementia, an online platform for people living with dementia and (more often) their care partners to track changes in the symptoms that are most important to them [19]. The menu of 67 dementia symptoms was developed through patient, clinician and caregiver feedback, and the data obtained from over 4000 SymptomGuide® users. It has been used to gain insights into common dementia symptoms such as verbal repetition [39] and agitation [40], and, as with GAS, has been found to be sensitive to change [41, 42]. This menu, however, is not specifically tailored towards people with DS. In this study, our aims were to adapt the SymptomGuide®-dementia menu to facilitate Goal Attainment Scaling in adults with DS-AD and to identify challenges most meaningful to people with DS-AD and their caregivers.

Methods

Dementia symptom library

The SymptomGuide®-dementia contains information on 67 dementia symptoms that consists of 2–12 (589 total) specific descriptions of their possible manifestations, called descriptors. Alternatively, users can define their own unique symptoms or descriptors not included in the menu. Variations of this menu have been used in a clinical study for people with vascular or mixed AD/vascular dementia [41] and in a tertiary care memory clinic [43] to track disease progression. In this study, we elicited feedback from caregivers of adults living with DS-AD and clinicians who have expertise in DS to tailor the SymptomGuide®-dementia symptom library for use in this population.

Sample

The expert panel consisted of four clinicians (JA, BAC, FL, IL) with expertise in DS-AD. Two researchers (KK, a research nurse and KR, a physician) conducted semi-structured qualitative interviews with them. To ensure the menu’s clarity and comprehensiveness, 10 people were recruited who cared for someone with both DS and a formal diagnosis or clinical suspicion of dementia to participate in individual semi-structured interviews. Semi-structured qualitative interviews with caregivers were conducted by KK.

For this qualitative study, purposive sampling was used to recruit people most likely to use this menu in practice: English speaking caregivers (typical case sampling) and clinicians (expert sampling). Participants were recruited from the United States or Canada. The sample size followed guidelines of the International Society for Pharmacoeconomics and Outcomes Research Patient-Reported Outcomes Good Research Practices Task Force [44, 45]. Caregivers most often reported caring for women with DS-AD, which is consistent with gender effects on AD in adults with DS [46]. The interviews were conducted between June and December 2019.

All interviews were audio-recorded and transcribed verbatim. Grounded Theory, an approach that applies inductive reasoning to systematically acquired data [47], was used to conceptualize the symptoms most meaningful to adults living with DS-AD and their caregivers. Grounded theory was used to identify potential symptoms described spontaneously and during menu review to revise the SymptomGuide®-dementia menu for this population. Our aim in developing individualized measures to assay disease progression and treatment effects was to achieve an adjudication that was relevant and non-arbitrary at the individual patient level.

Clinician interviews

The first clinician interview was conducted individually, in-person; the second was conducted in an online group setting with the remaining three clinicians. These interviews were used to determine whether SymptomGuide®-dementia was comprehensive and reflected the DS population. Clinicians were asked the following: 1) to describe the most important dementia symptoms identified by adults living with DS-AD or their carers; 2) to identify new symptoms and descriptors that were not available in SymptomGuide®-dementia; and 3) to ensure that the symptoms and descriptors were written in language that was easy to understand and to use. All suggested menu revisions were discussed in subsequent caregiver interviews. The interview facilitators reviewed audio recordings and interview transcripts to ensure all clinician-identified themes were present in the revised menu.

Caregiver interviews

Caregivers were recommended by the LuMind IDSC Foundation or recruited through social media. Potential participants were screened based on inclusion/exclusion criteria (Appendix). Each semi-structured caregiver interview was divided into four sections (Table 1). Interviews were conducted via online video conferencing to facilitate slide sharing and audio recording. Each interview lasted approximately 1.5 h. To ensure rigour, the nurse used an interview guide, took notes, and actively solicited participant feedback during interviews. The research nurse’s reflections were documented following each interview to remove biases when responding to participants and to improve the interviewing style for subsequent interviews.

Table 1 Caregiver interview structure
Full size table

Menu revision

Both clinicians and caregivers were asked to discuss the most common and meaningful challenges they experienced while caring for someone with DS-AD. They were then prompted to provide both examples of symptoms from dementia onset as well as their current symptoms.

During the interviews, caregivers were shown a randomly selected subset of 9–15 SymptomGuide®-dementia symptoms and their descriptors. Each item was read aloud one-by-one, pausing for caregiver responses between items. Caregivers were asked to report whether the items were clear and in language that they would typically use. They were given the opportunity to suggest alternative wording for menu items and, after reviewing each symptom, they were offered the chance to identify concepts not included in the menu. Each menu item was reviewed by 2–3 caregivers. Following symptom review, caregivers were shown the full menu to assess the clarity, comprehensiveness, and comprehensibility of the symptom list. Caregivers were then asked to identify the five symptoms most important to them. They were advised that they were not bound by the symptom menu and could identify their own unique symptoms.

Data analysis

Concepts from the clinician interviews were reviewed and discussed by both the research nurse and physician facilitator until a consensus was reached. Identified concepts were compared against existing menu items. New symptoms, descriptors and revisions were implemented prior to caregiver interviews. Two researchers listened to audio recordings of caregiver interviews while reading through interview transcripts to familiarize themselves with the data. Caregiver feedback on menu items were extracted, arranged by symptom and descriptor and then coded as ‘clear’, ‘modify’, ‘remove’ or ‘new’. Researchers discussed codes for each menu item until a consensus was reached. Considering the individualized nature of the menu (for which each item need not be relevant to every individual), some items were added or modified based on a minority of participant comments. To ensure the trustworthiness of the results, a rigorous approach that included reflexivity (the researcher reflects on the processes used for data collection and interpretation) and an audit trail (complete description of research steps taken) for all data analyses was used. Opinions were solicited from a range of stakeholders (e.g. clinicians, caregivers, study authors, etc.) and included open-ended discussion to reduce bias.

Quotes from the open-ended portions of caregiver interviews were independently analyzed by two researchers using NVivo 12 qualitative data analysis software (QSR International Pty Ltd.). Data were categorized into key themes using a seven-step process: transcription, data familiarization, coding, identification of a thematic framework, indexing, mapping, and interpretation [48]. Two researchers independently reviewed audio-recordings and interview transcripts. Researchers then independently indexed quotes not directly related to menu review. Quotes were then discussed to develop an initial thematic framework and coding structure using both inductive and deductive approaches. Quotes were then coded under each theme. Researchers compared codes and discussed any new findings. Codes were mapped and interpreted to determine the key findings.

Demographic data were extracted from deidentified interview transcripts and summarized by means and standard deviations, medians, and ranges, or by frequency and proportions as appropriate.

Ethics

This study was approved by WIRB Copernicus Group Inc. research ethics board (study #1265203). All participants provided informed consent.

Results

Subject characteristics

The caregivers of adults with DS (n=10) ranged from 54 to 77 years (median 65 years). All were siblings of the person with DS-AD that they cared for and most were women (9/10) with ≥15 years of education (10/10). The 10 adults with DS-AD were between 52 and 61 years of age (median 58 years) with a formal diagnosis (6/10) or clinical suspicion (4/10) of dementia. The people with DS-AD lived either with the caregiver interviewed (7/10) or in a group home (3/10). The demographic information is summarized in Table 2.

Table 2 Characteristics of the person with DS and their caregiver
Full size table

Menu revisions

Expert clinician interviews resulted in several revisions. Of the original 67 SymptomGuide®-dementia symptoms, 5 (7%) were deemed ‘not relevant’ to people with DS and were removed (e.g. Looking after grandchildren). Some, (n=5, 7%) were renamed to better reflect difficulties associated with caring for someone with DS (e.g. ‘Travel’ renamed to ‘Travel and Transportation’). The content of 12 symptoms (18%) was combined resulting in 6 symptoms (e.g. ‘Appetite’ and ‘Eating’ were combined into ‘Eating’). In addition, ‘Money/Math’ was added to the menu in lieu of ‘Financial Management’. ‘Vocational (work)’ was also added to describe decline in gainful employment performance or group home tasks. With respect to the original 589 descriptors, 24 (4.1%) were reworded and 102 (17.3%) were removed. A further 93 descriptors were added. This resulted in a revised menu containing 58 symptoms each with 4–17 descriptors (580 total) tailored to individuals with DS-AD.

Caregivers reviewed a median of 11.5 symptoms (range 9–15) on the revised menu. Each symptom was reviewed by 2–3 caregivers (median 2). Most symptoms 98% (57/58) were endorsed by the caregivers. The “Money/Math” symptom was not endorsed and was therefore removed from the menu. Caregivers commented that the adults with DS they cared for only had a basic understanding of money and math even before the onset of dementia.

“ … if you just said, ‘this costs two dollars and ten cents’ she wouldn't know how to do that and she would never know if somebody gave her the correct change or not.”

“ … she would get her own money out for certain things just because it was habit. She had learned that, when it was bowling day, she needed three one-dollar bills and two quarters.”

“When she first started working in the shelter workshop, she was going to get a paycheck. Her big thing was she was taking everybody out for McDonald's hamburger, French fries, Coke, everybody can have one. And so, you know, she had a dollar sixty-eight.” The caregiver then sarcastically remarked “Six brothers and sisters and a mother and father and we all went out for dinner on a dollar sixty-eight … Not.”

Descriptors from this goal that were deemed relevant were moved to other goals, for example, “Trouble paying with debit” was moved to the “Shopping” symptom. Additionally, a symptom for “Seizures” was added to the menu. Most caregivers (6/10) reported seizures and described seizure-like episodes as traumatic events for both themselves and the person they cared for.

“He has had some incidents and I don't know what it is... He'll call out and say, “Come here, come here, come here”. I get there, he passes out cold on the floor, his eyes roll up in his head.”

“The seizures are a pretty dramatic event. And for people that are not in the medical profession, seizures are downright scary.”

A further six symptoms were renamed based on caregiver feedback. For example, ‘Operating gadgets/appliances’ was renamed to ‘Operating devices/appliances’ to reflect current nomenclature and ‘Meal preparation and baking’ was renamed to ‘Meal-time preparation and activities’ to reflect the level of function in adults with DS.

Most of the descriptors in the revised menu (93%, 539/580) were endorsed by caregivers. After reviewing the ‘Irritability/frustration’ symptom, one caregiver said, “It’s like they’re written for her!”. While reviewing the clarity of descriptors in the ‘Eating’ symptom, another commented “Oh my God, [the descriptor is] clear, I don’t feel like I’m crazy anymore” after being shown the descriptor ‘Gags and clears throat frequently’. The individualized nature of this tool allows for the inclusion of less common symptom manifestations. One caregiver supported this method by spontaneously saying,

“So, you know, some of these things I'm surprised to see them here in writing during a research study … I didn't realize it was common enough to be on the questionnaire”

Descriptors that were unclear to caregivers (n=37, 6%) were reworded; those that were not endorsed were removed (n=4, 1%). A further 46 descriptors were added to include caregiver-identified concepts. Examples of additional menu revisions can be found in Table 3. The final menu contained 58 symptoms, each with 7–17 descriptors (622 total).

Table 3 Examples of menu revisions based on caregiver feedback
Full size table

Thematic analysis

Chiefly, two key findings emerged from the thematic framework analysis: caregiver burden and healthcare difficulties. Caregiver burden was expressed in many ways such as increased responsibilities and financial impacts:

“I just realized that it was just too much … And so, I left my job in 2016 and I became her full-time caregiver.”

“There was no program here in our community that I could send her to. So, then I had to start paying people to stay with her during the day.”

“About a year after she was there … she started to display a lot of things and I was out of sight of my family. So, we relocated back to our original state. And that sort of improved things for a while but certain symptoms and challenges continued but at least I have more family to assist me.”

“She goes to the mall, she goes to the movies, she goes to the library and we try to go out at least to a senior center. She'd rather stay in the house, but she has to go out. It's a lot of my time but she has to get out, so I just make it happen.”

Some caregivers confided the emotional hardships they experienced when caring for someone with DS-AD.

“It's gut wrenching for me, to be honest. I mean she was always just the sweetest person and never would have hit somebody in a million years. And now she wants to hit people; she wants to hit me too.”

“I was scared to death; I could see what was happening and I just it was like “my God” … this is bad but it's going to be so much worse.”

In the second theme, caregivers described challenges with medical professionals who were not well-equipped for patients with DS-AD.

“I talk with [doctor] every time we go, and we discuss the changes that I’m seeing, the regression that I’m seeing … I don’t know that she knows a whole lot about people with Down syndrome. I asked her, ‘Do you have any other patients with Down syndrome?’ and I think she said she’s had two other ones.”

“I was shocked at what he couldn’t do but I also was not impressed with the person who gave it [test] to him. We walk out and he says, “so tell me, he does have Down syndrome, right?” I'm like “What the heck are you asking me? Take a look. You got to ask me?”

This was particularly noted by caregivers living in smaller communities.

“I think that was more of a result of where we live. You know small rural town and, when I went to nearby towns, larger towns that had nice medical centers, we've been able to get exactly what we need. It was just the travel that was difficult.

To close interviews, caregivers were asked to identify five symptoms that were most important to them. They were shown a list of all symptoms included in the revised menu however, they were advised that the symptoms they identify as most important need not be selected from the menu. A total of 25 unique important symptoms were identified, all of which had been included in the menu. The most common were ‘Anxiety and Worry’, ‘General Memory’ and ‘Incontinence’ each reported by 4/10 participants. We categorized caregiver-reported symptoms into five domains: behaviour, cognition, daily function, executive function, and physical manifestations. Caregivers most often identified changes in behaviour (13/50, e.g. irritability/frustration) followed by cognitive decline (12/50, e.g. verbal repetition) and physical manifestations (11/50, e.g. incontinence; Fig. 1).

Fig. 1
figure 1

Symptom domains identified as most important. The number of symptoms reported was plotted as a function of the specific symptom domain categories caregivers identified as most important in this study. Symptoms related to daily function were least often regarded as important by the caregivers

Full size image

Discussion

The aim of this study was to adapt the SymptomGuide®-dementia symptom menu for use in adults living with DS-AD. Expert clinicians and caregivers of people affected by DS-AD were interviewed to ensure that modifications were meaningful to this population. First, menu modifications were made after eliciting feedback from expert clinicians. Their expertise guided the revision or addition of over 200 menu items. Feedback from a representative sample of caregivers was then elicited which resulted in nearly 100 additional changes. This resulted in a comprehensive symptom menu that was specifically tailored for adults with DS-AD and their caregivers. This work shows that input from both expert clinicians and caregivers can be used to identify symptoms that are most meaningful both to people living with DS-AD and to their caregivers. The resulting menu will be used to facilitate the use of GAS in adults with DS-AD.

Interestingly, some items revised based on clinician feedback were further modified or even changed back to the original form based on caregiver feedback. For example, the symptom titled ‘Meal Preparation and Cooking’ was first changed to ‘Meal Preparation and Baking’ based on clinician feedback and later changed to ‘Meal-Time Preparation and Activities’ based on caregiver feedback. This highlights the need for real world evidence and patient engagement in the early stages of patient-centred outcome development. Indeed, the US Food and Drug Administration recommends early patient involvement in new Patient-Reported Outcome measures [49]. By asking stakeholders to describe both early and present symptom manifestations in this study, we were able to develop a comprehensive menu applicable to any level of impairment. The symptoms that each individual targets however will not only vary by personal preference but also by dementia stage. For example, problems with recent memory most often appear in early stages of dementia where symptoms are mild, whereas hallucinations do not usually emerge until the disease progresses into later stages [50,51,52]. Moreover, the nature of each symptom likely also captures disease progression. For example, in the symptom ‘misplacing objects’ the descriptor most used at the early stage commonly reflects simply mislaying items, compared with the later stages, in which odd placement of items (e.g. placing eye-glasses in the freezer) is more likely [53]. Each item on the menu need not be meaningful to every individual. Even so, the menu is designed to be robust enough such that everyone can find personally meaningful symptoms and descriptions no matter the level of impairment. In this study we did not consider dementia stage, but this could be interesting to explore in future work.

The baseline level of cognition, function, and behaviour in people with DS varies greatly within the DS population and even more so between adults with DS-AD and other people with dementia [7, 8, 10,11,12,13]. When asked to report the most meaningful challenges faced when caring for someone with DS-AD, caregivers chiefly described an enhanced sense of burden in addition to the challenges associated with disease progression. Caregivers described many different causes for their sense of burden, again demonstrating important heterogeneity in this population. Many caregivers reported needing to leave the workforce. Consistent with this, caregivers can average 52 h per week caring for someone with both dementia and intellectual or developmental disabilities [54]. Together these observations underscore the challenges posed by caring for adults who live with DS-AD.

Although cognitive decline is the hallmark of dementia in people without DS, as in other informant-based studies [55], caregivers in this study frequently reported changes in behaviour and physical manifestations as its most meaningful impacts. This can pose problems when applying outcome measures designed to assess the decline in late-life cognitive function to assess intervention or track the disease course in adults living with DS-AD. Much of the difficulty from the marked heterogeneity in cognition, function, and behaviour of this group occurs prior to the onset of dementia. In addition, standardized measures that focus on changes in cognition or daily function might not capture the changes that are most meaningful to the people with DS-AD or their caregivers. In consequence, individualized measures for evaluating disease progression and symptomatic changes that are specific to adults with DS-AD are needed. The symptom menu developed in this study provides an opportunity to increase the uptake and use of one such measure, GAS. Comparable to measures of global change, GAS provides an overarching metric of change. The standardized GAS T-score evaluates the extent to which goals have been met [16] – or in this case, the extent to which symptoms have improved. However, unlike measures of global change that do not specify the source of what has changed (e.g. the Clinician Interview Based Impression of Change [56]), tracking symptom-defined goals with GAS can provide an opportunity to determine specifically which symptoms are influenced by an intervention. That is, participants would select a set of symptoms and track changes in those symptoms individually over regular intervals depending on the study or intervention. For example, subjects might track changes once every 3 months. Moreover, another strength of GAS is that the methodology can be equally applied to individuals with vastly different backgrounds. GAS scales are uniquely developed for each individual and can therefore readily accommodate cultural differences between generations, geographic locations, and socioeconomic status.

Although simplified and menu-facilitated GAS has been shown to be feasible in several conditions [30, 37, 38, 41, 57], further work is needed to assess the responsiveness, feasibility and validity of the DS-AD menu in this population. To do so, the next step in this process is to evaluate GAS facilitated by this menu in a feasibility study or as an exploratory outcome measure in adults living with DS-AD. Furthermore, GAS is designed for individualization such that goal attainment is rated based on participant-defined concepts. Other important symptoms may become apparent if other methods of data collection are used such as focus groups, face-to-face interviews, or clinic visits. Given data from other studies, we will have the opportunity to describe and include newly identified concepts in the menu. In addition to its use in clinical studies, it is also important to note other potential applications for the menu that can be conducive to clinical care. SymptomGuide®-dementia is currently used in a memory clinic as a shared decision-making tool to help clinicians identify and track change in the symptoms most troubling to their patients [43]. This digital symptom tracking tool can be even more helpful for patients and caregivers who live in rural or remote areas and are therefore unable to see their clinicians regularly. Symptom data collected in this way could also be used in conjunction with other clinical assessments. For example, relationships between patterns of dementia symptom tracking and stage have been identified using an artificial neural network [58]. The use of this menu could likewise help better understand dementia progression in adults living with DS-AD.

Conclusions

In conclusion, this study demonstrated that a comprehensive dementia symptom menu could be developed specifically for adults living with DS-AD. The menu was developed with expert clinician input and with feedback from caregivers of those with DS-AD. Input from these two groups allowed us to identify meaningful items that incorporate the perspectives of the people with DS and their caregivers. This menu will ultimately help facilitate the use of GAS, an individualized patient-reported outcome measure, to monitor dementia progression and the effectiveness of treatment in this population.

Availability of data and materials

De-identified participant data including supporting quotes will be made available to researchers upon reasonable request. Requesters who wish to access data must enter a data access agreement with the LuMind IDSC Foundation.

Abbreviations

AD:

Alzheimer’s disease

DS:

Down syndrome

DS-AD:

Down syndrome-associated Alzheimer’s disease

GAS:

Goal Attainment Scaling

US:

United States

References

  1. de Graaf, G., Buckley, F., & Skotko, B. (2019). People living with down syndrome in the USA: Births and population Down syndrome education international https://suri.net/us-population-factsheet 2019. Accessed 11 May 2020.

    Google Scholar 

  2. Cipriani, G., Danti, S., Carlesi, C., & Di Fiorino, M. (2018). Aging with Down syndrome: The dual diagnosis: Alzheimer's disease and down syndrome. American Journal of Alzheimer's Disease and Other Dementias, 33(4), 253–262. https://doi.org/10.1177/1533317518761093.

    Article  PubMed  Google Scholar 

  3. Coppus, A., Evenhuis, H., Verberne, G.-J., et al. (2006). Dementia and mortality in persons with Down’s syndrome. Journal of Intellectual Disability Research, 50(10), 768–777. https://doi.org/10.1111/j.1365-2788.2006.00842.x.

    CAS  Article  PubMed  Google Scholar 

  4. Lai, F., & Williams, R. S. (1989). A prospective study of Alzheimer disease in Down syndrome. Archives of Neurology, 46(8), 849–853. https://doi.org/10.1001/archneur.1989.00520440031017.

    CAS  Article  PubMed  Google Scholar 

  5. McCarron, M., McCallion, P., Reilly, E., & Mulryan, N. (2014). A prospective 14-year longitudinal follow-up of dementia in persons with Down syndrome. Journal of Intellectual Disability Research, 58(1), 61–70. https://doi.org/10.1111/jir.12074.

    CAS  Article  PubMed  Google Scholar 

  6. Strydom, A., Coppus, A., Blesa, R., et al. (2018). Alzheimer’s disease in Down syndrome: An overlooked population for prevention trials. Alzheimer’s & Dementia: Translational Research & Clinical Interventions, 4(1), 703–713. https://doi.org/10.1016/j.trci.2018.10.006.

    Article  Google Scholar 

  7. Esbensen, A. J., Hooper, S. R., Fidler, D., et al. (2017). Outcome measures for clinical trials in Down syndrome. American Journal on Intellectual and Developmental Disabilities, 122(3), 247–281. https://doi.org/10.1352/1944-7558-122.3.247.

    Article  PubMed  PubMed Central  Google Scholar 

  8. Lautarescu, B. A., Holland, A. J., & Zaman, S. H. (2017). The early presentation of dementia in people with Down syndrome: A systematic review of longitudinal studies. Neuropsychology Review, 27(1), 31–45. https://doi.org/10.1007/s11065-017-9341-9.

    Article  PubMed  PubMed Central  Google Scholar 

  9. Ballard, C., Mobley, W., Hardy, J., Williams, G., & Corbett, A. (2016). Dementia in Down's syndrome. Lancet Neurology, 15(6), 622–636. https://doi.org/10.1016/S1474-4422(16)00063-6.

    Article  PubMed  Google Scholar 

  10. Hartley, D., Blumenthal, T., Carrillo, M., et al. (2015). Down syndrome and Alzheimer’s disease: Common pathways, common goals. Alzheimer's & Dementia, 11(6), 700–709. https://doi.org/10.1016/j.jalz.2014.10.007.

    Article  Google Scholar 

  11. Lott, I. T., & Head, E. (2019). Dementia in Down syndrome: Unique insights for Alzheimer’s disease research. Nature Reviews. Neurology, 15, 135–147.

    Article  Google Scholar 

  12. Startin, C. M., Rodger, E., Fodor-Wynne, L., Hamburg, S., & Strydom, A. (2016). Developing an informant questionnaire for cognitive abilities in Down syndrome: The cognitive scale for Down syndrome (CS-DS). PLoS One, 11(5), e0154596Published 2016 May 6. https://doi.org/10.1371/journal.pone.0154596.

    CAS  Article  PubMed  PubMed Central  Google Scholar 

  13. Sinai, A., Hassiotis, A., Rantell, K., & Strydom, A. (2016). Assessing specific cognitive deficits associated with dementia in older adults with Down syndrome: Use and validity of the Arizona cognitive test battery (ACTB). PLoS One, 11(5), e0153917Published 2016 May 12. https://doi.org/10.1371/journal.pone.0153917.

    CAS  Article  PubMed  PubMed Central  Google Scholar 

  14. McCarron, M., McCallion, P., Coppus, A., et al. (2018). Supporting advanced dementia in people with Down syndrome and other intellectual disability: Consensus statement of the international summit on intellectual disability and dementia. Journal of Intellectual Disability Research, 62(7), 617–624. https://doi.org/10.1111/jir.12500.

    CAS  Article  PubMed  Google Scholar 

  15. Keeling, L. A., Spiridigliozzi, G. A., Hart, S. J., Baker, J. A., Jones, H. N., & Kishnani, P. S. (2017). Challenges in measuring the effects of pharmacological interventions on cognitive and adaptive functioning in individuals with Down syndrome: A systematic review. American Journal of Medical Genetics. Part A, 173(11), 3058–3066. https://doi.org/10.1002/ajmg.a.38416.

    Article  PubMed  Google Scholar 

  16. Kiresuk, T. J., & Sherman, R. E. (1968). Goal attainment scaling: A general method for evaluating comprehensive community mental health programs. Community Mental Health Journal, 4(6), 443–453. https://doi.org/10.1007/BF01530764.

    CAS  Article  PubMed  Google Scholar 

  17. Rockwood, K., Graham, J. E., Fay, S., & ACADIE Investigators (2002). Goal setting and attainment in Alzheimer’s disease patients treated with donepezil. Journal of Neurology, Neurosurgery, and Psychiatry, 73(5), 500–507. https://doi.org/10.1136/jnnp.73.5.500.

    CAS  Article  PubMed  PubMed Central  Google Scholar 

  18. Rockwood, K., Fay, S., MacKnight, C., Gorman, M., & Video-Imaging Synthesis of Treating Alzheimer’s Disease (VISTA) Investigators (2006). Attainment of treatment goals by people with Alzheimer’s disease receiving galantamine: A randomized controlled trial. Canadian Medical Association Journal, 174(8), 1099–1105. https://doi.org/10.1503/cmaj.051432.

    Article  PubMed  Google Scholar 

  19. Rockwood, K. (2010). An individualized approach to tracking and treating Alzheimer’s disease. Clinical Pharmacology and Therapeutics, 88(4), 446–449. https://doi.org/10.1038/clpt.2010.68.

    CAS  Article  PubMed  Google Scholar 

  20. Stolee, P., Rockwood, K., Fox, R. A., & Streiner, D. L. (1992). The use of goal attainment scaling in a geriatric care setting. Journal of the American Geriatrics Society, 40(6), 574–578.

    CAS  Article  Google Scholar 

  21. Joyce, B. M., Rockwood, K., & Mate-Kole, C. C. (1994). Use of goal attainment scaling in brain injury in a rehabilitation hospital. American Journal of Physical Medicine & Rehabilitation, 73(1), 10.

    CAS  Article  Google Scholar 

  22. Gordon, J., Powell, C., & Rockwood, K. (1999). Goal attainment scaling as a measure of clinically important change in nursing-home patients. Age and Ageing, 28(3), 275–281. https://doi.org/10.1093/ageing/28.3.275.

    CAS  Article  PubMed  Google Scholar 

  23. Kloseck, M. (2007). The use of goal attainment scaling in a community health promotion initiative with seniors. BMC Geriatrics, 7(1), 16. https://doi.org/10.1186/1471-2318-7-16.

    Article  PubMed  PubMed Central  Google Scholar 

  24. Wallen, M., O’Flaherty, S. J., & Waugh, M.-C. A. (2007). Functional outcomes of intramuscular Botulinum toxin type a and occupational therapy in the upper limbs of children with cerebral palsy: A randomized controlled trial. Archives of Physical Medicine and Rehabilitation, 88(1), 1–10. https://doi.org/10.1016/j.apmr.2006.10.017.

    Article  PubMed  Google Scholar 

  25. Hartman, D., Borrie, M. J., Davison, E., & Stolee, P. (1997). Use of goal attainment scaling in a dementia special care unit. American Journal of Alzheimer's Disease, 12(3), 111–116. https://doi.org/10.1177/153331759701200303.

    Article  Google Scholar 

  26. Khan, F., Pallant, J. F., & Turner-Stokes, L. (2008). Use of goal attainment scaling in inpatient rehabilitation for persons with multiple sclerosis. Archives of Physical Medicine and Rehabilitation, 89(4), 652–659. https://doi.org/10.1016/j.apmr.2007.09.049.

    Article  PubMed  Google Scholar 

  27. Wilz, G., Weise, L., Reiter, C., Reder, M., Machmer, A., & Soellner, R. (2018). Intervention helps family caregivers of people with dementia attain own therapy goals. American Journal of Alzheimer's Disease and Other Dementias, 33(5), 301–308. https://doi.org/10.1177/1533317518769475.

    Article  PubMed  Google Scholar 

  28. Jennings, L. A., Ramirez, K. D., Hays, R. D., Wenger, N. S., & Reuben, D. B. (2016). Personalized goal attainment in dementia care: Measuring what persons with dementia and their caregivers want. Journal of the American Geriatrics Society, 66(11), 2120–2127. https://doi.org/10.1111/jgs.15541.

    Article  Google Scholar 

  29. Stolee, P., Stadnyk, K., Myers, A. M., & Rockwood, K. (1999). An individualized approach to outcome measurement in geriatric rehabilitation. The Journals of Gerontology. Series A, Biological Sciences and Medical Sciences, 54(12), 641–647. https://doi.org/10.1093/gerona/54.12.M641.

    Article  Google Scholar 

  30. Roberts, J. C., Lattimore, S., Recht, M., et al. (2018). Goal attainment scaling for haemophilia (GAS-Hēm): Testing the feasibility of a new patient-centric outcome measure in people with haemophilia. Haemophilia., 24(4), e199–e206. https://doi.org/10.1111/hae.13454.

    CAS  Article  PubMed  Google Scholar 

  31. Javadi, D., Lamarche, L., Avilla, E., et al. (2018). Feasibility study of goal setting discussions between older adults and volunteers facilitated by an eHealth application: Development of the health TAPESTRY approach. Pilot and Feasibility Studies, 4(1), 184. https://doi.org/10.1186/s40814-018-0377-2.

    Article  PubMed  PubMed Central  Google Scholar 

  32. Hale, L. A. (2010). Using goal attainment scaling in physiotherapeutic home-based stroke rehabilitation. Advances in Physiotherapy, 12(3), 142–149. https://doi.org/10.3109/14038196.2010.486040.

    Article  Google Scholar 

  33. Stolee, P., Awad, M., Byrne, K., DeForge, R., Clements, S., & Glenny, C. (2012). A multi-site study of the feasibility and clinical utility of goal attainment scaling in geriatric day hospitals. Disability and Rehabilitation, 34(20), 1716–1726. https://doi.org/10.3109/09638288.2012.660600.

    Article  PubMed  Google Scholar 

  34. Steenbeek, D., Ketelaar, M., Galama, K., & Gorter, J. W. (2008). Goal attainment scaling in paediatric rehabilitation: A report on the clinical training of an interdisciplinary team. Child: Care, Health and Development, 34(4), 521–529. https://doi.org/10.1111/j.1365-2214.2008.00841.x.

    CAS  Article  Google Scholar 

  35. Milne, J. L., Robert, M., Tang, S., Drummond, N., & Ross, S. (2009). Goal achievement as a patient-generated outcome measure for stress urinary incontinence. Health Expectations, 12(3), 288–300. https://doi.org/10.1111/j.1369-7625.2009.00536.x.

    Article  PubMed  PubMed Central  Google Scholar 

  36. King, G. A., McDougall, J., Palisano, R. J., Gritzan, J., & Tucker, M. A. (1999). Goal attainment scaling: Its use in evaluating pediatric therapy programs. Physical & Occupational Therapy in Pediatrics, 19(2), 31–52. https://doi.org/10.1080/J006v19n02_03.

    Article  Google Scholar 

  37. Burnes, D., Connolly, M.-T., Hamilton, R., & Lachs, M. S. (2018). The feasibility of goal attainment scaling to measure case resolution in elder abuse and neglect adult protective services intervention. Journal of Elder Abuse & Neglect, 30(3), 209–222. https://doi.org/10.1080/08946566.2018.1454864.

    Article  Google Scholar 

  38. Yip, A. M., Gorman, M. C., Stadnyk, K., Mills, W. G. M., MacPherson, M., & Rockwood, K. (1998). A standardized menu for goal attainment scaling in the care of frail elders. The Gerontologist, 38(6), 735–742. https://doi.org/10.1093/geront/38.6.735.

    CAS  Article  PubMed  Google Scholar 

  39. Reeve, E., Molin, P., Hui, A., & Rockwood, K. (2017). Exploration of verbal repetition in people with dementia using an online symptom-tracking tool. International Psychogeriatrics, 29(6), 959–966. https://doi.org/10.1017/S1041610216002180.

    Article  PubMed  PubMed Central  Google Scholar 

  40. Rockwood, K., Sanon Aigbogun, M., Stanley, J., et al. (2019). The symptoms targeted for monitoring in a web-based tracking tool by caregivers of people with dementia and agitation: Cross-sectional study. Journal of Medical Internet Research, 21(6), e13360. https://doi.org/10.2196/13360.

    Article  PubMed  PubMed Central  Google Scholar 

  41. Rockwood, K., Mitnitski, A., Black, S. E., Richard, M., & Defoy, I. (2013). Cognitive change in donepezil treated patients with vascular or mixed dementia. Canadian Journal of Neurological Sciences / Journal Canadien des Sciences Neurologiques, 40(4), 564–571. https://doi.org/10.1017/S0317167100014670.

    Article  Google Scholar 

  42. Rockwood, K., Howlett, S. E., Hoffman, D., Schindler, R., & Mitnitski, A. (2017). Clinical meaningfulness of Alzheimer's disease assessment scale-cognitive subscale change in relation to goal attainment in patients on cholinesterase inhibitors. Alzheimers Dement, 13(10), 1098–1106. https://doi.org/10.1016/j.jalz.2017.02.005.

    Article  PubMed  Google Scholar 

  43. Rockwood, K., Zeng, A., Leibman, C., Mucha, L., & Mitnitski, A. (2012). Validation of an informant-reported web-based data collection to assess dementia symptoms. Journal of Medical Internet Research, 14(2), e42Published 2012 Mar 12. https://doi.org/10.2196/jmir.1941.

    Article  PubMed  PubMed Central  Google Scholar 

  44. Patrick, D. L., Burke, L. B., Gwaltney, C. J., et al. (2011). Content validity—Establishing and reporting the evidence in newly developed patient-reported outcomes (PRO) instruments for medical product evaluation: ISPOR PRO good research practices task force report: Part 1— Eliciting concepts for a new PRO instrument. Value in Health, 14(8), 967–977.

    Article  Google Scholar 

  45. Patrick, D. L., Burke, L. B., Gwaltney, C. J., et al. (2011). Content validity—Establishing and reporting the evidence in newly developed patient-reported outcomes (PRO) instruments for medical product evaluation: ISPOR PRO good research practices task force report: Part 2—Assessing respondent understanding. Value in Health, 14(8), 978–988.

    Article  Google Scholar 

  46. Lai, F., Kammann, E., Rebeck, G. W., Anderson, A., Chen, Y., & Nixon, R. A. (1999). APOE genotype and gender effects on Alzheimer’s disease in 100 adults with Down syndrome. Neurology., 53(2), 331–336. https://doi.org/10.1212/wnl.53.2.331.

    CAS  Article  PubMed  Google Scholar 

  47. Chun Tie, Y., Birks, M., & Francis, K. (2019). Grounded theory research: A design framework for novice researchers. SAGE Open Medicine, 7, 2050312118822927. https://doi.org/10.1177/2050312118822927.

    Article  PubMed  PubMed Central  Google Scholar 

  48. Gale, N. K., Heath, G., Cameron, E., Rashid, S., & Redwood, S. (2013). Using the framework method for the analysis of qualitative data in multi-disciplinary health research. BMC Medical Research Methodology, 13, 1–8.

    Article  Google Scholar 

  49. US Food and Drug Administration (2009). Guidance for industry patient-reported outcome measures: Use in medical product development to support labeling claims https://www.fda.gov/media/77832/download. Accessed 9 Apr 2020.

    Google Scholar 

  50. Blok, J. B., Scheirs, J. G. M., & Thijm, N. S. (2017). Personality and behavioural changes do not precede memory problems as possible signs of dementia in ageing people with Down syndrome. International Journal of Geriatric Psychiatry, 32, 1257–1263.

    CAS  Article  Google Scholar 

  51. Deb, S., Hare, M., & Prior, L. (2007). Symptoms of dementia among adults with Down’s syndrome: A qualitative study. Journal of Intellectual Disability Research, 51, 726–739.

    CAS  Article  Google Scholar 

  52. El Haj, M., Roche, J., Jardri, R., Kapogiannis, D., Gallouj, K., & Antoine, P. (2017). Clinical and neurocognitive aspects of hallucinations in Alzheimer's disease. Neuroscience and Biobehavioral Reviews, 83, 713–720.

    Article  Google Scholar 

  53. McGarrigle, L., Howlett, S. E., Wong, H., Stanley, J., & Rockwood, K. (2019). Characterizing the symptom of misplacing objects in people with dementia: Findings from an online tracking tool. International Psychogeriatrics, 31(11), 1635–1641. https://doi.org/10.1017/S104161021800220X.

    Article  PubMed  Google Scholar 

  54. Haley, W. E., & Perkins, E. A. (2004). Current status and future directions in family caregiving and aging people with intellectual disabilities. Journal of Policy and Practice in Intellectual Disabilities, 1(1), 24–30. https://doi.org/10.1111/j.1741-1130.2004.04004.x.

    Article  Google Scholar 

  55. Fonseca, L. M., Padilla, C., Jones, E., et al. (2020). Amnestic and non-amnestic symptoms of dementia: An international study of Alzheimer's disease in people with Down's syndrome. International Journal of Geriatric Psychiatry, 35(6), 650–661. https://doi.org/10.1002/gps.5283.

    Article  PubMed  Google Scholar 

  56. Knopman, D. S., Knapp, M. J., Gracon, S. I., & Davis, C. S. (1994). The clinician interview-based impression (CIBI): A clinician's global change rating scale in Alzheimer's disease. Neurology., 44(12), 2315–2321. https://doi.org/10.1212/wnl.44.12.2315.

    CAS  Article  PubMed  Google Scholar 

  57. Turner-Stokes, L. (2009). Goal attainment scaling (GAS) in rehabilitation: A practical guide. Clinical Rehabilitation, 23, 362–370. https://doi.org/10.1177/0269215508101742.

    Article  PubMed  Google Scholar 

  58. Rockwood, K., Richard, M., Leibman, C., Mucha, L., & Mitnitski, A. (2013). Staging dementia from symptom profiles on a care partner website. Journal of Medical Internet Research, 15(8), e145Published 2013 Aug 7. https://doi.org/10.2196/jmir.2461.

    Article  PubMed  PubMed Central  Google Scholar 

Download references

Acknowledgments

Not Applicable.

Funding

This study was funded by the LuMind IDSC Foundation and conducted by DGI Clinical Inc.

Author information

Authors and Affiliations

  1. DGI Clinical Inc, 300SH-1701 Hollis St, Halifax, NS, B3J 3M8, Canada

    Kari Knox, Justin Stanley, Taylor Dunn, Sanja Stanojevic, Susan E. Howlett & Kenneth Rockwood

  2. LuMind IDSC Foundation, Burlington, MA, USA

    James A. Hendrix & Hampus Hillerstrom

  3. Dalhousie University, Halifax, NS, Canada

    Jillian Achenbach, Susan E. Howlett & Kenneth Rockwood

  4. Advocate Medical Group, Park Ridge, IL, USA

    Brian A. Chicoine

  5. Massachusetts General Hospital, Harvard University, Boston, MA, USA

    Florence Lai

  6. University of California Irvine Institute for Memory Impairments and Neurological Disorders, Irvine, CA, USA

    Ira Lott

Authors
  1. Kari Knox
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Justin Stanley
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. James A. Hendrix
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Hampus Hillerstrom
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Taylor Dunn
    View author publications

    You can also search for this author in PubMed Google Scholar

  6. Jillian Achenbach
    View author publications

    You can also search for this author in PubMed Google Scholar

  7. Brian A. Chicoine
    View author publications

    You can also search for this author in PubMed Google Scholar

  8. Florence Lai
    View author publications

    You can also search for this author in PubMed Google Scholar

  9. Ira Lott
    View author publications

    You can also search for this author in PubMed Google Scholar

  10. Sanja Stanojevic
    View author publications

    You can also search for this author in PubMed Google Scholar

  11. Susan E. Howlett
    View author publications

    You can also search for this author in PubMed Google Scholar

  12. Kenneth Rockwood
    View author publications

    You can also search for this author in PubMed Google Scholar

Contributions

This study was conceived by HH, JAH, and KR. Data were acquired by KK and KR. Data analyses were performed by KK, JS, TD, and KR and all authors were involved in the interpretation of results. KK, JS, and KR drafted the manuscript which was critically reviewed and approved by all authors.

Corresponding author

Correspondence to Kenneth Rockwood.

Ethics declarations

Ethics approval and consent to participate

Ethical approval was granted by WIRB-Copernicus Group Company IRB. The approval number is 20192259. All caregivers provided informed consent.

Consent for publication

Not applicable.

Competing interests

HH is President and CEO and JAH is CSO of the LuMind IDSC Foundation. This study was conducted by DGI Clinical Inc. in which KR is President, Chief Science Officer and a shareholder. KK, JS, TD, SS, SEH and TD are employees of DGI Clinical Inc. In the last 3 years, KR has also attended an advisory board meeting for Roche/Genentech and Nutricia and has given two talks sponsored by Nutricia.

Additional information

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Appendix

Appendix

Criteria for Participant Selection

Recruitment Targets:

  • Population: Caregivers of people with both Down syndrome and a diagnosis or clinical suspicion of dementia

  • Geographic location: United States of America

  • Age: Adult caregivers aged 18 years or older; Person with Down syndrome and dementia aged 45 years or older

  • Gender: Men and Women

  • Race: Any

  • Number of participants: 8–10

  • Selection method: Purposive sampling

Inclusion Criteria:

Caregiver:

  • Aged 18 years or older

  • English speaking

  • Access to computer with internet access

  • Currently cares for or had recently cared for someone with both Down syndrome and dementia

  • Willing and able to discuss symptoms, changes, and challenges with respect to Down syndrome and dementia.

  • Familiar with the person with Down syndrome prior to dementia onset

Person with Down syndrome and dementia:

  • Aged 45 years or older

  • Diagnosed with Down syndrome

  • Diagnosed with or clinical suspicion of dementia

Exclusion Criteria

Caregiver:

  • Inability to complete interview in English

  • Unable to meet technical requirements (e.g. unable to connect microphone, speakers, or telephone with video conferencing tool)

  • Inability/refusal to meet scheduling needs of interviewer

  • Refusal to provide informed consent

Rights and permissions

Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/.

Reprints and Permissions

About this article

Verify currency and authenticity via CrossMark

Cite this article

Knox, K., Stanley, J., Hendrix, J.A. et al. Development of a symptom menu to facilitate Goal Attainment Scaling in adults with Down syndrome-associated Alzheimer’s disease: a qualitative study to identify meaningful symptoms. J Patient Rep Outcomes 5, 5 (2021). https://doi.org/10.1186/s41687-020-00278-7

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1186/s41687-020-00278-7

Keywords

  • Down syndrome
  • Alzheimer’s disease
  • Dementia
  • Goal attainment scaling
  • Symptoms
  • Qualitative study