- Open Access
Patient-reported outcome measures for life engagement in mental health: a systematic review
Journal of Patient-Reported Outcomes volume 6, Article number: 62 (2022)
Life engagement in the context of mental health is a broad term that describes positive health aspects relating to cognition, vitality, motivation and reward, and the ability to feel pleasure—concepts that are meaningful to patients. The aim of this systematic literature review was to identify validated patient-reported outcomes (PROs) that can assess any aspect of life engagement in adults, in the field of general mental health.
This was a systematic literature review of articles in English from the MEDLINE database (date of search: September 9, 2020). The search strategy had three components: (1) terms to capture PROs; (2) terms to capture mental health; and (3) terms to capture aspects of life engagement. Articles were eligible if they included a PRO that: (1) is named; (2) can be used across mental health disorders; (3) is used to assess any aspect of life engagement; and (4) has undergone psychometric validation and/or qualitative content validation. A list of PROs was extracted.
A total of 1585 records were screened and 233 articles were eligible for inclusion. Within these 233 articles, 49 distinct PROs were identified, two of which specifically captured their authors’ interpretation of life engagement: the Engaged Living Scale (ELS) and the Life Engagement Test (LET). However, while the ELS and LET covered motivation and reward, life fulfillment, and value-based living, neither scale captured the cognitive or vitality aspects of life engagement. The remaining identified PROs generally captured single aspects of life engagement, most commonly motivation/reward/energy–apathy, pleasure–anhedonia, and mental/psychological well-being.
Numerous PROs are available that may capture aspects of life engagement. However, a need remains for a new PRO that can be used in clinical trials to provide a more comprehensive description of the improvements in life engagement that patients with mental health disorders may experience with successful treatment.
A patient’s subjective view of their own health is increasingly being recognized as an essential part of health care. Patient-reported outcomes (PROs) can be used in clinical research to capture outcomes that are meaningful to the patient, in a manner that is standardized across the trial population [1, 2]. The United States Food and Drug Administration (FDA) encourages the use of patient experience data, including PROs, in clinical trials , and both the FDA and European Medicines Agency (EMA) are developing guidance to advance patient-focused drug development [4, 5]. PROs can also be used in clinical practice to monitor patient progress and to assess treatment benefits .
In mental health, there are numerous PROs that can measure patient well-being, quality of life, treatment satisfaction, patient needs, and the therapeutic relationship [6,7,8]. There remains a need for PROs that can measure other concepts that are meaningful to patients, such as ‘life engagement’.
In the context of mental health, a conceptual framework for patient life engagement has been developed by Weiss et al., with the objective of better defining and capturing meaningful patient functional outcomes including life fulfillment, well-being, and participation in valued and meaningful activities [9, 10]. The life engagement concept includes positive health aspects relating to cognition (including ‘hot’ cognition, i.e., cognition colored by emotion), vitality, motivation and reward, and the ability to feel pleasure, and was developed based on transcripts from patient interviews and discussion with a panel of expert psychiatrists . The rationale for developing the framework was that health care professionals and patient call centers had provided unsolicited feedback to a drug manufacturer describing benefits of a depression treatment that were not fully captured by existing terminology. Specifically, in the new framework, life engagement is split into four domains: emotional (affect/mood), physical (energy), social (interest), and cognitive (alertness/thinking). The framework was validated in a separate study, in which 20 patients with major depressive disorder (MDD) were interviewed and asked to describe how they felt when engaged with life . The patients’ definitions and experiences were consistent with the four domains of Weiss et al., suggesting that the framework successfully captures the concept of life engagement, and that the concept resonates with patients. In an online survey, patients with mental health disorders (depression or bipolar disorder) listed aspects of life engagement, such as being proactive, returning to activities that they used to enjoy, and being able to maintain concentration on activities, among the top indicators of treatment effectiveness .
The concept of life engagement overlaps with, but is not fully captured by, other concepts in mental health. For example, life engagement incorporates improvement of anhedonia (which comprises motivational and consummatory aspects ) and apathy (which comprises behavior/cognition, emotion, and social interaction dimensions )—important treatment targets in mental health [15, 16]. However, anhedonia and apathy alone do not describe the aspects of life engagement relating to attention, alertness, and clarity of thought . Similarly, quality of life (defined by the World Health Organization as an individual’s perception of their position in life in the context of the culture and value systems in which they live and in relation to their goals, expectations, standards and concerns ) and mental well-being (which refers to an individual’s ability to develop their potential, work productively and creatively, build strong and positive relationships with others and contribute to their community ) do not fully capture the energy and alertness aspects of life engagement.
It is not clear if any PROs exist that are fit for purpose to measure life engagement in clinical trials or in clinical practice. The aim of this systematic literature review (SLR) was to identify validated PROs that can assess any aspect of life engagement in adults, in the field of general mental health, in order to answer the question: can the life engagement framework be evaluated in research and/or clinical practice using existing tools?
An SLR was conducted to search for eligible PROs relating to life engagement. The search strategy and inclusion criteria were specified in advance and documented in a protocol.
Reports were considered eligible if they described studies in adults in any mental health area, including mental health symptoms in a non-clinical sample. The outcomes of each study must have included a PRO that (1) was named (i.e., not a one-off questionnaire or visual analogue scale); (2) could be used across mental health disorders (i.e., it was not for a specific disease); (3) was used to assess any aspect of life engagement; and (4) had undergone psychometric validation (e.g., criterion validity, construct validity) and/or qualitative content validation [19, 20]. Any study type, with or without an intervention and comparator, was permitted. Reports must have been published in English.
The search strategy had three components: (1) terms to capture articles that include one or more PROs; (2) terms to capture articles in general mental health; and (3) terms to capture articles covering life engagement. The terms to capture life engagement were developed in pairs such that each aspect of life engagement had both a positively and negatively valenced descriptor (e.g., engaged–disengaged; pleasure–anhedonia; motivated–aimless). Studies were identified by searching the MEDLINE/PubMed database (which covers the period, 1964–present) using the following terms: (“patient-report*” OR “patient-rated” OR “self-report*” OR “self-rated” OR “self-evaluation”) AND (scale OR measure OR instrument OR tool) AND (“mental health” OR psychiatry) AND (engag*[title] OR motivat*[title] OR reward*[title] OR enthusias*[title] OR passion*[title] OR effort[title] OR pleasur*[title] OR “well-being”[title] OR energiz*[title] OR arous*[title] OR connected*[title] OR attent*[title] OR alert*[title] OR calmness[title] OR calm[title] OR ataraxi*[title] OR disengag*[title] OR aimless[title] OR apath*[title] OR laziness[title] OR lazy[title] OR anhedoni*[title] OR disaffection[title] OR letharg*[title] OR disconnected*[title] OR indifferen*[title] OR inattent*[title] OR excit*[title] OR ruminat*[title] OR unsettl*[title] OR initiative[title] OR ambitio*[title] OR relax*[title] OR incent*[title] OR passive[title] OR disinterest*[title] OR detach*[title]). During development of the protocol, the search strategy was tested to confirm that it captured two known PROs (the Temporal Experience of Pleasure Scale and the Snaith–Hamilton Pleasure Scale).
No language or date restrictions were applied to the electronic search, and all article types were eligible. The search was performed on September 9, 2020, by CPW.
First, retrieved records were screened based on their titles and abstracts, and excluded if: (1) not in English; (2) in a non-mental health topic; (3) in children or adolescents; (4) it was clear from the abstract that the article did not contain a PRO; (5) it was clear from the abstract that the article contained only a disease-specific PRO or PRO for a non-life engagement topic.
Second, full-text articles were retrieved and excluded if: (1) the article did not contain a PRO, or contained only unnamed PROs; (2) the article contained only disease-specific PROs and/or PROs for non-life engagement topics, or where questions were about a specific task/activity (e.g., sport). The scope of the SLR was full scales, not subscales or individual items. With regard to ‘well-being’, this was applied in the context of positive mental health (i.e., psychological and social well-being) , as opposed to physical well-being/health. Satisfaction with life was not included in the search terms, but these PROs were included because satisfaction with life is related to the concept of life engagement.
Eligibility assessment was performed by a single reviewer (CPW).
PRO names were extracted from eligible articles by a single reviewer (CPW). Based on this shortlist of PROs, further research was conducted and articles were excluded if: (1) no psychometric or qualitative content evaluation was available for the PRO; or (2) no English language version of the PRO was available.
Since the purpose of the review was to generate a list of PROs, no study outcomes were extracted and no bias assessment was necessary. The number of eligible articles in which each PRO appeared was counted.
A total of 1585 records were screened, and 233 articles were eligible for inclusion (Fig. 1). Within these 233 articles, a total of 49 distinct PROs were identified (Table 1). In addition, the SLR identified two prior reviews of ‘well-being’ scales (using a very broad definition of well-being that included quality of life, physical well-being, and health), which found 99 and 60 PROs respectively [6, 7].
Of the 49 identified PROs, two specifically captured their respective authors’ interpretation of life engagement (Engaged Living Scale and Life Engagement Test). In addition, three PROs captured engagement in the context of work/occupations. The remaining PROs generally captured single aspects of life engagement, rather than multiple aspects; most commonly motivation/reward/energy–apathy, pleasure–anhedonia, and mental/psychological well-being (Table 1).
The three most frequently identified PROs were specific measures of pleasure/anhedonia: the Revised Chapman Physical and Social Anhedonia Scales (appeared in 36 eligible articles), the Snaith–Hamilton Pleasure Scale (33 articles), and the Temporal Experience of Pleasure Scale (29 articles).
Many PROs appeared in eligible articles just once (20/49; 40.8%). The majority of PROs appeared ≤ 3 times (32/49; 65.3%).
Descriptions of selected PROs
Of the 49 identified PROs, the ten judged by the authors as most relevant to life engagement are described in more detail below. These ten scales (an arbitrary number) were singled out for more detailed descriptions because they include items that can measure multiple aspects of life engagement.
Engaged Living Scale (ELS)
The ELS  measures engaged living in the context of acceptance and commitment therapy (ACT). ACT is a form of cognitive behavioral therapy that aims to enhance a person’s acceptance of negative emotions, memories, and thoughts, so that they might engage in valued life activities. The ELS comprises 16 items across two subscales: Valued living (ten items, e.g., “I have values that give my life more meaning”, “I know what motivates me in life”); and Life fulfillment (six items, e.g., “I live the way I always intended to live”, “I am satisfied with how I live my life”). Items are scored on a 5-point scale, from 1 (completely disagree) to 5 (completely agree). A total score and subscale scores are obtained by summing the item scores.
In a general non-clinical sample, and in a sample with chronic pain, the ELS showed good internal consistency (Cronbach’s α = 0.90–0.91) and construct validity, correlating with outcomes including psychological well-being (Pearson’s r = 0.35–0.64), anxiety (r = − 0.30), and depression (r = − 0.46) . The ELS has not been used in a sample with mental health disorders.
Life Engagement Test (LET)
The LET  measures purpose in life. It comprises six items assessing the extent to which a person considers their activities to be valuable and important, e.g., “There is not enough purpose in my life”, “To me, the things I do are all worthwhile”. Items are scored on a 5-point scale, from 1 (strongly disagree) to 5 (strongly agree); some items are reverse scored. A total score is obtained by summing the item scores.
In a general non-clinical sample, university students, and a variety of clinical (non-mental health) samples, the LET showed acceptable internal consistency (Cronbach’s α = 0.72–0.87), moderately stable test–retest reliability (r = 0.61–0.76), and construct validity based on correlations with other psychosocial measures including depression (r = − 0.33 to − 0.49) and mental health (r = 0.32–0.49) .
Shirom–Melamed Vigor Measure (SMVM)
The SMVM  measures vigor or energetic feelings at work during the past 30 days. It comprises 14 items across three subscales: Physical strength (five items, e.g., “I feel full of pep”, “I feel energetic”); Cognitive liveliness (five items, e.g., “I feel mentally alert”, “I feel I can think rapidly”); and Emotional energy (four items, e.g., “I feel able to show warmth to others”, “I feel able to be sensitive to the needs of coworkers and customers”). Items are scored on a 7-point scale, from 1 (never or almost never) to 7 (always or almost always).
In a sample of employees, the SMVM subscales each showed good internal consistency (Cronbach’s α = 0.95 for Physical strength, 0.72 for Cognitive liveliness, and 0.88 for Emotional energy), with moderate intercorrelation between subscales (mean r = 0.44) . Each subscale negatively correlated with a measure of emotional exhaustion (burnout) (mean r = − 0.17), and positively correlated with personal accomplishment (mean r = 0.47) and another measure of work engagement (r = 0.45–0.66) [27, 80]. The SMVM has not been used in a sample with mental health disorders.
Apathy Evaluation Scale Self-report (AES-S)
The AES-S  measures apathy including interests, productivity and initiative during the past 4 weeks. The original AES-S had 18 items; subsequent factor analysis identified an Apathy subscale comprising 12 items, e.g., “Are you interested in things?”, “Is it important for you to get things done during the day?”, “Do you feel motivated?” [29,30,31]. Items are scored on a 5-point scale, from 0 (not at all) to 4 (very much) [29,30,31].
In a sample that included healthy participants and those with MDD, the AES-S showed satisfactory internal consistency (Cronbach’s α = 0.86) and test–retest reliability (Pearson’s r = 0.76); convergent validity with clinician-rated apathy (r = 0.72) (the correlation was smaller with informant-rated apathy, r = 0.43); divergent validity with patient-rated depression and anxiety (r = 0.42 for both); and was able to discriminate between healthy participants and those with MDD . The AES has also been validated in psychosis/schizophrenia, and is able to distinguish patients with schizophrenia from healthy controls [31, 81].
Motivation and Pleasure Scale—Self-Report (MAP-SR)
The MAP-SR  measures motivation and pleasure during the past week. It has 15 items, covering the domains of social and recreational or work pleasure (six items, e.g., “In the past week, how often have you experienced pleasure from being with other people?”, “Looking ahead to being with other people in the next few weeks, how much pleasure do you expect you will experience from being with others?”); feelings and motivations about close, caring relationships (three items, e.g., “When it comes to relationships with your family members, how important have these relationships been to you over the past week?”); and motivation and effort to engage in activities (six items, e.g., “In the past week how motivated have you been to be around other people and do things with them?”, “In the past week how much effort have you made to actually do things with other people?”). Items are scored on a 5-point scale, from 0 (none/not at all) to 4 (very/extremely).
In schizophrenia/schizoaffective disorder, the MAP-SR showed excellent internal consistency (Cronbach’s α = 0.90), good convergent validity with another rating of motivation and pleasure (r = 0.65), and divergent validity from depressive/anxiety symptoms (r = 0.06) and positive symptoms (r = 0.11), though not from agitation/mania (r = 0.41) .
Motivation and Energy Inventory (MEI)
The MEI  measures vitality in the past 4 weeks. It was designed to be responsive to treatment effects and able to discriminate among patient populations with differing clinical characteristics. It comprises 27 items across three subscales: Mental energy (ten items, e.g., “During the past 4 weeks, how often did you feel satisfied with what you accomplished during the day?”, “During the past 4 weeks, how often did you have trouble getting out of bed in the morning because you didn’t want to face the day?”), Social motivation (ten items, e.g., “During the past 4 weeks, how often did you avoid social conversations with others?”, “During the past 4 weeks, how much of the time did you prefer to be alone?”), and Physical energy (seven items, e.g., “During the past 4 weeks, how often did you feel enthusiastic when you began your day?”, “During the past 4 weeks, how often did you run out of energy before the end of the day?”). Items are variably scored on a 5-, 6- or 7-point scale; some items are reverse scored.
In depression, the three MEI subscales each showed good internal consistency (Cronbach’s α = 0.75–0.89), construct validity (moderate correlation with quality of life, r = − 0.42 to − 0.64, and modest correlation with depressive symptoms, r = − 0.15 to − 0.26), and could detect changes over time . In schizophrenia, an 18-item inpatient version of the MEI distinguished between patients and controls, and correlated with symptoms including depressive symptoms (Spearman’s r = − 0.49) and overall psychopathology (r = − 0.37), but not positive symptoms (r = − 0.14), indicating good divergent validity . The 18-item inpatient version has also been used in MDD .
Dimensional Anhedonia Rating Scale (DARS)
The DARS  measures desire/interest, motivation, effort, and pleasure “right now”. It comprises 17 items across four domains: Hobbies/past-times, Food/drinks, Social activities, and Sensory experiences. For each domain, the patient must provide two examples of what they find rewarding (e.g., their two favorite hobbies/past-times), and then answer standardized questions about these examples (e.g., “I would enjoy these activities”, “I would spend time doing these activities”). Items are scored on a 5-point scale, from 0 (not at all) to 4 (very much); some items are reverse scored. A total score is obtained by summing the item scores.
In patients with MDD/bipolar depressive episodes, the DARS showed excellent internal consistency (Cronbach’s α = 0.96), convergent validity with another anhedonia scale (r = − 0.79), moderate correlation with a depression measure (r = − 0.37), and was able to distinguish MDD from healthy controls .
World Health Organization (Five) Well-Being Questionnaire (WHO-5)
The WHO-5  measures psychological well-being over the past 2 weeks. It comprises five items: “I feel cheerful and in good spirits”, “I feel calm and relaxed”, “I feel active and vigorous”, “I wake up feeling fresh and rested”, and “My daily life is filled with things that interest me”. Items are scored on a 6-point scale, from 0 (at no time) to 5 (all the time). A ‘raw score’ from 0 to 25 is obtained by summing the item scores, and a ‘standardized percentage score’ from 0 to 100 is calculated by multiplying the raw score by 4.
The WHO-5 is a widely administered PRO that can be used irrespective of underlying illness (or lack of illness), and has been thoroughly validated across many different mental health settings [84,85,86,87]. It can be used as a screening tool for depression (a raw score below 13 is an indication that the individual should be tested for depression), and it can capture improvement in well-being over time in clinical trials [62, 85].
Comprehensive Inventory of Thriving (CIT)
The CIT  is a comprehensive measure of psychological well-being designed for use in research purposes and for in-depth assessment of well-being in health settings, such as psychiatric and clinical practices. It is also available as a brief version for initial assessment of well-being. The CIT comprises 54 items across seven dimensions: Relationships (e.g., “There are people I can depend on to help me”), Engagement (e.g., “I get fully absorbed in activities I do”), Mastery (e.g., “I use my skills a lot in my everyday life”), Autonomy (e.g., “Other people decide most of my life decisions”), Meaning (e.g., “My life has a clear sense of purpose”), Optimism (e.g., “I am optimistic about my future”), and Subjective well-being (e.g., “I feel negative most of the time”). Items are scored on a 5-point scale, from 1 (strongly disagree) to 5 (strongly agree); some items are reverse scored.
In a general non-clinical sample, the CIT subscales showed good internal consistency (Cronbach’s α = 0.71–0.96), good test–retest reliability (r = 0.57–0.83), convergent validity with other measures of psychological well-being, divergent validity with measures of ill-being, and good predictive validity for health and quality of life . The CIT also negatively correlates with measures of depression (r = − 0.46) and anxiety (r = − 0.34) .
Stress Arousal Checklist (SACL)
The SACL  measures stress and arousal. It comprises two subscales, which do not correlate with each other [74, 89]. Originally, the Stress subscale consisted of 19 adjectives (tense, worried, apprehensive, bothered, uneasy, dejected, uptight, nervous, distressed, fearful, jittery, peaceful, relaxed, cheerful, contented, pleasant, comfortable, calm, restful), and the Arousal subscale consisted of 15 adjectives (active, energetic, vigorous, alert, lively, activated, stimulated, aroused, drowsy, tired, idle, sluggish, sleepy, somnolent, passive). However, other studies have since adjusted the list of adjectives (for example, 20- and 30-adjective versions are available) [90, 91]. Each adjective is rated as one of four options: ‘definitely feel’ (++), ‘feel slightly’ (+), ‘do not understand or cannot decide’ (?), and ‘definitely do not feel’ (−). These scores are dichotomized to a 2-point scale, from 0 (do not feel [− and ?]) to 1 (do feel [++ and +]) (some items are reverse scored), and summed for each subscale.
The SACL subscales are able to differentiate psychiatric inpatients from healthy controls . In university students, compared with another measure of stress, the Stress subscale showed convergent validity (r = 0.85) and the Arousal subscale showed divergent validity (r = − 0.25) . Compared with a measure of relaxation, the Arousal subscale showed greater correlation (r = 0.35) than the Stress subscale (r = 0.23) .
In this review, 49 validated PROs of varying complexity were identified that may be used to assess aspects of life engagement in adults with mental health symptoms. From this list, only two PROs specifically captured their respective authors’ interpretation of life engagement; the remaining PROs generally focused on a single aspect of life engagement, for example, the ability to feel pleasure. Overall, the results of this review indicate that there are no validated PROs that can capture all aspects of life engagement within the conceptual framework defined by expert psychiatrists , and thus it is not possible to fully evaluate the life engagement framework in research and/or clinical practice using existing tools.
Considering the two ‘life engagement’ PROs, the Engaged Living Scale (ELS) and Life Engagement Test (LET) each include items to measure motivation and reward, life fulfillment, and value-based living [22, 23]. The LET also includes an item to measure valued activities. However, neither PRO captures the cognitive or vitality aspects of life engagement, which are important aspects of treatment effectiveness . Furthermore, both PROs are rather brief—the LET comprises just six items, and the ELS comprises six ‘life fulfillment’ items that measure a person’s current status (e.g., “I feel that I am living a full life”), with the remaining ten ‘valued living’ items being more conceptual and potentially less useful to track changes over time (e.g., “I know how I want to live my life”). Finally, both PROs appeared just once in eligible SLR articles, and neither PRO has been used in a sample with mental health disorders (though both negatively correlate with mental health symptoms), suggesting that neither PRO has become established in mental health clinical research or practice.
Considering specific aspects of life engagement, a number of widely used PROs were identified to measure pleasure–anhedonia, in line with a previous review in MDD . Anticipatory pleasure (related to motivation to engage in rewarding and goal-directed behavior) and consummatory pleasure (momentary pleasure that is experienced while engaged in an enjoyable activity) may be suppressed in mental health disorders [93, 94], and are likely to be key components of life engagement. Other aspects of engagement for which commonly used PROs were identified included motivation/reward/energy–apathy, attention/alertness, mental/psychological well-being, life satisfaction/meaning, and rumination. However, none of these PROs encompass the full concept of life engagement.
Another observation from this review is that the majority of PROs appeared in the search results ≤ 3 times, indicating that most of these rating scales have not become established in research.
The implications of this review for research and clinical practice are that there is a need for a new, validated PRO to more comprehensively measure life engagement in mental health—a meaningful clinical outcome beyond improvement of core symptoms. Thus, future research should attempt to develop such a PRO, potentially by adapting or combining PROs identified in this review to better align with the framework. Recently, an expert panel attempted to repurpose an existing PRO of depressive symptoms to potentially capture multiple aspects of life engagement . The panel selected relevant items from the Inventory of Depressive Symptomatology Self-Report (IDS-SR) to create the ‘IDS-SR10 Life Engagement’ exploratory subscale. Though in need of further validation and input from patients, the IDS-SR10 Life Engagement subscale has been used to show a benefit for active treatment versus placebo in a post hoc analysis of MDD clinical studies, and may represent a useful new tool in clinical research .
It should be noted that improvement in functional outcomes that reflect life engagement may lag behind symptomatic improvement, since the presence of unresolved mental health symptoms can limit improvements in other domains [96, 97]. Thus, a life engagement PRO may not show a treatment effect as quickly as a PRO that measures core mental health symptoms.
Limitations of this SLR include that a single database was searched; that a single reviewer selected articles, increasing the risk of rejecting relevant reports; and that PROs tend to be secondary or exploratory study outcomes in clinical trials, and thus may not be mentioned in the publication abstract. Finally, the conceptual framework of life engagement requires additional validation and further clarification on how it differs from existing concepts.
Numerous PROs are available that may capture aspects of life engagement. However, a need remains for a new PRO that can be used in clinical trials in mental health disorders to provide a more comprehensive description of improvements in life engagement that may result from successful treatment. If such a tool can be developed, it will assist in the development of new treatments that may provide meaningful and valued benefits to patients with mental health disorders.
Availability of data and materials
All data generated or analyzed during this study are included in this published article.
Acceptance and commitment therapy
Apathy Evaluation Scale Self-report
Comprehensive Inventory of Thriving
Dimensional Anhedonia Rating Scale
Engaged Living Scale
European Medicines Agency
Food and Drug Administration
Inventory of Depressive Symptomatology Self-Report
Life Engagement Test
Motivation and Pleasure Scale—Self-Report
Major depressive disorder
Motivation and Energy Inventory
Stress Arousal Checklist
Systematic literature review
Shirom–Melamed Vigor Measure
World Health Organization (Five) Well-Being Questionnaire
Mercieca-Bebber R, King MT, Calvert MJ, Stockler MR, Friedlander M (2018) The importance of patient-reported outcomes in clinical trials and strategies for future optimization. Patient Relat Outcome Meas 9:353–367
Weldring T, Smith SMS (2013) Patient-reported outcomes (PROs) and patient-reported outcome measures (PROMs). Health Serv Insights 6:61–68
Kieffer CM, Miller AR, Chacko B, Robertson AS (2020) FDA reported use of patient experience data in 2018 drug approvals. Ther Innov Regul Sci 54(3):709–716
United States Food and Drug Administration (FDA) (2020) FDA patient-focused drug development guidance series for enhancing the incorporation of the patient’s voice in medical product development and regulatory decision making. https://www.fda.gov/drugs/development-approval-process-drugs/fda-patient-focused-drug-development-guidance-series-enhancing-incorporation-patients-voice-medical. Accessed 23 Sep 2021
European Medicines Agency (EMA) Committee for Medicinal Products for Human Use (CHMP) (2020) ICH reflection paper on proposed ICH guideline work to advance patient focused drug development. European Medicines Agency, Amsterdam, The Netherlands. https://www.ema.europa.eu/en/documents/scientific-guideline/ich-reflection-paper-proposed-ich-guideline-work-advance-patient-focused-drug-development_en.pdf. Accessed 23 Sep 2021
Linton MJ, Dieppe P, Medina-Lara A (2016) Review of 99 self-report measures for assessing well-being in adults: exploring dimensions of well-being and developments over time. BMJ Open 6(7):e010641
Lindert J, Bain PA, Kubzansky LD, Stein C (2015) Well-being measurement and the WHO health policy Health 2010: systematic review of measurement scales. Eur J Public Health 25(4):731–740
Reininghaus U, Priebe S (2012) Measuring patient-reported outcomes in psychosis: conceptual and methodological review. Br J Psychiatry 201(4):262–267
Weiss C, Meehan SR, Brown TM et al (2021) Effects of adjunctive brexpiprazole on calmness and engagement in major depressive disorder: post hoc analysis of patient-reported outcomes from clinical trial exit interviews. J Patient Rep Outcomes 5(1):128
Bartrés-Faz D, Cattaneo G, Solana J, Tormos JM, Pascual-Leone A (2018) Meaning in life: resilience beyond reserve. Alzheimers Res Ther 10(1):47
MacKenzie E, Therrien F, Brown TM, Weiss C, Meehan SR (2021) Exploring the concept of life engagement from the perspective of patients with major depressive disorder: a study using patient interviews. Poster presented at American Society of Clinical Psychopharmacology Annual Meeting, virtual conference, 1–4 June 2021
Rosenblat JD, Simon GE, Sachs GS et al (2019) Treatment effectiveness and tolerability outcomes that are most important to individuals with bipolar and unipolar depression. J Affect Disord 243:116–120
Treadway MT, Zald DH (2011) Reconsidering anhedonia in depression: lessons from translational neuroscience. Neurosci Biobehav Rev 35(3):537–555
Robert P, Lanctôt KL, Agüera-Ortiz L et al (2018) Is it time to revise the diagnostic criteria for apathy in brain disorders? The 2018 international consensus group. Eur Psychiatry 54:71–76
Lambert C, Da Silva S, Ceniti AK, Rizvi SJ, Foussias G, Kennedy SH (2018) Anhedonia in depression and schizophrenia: a transdiagnostic challenge. CNS Neurosci Ther 24(7):615–623
Chase TN (2011) Apathy in neuropsychiatric disease: diagnosis, pathophysiology, and treatment. Neurotox Res 19(2):266–278
World Health Organization (1995) The World Health Organization Quality of Life assessment (WHOQOL): position paper from the World Health Organization. Soc Sci Med 41(10):1403–1409
Beddington J, Cooper CL, Field J et al (2008) The mental wealth of nations. Nature 455(7216):1057–1060
Bannigan K, Watson R (2009) Reliability and validity in a nutshell. J Clin Nurs 18(23):3237–3243
Patrick DL, Burke LB, Gwaltney CJ et al (2011) Content validity: establishing and reporting the evidence in newly developed patient-reported outcomes (PRO) instruments for medical product evaluation: ISPOR PRO good research practices task force report: part 1—eliciting concepts for a new PRO instrument. Value Health 14(8):967–977
Gallagher MW, Phillips CA, D’Souza J et al (2020) Trajectories of change in well-being during cognitive behavioral therapies for anxiety disorders: quantifying the impact and covariation with improvements in anxiety. Psychotherapy (Chic) 57(3):379–390
Trompetter HR, Ten Klooster PM, Schreurs KMG, Fledderus M, Westerhof GJ, Bohlmeijer ET (2013) Measuring values and committed action with the Engaged Living Scale (ELS): psychometric evaluation in a nonclinical sample and a chronic pain sample. Psychol Assess 25(4):1235–1246
Scheier MF, Wrosch C, Baum A et al (2006) The Life Engagement Test: assessing purpose in life. J Behav Med 29(3):291–298
Schaufeli WB, Salanova M, González-Romá V, Bakker AB (2002) The measurement of engagement and burnout: a two sample confirmatory factor analytic approach. J Happiness Stud 3:71–92
Schaufeli WB, Bakker AB, Salanova M (2006) The measurement of work engagement with a short questionnaire: a cross-national study. Educ Psychol Meas 66(4):701–716
Tjörnstrand C, Bejerholm U, Eklund M (2013) Psychometric testing of a self-report measure of engagement in productive occupations. Can J Occup Ther 80(2):101–110
Shirom A (2003) Feeling vigorous at work? The construct of vigor and the study of positive affect in organizations. In: Perrewe PL, Ganster DC (eds) Emotional and physiological processes and positive intervention strategies (Research in occupational stress and well being vol 3). Emerald Group Publishing Limited, Bingley
Carver CS, White TL (1994) Behavioral inhibition, behavioral activation, and affective responses to impending reward and punishment: the BIS/BAS Scales. J Pers Soc Psychol 67(2):319–333
Marin RS, Biedrzycki RC, Firinciogullari S (1991) Reliability and validity of the Apathy Evaluation Scale. Psychiatry Res 38(2):143–162
Faerden A, Friis S, Agartz I et al (2009) Apathy and functioning in first-episode psychosis. Psychiatr Serv 60(11):1495–1503
Faerden A, Nesvåg R, Barrett EA et al (2008) Assessing apathy: the use of the Apathy Evaluation Scale in first episode psychosis. Eur Psychiatry 23(1):33–39
Llerena K, Park SG, McCarthy JM, Couture SM, Bennett ME, Blanchard JJ (2013) The Motivation and Pleasure Scale—Self-Report (MAP-SR): reliability and validity of a self-report measure of negative symptoms. Compr Psychiatry 54(5):568–574
Torrubia R, Ávila C, Moltó J, Caseras X (2001) The Sensitivity to Punishment and Sensitivity to Reward Questionnaire (SPSRQ) as a measure of Gray’s anxiety and impulsivity dimensions. Pers Individ Dif 31(6):837–862
Hughes JR, Callas PW, Priest JS, Etter JF, Budney AJ, Sigmon SC (2017) Development of a self-report measure of reward sensitivity: a test in current and former smokers. Nicotine Tob Res 19(6):723–728
Fehnel SE, Bann CM, Hogue SL, Kwong WJ, Mahajan SS (2004) The development and psychometric evaluation of the Motivation and Energy Inventory (MEI). Qual Life Res 13(7):1321–1336
Armento MEA, Hopko DR (2007) The Environmental Reward Observation Scale (EROS): development, validity, and reliability. Behav Ther 38(2):107–119
Heggestad ED, Kanfer R (2000) Individual differences in trait motivation: development of the Motivational Trait Questionnaire. Int J Educ Res 33(7–8):751–776
Van den Berg I, Franken IHA, Muris P (2010) A new scale for measuring reward responsiveness. Front Psychol 1:239
Tremblay MA, Blanchard CM, Taylor S, Pelletier LG, Villeneuve M (2009) Work Extrinsic and Intrinsic Motivation Scale: its value for organizational psychology research. Can J Behav Sci 41(4):213–226
MacCarthy B, Benson J, Brewin CR (1986) Task motivation and problem appraisal in long-term psychiatric patients. Psychol Med 16(2):431–438
Chapman LJ, Chapman JP, Raulin ML (1976) Scales for physical and social anhedonia. J Abnorm Psychol 85(4):374–382
Chapman LJ, Chapman JP (1978) The Revised Physical Anhedonia Scale. University of Wisconsin–Madison, Wisconsin
Eckblad ML, Chapman LJ, Chapman JP, Mishlove M (1982) The Revised Social Anhedonia Scale. University of Wisconsin–Madison, Wisconsin
Snaith RP, Hamilton M, Morley S, Humayan A, Hargreaves D, Trigwell P (1995) A scale for the assessment of hedonic tone: the Snaith–Hamilton Pleasure Scale. Br J Psychiatry 167(1):99–103
Gard DE, Gard MG, Kring AM, John OP (2006) Anticipatory and consummatory components of the experience of pleasure: a scale development study. J Res Pers 40(6):1086–1102
Fawcett J, Clark DC, Scheftner WA, Gibbons RD (1983) Assessing anhedonia in psychiatric patients. Arch Gen Psychiatry 40(1):79–84
Gooding DC, Pflum MJ (2014) The assessment of interpersonal pleasure: introduction of the Anticipatory and Consummatory Interpersonal Pleasure Scale (ACIPS) and preliminary findings. Psychiatry Res 215(1):237–243
Frewen PA, Dean JA, Lanius RA (2012) Assessment of anhedonia in psychological trauma: development of the Hedonic Deficit and Interference Scale. Eur J Psychotraumatol 3:8585
Rizvi SJ, Quilty LC, Sproule BA, Cyriac A, Michael Bagby R, Kennedy SH (2015) Development and validation of the dimensional anhedonia rating scale (DARS) in a community sample and individuals with major depression. Psychiatry Res 229(1–2):109–119
Masselink M, van Roekel E, Heininga VE, Vrijen C, Oldehinkel AJ (2019) Domains of Pleasure Scale (DOPS): assessing pleasure across domains. OSF Preprints. https://doi.org/10.31219/osf.io/bu7z5. Accessed 23 Sep 2021
Winer ES, Veilleux JC, Ginger EJ (2014) Development and validation of the Specific Loss of Interest and Pleasure Scale (SLIPS). J Affect Disord 152–154:193–201
Derryberry D, Reed MA (2002) Anxiety-related attentional biases and their regulation by attentional control. J Abnorm Psychol 111(2):225–236
Brown KW, Ryan RM (2003) The benefits of being present: mindfulness and its role in psychological well-being. J Pers Soc Psychol 84(4):822–848
Groen Y, Fuermaier ABM, Tucha L, Weisbrod M, Aschenbrenner S, Tucha O (2019) A situation-specific approach to measure attention in adults with ADHD: the Everyday Life Attention Scale (ELAS). Appl Neuropsychol Adult 26(5):411–440
Barry TJ, Hermans D, Lenaert B, Debeer E, Griffith JW (2013) The eACS: attentional control in the presence of emotion. Pers Individ Dif 55:777–782
Shapiro CM, Auch C, Reimer M et al (2006) A new approach to the construct of alertness. J Psychosom Res 60(6):595–603
Keyes CLM (1998) Social well-being. Soc Psychol Q 61(2):121–140
Lee RM, Draper M, Lee S (2001) Social connectedness, dysfunctional interpersonal behaviors, and psychological distress: testing a mediator model. J Couns Psychol 48(3):310–318
Bekker MHJ, van Assen MALM (2006) A short form of the Autonomy Scale: properties of the Autonomy–Connectedness Scale (ACS-30). J Pers Assess 86(1):51–60
Tennant R, Hiller L, Fishwick R et al (2007) The Warwick–Edinburgh Mental Well-Being Scale (WEMWBS): development and UK validation. Health Qual Life Outcomes 5:63
Stewart-Brown S, Tennant A, Tennant R, Platt S, Parkinson J, Weich S (2009) Internal construct validity of the Warwick–Edinburgh Mental Well-Being Scale (WEMWBS): a Rasch analysis using data from the Scottish Health Education Population Survey. Health Qual Life Outcomes 7:15
World Health Organization Regional Office for Europe (1998) Well-being measures in primary health care: the DepCare Project. World Health Organization, Copenhagen. https://www.euro.who.int/__data/assets/pdf_file/0016/130750/E60246.pdf. Accessed 23 Sep 2021
Ryff CD (1989) Happiness is everything, or is it? Explorations on the meaning of psychological well-being. J Pers Soc Psychol 57(6):1069–1081
Keyes CLM, Wissing M, Potgieter JP, Temane M, Kruger A, van Rooy S (2008) Evaluation of the mental health continuum: Short Form (MHC-SF) in Setswana-speaking South Africans. Clin Psychol Psychother 15(3):181–192
Keyes CLM (2005) The subjective well-being of America’s youth: toward a comprehensive assessment. Adolesc Fam Health 4(1):3–11
Diener E, Wirtz D, Tov W et al (2010) New well-being measures: short scales to assess flourishing and positive and negative feelings. Soc Indic Res 97(2):143–156
Su R, Tay L, Diener E (2014) The development and validation of the Comprehensive Inventory of Thriving (CIT) and the Brief Inventory of Thriving (BIT). Appl Psychol Health Well Being 6(3):251–279
Dupuy HJ (1990) The Psychological General Well-Being (PGWB) index. In: Wenger NK, Mattson ME, Furburg CD, Elinson J (eds) Assessment of quality of life in clinical trials of cardiovascular therapies. Le Jacq Publishing, New York
Pedersen RD, Pallay AG, Rudolph RL (2002) Can improvement in well-being and functioning be distinguished from depression improvement in antidepressant clinical trials? Qual Life Res 11(1):9–17
Diener E, Emmons RA, Larsen RJ, Griffin S (1985) The satisfaction with life scale. J Pers Assess 49(1):71–75
International Wellbeing Group (2013) Personal Wellbeing Index: 5th edn. Australian Centre on Quality of Life, Deakin University, Melbourne. http://www.acqol.com.au/instruments#measures. Accessed 23 Sep 2021
Cummins RA, Eckersley R, Pallant J, van Vugt J, Misajon R (2003) Developing a national index of subjective wellbeing: the Australian Unity Wellbeing Index. Soc Indic Res 64(2):159–190
Steger MF, Frazier P, Oishi S, Kaler M (2006) The Meaning in Life Questionnaire: assessing the presence of and search for meaning in life. J Couns Psychol 53(1):80–93
Mackay C, Cox T, Burrows G, Lazzerini T (1978) An inventory for the measurement of self-reported stress and arousal. Br J Soc Clin Psychol 17(3):283–284
Nolen-Hoeksema S, Morrow J (1991) A prospective study of depression and posttraumatic stress symptoms after a natural disaster: the 1989 Loma Prieta Earthquake. J Pers Soc Psychol 61(1):115–121
Treynor W, Gonzalez R, Nolen-Hoeksema S (2003) Rumination reconsidered: a psychometric analysis. Cognit Ther Res 27(3):247–259
Brinker JK, Dozois DJA (2009) Ruminative thought style and depressed mood. J Clin Psychol 65(1):1–19
Raes F, Hermans D, Williams JMG, Bijttebier P, Eelen P (2008) A “Triple W”-model of rumination on sadness: why am I feeling sad, what’s the meaning of my sadness, and wish I could stop thinking about my sadness (but I can’t!). Cognit Ther Res 32(4):526–541
Douilliez C, Heeren A, Lefèvre N, Watkins E, Barnard P, Philippot P (2014) Validation de la version française d’un questionnaire évaluant les pensées répétitives constructives et non constructives [Validation of the French version of a questionnaire that evaluates constructive and non-constructive repetitive thoughts]. Can J Behav Sci 46(2):185–192
Wefald AJ, Mills MJ, Smith MR, Downey RG (2012) A comparison of three job engagement measures: examining their factorial and criterion-related validity. Appl Psychol Health Well Being 4(1):67–90
Kiang M, Christensen BK, Remington G, Kapur S (2003) Apathy in schizophrenia: clinical correlates and association with functional outcome. Schizophr Res 63(1–2):79–88
Trémeau F, Goldman J, Antonius D, Javitt DC (2013) Inpatients with schizophrenia report impaired situational motivation but intact global and social motivation. Psychiatry Res 210(1):43–49
Hewett K, Chrzanowski W, Schmitz M et al (2009) Eight-week, placebo-controlled, double-blind comparison of the antidepressant efficacy and tolerability of bupropion XR and venlafaxine XR. J Psychopharmacol 23(5):531–538
Hall T, Krahn GL, Horner-Johnson W, Lamb G, Rehabilitation Research and Training Center Expert Panel on Health Measurement (2011) Examining functional content in widely used health-related quality of life scales. Rehabil Psychol 56(2):94–99
Topp CW, Østergaard SD, Søndergaard S, Bech P (2015) The WHO-5 Well-Being Index: a systematic review of the literature. Psychother Psychosom 84(3):167–176
Lara-Cabrera ML, Mundal IP, De Las Cuevas C (2020) Patient-reported well-being: psychometric properties of the World Health Organization Well-Being Index in specialised community mental health settings. Psychiatry Res 291:113268
Lara-Cabrera ML, Bjørkly S, De Las Cuevas C, Pedersen SA, Mundal IP (2020) Psychometric properties of the Five-item World Health Organization Well-Being Index used in mental health services: protocol for a systematic review. J Adv Nurs 76(9):2426–2433
Duan W, Fei Y, Zhao J, Guo X (2020) Incremental validity of the Comprehensive Inventory of Thriving in predicting self-reporting mental and physical health among community populations. J Health Psychol 25(10–11):1366–1373
Duckro PN, Korytnyk NX, Vandenberg BR (1989) The Stress–Arousal Checklist as a measure of situational stress versus simple arousal. Psychol Rep 64(1):239–242
King MG, Burrows GD, Stanley GV (1983) Measurement of stress and arousal: validation of the Stress/Arousal Adjective Checklist. Br J Psychol 74(Pt 4):473–479
Norton M, Holm JE, McSherry WC 2nd (1997) Behavioral assessment of relaxation: the validity of a Behavioral Rating Scale. J Behav Ther Exp Psychiatry 28(2):129–137
Rizvi SJ, Pizzagalli DA, Sproule BA, Kennedy SH (2016) Assessing anhedonia in depression: potentials and pitfalls. Neurosci Biobehav Rev 65:21–35
Hallford DJ, Sharma MK (2019) Anticipatory pleasure for future experiences in schizophrenia spectrum disorders and major depression: a systematic review and meta-analysis. Br J Clin Psychol 58(4):357–383
Strauss GP, Wilbur RC, Warren KR, August SM, Gold JM (2011) Anticipatory vs. consummatory pleasure: what is the nature of hedonic deficits in schizophrenia? Psychiatry Res 187(1–2):36–41
Thase ME, Pedersen AM, Ismail Z et al (2019) Efficacy of adjunctive brexpiprazole in adults with MDD: improvement of patient engagement based on selected items from the Inventory of Depressive Symptomatology Self-Report (IDS-SR) scale. Poster presented at the 32nd annual Psych Congress, San Diego, California, 3–6 October 2019. https://www.hmpgloballearningnetwork.com/site/pcn/posters/efficacy-adjunctive-brexpiprazole-adults-mdd-improvement-patient-engagement-based-selected. Accessed 23 Sep 2021
McKnight PE, Kashdan TB (2009) The importance of functional impairment to mental health outcomes: a case for reassessing our goals in depression treatment research. Clin Psychol Rev 29(3):243–259
Saltiel PF, Silvershein DI (2015) Major depressive disorder: mechanism-based prescribing for personalized medicine. Neuropsychiatr Dis Treat 11:875–888
Writing support was provided by Cambridge—a Prime Global Agency (Cambridge, UK), and funded by Otsuka Pharmaceutical Development & Commercialization Inc. and H. Lundbeck A/S.
This work was supported by Otsuka Pharmaceutical Development & Commercialization Inc. (Princeton, NJ, USA) and H. Lundbeck A/S (Valby, Denmark). Authors affiliated with the sponsors were involved in the design of the study, the analysis and interpretation of data, and the writing and reviewing of this article.
Ethics approval and consent to participate
Consent for publication
RSM has received research grant support from CIHR/GACD/National Natural Science Foundation of China (NSFC); and speaker/consultation fees from Lundbeck, Janssen, Alkermes, Neumora Therapeutics, Boehringer Ingelheim, Sage, Biogen, Mitsubishi Tanabe, Purdue, Pfizer, Otsuka, Takeda, Neurocrine, Sunovion, Bausch Health, Axsome, Novo Nordisk, Kris, Sanofi, Eisai, Intra-Cellular, NewBridge Pharmaceuticals, AbbVie, and Atai Life Sciences. He is a CEO of Braxia Scientific Corp. ZI has received grant support from CIHR, NIH, Brain Canada, and Weston Foundation, and has served as a consultant for Janssen, Lundbeck and Otsuka. Additionally, his institution has received funds on his behalf from Acadia, Biogen, Roche, and Sunovion. CPW is an employee of Cambridge—a Prime Global Agency, which received funding from Otsuka Pharmaceutical Development & Commercialization Inc. and H. Lundbeck A/S for this work. CW was a full-time employee of Otsuka Pharmaceutical Development & Commercialization Inc. at the time that this work was conducted. SRM is a full-time employee of H. Lundbeck A/S. PM received funding from H. Lundbeck A/S for this work. MET has served as an advisor/consultant for Acadia Inc, Akili Inc, Alkermes Plc, Allergan Inc, Axsome, BioHaven Inc, Clexio Pharma, Gerson Lehrman Group Inc, H. Lundbeck A/S, Jazz Pharmaceuticals, Johnson & Johnson, Merck & Company Inc, Otsuka Pharmaceutical Company Ltd, Pfizer Inc, Sage Pharmaceuticals, Seelos Pharmaceuticals, Sunovion Pharmaceuticals Inc, Takeda Pharmaceutical Company Ltd; he has received grant support from Acadia Inc, Allergan Inc, AssureRx Health, Axsome Therapeutics Inc, BioHaven Inc, Intracellular Inc, Johnson & Johnson, Otsuka Pharmaceutical Company Ltd, Patient-Centered Outcomes Research Institute (PCORI), Takeda Pharmaceutical Company Ltd; and royalties from American Psychiatric Foundation, Guilford Publications, Herald House, Kluwer-Wolters, WW Norton & Company Inc; and his spouse is employed by Peloton Advantage, which does business with most major pharmaceutical companies.
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
About this article
Cite this article
McIntyre, R.S., Ismail, Z., Watling, C.P. et al. Patient-reported outcome measures for life engagement in mental health: a systematic review. J Patient Rep Outcomes 6, 62 (2022). https://doi.org/10.1186/s41687-022-00468-5
- Mood disorders
- Emotional blunting
- Life engagement
- Mental health
- Patient reported outcome measures