Skip to main content
Journal of Patient-Reported Outcomes
Download PDF
Download ePub

Psychometric properties of the thyroid-specific quality of life questionnaire ThyPRO in Singaporean patients with Graves’ disease

Journal of Patient-Reported Outcomes volume 5, Article number: 54 (2021) Cite this article

Abstract

Background

Graves’ disease is the most common cause of hyperthyroidism. It results in accelerated tissue metabolism with multi-organ involvement ranging from cardiovascular to neuropsychological function. This results in a negative impact on the quality of life (QOL) of the individual patient. We aim to evaluate the psychometric properties of ThyPRO, a Thyroid-related Patient Reported Outcome questionnaire, and validate its use in our multi-ethnic Asian patients with Graves’ hyperthyroidism.

Methods

Forty-seven consecutive Graves’ hyperthyroidism patients answered the ThyPRO questionnaire at baseline and at 4 months after treatment initiation. Data were recorded for thyroid related symptoms and signs, thyroid function tests and thyroid volume. We analyzed the internal consistency using Cronbach’s alpha, construct validity by evaluating relationship between clinical variables and ThyPRO scales, ceiling and floor effects, and responsiveness of ThyPRO to treatment based on Cohen’s effect size.

Results

Correlations between individual scale scores and free thyroxine concentrations were moderate and statistically significant: 0.21–0.64 (p <  0.05). There was high internal consistency between the items in this instrument, Cronbach’s alpha > 0.7 for all scales. ThyPRO was responsive to the changes in QOL after treatment (Effect Size: 0.20–0.77) in 9 of the 14 scales including the hyperthyroid symptoms and psychosocial scales (Tiredness, Cognitive complaints, Anxiety, Emotional susceptibility, Impact on Social, Daily and Sex life).

Conclusion

This study provides evidence that ThyPRO has satisfactory measurement properties in hyperthyroid Graves’ disease patients in Singapore population with the potential to complement clinical care.

Plain English summary

What is the key problem/ issues/ question this manuscript addresses?

Graves’ disease is the most common cause of hyperthyroidism. It negatively affects the patients’ ability to perform activities ranging from daily living to work. Yet in a busy clinic, doctors seldom have time to collect information on these aspects which are meaningful to the patients.

Why is this study needed?

It is important to evaluate the functional and social aspects of hyperthyroid Graves’ disease patients in Singapore population. These experiences varied in different countries and culture.

Main point of my study

In this study, we evaluate the accuracy of a thyroid-specific quality of life questionnaire ThyPRO in measuring the health aspect of Graves’ hyperthyroidism in Singapore patients and correlate with their thyroid blood tests, thyroid volume and complaints. We repeated the questionnaire 4 months after anti-thyroid medications to gauge the responsiveness of the survey.

Brief overview of my results and what they mean

This study demonstrates that the survey scores correspond with improvement in the thyroid blood tests. The questionnaire also shows how Graves’ disease patients in Singapore population related to their functions including tiredness, emotions and activities of living after starting antithyroid medication. This result encourages future research on our population’s experiences with different treatment options (anti-thyroid medication, radioactive therapy, surgery) hence potential to improve clinical care.

Introduction

Hyperthyroidism is a prevalent clinical condition with a reported global prevalence of about 1% [1]. Graves’ disease, the most common cause of hyperthyroidism [2, 3], is an immunologically-mediated condition where the thyroid gland is stimulated by thyroid receptor antibodies with a resultant increased synthesis of thyroid hormones [4, 5]. In the untreated state, the rise in circulating thyroxine levels accelerates tissue metabolism. It results in multi organ involvement resulting in significant impact on the eye, neuropsychology, cardiovascular, gastrointestinal, and neurological systems [6]. The accompanying negative influence on the individual’s well-being and social functioning is well known, including increased somatic and psychiatric morbidity such as anxiety, depression, work disability and mortality [1, 7,8,9,10,11,12,13,14,15,16].

Graves’ disease is usually managed in the ambulatory setting with individualized treatment with either anti-thyroid medications, radioactive iodine, or surgery. Patients with Graves’ disease do not feel completely well despite normalization of thyroid function [17,18,19,20]. Compared to other causes of hyperthyroidism, patients with Graves’ hyperthyroidism experience higher levels of anxiety and depression [18, 19]. Studies have shown that the hyperthyroid symptoms are correlated to the size of thyroid goitre, not the thyroid hormone concentration [21]. Despite being cognizant of the negative influence of the hyperthyroid status on various aspects of living, clinicians seldom have the time to probe the impact of hyperthyroidism on the individual’s quality of life (QOL). These reasons underscores the need to optimise the health-related QOL of patients with Graves’ diseases besides focusing on their clinical signs and biochemical tests [22, 23].

Health related QOL surveys are broadly classified into generic questionnaire, which looks at the general aspects of QOL in the population, and disease-specific questionnaire, which relates particularly to a medical condition [22, 24]. To assess the QOL of patients with Graves’ disease, it is important to use a disease-specific questionnaire that measures the intended patient reported outcomes (PRO) of their experience of the disease and its impact on their well-being. This property of evaluating the accuracy to which the questionnaire measures the concept of interest in a target population is known as validity: content validity examines the respective items in a scale for its relevance and coverage, whereas construct validity inspects the relationship of the items, scales to a priori hypothesis [25, 26]. Importantly, the instrument for evaluating PRO has to be reproducible, which means yielding the same result on independent repeat assessments, and be responsive in terms of its ability to detect meaningful changes in the measured QOL with treatment [22, 24, 27].

Of the instruments targeting population with hyperthyroidism, Hyperthyroidism Complaint Questionnaire and Thyroid specific patient reported outcome (ThyPRO) questionnaire were identified. The measurement properties of ThyPRO was the most published with proven hypothesis testing, internal consistency, reliability, content validity, structural validity and responsiveness [24, 25, 27,28,29]. In Danish speaking patients, ThyPRO has been rated good to excellent in its measurement properties. Also, it has cross -cultural validity in many languages [30,31,32,33,34,35].. To improve the ease of administration, the developer has also shortened the original questionnaire from 84 to 39 questions in 13 scales, ThyPRO-39 [36].

ThyPRO has been used in studies looking at the QOL of subjects with various benign thyroid conditions [37,38,39], in randomized control trials looking at the QOL of Graves’ patients on selenium supplementation [40], post thyroidectomy [41], post radioactive-ablation [42], and in patients with non-functioning thyroid nodules after percutaneous laser ablation [43]. There is an ongoing study looking at the improvement in QOL of post-radioactive ablated Graves’ patients who were rendered euthyroid with levothyroxine dose towards a target thyroid function range based on mathematical set point theory [44].

According to World Health Organisation global database on iodine deficiency, South East Asia region has iodine status ranging from predominantly optimal to mild insufficiency [45]. In iodine-replete countries like Singapore, the thyroid disorders are mainly autoimmune conditions such as Graves’ disease and Hashimoto’s thyroiditis [2]. There is paucity of literature on patient reported outcomes on benign thyroid conditions in Singapore and Southeast Asia. Singapore is a unique country with a multi-ethnic 5.69 million residents (74.3% Chinese, 13.5% Malays, 9.0% Indians and 3.2% other ethnicity) [46] . English is the main language and majority of the population is bilingual [47]. Besides being culturally diverse, Singapore, being near the Equator and part of South East Asia, has a tropical rainforest climate: constant warm and humid with daily temperature ranging between 25 °C to 33 °C henceforth native subjects with Graves’ hyperthyroidism may perceive heat intolerance and the impact of the disease differently from elsewhere.

The purpose of this study was to evaluate the psychometric properties of ThyPRO among Singaporean patients with Graves’ disease after treatment with anti-thyroid medication.

Materials and methods

Patients and study design

We enrolled 47 patients (35 Females; 12 Males) with Graves’ hyperthyroidism consecutively from a tertiary endocrine centre in Singapore between March 2014 and February 2015. This study was conducted in accordance with the declarations of Helsinki and approval was obtained from the institutional review board (IRB) [National Healthcare Group Domain Specific Review Board (DSRB) Reference No. 2012/ 01098]. Written informed consent was obtained from all subjects.

The inclusion criteria were: [1] age: 21 to 80 years old, [2] able to read and understand English and [3] biochemical hyperthyroidism (defined as free thyroxine (FT4) above upper limit of normal with our laboratory reference range for normal FT4 being 8 to 21 pmol/L, and thyrotropin (TSH) suppressed below low limit of normal with our laboratory reference range for normal TSH being 0.34 to 5.60 mIU/L, at time of recruitment. The exclusion criteria were: [1] cognitive impairment, [2] biochemically euthyroid status [3] pregnancy.

TSH receptor antibodies (TRAb) were performed in all subjects for establishment of the diagnosis of Graves’ disease. In one case where the TRAb was negative, Thyroid Stimulating Immunoglobulin TSI assay was sent. Ultrasound measurement of the thyroid was done, and volume measurement of each thyroid lobe was obtained with the General Electric Logiq P5 ultrasound machine using the Brunn formula: width (cm) x length (cm) x depth (cm) × 0.479 [48]. The thyroid volume is the summation of the two thyroid lobes.

Clinical data including patients’ demographics, clinical symptoms, physical examination, vital signs, diagnosis, and treatment were collected via the standardised electronic clerking template in the clinic as per routine clinical care. Clinical symptoms were categorized as follows: general, cardiorespiratory, neurological, gastrointestinal, eye and constitutional (Supplementary I, Table 1). The subject was considered to have the group of symptoms if he/she has at least one symptom in that category. At 4 months after initiation or titration of antithyroid medications (either carbimazole or propylthiouracil), the TFT, ultrasound and the ThyPRO questionnaire were repeated. Five patients were lost to follow-up and answered only one baseline questionnaire. Thiamazole dose tabulation was converted to carbimazole dose using an equivalence of 0.6 to 1.0 [6].

Instruments

ThyPRO

ThyPRO is a questionnaire which evaluates the impact of benign thyroid disease on QOL, developed by Watt et al [22, 25, 29]. It is a self-administered questionnaire with 84 items within 13 scales and one overall QOL-impact scale. Higher scores implicate more negative symptoms and worse thyroid-related QOL. The questions relate to physical symptoms of Goitre, Hyperthyroid, Hypothyroid, and Eye Symptoms; psychological symptoms of Anxiety, Depressivity; Functional and well-being symptoms of Tiredness, Cognitive Complaints, Emotional Susceptibility; its impact on participation in activities of Social Life, Sex Life and Daily Life; Cosmetic Complaints; and the overall impact on the QOL. The patients’ responses are based on how they have been feeling on a 4-week retrieval period [27]. In accordance with ThyPRO standard scorings, each item is scored on a 5-point Likert scale (0=” not at all”, 4=” very much” or “completely”). Each scale is derived by summation of relevant item (after reversal of positively worded items) and linear transformation to 0–100 [25]. The English version of the ThyPRO is administered at baseline and at 4 months in this study.

Local clinicians’ review

Prior to commencement of the study, 9 local experienced peer and/or senior endocrinologists reviewed the questionnaire and examined the feasibility and applicability of the questions in our local context based on their clinical experience (yes/ no/ not sure). The survey showed that three quarters of them agreed that more than 80% of the items in the questionnaire were applicable to our local patients.

Data analysis

Data was analysed using STATA version 14.0 (College Station, Texas 77,845, USA) with statistical significance set at p <  0.05. Descriptive data for numerical variables were presented as mean (Standard Deviation SD) and n (%) for categorical variables and median (Interquartile Range IQR) for ordinal variables. Paired t-test was performed to compare thyroid function variables, thyroid volumes and carbimazole doses at baseline and at 4 months, when normality assumptions were satisfied, otherwise Wilcoxon signed rank test was used.

The construct validity of this ThyPRO tool was assessed using the relevant ThyPRO scales with the categories of presenting symptoms, thyroid function and thyroid volume [22, 28].

We hypothesised that ThyPRO hyperthyroid and goitre scale correlated with the thyroid function tests and thyroid volume respectively and that the more abnormal the thyroid function, the worse is the QOL assessing the social and function wellbeing scales (Tiredness, Cognitive Complaints, Anxiety, Depressivity, Impaired Social life, Impaired Daily life, Impaired Sex Life, Cosmetic Complaints, and Overall QOL Impact). Item-test correlation was performed using Pearson correlation for parametric variables; otherwise, Spearman correlation was used. A correlative coefficient value of 0.5 or higher, 0.35–0.5, and 0.2–0.35 would be considered strong, moderate, and weak correlation respectively [49].

Cronbach’s alpha was used to assess internal consistency reliability where a value of above 0.7 indicates satisfactory degree of internal consistency [25, 28, 50]. Cohen’s effect size, defined as the mean change of each item scale score from baseline to 4 months over the standard deviation, was used to evaluate the responsiveness of the questionnaire to treatment. Cohen’s effect size of greater than 0.8 was considered large, between 0.5 to 0.8 moderate otherwise small [51]. We sought to look at the responsiveness in two aspects: [1] whether the change in QOL scales is clinically significant based on Cohen’s effect size and [2] whether the change in QOL correlates with the change in thyroid function tests and thyroid volume.

In terms of evaluating the minimally important change (MIC), a one-way ANOVA was conducted to determine if the mean change in negative QOL was different for groups with different categories of negative impact on overall QOL. They were classified into five groups (“Not at all”, “A little”, “Some”, “Quite a bit”, and “Very much”) based on their overall negative QOL score at 4 months where the higher the score, the more negative impact the thyroid condition has on their QOL.

Results

Patient characteristics

At baseline, 47 subjects with Graves’ hyperthyroidism completed the self-administered English questionnaire with ease. The majority were females (35, 74%), Chinese (43, 92%) and non-smokers (29, 70%). All subjects were bilingual in English and either Chinese or Malay. Approximately, half (24/47, 53%) of them had family history of thyroid disorders. The mean age of diagnosis was 38.5 ± 14.1 years old. Table 1 depicts the baseline demographic, clinical and thyroid ultrasound characteristics of the 47 subjects. The mean FT4 was 45.9 ± 22.0 pmol/L (RI: 8.0–21.0) and median TSH was 0.02 (0.01–0.03) mIU/L (RI: 0.34–5.60). The mean TRAb concentration was 16.0 ± 13.3 IU/L (Table 2). At 4 months of follow up, the FT4 normalised in 90% (38/42) and TSH remained suppressed in 64% (27/42) of the individuals. The improvement in thyroid function and volume was statistically significant (P < 0.05) (Table 2).

Table 1 Demographic and clinical features of patients
Full size table
Table 2 Biochemical and ultrasound thyroid volume at first visit and at 4 months later
Full size table

ThyPRO evaluation

Distribution approach

The distributional characteristics of ThyPRO are shown in Table 3. For the ThyPRO completed by 47 subjects, only 6 items had a missing response which were imputed as the mean score of the scale if half or more of the items in the scale were filled. There were no missing data for the follow-up questionnaires. There was no ceiling effect (defined as more than 15% of subjects attaining the maximum score of 100) observed in all the scales.

Table 3 Distribution characteristics of ThyPRO score at baseline
Full size table

Floor effects were noticeable in the following scales: Goitre symptoms, Hypothyroid symptoms, Eye symptoms, Cognitive complaints, Anxiety, Impact on Social life, Impact on Daily life, Impact on Sex life, Cosmetic complaints and overall quality of life impact (refer Table 3).

Supplementary II, Figure 1 illustrates histograms depicting the proportion of respondents across the range of score for each scale. Supplementary II, Figure 2 gives the breakdown of the items in the scale with floor effects.

Construct validity

All ThyPRO scales correlated with FT4 concentrations; of significance were the Hyperthyroid Symptoms scale with a correlation of 0.64 and the Anxiety scale 0.45 (p < 0.05). The Hyperthyroid Symptoms scale correlated with all the clinical symptoms except for constitutional symptoms. None of the scales correlated with thyroid volume. (Supplementary I, Table 2).

Reliability

Cronbach’s alpha exceeded 0.7 for all the scales in ThyPRO in the evaluation for internal consistency reliability (Table 3).

The item-test correlation was generally higher than 0.4 for all items except for items in the Goitre scale asking for “had pain in your neck that could be felt in your ears” (0.13), “had pain in front of your throat” (0.29), and in the Emotional susceptibility scale asking about whether one “felt in control of your life” (0.08), and “felt in balance” (− 0.02). (Supplementary I, Table 3).

Responsiveness

Out of the 47 subjects, 42 subjects completed the follow-up with a response rate of 90%. The Cohen’s effect size ranged from − 0.1 to 0.8 in ThyPRO (Table 4). The responsiveness was the highest for the hyperthyroidism symptom scale for both questionnaires. The improvement in the various scales in both ThyPRO was graphically illustrated in the radar plots in Fig. 1.

Table 4 Responsiveness in ThyPRO score after 4 months of treatment
Full size table
Fig. 1
figure 1

Radar plot of ThyPRO scale scores at baseline and 4 months later. The radar plot illustrated the improvement in the scales (range 0 to 100) of ThyPRO from baseline to 4 months after treatment of hyperthyroidism. The mean score of the following symptoms and psychosocial scales decreased after treatment signifying an improvement in the quality of life score: Hyperthyroidism symptoms, Tiredness, Anxiety, Emotional Susceptibility, Impact on Social Life, Impact on Daily Life and Impact on Sex Life. Legend: ThyPRO- Thyroid related Patient Reported Outcome

Full size image

The hypothesized social and functioning well-being scales (Tiredness, Anxiety, Emotional Susceptibility, Impaired Social, Daily and Sex life scales in ThyPRO had moderate to large effect sizes as anticipated by the thyroid experts in a prior study [17].

Anchor based approach

At baseline, 14 (33%) subjects answered “Not at all” to negative impact on their quality of life. This proportion increased to 20 (47%) at 4 months. Those who were affected very much by their disease states decreased from 7 (16%) to 3 (7%). For those who chose “Very much” for baseline negative QOL, the mean change in score was an improvement of 46 points (Supplementary II, Figure 3a).

There was a close to statistically significant difference between groups as determined by one-way ANOVA (F (4,38) = 2.51, p = 0.0576). A pairwise comparison of mean test revealed that the negative QOL was statistically significantly higher in the category “Very much” compared to “Some” (83 ± 36, 95% CI 9.5–157.2, p = 0.028); “Very much” compared to “A little” (41 ± 20, 95% CI 0.9–81, p = 0.045); and “Very much” compared to “Not at all” (55 ± 20, 95% CI 15–94, p = 0.008). There were no statistically significant differences between the other groups (Table 5).

Table 5 Number and percentages of responses on the Negative QOL item at 4 months (Global Transition item) for different response categories, with effect sizes, mean score changes by response category, and ANOVA tests for linear trend for the ThyPRO
Full size table

Using “A little” as the reference that distinguishes “Not at all” from the rest of the categories, the minimum, the MIC (Minimum Important Change or average score associated with “A little”) on the overall negative QOL scale at 4 months was − 8 points.

Discussion

To our knowledge, this is the first study that comprehensively evaluated the psychometric properties of ThyPRO in our local population with Graves’ hyperthyroidism. Like previous studies, our study showed that ThyPRO fared well in six out of nine internationally agreed measurement properties namely internal consistency, reliability, content validity, structural validity, hypothesis testing and responsiveness.

Similar to Wong et al. who evaluated the measurement properties of ThyPRO-39 (Traditional Chinese version), there were significant (defined as > 15%) floor effects observed in 9 of the 13 domains namely Goitre, Hypothyroid symptoms, Eye symptoms, Cognitive complaints, Anxiety, Impact on Social life, Impact on Sex Life, Cosmetic Complaints, and Overall Impact [33]. There are 3 possible reasons for floor effects. Firstly, the majority of our subjects do not have all the clinical symptoms and only 25% of them had eye symptoms on clinical examination. This is consistent with a local paper where 70% of patients attending a thyroid eye clinic have mild symptoms [52]. These scales cover a comprehensive range of relevant symptoms for which some severe symptoms such as sensation of suffocation, impaired vision, double vision or eye pain are not commonly encountered for our patient population (Supplementary II, Figures 2a and 2c). Only 62% had a palpable goitre and on sonography, they were not very large. The range of Goitre symptoms score spanned between 0 to 45 with 20% of patients having the lowest possible score. It was possible that our cohort of patients had a higher QOL in this aspect than the scale where they did not experience globus sensation, pain, the need to clear throat, difficulty in swallowing, hoarseness or suffocation since they score mainly between the category of “not at all” to “a little”.

Secondly, the mean duration of the condition in our cohort was 5.5 years and some of the patients had relapses of their hyperthyroid conditions whilst on antithyroid treatment. The subjects may have become accustomed to their conditions hence they did not have significant impairment of their QOL in these aspects based on the questionnaire which used last 4 weeks recall. Thirdly, the relevance of items in a scale contribute to the floor effects in certain scales. In the Cosmetic scale, one of the items enquiring on whether the thyroid disease made the respondent feel too fat may not be relevant in our cohort of patients with hyperthyroidism (Supplementary II, Figure 2i). In this condition, subjects tend to lose weight.

Given the lower prevalence of reported anxiety symptoms in Singapore compared to Western countries [53], it was likely that our patient population minimizes their anxiety symptoms in our culture hence accounting for the floor effect of 17% in the Anxiety symptom scale. In terms of negative impact on social and daily life, the scale, it could be possible that Singaporeans have a higher QOL in these domains. This was substantiated by previous studies demonstrating a high quality of life in Singapore and the 2019 Mercer Global Quality of living report [54,55,56] In Watt et al., paper looking at thyroid -attributable impaired sex QOL, 57% of women with Grave’s hyperthyroidism reported being affected [57]. Compared to our study, 58% of males and 60% of females reported “Not at all” affected. In the Asia culture, this is a sensitive topic which could be under-reported.

ThyPRO has adequate internal consistency as measured by Cronbach’s alpha of above 0.70 (Table 3). Besides the two items “Pain in front of throat” and “Throat pain felt in ears” in the Goitre symptoms scale, and another two items “Felt in control of life” and “Felt in balance”, in the Emotional scale, the item-scale correlations are above 0.4 (Supplementary I, Table 3) Our well-defined cohort of Graves’ related hyperthyroidism patients may not perceive the importance of these two items in the Goitre scale unlike in subjects with other causes of hyperthyroidism such as subacute thyroiditis which can manifest as tenderness in the thyroid or neck region.

This study supported the hypothesis of construct validity of ThyPRO with good correlative item analysis in Hyperthyroidism symptoms with both clinical symptoms and FT4 concentration (Supplementary I, Table 2). Although a statistical improvement in thyroid volume on 4 months’ follow-up was seen in our cohort, correlative changes in the all the domains of ThyPRO was not seen (Supplementary I, Table 2). This is likely because the evaluation was conducted at just 4 months after initial treatment and the change in thyroid volume was not clinically significant to have cause a change in perceived quality of life.

Our data demonstrated good correlation between the scales (symptoms, psychosocial and Overall QOL Impact) with clinical symptoms and FT4 concentrations. Moreover, the Hyperthyroidism Symptoms scale showed the strongest correlation. This signified convergent validity in these scales.

Similar to a previous study showing at least moderate effect sizes in eight of the scales in ThyPRO (Goiter symptoms, Hyperthyroid symptoms, Tiredness, Anxiety, Depressivity, Emotional susceptibility, Impaired daily life and Overall QOL impact), ThyPRO demonstrated fair responsiveness with moderate effect size in Hyperthyroidism Symptoms scale and small effect sizes in the corresponding scales [27]. This instrument complements physicians’ routine clinical care on clinical signs and symptoms not usually enquired, like subjects’ emotional and low energy status.

The effect sizes of eye symptoms and the cosmetic complaints were low at − 0.1 and 0.1 respectively (Table 4). At baseline, the mean scores for both categories were amongst the lowest. Given the variable presentation and duration of Graves’ thyroid eye manifestations [52, 58], this may explain the minimal improvement in the Eye symptom scale after a short 4 months of anti-thyroid treatment with an effect size of less than the threshold of 0.2. (Table 4) The second reason could be that our patients may not perceive these eye symptoms as important as clinicians [29]. Only 12% of the recruited subjects have eye symptoms on clinical history (Table 1); this mirrored the low prevalence of thyroid eye disease (TED) in our local population [52]. Compared to Caucasians population, our local clinico-epidemiological TED study revealed a lower prevalence of severe TED in Asians; this was attributed to our shallower orbital structure [52, 59]. The third explanation for lower effect size could be that at baseline dry eye symptoms, one of the commonest eye complaints in thyroid eye disease, are very common in our Asian population [52, 59] and so they would not have attributed the symptoms to Graves’ disease. A recently developed and validated Singapore Thyroid Eye Disease QOL (STED-QOL) had similar questions to the Eye component of ThyPRO on its effect on daily activities, getting about, appearance, confidence and work performance affirming our findings on ThyPRO, however STED-QOL has not been tested to look for responsiveness after treatment [60]. The two new questions in STED-QOL specifically addressed eye symptoms not found in ThyPRO were the need to vary head position to have better vision and avoidance of photo-taking because of TED.

Noticeably, the effect size on cosmetic complaints for our local population was minimal. This was unlike a South Korean study evaluating Graves’ ophthalmopathy where most of the subjects were bothered by the change of their appearance (92%) with affected self -esteem (70%). Majority of the Korean subjects (96%) felt that their social wellbeing were affected by their appearance as compared to 70% of them who were affected by their altered vision [61]. Our results are comparable with other Asian communities like Taiwan, and China [62, 63]. Our study population has apparently placed a lower emphasis on their appearances and cosmetics due to Graves’ disease as compared to other aspects of their QOL.

One virtue of this paper is the completeness of data collection with less than 1% of missing data in this study and the characteristics of those who drop-out resembles the remaining subjects. Another strength of our study is that the subject completed the ThyPRO survey on the same day as the physician’s clinical assessment. Our study re-affirms ThyPRO comprehensively in its measurement properties in terms of reliability, validity and responsiveness with its use in a clinic setting. There was no ceiling effect observed with the use of ThyPRO as the developer had used positively worded items thus empowering this tool to discriminate and recognise improvement of study subjects in the QOL on follow-up with serial use of ThyPRO.

We acknowledge the limitations of this study. One drawback of this study is the small sample size given there are 14 scales in this questionnaire. Secondly, the percentage of subjects having the lowest score in the scales: Goitre Symptoms, Eye Symptoms, Cognitive Complaints, Anxiety, Depressivity, Impact on Social, Daily and Sex Life and Overall QoL Impact was above 10 %. We admit that many subjects with the same score may affect the discriminatory ability between subjects and hence affect reliability. Thirdly, only 88% of patients became euthyroid at 4 months. In 4 months’ follow-up, thyroid function changes are too small to fully capture all relevant changes in QOL [21]. Studies have shown persistence of impaired QOL in Graves’ disease patients after treatment for up to 6 months to a year [17, 23].

Our paper looked at the measurement properties of ThyPRO in our local population using a statistical characteristic in a distribution-based approach [64]. To interpret our data in a meaningful manner, we used the last item assessing the negative overall QOL in ThyPRO as the transition question to find out what the Minimally Important Change (M.I.C) is in this global rating that corresponds to the patients’ benefit. We acknowledge that this item did not specifically ask for the improvement in QOL after the commencement of anti-thyroid medication, rather it was based on the QOL over the preceding 4 weeks at 4 months.

When it comes to looking at the QOL, the cross-cultural differences play a key role. As per local practice, anti-thyroid medications are the first line approach towards treatment and are more favoured and used by the endocrinologists. Moving forward, there is a role in the future to study changes with radioactive iodine and surgical treatment. We also need to evaluate the electronic mode of questionnaire administration [65].

Conclusions

In summary, ThyPRO has satisfactory psychometric properties thus supporting its use for assessing quality of life in Singapore patients with Graves’ hyperthyroidism.

Availability of data and materials

All data generated and analysed during this study are included in this published article (and its supplementary information files).

Abbreviations

CI:

Confidence Interval

DSRB:

Domain Specific Review Board

ES:

Effect Size

FT4:

Free thyroxine

GRASS:

Graves’ disease selenium supplementation trial

HCQ:

Hyperthyroid complaints questionnaire

IQR:

Interquartile range

IRB:

Institutional review board

IU:

International Unit

MIC:

Minimally Important Change

mIU:

Milli international Unit

PRO:

Patient Reported Outcome

QOL:

Quality of life

RCT:

Randomized clinical trial

SD:

Standard Deviation

TFT:

Thyroid function test

ThyPRO:

Thyroid- related patient reported outcome

TRAb:

TSH receptor antibody

TSH:

Thyrotropin/ Thyroid stimulating hormone

TSI:

Thyroid Stimulating Immunoglobulin

References

  1. Brandt, F., Thvilum, M., Almind, D., Christensen, K., Green, A., Hegedüs, L., & Brix, T. H. (2013). Morbidity before and after the diagnosis of hyperthyroidism: A Nationwide register-based study. PLoS One, 8(6), e66711 https://doi.org/10.1371/journal.pone.0066711.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  2. Vanderpump, M. P. J. (2011). The epidemiology of thyroid disease. British Medical Bulletin, 99(1), 39–51 https://doi.org/10.1093/bmb/ldr030.

    Article  PubMed  Google Scholar 

  3. Smith, D. M., Dutta, S., Ahmed, F., & Thaha, M. A. (2016). Change in Practice over Four Decades in the Management of Graves’ Disease in Scotland. Journal of Thyroid Research, 2016 Available from: https://www.ncbi.nlm.nih.gov/pmc/articles/PMC4904117/.

  4. Kahaly, G. J., Grebe, S. K. G., Lupo, M. A., McDonald, N., & Sipos, J. A. (2011). Graves’ disease: Diagnostic and therapeutic challenges (multimedia activity). The American Journal of Medicine, 124(6), S2–S3 https://doi.org/10.1016/j.amjmed.2011.03.001.

    Article  CAS  PubMed  Google Scholar 

  5. Menconi, F., Marcocci, C., & Marinò, M. (2014). Diagnosis and classification of graves’ disease. Autoimmunity Reviews, 13(4–5), 398–402 https://doi.org/10.1016/j.autrev.2014.01.013.

    Article  PubMed  Google Scholar 

  6. Ross, D. S., Burch, H. B., Cooper, D. S., Greenlee, M. C., Laurberg, P., Maia, A. L., … Walter, M. A. (2016). 2016 American Thyroid Association guidelines for diagnosis and Management of Hyperthyroidism and Other Causes of thyrotoxicosis. Thyroid, 26(10), 1343–1421 https://doi.org/10.1089/thy.2016.0229.

    Article  PubMed  Google Scholar 

  7. Brandt, F., Thvilum, M., Almind, D., Christensen, K., Green, A., Hegedüs, L., & Brix, T. H. (2014). Hyperthyroidism and psychiatric morbidity: Evidence from a Danish nationwide register study. European Journal of Epidemiology, 170(2), 341–348 https://doi.org/10.1530/EJE-13-0708.

    CAS  Google Scholar 

  8. Nexo, M. A., Watt, T., Pedersen, J., Bonnema, S. J., Hegedüs, L., Rasmussen, A. K., … Bjorner, J. B. (2014). Increased risk of long-term sickness absence, lower rate of return to work, and higher risk of unemployment and disability pensioning for thyroid patients: A Danish register-based cohort study. The Journal of Clinical Endocrinology & Metabolism, 99(9), 3184–3192 https://doi.org/10.1210/jc.2013-4468.

    Article  CAS  Google Scholar 

  9. Franklyn, J. A., Sheppard, M. C., & Maisonneuve, P. (2005). Thyroid function and mortality in patients treated for hyperthyroidism. JAMA., 294(1), 71–80 https://doi.org/10.1001/jama.294.1.71.

    Article  CAS  PubMed  Google Scholar 

  10. Brandt, F., Almind, D., Christensen, K., Green, A., Brix, T. H., & Hegedüs, L. (2012). Excess mortality in hyperthyroidism: The influence of preexisting comorbidity and genetic confounding: A danish nationwide register-based cohort study of twins and singletons. The Journal of Clinical Endocrinology & Metabolism, 97(11), 4123–4129 https://doi.org/10.1210/jc.2012-2268.

    Article  CAS  Google Scholar 

  11. Chen, H.-H., Yeh, S.-Y., Lin, C.-L., Chang, S.-N., & Kao, C.-H. (2014). Increased depression, diabetes and diabetic complications in graves’ disease patients in Asia. QJM Mon Journal Association Physicians, 107(9), 727–733 https://doi.org/10.1093/qjmed/hcu069.

    Article  Google Scholar 

  12. Fukao, A., Takamatsu, J., Murakami, Y., Sakane, S., Miyauchi, A., Kuma, K., … Hanafusa, T. (2003). The relationship of psychological factors to the prognosis of hyperthyroidism in antithyroid drug-treated patients with graves’ disease. Clinical Endocrinology, 58(5), 550–555 https://doi.org/10.1046/j.1365-2265.2003.01625.x.

    Article  PubMed  Google Scholar 

  13. Metso, S., Jaatinen, P., Huhtala, H., Auvinen, A., Oksala, H., & Salmi, J. (2007). Increased cardiovascular and Cancer mortality after radioiodine treatment for hyperthyroidism. The Journal of Clinical Endocrinology & Metabolism, 92(6), 2190–2196 https://doi.org/10.1210/jc.2006-2321.

    Article  CAS  Google Scholar 

  14. Bauer, D. C., Rodondi, N., Stone, K. L., Hillier, T. A., & Study of Osteoporotic Fractures Research Group: Universities of California (San Francisco), Pittsburgh, Minnesota (Minneapolis), Kaiser Permanente Center for Health Research, Portland (2007). Thyroid hormone use, hyperthyroidism and mortality in older women. The American Journal of Medicine, 120(4), 343–349 https://doi.org/10.1016/j.amjmed.2006.04.034.

    Article  CAS  PubMed  Google Scholar 

  15. Giesecke, P., Rosenqvist, M., Frykman, V., Friberg, L., Wallin, G., Höijer, J., … Törring, O. (2017). Increased cardiovascular mortality and morbidity in patients treated for toxic nodular goiter compared to graves’ disease and nontoxic goiter. Thyroid., 27(7), 878–885 https://doi.org/10.1089/thy.2017.0029.

    Article  CAS  PubMed  Google Scholar 

  16. Gulseren, S., Gulseren, L., Hekimsoy, Z., Cetinay, P., Ozen, C., & Tokatlioglu, B. (2006). Depression, anxiety, health-related quality of life, and disability in patients with overt and subclinical thyroid dysfunction. Archives of Medical Research, 37(1), 133–139 https://doi.org/10.1016/j.arcmed.2005.05.008.

    Article  PubMed  Google Scholar 

  17. Cramon, P., Winther, K. H., Watt, T., Bonnema, S. J., Bjorner, J. B., Ekholm, O., … Rasmussen, Å. K. (2016). Quality-of-life impairments persist six months after treatment of graves’ hyperthyroidism and toxic nodular goiter: A prospective cohort study. Thyroid, 26(8), 1010–1018 https://doi.org/10.1089/thy.2016.0044.

    Article  CAS  PubMed  Google Scholar 

  18. Bové, K. B., Watt, T., Vogel, A., Hegedüs, L., Bjoerner, J. B., Groenvold, M., … Feldt-Rasmussen, U. (2014). Anxiety and depression are more prevalent in patients with graves’ disease than in patients with nodular goitre. European Thyroid Journal, 3(3), 173–178 https://doi.org/10.1159/000365211.

    Article  PubMed  PubMed Central  Google Scholar 

  19. Bunevicius, R., Velickiene, D., & Prange, A. J. (2005). Mood and anxiety disorders in women with treated hyperthyroidism and ophthalmopathy caused by graves’ disease. General Hospital Psychiatry, 27(2), 133–139 https://doi.org/10.1016/j.genhosppsych.2004.10.002.

    Article  PubMed  Google Scholar 

  20. Fahrenfort, J. J., Wilterdink, A. M., & van der Veen, E. A. (2000). Long-term residual complaints and psychosocial sequelae after remission of hyperthyroidism. Psychoneuroendocrinology., 25(2), 201–211 https://doi.org/10.1016/S0306-4530(99)00050-5.

    Article  CAS  PubMed  Google Scholar 

  21. Trzepacz, P. T., Klein, I., Roberts, M., Greenhouse, J., & Levey, G. S. (1989). Graves’ disease: An analysis of thyroid hormone levels and hyperthyroid signs and symptoms. The American Journal of Medicine, 87(5), 558–561 https://doi.org/10.1016/S0002-9343(89)80614-X.

    Article  CAS  PubMed  Google Scholar 

  22. Watt, T. (2006). Quality of life in patients with benign thyroid disorders. A review. European Journal of Endocrinology, 154(4), 501–510 https://doi.org/10.1530/eje.1.02124.

    Article  CAS  PubMed  Google Scholar 

  23. Elberling, T. V., Rasmussen, A. K., Feldt-Rasmussen, U., Hørding, M., Perrild, H., & Waldemar, G. (2004). Impaired health-related quality of life in graves’ disease. A prospective study. European Journal of Endocrinology, 151(5), 549–555 https://doi.org/10.1530/eje.0.1510549.

    Article  CAS  PubMed  Google Scholar 

  24. Wong, C. K. H., Lang, B. H. H., & Lam, C. L. K. (2016). A systematic review of quality of thyroid-specific health-related quality-of-life instruments recommends ThyPRO for patients with benign thyroid diseases. Journal of Clinical Epidemiology, 78, 63–72 https://doi.org/10.1016/j.jclinepi.2016.03.006.

    Article  PubMed  Google Scholar 

  25. Watt, T., Bjorner, J. B., Groenvold, M., Rasmussen, Å. K., Bonnema, S. J., Hegedüs, L., & Feldt-Rasmussen, U. (2009). Establishing construct validity for the thyroid-specific patient reported outcome measure (ThyPRO): An initial examination. Quality of Life Research, 18(4), 483–496 https://doi.org/10.1007/s11136-009-9460-8.

    Article  PubMed  Google Scholar 

  26. Doward, L. C., Meads, D. M., & Thorsen, H. (2004). Requirements for quality of life instruments in clinical research. Value in Health, 7(Suppl 1), S13–S16 https://doi.org/10.1111/j.1524-4733.2004.7s104.x.

    Article  PubMed  Google Scholar 

  27. Watt, T., Cramon, P., Hegedüs, L., Bjorner, J. B., Bonnema, S. J., Rasmussen, Å. K., … Groenvold, M. (2014). The thyroid-related quality of life measure ThyPRO has good responsiveness and ability to detect relevant treatment effects. The Journal of Clinical Endocrinology & Metabolism, 99(10), 3708–3717 https://doi.org/10.1210/jc.2014-1322.

    Article  CAS  Google Scholar 

  28. Watt, T., Hegedüs, L., Groenvold, M., Bjorner, J. B., Rasmussen, A. K., Bonnema, S. J., et al. (2010). Validity and reliability of the novel thyroid-specific quality of life questionnaire, ThyPRO. European Journal of Endocrinology, 162(1), 161–167 https://doi.org/10.1530/EJE-09-0521.

    Article  CAS  PubMed  Google Scholar 

  29. Watt, T., Hegedüs, L., Rasmussen, A. K., Groenvold, M., Bonnema, S. J., Bjorner, J. B., et al. (2007). Which domains of thyroid-related quality of life are most relevant? Patients and clinicians provide complementary perspectives. Thyroid., 17(7), 647–654 https://doi.org/10.1089/thy.2007.0069.

    Article  PubMed  Google Scholar 

  30. Sawicka-Gutaj, N., Watt, T., Sowiński, J., Gutaj, P., Waligórska-Stachura, J., & Ruchała, M. (2015). ThyPROpl--the polish version of the thyroid-specific quality of life questionnaire ThyPRO. Endokrynologia Polska, 66(4), 367–380 https://doi.org/10.5603/EP.2015.0047.

    Article  PubMed  Google Scholar 

  31. Watt, T., Barbesino, G., Bjorner, J. B., Bonnema, S. J., Bukvic, B., Drummond, R., … Feldt-Rasmussen, U. (2015). Cross-cultural validity of the thyroid-specific quality-of-life patient-reported outcome measure, ThyPRO. Quality of Life Research, 24(3), 769–780 https://doi.org/10.1007/s11136-014-0798-1.

    Article  PubMed  Google Scholar 

  32. Mintziori, G., Watt, T., Veneti, S., Panagiotou, A., Pournaras, D. J., Feldt-Rasmussen, U., … Goulis, D. G. (2018). ThyPROgr: The Greek edition of the ThyPRO questionnaires for patients with benign thyroid diseases. Hormones Athens Greece, 17(1), 107–112 https://doi.org/10.1007/s42000-018-0015-7.

    Article  Google Scholar 

  33. Wong, C. K. H., Choi, E. P. H., Woo, Y. C., & Lang, B. H. H. (2018). Measurement properties of ThyPRO short-form (ThyPRO-39) for use in Chinese patients with benign thyroid diseases. Quality of Life Research, 27(8), 2177–2187 https://doi.org/10.1007/s11136-018-1857-9.

    Article  PubMed  Google Scholar 

  34. Zahan, A. E., Watt, T., Pascanu, I., Rasmussen, A. K., Hegedüs, L., Bonnema, S. J., et al. (2018). The Romanian version of the thyroid-related patient-reported outcomes thypro and thypro-39. Translation and assessment of reliability and cross-cultural validity. Acta Endocrinologica (Bucharest) 2005, 14(2), 192–200.

    Article  CAS  Google Scholar 

  35. Gonzalez, L. A. M., Cortes, M. B., Feldt-Rasmussen, U., Perez, C. R., Rasmussen, A. K., Plasencia, Y. L., et al. (2018). Adaptation and cross-cultural validation of the Spanish version of the Thyroid-Related Quality-of-Life Patient-Reported Outcome (ThyPRO) questionnaire. In BioScientifica Available from: https://www.endocrine-abstracts.org/ea/0056/ea0056p1056. Cited 2018 Aug 1.

    Google Scholar 

  36. Watt, T., Bjorner, J. B., Groenvold, M., Cramon, P., Winther, K. H., Hegedüs, L., … Feldt-Rasmussen, U. (2015). Development of a short version of the thyroid-related patient-reported outcome ThyPRO. Thyroid., 25(10), 1069–1079 https://doi.org/10.1089/thy.2015.0209.

    Article  PubMed  Google Scholar 

  37. Grove-Laugesen, D., Cramon, P. K., Malmstroem, S., Ebbehoj, E., Watt, T., Hansen, K. W., & Rejnmark, L. (2020). Effects of supplemental vitamin D on muscle performance and quality of life in graves’ disease: A randomized clinical trial. Thyroid, 30(5), 661–671 https://doi.org/10.1089/thy.2019.0634.

    Article  CAS  PubMed  Google Scholar 

  38. Mooijaart, S. P., Du Puy, R. S., Stott, D. J., Kearney, P. M., Rodondi, N., Westendorp, R. G. J., et al. (2019). Association between levothyroxine treatment and thyroid-related symptoms among adults aged 80 years and older with subclinical hypothyroidism. JAMA., 30, 1–11.

    Google Scholar 

  39. Recker, S., Voigtländer, R., Viehmann, A., Dunschen, K., Kerp, H., Frank-Raue, K., et al. (2019). Thyroid related quality of life in elderly with subclinical hypothyroidism and improvement on levothyroxine is distinct from that in young patients (TSAGE). Hormone and Metabolic Research, 51(9), 568–574.

    Article  CAS  PubMed  Google Scholar 

  40. Watt, T., Cramon, P., Bjorner, J. B., Bonnema, S. J., Feldt-Rasmussen, U., & Gluud, C. (2013). Selenium supplementation for patients with graves’ hyperthyroidism (the GRASS trial): Study protocol for a randomized controlled trial. Trials., 14(1), 119 https://doi.org/10.1186/1745-6215-14-119.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  41. Sorensen, J. R., Watt, T., Cramon, P., Døssing, H., Hegedüs, L., Bonnema, S. J., & Godballe, C. (2017). Quality of life after thyroidectomy in patients with nontoxic nodular goiter: A prospective cohort study. Head & Neck, 39(11), 2232–2240 https://doi.org/10.1002/hed.24886.

    Article  Google Scholar 

  42. Taïeb, D., Bournaud, C., Eberle, M.-C., Catargi, B., Schvartz, C., Cavarec, M.-B., … Baumstarck, K. (2016). Quality of life, clinical outcomes and safety of early prophylactic levothyroxine administration in patients with graves’ hyperthyroidism undergoing radioiodine therapy: A randomized controlled study. European Journal of Endocrinology, 174(4), 491–502 https://doi.org/10.1530/EJE-15-1099.

    Article  PubMed  CAS  Google Scholar 

  43. Oddo, S., Felix, E., Mussap, M., & Giusti, M. (2018). Quality of life in patients treated with percutaneous laser ablation for non-functioning benign thyroid nodules: A prospective single-center study. Korean Journal of Radiology, 19(1), 175–184 https://doi.org/10.3348/kjr.2018.19.1.175.

    Article  PubMed  PubMed Central  Google Scholar 

  44. Leow, M. K.-S., & Goede, S. L. (2014). The homeostatic set point of the hypothalamus-pituitary-thyroid axis – Maximum curvature theory for personalized euthyroid targets. Theoretical Biology and Medical Modelling, 11(1), 35 https://doi.org/10.1186/1742-4682-11-35.

    Article  PubMed  PubMed Central  Google Scholar 

  45. WHO | Degree of public health significance of iodine nutrition [Internet]. WHO. Available from: http://www.who.int/vmnis/database/iodine/iodine_data_status_summary_t4/en/. Cited 2018 Mar 1

  46. Singapore Department of Statistics | Population Trends. 2020: 157.

  47. Singapore, Department of Statistics. General Household Survey 2015. 2016.

    Google Scholar 

  48. Brunn, J., Block, U., Ruf, G., Bos, I., Kunze, W. P., & Scriba, P. C. (2008). Volumetrie der Schilddrüsenlappen mittels Real-time-Sonographie. DMW – Deutsche Medizinische Wochenschrift, 106(41), 1338–1340.

    Article  Google Scholar 

  49. Juniper, E. F., Guyatt, G. H., & Jaeschke, R. (1995). How to develop and validate a new quality of life instrument. In B. Spilker (Ed.), Quality of Life and Pharmacoeconomics in Clinical Trials, (2nd ed., pp. 49–56). New York: Raven Press Ltd.

    Google Scholar 

  50. Bland, J. M., & Altman, D. G. (1997). Statistics notes: Cronbach’s alpha. BMJ., 314(7080), 572 https://doi.org/10.1136/bmj.314.7080.572.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  51. Cohen, J. (1992). Quantitative methods in psychology. Psychology Bulletin, 112(1), 155–159.

    Article  CAS  Google Scholar 

  52. Lim, N. C. S., Sundar, G., Amrith, S., & Lee, K. O. (2015). Thyroid eye disease: A southeast Asian experience. British Journal of Ophthalmology, 99(4), 512–518 https://doi.org/10.1136/bjophthalmol-2014-305649.

    Article  PubMed  Google Scholar 

  53. Lee, S. P., Sagayadevan, V., Abdin, E., Vaingankar, J. A., Chong, S. A., & Subramaniam, M. (2016). Prevalence, correlates, comorbidity and severity of generalized anxiety disorder in Singapore. Asian Journal of Psychiatry, 23, 32–38 https://doi.org/10.1016/j.ajp.2015.06.012.

    Article  PubMed  Google Scholar 

  54. Singapore tops Quality of Living ranking for Asia | Mercer Singapore [Internet]. Available from: https://www.mercer.com.sg/newsroom/2019-quality-of-living-survey.html. Cited 2021 Mar 28.

  55. Tambyah, S. K., Tan, S. J., & Kau, A. K. (2009). The quality of life in Singapore. Social Indicators Research, 92(2), 337–376 https://doi.org/10.1007/s11205-008-9347-z.

    Article  Google Scholar 

  56. Keng, K. A., & Hooi, W. S. (1995). Assessing quality of life in Singapore: An exploratory study. Social Indicators Research, 35(1), 71–91 https://doi.org/10.1007/BF01079239.

    Article  Google Scholar 

  57. Sawicka-Gutaj, N., Ruchala, M., Feldt-Rasmussen, U., Rasmussen, Å. K., Hegedüs, L., Bonnema, S. J., … Watt, T. (2018). Patients with benign thyroid diseases experience an impaired sex life. Thyroid, 28(10), 1261–1269 https://doi.org/10.1089/thy.2017.0602.

    Article  CAS  PubMed  Google Scholar 

  58. Bothun, E. D., Scheurer, R. A., Harrison, A. R., & Lee, M. S. (2009). Update on thyroid eye disease and management. Clinical ophthalmology (Auckland, NZ), 3, 543–551.

    Google Scholar 

  59. Chng, C.-L., Seah, L. L., & Khoo, D. H. C. (2012). Ethnic differences in the clinical presentation of Graves’ ophthalmopathy. Best Practice & Research Clinical Endocrinology & Metabolism, 26(3), 249–258.

    Article  Google Scholar 

  60. Wong, M. H. Y., Fenwick, E., Aw, A. T., Lamoureux, E. L., & Seah, L. L. (2018). Development and validation of the Singapore thyroid eye disease quality of life questionnaire. Translational Vision Science & Technology, 7(5), 14 https://doi.org/10.1167/tvst.7.5.14.

    Article  Google Scholar 

  61. Choi, Y. J., Lim, H. T., Lee, S. J., Lee, S. Y., & Yoon, J. S. (2012). Assessing graves’ ophthalmopathy-specific quality of life in Korean patients. Eye., 26(4), 544–551 https://doi.org/10.1038/eye.2011.359.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  62. Lin, I.-C., Lee, C.-C., & Liao, S.-L. (2014). Assessing quality of life in Taiwanese patients with graves’ ophthalmopathy. Journal of the Formosan Medical Association, 13, 114.

    CAS  Google Scholar 

  63. Zeng, P., Fan, S., Li, Z., Peng, Y., Hu, Y., Xu, M., et al. (2019). Evaluation of the graves’ Orbitopathy-specific quality of life questionnaire in the mainland Chinese population. Journal of Ophthalmology, 2019, e7602419.

    Google Scholar 

  64. Guyatt, G. H., Osoba, D., Wu, A. W., Wyrwich, K. W., & Norman, G. R. (2002). Methods to explain the clinical significance of health status measures. Mayo Clinic Proceedings, 77(4), 371–383 https://doi.org/10.4065/77.4.371.

    Article  PubMed  Google Scholar 

  65. Rasmussen, S. L., Rejnmark, L., Ebbehøj, E., Feldt-Rasmussen, U., Rasmussen, Å. K., Bjorner, J. B., & Watt, T. (2016). High level of agreement between electronic and paper mode of Administration of a Thyroid-Specific Patient-Reported Outcome, ThyPRO. European Thyroid Journal, 5(1), 65–72 https://doi.org/10.1159/000443609.

    Article  PubMed  PubMed Central  Google Scholar 

Download references

Acknowledgements

We are grateful to all the patients who participated in this study. We express our gratitude to Dr. Torquil Watt and his team at Copenhagen University Hospital Rigshospitalet and University of Massachusetts, Health Research Associates Ms. Valeska Kantzer, and Ms. Linda See. I am thankful to the following clinicians Dr. Hoi Wai Han, Dr. Lee Ying Shan, Dr. Stanley Lam for the recruitment of the subjects; Ms. Lian Xia, Ms. Tan Hong Yun, Ms. Xu Weiru, Ms. Zou Yaxing, Dr. Khor Hong Tar for their assistance in the translation and validation of the questionnaire; Ms. Janet Tan and Ms. Amanda Tay for general support and formatting, Ms. Yang Lulu and Ms. Siti Zaidah for data collection and logistic support.

Funding

This study received funding from the National Healthcare Group-Khoo Teck Puat Hospital (NHG-KTPH) Clinician Leadership Research grant (CLR-13007) in the design of the study, data collection, analysis and interpretation, and writing of the manuscript.

Author information

Authors and Affiliations

  1. Department of Diabetes and Endocrinology, Tan Tock Seng Hospital, 11 Jalan Tan Tock Seng, Singapore, 308433, Singapore

    Huiling Liew, Alvin W. K. Tan, Daniel Ek Kwang Chew & Rinkoo Dalan

  2. Department of Medical Endocrinology, Copenhagen University Hospital Rigshospitalet, Copenhagen, Denmark

    Torquil Watt

  3. Saw Swee Hock School of Public Health, National University of Singapore, Singapore, Singapore

    Luo Nan

  4. Biostatistics Unit, Yong Loo Lin School of Medicine, National University of Singapore, Singapore, Singapore

    Yiong Huak Chan

  5. Lee Kong Chian School of Medicine, Nanyang Technological University, Singapore, Singapore

    Daniel Ek Kwang Chew & Rinkoo Dalan

  6. Yong Loo Lin School of Medicine, National University of Singapore, Singapore, Singapore

    Daniel Ek Kwang Chew & Rinkoo Dalan

Authors
  1. Huiling Liew
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Torquil Watt
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Luo Nan
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Alvin W. K. Tan
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Yiong Huak Chan
    View author publications

    You can also search for this author in PubMed Google Scholar

  6. Daniel Ek Kwang Chew
    View author publications

    You can also search for this author in PubMed Google Scholar

  7. Rinkoo Dalan
    View author publications

    You can also search for this author in PubMed Google Scholar

Contributions

H. Liew and R. Dalan conceived, designed and performed the study with the support of T. Watt and D. Chew. T. Watt provided pertinent advice in the implementation of the research. Y.H. Chan verified the analytical methods and contributed to the statistical methods of the manuscript. N. Luo, A. Tan, T. Watt and R. Dalan contributed to the analysis and shaped the writing of the manuscript. H. Liew wrote the final manuscript with the critical feedback from all the authors (T. Watt, N. Luo, A. Tan, Y.H. Chan, D. Chew, R. Dalan). The authors read and approved the final manuscript.

Corresponding author

Correspondence to Huiling Liew.

Ethics declarations

Ethics approval and consent to participate

This study was conducted in accordance with the declarations of Helsinki and approval was obtained from the National Healthcare Group (NHG) Institutional Review Board (IRB) in Singapore (DSRB Reference No. 2012/ 01098).

Consent for publication

Consent for publication was not applicable as this manuscript does not contain data for any individual person.

Competing interests

The authors declare that they have no competing interests.

Additional information

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Supplementary Information

Rights and permissions

Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Liew, H., Watt, T., Nan, L. et al. Psychometric properties of the thyroid-specific quality of life questionnaire ThyPRO in Singaporean patients with Graves’ disease. J Patient Rep Outcomes 5, 54 (2021). https://doi.org/10.1186/s41687-021-00309-x

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1186/s41687-021-00309-x

Keywords