Skip to main content
Journal of Patient-Reported Outcomes
Download PDF

The development and validation of a revised version of the Medical Outcomes Study Sleep Scale (MOS Sleep-R)

Journal of Patient-Reported Outcomes volume 5, Article number: 40 (2021) Cite this article

Abstract

Background

The 12-item Medical Outcomes Study Sleep Scale (MOS Sleep Scale) has been used to capture patient-reported sleep problems in hundreds of studies. A revised version of the MOS Sleep Scale (MOS Sleep-R) was developed that uses simplified response sets, provides interpretable norm-based scoring, and has two recall versions (one-week or four-week). The objective of this study was to evaluate the psychometric properties (reliability and construct validity) of the MOS Sleep-R using data from a representative sample of U.S. adults.

Methods

Standardization of raw scores into norm-based T-scores (mean = 50, standard deviation = 10) was based on data from a 2009 U.S. internet-based general population survey. The internal consistency reliability of multi-item subscales and global sleep problems indices for both one-week and four-week recall forms of the MOS Sleep-R were examined using Cronbach’s alphas and inter-item correlations. Construct validity was tested by comparing item-scale correlations between items within subscales with item-scale correlations across subscales. Scale-level convergent validity was tested using correlations with measures including generic health-related quality of life (i.e., SF-36v2) and other relevant outcomes (e.g., job performance, number of days in bed due to illness or injury, happiness/satisfaction with life, frequency of stress/pressure in daily life, the impact of stress/pressure on health, and overall health).

Results

The one-week and four-week recall forms of the MOS Sleep-R were completed by 2045 and 2033 respondents, respectively. The psychometric properties of the one-week and four-week forms were similar. All multi-item subscales and global index scores showed adequate internal consistency reliability (all Cronbach’s alpha > 0.75). Patterns of inter-item and item-scale correlations support the scaling assumptions of the MOS Sleep-R. Patterns of correlations between MOS Sleep-R scores with criterion measures of health-related quality of life and other outcomes indicated adequate construct validity.

Conclusions

The MOS Sleep-R introduces a number of revisions to the original survey, including simplified response sets, the introduction of a one-week recall form, and norm-based scoring that enhances interpretability of scores. Both the one-week and four-week recall period forms of the MOS Sleep-R demonstrated good internal consistency reliability and construct validity in a U.S. general population sample.

Introduction

Sleep is a crucial biological function, strongly tied to physical and mental health outcomes. Optimal sleep is linked to tissue and muscle reparation and growth [1,2,3,4,5], release of growth hormones [6], and memory consolidation [7, 8]. Conversely, disordered or shortened sleep is associated with increased risk for many health consequences including cardiovascular disease [9, 10], inflammation [11], obesity [12], diabetes [13], cognitive impairment [14, 15], injury [16, 17], and mortality [18, 19].

Many people do not get enough sleep [20]. Seven to 9 h of sleep are recommended for adults [21], but approximately 30% of Americans report consistently getting less than 6 h of sleep per night [22]. Self-reported data indicate that 25–40% of people experience poor sleep quality or symptoms of insomnia [23,24,25]. Given the high rates of insufficient and low quality sleep, it is important to accurately measure and interpret aspects of sleep in both clinical practice and in research.

Sleep can be quantified in a variety of ways. Polysomnography (PSG) [26] is a sleep measure assessing multiple body functions including heart rate, muscle tone, and brain activity that can be scored by stages (e.g., rapid eye movement [REM] sleep). PSG is considered the gold standard for measuring sleep accurately and objectively [27]. Technological devices such as smartwatches (e.g., actiwatches, exercise trackers) can also be used in sleep research [28].

PSG and other sleep measuring devices are unable to thoroughly characterize the impact of sleep problems on an individual. For example, devices cannot describe daytime sleepiness that occurs after a night of poor or insufficient sleep. Patient-reported outcome (PRO) measures can supplement sleep measuring technology or can be used independently and are useful for measuring sleep quality and poor sleep. There are several commonly used PROs focused on aspects of sleep including the Pittsburgh Sleep Quality Index (PSQI) [29], which captures sleep quality, latency, quantity, efficiency, and disturbance, in addition to somnolence and use of sleep medication; the Epworth Sleepiness Scale (ESS) [30], which captures the likelihood of falling asleep when engaged in various daily activities; the Patient-Reported Outcomes Information System (PROMIS) Sleep Disturbance Scale [31], which focuses on the frequency of disturbances during sleep; and the Medical Outcomes Study Sleep Scale (MOS Sleep Scale) [32].

The 12-item MOS Sleep Scale was developed as part of the Medical Outcomes Study [33], a 4 year longitudinal observational study. The MOS Sleep Scale measures sleep quality and problems over the previous four-week period. The original scale captures essential sleep concepts for general populations and for chronic condition groups (e.g., restless leg syndrome, neuropathic pain); it is considered to have good psychometric properties [34, 35], including reliability and construct validity [36]. While item selection and wording did not incorporate input from patients, as was later recommended by the United States Food and Drug Administration (FDA) for ensuring content validity [37], a subsequent cognitive debriefing study, based on interviews with 19 patients with fibromyalgia, reported that patients generally found the items on the MOS Sleep Scale to be appropriate and relevant, capturing all of their sleep-related symptoms [38]. But, patients did recommend some modifications to the MOS Sleep Scale for general use. Based on this feedback, and ongoing use of the MOS Sleep Scale by the developers, three key areas for improvement were identified.

First, the original scale asks respondents to consider their past 4 weeks of sleep when answering the questions; some research areas require sleep measures with a shorter recall period. Utilization of acute recall versions of other scales, including the SF-36 Health Survey, has been supported in previous work [39].

Second, the majority of scale items (10 of 12) use a 6-point scale, with the response options: ‘all of the time,’ ‘most of the time,’ ‘a good bit of the time,’ ‘some of the time,’ ‘a little of the time,’ and ‘none of the time.’ The response option ‘a good bit of the time’ failed to support assumptions of ordinality: respondents reported being unsure of whether the order of this choice falls naturally between its adjacent responses [40]. In addition, the phrasing of this response option had poor translatability, which may account for inconsistencies in the frequency with which respondents chose this option across different translations [40]. Further, studies using item response theory (IRT) modeling to examine other scales have found that the elimination of this response category resulted in little or no loss of item information [41].

Third, some items and subscales are coded such that a higher score is indicative of a more positive sleep outcome (e.g., higher sleep quality), while a higher score on other subscales indicate more negative sleep outcomes (e.g., more sleep disturbance). This leads to a less intuitive interpretation of scores. Finally, the scoring of subscales and global indices on a 0 to 100 scale can be difficult to interpret. For example, would a score of 40 on the somnolence subscale be considered evidence of high or moderate somnolence? Without reference values, this question cannot be answered. Conversion of 0 to 100 scores into T-scores (mean = 50, standard deviation [SD] = 10), standardized to the general population, such as has been done for other versions of the MOS Sleep Scale [36], would provide general reference values to help interpretation of scores. Using T-scores, a score of 40 would be interpreted as poor, being one SD below the general population normative value.

The MOS Sleep-R was developed to address these limitations. The aim of the present study is to evaluate the psychometric properties of the standard and acute versions of the MOS Sleep-R within a nationally representative sample of adults.

Methods

Study design and sample

The data used for this validation were from a subset of the sample in a 2009 internet-based U.S. general population survey conducted by QualityMetric (QM) for the purpose of updating norms for scoring and interpretation of several PROs, including the MOS Sleep-R [42]. The normative sample was recruited from among panelists within KnowledgePanel®, a national address-based probability sample that is estimated to reach 97% of the U.S. non-institutionalized adult population [43], who provided informed consent to participate in this survey, and who received an honorarium for participating. Older panelists were oversampled to ensure adequate inclusion of those with chronic health conditions and to better reflect clinical trial populations for whom this instrument is expected to be most commonly used. Limitations regarding the representativeness of this sampling approach, including response bias of panel members, have been described elsewhere [44]. Respondents in this sample were randomly assigned (with no quotas or stratifications enforced) to one of four surveys, two of which included the MOS Sleep-R. One of these two surveys included the MOS Sleep-R with a one-week recall period (acute form), while the other included the MOS Sleep-R with a four-week recall period (standard form). Each survey also included a number of other PROs, such as the SF-36v2® Health Survey (SF-36v2; a measure of health-related quality of life [HRQoL]); the revised version of the MOS cognitive functioning scale (MOS Cog-R); a checklist to indicate diagnostic history for 40 possible chronic conditions; demographic items; and numerous criterion measures assessing work performance, psychological distress and well-being, medical resource use, and lifestyle behaviors. Recall periods of the SF-36v2 and criterion measures matched that used for the MOS Sleep-R within each survey. A more detailed description of the 2009 QM survey study can be found in the MOS Sleep-R user manual [42] and the SF-36v2 user manual [45].

Measures

Revised MOS sleep scale (MOS sleep-R)

The MOS Sleep-R is a 12-item scale with recall periods of either 4 weeks (standard form) or 1 week (acute form). Following the structure of the original MOS Sleep Scale [36], responses to items afford calculation of 6 subscales related to: sleep disturbances (difficulties in initiating or maintaining sleep; 4 items), snoring (1 item), waking up with shortness of breath or a headache (1 item), adequacy (perceived sufficiency of sleep quality and quantity; 2 items), somnolence (daytime sleepiness and urge to nap; 3 items), and sleep quantity (1 item) (Table 1). Sleep quantity can either be scored continuously (0–24 h), or as a dichotomous variable: optimal (7–9 h, inclusive; coded as ‘1’) vs. non optimal (< 7 or > 9 h; coded as ‘0’) [21].

Table 1 MOS Sleep-R items
Full size table

Responses to items also enable calculation of two global index measures of sleep quality and problems: sleep problem index I (SPI-I [6 items]) and sleep problem index II (SPI-II [9 items]). Each index provides a single score that can be interpreted as a general summary of the extent and severity of a respondent’s sleep problems [36].

The MOS Sleep-R kept the content of the MOS Sleep items, but made changes to response options and scoring. First, for the 10 of 12 items that are coded as the frequency of an event (see Table 1), the number of response options was reduced from 6 to 5, with the response option ‘a good bit of the time’ omitted.

Second, the scoring of subscales and indices on a scale from 0 to 100 has been supplemented with norm-based scoring using the normative data from the QM U.S. general population survey. Except for the quantity subscale, all MOS Sleep-R scores are expressed as T-scores with the U.S. general population having a mean score of 50 and a SD of 10. The quantity subscale, which is based on a single item asking respondents to report their average number of hours slept per night over the recall period, can be transformed into the optimal quantity subscale. This subscale dichotomizes responses to this item into a score of 1, indicating optimal quantity (a response that is ≥7 and ≤ 9) or 0, indicating non-optimal quantity (all other responses). In all psychometric analyses conducted here, the binary optimal quantity subscale was used. Note that neither raw responses to this item nor the binary coded subscale based on the response contribute to the scoring of either SPI-I or SPI-II.

Third, the direction of scoring for the original scales was subscale specific (i.e., higher scores indicated better sleep outcomes on some subscales, but worse sleep outcomes on others). The scores in the revised scales are interpreted with a single directionality, such that higher scores indicate better sleep for all subscales and both global indices.

Criterion measures

A number of scales and individual ad hoc items included in the QM 2009 normative survey were treated as criterion measures in the current survey. One criterion measure was the SF-36v2, which is a 36-item measure of HRQoL [45]. The SF-36v2 is available with both four-week (standard) and one-week (acute) recall periods and measures 8 domains of patients’ well-being and functioning, including physical functioning (PF), role limitations due to physical health problems (RP), bodily pain (BP), general health (GH), vitality (VT), social functioning (SF), role limitations due to emotional health problems (RE), and mental health (MH). Scores on these 8 subscales can be weighted and combined to produce two component summary measures; one for physical HRQoL (Physical Component Summary [PCS]) and one for mental HRQoL (Mental Component Summary [MCS]). All SF-36v2 domains are expressed as norm-based T-scores using the data from QM’s 2009 U.S. general population survey, with higher scores indicating better HRQoL. We used the one-week SF-36v2 for comparisons with the one-week version of MOS Sleep-R and the four-week SF-36v2 for comparisons with the four-week version of MOS Sleep-R.

Other criterion measures used in this analysis included ad hoc items measuring self-ratings of job performance, happiness/satisfaction, and overall health, which were all measured on a scale from 0 to 100 with higher numbers indicating better outcomes; and the impact of stress/pressure on health, also measured on a scale from 0 to 100 but with higher numbers indicating a worse outcome (i.e., larger impact). Criterion measures also included the number of days in bed due to illness or injury, and the frequency of stress/pressure in daily life during the same recall-period as was used for the MOS Sleep-R (i.e., the last week or last 4 weeks), and the number of chronic conditions that the respondent endorsed on a checklist.

Statistical analysis

Data from all respondents in the QM 2009 normative survey who were administered either the standard or the acute form of MOS Sleep-R were included in this analysis. All validation analyses were conducted separately for each form. Analyses were conducted using SPSS v23.0 and SAS v9.4.

Scaling assumptions of the MOS Sleep-R were examined using multiple techniques. First, we assessed the internal consistency reliability of each of the 3 multiple-item subscales (i.e., disturbance, somnolence, and adequacy) and the 2 global indices. Cronbach’s alpha was calculated for items within each of these subscales and indices; sufficient reliability was determined using the conventional threshold of 0.70 [46].

Second, stability of all subscales and both indices was examined based on scores from a subset of 90 respondents in the QM 2009 normative survey who were administered the MOS Sleep-R twice, with the standard and acute forms completed by 45 subjects each. Time between standard form administrations ranged from 80 to 123 days (mean = 106.0 days, SD = 5.9 days), while time between acute form administrations ranged from 80 to 121 days (mean = 105.9 days, SD = 6.4 days) [42]. Stability of scores over time for each subscale and index across the two assessments was evaluated using intraclass correlation coefficients (ICCs) calculated using McGraw and Wong’s Case 3 (A,1) model [47], which is a two-way mixed-effect model with interaction for the absolute agreement for a single measurement that has been recommended as the preferred model for assessing stability of a repeated PRO measure [48, 49]. An ICC value ≥0.70 has been suggested as indicating adequate stability [50].

Third, as part of evaluating construct validity, we tested the assumption of item-subscale convergent validity for each multi-item subscale (and both indices) of the MOS Sleep-R [51, 52]. This assumption holds that each item which contributes to the scoring of a multi-item subscale (or index) should be sufficiently associated with that subscale, by calculating whether each component item within a multi-item subscale correlated at least moderately with its parent subscale (or index). To accomplish this, the magnitude of the Pearson correlation coefficient between each item on the disturbance, somnolence, and adequacy subscales, and its corrected-parent subscale (i.e., the correlation between the item and its parent subscale when the subscale is calculated using only the remaining component items) or index was compared to a threshold value of 0.40, which can be interpreted as support for convergent validity [50]. Means of correlations between items and their corrected-parent subscale for each multi-item domain were computed using Fisher’s r-to-z approach [53].

Fourth, we tested the assumption of item-subscale discriminant validity for each multi-item subscale of the MOS Sleep-R. This assumption holds that each item which contributes to the scoring of a multi-item subscale should be more highly correlated with that parent subscale than with any of the other subscales [51, 52]. This was achieved by descriptively comparing the magnitudes of Pearson correlations (or, in the case of the binary optimal quantity subscale, polychoric correlations, which are more appropriate for evaluating associations with an ordinal variable) between items and their corrected-parent subscale with the magnitudes of correlations between items and the remaining 5 subscales.

Fifth, scale-level convergent validity of the MOS Sleep-R subscale scores (which is the degree to which scores correspond to conceptually related constructs) was examined using correlations. Magnitudes of correlation coefficients were interpreted following Cohen’s guidelines, such that correlations of 0.1, 0.3, and 0.5 represented small, moderate, and large correlations, respectively [54]. Pearson correlations (or polychoric correlations for the optimal quantity subscale, comprised of one item) were calculated between subscale and the two SPI indices on the standard and acute forms of the MOS Sleep-R, and the corresponding form of the SF-36v2. Based on previous work examining the association between sleep quality and HRQoL, which has found a stronger correspondence of sleep with mental aspects of HRQoL than with physical aspects [55,56,57], along with the well-established evidence for associations between sleep problems and pain [58], we predicted that with the exception of the BP domain, MOS Sleep-R scores would generally show higher correlations (based on descriptive comparisons) with mental-based subscales of the SF-36v2 (VT, SF, RE, and MH) and with MCS than with physical-based subscales and with PCS. Spearman rank-order correlations (or polychoric correlations for the optimal quantity subscale) were calculated for scores on each MOS Sleep-R subscale and index with scores on the selected criterion measures described in the previous section. In general, positive correlations were expected between MOS Sleep-R scores and perceptions of job performance and overall health, while negative correlations were expected between MOS Sleep-R scores and the number of days in bed due to illness or injury, happiness/satisfaction with life (with higher scores indicating less happiness/satisfaction), frequency of stress/pressure in daily life, the impact of stress/pressure on health, and the number of chronic conditions endorsed. For the correlational analyses described above (i.e., correlations between MOS Sleep-R items and subscales, inter-scale correlations among MOS Sleep-R subscale scores, correlations between MOS Sleep-R and SF-36v2 scores, and correlations between MOS Sleep-R and other criterion measures), we performed sensitivity analyses using polychoric correlations. A non-trivial difference in magnitude of coefficients between standard Pearson or Spearman correlations and polychoric correlations would suggest that the use of Pearson or Spearman correlations was not appropriate. For the first three of these sensitivity analyses, polychoric correlations were similar to Pearson correlations, and so Pearson correlations were reported for those analyses (with the exception of correlations involving the optimal quantity subscale). For the third sensitivity analysis (correlations between MOS Sleep-R and other criterion measures), differences between Spearman correlations and polychoric correlations were observed. Thus, results from polychoric correlations were reported for this analysis.

Sixth, known-groups validity of MOS Sleep-R subscales (with the exception of sleep quantity) and index scores was examined by comparing scores between respondents who did and did not self-report having sleep apnea, and between respondents who did or did not self-report health conditions known to be associated with sleep problems: rheumatoid arthritis [RA] [59], and osteoarthritis [OA] [60]. For each health condition, statistically significant differences in mean MOS Sleep-R scores between respondents reporting having or not having the condition were tested using independent-samples t-tests. Cohen’s d was used to estimate magnitude of standardized differences in means between groups; values were interpreted according to Cohen’s published guidelines (d = 0.2, small effect; d = 0.5, medium effect; d = 0.8, large effect) [54].

Results

Sample characteristics and descriptive statistics

A total of 4098 respondents completed the MOS Sleep-R in the QM 2009 normative survey, with 2037 completing the standard recall form and 2061 completing the acute recall form. The completion rate across all surveys was 66.0% [45]. Demographic characteristics of the sample, presented in Table 2, were similar across both forms. Both genders were close to equally represented, while age was older than that of the U.S. general population (mean age was 50.8 for the standard form group and 50.6 for the acute form group) due to deliberate oversampling of older panelists.

Table 2 Patient characteristics of validation sample
Full size table

Means and SDs for raw item scores from each form are shown in Table 3. Values of item scores showed little variation between the two forms; all scores were within 0.10 points (on 5-point response scales) on all items. Average sleep from both forms was slightly less than 7 h, which is consistent with findings from other nationally representative surveys measuring sleep [61].

Table 3 MOS Sleep-R standard and acute form item score means and standard deviations
Full size table

Reliability and construct validity

Findings from assessments of internal consistency for the 3 multi-item subscales and the 2 SPI indices for standard and acute forms of the MOS Sleep-R are reported in Table 4. Cronbach’s alphas for all multi-item subscales and indices of both forms exceeded 0.70, with the majority exceeding 0.80, indicating acceptable reliability.

Table 4 Summary of internal consistency, stability, and construct validity for MOS Sleep-R standard and acute form subscales and global index measures
Full size table

Results for evaluation of stability are also reported in Table 4. For the standard form ICC ≥ 0.70 was found for both indices and 3 subscales – disturbance, somnolence, and snoring – with the adequacy subscale falling just below the cut-off (ICC = 0.68). Both the shortness of breath/headache and the optimal quantity subscales had poor stability for the standard form (both ICC < 0.35). For the acute form, results found ICC ≥ 0.70 for all subscales and indices except the shortness of breath/headache subscale, where ICC = 0.69.

Table 4 also reports results from the examination of the construct validity of the MOS Sleep-R. For both forms, all Pearson correlations between component items and their corrected-parent subscale or index exceeded the criterion of 0.40. In fact, mean correlations of items for each subscale and index > 0.60, thus providing strong support for the item-level convergent validity of these subscales. On the standard form, for all 3 multi-item subscales (i.e., disturbance, adequacy, and somnolence), all items hand higher correlations with their corrected-parent subscale than with any other subscale. On the acute form, this was again the case for the disturbance and adequacy subscales, and for 14 of 15 correlations for the 3 items on the somnolence subscale, with the only deviation being for the item “How often did you feel drowsy or sleepy during the day,” for which there was a very similar correlation with the adequacy subscale (r = 0.63) compared with its own corrected-parent subscale (r = 0.62).

Table 5 shows intercorrelations among subscales and between subscales and global indices. The generally low magnitude of the inter-subscale correlations – the only correlations exceeding 0.5 were the correlation between adequacy and disturbance (0.60) for the standard form, and correlations between adequacy and disturbance (0.60), somnolence and disturbance (0.55), and somnolence and adequacy (0.54) for the acute form – indicates that magnitudes of correlations among the subscales are mostly small or moderate, and thus appear to be capturing separate constructs.

Table 5 Inter-subscale and index-subscale correlations for MOS Sleep-R standard and acute forms
Full size table

Scale-level convergent validity

Correlations between MOS Sleep-R scores for the standard and acute forms, and SF-36v2 scores from the corresponding form are presented in Table 6. Both forms showed very similar patterns of inter-scale correlations. In general, small to moderate correlations were observed between scores on the two scales. Among MOS Sleep-R subscales, disturbance and somnolence generally showed the highest correlations with SF-36v2 scores, while snoring and optimal quantity generally showed the smallest correlations.

Table 6 Correlation coefficients between MOS Sleep-R and SF-36v2 standard and acute form subscales and summary measures
Full size table

Among SF-36v2 domains, VT, SF, and MH generally showed the highest correlations with MOS Sleep-R scores, while PF and RP generally showed the smallest correlations. This trend towards higher correlations between MOS Sleep-R scores and mental-based domains is clearly indicated by the higher correlations among indices and summary measures, with correlations between SPI-I/SPI-II and PCS scores ranging from 0.42 to 0.43 across forms, and correlations between SPI-I/SPI-II and MCS scores ranging from 0.58 to 0.64. Overall, the sleep problem indices tended to have the largest correlations with the SF-36v2 mental domains.

Polychoric correlations between MOS Sleep-R scores and other criterion measures are shown in Table 7. Both forms showed very similar patterns of correlations with these criterion measures. Correlations between MOS Sleep-R scores and all criterion measures were in the hypothesized direction: positive correlations were observed for the 3 positively-worded items (ratings of job performance, happiness, and overall health), while negative correlations were observed for the remaining negatively-worded items. Correlations with the number of current chronic conditions, which were negative across all subscales, were highest for disturbance, somnolence, and shortness of breath/headache subscales. The multi-item scales generally show stronger correlations than the single-item measures – presumably due to higher reliability of the multi-item scales.

Table 7 Correlation coefficients between MOS Sleep-R scores and convergent validity measures
Full size table

Among MOS Sleep-R subscales, disturbance, adequacy, and somnolence generally showed the highest correlations with criterion measures, while snoring and optimal quantity generally showed the smallest correlations. Among criterion measures, those measuring psychological constructs (happiness/satisfaction, stress/pressure) showed the highest correlations with MOS Sleep-R scores, while those measuring perceived job performance and days in bed due to illness or injury showed the smallest correlations.

Known-groups validity

Comparisons of mean MOS Sleep-R scores between patients with or without sleep apnea, RA, and OA are presented in Table 8. Mean scores for all subscale and SPI-I/SPI-II were statistically significantly worse for respondents self-reporting sleep apnea than for those not self-reporting sleep apnea (all p < 0.001 for both standard and acute forms), for respondents self-reporting RA than for those not self-reporting RA (all p < 0.001 for standard form; all p < 0.05 for acute form), and for respondents self-reporting OA than for those not self-reporting OA (all p < 0.001 for both standard and acute forms). Effect sizes for subscale differences were generally medium-sized between sleep apnea groups (Cohen d’s ranging from 0.46 to 0.90 for the standard form and 0.43 to 0.79 for the acute form), and generally small to medium-sized between RA groups (0.28 to 0.65 for the standard form and 0.18 to 0.75 for the acute form) and between OA groups (0.24 to 0.65 for the standard form and 0.26 to 0.63 for the acute form). Deficits on the somnolence subscale were uniformly largest for each health condition; impacts on snoring were smallest for OA and RA groups.

Table 8 Differences in mean MOS Sleep-R scores as a function of self-reported health condition
Full size table

Discussion

Data from a large sample of individuals from the U.S. general population were analyzed to evaluate the psychometric properties of the MOS Sleep-R. The results provide support for good reliability and validity of both the standard and acute recall versions in the general population. Specifically, the instrument demonstrated acceptable reliability, as assessed using both internal consistency and stability. Correlations between component items and their parent subscale, correlations among subscales, and correlations between subscales and external variables provide strong evidence supporting construct validity of the instrument.

Patterns of inter-item correlations between the MOS Sleep-R and a generic measure of HRQoL (the SF-36v2) were in expected directions. As predicted, mental-based domains of the SF-36v2 were more highly correlated with the MOS Sleep-R than physical domains. This reflects findings in the literature that show a strong relationship between mental health and sleep [62,63,64]. Higher (i.e., better) scores on the MOS Sleep-R were also associated with more positive ratings of job performance, happiness, and overall health. These results provide support for the convergent validity of the MOS Sleep-R. Further, respondents who self-reported sleep apnea and those who self-reported health conditions known to be associated with sleep problems, showed consistently worse scores on all MOS Sleep-R subscales and indices than their counterparts.

The rationale behind most of the changes made to develop the MOS Sleep-R was to improve the usability of the scale (by providing an acute form with a shorter recall period) and to improve the interpretability of scores (by making all scoring unidirectional and norm-based). These changes are unlikely to have made a large impact on the psychometric properties of the measure [65]. It was not an objective of the current study to compare the psychometric properties of the MOS Sleep-R with the original MOS Sleep Scale, or to provide evidence for a claim that the changes made to the MOS Sleep-R lead to improvement in psychometric properties compared to the original scale, which, as mentioned above, has been shown to have good reliability and construct validity. The objective of the current study, then, was to confirm that the newly developed MOS Sleep-R, with improved utility and interpretability compared to the original scale, also showed evidence of good reliability and construct validity. As such, the current study did not include a direct comparison between the MOS Sleep Scale and MOS Sleep-R.

In spite of sleep being an important contributor to overall health and well-being, many people suffer from poor sleep. The MOS Sleep-R yields scores that can be more easily understood than those provided by previous versions. Improvements to this scale allow for interpretation of scores relative to the general population. The MOS Sleep-R norm-based scoring provides a comparison point for any condition that may affect sleep. This could be used to show where a specific group (e.g., patients with restless leg syndrome) fall on the scale relative to the general population, allowing researchers and clinicians to better understand the burden of different conditions on sleep. While some state-of-the-art PRO measures, such as the PROMIS measures [66], use different directions for scoring depending on the domain, results from tests with patients and clinicians suggest that it is easier for them to interpret the scores if higher scores consistently indicates better health [67].

While most correlations among subscales and indices were high, the snoring subscale had small correlations with all other measures and showed the smallest deficits for respondents self-reporting RA or OA. Breathing patterns at night may be difficult to self-report accurately; some respondents may be unaware of the presence or frequency of their own snoring. Low accuracy in reporting could explain the lack of high correlations between this subscale and other sleep constructs captured by the MOS Sleep-R. Snoring is associated with known sleep-related conditions (e.g., sleep apnea, for which deficits observed in this study were medium-sized) and it is therefore important to capture this behavior despite its relative lack of association with the other measured concepts in this instrument.

Results from the evaluation of stability of the MOS Sleep-R should be interpreted with caution. First, the interval between administrations for the 90 patients in the test-retest subsample, which ranged between 80 and 123 days with a mean of 106 days, is much longer than is typically, or optimally, used for this purpose. In addition, we did not assess whether a respondent had experienced actual change in the target construct during this interval, which would have allowed for restricting the test-retest sample to include only respondents with stable sleep behaviors. Each of these factors increases the probability that respondents in the subsample actually experienced change in the measured constructs, which violates the core assumption of repeatability (i.e., the measured construct is unchanged between assessments), and as such underestimates the ‘true’ stability of the MOS Sleep-R. This may explain the poor stability observed for some of the subscales, in particular shortness of breath/headache and optimal quantity subscales for the standard form.

These findings should be interpreted in the light of some additional limitations. This study used a representative sample of the U.S. population but people in other countries may have different sleep experiences and expectations than those in the U.S. For example, daytime napping is an established part of the culture in multiple countries, such as Spain, Italy, and Japan [68], but not in other countries. Thus, a person in the U.S. may be more likely to perceive daytime napping as an indication of somnolence than a person from another country where this behavior is considered ‘normal’. Other work has established global variations in sleep patterns (such as wake times) and sleep problems (such as insomnia) [69, 70]. These differences should be considered when interpreting findings from the MOS Sleep-R for individuals outside the U.S.

Results from the current study were based on a general population sample. Previous research has shown that good psychometric properties observed for scales developed and validated in a general population sample may not hold up when used with clinical samples of patients with considerably worse sleep problems [71]. In a general population sample it would be expected to observe a fairly wide range of sleep quality and problems, with many respondents having very mild or no sleep problems. However, the variability of sleep problems in a clinical sample of patients with a health condition associated with sleep problems would likely be more limited, with possible floor effects. The resultant restriction of range in scores could lead to biased underestimation of correlations among MOS Sleep-R items and subscales, reduce correlations between MOS Sleep-R scores and criterion measures, and reduce differences among subgroups differing on clinical characteristics. As such, it cannot be claimed from the current study data that the MOS Sleep-R would exhibit similar psychometric properties when used within a clinical sample. Future studies administering the MOS Sleep-R in clinical samples of patients with sleep problems could address this issue.

With the exception of a small subsample for which there were two assessments, this study used a cross-sectional sample. Use of longitudinal methods or an intervention study design would allow evaluation of the scale’s responsiveness across multiple time points.

This study did not include additional measures of sleep other than the MOS Sleep-R. Our criterion measures were mostly comprised of second-order outcomes (those that are known to be indirectly related to sleep) rather than actual measures of sleep quality and problems. Future studies in which the MOS Sleep-R is administered alongside other methods of capturing sleep quality and problems, such as sleep-measuring devices or different sleep-related PROs, would provide further evidence for evaluating the convergent validity of this scale.

Finally, the psychometric analyses used in this study was based on classical psychometric techniques. This approach is in line with original work on the MOS Sleep instrument. However, more thorough analyses of construct validity could be performed using confirmatory factor analysis, structural equation models, and IRT models [31]. These approaches could be used in future work. We also encourage qualitative studies, in both general population and clinical samples, to examine the content validity of the MOS Sleep-R.

Conclusions

The MOS Sleep-R has good psychometric properties in the general U.S. population and is recommended for capturing sleep quality and problems in both clinical trials and practice. Future work should evaluate discriminant validity and responsiveness of the instrument over time.

Availability of data and materials

Specific data points can be made available upon reasonable request.

Abbreviations

BP:

Bodily Pain

ESS:

Epworth Sleepiness Scale

FDA:

United States Food and Drug Administration

GH:

General Health

HRQoL:

Health-related quality of life

ICC:

Intraclass correlation coefficients

IRT:

Item response theory

MCS:

Mental Component Summary

MH:

Mental Health

MOS Cog-R:

MOS cognitive functioning scale

MOS Sleep:

Medical Outcomes Study Sleep Scale

MOS Sleep-R:

Medical Outcomes Study Sleep Scale Revised

OA:

Osteoarthritis

PCS:

Physical Component Summary

PF:

Physical Functioning

PRO:

Patient-reported outcome

PROMIS:

Patient-Reported Outcomes Information System

PSG:

Polysomnography

PSQI:

Pittsburgh Sleep Quality Index

QM:

QualityMetric

RA:

Rheumatoid Arthritis

REM:

Rapid Eye Movement

RE:

Role-Emotional

RP:

Role-Physical

SD:

Standard deviation

SF:

Social Functioning

SPI-I:

Sleep problem index I

SPI-II:

Sleep problem index II

VT:

Vitality

References

  1. Elkhenany, H., AlOkda, A., El-Badawy, A., & El-Badri, N. (2018). Tissue regeneration: Impact of sleep on stem cell regenerative capacity. Life Sciences, 214, 51–61. https://doi.org/10.1016/j.lfs.2018.10.057 .

    CAS  Article  PubMed  Google Scholar 

  2. Schwarz, P., Graham, W., Li, F., Locke, M., & Peever, J. (2013). Sleep deprivation impairs functional muscle recovery following injury. Sleep Medicine, 14, e262. https://doi.org/10.1016/j.sleep.2013.11.638 .

    Article  Google Scholar 

  3. Chen, Y., Cui, Y., Chen, S., & Wu, Z. (2017). Relationship between sleep and muscle strength among Chinese university students: A cross-sectional study. Journal of Musculoskeletal & Neuronal Interactions, 17(4), 327–333.

    CAS  Google Scholar 

  4. Dattilo, M., Antunes, H. K. M., Medeiros, A., et al. (2011). Sleep and muscle recovery: Endocrinological and molecular basis for a new and promising hypothesis. Medical Hypotheses, 77(2), 220–222. https://doi.org/10.1016/j.mehy.2011.04.017 .

    CAS  Article  PubMed  Google Scholar 

  5. de Sousa Nogueira Freitas, L., da Silva, F. R., Andrade, H. d. A., et al. (2020). Sleep debt induces skeletal muscle injuries in athletes: A promising hypothesis. Medical Hypotheses, 142, 109836. https://doi.org/10.1016/j.mehy.2020.109836 .

    CAS  Article  PubMed  Google Scholar 

  6. Kim, T. W., Jeong, J., & Hong, S. (2015). The impact of sleep and circadian disturbance on hormones and metabolism. International Journal of Endocrinology, 2015, 1–9. https://doi.org/10.1155/2015/591729 .

    Article  Google Scholar 

  7. Klinzing, J. G., Niethard, N., & Born, J. (2019). Mechanisms of systems memory consolidation during sleep. Nature Neuroscience, 22(10), 1598–1610. https://doi.org/10.1038/s41593-019-0467-3 .

    CAS  Article  PubMed  Google Scholar 

  8. Spencer RMC, Walker MP, Stickgold R. (2017). Sleep and Memory Consolidation. In: Chokroverty S. (eds) Sleep Disorders Medicine. New York: Springer. https://doi.org/10.1007/978-1-4939-6578-6/.

  9. Hla, K. M., Young, T., Hagen, E. W., Stein, J. H., Finn, L. A., Nieto, F. J., & Peppard, P. E. (2015). Coronary heart disease incidence in sleep disordered breathing: The Wisconsin sleep cohort study. Sleep., 38(5), 677–684. https://doi.org/10.5665/sleep.4654 .

    Article  PubMed  PubMed Central  Google Scholar 

  10. Strand, L. B., Tsai, M. K., Gunnell, D., Janszky, I., Wen, C. P., & Chang, S. (2016). Self-reported sleep duration and coronary heart disease mortality: A large cohort study of 400,000 Taiwanese adults. International Journal of Cardiology, 207, 246–251. https://doi.org/10.1016/j.ijcard.2016.01.044 .

    Article  PubMed  Google Scholar 

  11. Irwin, M. R., Olmstead, R., & Carroll, J. E. (2016). Sleep disturbance, sleep duration, and inflammation: A systematic review and meta-analysis of cohort studies and experimental sleep deprivation. Biological Psychiatry, 80(1), 40–52. https://doi.org/10.1016/j.biopsych.2015.05.014 .

    Article  PubMed  Google Scholar 

  12. Wu, Y., Zhai, L., & Zhang, D. (2014). Sleep duration and obesity among adults: A meta-analysis of prospective studies. Sleep Medicine, 15(12), 1456–1462. https://doi.org/10.1016/j.sleep.2014.07.018 .

    Article  PubMed  Google Scholar 

  13. Shan, Z., Ma, H., Xie, M., Yan, P., Guo, Y., Bao, W., … Liu, L. (2015). Sleep duration and risk of type 2 diabetes: A meta-analysis of prospective studies. Diabetes Care, 38(3), 529–537. https://doi.org/10.2337/dc14-2073 .

    Article  PubMed  Google Scholar 

  14. Alhola, P., & Polo-Kantola, P. (2007). Sleep deprivation: Impact on cognitive performance. Neuropsychiatric Disease and Treatment, 3(5), 553–567.

    PubMed  PubMed Central  Google Scholar 

  15. Killgore, W. D. S. (2010). Effects of sleep deprivation on cognition. Progress in Brain Research, 185, 105–129. https://doi.org/10.1016/B978-0-444-53702-7.00007-5 .

    Article  PubMed  Google Scholar 

  16. Leger, D., Bayon, V., Ohayon, M. M., et al. (2014). Insomnia and accidents: Cross-sectional study (EQUINOX) on sleep-related home, work and car accidents in 5293 subjects with insomnia from 10 countries. Journal of Sleep Research, 23(2), 143–152. https://doi.org/10.1111/jsr.12104 .

    Article  PubMed  Google Scholar 

  17. Bioulac S, Micoulaud-Franchi JA, Arnaud M, et al. (2017). Risk of motor vehicle accidents related to sleepiness at the wheel: a systematic review and meta-analysis. Sleep, 40,(10). https://doi.org/10.1093/sleep/zsx134.

  18. Cai, H., Shu, X., Xiang, Y., et al. (2015). Sleep duration and mortality: A prospective study of 113,138 middle-aged and elderly Chinese men and women. Sleep., 38(4), 529–536. https://doi.org/10.5665/sleep.4564 .

    Article  PubMed  PubMed Central  Google Scholar 

  19. Liu, T., Xu, C., Rota, M., et al. (2017). Sleep duration and risk of all-cause mortality: A flexible, non-linear, meta-regression of 40 prospective cohort studies. Sleep Medicine Reviews, 32, 28–36. https://doi.org/10.1016/j.smrv.2016.02.005 .

    Article  PubMed  Google Scholar 

  20. Liu Y, Wheaton AG, Chapman DP, Cunningham TJ, Lu H, Croft JB. (2016). Prevalence of healthy sleep duration among adults—United States, 2014. Morbidity and Mortality Weekly Report, 65(6), 137–141. https://doi.org/10.15585/mmwr.mm6506a1.

  21. Hirshkowitz, M., Whiton, K., Albert, S. M., Alessi, C., Bruni, O., DonCarlos, L., … Ware, J. C. (2015). National Sleep Foundation’s updated sleep duration recommendations: Final report. Sleep Health, 1(4), 233–243. https://doi.org/10.1016/j.sleh.2015.10.004 .

    Article  PubMed  Google Scholar 

  22. Ford, E. S., Cunningham, T. J., & Croft, J. B. (2015). Trends in self-reported sleep duration among US adults from 1985 to 2012. Sleep., 38(5), 829–832. https://doi.org/10.5665/sleep.4684 .

    Article  PubMed  PubMed Central  Google Scholar 

  23. Ohayon, M. M., & Smirne, S. (2002). Prevalence and consequences of insomnia disorders in the general population of Italy. Sleep Medicine, 3(2), 115–120. https://doi.org/10.1016/S1389-9457(01)00158-7 .

    Article  PubMed  Google Scholar 

  24. Wong Wing, S., & Fielding, R. (2011). Prevalence of insomnia among Chinese adults in Hong Kong: a population-based study. Journal of Sleep Research, 20(1pt1), 117–126. https://doi.org/10.1111/j.1365-2869.2010.00822.x .

    CAS  Article  PubMed  Google Scholar 

  25. Ohayon, M. M., & Paiva, T. (2005). Global sleep dissatisfaction for the assessment of insomnia severity in the general population of Portugal. Sleep Medicine, 6(5), 435–441. https://doi.org/10.1016/j.sleep.2005.03.006 .

    Article  PubMed  Google Scholar 

  26. Chesson Jr., A. L., Ferber, R. A., Fry, J. M., et al. (1997). The indications for polysomnography and related procedures. Sleep., 20(6), 423–487.

    Article  Google Scholar 

  27. Michaelson, P. G., Allan, P., Chaney, J., & Mair, E. A. (2006). Validations of a portable home sleep study with twelve-lead polysomnography: Comparisons and insights into a variable gold standard. The Annals of Otology, Rhinology, and Laryngology, 115(11), 802–809. https://doi.org/10.1177/000348940611501102 .

    Article  PubMed  Google Scholar 

  28. Jovanov, E. (2015). Preliminary analysis of the use of smartwatches for longitudinal health monitoring. IEEE.

  29. Buysse, D. J., Reynolds, I. I. I., Charles, F., Monk, T. H., Berman, S. R., & Kupfer, D. J. (1989). The Pittsburgh sleep quality index: A new instrument for psychiatric practice and research. Psychiatry Research, 28(2), 193–213. https://doi.org/10.1016/0165-1781(89)90047-4 .

    CAS  Article  PubMed  PubMed Central  Google Scholar 

  30. Johns, M. W. (1991). A new method for measuring daytime sleepiness: The Epworth sleepiness scale. Sleep., 14(6), 540–545. https://doi.org/10.1093/sleep/14.6.540 .

    CAS  Article  PubMed  Google Scholar 

  31. Buysse, D. J., Yu, L., Moul, D. E., Germain, A., Stover, A., Dodds, N. E., … Pilkonis, P. A. (2010). Development and validation of patient-reported outcome measures for sleep disturbance and sleep-related impairments. Sleep., 33(6), 781–792. https://doi.org/10.1093/sleep/33.6.781 .

    Article  PubMed  PubMed Central  Google Scholar 

  32. Spritzer KL, Hays RD. (2003). MOS sleep scale: a manual for use and scoring, version 1.0. Los Angeles, 1–8.

  33. Hays, R. D., & Stewart, A. L. (1992). Sleep measures. In A. L. Stewart, & J. E. Ware Jr. (Eds.), Measuring functioning and well-being: The medical outcomes study approach, (pp. 235–259). Duke University Press.

  34. Allen, R. P., Kosinski, M., Hill-Zabala, C. E., & Calloway, M. O. (2009). Psychometric evaluation and tests of validity of the medical outcomes study 12-item sleep scale (MOS sleep). Sleep Medicine, 10(5), 531–539. https://doi.org/10.1016/j.sleep.2008.06.003 .

  35. Rejas, J., Ribera, M. V., Ruiz, M., & Masrramón, X. (2007). Psychometric properties of the MOS (medical outcomes study) sleep scale in patients with neuropathic pain. European Journal of Pain, 11(3), 329–340. https://doi.org/10.1016/j.ejpain.2006.05.002 .

    Article  PubMed  Google Scholar 

  36. Hays, R. D., Martin, S. A., Sesti, A. M., & Spritzer, K. L. (2005). Psychometric properties of the medical outcomes study sleep measure. Sleep Medicine, 6(1), 41–44. https://doi.org/10.1016/j.sleep.2004.07.006 .

    Article  PubMed  Google Scholar 

  37. U.S. Department of Health and Human Services, Food and Drug Administration. Guidance for Industry: Patient-Reported Outcome Measures: Use in Medical Product Development to Support Labeling Claims. http://www.fda.gov/downloads/Drugs/Guidances/UCM193282.pdf. Updated December 2009. Accessed 16 June 2020.

  38. Martin, S., Chandran, A., Zografos, L., & Zlateva, G. (2009). Evaluation of the impact of fibromyalgia on patients’ sleep and the content validity of two sleep scales. Health and Quality of Life Outcomes, 7(1), 64. https://doi.org/10.1186/1477-7525-7-64 .

    Article  PubMed  PubMed Central  Google Scholar 

  39. Keller, S. D., Bayliss, M. S., Ware Jr., J. E., Hsu, M., Damiano, A. M., & Goss, T. F. (1997). Comparison of responses to SF-36 Health Survey questions with one-week and four-week recall periods. Health Services Research, 32(3), 367.

    CAS  PubMed  PubMed Central  Google Scholar 

  40. Keller, S. D., Ware Jr., J. E., Gandek, B., et al. (1998). Testing the equivalence of translations of widely used response choice labels: results from the IQOLA Project. International Quality of Life Assessment. Journal of Clinical Epidemiology, 51(11), 933–944. https://doi.org/10.1016/S0895-4356(98)00084-5 .

    CAS  Article  PubMed  Google Scholar 

  41. Reeve, B. B., & Mâsse, L. C. (2004). Item response theory modeling for questionnaire evaluation. In S. Presser, J. M. Rothgeb, M. P. Couper, et al. (Eds.), Methods for testing and evaluating survey questionnaires, (pp. 247–273). Wiley.

  42. Maruish, M. E. (Ed.) (2012). User’s guide for the MOS sleep scale–revised, (3rd ed., ). QualityMetric Inc.

  43. http://www.knowledgenetworks.com/knpanel: GfK Custom Research North America; 2013. http://www.knowledgenetworks.com/knpanel/. Accessed 20 July 2018.

  44. Chang, L., & Krosnick, J. A. (2009). National surveys via RDD telephone interviewing versus the internet: Comparing sample representativeness and response quality. Public Opinion Quarterly, 73(4), 641–678. https://doi.org/10.1093/poq/nfp075 .

  45. Maruish, M. E. (Ed.) (2011). User’s manual for the SF-36v2® health survey, (3rd ed., ). QualityMetric Inc.

  46. Nunnally, J. C., & Bernstein, I. H. (1994). Psychometric theory. In McGraw-Hill series in psychology, (3rd ed., ). McGraw-Hill.

  47. McGraw, K. O., & Wong, S. P. (1996). Forming inferences about some intraclass correlation coefficients. Psychological Methods, 1(1), 30–46. https://doi.org/10.1037/1082-989X.1.1.30 .

  48. Qin, S., Nelson, L., McLeod, L., Eremenco, S., & Coons, S. J. (2019). Assessing test-retest reliability of patient-reported outcome measures using intraclass correlation coefficients: Recommendations for selecting and documenting the analytical formula. Quality of Life Research, 28(4), 1029–1033. https://doi.org/10.1007/s11136-018-2076-0 .

  49. Koo, T. K., & Li, M. Y. (2016). A guideline of selecting and reporting intraclass correlation coefficients for reliability research. Journal of Chiropractic Medicine, 15(2), 155–163. https://doi.org/10.1016/j.jcm.2016.02.012 .

  50. Cappelleri, J. C., Zou, K. H., Bushmakin, A. G., Alvir, J. M., Alemayehu, D., & Symonds, T. (2013). Patient-reported outcomes: Measurement, implementation and interpretation. Chapman & Hall/CRC Press. https://doi.org/10.1201/b16139 .

  51. Campbell, D. T., & Fiske, D. W. (1959). Convergent and discriminant validation by the multitrait-multimethod matrix. The Psychological Bulletin, 56(2), 81–105. https://doi.org/10.1037/h0046016 .

  52. McHorney, C. A., Ware, J. E., & Raczek, A. E. (1993). The MOS 36-item short-form health survey (SF-36): II. Psychometric and clinical tests of validity in measuring physical and mental health constructs. Medical Care, 31(3), 247–263. https://doi.org/10.1097/00005650-199303000-00006 .

  53. Fisher, R. A. (1915). Frequency distribution of the values of the correlation coefficient in samples from an indefinitely large population. Biometrika., 10(4), 507–521.

    Google Scholar 

  54. Cohen, J. (1988). Statistical power analysis for the behavioral sciences. Lawrence Erlbaum Associates 2nd.

  55. Freeman, D., Sheaves, B., Goodwin, G. M., Yu, L. M., Nickless, A., Harrison, P. J., … Espie, C. A. (2017). The effects of improving sleep on mental health (OASIS): A randomised controlled trial with mediation analysis. Lancet Psychiatry, 4(10), 749–758. https://doi.org/10.1016/S2215-0366(17)30328-0 .

  56. Chen, X., Gelaye, B., & Williams, M. A. (2014). Sleep characteristics and health-related quality of life among a national sample of American young adults: Assessment of possible health disparities. Quality of Life Research, 23(2), 613–625. https://doi.org/10.1007/s11136-013-0475-9 .

    Article  PubMed  Google Scholar 

  57. O'Donoghue, G. M., Fox, N., Heneghan, C., & Hurley, D. A. (2009). Objective and subjective assessment of sleep in chronic low back pain patients compared with healthy age and gender matched controls: A pilot study. BMC Musculoskeletal Disorders, 10(1), 122. https://doi.org/10.1186/1471-2474-10-122 .

    Article  PubMed  PubMed Central  Google Scholar 

  58. Sivertsen, B., Lallukka, T., Petrie, K. J., Steingrímsdóttir, Ó. A., Stubhaug, A., & Nielsen, C. S. (2015). Sleep and pain sensitivity in adults. Pain., 156(8), 1433–1439. https://doi.org/10.1097/j.pain.0000000000000131 .

    Article  PubMed  Google Scholar 

  59. Wolfe, F., Michaud, K., & Li, T. (2006). Sleep disturbance in patients with rheumatoid arthritis: Evaluation by medical outcomes study and visual analog sleep scales. The Journal of Rheumatology., 33(10), 1942–1951.

    PubMed  Google Scholar 

  60. Pickering, M., Chapurlat, R., Kocher, L., & Peter-Derex, L. (2016). Sleep disturbances and osteoarthritis. Pain Practice, 16(2), 237–244. https://doi.org/10.1111/papr.12271 .

    Article  PubMed  Google Scholar 

  61. Swanson, L. M., Arnedt, J. T., Rosekind, M. R., Belenky, G., Balkin, T. J., & Drake, C. (2011). Sleep disorders and work performance: Findings from the 2008 National Sleep Foundation sleep in America poll. Journal of Sleep Research, 20(3), 487–494. https://doi.org/10.1111/j.1365-2869.2010.00890.x .

    Article  PubMed  Google Scholar 

  62. Chan, M., Chung, K., Yung, K., & Yeung, W. (2017). Sleep in schizophrenia: A systematic review and meta-analysis of polysomnographic findings in case-control studies. Sleep Medicine Reviews, 32, 69–84. https://doi.org/10.1016/j.smrv.2016.03.001 .

    Article  PubMed  Google Scholar 

  63. Dickinson, D. L., Wolkow, A. P., Rajaratnam, S. M. W., & Drummond, S. P. A. (2018). Personal sleep debt and daytime sleepiness mediate the relationship between sleep and mental health outcomes in young adults. Depression and Anxiety, 35(8), 775–783. https://doi.org/10.1002/da.22769.

  64. Wolkow, A. P., Dickinson, D. L., Rajaratnam, S. M., & Drummond, S. P. (2018). 0963 sleep debt and daytime sleepiness mediate the relationship between sleep and mental health outcomes in young adults: A cross-sectional study. Sleep, 41(suppl_1), A357–A358.

    Article  Google Scholar 

  65. Uy, V., Hays, R. D., Xu, J. J., Fayers, P. M., Auerbach, A. D., Black, J. T., … Ong, M. K. (2020). Do the unlabeled response categories of the Minnesota living with heart failure questionnaire satisfy the monotonicity assumption of simple-summated scoring? Quality of Life Research, 29(5), 1349–1360. https://doi.org/10.1007/s11136-020-02422-8 .

    Article  PubMed  PubMed Central  Google Scholar 

  66. Cella, D., Riley, W., Stone, A., Rothrock, N., Reeve, B., Yount, S., … PROMIS Cooperative Group (2010). The patient-reported outcomes measurement information system (PROMIS) developed and tested its first wave of adult self-reported health outcome item banks: 2005-2008. Journal of Clinical Epidemiology, 63(11), 1179–1194. https://doi.org/10.1016/j.jclinepi.2010.04.011 .

    Article  PubMed  PubMed Central  Google Scholar 

  67. Snyder, C. F., Smith, K. C., Bantug, E. T., Tolbert, E. E., Blackford, A. L., & Brundage, M. D. (2017). What do these scores mean? Presenting patient-reported outcomes data to patients and clinicians to improve interpretability. Cancer., 123(10), 1848–1859. https://doi.org/10.1002/cncr.30530 .

    Article  PubMed  PubMed Central  Google Scholar 

  68. Mishra, J. M. (2009). A case for naps in the workplace. Seidman Business Review, 15(1), 9.

    Google Scholar 

  69. Soldatos, C. R., Allaert, F. A., Ohta, T., & Dikeos, D. G. (2005). How do individuals sleep around the world? Results from a single-day survey in ten countries. Sleep Medicine, 6(1), 5–13. https://doi.org/10.1016/j.sleep.2004.10.006 .

    Article  PubMed  Google Scholar 

  70. Gradisar, M., Gardner, G., & Dohnt, H. (2011). Recent worldwide sleep patterns and problems during adolescence: A review and meta-analysis of age, region, and sleep. Sleep Medicine, 12(2), 110–118. https://doi.org/10.1016/j.sleep.2010.11.008 .

    Article  PubMed  Google Scholar 

  71. Lee, M. K., Yost, K. J., McDonald, J. S., Dougherty, R. W., Vine, R. L., & Kallmes, D. F. (2017). Item response theory analysis to evaluate reliability and minimal clinically important change of the Roland-Morris disability questionnaire in patients with severe disability due to back pain from vertebral compression fractures. The Spine Journal, 17(6), 821–829. https://doi.org/10.1016/j.spinee.2017.01.002 .

    Article  PubMed  Google Scholar 

Download references

Code availability

Not applicable.

Funding

This study was funded by QualityMetric, which licenses the MOS Sleep-R. Permission to reproduce and to use the MOS Sleep-R and the associated trademark(s) is routinely granted royalty-free to individuals and organizations that collect their own data for purposes of scholarly research. Permissions for both scholarly and commercial use of the MOS Sleep-R can be obtained by completing a License Application Form. All other uses, commercial and noncommercial, may require payment of a license fee. Completion of the License Application Form will result in the quotation of any user fees and, upon user request and approval by QualityMetric™, the issuance of a license and invoice. Any organization or individual wishing to reproduce the survey documented herein and/or any associated intellectual property (e.g., the trademarks, scoring algorithms, interpretation guidelines, and/or normative data) for any purpose must register or obtain a license from QualityMetric. For information about registering or obtaining a license, go to www.qualitymetric.com.

Author information

Authors and Affiliations

  1. QualityMetric, 1301 Atwood Ave, Suite 216E, Johnston, RI, USA

    Aaron Yarlas, Michelle K. White, Danielle G. St. Pierre & Jakob B. Bjorner

  2. Department of Public Health, University of Copenhagen, Gothersgade 160, DK-1123, Copenhagen, Denmark

    Jakob B. Bjorner

  3. The Danish National Research Centre for the Working Environment, Lerso Park Alle 105, DK-2100, Copenhagen, Denmark

    Jakob B. Bjorner

Authors
  1. Aaron Yarlas
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Michelle K. White
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Danielle G. St. Pierre
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Jakob B. Bjorner
    View author publications

    You can also search for this author in PubMed Google Scholar

Contributions

AY, MKW, and JBB conceived this study and made substantive contributions to the study design, analysis, and interpretation. All authors contributed to interpretation of results. AY and DGS drafted the first version of the manuscript and all authors reviewed that version and later drafts. All authors read and approved the final manuscript. All authors drafted the response letter to reviewers and made revisions to the resubmitted manuscript.

Corresponding author

Correspondence to Aaron Yarlas.

Ethics declarations

Ethics approval and consent to participate

All procedures performed in studies involving human participants were in accordance with the ethical standards of the institutional and or national research committee and with the 1964 Helsinki Declaration and its later amendments or comparable ethical standards.

All participants provided consent.

Consent for publication

Not applicable.

Competing interests

At the time of the original submission all authors were full-time employees of QualityMetric. They have no conflicts of interest to report.

Additional information

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/.

Reprints and Permissions

About this article

Verify currency and authenticity via CrossMark

Cite this article

Yarlas, A., White, M.K., St. Pierre, D.G. et al. The development and validation of a revised version of the Medical Outcomes Study Sleep Scale (MOS Sleep-R). J Patient Rep Outcomes 5, 40 (2021). https://doi.org/10.1186/s41687-021-00311-3

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1186/s41687-021-00311-3

Keywords

  • Psychometric validation
  • Sleep
  • Sleep disturbance
  • Somnolence
  • PRO development