- Open Access
Confirmatory factor analysis of the Dutch Screening Visual Complaints questionnaire in people with multiple sclerosis
Journal of Patient-Reported Outcomes volume 6, Article number: 36 (2022)
Visual complaints among people with multiple sclerosis (pwMS) are common, but often difficult to recognize. The Screening Visual Complaints questionnaire (SVCq) has been developed to screen for visual complaints in people with a neurodegenerative disease, including multiple sclerosis (MS). A previous study performed a factor analysis in a normal population which revealed an acceptable one-factor model, a three-factor model and a five-factor model within the SVCq. To increase the usability of the SVCq in people with MS, the purpose of the current study was to investigate the fit of the three models in a cohort of pwMS.
The confirmatory factor analysis on the SVCq in 493 people with MS showed good fit for all the models. The three-factor model (diminished visual perception, altered visual perception and ocular discomfort) outperformed the one-factor model. The five-factor model outperformed both models, which showed that dividing the first factor (diminished visual perception) into three more factors (function-related, luminance-related and task-related) has merit.
All models may be useful in clinical care for pwMS. The one-factor model may give a quick overview of the presence and severity of visual complaints in general. The individual factors, of either the three- or the five factor models, may contribute to a better recognition of the nature of visual complaints in pwMS and may guide further steps in rehabilitation for pwMS with visual complaints.
People with a neurodegenerative disorder, such as Parkinson’s disease, dementia and multiple sclerosis (MS) frequently deal with visual problems [1,2,3]. However, since these problems may not be easy to describe and since symptoms that are more eminent, visible, or acute may receive greater emphasis, visual problems and their impact on daily life’s challenges may remain unattended to in clinical settings [4, 5].
A recent study by this author  found that the prevalence of visual complaints among people with MS (pwMS) is higher than previously estimated. Up to 90% of pwMS reported to experience some kind of visual complaints in daily life. Complaints regarding light, such as a difficulty adapting to lighter or darker environments, being blinded by bright light or needing more light were especially common, next to for example the feeling to need more time to see something, changes in the visual field, or problems with depth perception. Overall, the nature of the complaints showed a large variability. Furthermore, the study revealed that pwMS with and without a history of optical neuritis (ON) reported similar complaints and the complaints could occur anytime along the disease course.
The study by van der Feen  made use of the Screening Visual Complaints questionnaire (SVCq; , see Appendix 1 and 2), a questionnaire that has been developed to quickly screen for the presence and nature of visual complaints in people with Parkinson’s disease, dementia and MS. The SVCq assesses subjective visual complaints on a functional level, while previously used questionnaires primarily assess vision related quality of life in daily activities, such as the NEI-VFQ, the NEI-VFQ-25 or MSVQ-7 [8,9,10]. The SVCq is comprised of 19 items reflecting visual complaints, which could be rated on frequency of occurrence. The SVCq may help direct attention to visual complaints and may support in referring people with visual complaints to fitting care or rehabilitation.
In a normal Dutch sample (people without MS or other severe neurological, ophthalmological or psychiatric disorders), the SVCq showed satisfactory validity, good internal consistency (α = 0.85), and good test–retest reliability (ICC = 0.82; ). In addition, Huizinga  performed a factor analysis and proposed a three-factor model of the 19 items, including the factors diminished visual perception, altered visual perception, and ocular discomfort. Along with the proposed three-factor structure, Huizinga  found an acceptable fit for the one-factor model (all 19 items comprised in one factor) and a five-factor model, where the diminished visual perception factor from the three-factor model was divided into three separate factors, being function related, luminance related and task related (see Fig. 1 for a summary of the models and their corresponding items).
These promising factor models should however also be investigated in clinical samples, since the SCVq was specifically developed for people with Parkinson’s disease, dementia and MS. Van der Lijn et al. (submitted) investigated the fit of the three models in a representative sample of people with Parkinson’s disease and was able to confirm good fit of all three models.
In order to be able to make optimal use of the SVCq in clinical care for pwMS, we aim to assess the factor structures of Huizinga  in a clinical sample of pwMS, using confirmatory factor analysis (CFA).
In this study, we made use of the same data set that was used in a study by van der Feen .
A Dutch cohort of patients regularly (once or twice a year) visiting the MS Centrum Noord Nederland (MSCNN), were invited to complete the SVCq . Since the questionnaire was only available in Dutch at the time of the data collection of this study, only Dutch-speaking patients were invited to complete the questionnaire (SVCq is available in English now; see ). Furthermore, the treating neurologist made a decision on clinical basis not to invite people to complete the SVCq when the SVCq would not be of appropriate and additive value to the care of a patient due to too servere disability (cognitively or otherwise). The neurologists estimated that this was the case in 10 to 15 people. In total, we send out 607 questionnaires. Several patients filled out the questionnaire more than once, in which case only the first SCVq was used. From the 607 questionnaires, we received questionnaires back from 507 unique patients, of which 493 patients provided informed consent to use the data for scientific purposes. Demographics and MS-related characteristics of the sample are presented in Table 1.
The SVCq  is a questionnaire that aims to screen for visual complaints and was specially designed for people with Parkinson’s disease, dementia and MS. Participants who wear glasses or contacts were instructed to complete the items as if they were wearing them. In the first part of the questionnaire, patients have the opportunity to spontaneously report any visual complaints they may have. Then, 19 statements regarding their sight are presented. Patients were asked to rate each statement on frequency of occurrence (never/hardly, sometimes, often/always). At the end of the SCVq, people indicated the discomfort in daily life due to the visual complaints on a scale from 0 to 10. For the analysis in the current study, we only used the 19 structured items.
People of the MSCNN received an invitation to complete the questionnaire either during a regular visit to their neurologist (n = 409), or via postal mail (n = 198). The invitation comprised a small information letter and the link to a Qualtrics questionnaire . People could complete the online questionnaire in their own time whenever and wherever suited best, on a self-chosen device. One individual requested to complete the questionnaire on paper. People who did not complete the questionnaire initially, were telephoned once for a reminder. These people were also offered to complete the SCVq right away on the phone with a research assistant. The research assistants were instructed to only read the complaint descriptions and answer options to the respondents. The questionnaires were completed between July 2017 and November 2020. Medical data was obtained from the electronic patients records. All pwMS who were invited to complete the SVCq were asked for consent to use the data of the SVCq and the electronic patient records.
Confirmatory factor analysis (CFA)
The CFA was performed in LISREL 8.8  to determine if the one-factor model, the three-factor model and the five-factor model of the SVCq in a healthy population  could be replicated in a cohort of pwMS. Because of the ordinal structure of the item answers and the non-normality of the responses, we chose to make use of the diagonally weighted least squares (DWLS) method of estimation. All factor variances were set to 1.0.
The fit of the models was assessed according to the following statistics for goodness of fit: (1) normed chi-square. The normed chi-squares were calculated by dividing the Satorra Bentler chi-square value by the degrees of freedom (χ2/df) of the model. This parameter takes sample size into account. Values between 2.0 and 5.0 were considered acceptable, values below 3.0 indicated a good fit [13, 14]; (2) Root Mean Squared Error of Approximation (RMSEA) with a 90% confidence interval . The RMSEA should not be larger than 0.07 and the upper limit of the confidence interval should not exceed 0.08 for an acceptable fit [13, 16]. (3) Standardized Root Mean Square (SRMS), which varies between 0 and 1. Values of 0.08 or smaller indicated a good model fit . (4) Comparative Fit Index (CFI), with values indicative of a good fit between 0.90 and 0.95 . To statistically compare the fit of the three proposed models, we performed nested chi-square difference tests for ordinal data .
McDonald’s ω was calculated in SPSS (v26.0) for every factor to assess internal consistency between the items. For the ocular discomfort scale, we calculated a Spearman Brown coefficient, since this measure is most appropriate to use for 2-item scales . Values between above 0.70 indicate an acceptable internal consistency . Values over 0.95 may indicate items who do not have any individual added value to the questionnaire .
Confirmatory factor analysis
In total, 493 pwMS completed the questionnaire. There was no missing data, hence the analysis was performed with all 493 pwMS. The item loadings and fit statistics of the three models from the CFA are shown in Table 2. Values of the RMSEA, SRMR, and CFI were all within the proposed intervals, indicating a good fit for all models. The normed chi-square indicated a good fit of all the models. Nested chi-square difference tests showed that the five-factor model had a significantly better fit compared to both the one-factor model (χ2(10) = 42.37, p = < 0.001) and the three-factor model (χ2(7) = 1.14, p = < 0.001). The fit of the one- and three-factor models did not differ statistically from each other (χ2(3) = 4.42, p = < 0.220). Dividing diminished visual perception into three additional factors (creating the five-factor model) was beneficial to the model fit.
The internal consistency of the one-factor model was good (McDonald’s ω = 0.89). In the three-factor model, internal consistencies of the factors were good for diminished visual perception (0.89), moderate for altered visual perception (0.66) and poor for ocular discomfort (Spearman Brown coefficient: 0.40). When dividing diminished visual perception into the three additional factors to create the five-factor model, diminished-function related and diminished-luminance related showed good internal consistencies (0.81–0.73 respectively). Diminished-task related showed a moderate internal consistency between the items (0.70).
The SVCq was developed to screen for visual complaints in people with a neurodegenerative disorder, including MS. In a study regarding the psychometric values of the SVCq a factor analysis was performed in a healthy population . The one-factor model, along with the three-factor model and the five-factor model that were revealed by the factor analysis all showed good psychometric values. The objective of the present study was to investigate the goodness-of-fit of the one-factor model (including all items in one factor), the three-factor model and the five-factor model in a sample of pwMS, using CFA.
The CFA revealed that all three tested models had a good fit in the cohort of pwMS. Though the differences were small, the three-factor model showed a better fit than the one-factor model and an extra division of one of the three factors (diminished visual perception) into three separate factors (function related, luminance related, and task related) to create the five-factor model resulted in an even better fit. This indicates that statistically, subdividing the items of the SVCq into three or five subscales has merit. The internal consistencies of the items within the factors slightly decreased with the addition of more factors. This may partly be explained by the inevitable decrease of the number of items per factor, which decreases the internal consistency between the items . This may also account for the lower internal consistencies of the items in the scale of ocular discomfort that consists of only two items.
The SVCq in clinical practice
While the reliability and validity of the questionnaire has only been assessed in a healthy population, it may be helpful to explore how the SVCq may support clinical care for pwMS in the future. Applying the one-factor model (total score on the SVCq) may be useful for a quick and time-efficient measure on the number and severity of the visual complaints pwMS experience. Higher total scores may indicate the need to take further steps in providing care. However, we would not suggest to refer just based on a certain amount of complaints, since the nature of complaints, rather than the number of complaints may be of significance in determining the next steps that should be taken in providing care. Moreover, all complaints may have significant impact on daily life individually. Therefore, we would suggest to make use of the five-factor model in clinical practice, or the three-factor model at least. In case of higher scores on ocular discomfort, referral to an ophthalmologist would be specifically appropriate, instead of for example referral to a rehabilitation center for visual problems. Dry eyes and/or painful eyes could be the consequence of a curable eye disorder. Rehabilitation would also not be meaningful when for example dry eyes are caused by the use of certain medications. Second, the other factors, namely the function-related, luminance-related and task-related scales of diminished visual functioning and altered visual functioning could be considered in tailoring the rehabilitation plan for people with visual complaints, since different complaints might ask for different rehabilitation strategies. Third, we would suggest considering regular assessments of visual complaints in pwMS, since visual complaints may arise anytime along the disease course  but may also worsen with disease progression, or as a consequence of an exacerbation. General practitioners, specialists (e.g. ophthalmologists and neurologists), and rehabilitation centers or other clinical institutions could well make use of the SVCq.
Strengths and limitations
The most prominent strength of this study is the sample size of the cohort. However, it has to be mentioned that a small number of patients (estimated 10–15 pwMS) from the cohort was not asked to complete the questionnaire, due to too severe disability. This could have marginally impacted the fit of the model, but the demographics and disease characteristics of our cohort are representative of a MS-population [24, 25]. Since only pwMS who did complete the SVCq could be inquired for permission to use their data, we do not have demographic and MS-related information about this group. The current sample may even be especially representative for pwMS that may benefit from referral to rehabilitation, since neuro-visual rehabilitation may not be a suitable step for pwMS that are far along the disease course. Moreover, as stated earlier, we only assessed the fit of the proposed models and did not reassess validity or test–retest reliability in our clinical sample. So, while the psychometric values in a healthy population were promising, we cannot claim good reliability or validity in our clinical population at this point. In reassessing the validity and reliability, it is advised to take the changing and unpredictable nature of MS into account. Like the validity and determining reliability in the healthy population, our study can only draw conclusions regarding the Dutch version of the SVCq in a Dutch-speaking population. Validity and reliability should be explored for translations of the SVCq. Another issue that should be pointed out is that we cannot exclude potential mode effects from the methods of data collection. People either completed the questionnaire online by themselves after the invitation (n = 379), or by themselves after a reminder from a research assistant, or directly on the phone with a research assistant (n = 114). We do not know which people completed the questionnaire on the phone. Since people could complete the questionnaire by themselves, we do not know if any help from family or other caretakers was provided during the completion of the SVCq.
The high prevalence and large variability of visual complaints in pwMS and its impact on daily life indicates that it is of clinical importance to bring these complaints to our attention. Using the three different models of the SVCq that were confirmed in a cohort of pwMS may serve different purposes in clinical care and rehabilitation. In future use, the total score of the SVCq (one-factor model) may provide a quick overview of the presence and severity of visual complaints. Subdividing diminished visual perception into three separate factors, creating the five-factor model, increases fit and may ameliorate further guidance in determining the next steps in organizing the appropriate care for pwMS who experience visual complaints.
Availability of data and materials
The datasets used and/or analyzed during the current study are available from the corresponding author on reasonable request.
People with multiple sclerosis
Screening Visual Complaints questionnaire
National Eye Institute-Visual function questionnaire
MS-specific vision questionnaire
Intraclass correlation coefficient
Confirmatory factor analysis
MS Centrum Noord Nederland
Relapsing remitting multiple sclerosis
Secondary progressive multiple sclerosis
Primary progressive multiple sclerosis
Extended Disability Status Scale
Diagonally Weighted Least Squares
Root Mean Squared Error of Approximation
Standardized Root Mean Square
Comparative Fit Index
Colligris P, Peres de Lara MJ, Colligris B, Pinter J (2018) The prospect of the eye as a tool for the early diagnosis of Alzheimer’s disease. J Ophthalmol. https://doi.org/10.1155/2018/8538573
Balcer LJ, Miller DH, Reingold SC, Cohen JA (2015) Vision and vision-related outcome measures in multiple sclerosis. Brain 138:11–27. https://doi.org/10.1093/brain/awu335
Davidsdottir S, Cronin-Golomb A, Lee A (2005) Visual and spatial symptoms in Parkinson’s disease. Vision Res 45(10):1285–1296. https://doi.org/10.1016/j.visres.2004.11.006
Berthold-Lindstedt M, Ygge J, Borg K (2017) Visual dysfunction is underestimated in patients with acquired brain injury. J Rehabil Med 49(4):327–332. https://doi.org/10.2340/16501977-2218
Hoff JM, Dhayalan M, Midelfart A, Tharaldsen AR, Bø L (2019) Synsproblemer ved multippel sklerose. Tidsskr Den Nor Legeforen. https://doi.org/10.4045/tidsskr.18.0786
van der Feen FE, de Haan GA, van der Lijn I, Huizinga F, Meilof JF, Heersema DJ, Heutink J (2022) Recognizing visual complaints in people with multiple sclerosis: Prevalence, nature and associations with key characteristics of MS. Mult Scler Relat Disord. https://doi.org/10.1016/j.msard.2021.103429
Huizinga F, Heutink J, de Haan GA, van der Lijn I, van der Feen FE, Vrijling ACL, Melis-Dankers BJM, de Vries S, Tucha O, Koerts J (2020) The development of the Screening of Visual Complaints questionnaire for patients with neurodegenerative disorders: evaluation of psychometric features in a community sample. PLoS ONE. https://doi.org/10.1371/journal.pone.0232232
Mangione CM, Lee PP, Gutierrez P, Spritzer K, Berry S, Hays RD (2001) Development of the 25-item National Eye Institute Visual Function Questionnaire. Arch Ophthalmol 119(7):1050–1058. https://doi.org/10.1001/archopht.119.7.1050
Mangione CM, Lee PP, Pitts J, Gutierrez P, Berry S, Hays RD (1998) Psychometric properties of the National Eye Institute Visual Function Questionnaire (NEI-VFQ) NEI-VFQ Field Test Investigators. Arch Ophthalmol 116(11):1496–1504. https://doi.org/10.1001/archopht.119.7.1050
Ma S-L, Shea JA, Galetta SL, Jacobs DA, Markowitz CE, Maguire MG et al (2002) Self-reported visual dysfunction in multiple sclerosis: new data from the VFQ-25 and development of an MS-specific vision questionnaire. Am J Ophthalmol 133(5):686–692. https://doi.org/10.1016/S0002-9394(02)01337-5
Qualtics (2017) Qualtric. https://www.qualtrics.com
Jöreskog KG, Sörbom D (2006) Lisrel 8.8 for Windows. Sci Softw Int, Lincolnwood
Hooper D, Coughlan J, Mullen M (2008) Structural equation modelling: guidelines for determining model structural equation modelling: guidelines for determining model fit. Electron J Bus Res 6:53–60
Hinkin TR (1998) A brief tutorial on the development of measures for use in survey questionnaires. Organ Res Methods 1(1):104–121. https://doi.org/10.1177/109442819800100106
Steiger JH (1990) Structural model evaluation and modification: an interval estimation approach. Multivar Behav Res 25(2):173–180. https://doi.org/10.1207/s15327906mbr2502_4
Steiger JH (2007) Understanding the limitations of global fit assessment in structural equation modeling. Pers Individ Differ 42(5):893–898. https://doi.org/10.1016/j.paid.2006.09.017
Hu LT, Bentler PM (1999) Cutoff criteria for fit indexes in covariance structure analysis: conventional criteria versus new alternatives. Struct Equ Model 6(1):1–55. https://doi.org/10.1080/10705519909540118
Bentler PM (1990) Comparative fit indexes in structural models. Psychol Bull 107(2):238–246. https://doi.org/10.1037/0033-2909.107.2.238
Bryant FB, Satorra A (2012) Principles and practice of scaled difference Chi-square testing. Struct Equ Model 19(3):372–398. https://doi.org/10.1080/10705511.2012.687671
Eisinga R, Te GM, Pelzer B (2013) The reliability of a two-item scale: Pearson, Cronbach, or Spearman-Brown? Int J Public Health 58(4):637–642. https://doi.org/10.1007/s00038-012-0416-3
Terwee CB, Bot SDM, de Boer MR, van der Windt DAWM, Knol DL, Dekker J, Bouter LM, de Vet HCW (2007) Quality criteria were proposed for measurement properties of health status questionnaires. J Clin Epidemiol 60(1):34–42. https://doi.org/10.1016/j.jclinepi.2006.03.012
Hulin C, Netemeyer R, Cudeck R (2001) Can a reliability coefficient be too high? J Consum Psychol 10(1):55–58. https://doi.org/10.2307/1480474
Tavakol M, Dennick R (2011) Making sense of Cronbach’s alpha. Int J Med Educ 2:53–55. https://doi.org/10.5116/ijme.4dfb.8dfd
Compston A, Coles A (2008) Multiple sclerosis. Lancet 372(9648):1502–1517. https://doi.org/10.1016/S0140-6736(08)61620-7
Pittock SJ, Mayr WT, McClelland RL, Jorgensen NW, Weigand SD, Noseworthy JH, Rodriguez M (2004) Disability profile of MS did not change over 10 years in a population-based prevalence cohort. Neurology 62(4):601–606. https://doi.org/10.1212/wnl.62.4.601
This work was supported by the Stichting Novum [Project NAH-Progress] Amsterdam, the Netherlands and ZonMW, program Expertisefunctie Zintuiglijk Gehandicapten [637,005,001].
Ethics approval and consent to participate
The study was approved by the Medical Ethics Review Board (Medisch Ethische toetsingscommissie; METc; NL62728.042.17) of the University Medical Centre Groningen. Consent was obtained from all participants.
Consent for publication
The authors declare that they have no competing interests.
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
About this article
Cite this article
van der Feen, F.E., de Haan, G.A., van der Lijn, I. et al. Confirmatory factor analysis of the Dutch Screening Visual Complaints questionnaire in people with multiple sclerosis. J Patient Rep Outcomes 6, 36 (2022). https://doi.org/10.1186/s41687-022-00443-0
- Screening Visual Complaints questionnaire
- Multiple sclerosis
- Visual complaints
- Factor analysis