Does response shift impact interpretation of change even among scales developed using item response theory?

Schwartz, Carolyn E.; Stucky, Brian D.; Michael, Wesley; Rapkin, Bruce D.

doi:10.1186/s41687-019-0162-x

Journal of Patient-Reported Outcomes

Table 4 ANOVA Results Comparing Catalyst Groups across PRO Change Scores

From: Does response shift impact interpretation of change even among scales developed using item response theory?

Change Score (post-pre)	Any Marital Change			Any Work Change			Any Job-Status Change			Increased Comorbidity change
	F	p-value	Eta squared	F	p-value	Eta squared	F	p-value	Eta squared	F	p-value	Eta squared
Appraisal Change
Wellness Focus	2.13	0.12	0.003	0.07	0.93	0.000	1.57	0.21	0.003	0.78	0.38	0.001
Health Worries	0.71	0.49	0.001	1.75	0.17	0.002	0.24	0.78	0.000	0.04	0.84	0.000
Recent Challenges	0.21	0.81	0.000	1.15	0.32	0.002	0.07	0.94	0.000	0.01	0.90	0.000
Spiritual Focus	3.75	0.02	0.005	1.91	0.15	0.003	0.09	0.92	0.000	0.67	0.41	0.000
Relationship Focus	0.23	0.80	0.000	4.63	0.01	0.006	0.50	0.61	0.001	0.43	0.51	0.000
Maintain Roles	1.66	0.19	0.002	3.62	0.03	0.005	0.31	0.73	0.001	0.82	0.37	0.001
Independence	3.07	0.05	0.004	1.34	0.26	0.002	1.01	0.36	0.002	1.76	0.19	0.001
Reduce Responsibilities	0.19	0.83	0.000	2.28	0.10	0.003	0.38	0.68	0.001	4.31	0.04	0.003
Pursue Dreams	1.32	0.27	0.002	0.68	0.51	0.001	0.90	0.41	0.002	1.70	0.19	0.001
Anticipating Decline	0.30	0.74	0.000	0.39	0.68	0.001	0.70	0.50	0.001	0.11	0.74	0.000
Worry-Free	0.16	0.85	0.000	0.21	0.81	0.000	0.24	0.79	0.000	0.72	0.40	0.000
Lightness of Being	1.84	0.16	0.003	0.36	0.70	0.000	0.21	0.81	0.000	1.36	0.24	0.001
Raw Change Score
PROMIS Global Physical Health	0.21	0.81	0.000	0.22	0.80	0.000	1.87	0.15	0.003	1.15	0.28	0.001
PROMIS Global Mental Health	0.04	0.96	0.000	1.98	0.14	0.003	1.69	0.18	0.003	0.00	1.00	0.000
NeuroQOL Applied Cognition-General Concerns	0.54	0.58	0.001	1.24	0.29	0.002	0.65	0.52	0.001	0.04	0.85	0.000
NeuroQOL Applied Cognition-Executive Function	0.56	0.57	0.001	0.11	0.90	0.000	0.02	0.98	0.000	1.10	0.29	0.001
NeuroQOL Positive Affect & Well-Being	0.01	0.99	0.000	1.48	0.23	0.002	0.88	0.41	0.002	0.64	0.42	0.000
Ryff Environmental Mastery	1.21	0.30	0.002	3.71	0.02	0.005	1.45	0.23	0.003	1.95	0.16	0.001
Residualized Change Score
PROMIS Global Physical Health	0.03	0.97	0.000	0.06	0.94	0.000	1.26	0.28	0.003	0.38	0.54	0.000
PROMIS Global Mental Health	0.51	0.60	0.001	2.15	0.12	0.004	2.14	0.12	0.005	0.00	0.95	0.000
NeuroQOL Applied Cognition-General Concerns	1.02	0.36	0.002	1.58	0.21	0.003	0.26	0.77	0.001	0.18	0.67	0.000
NeuroQOL Applied Cognition-Executive Function	0.39	0.68	0.001	0.01	0.99	0.000	0.33	0.72	0.001	1.14	0.29	0.001
NeuroQOL Positive Affect & Well-Being	0.10	0.91	0.000	0.75	0.47	0.001	0.54	0.58	0.001	0.95	0.33	0.001
Ryff Environmental Mastery	1.71	0.18	0.003	2.13	0.12	0.004	1.29	0.28	0.003	1.68	0.19	0.001

Note: Eta-Squared effect sizes are all less than Small as defined by Cohen (1988)
Bolded numbers reflect statistical signficance (i.e., p<0.05)

Back to article page