Skip to main content

Race-related differences in the economic, healthcare-access, and psychological impact of COVID-19: personal resources associated with resilience

Abstract

Background

The impact of the coronavirus disease 2019 (COVID) is worse among those with fewer financial resources, in jobs not amenable to remote work, and in denser living conditions. People of color are more likely to be among these vulnerable groups. Although race itself is a social construction and not based on underlying genetic/biological differences, this study investigated race/ethnicity differences in the negative repercussions of COVID and in the benefits of psychological and social resources.

Methods

This cross-sectional, web-based study (n = 4817) was administered to a heterogeneous United States sample in Spring/Summer 2020. Information was gathered on the following COVID-specific variables: Infection Status, Coping with Lockdown, Social Support, Post-traumatic Growth, Interpersonal Conflict, Worry about Self, Financial Impact on Family, Lack of Money, Inadequate Access to Healthcare, and Housing Instability. Resilience was operationalized as the ability to maintain a sense of wellness in the face of the pandemic, using the DeltaQuest Wellness measure. Multivariate linear regression (adjusting for demographics) and propensity-matched cohort analysis (matched on demographics) evaluated the impact of COVID-specific variables on Wellness in separate models for Whites and Non-Whites.

Findings

Both sets of models retained the same COVID-specific variables and explained about half of the variance in wellness. Coping with Lockdown, Social Support, and Post-traumatic Growth were associated with higher levels of Wellness in both Whites and Non-Whites, while Interpersonal Conflict and Worry about Self were associated with lower levels of Wellness. While these associations are similar, Non-Whites reported worse levels of some positive resources (e.g., social support) and more challenging levels of negative stressors (e.g., interpersonal, worry, financial). Non-Whites also reported much higher levels of post-traumatic growth.

Conclusion

COVID was a source of worry and even conflict, but also unlocked people’s resources in use of health-enhancing behavioral strategies, social support, and renewed gratitude for sources of personal meaning and value. The similar relationships between Whites and Non-Whites on wellness and COVID-specific stressors across racial groups underscore that race is a social construction, not a biological fact. Focusing on a renewed appreciation for sources of personal meaning, and particularly faith, seemed to buffer much of the COVID-related stress for Non-Whites.

Introduction

We are living in extraordinary times. The novel coronavirus disease 2019 (COVID) has led to a world-wide health crisis, infecting over 584 million people, directly causing over 6.4 million deaths worldwide [1], and indirectly causing over 8.5 million excess deaths due to the wider impact of the pandemic on health systems and society [2]. COVID has required enormous changes in our lives. The social distancing needed to contain the pandemic has necessitated shutting down large portions of our economy, with important reverberations for livelihoods [3], healthcare [4,5,6], healthy living behaviors [7, 8], social connections [9, 10], quality of life [5, 11, 12], and well-being [13, 14]. By dint of its different repercussions associated with sociodemographic [15] and other personal characteristics [16,17,18], the novel coronavirus also presents a unique opportunity to study social determinants of the impact of such multidimensional challenges.

The COVID pandemic presents stressors at many levels. In addition to the immediate physiological challenges of infection, [19,20,21], the virus also impacts physical functioning by limiting one’s ability to engage in normal activities, including exercise, if these activities involve being near or around other people [22,23,24]. The pandemic causes emotional [25, 26] and social stress [27] due to worry [28, 29], hardship [30], social isolation [31], and interpersonal conflict [32] caused either by too much close contact among people with an already stressed relationship, or by difficulty coping with the imposed financial, logistic, or other hardships [33]. The pandemic also causes cognitive stress, as a result of worry, hardship, or other overwhelming situations [34].

In the face of the many negative aspects of the pandemic, what are the most effective ways of remaining resilient to its effects? Psychosocial research across many patient populations points to the importance of social support and social capital [35, 36]. Similarly, conceptual work on resilience in the face of natural disasters has emphasized the “three C’s”: control, coherence, and connectedness [37]. In other words, having a network of people who provide companionship, emotional solace, fun, intellectual stimulation, and pragmatic assistance enables better functioning [38,39,40]. Additionally, people can attenuate this impact by using coping strategies that are both behavioral (i.e., problem-focused) and cognitive, rather than by focusing on the negative and/or by venting (i.e., negative emotion-focused) [6, 41]. Thus, even when dealing with a stressful and challenging situation, the way people think about it and behave can attenuate or exacerbate its impact [42, 43]. All of these positive behavioral and attitudinal approaches may promote a type of wellness that enables resilience in the face of COVID.

Early in the pandemic, it became clear that the impact of COVID particularly afflicted vulnerable populations, specifically those having fewer financial resources [44,45,46,47,48], being more likely to work in “essential” jobs that were not amenable to remote work accommodations [49], and living in denser conditions [50]. Since people of color are more likely to have fewer financial resources, to work in “essential” jobs, and to live in denser housing, they are at greater risk of experiencing detrimental effects of COVID [51].

It should be noted that race/ethnicity itself is a social construction [52] [53, 54]. It is not based on underlying genetic or biological differences [55], but rather was a construct initiated and promoted for political and financial reasons [56, 57]. With more information about one’s family background comes the recognition that race/ethnicity is likely not a binary personal characteristic, and that many individuals are multi-racial. In the United States population, Hispanic ethnicity is assessed as a variable separate from race. People who are Hispanic in the US are a minoritized group, along with Blacks, Asian, American Indians, and other non-whites. Accordingly, in the present study, we compared Non-Hispanic Whites to all other groups. Although not ideal, this was a way to distinguish “majority” versus “minoritized” participants, and thereby to study social determinants of health and psychosocial resources in the context of the pandemic.

It is unknown, however, whether there are differences in resilience to the pandemic as a function of race/ethnicity. Specifically, is the impact different with regard to the specific negative economic, healthcare-access, and psychosocial repercussions of COVID? Similarly, how do the benefits of psychological and social resources differ by race/ethnicity? The present study addressed resilience using a measure of attitudes, perspectives, and behaviors related to wellness in a large and diverse United States (US) sample.

Methods

Design

This cross-sectional study was administered in late Spring through mid-Summer of 2020 (May-15 to July-17 2020), as part of a larger, longitudinal study of the impact of the COVID-19 pandemic on health and well-being. The overall study aims to investigate personal factors related to resilience in response to COVID-related stress in a heterogeneous population in terms of health, race, and ethnicity.

Sample and procedure

This study recruited participants via Rare Patient Voice and Ipsos Insight —the former to target patients and caregivers of people with chronic medical conditions; the latter to target a general-population sample of US adults who were heterogeneous in terms of health. This general-population subsample was recruited to yield an overall sample that was more diverse and more nationally representative in terms of age distribution, gender, region, and income. Participants were not paid for their participation, although Ipsos Insight used its usual respondent point-related incentives. Eligible participants were age 18 or older and able to complete an online questionnaire. Participants with motor, visual, and/or other problems that made it difficult for them to complete the web-based survey enlisted the assistance of someone else to enter the participant’s answers. This survey was administered through the secure Alchemer engine (www.alchemer.com), which is compliant with the US Health Insurance Portability and Accountability Act. The protocol was reviewed and approved by the New England Independent Review Board (NEIRB #2,021,164), and all participants provided informed consent prior to beginning the survey.

Measures

COVID-Specific Questions included selected items compiled by the US National Institutes of Health (NIH) Office of Behavioral and Social Sciences Research and the NIH Disaster Research program [58]. Additional file1: Table 1 provides a full listing of the items used in the COVID-specific scales and their internal consistency. These items assessed (time frames in parentheses): Infection Status (currently) reflecting whether the individual had been infected with Sars Cov-2; Coping with Lockdown (currently), reflecting health-enhancing behavioral strategies; Social Support (currently), reflecting sources of emotional support; Post-traumatic Growth (since the pandemic began), reflecting renewed appreciation for sources of personal meaning and value; Interpersonal Conflict (currently), reflecting anger and conflict with others in one’s environment; Worry about Self (currently), reflecting dysphoric rumination; Financial Impact on Family (currently), reflecting economic problems within the family; Lack of Money (past month), reflecting economic concerns of the individual; Inadequate Access to Healthcare (during the pandemic), reflecting pandemic-caused lack of access or delays getting medications and routine care; and Housing Instability (currently), reflecting not having a regular place to sleep or stay. The Post-traumatic Growth scale used four items adapted with permission from the Post-Traumatic Growth Inventory [59,60,61].

Table 1 Sample Demographic Characteristics (N = 4816)

We conceptualized resilience in the present study as the ability to maintain a sense of wellness in the face of the pandemic. We used the DeltaQuest Wellness Measure© (DQ Wellness), a 15-item measure with documented reliability and cross-sectional reliability, general construct validity, convergent and divergent validity, and known-groups validity [62]. The measure taps attitudes, perspectives, and behaviors relevant to wellness over the past week. Thirteen positively worded items assessed concepts such as joy/zest, self-care/calm, and outward view (i.e., a positive engagement in the world and with others). Two negatively worded items tapped characteristics antithetical to wellness, namely low energy, and a preoccupation with the negative aspects of one’s life. All items followed an instruction to “indicate how true each of the following statements is for you over the past week” and used rating-scale descriptors ranging from “not at all” (0) to “very much” (4). All items provided an option “do not know/prefer not to answer.” The measure yields a general wellness score on an IRT-score metric, ranging from − 3.0 to + 3.0, with a score of zero reflecting the overall population mean.

Race and ethnicity were assessed using two questions. The first asked “What is your race? (Check all that apply)”. Eight options were listed: American Indian or Alaskan Native; Middle Eastern; South Asian; Other Asian; Black or African American; Native Hawaiian or Pacific Islander; White; Do not know / prefer not to answer. The second question asked, “What is your ethnicity?” with the following response options: Hispanic or Latino; Not Hispanic or Latino; Prefer not to answer. Following guidelines for coding race/ethnicity used by the National Center for Education Statistics Integrated Postsecondary Education Data System [63], we coded all individuals who reported being Hispanic or Latino as Hispanic, regardless of race; and we used multiple codes to reflect all of the races endorsed by each individual.

Other demographic characteristics included role (patient, caregiver, both or neither), year of birth (to compute age), gender, with whom the person lives, cohabitation/marital status, difficulty paying bills, employment status, height and weight (to compute body mass index), education, smoking status, total number of comorbidities, year of chronic medical diagnosis (if applicable; to compute time since diagnosis), whether the participant received help to complete the survey, and whether the individual had been infected with Sars Cov-2. Occupational complexity was assessed using the DeltaQuest Reserve-Building (DQRB) measure’s [64] Occupational Complexity Index. Questions querying the job that was closest to the respondent’s current or past occupation were then scored for complexity using the Occupational Information Network (O*NET) system [65]. Under this comprehensive, in-depth job-classification system, scores range from low complexity (1) to high complexity (5)), with higher scores reflecting more training and skills required to perform that occupation [53].

Statistical analysis

Descriptive statistics summarized the sample demographic characteristics and scores on person-reported outcomes. The COVID-specific variables were evaluated by factor analysis to assess dimensionality of the items within each presumed construct. Alpha reliability coefficients were used to determine whether the internal consistency of the resulting scores were sufficiently reliable for use in multivariate models [66]. Scores were computed as the mean of items with related content multiplied by the number of items in the domain. All COVID-specific variables were transformed to Z scores on the whole sample to facilitate comparison among them and between subsamples. Pearson correlations addressed associations between COVID-specific variables.

Analysis of Variance (ANOVA) models were computed to compare the demographic characteristics of participants across the race groups with at least 26 members (i.e., power to detect at least a large effect size (ES) [67]), and to compare PRO scores by race group (a nominal variable tracking White (1), Black (2), Asian (3), American Indian (4), and Multiple Races (5)). T-tests were used to compare the demographic characteristics and person-reported outcome (PRO) scores of Hispanic versus Non-Hispanic participants. Descriptive statistics were used to illustrate the intersectionality of race and ethnicity, to reflect the multi-racial nature of the study sample, and to summarize the distributions of the PROs used in the present study.

To address selection biases, t-tests were used to compare the demographic characteristics and PRO scores of those missing and not-missing race information. Additionally, we compared the study sample to US census data on gender, age, and US state and region.

Correlation and multivariate linear regression were used to investigate the associations between COVID-specific variables and DQ Wellness. Initial models utilized the whole sample, testing for COVID-specific variables’ effects on DQ Wellness with and without race (i.e., in the second model, dummy variables were included for race/ethnicity groups). Due to small numbers in the different race groups, we had insufficient power to test for interactions with specific race groups in the multivariate models. Additionally, these models suggested collinearity issues and/or suppression due to race/ethnicity differences, so we decided to test for relationships in separate models that stratified by race/ethnicity. For the purpose of these multivariable analyses, the non-White group included Blacks, Asians, American Indians, and Hispanics. Two sets of models were thus computed: one set of models included the whole sample and stratified by race/ethnicity (i.e., divided into Whites Only vs. Non-Whites Only); a second set of models focused on the propensity-matched samples and stratified by race/ethnicity (i.e., Whites Only vs. Non-Whites Only). The propensity-matched-cohort analysis [68] used the SPSS Propensity Score Matching procedure that includes a FUZZY extension command and aligned the two subsamples (Match Tolerance 0.02) on the following demographic characteristics: age, body mass index, total number of comorbidities, gender, whether the person lived alone, marital status, employment status, occupational complexity, education, smoking status, and time since diagnosis. The FUZZY extension command has several features, including using separate case and control datasets as input, matching on a set of variables without the intermediate logistic regression, and matching multiple controls with each case [68]. The extent of match was assessed by comparing White vs. Non-White group differences on the above covariates using one-way ANOVAs. By having both sets of models, we would thus be able to ascertain what demographic factors were relevant in the Whites Only vs. Non-Whites Only groups, and determine whether matching on these variables modified results.

Both sets of models began with forward stepwise regression selecting among the COVID-specific variables, and then included demographic variables along with the COVID-specific variables. A separate model testing only demographics was included to provide a comparison of explained variance by demographic, COVID-specific, and full models. The following demographic characteristics were considered: age, gender, body mass index, number of comorbidities, educational achievement, occupational complexity, whether the person lived alone, smoking status, time since diagnosis, and Sars Cov-2 infection status.

Due to the relatively large sample sizes and the number of variables examined in the present analyses, we focused on ES of the relevant statistics generated (e.g., beta coefficient (β) for linear models) rather than p-value as the criterion for determining relevance of the variables examined. This approach focuses more on the clinical importance, rather than capitalizing on chance significance due to multiple comparisons. We relied on Cohen’s criteria for small, medium, and large ES for interpretation [69]. IBM SPSS version 28 [69] was used for all analyses.

Results

Sample

Ninety-four percent of the sample endorsed only one race group, 2% endorsed two race groups, 0.3% endorsed three, 0.1% endorsed 4, and 4% did not provide information on race (data not shown). Table 1 provides sociodemographic characteristics on the sample by race and ethnicity groups, after excluding race categories with fewer than 26 people. Table 2 provides the statistical comparisons of the ethnicity / race groups in the sample.

Table 2 Sample Demographic Characteristics (N = 4816)

In the sample, 7% of Whites, 11% of Blacks, 6% of Asians, and 6% of American Indians indicated that they had been infected with Sars Cov-2 (p < 0.0001, medium ES; Table 1). There were statistically significant differences by race on all demographics except whether the person received help completing the survey (Table 2). Age and total number of comorbidities were small ES differences. Medium ES differences were detected for Sars Cov-2 infection status, role, gender, difficulty paying bills, employment status, education, and smoking status. Large ES differences were found for living alone and marital status. All others were negligible effect-sizes.

The analyses comparing Hispanics and Non-Hispanics revealed statistically significant differences on all but five demographic characteristics. There were small ES differences on role, living alone, education, smoking status, receiving help to complete the survey, and Sars Cov-2 infection status. There were medium ES differences on difficulty paying bills and employment status. There were large ES differences on age.

Selection bias and data quality

Analyses comparing those participants with and without race information revealed small ES differences in age and gender, and a large ES difference in role (Table 2). Missing race group was associated with being Hispanic although not fully explained by such (Phi = 0.26, p < 0.001, data not shown). Comparisons of PRO scores and distributions between Missing vs. Not-Missing race groups generally revealed similar magnitudes of the skewness statistics, although those Not Missing Race had a notably more positively skewed distribution for Financial Impact on Family (Additional file 1: Table 2). Although PRO comparisons by Missing vs. Not-Missing on race group revealed large ES differences on Financial Impact on Family and Inadequate Access to Healthcare (Additional file 1: Table 3), box-and-whisker plots and bar charts revealed that the Missing Race group’s average score tended to be similar to the other Non-White race groups (Figs. 1 and 2 a-i). A comparison between the study sample and US census data revealed that the study sample was 3 years older on average, and included a much larger proportion of women (82% vs. 51%; Additional file 1: Table 4). Although relatively balanced across US regions, the study sample over-represented people in the South, and under-represented people in the West. These selection-bias analyses suggest that the study participants who were missing race data were not notably different from those not missing race information, but they were older, more likely to be female, and over-represented the southern US.

Table 3 Intercorrelations of DQ Wellness and COVID-Specific Variables
Fig. 1
figure 1

Box and whisker plot showing means and 95% confidence intervals of DQ Wellness scores by race group. Although on average, all participants had negative DQ Wellness scores indicating poor levels of wellness, those with the worst scores were those endorsing multiple races

Fig. 2
figure 2

ai. Bar chart of racial group differences on COVID-specific variable mean scores. There were marked differences on average levels of all variables compared to Whites

Table 4 Multivariate Linear Models of COVID-Specific Impact on DQ Wellness by Race Grouping

COVID-specific variable characteristics

On the COVID-related variables, the most internally consistent scores were Financial Impact on Family, Post-traumatic Growth, Inadequate Access to Health care, and Interpersonal Conflict (α = 0.90, 0.82, 0.77, and 0.76, respectively; Additional file 1: Table 1). Lack of Money, Worry about Self, Social Support, and Coping with Lockdown had somewhat lower internal consistency but were retained in the subsequent analyses because they contained unique information not captured by the other scores (α = 0.67, 0.62, 0.58, and 0.57, respectively).

It was notable that all groups had on average negative wellness scores, meaning that they were below the mean for the norm-referenced sample (Additional file 1: Table 2, Fig. 1). The skewness statistics indicate that while the DQ Wellness score, Post-Traumatic Growth, and Worry about Self were not skewed, several COVID-specific variables had moderate or high skewness in most or all race groups. Coping with Lockdown had a preponderance of high scores among Asians and American Indians (skewness = − 0.56 and − 1.23. respectively). Social support had a preponderance of high scores among Whites and Asians (skewness = − 0.66 and − 0.56, respectively). Interpersonal Conflict, Financial Impact on Family, Lack of Money, Inadequate Access to Healthcare, and Housing Instability had a preponderance of low scores among all groups. Comparisons of Hispanic vs. Non-Hispanic generally revealed similar magnitudes of the skewness statistics, although Non-Hispanics had a notably more positively skewed distribution for Financial Impact on Family and Lack of Money, reflecting a preponderance of low scores on these variables.

Intercorrelations

Pearson intercorrelations of DQ Wellness and the COVID-specific variables revealed medium ES correlations with five of the COVID-specific variables, suggesting that higher wellness was associated with higher levels of Coping with Lockdown, Social Support, and Post-traumatic Growth, and lower levels of Interpersonal Conflict and Worry about Self (Table 3). It had small ES, negative correlations with Financial Impact on Family, Lack of Money, and Inadequate Access to Healthcare. It was unrelated to Housing Instability.

The other COVID-specific variables generally had small ES correlations in the expected direction (i.e., psychosocial resources had positive intercorrelations with each other and negative intercorrelations with stress-related variables, and stress-related variables were positively associated with one another; Table 3). Housing Instability was unrelated to all but Lack of Money, and Post-traumatic Growth was unrelated to all of the stress-related variables.

Unadjusted group differences

There were no raw differences between race groups in DQ Wellness, Worry about Self, or Housing Instability (Additional file 1: Table 3). Among those COVID-specific variables with significant unadjusted ANOVAs comparing race groups, the eta-squared statistics reflected small ES for Post-Traumatic Growth, Financial Impact on Family, and Lack of Money (eta2 at least 0.02). There were large ES differences between Hispanics and Non-Hispanics on Coping with Lockdown, Post-Traumatic Growth, Interpersonal Conflict, Worry about Self, Financial Impact on Family, Lack of Money, Inadequate Access to Healthcare, and Housing Instability (Cohen’s d at least 0.80) (Additional file 1: Table 3).

On average, all participants had negative DQ Wellness scores indicating poor levels of wellness, and those reported the worst scores were those endorsing multiple races (Fig. 1). The unadjusted group differences were not, however, statistically significant (Additional file 1: Table 3).

There were marked differences on average levels of all variables comparing Whites and Non-Whites, with statistically significant differences found for all but Worry about Self and Housing Instability (Figs. 2 a-i; Additional file 1: Table 3). In general, Non-Whites reported much lower levels of Social Support, higher levels of Financial Impact on Family, Lack of Money, Inadequate Access to Healthcare, and Housing Instability. In contrast, Asians reported much higher levels of Coping with Lockdown compared to other Non-Whites, and Blacks reported much lower levels of Interpersonal Conflict and Worry about Self compared to Non-Whites. Non-Whites reported much higher levels of Post-traumatic Growth than Whites.

Hispanics had notably worse scores on Coping with Lockdown, Interpersonal Conflict, Worry about Self, Financial Impact on Family, Lack of Money, Inadequate Access to Healthcare, and Housing Instability (Fig. 3). They had notably better scores on Post-traumatic Growth than Non-Hispanics.

Fig. 3
figure 3

PRO Score Differences by Hispanic vesus Non-Hispanic. Statistically significant differences are indicated by an asterisk above the bars

Multivariate comparisons

The whole-sample full models retained the same COVID-specific variables as the matched-cohort analysis, with generally similar ES magnitude of the beta (β) coefficients. Coping with Lockdown, Social Support, and Post-traumatic Growth were associated with higher levels of wellness in both Whites and Non-Whites, while Interpersonal Conflict and Worry about Self were associated with lower levels of Wellness (top half of Table 4). The Whites-only model also retained Lack of Money, although its ES was negligible (Table 4). A notable difference between the two whole-sample models was what demographic factors were retained. Both retained number of comorbidities, and the Whites had a negligible ES while the Non-Whites had a small ES. The Whites-Only model also retained seven other covariates, for which only age had a non-negligible ES suggesting that older participants reported higher wellness, after adjusting for all other variables. The only covariate retained in the Non-Whites model other than comorbidities was occupational complexity, which had a negligible ES after adjusting for all the other variables in the model.

The propensity matching was effective in aligning the White and Non-White groups on 9 of the 11 demographic and health status characteristics, in contrast to 4 of the 11 in the unmatched subset of the sample (Additional file 1: Table 5). We were able to match 12.7% of Whites and 73.6% of Non-Whites. The lower matching ratio in the White sample is because of the large differences in demographic and health-status characteristics between the White and Non-White samples (Tables 1 and 2). By focusing on a close match (matching tolerance of 0.02), we effectively reduced the sample size and thus power in the propensity-matched analyses. Retaining 73.6% of Non-Whites is justified due to the strict matching tolerance and differences in the demographic and health status characteristics across the groups. We were, however, able to retain a large proportion of the Non-White sample.

Figure 4 shows mean comparisons of COVID-specific variables for Whites vs. Non-Whites in the propensity-matched groups. There were small ES differences in explained variance (eta2) for Social Support, Post-traumatic Growth, Financial Impact on Family, Lack of Money, and Inadequate Access to Healthcare. Results of the propensity-matched cohort regressions were very similar to the whole-sample analyses (bottom half of Table 4). The retained COVID-specific variables were identical and had comparable beta coefficients, both in magnitude and direction. The comorbidities variable was retained in both Whites and Non-Whites models, with similar coefficients. Smoking status (for Whites) and Occupational Complexity (for Non-Whites) were retained with negligible ES. Explained variance in the full models was similar albeit slightly higher compared to the whole-sample analysis.

Fig. 4
figure 4

COVID-specific variables by racial grouping: Cohorts matched on propensity scores. Asterisks indicate group comparisons with eta2 of at least a small ES (i.e., ≥ 0.01)

In the whole-sample models, COVID-specific variables explained substantially more variance than demographics, and the full models in Whites and Non-Whites explained about half of the variance (Additional file 1: Table 6). Thus, although mean levels of the COVID-specific variables differed between race groups, their impact on wellness was similar across groups.

Discussion

Our findings suggest that COVID-specific variables show similar relationships with wellness across racial groups, after adjusting for relevant covariates. Positive resources such as coping with lockdown, social support, and post-traumatic growth, are associated with higher levels of wellness, whereas interpersonal challenges and worry are associated with lower levels of wellness. Even matching the groups on demographic variables in the propensity-matched analysis yielded similar results to the whole-sample, despite the potential for losing power and variability. These similar relationships between COVID-specific stressors and wellness across all race groups underscore that race is a social construction, not a biological fact [52].

While the associations are similar, the average levels of COVID-specific variables differed across race / ethnicity groups. Non-Whites often reported worse levels of some positive resources (e.g., social support) and more challenging levels of negative stressors (e.g., interpersonal conflict, worry about self and family, lack of money, inadequate access to healthcare, and housing instability). These findings are consistent with a large body of research documenting the traumatic effects of racial discrimination and their cumulative impacts [70]. They are also consistent with research documenting that Non-Whites have lesser access to healthcare during COVID-19 [71, 72], and findings of excess mortality rates and premature deaths during COVID-19 for Non-Whites [73]. They are consistent with research documenting that Non-Whites had more difficulty procuring food and supplies during COVID-19 [72]. They jibe with documented evidence that during COVID-19, Non-White women [74] and Black men [75] suffer greater unemployment, and Non-White women experience more substantial losses in their work productivity than men or Whites in general [76]. Our findings underscore the race-related disparities in resources, including social support, healthcare and stable housing.

Our findings suggest, however, a source of resilience for Non-Whites. They reported much higher levels of post-traumatic growth, reflecting their ability to find the good in a difficult situation. Focusing on a renewed appreciation for sources of personal meaning and value, and particularly faith, seemed to buffer much of the COVID-related stress for Non-Whites. It was notable that post-traumatic growth was independent of all of the stress-related variables. In other words, post-traumatic growth co-exists as a distinct dimension from COVID-related stress in all measured domains.

While our study has clear advantages in terms of large sample size, collection of a comprehensive set of informative variables about COVID, and careful modeling, its limitations must be acknowledged. First, the sample had many more Whites than other races, which had the potential to dominate the results. To guard against this, we performed the matched-cohort analyses and confirmed the same findings in smaller, demographically matched samples. Second, although we had a sufficient number of Non-White respondents to compare to the large sample of White respondents, we had insufficient power to test for interactions with specific race groups in the multivariate models. Based on the plots shown in Fig. 2, it is possible that relationships that differed among Non-White race subgroups led to suppression in the multivariable model. Future research might test this study’s hypotheses using large enough racial group samples to be able to test for main effects and race-by-COVID-specific-subscale interactions in a full-sample model. Third, it is not possible to calculate a response rate given the participant-recruitment sources, so the generalizability of the findings is unknown. Nonetheless, the Ipsos comparison sample was specifically recruited to be representative of the adult population in the United States. Further, the selection-bias analyses suggest that the study findings are likely robust to any selection biases caused by missing race/ethnicity information and thus lend support to the generalizability of the findings. Fourth, the COVID-specific measures are based on recommended individual items from the National Institutes of Health rather than scales developed from rigorous psychometric testing. The scales had lower internal-consistency reliability than those commonly used in PRO research. Observed relationships may thus have been attenuated by this imprecision in measurement. Fifth, the models are built from cross-sectional data, and so any causal inference is limited. Future research might assess causality using similar models fashioned from longitudinal data. Finally, the data included in the present work was collected relatively early in the pandemic, and findings might evolve over time. Future work will consider data collected at other time points in the pandemic to address how peoples’ experiences of COVID might change and modify these relationships. For example, did post-traumatic growth peak early and thus have a reduced impact later in the pandemic?

Conclusion

In summary, although COVID was a source of worry and even conflict, it also unlocked people’s resources in many different ways—use of health-enhancing behavioral strategies, social support, and renewed gratitude for sources of personal meaning and value. Thus, behavioral- and emotion-focused coping clearly contributed to resilience, across all racial and ethnic groups in our sample. The similar relationships between Whites and Non-Whites on wellness and COVID-specific stressors across all race groups underscore that race is a social construction, not a biological fact. Focusing on a renewed appreciation for sources of personal meaning and value, and particularly faith, seemed to buffer much of the COVID-related stress for Non-Whites. Future research is needed to examine how these approaches to coping evolve over the course of the pandemic.

Availability of data and materials

The study data are confidential and thus not able to be shared.

Abbreviations

COVID:

Coronavirus disease 2019

ES:

Effect size

PRO:

Person-reported outcome

References

  1. Roser M (2022) Our world in data. https://ourworldindata.org/explorers/coronavirus-data-explorer. Accessed August 11 2022.

  2. World Health Organization (2022) Global excess deaths associated with COVID-19, January 2020 - December 2021. https://www.who.int/data/stories/global-excess-deaths-associated-with-covid-19-january-2020-december-2021. Accessed August 11 2022.

  3. Buheji M, da Costa Cunha K, Beka G, Mavric B, De Souza Y, da Costa Silva SS et al (2020) The extent of covid-19 pandemic socio-economic impact on global poverty: a global integrative multidisciplinary review. Am J Econ 10(4):213–224

    Article  Google Scholar 

  4. Mann DM, Chen J, Chunara R, Testa PA, Nov O (2020) COVID-19 transforms health care through telemedicine: evidence from the field. J Am Med Inform Assoc 27(7):1132–1135

    Article  PubMed  PubMed Central  Google Scholar 

  5. Hassan EM, Mahmoud HN (2021) Impact of multiple waves of COVID-19 on healthcare networks in the United States. PLoS ONE 16(3):e0247463

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  6. Umucu E, Lee B (2020) Examining the impact of COVID-19 on stress and coping strategies in individuals with disabilities and chronic conditions. Rehabil Psychol 65(3):193–198

    Article  PubMed  Google Scholar 

  7. Huizar MI, Arena R, Laddu DR (2020) The global food syndemic: The impact of food insecurity, Malnutrition and obesity on the healthspan amid the COVID-19 pandemic. Prog Cardiovasc Dis 64:105–107

    Article  PubMed  PubMed Central  Google Scholar 

  8. Coetzee BJ, s., & Kagee, A. (2020) Structural barriers to adhering to health behaviours in the context of the COVID-19 crisis: considerations for low-and middle-income countries. Glob Public Health 15(8):1093–1102

    Article  PubMed  Google Scholar 

  9. Rosenberg M, Luetke M, Hensel D, Kianersi S, Fu T-C, Herbenick D (2021) Depression and loneliness during April 2020 COVID-19 restrictions in the United States, and their associations with frequency of social and sexual connections. Soc Psychiatry Psychiatr Epidemiol. https://doi.org/10.1007/s00127-020-02002-8

    Article  PubMed  PubMed Central  Google Scholar 

  10. Luchetti M, Lee JH, Aschwanden D, Sesker A, Strickhouser JE, Terracciano A et al (2020) The trajectory of loneliness in response to COVID-19. Am Psychol 75(7):897–908

    Article  PubMed  PubMed Central  Google Scholar 

  11. Shek DT (2021) COVID-19 and quality of life: twelve reflections. Appl Res Qual Life 16(1):1–11

    Article  PubMed  PubMed Central  Google Scholar 

  12. Bryson WJ (2021) Long-term health-related quality of life concerns related to the COVID-19 pandemic: a call to action. Qual Life Res 30(3):643–645

    Article  PubMed  Google Scholar 

  13. Xiong J, Lipsitz O, Nasri F, Lui LM, Gill H, Phan L et al (2020) Impact of COVID-19 pandemic on mental health in the general population: a systematic review. J Affect Disord. https://doi.org/10.1016/j.jad.2020.08.001

    Article  PubMed  PubMed Central  Google Scholar 

  14. Taquet M, Geddes JR, Husain M, Luciano S, Harrison PJ (2021) 6-month neurological and psychiatric outcomes in 236 379 survivors of COVID-19: a retrospective cohort study using electronic health records. Lancet Psychiatry 8(5):416–427

    Article  PubMed  PubMed Central  Google Scholar 

  15. Singu S, Acharya A, Challagundla K, Byrareddy SN (2020) Impact of social determinants of health on the emerging COVID-19 pandemic in the United States. Front Public Health. https://doi.org/10.3389/fpubh.2020.00406

    Article  PubMed  PubMed Central  Google Scholar 

  16. Karmakar M, Lantz PM, Tipirneni R (2021) Association of social and demographic factors with COVID-19 incidence and death rates in the US. JAMA Netw Open 4(1):e2036462–e2036462

    Article  PubMed  PubMed Central  Google Scholar 

  17. Yehia BR, Winegar A, Fogel R, Fakih M, Ottenbacher A, Jesser C et al (2020) Association of race with mortality among patients hospitalized with coronavirus disease 2019 (COVID-19) at 92 US hospitals. JAMA Netw Open 3(8):e2018039–e2018039

    Article  PubMed  PubMed Central  Google Scholar 

  18. Vahidy FS, Nicolas JC, Meeks JR, Khan O, Pan A, Jones SL et al (2020) Racial and ethnic disparities in SARS-CoV-2 pandemic: analysis of a COVID-19 observational registry for a diverse US metropolitan population. BMJ Open 10(8):e039849

    Article  PubMed  PubMed Central  Google Scholar 

  19. Struyf T, Deeks JJ, Dinnes J, Takwoingi Y, Davenport C, Leeflang MM, et al. (2021) Signs and symptoms to determine if a patient presenting in primary care or hospital outpatient settings has COVID‐19. Cochrane Database Syst Rev (2).

  20. Çalıca Utku A, Budak G, Karabay O, Güçlü E, Okan HD, Vatan A (2020) Main symptoms in patients presenting in the COVID-19 period. Scott Med J 65(4):127–132

    Article  PubMed  Google Scholar 

  21. Daugherty SE, Guo Y, Heath K, Dasmariñas MC, Jubilo KG, Samranvedhya J et al (2021) Risk of clinical sequelae after the acute phase of SARS-CoV-2 infection: retrospective cohort study. BMJ. https://doi.org/10.1136/bmj.n1098

    Article  PubMed  Google Scholar 

  22. Beck MJ, Hensher DA (2020) Insights into the impact of COVID-19 on household travel and activities in Australia-The early days under restrictions. Transp Policy 96:76–93

    Article  Google Scholar 

  23. Constandt B, Thibaut E, De Bosscher V, Scheerder J, Ricour M, Willem A (2020) Exercising in times of lockdown: an analysis of the impact of COVID-19 on levels and patterns of exercise among adults in Belgium. Int J Environ Res Public Health 17(11):4144

    Article  CAS  PubMed Central  Google Scholar 

  24. Lesser IA, Nienhuis CP (2020) The impact of COVID-19 on physical activity behavior and well-being of Canadians. Int J Environ Res Public Health 17(11):3899

    Article  CAS  PubMed Central  Google Scholar 

  25. Ammar A, Mueller P, Trabelsi K, Chtourou H, Boukhris O, Masmoudi L et al (2020) Psychological consequences of COVID-19 home confinement: The ECLB-COVID19 multicenter study. PLoS ONE 15(11):e0240204

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  26. Ammar A, Mueller P, Trabelsi K, Chtourou H, Boukhris O, Masmoudi L, et al. (2020) Emotional consequences of COVID-19 home confinement: the ECLB-COVID19 multicenter study. medRxiv.

  27. Ammar A, Chtourou H, Boukhris O, Trabelsi K, Masmoudi L, Brach M et al (2020) COVID-19 home confinement negatively impacts social participation and life satisfaction: a worldwide multicenter study. Int J Environ Res Public Health 17(17):6237

    Article  CAS  PubMed Central  Google Scholar 

  28. Van der Vegt I, Kleinberg B (2020) Women worry about family, men about the economy: Gender differences in emotional responses to COVID-19. In: International Conference on Social Informatics, 2020. pp 397–409, Springer

  29. Zhou M, Guo W (2021) Social factors and worry associated with COVID-19: Evidence from a large survey in China. Soc Sci Med 277:113934

    Article  PubMed  Google Scholar 

  30. Witteveen D, Velthorst E (2020) Economic hardship and mental health complaints during COVID-19. Proc Natl Acad Sci 117(44):27277–27284

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  31. Banerjee D, Rai M (2020) Social isolation in Covid-19: the impact of loneliness. Int J Soc Psychiatry 66(6):525–527. https://doi.org/10.1177/0020764020922269

    Article  PubMed  PubMed Central  Google Scholar 

  32. Luetke M, Hensel D, Herbenick D, Rosenberg M (2020) Romantic relationship conflict due to the COVID-19 pandemic and changes in intimate and sexual behaviors in a nationally representative sample of American adults. J Sex Marital Ther 46(8):747–762

    Article  PubMed  Google Scholar 

  33. Polizzi C, Lynn SJ, Perry A (2020) Stress and coping in the time of covid-19: pathways to resilience and recovery. Clin Neuropsychiatry 17(2):59–62

    PubMed  PubMed Central  Google Scholar 

  34. Fiorenzato E, Zabberoni S, Costa A, Cona G (2021) Cognitive and mental health changes and their vulnerability factors related to COVID-19 lockdown in Italy. PLoS ONE 16(1):e0246204

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  35. Kawachi I, Subramanian SV, Kim D (2008) Social capital and health. In: Social Capital and Health. Pp 1–26, Springer.

  36. Hawe P, Shiell A (2000) Social capital and health promotion: a review. Soc Sci Med 51(6):871–885

    Article  CAS  PubMed  Google Scholar 

  37. Reich JW (2006) Three psychological principles of resilience in natural disasters. Disaster Prev Manag 15(5):793–798. https://doi.org/10.1108/09653560610712739

    Article  Google Scholar 

  38. Murayama H, Fujiwara Y, Kawachi I (2012) Social capital and health: a review of prospective multilevel studies. J Epidemiol. https://doi.org/10.2188/jea.JE20110128

    Article  PubMed  PubMed Central  Google Scholar 

  39. Song L (2013) Social capital and health. In: Medical Sociology on the Move, pp 233–257, Springer.

  40. Gilbert KL, Quinn SC, Goodman RM, Butler J, Wallace J (2013) A meta-analysis of social capital and health: a case for needed research. J Health Psychol 18(11):1385–1399

    Article  PubMed  PubMed Central  Google Scholar 

  41. Helgeson VS, Zajdel M (2017) Adjusting to chronic health conditions. Annu Rev Psychol 68:545–571

    Article  PubMed  Google Scholar 

  42. Croyle RT (1992) Appraisal of health threats: Cognition, motivation, and social comparison. Cogn Ther Res 16(2):165–182

    Article  Google Scholar 

  43. Folkman S, Lazarus RS, Gruen RJ, DeLongis A (1986) Appraisal, coping, health status, and psychological symptoms. J Pers Soc Psychol 50(3):571–570

    Article  CAS  PubMed  Google Scholar 

  44. Adams-Prassl A, Boneva T, Golin M, Rauh C (2020) Inequality in the impact of the coronavirus shock: evidence from real time surveys. J Public Econ 189:104245

    Article  Google Scholar 

  45. Parker K, Horowitz JM, Brown A (2020) About half of lower-income Americans report household job or wage loss due to COVID-19. In: Pew Res Center, 21.

  46. Quan D, Luna Wong L, Shallal A, Madan R, Hamdan A, Ahdi H et al (2021) Impact of race and socioeconomic status on outcomes in patients hospitalized with COVID-19. J Gen Intern Med 36(5):1302–1309

    Article  PubMed  PubMed Central  Google Scholar 

  47. Navar AM, Purinton SN, Hou Q, Taylor RJ, Peterson ED (2021) The impact of race and ethnicity on outcomes in 19,584 adults hospitalized with COVID-19. PLoS ONE 16(7):e0254809

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  48. Polyakova M, Udalova V, Kocks G, Genadek K, Finlay K, Finkelstein AN (2021) Racial disparities in excess all-cause mortality during the early COVID-19 pandemic varied substantially across states: study examines the geographic variation in excess all-cause mortality by race to better understand the impact of the COVID-19 pandemic. Health Aff 40(2):307–316

    Article  Google Scholar 

  49. Ramos AK, Lowe AE, Herstein JJ, Schwedhelm S, Dineen KK, Lowe JJ (2020) Invisible no more: the impact of COVID-19 on essential food production workers. J Agromedicine 25(4):378–382

    Article  PubMed  Google Scholar 

  50. Bhadra A, Mukherjee A, Sarkar K (2021) Impact of population density on Covid-19 infected and mortality rate in India. Model Earth Syst Environ 7(1):623–629

    Article  PubMed  Google Scholar 

  51. Rogers TN, Rogers CR, VanSant-Webb E, Gu LY, Yan B, Qeadan F (2020) Racial disparities in COVID-19 mortality among essential workers in the United States. World Med Health Policy 12(3):311–327

    Article  PubMed  PubMed Central  Google Scholar 

  52. Appiah A (1994) Race, culture, identity: Misunderstood connections (The Tanner Lectures on Human Values).

  53. Gannon M (2016) Race is a social construct, scientists argue. Sci Am 5:1–11

    Google Scholar 

  54. Onwuachi-Willig A (2016) Race and racial identity are social constructs. NY Times 6:2016

    Google Scholar 

  55. Sarich V, Miele F (2018) Race: The reality of human differences. Routledge, Milton Park, Abingdon-on-Thames, Oxfordshire, England

    Book  Google Scholar 

  56. Chatterji AK, Seamans RC (2012) Entrepreneurial finance, credit cards, and race. J Financ Econ 106(1):182–195

    Article  Google Scholar 

  57. Gilroy P (2000) Against race: imagining political culture beyond the color line. Harvard University Press, Cambridge, MA

    Google Scholar 

  58. NIH Office of Behavioral and Social Sciences Research (OBSSR), NIH Disaster Research program (DR2) (2020). COVID-19 BSSR Research Tools. 1st edn. NIH Office of Behavioral and Social Sciences Research (OBSSR), Bethesda, MD

  59. Tedeschi RG, Calhoun LG (1996) The posttraumatic growth inventory: Measuring the positive legacy of trauma. J Trauma Stress 9:455–471. https://doi.org/10.1002/jts.2490090305

    Article  CAS  PubMed  Google Scholar 

  60. Tedeschi RG, Cann A, Taku K, Senol-Durak E, Calhoun LG (2017) The posttraumatic growth inventory: a revision integrating existential and spiritual change. J Trauma Stress 30(1):11–18. https://doi.org/10.1002/jts.22155

    Article  PubMed  Google Scholar 

  61. Tedeschi RG, Moore BA (2020) Posttraumatic growth as an integrative therapeutic philosophy. J Psychother Integr. https://doi.org/10.1037/int0000250

    Article  Google Scholar 

  62. Schwartz CE, Stucky BD, Stark RB (2021) Operationalizing the attitudes, behaviors, and perspectives of wellness: a brief measure for use in resilience research. Health Psychol Behav Med 9(1):1031–1052. https://doi.org/10.1080/21642850.2021.2008940

    Article  PubMed  PubMed Central  Google Scholar 

  63. Integrated Postsecondary Education Data System Collecting Race and Ethnicity Data from Students and Staff Using the New Categories (2022) https://nces.ed.gov/ipeds/report-your-data/race-ethnicity-collecting-data-for-reporting-purposes. Accessed January 26 2022.

  64. Schwartz CE, Michael W, Zhang J, Rapkin BD, Sprangers MAG (2018) Assessing reserve-building pursuits and person characteristics: Psychometric validation of the DeltaQuest Reserve-Building Measure. Qual Life Res 27:423–436. https://doi.org/10.1007/s11136-017-1694-2

    Article  PubMed  Google Scholar 

  65. U.S. Department of Labor/Employment and Training Administration (USDOL/ETA) (1998) Occupational information network (O*NET) In: N. C. f. O. N. Development (Eds) U.S. Department of Labor/Employment and Training Administration (USDOL/ETA), Washington, D.C

  66. Reeve BB, Wyrwich KW, Wu AW, Velikova G, Terwee CB, Snyder CF et al (2013) ISOQOL recommends minimum standards for patient-reported outcome measures used in patient-centered outcomes and comparative effectiveness research. Qual Life Res 22(8):1889–1905. https://doi.org/10.1007/s11136-012-0344-y

    Article  PubMed  Google Scholar 

  67. Cohen J (1992) A power primer. Psychol Bull 112:155–159

    Article  CAS  PubMed  Google Scholar 

  68. Thoemmes F (2012) Propensity score matching in SPSS. arXiv preprint arXiv:1201.6385.

  69. IBM (2022) IBM SPSS statistics for windows, 28th edn. IBM Corp, Armonk, NY

    Google Scholar 

  70. Kirkinis K, Pieterse AL, Martin C, Agiliga A, Brownell A (2021) Racism, racial discrimination, and trauma: a systematic review of the social science literature. Ethn Health 26(3):392–412

    Article  PubMed  Google Scholar 

  71. Tai DBG, Shah A, Doubeni CA, Sia IG, Wieland ML (2021) The disproportionate impact of COVID-19 on racial and ethnic minorities in the United States. Clin Infect Dis 72(4):703–706

    Article  PubMed  Google Scholar 

  72. Ruprecht MM, Wang X, Johnson AK, Xu J, Felt D, Ihenacho S et al (2021) Evidence of social and structural COVID-19 disparities by sexual orientation, gender identity, and race/ethnicity in an urban environment. J Urban Health 98(1):27–40

    Article  PubMed  Google Scholar 

  73. Alsan M, Chandra A, Simon K (2021) The great unequalizer: Initial health effects of COVID-19 in the United States. J Econ Perspect 35(3):25–46

    Article  Google Scholar 

  74. Gezici A, Ozay O (2020) How race and gender shape COVID-19 unemployment probability. Available at SSRN 3675022.

  75. Moen P, Pedtke JH, Flood S (2020) Disparate disruptions: Intersectional COVID-19 employment effects by age, gender, education, and race/ethnicity. Work Aging Retire 6(4):207–228

    Article  PubMed  PubMed Central  Google Scholar 

  76. Staniscuaski F, Kmetzsch L, Soletti RC, Reichert F, Zandonà E, Ludwig Z et al (2021) Gender, race and parenthood impact academic productivity during the COVID-19 pandemic: from survey to action. Front Psychol. https://doi.org/10.3389/fpsyg.2021.663252

    Article  PubMed  PubMed Central  Google Scholar 

Download references

Acknowledgements

We are grateful to Wesley Michael, M.B.A., of Rare Patient Voice, LLC, and IPSOS-Insight, LLC, for facilitating access to participants; to Ariel Waldman for helpful discussions earlier in the manuscript development; and to the participants themselves who provided data for this project.

Funding

This work was not funded by an external organization.

Author information

Authors and Affiliations

Authors

Contributions

CES and BDR designed the research study. CES, BDR, and KB analyzed the data. CES wrote the paper, EB assisted with table preparation, and KB, EB, and BDS edited the manuscript. All authors read and approved the final manuscript.

Corresponding author

Correspondence to Carolyn E. Schwartz.

Ethics declarations

Ethics approval and Consent to participate

The protocol was reviewed and approved by the New England Independent Review Board (NEIRB #2021164).

Informed consent

All participants provided informed consent prior to beginning the survey.

Consent for publication

All participants agreed to their data being published in a journal article.

Competing interests

All authors declare that they have no potential conflicts of interest and report no disclosures.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Supplementary Information

Additional file 1. Table S1.

COVID-Specific Items and Scales. Table S2. Descriptive Statistics of Person-Reported Outcomes. Table S3. Unadjusted Group Comparisons on Person-Reported Outcomes. Table S4. Representativeness Checks. Table S5. Distribution of Covariates in the Matched Samples. Table S6. Comparison of Explained Variance by Demographics and COVID-specific Variables in Whole-Sample vs. Matched Cohort Analyses.

Rights and permissions

Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Schwartz, C.E., Borowiec, K., Biletch, E. et al. Race-related differences in the economic, healthcare-access, and psychological impact of COVID-19: personal resources associated with resilience. J Patient Rep Outcomes 6, 113 (2022). https://doi.org/10.1186/s41687-022-00514-2

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1186/s41687-022-00514-2

Keywords