Swedish translation and cross-cultural adaptation of eight pediatric item banks from the Patient-Reported Outcomes Measurement Information System (PROMIS)^®

Abstract

Background

This study is part of the Swedish initiative for the establishment of standardized, modern patient-reported measures for national use in Swedish healthcare. The goal was to translate and culturally adapt eight pediatric Patient-Reported Outcomes Measurement Information System (PROMIS^®) item banks (anger, anxiety, depressive symptoms, family relationships, fatigue, pain interference, peer relationships and physical activity) into Swedish.

Methods

Authorization to translate all currently available pediatric PROMIS item banks (autumn, 2016) into Swedish was obtained from the PROMIS Health Organization. The translation followed the Functional Assessment of Chronic Illness Therapy translation recommendations with one major modification, which was the use of a bilingual multi-professional review workshop. The following steps were applied: translation, reconciliation, a two-day multi professional reviewer workshop, back translation, and cognitive debriefing with eleven children (8–17 years) before final review. The bilingual multi-professional review workshop provided a simultaneous, in-depth assessment from different professionals. The group consisted of questionnaire design experts, researchers experienced in using patient-reported measures in healthcare, linguists, and pediatric healthcare professionals.

Results

All item banks had translation issues that needed to be resolved. Twenty-four items (20.7%) needed resolution at the final review stage after cognitive debriefing. The issues with translations included 1. Lack of matching definitions with items across languages (6 items); 2. Problems related to language, vocabulary, and cultural differences (6 items); and 3. Difficulties in adaptation to age-appropriate language (12 items).

Conclusions

The translated and adapted versions of the eight Swedish pediatric PROMIS item banks are linguistically acceptable. The next stage will be cross-cultural validation studies in Sweden. Despite the fact that there are cultural differences between Sweden and the United States, our translation processes have successfully managed to address all issues. Expert review groups from already-established networks and processes regarding pediatric healthcare throughout the country will facilitate the future implementation of pediatric PROMIS item banks in Sweden.

Background

The Patient Reported Outcome Measurement Information System (PROMIS) was established in 2004 with funding from the US National Institutes of Health (NIH), with the goal to “develop an efficient state-of-the-art assessment system for self-reported health.” PROMIS has now been used in research and clinical practice for over a decade, mostly with adult patients e.g. [5], but also with children and their parents (e.g. [7,8,9, 14, 16, 21].

PROMIS has been shown to have higher reliability, validity, and better sensitivity to symptom change than most legacy health measures [2, 4, 5, 12]. PROMIS uses item banks instead of traditional questionnaires. An item bank is a set of questions which measure the same underlying construct. One advantage of the item bank format is that the items can be presented to the respondent through computerized adaptive testing (CAT) [3, 19]. CAT adapts uniquely to each respondent based on previous responses. This method iteratively selects the most suitable items to complete to reach a high precision, which provides both precise and adequate information, and often results in fewer items to be answered and a reduced burden for the respondent.

The PROMIS system has a rapidly growing global coverage [2, 5], including Sweden [6, 17, 20]. PROMIS is utilized for a variety of clinical conditions, e.g., cancer, rheumatism, asthma, and sickle-cell disease [7, 13, 16, 21, 25].

In Sweden, a project to translate and culturally adapt PROMIS item banks to Swedish, including the pediatric banks, was launched in 2016. In Sweden, pediatric health questionnaires are widely used, but several have not been properly validated [22]. This study is part of the Swedish initiative to establish standardized modern patient reported measures for national use in Swedish healthcare, and aims to create a shared unified terminology and metric for reporting on common symptoms and functional life domains.

The main purpose of this study was to improve equity and quality of assessment and monitoring of health service delivery for children and adolescents with various medical conditions and psychiatric disorders by translating and culturally adapting eight pediatric PROMIS item banks for Swedish use.

Method

Authorization to translate the eight PROMIS pediatric item banks to Swedish was obtained from PROMIS Health Organization (PHO) in 2016 (see Table 1 for an overview). All items have unipolar verbal response scales, for example, the Depressive symptoms item banks provide five response alternatives: never, almost never, sometimes, often, almost always. The PROMIS organization offers pediatric item definition lists to aid translations by clarifying the concept behind each item [18]. Item definition lists were available for the following six out of eight item banks: Anger, Anxiety, Depressive symptom, Fatigue, Pain interference, and Peer relationships (definition lists were lacking for Family relationships and Physical activity).

Table 1 An overview of the pediatric PROMIS item banks translated to Swedish

The translation process followed the Functional Assessment of Chronic Illness Therapy (FACIT) translation methodology [11] with some modifications (see Table 2), and semantic/linguistic, content, and conceptual adaptation was performed [24]. After two independent forward translations were completed, any differences in the two translations were reconciled by the original translators and a third researcher. This version of the translation was then submitted to a multi-professional bi-lingual review group. This review group (a modification of the FACIT method [11], provided an in-depth assessment by different professionals simultaneously. The group consisted of questionnaire design experts, researchers experienced in using patient-reported measures in healthcare, linguists, and pediatric healthcare professionals. In total, 21 people from different geographical regions of Sweden participated. The group review was conducted in a two-day session which started with general information about PROMIS, test adaptation, and translation methodology. The group was then divided into four smaller subgroups, each responsible for reviewing 4–6 item banks. Individual reviewing by each group member was conducted before group discussions. Back translation was then carried out and a final review was made by the bilingual translation team. A member of the PROMIS organization (JC) reviewed each back-translated item to assess the equivalence of the source and target translation. A final report was written to document the development of each translation.

Table 2 Translation process (modified FACIT methodology)

Cognitive debriefing interviews

Cognitive debriefing interviews were carried out for all eight item banks by four researchers specifically trained in conducting these interviews. A cognitive interview manual was written in Swedish for guidance. The interviews were performed with eleven children of varied ages and gender (see Table 2). All children were fluent in Swedish. Think-aloud methodology and subsequent respondent debriefing were used [15]. In this approach, respondents are requested to think out loud while answering five to six questions (depending on the item bank), followed by a short interview about the relevant items.

The pre-final version of the questionnaire was completed by a small sample of the target population. All respondents received the item banks in the same order. Comprehensibility, relevance, acceptability, and feasibility of all questions were considered [24]. The respondents answered the full battery of questions over the Internet and were then asked how they perceived the questions and the on-line survey.

Data analyses

Both inductive and deductive methodologies (content analysis as per [23] were used to analyze the data qualitatively and simultaneously quantify the data. The number of items that belonged to each subtheme were counted, and it was noted when in the translation process the potential issues were found and how many times.

Results

Eight pediatric PROMIS item banks were translated to Swedish, and all of them had translation issues to be resolved. In total, the eight item banks consisted of 116 items, and 24 of these items (20.7%) were problematic for translation and required specific linguistic attention.

The translation problems were categorized into three themes: 1. Lack of matching definitions with items across languages (6 items), 2. Problems related to language, vocabulary, and cultural differences (6 items), and 3. Difficulties in adaption to age-appropriate language (12 items). Table 3 presents the themes and subthemes of translations issues with examples.

Table 3 Themes of translation issues

Lack of matching definitions with items across languages

We identified two subthemes of translation issues related to matching definitions with items across languages: 1. Equivocal items with precise definitions, i.e., the Swedish translation was more in accordance with the item definition in the definition list than the original English version; 2. Equivocal items without precise definitions, i.e., a lack of adequate definitions in the definition list made the item difficult to translate with precision.

Problems related to language, vocabulary, and cultural differences

We identified three subthemes of translation issues: 1. Adjectival agreement on intensity levels of the concept to be translated; here, the differing availability of appropriate Swedish adjectives had to be overcome; 2. Culturally-specific idiomatic phrases made nine items difficult to translate; 3. Cultural differences of measurements; i.e., distance, weights, and volume are measured differently both formally and informally in the two nations, which presented a problem in the translation process.

Difficulties in adaption to age-appropriate language

We identified two subthemes of translation issues: 1. Comprehensibility of the items changes in the translation process; an effort was made to harmonize items between age groups and make it comprehensive for all ages of respondents; 2. Acceptance of the items for all age groups; for example, the word “kid” was avoided in order to make the translation more acceptable for teenagers.

Discussion

Eight pediatric PROMIS item banks containing 116 items were translated to Swedish, out of which 24 items presented translational problems that needed to be resolved. After thorough adaptation and translation, using internationally standardized methods, acceptable translations were obtained for all items and were sent for further processing to the PROMIS organization. In our translation process, we identified some potential issues, including problems of cultural non-equivalencies.

First, it should be noted that the PROMIS organization provides item bank definitions for some but not all item banks. These definition lists were vitally important for the translation process and may even have led to greater precision in the meaning of an item as compared to the original English version.

Second, a general effort has been made in many pediatric questionnaires to include items perceived as relevant across the whole relevant age range, which is usually done in order to simplify administration of the questionnaires which otherwise would need multiple age range versions to reflect maturation of language, vocabulary, and developmental stages. Generic terms such as ‘child’ or ‘kid’ might be adequate to use even for teenagers in some languages, but in other languages, such as Swedish, it is not appropriate. The items in the pediatric banks are intended to be suitable for both children and adolescents (8–17 years), therefore, we replaced ‘kids’ with ‘others my age’.

Third, the hierarchy of the adjectives (e.g., ‘afraid’ and ‘scared’) is hard to retain without reference to a standardized calibration of the item location [1]. In the lack of such a reference, we used the item definition list [18].

Lastly, the translation process also led to decisions similar to those made in other language translations [8, 14] regarding measures of distance, time, and idiomatic phrases. Measures often need context and qualitative descriptions to be understandable. Idiomatic phrases are often difficult to understand and should be avoided.

Limitations

A possible limitation was that the cognitive debriefing took place in a single geographical area; hence, there is a risk of not reflecting the dialectal variations of the country. Richer data might have been obtained by including a larger representation of boys, younger children, and children from more diverse linguistic groups in the cognitive debriefing.

Our next step is to validate the item banks in community and patient samples, develop CAT, and perform differential item functioning (DIF) between English and Swedish in addition to other languages. The investigation of language-related DIF will enable us to evaluate the translation and cultural adaption process. With this knowledge, an additional goal will be to translate and culturally adapt more of the pediatric PROMIS item banks for children and parents into Swedish.

Using patient representatives in the development of the items is part of the philosophy of PROMIS (DeWalt, Rothrock, Yount, Stone, & Group, 2007). In the previous translation of the adult PROMIS items into Swedish, patient representatives were included in the review groups, which was beneficial to the whole process. The intention for future studies is to include children, adolescents, and caregivers in a similar way.

Conclusions

In conclusion, the translated and adapted versions of the eight Swedish pediatric PROMIS item banks are linguistically acceptable. Despite the fact that there are cultural differences between Sweden and the United States, our translation processes have successfully addressed the relevant issues.

In our study, we utilized the FACIT methodology for translation with some modifications. Expert review groups emanating from already established networks and processes regarding pediatric healthcare throughout the country will facilitate the future implementation of pediatric PROMIS item banks in Sweden.