Skip to main content

Transition of care in a Danish context: translation, cross-cultural adaptation and content validation of CTM-15 and PACT-M

Abstract

Background

Transition of care from hospitalisation to home is a complex process with potential patient safety risks, especially for patients with multimorbidity. Traditionally, the quality of transition of care has been evaluated primarily through readmission rates. However, interpreting the readmission rates presents challenges, and readmission rates fail to capture the patient’s perspective on the quality of the care transition. Insight into the patient’s experience with their care or a health service can be provided through the use of patient-reported experience measures (PREMs), and the two PREMs Care Transitions Measure 15 (CTM-15) and Partners at Care Transitions Measure part 1 and 2 (PACT-M1 and PACT-M2) assess on the quality of transition of care from the patients’ perspective. The aim of this study was to translate, culturally adapt, and assess content validity of CTM-15, PACT-M1, and PACT-M2 for Danish-speaking patients with multimorbidity.

Methods

A two-step approach was used for content validation, involving cognitive debriefing and interviews with patients, representing the target group, as well as quantitative data collection from healthcare professionals representing all three sectors of the Danish healthcare system. The patients were systematically interviewed regarding the aspects of content validity; comprehensibility, relevance, and comprehensiveness. The healthcare professionals assessed the relevance and comprehensiveness of each item through questionnaires, allowing the calculation of a content validity index (CVI). An item CVI ≥ 0.78 is considered good.

Results

The results of the qualitative data indicated that both CTM-15 and the PACT-M questionnaires were considered relevant, and comprehensible, and comprehensive to the target group. The CVI computed at item level determined that PACT-M1 and PACT-M2 demonstrated excellent content validity among the healthcare professionals, whereas the CVI for two items of the CTM-15 fell below the threshold value for “good”.

Conclusion

The Danish versions of the PACT-M questionnaires demonstrated good content validity, and the CTM-15 demonstrated acceptable content validity based on qualitative data from patients and quantitative data from healthcare professionals. Further validation of the questionnaires, by assessing their construct validity and reliability is recommended.

Plain English summary

In this study, we aimed to translate two questionnaires, CTM-15 and PACT-M, that address patients’ perspectives on the quality of transition of care, into Danish. Furthermore, we assessed their content validity i.e., their relevance, comprehensibility, and comprehensiveness. The study is important because we need to include the patients’ experiences in the overall evaluation of transition of care from hospital admission to home. This is possible through validated questionnaires. In order to investigate the content validity, it is important to include representatives of the target group, in this study patients with multimorbidity, as well as professional experts in the area. We interviewed patients about their perception of the relevance, comprehensibility, and comprehensiveness of the questionnaires. Additionally, we asked healthcare professionals about the relevance and comprehensiveness of the questionnaires. PACT-M demonstrated good content validity according to both patients and healthcare professionals. CTM-15 showed good content validity among patients, however, two items were not considered relevant by healthcare professionals. To ensure the usability of the questionnaires, further investigation into their construct validity, reliability, and responsiveness is necessary. Upon completion of the validation process, the questionnaires will be valuable tools in research projects aiming to improve the transition of care, as well as in quality monitoring and improvement initiatives.

Background

Transitions of care between hospitals and primary care settings are recognised as high risk scenarios for patient safety [1]. The process of transition of care from hospitalisation to home is a complex and multifaceted process with potential risks such as medication errors, insufficient care coordination, patient and caregiver uncertainty, heightened healthcare utilisation, and preventable readmissions [1,2,3]. Patients with multimorbidity, defined as living with two or more chronic conditions, are particularly susceptible to experiencing one or more of these adverse events [4,5,6,7].

Transitions of care are an integral part of a patient’s journey throughout a healthcare system, and refer to the various points where a patient moves to, or returns from, a particular physical location or makes contact with a healthcare professional for the purposes of receiving health care [1]. Transition of care can be defined as a set of actions designed to ensure the coordination and continuity of healthcare services as patients transfer between different locations or different levels of care within the same location [8].

To enhance transition of care and mitigate the risk of adverse events, it becomes essential to conduct a comprehensive and nuanced evaluation of the quality of these transitions.

Traditionally, the quality of transition of care has been gauged primarily through readmission rates [9, 10]. However, interpreting readmission rates presents challenges [11]. Relying solely on readmission rates hinder the ability to pinpoint specific aspects of the transition process requiring improvement, as these rates are influenced by the actions of various healthcare providers and factors related to the individual patient, including their primary medical condition, age, co-morbidities, health literacy, and social circumstances [9,10,11,12]. Moreover, readmission rates fail to capture the patient’s perspective on the quality of the care transition.

Evidence across different areas of healthcare indicates that patient experience is clinically important in investigating the quality in healthcare, alongside clinical effectiveness and patient safety [13]. Given the organisational fragmentation of much of healthcare and the numerous services with which many patients interact, the measurement of patient experience may help provide a ‘whole-system’ perspective [13].

Patient experience holds considerable importance in comprehending healthcare quality, and patient experience data, robustly collected and analysed, can shed light on both strengths and weaknesses in terms of effectiveness and safety [13]. There is increasing international attention regarding the use of patient-reported experience measures (PREMs) as a quality indicator of patient care and safety, and insight into the patient’s experience with their care or a health service, can be provided through the use of PREMs [14].

In a systematic review, seven measurement tools that assess transitional care quality from the patient’s perspective have been identified and appraised [15]. Among these, Care Transitions Measure-15 (CTM-15) and PACT-M are the most comprehensive in covering the transition of care process [16,17,18,19].

The CTM-15 and PACT-M have been translated and validated in several countries [20, 21]. However, whether these measures can assess the quality and safety of transitional care for patients with multimorbidity in Denmark has not been investigated. Therefore, the aims of this study were to translate and cross-culturally adapt the CTM-15 and the PACT-M questionnaires for use in a Danish-speaking population. Moreover, to assess and compare content validity of the two questionnaires in terms of relevance, comprehensibility and comprehensiveness among patients with multimorbidity, and among healthcare professionals.

Methods

Instruments

CTM-15

The original CTM-15 was developed in the USA in 2003 to assess the quality of care transitions across healthcare settings and to provide a better understanding of the care transition experiences from the patient’s perspective [17]. The objective was to create a metric that aligns with the principles of patient-centeredness, both in substance and methodology, and can be effectively utilized for performance measurement and public reporting [16]. The CTM-15 consists of four sections covering preferences taking into account at the hospital, preparations to leave the hospital, preparations on follow-up arrangements, and medication management.

PACT-M

The PACT-M was developed in the UK in 2019 with the aim of creating a tool to evaluate patient experiences during care transitions. Its purpose is to serve as an indicator of transitional care quality by assessing the patients’ experience of the transition process [18]. PACT-M covers both the immediate post-discharge period and the longer-term experience of managing health and care at home by examining the patients’ experience at two points of time; one week after discharge (using PACT-M1) and one month after discharge (using PACT-M2) [15].

The PACT-M comprehensively addresses eight components related to patients’ transitional care experience from hospital to home; patient involvement, medication management, discharge arrangements, coordination with other providers, providing information and guidance to patient/family, providing psychological and social support, anticipation and preparation for emergencies/deterioration, and feeling safe [18]. Furthermore, it incorporates a list of seven questions to capture potential care-related problems and adverse events commonly encountered by recently discharged patients [19].

Participants and setting

The study was conducted in Denmark at four wards at a medium sized hospital in Central Denmark Region. The study was carried out from November 2022 to March 2023.

Patients and inclusion procedure

We aimed to recruit patients who represented demographic diversity in terms of gender, age, and marital status to enhance the likelihood that the findings would be valuable and comprehensive [22, 23]. A priori, it was decided to interview at least seven patients, which is considered an appropriate number of patients according to the COSMIN Methodology [24].

The inclusion criteria for the study encompassed: multimorbidity, defined as living with two or more chronic conditions [7], individuals aged 18 years or older, patients who were planned to be discharged to their homes after being hospitalised for an acute medical condition, and finally, patients should be native speakers of the Danish language. Exclusion criteria were: Patients with mental disorders that impede their ability to understand and respond appropriately to the questions in the provided questionnaires, and individuals who were incapable of providing written and oral informed consent.

Eligible patients were identified by the treating clinicians in the ward. The clinician introduced the patients to the project. Patients who agreed to learn more about the project were contacted by MA and were informed about the project orally and in writing. Only patients, who provided oral and written consent for participation, were included in the project. Information about their age, education level, and cohabitation status was obtained. Information regarding the patient’s chronic conditions was obtained through a combination of patient inquiry and chart review. Furthermore, the patient’s score on the clinical frailty scale was assessed [25, 26]. The same inclusion and exclusion criteria were used for patient expert panel I and II.

Healthcare professionals

We included healthcare professionals from two different professions, medical doctors and nurses, from the three sectors of the Danish healthcare system; the hospital, the municipality, and general practitioners. To ensure the best possible evaluation, all healthcare professionals included in the study had experience within patients with multimorbidity and transition of care [24, 27].

Translation procedure

The translation procedure followed the ISPOR principles of Good Practice for the Translation and Cultural Adaption Process for Patient-Reported Outcomes (PRO) Measures in combination with the EORTC Quality of Life Group Translation Procedure [28, 29].

The process included the following steps: forward translation, reconciliation, back translation, back translation review, pre-testing, review of cognitive debriefing results and finalisation, proof reading, and final report of translation, including the final versions of the questionnaires [28, 29].

Before the translation, the instrument developers were contacted and granted permission for the translation of the questionnaires to Danish versions. The developer of CTM-15 did not participate in the process. The developers of PACT-M contributed to the process by addressing any uncertainties and providing additional considerations. In the forward translation, two native Danish speakers, one professional translator with experience within translating questionnaires, and one healthcare professional (MA), separately translated the English versions into Danish. The Danish versions were compared and reconciled into one by three native Danish speakers (the professional translator, LKN and MA). The translated versions were sent for back translation to two native speakers of English who had no knowledge of the original versions of the questionnaires. The back translations were reviewed and compared with the original version by LKN and MA, and the back translation of PACT-M was approved by the developers.

The pre-testing was conducted with patient expert panel I, who were all native speakers of Danish, and consisted of two parts:

  1. 1.

    Patients received and completed the three translated questionnaires

  2. 2.

    Debriefing. A researcher discussed the translation with the patients individually.

The debriefing was conducted in Danish, and the interviewing researcher was a native speaker of Danish. During the debriefing, the interviewing researcher (MA) went through each item of the questionnaires, asking the patient whether the translation was difficult to answer, confusing, difficult to understand or offensive. If the patient had any comments, the patient was invited to reword the question in a way that would be easier to understand, less confusing or less offensive. All comments were recorded on patient report sheets, and all comments were included in the review of the cognitive debriefing results.

Based on the cognitive debriefing results, final versions of the questionnaires were formulated by MA, CTM and LKN. MA and LKN proofread the questionnaires, and MA completed the final translation report.

Content validity assessment

The assessment of content validity followed the COSMIN methodology for assessing the content validity of PROMs [24]. Content validity is the degree to which the content of an instrument is an adequate reflection of the construct to be measured [30]. The construct in this study being “transition of care”. Content validity refers to the relevance, comprehensiveness, and comprehensibility of the instrument for the construct, target population, and context of use. A first aspect is face validity, which was assessed by MA, LKN, and DHC [31]. Content validity was assessed by asking patients and healthcare professionals about the relevance, comprehensiveness and comprehensibility of the items, response options, and instructions [31].

The content validity from the patient’s perspectives was investigated through qualitative methods in order to focus on the patient’s voice and reach a more in-depth insight of the patient’s thoughts and experiences with the content of the instruments [32].

The content validity among healthcare professionals was investigated through quantitative methods, which allowed for a more systematic and standardised evaluation of content validity, in order to be able to test the content validity index of the questionnaires.

Part 1 of both PACT-M questionnaires consists of seven questions to capture potential care-related problems and adverse events. These were not included in the assessment of the quality of the care transition itself. Therefore, we chose to pre-test these questions to ensure their comprehensibility, but we did not include them in the actual content validation process as they do not directly relate to the underlying construct, but rather pertain to actual events.

Content validity—patients

Procedure

To assess the content validity of the final Danish questionnaires from the patients’ perspective, cognitive interviewing was performed on a new patient group (patient expert panel II). The cognitive interviews were performed to uncover potential problems with encoding or retrieval of information [32]. The interview technique was retrospective probing where the probes were administered once all the survey questions had been answered [33]. A semi-structured interview guide was formulated by CTM, LKN and MA allowing for a more dynamic and responsive conversation while ensuring that essential topics were covered. The interview guide was based on the concepts of the COSMIN methodology for assessing the content validity of PROMs, focusing on relevance and comprehensiveness [24]. The patients were asked whether each item was relevant for them, considering their own experience with transition of care. Furthermore, the patients were asked whether the questionnaire as a whole seemed meaningful and if any key concepts were missing, in order to assess whether the items together comprehensively cover the construct. To assess the overall comprehensibility, the patients were asked if they found the instructions, the response options, and the recall period or timing of the questionnaire appropriate. The comprehensibility of each item was addressed previously through the questions targeting the translation.

The cognitive interviewing consisted of two parts at three different points of time. Part 2 was carried out in continuation of part 1:

  1. 1.

    The patient received and completed the translated questionnaire

  2. 2.

    A researcher interviewed the patient about the relevance, comprehensiveness and comprehensibility of the questionnaire.

The cognitive interviews were carried out in the following points of time:

  • CTM-15: at the day of discharge (T0)

  • PACT-M1: within one week from discharge (T1)

  • PACT-M2: within one month from discharge (T2).

The interviews were performed by MA, who were trained specifically for this study by an experienced qualitative researcher, CTM.

The interview at T0, was performed face-to-face with the patient at the ward before discharge. The cognitive interviews at T1 and T2 were planned to be performed at visits in the patient’s home, alternative at a location following the patients wish.

Analysis of interviews

All the interviews were recorded and transcribed verbatim. The qualitative data were managed in NVivo. Data from the interviews were analysed using a content analysis approach where content codes were sorted according to the aspects of content validity; relevance, comprehensiveness and comprehensibility [24]. All interview data were analysed after the last interview was conducted. The analyses were performed by MA and CTM with continuous input from and discussions with the research group.

The relevance, comprehensibility, and comprehensiveness of each questionnaire were assessed based on the analyses, thereby reflecting the content validity of the questionnaires from the patients’ perspective.

Content validity—healthcare professionals

Procedure

Questionnaires were administered electronically to 80 healthcare professionals from hospital, municipality, and general practice. If the questionnaire was not answered, a reminder was sent. A group of healthcare professionals at the hospital requested the possibility to answer the questionnaire on paper instead of electronically, which was accepted.

The healthcare professionals were asked about their job title and years of experience. They were then asked to read the CTM-15 and PACT-M carefully and subsequently to rate the relevance in terms of quality transition of care from hospital admission to home from the patients’ perspective of each item on a 4 point Likert scale from 1 (not relevant) to 4 (extremely relevant). Additionally, for each questionnaire they were asked whether they found any significant aspects to be missing.

Data analysis

To quantify the assessments of the healthcare professionals, the content validity index for each item (I-CVI) was computed. The I-CVI is the proportion of participants who rate the item as a 3 or 4 on the Likert scale. In addition, the average CVI (Ave-CVI), which represents the content validity of the overall instrument, was calculated by summing the I-CVIs for the instrument and dividing them by the number of items. An I-CVI ≥ 0.78 is considered good [34, 35], and the acceptable standard of Ave-CVI is 0.90 [34, 35].

Results

Face validity

MA, LKN and DHC assessed the face validity of the CTM-15 and PACT-M questionnaires as an overall view of the items, and established that the items seemed as an adequate reflection of the construct to be measured i.e., the quality of transition of care from the patients’ perspective.

Translation and cultural adaption

The Danish versions of CTM-15 and PACT-M were pre-tested among patient expert panel I of 13 patients, who represented a variability of ages, gender, and educational levels (Table 1). All pre-testings were performed face-to-face at the hospital on the day of discharge.

Table 1 Characteristics, patient expert panel I

The cultural adaptations that were necessary are described below. The items presented in italics represent the English source item, while those not in italics are the English translation of the Danish revision.

CTM-15

Item 2 “The hospital staff took my preferences and those of my family or caregiver into account in deciding what my health care needs would be when I left the hospital”. Some patients expressed that the question was lengthy and somewhat confusing. It was challenging because the original item is complex, and we would like to end up with an item that closely resembled the original item. Therefore, we only made slight modifications to maintain the closest possible alignment with the original item and yet make it more comprehensible to the patients.

Item 12 “When I left the hospital, I had a readable and easily understood written list of the appointments or tests I needed to complete within the next several weeks”. In the Danish healthcare system, patients are not typically provided with written lists of future appointments. Furthermore, it is not uncommon to be discharged from the hospital with a follow-up appointment scheduled three months (or longer) in the future. Consequently, we did not find the time frame “the next several weeks” entirely appropriate. To better reflect the reality of the Danish healthcare system, we modified the wording to what we found aligned with the content of the original item: “When I left the hospital, I had a good overview of my future appointments and tests”.

PACT-M1

Part 1, item 2 “Have you had any infections?”. In Danish, the direct translation of “infection” is a term mostly used by healthcare professionals rather than by layman. During the debriefing some of the patients asked for examples of infections. Following correspondence with the developers, we incorporated “novel infections” along with examples of infections “such as urinary tract infection or pneumonia” in order to make the question more precise. The examples were chosen, as they are common and well-known layman terms.

Part 1, item 6 “Have you had any problems getting essential healthcare supplies (like pads or prescribed feed)?” posed a challenge in translation, as there is no exact equivalent for “healthcare supplies” in Danish. Furthermore, “pads” is not relevant to mention in a Danish healthcare context as patients have to buy pads themselves at the pharmacy. Therefore, in agreement with the developers, we added the word “aids” in the item, and included examples relevant in a Danish context to provide patients with a clearer understanding of the term’s meaning. The final Danish item was: “Have you had any problems getting essential aids or healthcare supplies (like a walker or prescription nutritional supplements)?”

Part 2, item 5 “I understood how to get help or support from my community services (e.g. doctors, nurses, home care staff) if I needed it after returning home”. We decided that “doctors” must be written outside the bracket, as they are not part of community services in a Danish context. The Danish version of the item being: “I understood how to get help or support from my general practitioner or my community services (e.g., nurses and homecare staff) if I needed it after returning home”.

PACT-M2

Part 2, item 2 “I know how to manage my medicines”. We decided to clarify “manage my medicines” with the specification “how to obtain my medication, when to take it, and the correct dosage”.

Part 2, item 3 “I have the necessary support to manage everyday activities (e.g. cooking, cleaning, buying food, showering, walking, dressing)”. Some of the patients in the debriefing, who did not receive homecare support, were requesting a “not applicable” response option. However, the developers recommended not to. Instead, they suggested to encourage patients, who did not need homecare support, to answer “strongly agree”. Accordingly, we added “If you do not need support, please mark ‘strongly agree’.”.

Part 2, item 5 “I feel confident about managing my health at home”. The Danish wording of the direct translation of “managing my health” was criticised by several patients in the debriefing. Therefore, we contacted the Danish Language Council to obtain a correct and at the same time more user-friendly wording of the item. All adaptions and additions for PACT-M were approved by the developers. The Danish version of each questionnaire was finalised and proofread, and a translation report of each step and each decision made was drafted.

Content validity—patients

The cognitive interviews, which form the basis of the content validity assessment, were conducted among patient expert panel II including nine patients (Table 2). One of the interviews was conducted over the phone, all other interviews were conducted face-to-face, either in the hospital (at T0) or at the patient’s home (at T1 and T2).

Table 2 Characteristics, patient expert panel II

CTM-15

Overall, the patients found the items in the questionnaire to be relevant in assessing the transition of care from the patient’s perspective. A few patients found certain items to be irrelevant, while some suggested combining two or three questions into one (e.g., questions 13–15 about medication). The patients generally did not have any problems filling out the questionnaire.

The majority of the patients found the answer options appropriate, as the scale from strongly disagree to strongly agree was short and concise yet allowed for grading the response, and there was an option to select not applicable. However, most patients found the timing of the questionnaire challenging, as many items referred to activities that had not yet taken place or information not yet given at the time of the interview, as the respondents had not yet been discharged.

The patients found the items in the questionnaire to be comprehensive in describing their experience of transition of care. None of the respondents felt that there were areas of the transition of care that were not adequately covered in the questionnaire.

PACT-M1

Generally, the patients expressed that the items in the questionnaire were relevant in assessing the patient’s perspective on the transition of care. However, several patients who did not require homecare found the questions related to homecare to be irrelevant. Nonetheless, they also acknowledged the importance of including these questions as long as “not applicable” was an answer option. The patients found the questionnaire instructions to be comprehensive and easy to understand.

The majority of patients found the response options to be appropriate and useful in allowing them to indicate the extent to which they agreed or disagreed. Some patients requested a “don’t know/not applicable” option for all questions, as the agree/disagree scale may not be applicable to all respondents for all questions. This was particularly noted in questions regarding homecare. None of the patients expressed that the recall period was too long or in any way unsuitable for the statements in the questionnaire.

Additionally, the patients expressed that the questionnaire’s length and coverage of necessary aspects were adequate in describing the transition of care from the patient’s perspective.

PACT-M2

Several patients, who did not have the need for homecare, found that particularly item 3 “I have the necessary support to manage everyday activities (e.g. cooking, cleaning, buying food, showering, walking, dressing)”, which pertains to everyday support, was not relevant. Additionally, a few informants did not find item 8 “I feel I can now manage my care safely at home” relevant, as well. However, overall, the informants assessed the items as relevant for evaluating sector transitions from the patient’s perspective. The patients found the instructions for completing the questionnaire easy to understand.

The patients generally found the response options meaningful and appropriate for the items. Several patients indicated a need for a “not applicable” response category for statements regarding homecare. This was particularly mentioned for item number 3 “I have the necessary support to manage everyday activities (e.g. cooking, cleaning, buying food, showering, walking, dressing)” and was also noted for items 4 “I feel I have the support I need from community health services (e.g. doctors, nurses, homecare staff)” and 8 “I feel I can now manage my care safely at home”.

The majority of patients expressed that the items in the questionnaire were comprehensive, and there were no areas that were missing in order to assess the quality of transitions of care from the patients’ perspective.

Content validity—healthcare professionals

In total, 57 healthcare professionals completed the questionnaires, of these, 10 completed on paper, assessing the content validity of CTM-15 and PACT-M. The healthcare professionals represented two different professions, nurses and medical doctors, and were from all three sectors of the Danish healthcare system. The characteristics of the healthcare professionals are presented in Table 3, and the CVIs of the CTM-15, PACT-M1 and PACT-M2 are presented in Table 4.

Table 3 Characteristics, healthcare professionals
Table 4 Content validity indices

Discussion

In this study we aimed to translate, cross-culturally adapt, and assess the content validity of the two questionnaires, CTM-15 and PACT-M for use in a Danish-speaking population. The results of pre-testing and cognitive interviewing indicated that both CTM-15 and the PACT-M questionnaires were relevant, comprehensive, and comprehensible to the patients.

The analysis of the quantitative data collected from the healthcare professionals i.e., the CVI computed at both the item and scale levels determined that PACT-M1 and PACT-M2 demonstrated excellent content validity among the healthcare professionals, whereas the CVI for two items of the CTM-15 fell below the threshold value for “good”, resulting in the ave-CVI falling just below the “acceptable” threshold of 0.9.

While there are some similarities between the CTM-15 and PACT-M as they both overall focus on the quality of the transition of care from the patient’s perspectives, there are also some differences. CTM-15 is widely recognised and used through the last two decades, while PACT-M is newly developed. CTM-15 captures the quality of the transition of care at one point of time, while PACT-M addresses both the immediate quality as well as coping at home within the first month after discharge. In this study, both instruments were well-received among the patients and healthcare professionals. However, a few concerns were noted.

The majority of respondents found the timing of CTM-15 inappropriate. The cognitive interviews were performed at the hospital on the day of discharge. As several items could only be answered after leaving the hospital, in future use, the CTM-15 should be administered after discharge to avoid these challenges. Another concern was that the CVI for item 11 from CTM-15, “When I left the hospital, I was confident I could actually do the things I needed to do to take care of my health”, at 0.77 fell just below the threshold value for “good”, indicating that healthcare professionals did not find this item highly relevant. Furthermore, item 15 from CTM-15 “When I left the hospital, I clearly understood the possibleside effectsof each of my medications” obtained a lower CVI of 0.60, potentially due to the perception among healthcare professionals that expecting patients to comprehend all side effects of every medication was not realistic.

Furthermore, some patients expressed concerns about the items related to homecare in the PACT-M questionnaires, as these specific items were not applicable to their situations. This could be due to the fact that we were validating the questionnaires on a target population with younger patients compared to the original target population, which was likely to result in a higher proportion of patients who did not need homecare. One possible approach to address these patients’ concerns could be to enhance the validation and utilisation of PACT-M by incorporating a “not applicable” response option for items 3, 4, and 8 in PACT-M2. This modification would ensure that the response options make sense also for patients who do not need homecare. When comparing across countries that do not provide this response option, the “not applicable”-responses can be added to the “strongly agree”-responses, as suggested by the developers.

Although the study was performed on patients with multimorbidity who were admitted to the hospital due to an acute medical condition, the results may be applicable to other similar populations e.g., patients with multimorbidity who are admitted due to non-medical conditions, or patients with less than two chronic conditions.

The study demonstrates several strengths that contribute to the credibility of the findings. Firstly, there is a strong variation of patient demographics in both Patient Panel I and Patient Panel II, increasing the likelihood that the results are useful in the target population. Secondly, the participation of healthcare professionals from all sectors of the Danish healthcare system ensures that the included items are important to clinicians, and are considered relevant and comprehensive for assessing the intended construct. Furthermore, the interviews were conducted systematically, ensuring consistency in data collection. The analyses were also approached systematically, enhancing the rigor of the study. Additionally, the inclusion of both quantitative and qualitative data provides a comprehensive evaluation of the questionnaires.

However, certain limitations should be acknowledged. One limitation is the limited participation of municipal healthcare professionals. They are primarily responsible for patients after discharge, and more responses from municipal healthcare professionals would have added further strength to the validation. The timing of the cognitive interviews regarding CTM-15 can also be considered a limitation, as many items in the questionnaire referred to activities that had not yet taken place, making it challenging for the patients to evaluate the relevance of the items.

Conclusion

In this study we have developed Danish versions of the CTM-15, PACT-M1, and PACT-M2. Minor cultural adaptations were made during the translation procedure to ensure the questionnaires are suitable for adult patients with multimorbidity in the Danish healthcare system.

Furthermore, we have investigated the relevance, comprehensibility, and comprehensiveness of the questionnaires, and the findings indicate that both questionnaires effectively measure the intended construct, establishing their content validity in a Danish context.

The PACT-M questionnaires showed good content validity among patients as well as among healthcare professionals. However, we suggest adding the “not applicable” answer option in PACT-M2 items 3, 4 and 8 in the further validation process in a Danish context.

Overall, we consider the content validity of CTM-15 to be acceptable, given that patients found it relevant, comprehensible and comprehensive, and only two items achieved a low I-CVI from the healthcare professionals. Consequently, we recommend retaining all items in CTM-15 and allowing ongoing validation processes to determine whether a shortened version of CTM-15 would be more suitable in a Danish context.

Further validation of both CTM-15 and PACT-M in order to investigate their construct validity, reliability, and responsiveness is needed.

The fully validated instruments will have the potential to provide valuable insights into the patients’ experiences of the transition of care. This will be highly relevant in future research projects aiming at investigating and improving transition of care. Additionally, the instruments can be utilised to identify target groups for interventions aiming at transition of care, quality monitoring, or improvement projects.

Data availability

The data described in this article is not publicly available in further detail beyond that provided in the manuscript.

References

  1. WHO (2016) Transitions of care: technical series on safer primary care. World Health Organization, Geneva

    Google Scholar 

  2. Coleman EA (2003) Falling through the cracks: challenges and opportunities for improving transitional care for persons with continuous complex care needs. J Am Geriatr Soc 51(4):549–555

    Article  PubMed  Google Scholar 

  3. Goldstein JN, Hicks LS, Kolm P, Weintraub WS, Elliott DJ (2016) Is the care transitions measure associated with readmission risk? Analysis from a single academic center. J Gen Intern Med 31(7):732–738

    Article  PubMed  PubMed Central  Google Scholar 

  4. Boyd CM, Fortin M (2010) Future of multimorbidity research: how should understanding of multimorbidity inform health system design? Public Health Reviews 32(2):451–474

    Article  Google Scholar 

  5. Schiotz ML, Stockmarr A, Host D, Glumer C, Frolich A (2017) Social disparities in the prevalence of multimorbidity - a register-based population study. BMC Public Health 17(1):422

    Article  PubMed  PubMed Central  Google Scholar 

  6. Barnett K, Mercer SW, Norbury M, Watt G, Wyke S, Guthrie B (2012) Epidemiology of multimorbidity and implications for health care, research, and medical education: a cross-sectional study. Lancet 380(9836):37–43

    Article  PubMed  Google Scholar 

  7. WHO (2016) Multimorbidity: technical series on safer primary care. World Health Organization, Geneva

  8. Coleman EA, Boult C (2003) Improving the quality of transitional care for persons with complex care needs. J Am Geriatr Soc 51(4):556–557

    Article  PubMed  Google Scholar 

  9. Burke RE, Kripalani S, Vasilevskis EE, Schnipper JL (2013) Moving beyond readmission penalties: creating an ideal process to improve transitional care. J Hosp Med 8(2):102–109

    Article  PubMed  Google Scholar 

  10. Brock J, Jencks SF, Hayes RK (2021) Future directions in research to improve care transitions from hospital discharge. Med Care 59(Suppl 4):S401–S4

    Article  PubMed  PubMed Central  Google Scholar 

  11. Genindlæggelser af ældre i (2009) Danmark 2008 - Nye Tal Fra Sundhedsstyrelsen. Sundhedsstyrelsen; 24 June 2009.

  12. Naylor MD, Shaid EC, Carpenter D, Gass B, Levine C, Li J et al (2017) Components of comprehensive and effective transitional care. J Am Geriatr Soc 65(6):1119–1125

    Article  PubMed  PubMed Central  Google Scholar 

  13. Doyle C, Lennox L, Bell D (2013) A systematic review of evidence on the links between patient experience and clinical safety and effectiveness. BMJ Open 3(1)

  14. Weldring T, Smith SM (2013) Patient-reported outcomes (PROs) and patient-reported outcome measures (PROMs). Health Serv Insights 6:61–68

    PubMed  PubMed Central  Google Scholar 

  15. Yoshimura M, Sumi N (2022) Measurement tools that assess the quality of transitional care from patients’ perspective: a literature review. Jpn J Nurs Sci 19(3):e12472

    Article  PubMed  Google Scholar 

  16. Coleman EA, Mahoney E, Parry C (2005) Assessing the quality of preparation for posthospital care from the patient’s perspective: the care transitions measure. Med Care 43(3):246–255

    Article  PubMed  Google Scholar 

  17. Coleman EA, Smith JD, Frank JC, Eilertsen TB, Thiare JN, Kramer AM (2002) Development and testing of a measure designed to assess the quality of care transitions. Int J Integr Care 2:e02

    Article  PubMed  PubMed Central  Google Scholar 

  18. Oikonomou E, Chatburn E, Higham H, Murray J, Lawton R, Vincent C (2019) Developing a measure to assess the quality of care transitions for older people. BMC Health Serv Res 19(1):505

    Article  PubMed  PubMed Central  Google Scholar 

  19. Oikonomou E, Page B, Lawton R, Murray J, Higham H, Vincent C (2020) Validation of the partners at care transitions measure (PACT-M): assessing the quality and safety of care transitions for older people in the UK. BMC Health Serv Res 20(1):608

    Article  PubMed  PubMed Central  Google Scholar 

  20. Flink M, Tessma M, Cvancarova Smastuen M, Lindblad M, Coleman EA, Ekstedt M (2018) Measuring care transitions in Sweden: validation of the care transitions measure. Int J Qual Health Care 30(4):291–297

    Article  PubMed  PubMed Central  Google Scholar 

  21. Liu LM, Liu MT, Sun MJ, Wang JN, Lin BL, Wang P, Li QF (2021) Validity and reliability of the Chinese version of the partners at care transitions measure. BMC Health Serv Res 21(1):1284

    Article  PubMed  PubMed Central  Google Scholar 

  22. Patrick DL, Burke LB, Gwaltney CJ, Leidy NK, Martin ML, Molsen E, Ring L (2011) Content validity–establishing and reporting the evidence in newly developed patient-reported outcomes (PRO) instruments for medical product evaluation: ISPOR PRO good research practices task force report: part 2–assessing respondent understanding. Value Health 14(8):978–988

    Article  PubMed  Google Scholar 

  23. Beatty PC, Willis GB (2007) Research synthesis: the practice of cognitive interviewing. Pub Opin Q 71(2):287–311

    Article  Google Scholar 

  24. Terwee CB, Prinsen CAC, Chiarotto A, Westerman MJ, Patrick DL, Alonso J et al (2018) COSMIN methodology for evaluating the content validity of patient-reported outcome measures: a Delphi study. Qual Life Res 27(5):1159–1170

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  25. Fournaise A, Nissen SK, Lauridsen JT, Ryg J, Nickel CH, Gudex C et al (2021) Translation of the updated clinical frailty scale 2.0 into Danish and implications for cross-sectoral reliability. BMC Geriatr 21(1):269

    Article  PubMed  PubMed Central  Google Scholar 

  26. Nissen SK, Fournaise A, Lauridsen JT, Ryg J, Nickel CH, Gudex C et al (2020) Cross-sectoral inter-rater reliability of the clinical frailty scale - a Danish translation and validation study. BMC Geriatr 20(1):443

    Article  PubMed  PubMed Central  Google Scholar 

  27. Terwee CB, Prinsen C, Chiarotto A, de Vet HC, Bouter LM, Alonso J et al (2018) COSMIN methodology for assessing the content validity of PROMs

  28. Wild D, Grove A, Martin M, Eremenco S, McElroy S, Verjee-Lorenz A, Erikson P (2005) Principles of good practice for the translation and cultural adaptation process for patient-reported outcomes (PRO) measures: report of the ISPOR task force for translation and cultural adaptation. Value Health 8(2):94–104

    Article  PubMed  Google Scholar 

  29. EORTC Quality of Life Group (2017) EORTC quality of life group translation procedure eortc.org European organisation for research and treatment of cancer (updated 2017). 4th. https://www.eortc.org/app/uploads/sites/2/2018/02/translation_manual_2017.pdf

  30. Mokkink LB, Terwee CB, Patrick DL, Alonso J, Stratford PW, Knol DL et al (2010) The COSMIN study reached international consensus on taxonomy, terminology, and definitions of measurement properties for health-related patient-reported outcomes. J Clin Epidemiol 63(7):737–745

    Article  PubMed  Google Scholar 

  31. De Vet HCW, Terwee CB, Mokkink LB, Knol DL (2011) Measurement in medicine: a practical guide. Cambridge: Cambridge University Press, x, 338s p

  32. Leidy NK, Vernon M (2008) Perspectives on patient-reported outcomes: content validity and qualitative research in a changing clinical trial environment. PharmacoEconomics 26(5):363–370

    Article  PubMed  Google Scholar 

  33. D’Ardenne J (2014) In: Collins D (ed) Developing interview protocols. NatCen, Cognitive Intervewing Practice

  34. Almanasreh E, Moles R, Chen TF (2019) Evaluation of methods used for estimating content validity. Res Social Adm Pharm 15(2):214–221

    Article  PubMed  Google Scholar 

  35. Polit DF, Beck CT (2006) The content validity index: are you sure you know what’s being reported? Critique and recommendations. Res Nurs Health 29(5):489–497

    Article  PubMed  Google Scholar 

Download references

Acknowledgements

The authors would like to thank all participants, patients as well as healthcare professionals, for their contribution to the study. Furthermore, we would like to thank the Danish Language Council for their proficient and helpful guidance.

Funding

Department of Internal Medicine, Viborg Regional Hospital. Clinical Academic Community Multimorbidity, Regional Hospital Central Jutland. Regional Hospital Central Jutland Research Fund.

Author information

Authors and Affiliations

Authors

Contributions

The study conception and design were planned by L.K.N., D.H.C. and M.A.; Data collections were performed by M.A. and L.K.N.; C.T.M. and M.A. prepared and analysed the interviews. M.A. performed the interviews. All authors read and approved the final manuscript.

Corresponding author

Correspondence to Merete Ajstrup.

Ethics declarations

Ethics approval and content to participate

The study is registered in the Central Denmark Region’s research notification system. Oral and written informed consent were obtained from all study participants.

Consent for publication

Not applicable.

Competing interests

The authors declare that they have no competing interests.

Additional information

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article’s Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article’s Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Ajstrup, M., Mejdahl, C.T., Christiansen, D.H. et al. Transition of care in a Danish context: translation, cross-cultural adaptation and content validation of CTM-15 and PACT-M. J Patient Rep Outcomes 8, 58 (2024). https://doi.org/10.1186/s41687-024-00739-3

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1186/s41687-024-00739-3

Keywords