Skip to main content
Journal of Patient-Reported Outcomes
Download PDF
Download ePub

What matters to children with lower limb deformities: an international qualitative study guiding the development of a new patient-reported outcome measure

Journal of Patient-Reported Outcomes volume 5, Article number: 30 (2021) Cite this article

Abstract

Background

Lower limb deformities include conditions such as leg length discrepancy, lower limb deficiency and associated angular and rotational deformities of the hips, knees, ankles and feet. Children with lower limb deformities often have physical limitations due to gait irregularities and pain. The differences in the appearance and function of their lower limbs can discourage participation in social, recreational and leisure activities, which may result in behavioural, emotional, psychological and social adjustment problems. The health-related quality of life (HRQL) of these children is often impacted due to the factors discussed above, as well as by the complex surgical procedures. Surgical treatment options for limb deformities in children vary from limb lengthening and reconstruction to amputation. The lack of evidence demonstrating superiority of either treatment options and their effect on HRQL limits the ability of healthcare providers to counsel families on the best evidence-based treatment option for them.

This manuscript describes the international qualitative study which guided the development of a new patient-reported outcome measure (PROM). Individual semi-structured face-to-face interviews with children with lower limb deformities and their parents were conducted at five sites: Canada (2 sites), Ethiopia, India and the USA.

Results

Seventy-nine interviews were conducted at five international sites. Five main themes emerged from the qualitative interviews and formed the basis of the conceptual framework. These themes were: 1) appearance, 2) physical health, 3) psychological health 4) school and 5) social health.

Conclusions

Lower limb deformities have a substantial impact on the HRQL of children. The concepts of interest identified in our study were similar across children from all countries. The conceptual framework guided the development of outcome scales specific to these patients.

The information about the impact of various treatment options on the HRQL of children with lower limb deformities, collected using this new PROM, could be used to inform parents and children about outcomes (physical, social, psychological) associated with specific treatment options. This information could supplement other objective outcome information (e.g., complication rates, how the leg will look, etc.) to help families to come to a more informed decision on a child’s course of treatment.

Introduction

Lower limb deformities include conditions such as leg length discrepancy, lower limb deficiency and associated angular and rotational deformities of the hips, knees, ankles and feet. Lower limb deformities can be separated into two broad categories: 1) congenital deformities, which may result from defects in fetal development, and 2) acquired deformities, which arise from trauma, infections, tumours and other medical conditions [1]. Epidemiological data vary among individual deformities. For example, in a retrospective study from France, leg length discrepancy of greater than 2 cm was found in at least 1 in every 1000 people [2]. In the USA, the overall incidence of limb reduction defects is estimated to be 2 per 10,000 live births [3]. The case rate of limb deficiency defects in Canada (excluding Quebec) in 2014 was 3.74 per 10,000 births [4]. Fibular hemimelia a congenital deficiency of the long bones has an estimated incidence between 7.4 and 20 per 1 million live births [5–8]. The incidence of tibial hemimelia is reported to be one per million live births [9, 10]. The incidence of congenital femoral deficiency is 1 in 52,029 [8]. However, there is lack of up to date data on epidemiology of these congenital conditions and lower limb deformities.

Children with lower limb deformities often have physical limitations due to gait irregularities and pain. These differences in the appearance and function of their lower limbs can discourage participation in social, recreational and leisure activities, which may result in behavioural, emotional, psychological and social adjustment problems [11–15]. The health-related quality of life (HRQL) of these children is often impacted due to the anatomic and functional factors discussed above, as well as by the complex surgical procedures for their treatments [16–19].

Treatment options depend on the type of limb deformity, as well as the clinician’s skills and institutional resources available at the treating centre. Non-surgical treatment options include shoe-lifts, braces and step-in prostheses. Surgical treatment options for limb deformities in children vary from limb lengthening and reconstruction to amputation. Choice of treatment is usually dependent on a number of factors including clinical presentation [20], the desires of the patients and parents, the predicted HRQL, cultural influences, cosmetic preference and socio-economic status of individual families [13, 14]. Socio-economic status has been known to be the fundamental cause of health disparities between high-income, lower-middle and low-income countries. Hence, the availability and access to treatments vary considerably between these countries. Furthermore, the high-income countries are using more sophisticated surgical treatment options such internal lengthening devices and latest hexapod external fixators with the ability to correct deformities more precisely, whereas majority of the low-income and lower-middle income countries are still using traditional external fixators when available. Overall, there is less specialist surgical workforce in low- income and lower-middle income countries [21].

Each treatment option has advantages and disadvantages. Amputation is a non-reversible surgical procedure followed by fitting of a prosthesis. Amputation is associated with potential stump overgrowth and pain. Prosthetic limbs require periodic replacement due to patient growth, breakage or fitting problems and lack normal sensation and proprioception [22]. The life-time cost of prosthesis replacement can be substantially higher than the repeat surgical procedures for limb lengthening [23].

Reconstruction by lengthening corrects limb length discrepancy and deformity by utilizing distraction osteogenesis [24]. This approach is more involved and may require multiple procedures. An external or internal fixation device is applied to the leg and remains in place for months. The child experiences multiple hospital visits and extensive physiotherapy and rehabilitation. This treatment is psychologically stressful due to its duration, impact on schooling and the potentially high rate of complications [16, 18, 25, 26].

There is insufficient evidence in the literature to support one treatment option over the other. Some studies show successful outcomes with amputations [22, 27–31], while others have also reported similarly successful outcomes with lengthening and reconstruction [32–36]. Some comparative effectiveness studies have found no difference when comparing amputation and reconstruction [37, 38].

The lack of evidence demonstrating superiority of either treatment options and their effect on HRQL limits the ability of healthcare providers to counsel families on the best evidence-based treatment option for them. Consequently, there is a need for a rigorously designed patient-reported outcome (PRO) instrument to collect data from patients with lower limb deformities. These data could be used to inform parents and children about outcomes (physical, social, psychological) associated with these procedures. This information could supplement other objective outcome information (e.g., complication rates, how the leg will look, etc.) to help families to come to a more informed decision on a child’s course of treatment [39].

Our systematic review (SR) identified the lack of a validated and psychometrically tested patient-reported outcome measure (PROM) for children with lower limb deformities [40]. To fill this gap, our team is developing a new PROM called LIMB-Q Kids [41]. A rigorous qualitative phase is crucial to the development of a new PROM [42]. Qualitative interviews can provide a deeper understanding of what is important to a patient and establish the content validity [43, 44]. In this report, we describe the international qualitative study which guided the development of LIMB-Q Kids. Our aim was to identify concepts of interest important to children with lower limb deformities and using this knowledge to develop a conceptual framework of HRQL for these children.

Methods

Individual semi-structured face-to-face interviews with children with lower limb deformities and their parents were conducted at five international sites: Canada (2 sites), Ethiopia, India and the USA. Ethics approval was obtained at the primary study site (CW15–0215 / H15–00514) and each of the participating sites. A written informed consent was obtained from the parents and assent was obtained from the children.

Sampling

Purposive sampling was used to recruit a maximum variation sample of children with lower limb deformities that included patients who varied by type of lower limb deformities, treatment type, stage of treatment, age, gender and country of residence.

Inclusion criteria

Children aged 8 to 18 years with a confirmed diagnosis of a lower limb deformity were eligible. Parents of these eligible patients were also invited to participate in individual interviews.

Exclusion criteria

Patients with lower limb deformities along with other medical conditions which may have a confounding effect on their HRQL and conditions such as cognitive or developmental delay affecting their ability to communicate were excluded from this study. Isolated deformities of hip and foot were excluded.

Study setting, recruitment and data collection

Recruitment took place at hospitals in Canada, the USA (High-income countries), India (Lower-middle income country) and Ethiopia (Low-income country). The two sites from Canada and 1 site from the USA were tertiary care hospitals providing specialised orthopaedic care to children across their respective provinces. The site from India was a leading tertiary care hospital providing care to patients from several states in India. The site from Ethiopia was a pediatric orthopaedic teaching hospital that provided care to physically disabled children. Our two centres in Ethiopia and India primarily catered to patients with low socio-economic status with limited access to medical care.

Recruitment at these sites was done by their respective research teams in consultation with the primary study site (senior author’s site). An interview guide was prepared in English (attached in appendix) and translated into French, Amharic, Hindi and Punjabi. The interview guide was based on the preliminary conceptual framework derived from our SR [40]. Feedback from the orthopaedic surgeon (AC) and an expert in PROM development (AK) also informed the interview guide. The interview guide was modified during the process to gain understanding of emerging themes.

All English interviews in Canada and the USA, and Hindi and Punjabi interviews in India were conducted by the first author (HC). The first author is a native speaker of both Hindi and Punjabi languages and is also fluent in English. Interviews at the French speaking Canadian site and Amharic speaking site in Ethiopia were conducted by their local research assistants who were trained by the first author. Both the researchers from the French speaking Canadian site and Amharic speaking site in Ethiopia were native speakers of French and Amharic respectively. They were both fluent in English aswell. Interviews were conducted until data saturation was reached i.e. no new information or thematic variation emerged in the subsequent interviews [45, 46].

Data analysis

All interviews were recorded and transcribed verbatim. Hindi and Punjabi interviews were transcribed and translated into English by the first author (HC). French interviews were translated and transcribed by the same researcher from the French speaking site in Canada who conducted the interviews. Amharic interviews were translated into English and transcribed by the research assistant from the Amharic speaking site who also performed the interviews. A pragmatic approach to translation was used in this study. Triangulation was achieved by interviewing the parents or caregivers of the children as a second source of data [47, 48].

The purpose of conducting this qualitative study was to identify prevailing concepts representative of the international sample as a means to developing items for a new patient-reported outcome measure. While analysing the interviews, variables such as age at the time of interview, country of residence, and child or parent interview were included to see if the concepts were relevant across country, age and parent versus child.

This study adopted an interpretive description (ID) approach [49]. ID is a non-categorical qualitative approach which aims at developing knowledge for the clinical context of applied health disciplines [50]. Transcripts were analysed using a line-by-line coding approach to label and identify recurrent themes and patterns. Coding involved an inductive (from the interviews) and deductive process (preliminary conceptual framework from our SR). Constant comparison was used to compare interview data and categorise the concepts of interest (COI) into major and minor themes [51]. The results of this analysis were used to refine the preliminary conceptual framework from our SR [40].

Rigor: We used Guba and Lincoln’s factors to assess four criteria of rigor as suggested by Sandelowski [52, 53]: truth value, applicability, consistency and neutrality. Truth value of a qualitative study is tested by the credibility of the results. Our study findings are supported by relevant quotations from the participants which support the representativeness of those findings. We also used triangulation as a way of ensuring credibility of our results. Triangulation involves collecting data from multiple sources/multiple points of view in an attempt to address the subjectivity in qualitative work and as a way of validating the findings [54]. We achieved triangulation in our study by interviewing the parents/caregivers of these children separately as a second source of data. According to Guba and Lincoln, the applicability of the results of a qualitative study is determined in terms of fittingness [53]. Fittingness refers to the ability of the research findings to fit the data from which they were derived. Quotations from the study participants demonstrated the fit between the data and study findings. The consistency of the qualitative findings is evaluated by their auditability [53]. A description of the coding process and ongoing discussion with the research team members contributed towards the auditability. Peer debriefing, which involved discussing the ongoing analysis with the research team, was also conducted on a regular basis to verify the study findings [51]. To further support auditability, close contact was maintained with the study team members with expertise in qualitative research and PROM development. We used confirmability as the criterion for neutrality, which means that we were reflexive about the research process and the findings [53, 55]. Reflexivity involves awareness of researchers’ biases and beliefs that can influence decisions during the data collection and analysis, including categories not ultimately borne out by the data [56]. The first author also kept a journal to signal thought processes and interpretations, in accounting for how individual patient or parent stories were selected as representative and thematic. The authors involved in developing the coding schedule were non-clinician researchers. Individual investigators from the participating sites were clinicians who were directly involved in the clinical care of children with lower limb deformities. These investigators were involved in the preparation of the manuscript, including a detailed review of the qualitative analysis. The involvement of multiple perspectives and discussions to reach a consensus reduced individual biases.

Results

Seventy-nine interviews (39 children and 40 parents) were conducted with children with lower limb deformities and their parents from four countries (Canada, Ethiopia, India and the USA) (Table 1). Interviews were conducted at individual sites between years 2015–2018. Out of the 39 interviewed children, 2 had amputation, 7 had no treatment at the time of the interview, 20 were in active treatment phase (external fixators, internal lengthening nails, osteotomy) and 10 had some treatment done in the past (external fixators, internal lengthening nails). A list of lower limb deformities of the interview participants is included in the appendix (Table 2). Five main themes emerged from the qualitative interviews and formed the basis of the conceptual framework (Fig. 1). These five themes were: 1) appearance, 2) physical health, 3) psychological health 4) school and 5) social health. These themes formed the basis of development of outcome scales for the LIMB-Q Kids. Other factors such as coping, emotional and instrumental support were identified to be the mediating factors influencing HRQL. Below we describe each theme and provide illustrative quotes (Additional file 2: Table S1) from interviewed children (labelled as ‘C’) and their parents (labelled as ‘P’). Though we conducted individual interviews with children and their parents separately, no new themes emerged from the parent interviews only.

  1. 1)

    Appearance: Leg appearance was an important theme for the interviewed children.

    1. a.

      Appearance of specific body parts and scars: Appearance was discussed in terms of the leg overall, specific parts including hips, knees, feet and surgical scars (Quotes 1–11). The children talked specifically about the shape, symmetry, size and overall appearance of their legs (Quotes 1–4).

    2. b.

      Clothing: Children also discussed how their leg looked when wearing different types of clothing and foot-wear (Quotes 12–16). Children talked about the type and fit of clothes and overall appearance with certain clothes (Quotes 13–17). They discussed how they were not able to wear different types of clothes as they would like. Some children talked about not being able to wear shorts or short skirts and they wore long pants to hide their leg. They also described having to wear specific types of clothes when they had an external fixator device (Quotes 13, 14). Adolescent children were also concerned about the appearance of their legs in photographs (Quote 19).

    3. c.

      Shoes and other devices: Children talked about the appearance when wearing treatment related devices such as splints, crutches, external fixator devices, braces, prosthesis and shoe-lifts (Quote 17–18).

  2. 2)

    Physical Health: Children talked about their limitations with physical function and their symptoms.

    1. a.

      Physical function: Under physical function, the children discussed their limitations with mobility, balance, sports and recreational activities, activities of daily living (ADL) and their adaptations for specific activities. Most children were unable to walk or run long distances without discomfort or pain (Quotes 20–23). The mobility limitations were either due to their limb deformity or due to the shoe-lifts or external fixator devices.

      Children also mentioned losing balance, feeling uneven and falling (Quote 26–27). They described limitations in the type of sports they could participate in due to their limb deformity and treatment related devices such as external fixators and shoe- lifts (Quote 30–32). Some children mentioned choosing alternate sports or adapting themselves accordingly (Quotes 28–29). Most children were able to perform ADLs without any limitations even when they were wearing prosthesis. However, some children mentioned having problems with ADLs (putting on or taking off clothes etc.) while they were in the external fixator devices (Quote 24).

    2. b.

      Symptoms: Children also talked about the symptoms they experienced due to their lower limb deformity. Symptoms included pain, feeling tired and limping (Quotes 33–36). Pain involved the leg as well as other parts of the body. Pain was described in terms of its frequency and severity (Quotes 37–41). Pain was reported during the time period when they had the external fixators on. They also discussed interference of pain during walking and sleeping at night (Quotes 33–34, 41).

  3. 3)

    Psychological Health: Lower limb deformities impacted the psychological health of children. Children shared their concerns about their body image, talked about the distress due to their leg related problems, how their leg related problems impacted their confidence and self-esteem and how they developed coping strategies. Some children indicated how their leg problems had a positive impact on them.

    1. a.

      Body image: Children with leg deformities perceived their body image diversely. Some children with congenital deformities perceived themselves as being ‘normal’ since they were born with the lower limb deformity. At the same time children who acquired the deformity due to trauma, infection, tumours or other medical conditions later on in their life perceived themselves as not being 'normal' and experienced challenges adapting physically and psychologically (Quotes 42- 44).

      Children described a range of strategies to conceal their leg with deformity or their leg with the external fixator device. Some avoided wearing certain types of clothes while others would not go out with clothes that revealed their deformity (Quotes 45–46). Some children with congenital deformities walked with an altered gait to conceal their limp (Quote 46). Some children felt ashamed or embarrassed about their body image with their limb deformity (Quote 45). Children described that they felt self-conscious due to their leg deformity, limping, external fixator devices or the shoe-raises they had to wear (Quotes 47–50).

    2. b.

      Distress: Most children had experienced leg related-distress to some extent either due to their physical limitations, appearance related issues due to the deformity, external fixator devices or shoe raises, complex surgical procedures and limitations in social participation. Their distress was expressed in various emotions such as being worried, feeling down, crying, feeling irritated, and angry (Quotes 57–68). Children were worried about their surgeries and how their leg problems would affect them in the future. (Quote 53–56). They were worried about limping, other people staring, not being able to walk and the leg length difference happening again after they had received the treatment. While some adolescents were also worried about the kind of jobs they can do in future with their leg problem, younger children worried about their leg or foot hurting while playing. Children also felt being down, sad, upset and discouraged at times due to the challenges they were facing either due to the deformity itself or due to the treatment procedures such as having the external fixator device on for months (Quotes 57–68).

    3. c.

      Confidence and Self-esteem: Children talked about how their leg problems and external fixator devices affected their confidence and self-esteem (Quotes 69–75). Some of them didn’t feel comfortable getting their pictures taken while others felt inferior to other kids (Quote 75).

Table 1 Participant Demographics
Full size table
Table 2 List of deformities included in the study sample
Full size table
Fig. 1
figure 1

Conceptual Framework

Full size image

4) School: Most children talked about the impact of having a limb deformity on their school life. They discussed their limited participation in activities at school, having to miss school, the isolation they felt at school, emotional and instrumental support from their friends and teachers and some school-based environmental barriers.

  1. a.

    Function: Children mentioned having to miss school because of their frequent appointments with the doctors, physiotherapists and occupational therapists and recovery period after surgeries. While some children were ok going to school with the external fixator devices on others were scared to go to school (Quotes 83–92). Most children interviewed from Canada and the USA were able to go to school while some children from India and Ethiopia had to miss a lot of school or were not able to go to school at all during the treatment phase. They either had to travel to different cities for treatment or had physical limitations getting to school with their deformity because they couldn’t afford the treatment (Quotes 87–92). Some children missed school due to pain and other complications of their surgical procedures (Quotes 91–92).

  2. b.

    Participation: Children talked about their limited participation at school in academic, sports and recreational activities. Most participants did not describe any impact on their academic performance due to their limb deformity. However, a few children from India and Ethiopia mentioned missing an entire year of school due to treatment (Quotes 93–95). Participation in sports and other activities at school was impacted for most children. Some children found alternate activities that were physically less demanding to accommodate their lower limb deformity or while they were in the external fixator devices (Quotes 93–95).

  3. c.

    Isolation: Children felt isolated and left out at times due to being teased by their peers, being asked about their legs all the time, having to tell other people about their leg, shoe-lifts and external fixator devices (Quotes 104–108).

  4. d.

    Environmental barriers: Children mentioned having problems at school due to the environmental barriers such as taking the stairs with their external fixator devices and problems when they were in wheelchair (Quotes 102–103).

  1. 5)

    Social Health: All children interviewed were school age so most of their social life was around friends at school or school related social activities. However, some children did talk about the impact of their deformity on the social life outside of school.

    1. a.

      Social Function: Children talked about how their social function was affected in terms of making new friends, going out with friends and family (Quotes 109–110). Their limited physical function and concerns about their appearance directly impacted their social function in terms of being unable to participate in social activities with friends and family (Quotes 111–112). Adolescent children mentioned how they would want to post pictures on social media. Some adolescent children also shared their difficulties in finding jobs especially the children with prosthesis (Quotes 112, 116–117).

    2. b.

      Isolation: Children also felt socially isolated and left out when their friends and other people noticed their limping, stared at their leg and asked them about their leg. Some experienced teasing from peers. They felt lonely and isolated when they couldn’t go out and play with their friends and siblings (Quotes 125–136).

Mediating factors

The mediating factors, as identified based on the qualitative analysis, were the factors impacted by the deformity that influenced the children’s perceptions of their HRQL. Coping, emotional and instrumental support were the three mediating factors found in this study.

Coping

It was also evident from the interviews that some children with lower limb deformities had developed their own coping strategies to deal with their challenges (Quotes 76–82). One child mentioned keeping a journal to document their feelings while another accepted their deformity philosophically, suggesting that everything happens for a reason. Another child also mentioned feeling better thinking that their problem was not as bad as some other people's. Some children coped with their scars by considering them to be reminders of what they have been through. There was a positive impact of their lower limb deformity seen on some children. They felt stronger and more motivated to do certain activities which they couldn’t do during their treatment especially involving the external fixator device. Strong religious beliefs and acceptance of their deformity as god’s will were also seen in interviewed participants from Ethiopia.

Emotional and instrumental support

Children talked about the emotional support they had at school from their friends and teachers (Quotes 96–98). They had instrumental support from their friends and teachers at school such as needing help carrying a backpack (Quote 99–101). Children also talked about the emotional and instrumental support from friends, people and family (Quotes 118–124).

Discussion

The aim of this study was to identify domains of HRQL important to children with lower limb deformities and to develop a conceptual framework of HRQL concepts that are important to these children. This framework guided the development of items and scales for an internationally applicable PROM for this patient population.

The preliminary conceptual framework developed based on our systematic review identified three overarching health concepts including physical, psychological and social health [40]. These concepts identified in our systematic review were also consistent with studies looking at the impact of tumours in the lower limb on the HRQL [57–63]. A systematic review by Bekkring et al. summarizes 12 studies, looking at the HRQL, functional ability and physical activity in children and adults with bone cancers of the lower limb [64]. While the overarching health concepts identified in our international qualitative study remain the same as identified in our systematic review, we found certain themes in our qualitative study that were not emphasized in the literature but were important to the children with lower limb deformities. For example, appearance of the leg was an under-represented theme in the literature that was found to be an important theme in the final conceptual framework derived through the interviews. Children talked about the appearance of legs, knees, feet and hips. This is now reflected in the conceptual framework emphasizing the importance of appearance for these children. Table 3 (in Appendix) shows how each theme was endorsed in the interviews.

Similarly, school was a major theme based on the qualitative interviews. Given that our target patient group is between the ages of 8 to18 years when children typically go to school, it is not surprising that most children talked about school-based challenges. Our findings of lower participation in physical activities at school and missed days of school are in line with the similar findings from previous studies [65, 66].

Our findings of concealment by wearing specific clothes or avoiding more revealing clothes, and hiding their affected leg were similar to strategies for hiding upper limb deficiencies [67, 68]. Children discussed several issues with the external fixator devices. These issues were found to be temporary and only encountered during the time they used the external fixators. However, it is common for children to require treatment with an external fixator multiple times over the course of their childhood with the duration of use as long as nine months each time.

The strength of this study is the heterogeneity of the sample for interviews, in terms of the age, gender, type of deformity, type of treatment, stage of treatment, country of residence and socio-economic status. This diverse sample enabled us to identify a range of concepts important to an eclectic international population of children with lower limb deformities, increasing the generalizability of the PROM. The overall thematic findings resonated with and fairly represented the entire sample included in this study.

With the aim of understanding what’s important to children with lower limb deformities, we also interviewed the parents of these children. A recent review indicating the current recommendations for proxy reports suggests that observable concepts are often reliable while the unobservable concepts such as emotional well-being and social functioning are found to be unreliable when measured using the proxy reports [69]. Similar discrepancies between child and parent proxy reports have been reported in a study looking at HRQL in children with congenital lower limb deficiencies using generic HRQL instruments [14]. The analysis of parent data in our study did not find any new themes other than those found from the interviews with children. This is also supportive of the previous literature suggesting that by the age of 8 years children can reliably report on their well-being, psychological health and health promoting behaviours [70–72].

Limitations

We acknowledge the potential for sampling bias given the centres selected for qualitative interviews. Since our centres in Ethiopia and India primarily serve patients with low socio-economic status some of these children might have reported substantially higher impact of their limb deformity on the HRQL. However, we did not collect any information on the socio-economic status of the participating children. This conjecture is based on author’s knowledge of the individual participating sites and may be reflective of their bias toward this population. For this study, we were only able to interview children from four countries. The number of children with amputations included in this qualitative study was small. Hence, we might have missed some concepts relevant to children with amputations.

We do recognise the importance of establishing trustworthiness of translating and transcribing verbatim qualitative interview data. The methodological challenges in cross-language qualitative research are well recognised [73]. A strength of our study is that members of the study team who translated the interview guide, performed interviews in local languages, translated and transcribed them into English were the native speakers of the local language and were fluent in English aswell. A pragmatic approach to translation was used in this study.

While there are limitations of not using a certified translator at this step, using researchers from the study team, with bilingual skills, as translators offers an unique advantage of not bringing in an ‘outsider’ to conduct, translate and transcribe these qualitative interviews. The interviewers had significant background knowledge about their individual sites, the orthopaedic conditions, were well aware of the study objectives and were able to probe efficiently using conceptually equivalent terms as needed.

Conclusion and future work

Our study describes the impact of lower limb deformities on the HRQL of children. This impact is further influenced by health inequities including low socio-economic status and access to healthcare in lower-middle- and low-income countries. Nonetheless, the COI identified were similar across children from all countries. This detailed knowledge gained from interviewing children with lower limb deformities has provided us with first-hand information about what matters most to these children. This framework guided the development of outcome scales specific to these patients. An exhaustive list of items was generated based on the qualitative interviews. Physical health, psychological health, social health, school and appearance were the areas most important to children with lower limb deformities. Cognitive debriefing interviews with children with lower limb deformities are in progress at the participating sites along with the feedback from clinicians at each site. Next steps include translation and cultural adaptation of the LIMB-Q Kids and an international field test study.

Availability of data and materials

As the raw data for this study is qualitative interviews which can pose a risk to the confidentiality of the participants; this data will not be available openly. However, authors will try their best to answer any questions from the readers and for any future studies in this area.

Abbreviations

HRQL:

Health- related quality of Life

PRO:

Patient- reported outcome

SR:

Systematic review

COI:

Concepts of interest

PROM:

Patient- reported outcome measure

References

  1. Wilson, G. N. (1998). In H. JA, & J. Birch (Eds.), Heritable limb deficiencies, (pp. 39–51). Rosemont, IL.

  2. Guichet, J.-M., Spivak, J. M., Trouilloud, P., & Grammont, P. M. (1991). Lower Limb-Length Discrepancy. An Epidemiologic Study. Clinical Orthopaedics and Related Research, 272, 235–241.

  3. Canfield, M. A., Honein, M. A., Yuskiv, N., Xing, J., Mai, C. T., Collins, J. S., et al. (2006). National estimates and race/ethnic-specific variation of selected birth defects in the United States, 1999–2001. Birth Defects Research Part A - Clinical and Molecular Teratology, 76, 747–756.

  4. Public Health Infobase. Public Health Agency of Canada. [Internet]. Congenit. Anomalies Canada 2017; Available from: https://health-infobase.canada.ca/congenital-anomalies/data-tool.

  5. Boakes, J. L., Stevens, P. M., & Moseley, R. F. (1991). Treatment of genu valgus deformity in congenital absence of the fibula. Journal of pediatric orthopedics, 11, 721–724.

    Article  CAS  PubMed  Google Scholar 

  6. Coventry, M. B., & Johnson, E. W. (1952). Congenital absence of the fibula. The Journal of bone and joint surgery. American volume, 34(A), 941–955.

    Article  PubMed  Google Scholar 

  7. Froster, U. G., & Baird, P. A. (1993). Congenital defects of lower limbs and associated malformations: A population based study. American journal of medical genetics, 45, 60–64.

    Article  CAS  PubMed  Google Scholar 

  8. Rogala, E. J., Wynne-Davies, R., & Littlejohn, A. (1974). Congenital limb anomalies: Frequency and aetiological factors. Data from the Edinburgh register of the newborn (1964-68). Journal of medical genetics, 11, 221–223.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  9. Paley, D. (2016). Tibial hemimelia: new classification and reconstructive options. Journal of Children’s Orthopaedics. Springer Verlag, 10, 529–555.

  10. Brown, F. W. (1971). The brown operation for total hemimelia tibia. In G. T. Aitken (Ed.), Selected lower limb anomalies National Academy of Sciences. Washington DC, (pp. 20–28).

    Google Scholar 

  11. Setoguchi, Y., & Rosenfelder, R. (1982). The limb deficient child. Thomas, editor. Springfield, IL.

    Google Scholar 

  12. Cadman, D., Boyle, M., Szatmari, P., & Offord, D. R. (1987). Chronic Illness, Disability, and Mental and Social Well-Being: Findings of the Ontario Child Health Study, 79, 805–813 Available from: http://pediatrics.aappublications.org/content/79/5/805.abstract.

  13. Michielsen, A., Van Wijk, I., & Ketelaar, M. (2010). Participation and quality of life in children and adolescents with congenital limb deficiencies: A narrative review. Prosthetics and orthotics international.

  14. Michielsen, A., Van Wijk, I., & Ketelaar, M. (2011). Participation and health-related quality of life of Dutch children and adolescents with congenital lower limb deficiencies. Journal of rehabilitation medicine, 43(19), 584–589.

    Article  PubMed  Google Scholar 

  15. Varni, J. W. P. D., & Setoguchi, Y. M. D. (1991). Correlates of perceived physical appearance in children with congenital/acquired limb deficiencies. Journal of developmental and behavioral pediatrics : JDBP, 12(3), 171–176.

    Article  CAS  PubMed  Google Scholar 

  16. Hrutkay, J. M., & Eilert, R. E. (1990). Operative lengthening of the lower extremity and associated psychological aspects: The Children’s hospital experience. Journal of pediatric orthopedics, 10, 373–377.

    Article  CAS  PubMed  Google Scholar 

  17. Ghoneem, H. F., Wright, J. G., Cole, W. G., & Rang, M. (1996). The Ilizarov method for correction of complex deformities. The Journal of bone and joint surgery. American volume, 78, 1480–1485.

    Article  CAS  PubMed  Google Scholar 

  18. Ramaker, R. R., Lagro, S. W., van Roermund, P. M., & Sinnema, G. (2000). The psychological and social functioning of 14 children and 12 adolescents after Ilizarov leg lengthening. Acta orthopaedica Scandinavica, 71(1), 55–59.

    Article  CAS  PubMed  Google Scholar 

  19. Montpetit, K., Hamdy, R. C., Dahan-oliel, N., Zhang, X., Narayanan, U. G., & Frcs, C. (2009). Measurement of health-related quality of life in children undergoing external fixator treatment for lower limb deformities. Journal of pediatric orthopedics, 29(8), 920–926.

    Article  PubMed  Google Scholar 

  20. Sakkers, R., & van Wijk, I. (2016). Amputation and rotationplasty in children with limb deficiencies: current concepts. Journal of Children’s Orthopaedics. Springer Verlag, 10, 619–626.

  21. World Bank. Specialist surgical workforce (per 100,000 population). 2018. https://data.worldbank.org/indicator/SH.MED.SAOP.P5?end=2018&start=2018&view=map.

    Google Scholar 

  22. Naudie, D., Hamdy, R. C., Fassier, F., Morin, B., & Duhaime, M. (1997). Management of Fibular Hemimelia: Amputation or Limb Lengthening. The Journal of bone and joint surgery. British volume, 79.

  23. Aiona, M. (2014). See you in the paralympics in 2022. Journal of Bone and Joint Surgery - American Volume. Journal of Bone and Joint Surgery Inc, 96, e173.

  24. De, B. G., Aldegheri, R., Renzi-Brivio, L., & Trivella, G. (1987). Limb Lengthening by Callus Distraction (Callotasis). Journal of pediatric orthopedics, 7(2) Available from: http://journals.lww.com/pedorthopaedics/Fulltext/1987/03000/Limb_Lengthening_by_Callus_Distraction.2.aspx.

  25. Paley, D. (1990). Problems, obstacles, and complications of limb lengthening by the Ilizarov technique. Clin Orthop Relat Res, 250, 81–104.

    Article  Google Scholar 

  26. Martin, L., Farrell, M., Lambrenos, K., & Nayagam, D. (2003). Living with the Ilizarov frame: Adolescent perceptions. J Adv Nurs.

  27. Choi IH, Kumar SJ, Bowen JR. Amputation or limb-lengthening for partial or total absence of the fibula. J Bone Jt Surg Am. 1990;72(9):1391–9.

  28. John Birch BG, Walsh SJ, Small JM, Morton A, Koch KD, Smith C, et al. Syme amputation for the treatment of fibular deficiency: An evaluation of long-term physical and psychological functional status. 1999.

    Google Scholar 

  29. McCarthy, J. J., Glancy, G. L., Chang, F. M., & Eilert, R. E. (2000). Fibular Hemimelia: Comparison of Outcome Measurements After Amputation and Lengthening* [Internet]. Vol. 82, (p. 1732) Available from: http://jbjs.org/jbjsam/82/12/1732.full.pdf.

    Google Scholar 

  30. Westin, L., Carlson, R., Israelsson, B., Willenheimer, R. C. C., & McNeil, T. F. (1997). Quality of life in patients with ischaemic heart disease: A prospective controlled study, 242, 239–247.

  31. Fernandez-Palazzi (1998). Congenital Defiency of Tibia. JPO.

    Google Scholar 

  32. Catagni, M. A., Radwan, M., Lovisetti, L., Guerreschi, F., & Elmoghazy, N. A. (2011). Limb lengthening and deformity correction by the Ilizarov technique in type III fibular hemimelia: An alternative to amputation. Clin Orthop Relat Res, 469(4), 1175–1180.

    Article  PubMed  Google Scholar 

  33. Miller LS. Management of Congenital Fibular Deficiency by Ilizarov Technique. J Pediatr Orthop. 1992;12(5):651–7.

  34. Yadav S. Type-I Tibial Hemimelia_ A Limb-Salvage and Lengthening Technique. JB JS Open Access 2019;4(1).

  35. Hosny, G. A. (2005). Treatment of tibial hemimelia without amputation: Preliminary report [internet]. Journal of Pediatric Orthopaedics B, 14 Available from: https://journals.lww.com/jpo-b. Lippincott Williams & Wilkins.

  36. Catagni, M. (1991). Management of Fibular Hemimelia Using Ilizarov Method. Orthop Clin North Am.

  37. Walker, J. L., Knapp, D., Minter, C., Boakes, J. L., Salazar, J. C., Sanders, J. O., et al. (2009). Adult Outcomes Following Amputation or Lengthening for Fibular Deficiency, 91, 797–804 Available from: http://jbjs.org/jbjsam/91/4/797.full.pdf.

  38. Birch, J. G., Paley, D., Herzenberg, J. E., Morton, A., Ward, S., Riddle, R., et al. (2019 Apr). Amputation versus staged reconstruction for severe fibular Hemimelia. JBJS Open Access, 4(2), e0053.

    Article  PubMed  PubMed Central  Google Scholar 

  39. Letts M, Vincent N. Congenital Longitudinal Deficiency of the Fibula (Fibular Hemimelia) Parental Refusal of Amputation.

  40. Chhina, H., Klassen, A., Kopec, J., Park, S., Fortes, C., & Cooper, A. (2017). Quality of life of children with lower limb deformities: A systematic review of patient-reported outcomes and development of a preliminary conceptual framework. J Limb Lengthening Reconstr, 3(1), 19–29.

    Article  Google Scholar 

  41. Chhina, H., Klassen, A., Kopec, J. A., Oliffe, J., & Cooper, A. (2019). International multiphase mixed methods study protocol to develop a patient-reported outcome instrument for children and adolescents with lower limb deformities. BMJ Open, 9(5), 1–8.

    Article  Google Scholar 

  42. Lasch, K. E., Marquis, P., Vigneux, M., Abetz, L., Arnould, B., Bayliss, M., et al. (2010). PRO development: Rigorous qualitative research as the crucial foundation. Quality of life research, 19(8), 1087–1096 Available from: http://www.jstor.org.ezproxy.library.ubc.ca/stable/40927744.

    Article  PubMed  PubMed Central  Google Scholar 

  43. Patrick, D. L., Burke, L. B., Gwaltney, C. J., Leidy, N. K., Martin, M. L., Molsen, E., et al. (2011). Content validity - establishing and reporting the evidence in newly developed patient-reported outcomes (PRO) instruments for medical product evaluation: ISPOR PRO good research practices task force report: Part 2 - assessing respondent understanding. Value Health., 14(8), 978–988.

    Article  PubMed  Google Scholar 

  44. Patrick, D. L., Burke, L. B., Gwaltney, C. J., Leidy, N. K., Martin, M. L., Molsen, E., et al. (2011). Content validity—Establishing and reporting the evidence in newly developed patient-reported outcomes (PRO) instruments for medical product evaluation: ISPOR PRO good research practices task force report: Part 1—Eliciting concepts for a new PRO instrument. Value Health, 14(8), 967–977.

    Article  PubMed  Google Scholar 

  45. Bowen, G. (2008). a. Naturalistic inquiry and the saturation concept: A research note. Qual Res, 8(1), 137–152.

    Article  Google Scholar 

  46. Lincoln, Y. S., & Guba, E. G. (1985). Naturalistic injuiry. In: Volume 75.

    Google Scholar 

  47. Patton MQ. Enhancing the Quality and Credibility of Qualitative Analysis.

  48. Carter, N., Bryant-Lukosius, D., Dicenso, A., Blythe, J., & Neville, A. J. (2014). The use of triangulation in qualitative research. Vol. 41, Oncology Nursing Forum. Oncology Nursing Society, 545–547.

  49. Thorne, S., Kirkham, S. R., & MacDonald-Emes, J. (1997). Interpretive description: A noncategorical qualitative alternative for developing nursing knowledge. Research in nursing & health, 20(2), 169–177. https://doi.org/10.1002/(SICI)1098-240X(199704)20:2%3C169::AID-NUR9%3E3.0.CO;2-I.

    Article  CAS  Google Scholar 

  50. Thorne, S., Kirkham, S. R., & MacDonald-Emes, J. (1997). Interpretive description: A noncategorical qualitative alternative for developing nursing knowledge. Research in nursing & health, 20(2), 169–177.

    Article  CAS  Google Scholar 

  51. Cohen, D. J., & Crabtree, B. F. (2008). Evaluative criteria for qualitative research in health care: Controversies and recommendations. Annals of family medicine.

  52. Sandelowski (1986). Problem of Rigour in Qualitative Research. Advances in nursing science, 8(3).

  53. Guba, E. G., & Lincoln, Y. S. (1981). Effective Evaluation [Internet]. Vol. 100, Principal Leadership, (pp. 16–21) Available from: http://books.google.co.jp/books?id=3fxGAAAAMAAJ.

    Google Scholar 

  54. Tracy Qualitative Quality Eight Big Tent Criteria for Excellent Qualitative Research. Quality Inquiries . 2010;

  55. Shenton, A. K. (2004). Strategies for ensuring trustworthiness in qualitative research projects. Educ Inf [Internet], 22(2), 63–75. https://doi.org/10.3233/EFI-2004-22201.

    Article  Google Scholar 

  56. Charmaz Qual Health Res-2004.

  57. Eiser, C., Cool, P., Grimer, R. J., Carter, S. R., Cotter, I. M., Ellis, A. J., et al. (1997). Quality of life in children following treatment for a malignant primary bone tumour around the knee. Sarcoma., 1, 39–45.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  58. Eiser, C., Kopel, S., Cool, P., & Grimer, R. (1999). The perceived illness experience scale (PIE): Reliability and validity revisited. Child: care, health and development, 25(3), 179–190.

    Article  CAS  Google Scholar 

  59. Bekkering, W. P., Vliet Vlieland, T. P. M., Koopman, H. M., Schaap, G. R., Schreuder, H. W. B., Beishuizen, A., et al. (2009). Development of a subjective measure of health-related quality of life in patients who underwent surgery for lower extremity malignant bone tumor. Pediatric blood & cancer, 53, 348–355.

    Article  Google Scholar 

  60. Bekkering, W. P., Vliet Vlieland, T. P. M., Koopman, H. M., Schaap, G. R., Schreuder, H. W. B., Beishuizen, A., et al. (2010). Quality of life in young patients after bone tumor surgery around the knee joint and comparison with healthy controls. Pediatric blood & cancer, 54(5), 738–745.

    Article  Google Scholar 

  61. Henderson, E. R., Pepper, A. M., Marulanda, G. A., Millard, J. D., & Letson, G. D. (2010). What is the emotional acceptance after limb salvage with an expandable prosthesis? Clinical orthopaedics and related research, 468, 2933–2938.

    Article  PubMed  PubMed Central  Google Scholar 

  62. Hillmann, A., Hoffmann, C., Gosheger, G., Krakau, H., & Winkelmann, W. (1999). Malignant tumor of the distal part of the femur or the proximal part of the tibia: endoprosthetic replacement or rotationplasty. Functional outcome and quality-of-life measurements. The Journal of bone and joint surgery. American volume, 81, 462–468.

    Article  CAS  PubMed  Google Scholar 

  63. Mason, G. E., Aung, L., Gall, S., Meyers, P. A., Butler, R., Krüg, S., et al. (2013). Quality of life following amputation or limb preservation in patients with lower extremity bone sarcoma. Frontiers of Oncology, 3(AUG).

  64. Bekkering WP, Vliet Vlieland TPM, Fiocco M, Koopman HM, Schoones JW, Nelissen RGHH, et al. Quality of life, functional ability and physical activity after different surgical interventions for bone cancer of the leg: A systematic review. Vol. 21, Surgical Oncology. 2012.

  65. Boonstra, A. M., Rijnders, L. J. M., Groothoff, J. W., & Eisma, W. H. (2000). Children with congenital deficiencies or acquired amputations of the lower limbs: Functional aspects, 24, 19–27. https://doi.org/10.1080/03093640008726518.

  66. Johansen, H., Dammann, B., Øinæs Andersen, L., & Andresen, I. L. (2016). Children with congenital limb deficiency in Norway: Issues related to school life and health-related quality of life. A cross-sectional study. Disability & rehabilitation, 38(18), 1803–1810.

    Article  Google Scholar 

  67. de Jong, I. G. M., Reinders-Messelink, H. A., Janssen, W. G. M., Poelma, M. J., van Wijk, I., & van der Sluis, C. K. (2012). Mixed feelings of children and adolescents with unilateral congenital below elbow deficiency: An online focus group study. PLoS One, 7(6).

  68. Krantz, O., Bolin, K., & Persson, D. (2008). Stigma-handling strategies in everyday life among women aged 20 to 30 with transversal upper limb reduction deficiency. Scandinavian journal of disabilities research, 10(4), 209–226.

    Article  Google Scholar 

  69. Germain, N., Aballéa, S., & Toumi, M. (2019 Jan). Measuring health-related quality of life in young children: How far have we come? Journal Marketing Access Health Policy, 7(1), 1618661.

    Article  Google Scholar 

  70. Bevans, K., Riley, A., Moon, J., & Forrest, C. (2010). Conceptual and methodological advances in children reported outcomes measurement expert review of Pharmacoeconomics.

    Google Scholar 

  71. Oakley, A., Bendelow, G., Barnes, J., Buchanan, M., & Husain, A. N. (1995). PAPERS health and cancer prevention: Knowledge and beliefs ofchildren and young people.

    Google Scholar 

  72. Piko, B. F., & Bak, J. (2006 Oct). Children’s perceptions of health and illness: Images and lay concepts in preadolescence. Health education research, 21(5), 643–653.

    Article  PubMed  Google Scholar 

  73. Squires, A. (2009 Feb). Methodological challenges in cross-language qualitative research: A research review. International journal of nursing studies, 46(2), 277–287.

    Article  PubMed  Google Scholar 

Download references

Acknowledgements

N/A

Previous publications

First author (HC) has presented abstracts based on this study at annual meetings of ISOQOL 2018, 2019. These abstracts have been published in the Quality of Life Research Journal 2018, 2019.

Funding

This study was funded by competitive research grants from the Department of Orthopaedics, University of British Columbia and the Canadian Orthopaedic Foundation.

The senior author is supported by a salary award from the BC Children’s Hospital Research Institute and research funding from the BC Children’s Hospital Foundation.

None of the funding bodies declared above had any role in the planning and execution of this study.

Author information

Authors and Affiliations

  1. Department of Experimental Medicine, Faculty of Medicine, University of British Columbia, Vancouver, Canada

    Harpreet Chhina

  2. Department of Orthopaedics, BC Children’s Hospital, 1D 18, Orthopaedics Research Office, 4480 Oak Street, Vancouver, BC, V6H 3V4, Canada

    Harpreet Chhina & Anthony P. Cooper

  3. Department of Pediatrics, McMaster University, Hamilton, ON, Canada

    Anne F. Klassen

  4. Department of Surgery, McMaster University, Hamilton, ON, Canada

    Anne F. Klassen

  5. Department of Health Research Methods, Evidence, and Impact, McMaster University, Hamilton, ON, Canada

    Anne F. Klassen

  6. School of Population and Public Health, University of British Columbia, Arthritis Research Canada, Vancouver, BC, Canada

    Jacek A. Kopec

  7. School of Nursing, University of British Columbia, Vancouver, BC, Canada

    John Oliffe

  8. Department of Orthopaedic Surgery, The Ohio State University, College of Medicine, Nationwide Children’s Hospital, Columbus, OH, USA

    Christopher Iobst

  9. Shriners Hospitals for Children, School of Physical and Occupational Therapy, McGill University, Montreal, Quebec, Canada

    Noemi Dahan-Oliel

  10. Department of Orthopaedic Surgery, Post Graduate Institute of Medical Education and Research, Chandigarh, India

    Aditya Aggarwal

  11. CURE Ethiopia Children’s Hospital, Addis Ababa, Ethiopia

    Tim Nunn

  12. Department of Orthopaedics, Faculty of Medicine, University of British Columbia, Vancouver, Canada

    Anthony P. Cooper

Authors
  1. Harpreet Chhina
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Anne F. Klassen
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Jacek A. Kopec
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. John Oliffe
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Christopher Iobst
    View author publications

    You can also search for this author in PubMed Google Scholar

  6. Noemi Dahan-Oliel
    View author publications

    You can also search for this author in PubMed Google Scholar

  7. Aditya Aggarwal
    View author publications

    You can also search for this author in PubMed Google Scholar

  8. Tim Nunn
    View author publications

    You can also search for this author in PubMed Google Scholar

  9. Anthony P. Cooper
    View author publications

    You can also search for this author in PubMed Google Scholar

Contributions

HC – Conception and study design, data collection, analysis and manuscript preparation. AK - Study design, analysis, interpretation of data, and manuscript preparation. JK - Study design, analysis and manuscript preparation. JO - Study design, analysis, interpretation of data, and manuscript preparation. CI - Contributed patients for the qualitative interviews and manuscript preparation. ND - Contributed patients for the qualitative interviews and manuscript preparation. AA - Contributed patients for the qualitative interviews and manuscript preparation. TN - Contributed patients for the qualitative interviews and manuscript preparation. AC- Conception and study design, data collection, analysis and manuscript preparation. The author(s) read and approved the final manuscript.

Corresponding author

Correspondence to Harpreet Chhina.

Ethics declarations

Ethics approval and consent to participate

This study is approved by Research Ethics Boards for the primary study site and each of the participating sites (The University of British Columbia/Children’s and Women’s Health Centre of British Columbia Research Ethics Board CW15–0215/H15–00514; Shriners Hospital Canada IRB A08-B40-16B; Nemours Children’s Hospital Institutional review Board IRB #00005145, CURE Ethiopia Children’s Hospital 20160808-IRB, PGIMER, Chandigarh, IEC-01/2017–579).

Consent for publication

Not applicable.

Competing interests

All authors declare no competing interests

Additional information

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Supplementary Information

Appendix

Appendix

Table 3 Saturation Table Showing the Number of Interviews Endorsing Each Theme and Sub-Theme
Full size table

Rights and permissions

Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Chhina, H., Klassen, A.F., Kopec, J.A. et al. What matters to children with lower limb deformities: an international qualitative study guiding the development of a new patient-reported outcome measure. J Patient Rep Outcomes 5, 30 (2021). https://doi.org/10.1186/s41687-021-00299-w

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1186/s41687-021-00299-w

Keywords