- Research
- Open Access
Development and psychometric evaluation of a Dutch-translated shorter Breast Cancer Treatment Outcome Scale (Dutch BCTOS-13)
- Gerson M. Struik1, 4Email authorView ORCID ID profile,
- Frank W. de Jongh1,
- Erwin Birnie2, 3,
- Jean-Philippe Pignol4, 5 and
- Taco M. Klem1
https://doi.org/10.1186/s41687-018-0085-y
© The Author(s) 2018
- Received: 6 August 2018
- Accepted: 8 November 2018
- Published: 3 December 2018
Abstract
Purpose
To create a Dutch translated short version of the Breast Cancer Treatment Outcome Scale (BCTOS) and validate it in patients who have completed both breast conserving surgery and adjuvant radiotherapy.
Methods
The BCTOS consists of items comparing the treated with the untreated breast. After forward and backward translation, we tested the BCTOS-12 plus 5 additional items. Two-hundred breast cancer patients treated with breast conserving therapy (BCT) between January 2016 and December 2017, were asked to complete the BCTOS items twice with a 2 week interval. The EORTC QLQ-BR23 breast and arm symptoms subscales were completed once in parallel. Feasibility was assessed by missing or non-unique answer rates and content validity with floor and ceiling effect analysis. Construct validity was evaluated with 1) principal component analysis (PCA) 2) convergent validity and 3) known groups comparison (clinical validity differentiating between patients with and without locoregional side effects). From all potential items with good feasibility, content and construct validity, items were selected for the Dutch BCTOS based on clinical validity. The relation to the EORTC QLQ-BR23 subscales and reliability was tested for the new Dutch BCTOS.
Results
Hundred and one of 200 (50.5%) approached patients participated in this study, with follow-up after surgery ranging from 5 to 29 months. Feasibility was high (1.5% missing answers). Content validity testing showed a floor effect > 20% in all 17 items. PCA showed that all items loaded well (> 0.4) into the assigned subscale and revealed two distinct subscales: cosmesis and function. Based on clinical validity, item “breast shape” was replaced by “breast elevation/position” and “overall skin appearance”. Very good clinical validity (Cohen’s d = 1.38) was found for the new Dutch BCTOS-13. Correlation to the EORTC QLQ-BR23 subscales was high (ICC = 0.65–0.85) for both subscales. Test-retest reliability (Cohen’s d = 0.105) and internal consistency (Cronbach’s α =0.90) were excellent.
Conclusions
Psychometric evaluation of a newly developed Dutch BCTOS-13 questionnaire in BCT patients showed excellent results, that were slightly better than the original BCTOS-22 and the shortened BCTOS-12. The good clinical validity makes the BCTOS-13 a useful tool to identify patients with unfavourable cosmetic and functional outcomes, requiring specific attention.
Keywords
- BCTOS
- Breast cancer
- Breast conserving treatment
- Cosmesis
- Clinical validity
- Dutch
Introduction
Breast conserving therapy (BCT), consisting of a wide local excision and adjuvant radiotherapy, is equally effective as breast amputation in early stage breast cancer patients [1]. Furthermore, it has cosmetic and functional benefits, which are directly related to patients’ quality of life [2, 3]. Oncoplastic techniques are increasingly used to further improve the cosmetic outcome of the surgical treatment [4]. The effect of high conformal or partial irradiation techniques on cosmetic outcome of adjuvant radiotherapy has been investigated in several clinical trials [5–12] showing benefit in most of these studies. With the excellent oncologic outcomes in this patient group, patient reported outcome measures (PROMs) are increasingly important to indicate healthcare quality and compare different surgical and radiotherapeutic techniques [13–15]. Brouwers et al. found that PROMs can be used to identify breast cancer patients who experience a heavy burden of late side-effects (≥3 months after completion of the radiation treatment), requiring specific attention. The use of PROMs instead of a standard outpatient clinical visit potentially spares visits in those patients with good cosmetic and functional outcomes [16].
Among others, the validated 22-item English Breast Cancer Treatment Outcome Scale (BCTOS) [17] is a questionnaire that is widely used [14, 18–23]. Its outcome is based on the comparison of the treated and untreated breast by the patient. It is clearly structured, comprehensive and assesses the most important aspects of morbidity after BCT. The questionnaire includes a cosmetic, functional and breast sensitivity subscale. The original BCTOS-22 was validated in patients after completing all treatment, so also including radiotherapy in the majority of patients. Therefore, it is widely used as a PROM in radiotherapy clinical trials [23–25].
However, for the best adoption of a questionnaire, besides being valid and comprehensive it should also be concise. Therefore, a shortened 12-item English version (BCTOS-12) has been developed and tested recently. The study by Hennigs et al. [22] showed good validity, without loss of information. In this shortened version the 12 items are assigned to two, instead of three, subscales: aesthetic and functional status. In contrast to the original version, the shortened BCTOS-12 was only validated in patients within a week after surgery.
The aim of the present study is to create a Dutch translated short version of the Breast Cancer Treatment Outcome Scale (BCTOS) and validate it in patients who have completed both breast conserving surgery and adjuvant radiotherapy. A translated version of the English BCTOS-12 was used in this study. As the aim of this study is to create a version of the BCTOS that is specifically valid for use in patients after adjuvant radiotherapy, we included 5 additional exploratory items in the cosmetic subscale, to anticipate for any differences in outcome in our population compared to the study by Hennigs [22]. The additional items were selected on the expectation that cosmesis, and more specifically skin outcome, could be influenced by the adjuvant radiotherapy. Selection of items to be included in the final questionnaire will be based on psychometric properties, specifically focussing on the clinical validity to identify patients with locoregional side effects related to the BCT.
Methods
The protocol of this cross-sectional validation study was reviewed by the TWOR regional medical research ethics committee (MREC), Rotterdam, the Netherlands. Ethical clearance for this study was granted (2018–16).
Study population
Our study population consisted of breast cancer patients treated with BCT, including adjuvant radiotherapy in the vast majority. All patients had their surgical treatment in the period January 2016 to December 2017 in the Franciscus Gasthuis and Vlietland, a large secondary teaching hospital in Rotterdam, the Netherlands. We chose this population as we are aiming to create a PROM that is valid to assess both surgical ánd radiotherapy outcomes. All participants were at least 18 years of age and able to understand the Dutch language. Patients that underwent major reconstructive surgery were excluded, since specific questionnaires have been developed for this group [26]. Bilateral breast cancer and mastectomy patients were excluded, as a comparison between the treated and untreated breast is not possible in these patients. Finally, patients with (planned) locoregional breast cancer treatment during data collection were excluded. All patients gave their written informed consent for study participation.
Study instruments: BCTOS-12, additional exploratory items, the European organization for research and treatment of cancer (EORTC) QLQ-BR23 questionnaire
We used the Hennigs’ BCTOS-12 questionnaire [22] as basis for the items to be tested in our study. The patients in their study were asked to complete the BCTOS questionnaire within a week after surgery. In our study patients will have completed both surgery as well as radiotherapy at a minimum of 2–3 months after surgery. A previous study by Heil et al. [20] found that functional outcome as scored with the BCTOS is stable over time, while cosmetic outcome is not. Therefore, we anticipated on differences in cosmetic outcomes of our study population compared to that of Hennigs’ study [22], by adding five exploratory items to the cosmetic subscale. The three cosmetic subscale items that showed high factor loadings in the original BCTOS (but were removed when the shortened BCTOS-12 was developed) were included for exploration (“breast size”, “breast elevation/position” and “fit of clothing”). Two protocol specific items, that were expected to specifically capture radiotherapy related skin toxicity and fibrosis, were also included for exploration ( “overall skin appearance” and “overall breast appearance”). These five exploratory items are also in use in ongoing breast radiotherapy clinical trials [27–29] to investigate cosmetic outcome.
The final questionnaire consists of 17 items, which are assigned to two subscales; 12 in a cosmetic subscale, 5 in a functional subscale. For details see Additional file 1. Patients were asked to rate each item of the questionnaire on a four-point scale evaluating the differences between the treated and the untreated breast (1 = no difference, 2 = slight difference, 3 = moderate difference, 4 = large difference). The score for each subscale is the unweighted mean of the ratings over all items belonging to that subscale. A higher score reflects less symmetry between the treated and the untreated breast and is therefore considered a measure of poor status.
An additional questionnaire containing 7-items of the EORTC QLQ-BR23 (Additional file 2) was completed once for external convergent validity testing. We chose this questionnaire as it is widely used and available and validated in the Dutch language [30]. We only used the two relevant subscales of the EORTC QLQ-BR23 assessing the same determinants as the BCTOS; breast symptoms subscale to compare with the BCTOS cosmetic subscale and arm symptoms subscale to compare with the BCTOS functional subscale.
Development of the Dutch BCTOS
The Dutch BCTOS was developed according to the adaptation process as described by Bullinger et al. [31]. A forward translation of the 17 items from English into Dutch was performed by three Dutch native speakers with extensive knowledge of the English language. The aim was to obtain conceptual equivalence using simple language, rather than achieving a literal translation. Any difficulties in the translation were discussed with the principal investigator until consensus was reached on an optimal Dutch phrasing. A backward translation to English was performed by two native English speakers who are fluent in Dutch. These backward translations were compared with the original items, and any differences were analysed. Finally, necessary changes in the formulation of the Dutch version were made in order to arrive at the exact original English formulation after backtranslation.
The pilot version (Additional file 3) was tested in five patients treated with BCT in our centre. They were asked to comment on readability and comprehension of the questionnaire. No relevant comments were made, so no additional changes were made hereafter.
Study design
Included patients were invited to complete the 17 items BCTOS pilot questionnaire twice with a two week interval for psychometric data collection. EORTC QLQ-BR23 breast and arm symptoms subscales were added in parallel with the first BCTOS for external convergent validation purposes.
Psychometric evaluation
Psychometric evaluation consisted of the following analyses. These analyses were based on pairwise complete data of items in the first BCTOS and the EORTC QLQ BR-23. Data from the second BCTOS was only used for test-retest analysis.
Feasibility
Missing (no option chosen) or non-unique responses (> 1 option chosen) were considered invalid and reported as n and percentages. Feasibility of the questionnaire was evaluated by response rates and missing answer percentages. Questionnaires with more than one invalid response were excluded from further analyses. There is no recommendation on handling missing data by the authors of the original BCTOS or BCTOS-12. With only 4 out of 105 patients excluded in our study, it is unlikely that this has impacted the outcome of this study.
Content validity
Floor and ceiling effects were measured by calculating the percentage of patients scoring the minimum (floor) and maximum (ceiling) score for each item [26].
Construct validity
1. PCA
Since the original BCTOS-22 consists of 3 subscales (cosmetic status, functional status and breast specific pain) and Hennigs’ shortened BCTOS-12 uses 2 subscales (aesthetic and functional status) we considered both a 2 and 3 factor solution. Two criteria were used to assess the validity of both options: Kaiser criterion (Eigen values> 1) and a scree plot analysis.
To identify items that did not load distinctly on a single factor, a principal component analysis with orthogonal Varimax rotation was performed on the original factor loadings. We used the same criteria as the original BCTOS development study [17] to select items eligible for exclusion from the questionnaire: items with a low (< 0.4) factor loading on their main factor and a high loading on the other factor (> 0.3).
2. Convergent validity
Convergent validity was assessed on the item and subscale level. Convergent validity of an item was confirmed when item-total correlation with the assigned subscale was high (ICC > 0.4) and discriminant validity was confirmed when an item had an ICC with the assigned subscale that was > 2 standard errors higher than its ICC with the other subscale .
3a. Known group comparison
It was hypothesized that the new Dutch BCTOS would be clinically valid by identifying patients with radiotherapy or surgery related toxicity. Toxicity scoring as performed by the treating physicians (i.e. surgeons/radiation oncologists) during clinical follow-up visits and recorded in the electronic patient file, according to RTOG/EORTC [32], LENTSOMA [33], and CTCAE [34] toxicity scales, was used in our analysis. The clinical validity per item was assessed with the effect size [35] and an unpaired Student’s t test for both all grades and ≥ grade 2 toxicity.
3b. Selection of the items to form the new Dutch BCTOS
As the aim of this study is to create a Dutch version of the BCTOS that is clinically valid for use in patients treated with both breast conserving surgery and adjuvant radiotherapy, final decision on the selection of items was made based on the known group comparison analysis. The shortened BCTOS-12 set of items was the starting point. If any of the 5 additional exploratory items showed good content and convergent validity ánd showed better clinical validity than any of the retained original items, this could result in a replacement of that item. This decision was made after a meeting of the research group, before continuing further analysis for the new set of BCTOS items.
4. Relationship to the EORTC QLQ-BR23
Convergent validity of the conceptual related subscales of the new BCTOS (cosmesis and function) and the acknowledged EORTC QLQ-BR23 (breast symptoms and arm symptoms) was assessed using interclass correlation coefficient (ICC model [36]: two-way mixed-a fixed number of instruments and all instruments are used in all patients (thereby, instruments and patients are two sources of data variation); single measures-as based on the individual patient data in the study instead of group averages; consistency- scores are measured on different scales).
Reliability
Two aspects of reliability were evaluated. To assess whether items evaluate the same concept (cosmesis, function), internal consistency of subscale items was measured using Cronbach’s α, which should exceed 0.70 [37].
Test–retest reliability was assessed with the intraclass correlations (ICC model [36], two-way mixed - a fixed number of instruments and all instruments are used in all patients (thereby, instruments and patients are two sources of data variation); single measures - as based on the individual patient data in the study instead of group averages; absolute agreement - scores are measured on the same scale) and effect size (Cohen’s d calculated as d = mean difference (retest-test)/SDtest [38] and interpreted as 0.01 ≤ d < 0.2 = very small, 0.2 ≤ d < 0.5 = small, 0.5 ≤ d < 0.8 = medium, 0.8 ≤ d < 1.2 = large, 1.2 ≤ d < 2.0 = very large, and d ≥ 2.0 = huge) [39].
Descriptive statistics were used to describe the study sample. All statistical tests were performed with IBM SPSS Statistics version 24.0, with two-sided p-values below 0.05 considered statistically significant. In case of one missing answer, that item was not included in the subscale average score.
Results
Study sample
Patient characteristics
Total patients | 101 |
|---|---|
Median age, years (range) | 61 (39–86) |
Type of surgery | |
Lumpectomy only | 5 (5.0%) |
Lumpectomy + SNB | 81 (80.2%) |
Lumpectomy + ALND | 6 (5.9%) |
Lumpectomy + SNB + volume replacement (level 2) | 5 (5.0%) |
Lumpectomy + ALND + volume replacement (level 2) | 2 (2.0%) |
Wedge resection for Paget’s disease | 2 (2.0%) |
Follow-up since surgery, months, median (range) | 14.9 (5–29) |
History of breast radiotherapy | 97 (96.0%) |
Axillary radiotherapy | 6 (5.9%) |
Locoregional side-effectsa | |
Any surgery or radiotherapy related | 56 (61%) |
Radiotherapy related | 29 (32%) |
Surgery related | 13 (14%) |
Radiotherapy and surgery related | 14 (15%) |
Grade 1 | 26 (28%) |
Grade 2 | 24 (26%) |
Grade 3 | 6 (7%) |
Feasibility
Missing answer rate for the BCTOS was 1.5%, ranging from 0% (item 2, 5-7, 13–17) to 4.0% (item 3, 8, 10). Four patients were excluded for further analysis because of > 1 missing answers in any of the questionnaires.
Content validity
The proportion minimum score of “1” (floor effect) was 0.46 (SD = 0.18), ranging from 0.24 (item 11) to 0.83 (item 17). A floor effect > 20% occurred in 17/17 items.
The proportion of maximum score of “4” (ceiling effect) was 0.08 (SD = 0.04), ranging from 0.01 (item 17) to 0.14 (item 3). A ceiling effect > 20% occurred in 0/17 items.
This means there is a floor effect and no ceiling effect in all the BCTOS items tested.
Construct validity
1.PCA
Based on the Kaiser criterion and scree plot analysis, a two or three factor solution would be possible: Eigenvalue of 2.5 for 2 subscales with a cumulative explained variance of 58.6%, or Eigenvalue of 1.1 for 3 subscales with a cumulative explained variance of 65.3%. The difference between the two and three factor solution was that the items “breast texture”, “nipple appearance”, “scar tissue”, “breast sensitivity” and “breast tenderness” were forming a separate subscale in the three factor solution. However, with the Eigen value being only slightly > 1 and the difficulty to create three clinically relevant subscales based on the pattern of factor loadings, we opted for the two factor solution for further analysis.
Principal component analysis. Items and factor loadings of all items explored for the Dutch BCTOS
Item | Subscale | |
|---|---|---|
Cosmesis | Function | |
1 Breast sizea | 0.77 | 0.01 |
2 Breast texture (hardening) | 0.67 | 0.37 |
3 Nipple appearance | 0.63 | 0.17 |
4 Breast shape | 0.69 | 0.19 |
5 Breast elevation/positiona | 0.65 | 0.32 |
6 Scar tissue | 0.63 | 0.04 |
7 Breast swelling | 0.50 | 0.45 |
8 Fit of bra | 0.80 | 0.20 |
9 Breast sensitivity | 0.73 | 0.18 |
10 Fit of clothinga | 0.69 | 0.03 |
11 Overall breast appearancea | 0.85 | 0.10 |
12 Overall skin appearancea | 0.72 | 0.27 |
13 Breast tenderness | 0.48 | 0.40 |
14 Arm heaviness | 0.19 | 0.90 |
15 Shoulder discomfort | 0.11 | 0.81 |
16 Arm discomfort | 0.19 | 0.89 |
17 Arm swelling | 0.06 | 0.85 |
All five additional cosmetic items had high factor loadings (range 0.65–0.85) for cosmesis and low factor loadings for function (range 0.01–0.32). Cronbach’s α if item deleted, was very similar for all cosmetic items (range 0.91–0.92). Also, all the additional exploratory items were highly correlated (ICC > 0.6) with at least one of the shortened BCTOS-12 cosmetic items.
2. Convergent validity
Convergent validity was confirmed for all 17 items. Discriminant ability was also confirmed for all items.
3a.Known group comparison
Of the retained original items, “breast shape” showed poorest clinical validity to differentiate between patients with and without locoregional radiotherapy or surgery related side effects, with very small effect sizes (Cohen’s d = 0.34 for any grade and 0.11 for ≥ grade 2).
Of the five additional items tested, “overall skin appearance” showed a large effect size for side effects of any grade (Cohen’s d = 1.18) and medium effect size for ≥ grade 2 (Cohen’s d = 0.71). “Breast elevation/position” showed large effect size for side effects of any grade (Cohen’s d = 1.00) and medium effect size for ≥ grade 2 (Cohen’s d = 0.62). The other items showed only small effect sizes, meaning little clinical validity.
3b. Selection of the items to form the new Dutch BCTOS-13
Principal component analysis. Items and factor loadings of the all items in the new Dutch BCTOS-13
Item | Subscale | |
|---|---|---|
Cosmesis | Function | |
1 Breast texture (hardening) | 0.78 | 0.27 |
2 Nipple appearance | 0.63 | 0.10 |
3 Breast elevation/position | 0.63 | 0.31 |
4 Scar tissue | 0.70 | −0.05 |
5 Breast swelling | 0.58 | 0.41 |
6 Fit of bra | 0.78 | 0.18 |
7 Breast sensitivity | 0.77 | 0.11 |
8 Overall skin appearance | 0.79 | 0.20 |
9 Breast tenderness | 0.61 | 0.30 |
10 Arm heaviness | 0.22 | 0.90 |
11 Shoulder discomfort | 0.14 | 0.81 |
12 Arm discomfort | 0.24 | 0.88 |
13 Arm swelling | 0.12 | 0.85 |
Correlations (ICCs[95% CI]) of the new Dutch BCTOS-13 with arm and breast symptoms EORTC QLQ-BR23 subscales
EORTC QLQ-BR23 subscale | BCTOS-13 cosmesis | BCTOS-13 function | BCTOS-13 total |
|---|---|---|---|
Breast symptoms | 0.65 [0.52-0.75] | 0.59 [0.44-0.70] | 0.74 [0.63-0.82] |
Arm symptoms | 0.37 [0.18-0.53] | 0.85 [0.78-0.90] | 0.62 [0.47-0.73] |
Total | 0.58 [0.43-0.70] | 0.75 [0.65-0.83] | 0.75 [0.64-0.82] |
Reliability analysis showing the test-retest effect sizes and intra-class correlation coefficient (ICC) and internal consistency
Test re-test reliability (n = 93) | Correlation, | Internal consistency a | ||||||
|---|---|---|---|---|---|---|---|---|
BCTOS item | Test | Re-test | Effect size | ICC [95% CI] | Cronbach’s α | |||
Mean | SD | Mean | SD | Cohen’s d | Test re-test, n = 93 | Item-subscale totalabn = 101 | n = 101 | |
Cosmetic subscalea | 1.95 | 0.69 | 1.88 | 0.61 | 0.112 | 0.89 [0.84–0.93] | 0.89 | |
1 Breast texture (hardening) | 2.06 | 0.92 | 2.03 | 0.83 | 0.034 | 0.82 [0.74–0.87] | 0.79 [0.69–0.85] | |
2 Nipple appearance | 1.93 | 1.08 | 1.86 | 1.05 | 0.074 | 0.85 [0.78–0.90] | 0.60 [0.45–0.72] | |
3 Breast elevation/position | 1.86 | 1.00 | 1.81 | 0.92 | 0.053 | 0.76 [0.66–0.84] | 0.65 [0.52–0.75] | |
4 Scar tissue | 2.12 | 0.94 | 2.09 | 0.86 | 0.034 | 0.82 [0.74–0.88] | 0.60 [0.45–0.71] | |
5 Breast swelling | 1.62 | 0.91 | 1.50 | 0.79 | 0.132 | 0.83 [0.75–0.89] | 0.62 [0.39–0.76] | |
6 Fit of bra | 1.84 | 0.93 | 1.71 | 0.90 | 0.130 | 0.76 [0.66–0.84] | 0.75 [0.65–0.83] | |
7 Breast sensitivity | 2.15 | 0.99 | 2.05 | 0.94 | 0.099 | 0.72 [0.60–0.80] | 0.70 [0.56–0.79] | |
8 Overall skin appearance | 1.85 | 0.88 | 1.70 | 0.78 | 0.172 | 0.79 [0.69–0.86] | 0.77 [0.67–0.84] | |
9 Breast tenderness | 2.11 | 0.97 | 2.07 | 0.93 | 0.043 | 0.79 [0.71–0.86] | 0.63 [0.49–0.74] | |
Functional subscalea | 1.46 | 0.73 | 1.43 | 0.67 | 0.032 | 0.90 [0.86–0.93] | 0.90 | |
10 Arm heaviness | 1.49 | 0.87 | 1.51 | 0.85 | 0.024 | 0.84 [0.78–0.89] | 0.92 [0.88–0.95] | |
11 Shoulder discomfort | 1.49 | 0.93 | 1.48 | 0.87 | 0.011 | 0.83 [0.75–0.88] | 0.84 [0.77–0.89] | |
12 Arm discomfort | 1.60 | 0.89 | 1.55 | 0.87 | 0.058 | 0.86 [0.80–0.90] | 0.91 [0.86–0.94] | |
13 Arm swelling | 1.24 | 0.58 | 1.19 | 0.47 | 0.090 | 0.87 [0.81–0.91] | 0.78 [0.69–0.85] | |
All itemsa | 1.80 | 0.62 | 1.74 | 0.56 | 0.105 | 0.91 [0.87–0.94] | 0.90 | |
4. Relationship to EORTC QLQ-BR23
Convergent validity testing showed that correlation to the EORTC QLQ BR23 subscales was high for both the functional (ICC = 0.85 (95%CI [0.78–0.90]) and the new cosmetic subscale (ICC = 0.65 (95%CI [0.52–0.75]) (Table 4).
Reliability (Table 5)
Mean BCTOS-13 scores were 1.81 (SD = 0.62) in the test versus 1.74 (SD = 0.56) in the re-test and test-retest effect size was very small, Cohen’s d = 0.105. There was a high correlation between the test and re-test BCTOS-13 scores, ICC was 0.91 (95%CI[0.87–0.94]). A high correlation was also found on a subscale and single-item level (Table 5).
Internal consistency was high; Cronbach’s α was 0.90 for all Dutch BCTOS-13 items, 0.89 for the cosmetic subscale and 0.90 for the functional subscale.
Discussion
The aim of this study was to validate a Dutch translation of the BCTOS with a specific focus on the clinical validity in patients treated with breast conserving surgery ánd adjuvant radiotherapy.
The original BCTOS was developed to create a measure of perceived aesthetic and functional status after breast-conserving surgical treatment (BCT) and radiotherapy. It was validated in patients after completion of all locoregional treatment. The BCTOS is clearly structured, with the patient comparing the treated with the untreated breast. Although the BCTOS-22 is widely used, a shorter version, with any redundant items removed might be more practical and further improve clinical adoption. We used the recently validated shortened version, the BCTOS-12, as a base for our translated version. As our goal was to create a PROM valid to differentiate between favourable and unfavourable BCT outcomes, we tested five additional items in the cosmetic subscale. By doing this, we anticipated for specifically better capturing unfavourable radiotherapy outcomes in our study population. The reason to do this was that we included patient after completing all locoregional treatment with a broad range of 5 to 29 months follow-up after surgery, instead of 1 week post-surgery in the study by Hennigs [22]. The additional exploratory items were selected on the expectation that cosmesis, and more specifically skin outcome, could be influenced by the adjuvant radiotherapy. We did not expect any differences in functional outcomes, as very few patients received axillary radiotherapy or axillary lymph node dissection. Also, a previous study by Heil et al. [20] found that functional outcome as scored with the BCTOS is stable over time, while cosmetic outcome is not.
Psychometric evaluation of the proposed new Dutch BCTOS items showed comparable to slightly better results than both the original version and the shortened BCTOS-12. Feasibility was high, with an overall missing answer rate of only 1.5% (compared to 5.5% for the English BCTOS-12) [22] and construct and convergent validity was good. Clinical validity testing resulted in the removal of one item from the BCTOS-12 (“breast shape”). Two of the additional exploratory items tested (“breast elevation/position” and “overall skin appearance”) showed specific value in differentiation between favourable and unfavourable BCT outcome and were added to form the new Dutch BCTOS-13. Consistent with the study by Hennigs [22], this questionnaire comprises two subscales: cosmesis and function.
Reliability was high with only a very small test-retest effect size (Cohen’s d = 0.105). Internal consistency was high with a Cronbach’s α of 0.89 for the cosmetic subscale and 0.90 for the functional subscale. This is comparable to the original BCTOS-22 questionnaire that showed an Cronbach’s α of 0.89 for cosmesis and a 0.91 for function. Notably, internal consistency of our Dutch BCTOS-13 is higher than the English BCTOS-12, which showed an α of 0.86 and 0.81 respectively.
Correlation to the EORTC BR23 subscales was stronger for our BCTOS-13 (strong for functional subscale to arm symptoms and moderate for cosmetic subscale to breast symptoms) compared to both the English original BCTOS-22 and the shortened BCTOS-12 (weak to moderate for both subscales). The higher internal consistency and correlation to the EORTC BR23 that was found in our study than in the BCTOS-13 study, might be explained by the timing of filling out the questionnaire. We hypothesize that patients are more consistent after getting used to certain symptoms or treatment outcomes (reduction of post-surgery complaints, perhaps adaptation and/or coping). This higher consistency will also increase correlation between the two conceptual comparable questionnaires (i.e. BCTOS and EORTC BR23).
Content validity analysis showed that in this study there was a floor effect> 20% in all items. This effect was most prominent in the functional subscale, with a mean proportion of minimum scores of 71%, compared to 34% in the cosmetic subscale. In the studies by Stanton et al. and Hennig et al. no floor/ceiling effect analysis was reported. However, the distribution of scores was comparable in the original BCTOS and the shortened BCTOS-12, which would probably result in a similar floor effect in those studies, although not reported.
The floor effect that was found, could be considered as a limitation of the BCTOS. However, with the good cosmetic and functional outcomes in BCT patients this finding was expected to occur in our study, consistent with other studies testing the BCTOS in BCT patients [17, 22]. In our study only 8 patients underwent axillary lymph node dissection and in 6 patients the axilla was irradiated. Results might be different in a high risk patient population undergoing breast conserving surgery. We would not recommend changing a scale that is already widely used, as this will impede comparison between studies. A better option would be to use the categories to interpret scores as suggested by Hennigs [22]: good (1.00–1.75); intermediate (1.76–2.50), fair (2.51–3.25), and poor (3.26–4.00) outcome. More important here is the good clinical validity of the Dutch BCTOS-13 that was demonstrated, which supports clinical use of the BCTOS to differentiate between favourable and unfavourable BCT outcomes.
Another limitation of our study was that we only used the two relevant EORTC subscales (breast symptoms and arm symptoms), instead of the complete EORTC QLQ-BR23 questionnaire. We chose to specifically focus on locoregional outcome, thereby limiting patient burden for participation. Doing this is common, related studies also analyzed correlation on a subscale level. However, therefore we were not able to draw any conclusions on the correlation between cosmetic and functional outcomes with overall quality of life. The previously found strong correlation between functional outcome and overall quality of life should be confirmed in subsequent research. Furthermore, our study population was quite homogenous regarding the received treatment. The vast majority underwent lumpectomy with sentinel node biopsy and adjuvant whole breast irradiation. Results might be different in other patient groups undergoing axillary lymph node dissection and/or irradiation, level 2 oncoplastic surgery or partial breast irradiation more frequently. Further validation should be performed in these specific patient groups. On the other hand, our study population was very heterogeneous regarding time after surgery, ranging from 5 to 29 months. This means that all of our patients completed locoregional treatment. Therefore, in contrast to the study by Hennigs [22], our questionnaire has now been validated for use in both breast cancer surgery and adjuvant radiotherapy.
Implications of our study findings are the recommendation to use the Dutch BCTOS-13 questionnaire as a PROM in all breast cancer research assessing cosmetic and functional outcome after adjuvant radiotherapy in the Netherlands. Clinical validity is superior to the commonly used EORTC QLQ-BR23 for this specific patient group. The BCTOS-13 could be used to identify patients with unfavourable BCT cosmetic and functional outcomes that require specific attention. Furthermore, in patients with favourable outcome, using the BCTOS-13 potentially reduces the need for clinical visits to assess BCT outcome.
In conclusion, we developed a shorter Dutch version of the BCTOS (Dutch BCTOS-13). Despite the reduced number of items, psychometric evaluation showed excellent results that were slightly better than the original BCTOS-22 and the shortened BCTOS-12. The design makes it suitable for assessment of cosmetic and functional outcomes in patients treated with breast conserving surgery ánd adjuvant radiotherapy.
Declarations
Acknowledgements
We thank all participating patients, our panel of native Dutch and English speakers for providing the translations and Cora Hazelzet for her support in data collection and entry.
Funding
GS receives a financial research support through the Theia Foundation (nr. 2016244), the Coolsingel Foundation (nr. 444) and the Franciscus Friends Fund (brachytherapy for breast cancer research project, no grant number available). The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript.
Availability of data and materials
The datasets generated and analyzed during the current study are available from the corresponding author on reasonable request.
Authors’ contributions
GS, EB, JP and TK conceived the study design. GS and FJ collected study data. Statistical analysis was performed by GS, FW and EB. GS, FJ and EB wrote the manuscript. All authors made contributions in revising the content, read and approved the final manuscript.
Ethics approval and consent to participate
All procedures performed in studies involving human participants were in accordance with the ethical standards of the institutional and/or national research committee and with the 1964 Helsinki Declaration and its later amendments or comparable ethical standards. The protocol of this study was reviewed by the TWOR regional medical research ethics committee (MREC), Rotterdam, the Netherlands. Ethical clearance for this study was granted (2018–16). Informed consent was obtained from all individual participants included in the study.
Consent for publication
Not applicable.
Competing interests
The authors declare that they have no competing interests.
Publisher’s Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Open AccessThis article is distributed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made.
Authors’ Affiliations
References
- Early Breast Cancer Trialists’ Collaborative, G, Darby, S., McGale, P., Correa, C., Taylor, C., Arriagada, R., et al. (2011). Effect of radiotherapy after breast-conserving surgery on 10-year recurrence and 15-year breast cancer death: Meta-analysis of individual patient data for 10,801 women in 17 randomised trials. Lancet, 378(9804), 1707–1716. https://doi.org/10.1016/S0140-6736(11)61629-2.View ArticleGoogle Scholar
- Kim, M. K., Kim, T., Moon, H. G., Jin, U. S., Kim, K., Kim, J., et al. (2015). Effect of cosmetic outcome on quality of life after breast cancer surgery. European journal of surgical oncology, 41(3), 426–432. https://doi.org/10.1016/j.ejso.2014.12.002.View ArticlePubMedGoogle Scholar
- Sun, Y., Kim, S. W., Heo, C. Y., Kim, D., Hwang, Y., Yom, C. K., et al. (2014). Comparison of quality of life based on surgical technique in patients with breast cancer. Japanese journal of clinical oncology, 44(1), 22–27. https://doi.org/10.1093/jjco/hyt176.View ArticlePubMedGoogle Scholar
- Clough, K. B., Kaufman, G. J., Nos, C., Buccimazza, I., & Sarfati, I. M. (2010). Improving breast cancer surgery: A classification and quadrant per quadrant atlas for oncoplastic surgery. Annals of surgical oncology, 17(5), 1375–1391. https://doi.org/10.1245/s10434-009-0792-y.View ArticlePubMedGoogle Scholar
- Livi, L., Meattini, I., Marrazzo, L., Simontacchi, G., Pallotta, S., Saieva, C., et al. (2015). Accelerated partial breast irradiation using intensity-modulated radiotherapy versus whole breast irradiation: 5-year survival analysis of a phase 3 randomised controlled trial. European journal of cancer, 51(4), 451–463. https://doi.org/10.1016/j.ejca.2014.12.013.View ArticlePubMedGoogle Scholar
- Olivotto, I. A., Whelan, T. J., Parpia, S., Kim, D. H., Berrang, T., Truong, P. T., et al. (2013). Interim cosmetic and toxicity results from RAPID: A randomized trial of accelerated partial breast irradiation using three-dimensional conformal external beam radiation therapy. Journal of clinical oncology, 31(32), 4038–4045. https://doi.org/10.1200/JCO.2013.50.5511.View ArticlePubMedGoogle Scholar
- Polgar, C., Fodor, J., Major, T., Sulyok, Z., & Kasler, M. (2013). Breast-conserving therapy with partial or whole breast irradiation: Ten-year results of the Budapest randomized trial. Radiotherapy and oncology, 108(2), 197–202. https://doi.org/10.1016/j.radonc.2013.05.008.View ArticlePubMedGoogle Scholar
- Rabinovitch, R., Winter, K., Kuske, R., Bolton, J., Arthur, D., Scroggins, T., et al. (2014). RTOG 95-17, a phase II trial to evaluate brachytherapy as the sole method of radiation therapy for stage I and II breast carcinoma--year-5 toxicity and cosmesis. Brachytherapy, 13(1), 17–22. https://doi.org/10.1016/j.brachy.2013.08.002.View ArticlePubMedGoogle Scholar
- Rodriguez, N., Sanz, X., Dengra, J., Foro, P., Membrive, I., Reig, A., et al. (2013). Five-year outcomes, cosmesis, and toxicity with 3-dimensional conformal external beam radiation therapy to deliver accelerated partial breast irradiation. Int J Radiat Oncol Biol Phys, 87(5), 1051–1057. https://doi.org/10.1016/j.ijrobp.2013.08.046.View ArticlePubMedGoogle Scholar
- Shah, C., Khwaja, S., Badiyan, S., Wilkinson, J. B., Vicini, F. A., Beitsch, P., et al. (2013). Brachytherapy-based partial breast irradiation is associated with low rates of complications and excellent cosmesis. Brachytherapy, 12(4), 278–284. https://doi.org/10.1016/j.brachy.2013.04.005.View ArticlePubMedGoogle Scholar
- Strnad, V., Ott, O. J., Hildebrandt, G., Kauer-Dorner, D., Knauerhase, H., Major, T., et al. (2016). 5-year results of accelerated partial breast irradiation using sole interstitial multicatheter brachytherapy versus whole-breast irradiation with boost after breast-conserving surgery for low-risk invasive and in-situ carcinoma of the female breast: A randomised, phase 3, non-inferiority trial. Lancet, 387(10015), 229–238. https://doi.org/10.1016/S0140-6736(15)00471-7.View ArticlePubMedGoogle Scholar
- Vicini, F. A., Chen, P., Wallace, M., Mitchell, C., Hasan, Y., Grills, I., et al. (2007). Interim cosmetic results and toxicity using 3D conformal external beam radiotherapy to deliver accelerated partial breast irradiation in patients with early-stage breast cancer treated with breast-conserving therapy. International journal of radiation oncology, biology, physics, 69(4), 1124–1130. https://doi.org/10.1016/j.ijrobp.2007.04.033.View ArticlePubMedGoogle Scholar
- Hu, E. S., Pusic, A. L., Waljee, J. F., Kuhn, L., Hawley, S. T., Wilkins, E., et al. (2009). Patient-reported aesthetic satisfaction with breast reconstruction during the long-term survivorship period. Journal of plastic surgery and hand surgery, 124(1), 1–8. https://doi.org/10.1097/PRS.0b013e3181ab10b2.View ArticleGoogle Scholar
- Kanatas, A., Velikova, G., Roe, B., Horgan, K., Ghazali, N., Shaw, R. J., et al. (2012). Patient-reported outcomes in breast oncology: A review of validated outcome instruments. Tumori, 98(6), 678–688. https://doi.org/10.1700/1217.13489.View ArticlePubMedGoogle Scholar
- Ou, K. W., Yu, J. C., Ho, M. H., Chiu, W. K., Ou, K. L., Chen, T. M., et al. (2015). Oncological safety and outcomes of nipple-sparing mastectomy with breast reconstruction: A single-centered experience in Taiwan. Annals of plastic surgery, 74(Suppl 2), S127–S131. https://doi.org/10.1097/SAP.0000000000000458.View ArticlePubMedGoogle Scholar
- Brouwers, P. J. A. M., van Loon, J., Houben, R. M. A., Paulissen, J., Engelen, S. M. E., Heuts, M., et al. (2018). Are PROMs sufficient to record late outcome of breast cancer patients treated with radiotherapy? A comparison between patient and clinician reported outcome through an outpatient clinic after 10years of follow up. Radiotherapy and Oncology, 126(1), 163–169. https://doi.org/10.1016/j.radonc.2017.08.004.View ArticleGoogle Scholar
- Stanton, A. L., Krishnan, L., & Collins, C. A. (2001). Form or function? Part 1. Subjective cosmetic and functional correlates of quality of life in women treated with breast-conserving surgical procedures and radiotherapy. Cancer, 91(12), 2273–2281.View ArticleGoogle Scholar
- Chen, C. M., Klassen, A. F., Cano, S. J., & Pusic, A. L. (2011). BCTOS in measuring HR-QoL after breast-conserving therapy. The Breast Journal, 17(4), 443–443. https://doi.org/10.1111/j.1524-4741.2011.01107.x.View ArticleGoogle Scholar
- Costa Vieira, R., Brandini Silva, F., da Silva, J., Ferreira, L., Santos Paulista, J., Alves de Lima, M., et al. (2017). Aesthetic and functional results of quality of life after breast conserving surgery evaluated by Portuguese/Brazil version of breast cancer treatment outcome scale (BCTOS). The Breast, 32, S131. https://doi.org/10.1016/s0960-9776(17)30408-3.View ArticleGoogle Scholar
- Heil, J., Czink, E., Golatta, M., Schott, S., Hof, H., Jenetzky, E., et al. (2011). Change of aesthetic and functional outcome over time and their relationship to quality of life after breast conserving therapy. European journal of surgical oncology, 37(2), 116–121. https://doi.org/10.1016/j.ejso.2010.11.007.View ArticlePubMedGoogle Scholar
- Heil, J., Holl, S., Golatta, M., Rauch, G., Rom, J., Marme, F., et al. (2010). Aesthetic and functional results after breast conserving surgery as correlates of quality of life measured by a German version of the breast Cancer treatment outcome scale (BCTOS). Breast, 19(6), 470–474. https://doi.org/10.1016/j.breast.2010.05.004.View ArticlePubMedGoogle Scholar
- Hennigs, A., Heil, J., Wagner, A., Rath, M., Moosbrugger, H., Kelava, A., et al. (2018). Development and psychometric validation of a shorter version of the breast Cancer treatment outcome scale (BCTOS-12). Breast, 38, 58–65. https://doi.org/10.1016/j.breast.2017.12.002.View ArticlePubMedGoogle Scholar
- Pignol, J. P., Truong, P., Rakovitch, E., Sattler, M. G., Whelan, T. J., & Olivotto, I. A. (2016). Ten years results of the Canadian breast intensity modulated radiation therapy (IMRT) randomized controlled trial. Radiotherapy and oncology, 121(3), 414–419. https://doi.org/10.1016/j.radonc.2016.08.021.View ArticlePubMedGoogle Scholar
- Jethwa, K. R., Kahila, M. M., Mara, K. C., Harmsen, W. S., Routman, D. M., Pumper, G. M., et al. (2018). Patient-reported outcomes of catheter-based accelerated partial breast brachytherapy and whole breast irradiation, a single institution experience. Breast cancer research and treatment, 169(1), 189–196. https://doi.org/10.1007/s10549-018-4665-6.View ArticlePubMedGoogle Scholar
- Swanick, C. W., Lei, X., Shaitelman, S. F., Schlembach, P. J., Bloom, E. S., Fingeret, M. C., et al. (2016). Longitudinal analysis of patient-reported outcomes and cosmesis in a randomized trial of conventionally fractionated versus hypofractionated whole-breast irradiation. Cancer, 122(18), 2886–2894. https://doi.org/10.1002/cncr.30121.View ArticlePubMedPubMed CentralGoogle Scholar
- Winters, Z. E., Afzal, M., Rutherford, C., Holzner, B., Rumpold, G., da Costa Vieira, R. A., et al. (2018). International validation of the European Organisation for Research and Treatment of Cancer QLQ-BRECON23 quality-of-life questionnaire for women undergoing breast reconstruction. The British journal of surgery, 105(3), 209–222. https://doi.org/10.1002/bjs.10656.View ArticlePubMedGoogle Scholar
- Coles, C. E., Griffin, C. L., Kirby, A. M., Titley, J., Agrawal, R. K., Alhasso, A., et al. (2017). Partial-breast radiotherapy after breast conservation surgery for patients with early breast cancer (UK IMPORT LOW trial): 5-year results from a multicentre, randomised, controlled, phase 3, non-inferiority trial. Lancet, 390(10099), 1048–1060. https://doi.org/10.1016/s0140-6736(17)31145-5.
- Struik, GMJG, Verduijn, GM, Kolkman-Deurloo, IKK, de Vries, KC, de Boer, R, et al. (2017). A randomized controlled trial testing a hyaluronic acid spacer injection for skin toxicity reduction for brachytherapy accelerated partial breast irradiation (APBI): a study protocol. http://www.trialregister.nl/trialreg/admin/rctview.asp?TC=6549. Accessed 25 June 2018.Google Scholar
- Crook, J., & Pignol, J. P. (2016). A Multicenter Registry Study of Breast Microseed Treatment for Early Stage Breast Cancer. https://clinicaltrials.gov/ct2/show/NCT02701244. Accessed 16 Oct 2018.Google Scholar
- Sprangers, M. A., Groenvold, M., Arraras, J. I., Franklin, J., Velde, A. t., Muller, M., et al. (1996). The European Organization for Research and Treatment of Cancer breast cancer-specific quality-of-life questionnaire module: First results from a three-country field study. Journal of Clinical Oncology, 14(10), 2756–2768. https://doi.org/10.1200/jco.1996.14.10.2756.View ArticlePubMedGoogle Scholar
- Bullinger, M., Alonso, J., Apolone, G., Leplege, A., Sullivan, M., Wood-Dauphinee, S., et al. (1998). Translating health status questionnaires and evaluating their quality: The IQOLA project approach. International quality of life assessment. Journal of clinical epidemiology, 51(11), 913–923.View ArticleGoogle Scholar
- Cox, J. D., Stetz, J., & Pajak, T. F. (1995). Toxicity criteria of the radiation therapy oncology group (RTOG) and the European Organization for Research and Treatment of Cancer (EORTC). International journal of radiation oncology, biology, physics, 31(5), 1341–1346. https://doi.org/10.1016/0360-3016(95)00060-c.View ArticlePubMedGoogle Scholar
- Radiation Therapy Oncology Group (RTOG) and Late Effects Normal Tissue Task Force (1995). LENT SOMA scales for all anatomic sites. International journal of radiation oncology, biology, physics, 31(5), 1049–1091.Google Scholar
- CTCAE 4.03 quick reference. https://evs.nci.nih.gov/ftp1/CTCAE/CTCAE_4.03/CTCAE_4.03_2010-06-14_QuickReference_8.5x11.pdf. Accessed 2 Feb 2018.
- Borenstein, M. (2009). Effect sizes for continuous data. In L. V. H. H. Cooper & J. C. Valentine (Eds.), The handbook of research synthesis and meta analysis (pp. 221–237). New York: Russell Sage Foundation.Google Scholar
- Streiner, D. L., Norman, G. R., & Cairney, J. (2014). Health measurement scales. A practical guide to their development and use (5th ed.). Oxford: Oxford University Press.Google Scholar
- Bland, J. M., & Altman, D. G. (1997). Cronbach's alpha. BMJ, 314(7080), 572.View ArticleGoogle Scholar
- Becker, B. J. (1988). Synthesizing standardized mean-change measures. British Journal of Mathematical and Statistical Psychology, 41(2), 257–278. https://doi.org/10.1111/j.2044-8317.1988.tb00901.x.View ArticleGoogle Scholar
- Sawilowsky, S. S. (2009). New effect size rules of thumb. Journal of Modern Applied Statistical Methods, 8(2), 597–599 doi: 10.22237.View ArticleGoogle Scholar
