Evaluation | Outcome | Criteria for success | Results | Lessons Learned |
---|---|---|---|---|
Initial 50 surveys | Less refusal to participate in study when we allowed postal codes to be used. RAs community engagement actions successful in further recruitment efforts. | Recruitment of 25 participants at Site A, and Site B completed in 1 month. | 50 participants recruited in 2 months. | Use postal codes in survey with SAs. Community engagement is essential in SA communities. Spending time in setting is required for 1 month before recruitment begins to connect with leaders. |
Recruitment | Reinforced confidentiality and anonymity resulted in participants more willing to participate in study. | 125 participants for site A and 125 for site B to be recruited in 4 months. Sample size of 300 participants to be recruited. | 278 participants recruited in 6 months from both site A and site B. Total sample recruited was 328. | Community-based recruitment using snowball and network sampling takes more time within SA communities. Recruitment target times should be more realistic to the population. |
Data collection | RA reinforced rationale for items that were perceived to be similarly worded. Some participants believed the survey took longer to complete than it did, although, it was not a deterrent from participating. Some participants reported too many response categories; and, most felt the midpoint response was acceptable. | Items within each subscale acceptable. Participant survey to be completed within 30 min. | All items in subscales completed during data collection. The average time to complete survey was 15 to 30 min. | Survey administrators need to explain a priori that items may seem to be similar, but they are tapping different aspects of a construct. Reinforce to participants survey length and rationale prior to administration. “I neither agree or disagree” response category is a good midpoint response to use in a Likert Scale with SAs. |
CAPI software & resources | The computer/tablet functionality and handling issues were problematic during initial recruitment. | Data collected on computer/tablet is seamless. Visual aids and honorariums acceptable. | RAs used paper-pencil administration alongside CAPI after initial round. Visual aids well received, and honorariums acceptable. | To allow more seamless administration, a better-quality tablet (i.e. enhanced font) would be required for CAPI software use. Use visual aids and provide honorariums for SA participants. |