Skip to main content
Download PDF

Lessons learned about development and assessment of feasibility of tools for health and rehabilitation services

Pilot and Feasibility Studies volume 10, Article number: 21 (2024) Cite this article

Abstract

Background

Given the dire need for health and rehabilitation services internationally, exacerbated during the COVID-19 pandemic, there is a critical need to develop tools to support service delivery. This need is palpable in the Global South where tools developed in Eurocentric contexts are not always adaptable, applicable, or relevant. It is for this reason that the researchers present three case studies of tool development using pilot and feasibility studies in South Africa and share the lessons learned from these studies.

Objectives

To describe three case studies that developed new tools for health and rehabilitation services using pilot and feasibility studies.

To synthesize lessons learned from these case studies on the development of tools.

Method

The researchers describe three case studies that were developed. The case studies are summarized as follows: aims and objectives, context, problem, study design, findings, and what happened after the study. Thereafter, a qualitative cross-case analysis was conducted by the researchers to generate themes.

Findings

The case studies are described individually and followed by themes identified through cross-case analysis.

Discussion

The lessons learned are discussed. It is essential to develop new tools and protocols, motivated by the need for equitable and contextually relevant practices. Partnerships and collaboration with end-users are critical for success. A critical, scientific process is essential in developing new tools. Pilot and feasibility studies are invaluable in developing tools and assessing the feasibility of tools and implementation. The goal is to develop practical, usable tools and protocols.

Conclusion

Through the lessons learned, the researchers are hopeful that the international health and rehabilitation professions will continue to strengthen the scientific development of contextually relevant tools and resources.

Peer Review reports

Background

There is a need to provide health care in a manner that is responsive to the needs of society, which requires a reimagination of the tools used in health care. Health and rehabilitation professions in South Africa are actively developing tools that are relevant to its context to serve marginalized communities more equitably [1,2,3,4]. South Africa has a two-tiered public–private health system mired in deeply entrenched structural inequalities, [5, 6] and as a consequence, rehabilitation service delivery is also unequal [7]. Due to the ever-increasing burden of disease, now further exacerbated by the COVID-19 pandemic and poor living conditions, the burden of disability is increasing [8]. It is estimated that one in three people internationally will need rehabilitation services during their illness or injuries [9], and therefore, comprehensive primary health care services must include rehabilitation as a priority, particularly at a community level [10, 11].

The tools (a broad term researchers use in this paper to describe protocols, interventions, and instruments), currently available in South Africa, were mainly developed for application in Western cultural contexts. However, when these tools are applied inappropriately to communities they were not designed for, there are significant negative consequences [4, 12,13,14]. The use of appropriate tools is a matter of social justice. Given this exploratory context with several unknowns, the researchers reflect on lessons learned in three case studies using pilot and feasibility studies for the scientific development of tools in a context of many uncertainties [15]. This commentary seeks to make a contribution to the literature related to the use of pilot and feasibility studies to develop tools that are crucial in advancing equitable rehabilitation service delivery.

The philosophical approach taken across the case studies resonates with the Re-Aim framework [16] which encourages scientists to be explicit about context and strategy, include qualitative research methods, and support the development of user-friendly and human-centered approaches.

Objectives

The objectives of this paper are to:

  1. 1.

    Describe three case studies in which researchers aimed to develop contextually relevant tools

  2. 2.

    Discuss the lessons learned about the scientific process of developing tools using pilot and feasibility studies

Methods

How the case studies came about

The case studies were developed through researchers’ identification of key service delivery challenges as they worked as university clinical educators in community settings to strengthen rehabilitation service delivery.

Case study 1: developing and testing a hearing screening protocol [17]

The researcher was concerned about the lack of contextualized hearing screening guidelines (at the time of the study) and how this contributed to inadequate school-based hearing screening services in the region [18]. The state of school hearing screening practice was especially concerning when considering the adverse effects of hearing impairment on the communication and learning ability of school-aged children [19]. Through collaborative work with the school health team in the district, and nurses in particular, key role players identified an urgent need for a contextually relevant hearing screening protocol which led to this case study.

Case study 2: pilot study of Classroom Communication Resource (CCR) [20]

The need for school-based intervention for children who stutter was identified by student clinicians and teachers in a marginalized community where speech-language therapy services were severely limited. Having identified this need, the students designed an intervention (Classroom Communication Resource) which was refined through further [21,22,23,24,25,26] studies. Thereafter, this case study was conducted to inform the feasibility study for an RCT.

Case study 3: the development of a rehabilitation and health information tool (RHIT) [27]

This case study was developed in response to the need for a user-friendly, contextually relevant tool to gather health and rehabilitation information from persons with disabilities. The need was identified by community rehabilitation workers providing continuity of services to persons with disabilities who required community-based care. They required the tool to gather information on the rehabilitation and health needs of persons with disabilities, plan interventions, and monitor progress. Hence, the study was conducted in partnership with community rehabilitation workers who were being trained as part of a pilot program at the University of Cape Town, Department of Health and Rehabilitation, aimed at strengthening community-based rehabilitation support.

Summarizing case studies

Each case study was summarized from published papers (case studies 1 and 2) and from the completed Masters’ studies (case study 3) The summary of each study included the aims and objectives, description of context, problem identified, study design, and findings. In addition, the researchers describe what happened since the conclusion of the studies.

Cross-case analysis

The researchers analyzed the summary of each study and then conducted an interpretive cross-case analysis to generate themes emerging across cases. The discussion focuses on lessons learned from these themes.

Findings

Case study 1

See Table 1.

Table 1 Developing and testing a hearing screening protocol
Full size table

Case study 2

See Table 2.

Table 2 Pilot study of Classroom Communication Resource (CCR)
Full size table

Case study 3

See Table 3.

Table 3 The development of a rehabilitation and health information tool (RHIT) [27]
Full size table

Themes generated in cross-case analysis

  • Community-based interventions require contextually relevant tools.

  • Identifying a contextually relevant tool requires consideration of a range of influences such as socio-economic, political, geographical, historical, structural, linguistic, and cultural (among others).

  • For researchers to develop tools for equitable service delivery, they need a level of political consciousness.

  • Contextual needs are identified through engagement with end-users.

  • Collaborative research-clinical partnerships and relationships are necessary for developing tools.

  • Scientific pilot and feasibility studies for tool development are necessary.

  • Qualitative and quantitative methods are complementary in study design.

  • Tools developed can be used when they are refined and validated.

A discussion of these themes is highlighted as lessons learned.

Discussion: lessons learned

Lesson 1: developing new tools and protocols, motivated by the need for contextually relevant practices, is essential

There were several dimensions of context that were addressed across the case studies. It was imperative that the socio-political and economic context was understood as a basis for developing tools that could potentially advance equitable practices. The politically conscious choice to prioritize populations who are unserved/underserved was necessary [5]. In case study 1, the population of school children in the public sector who struggled to receive effective primary-level care in a democratic South Africa was identified as a significant concern. Similarly, case study 2 targeted school children in public schools with minimal access to services who are subject to bullying because they stutter. Case study 3 identified persons with disabilities who require home-based care as an invisible population in low-income communities due to their severe impairments and disabling environments.

The case studies were sensitive to various contextual factors, including time and resource constraints resource of their rehabilitation service partners (teacher, nurses, and community rehabilitation workers). Nurses and community rehabilitation workers are required to operate within public settings where the health system is severely resourced-constrained impacting on how they practice in their everyday environments. Case study 1 focused on the nurses, addressing their need for a protocol that was effective and affordable and one that was applicable so that it could be administered rapidly to a large number of children. Similarly, community rehabilitation workers had significant time and resource constraints as they had to provide services to several persons with disabilities in the community and therefore needed a tool which could efficiently gather information and monitor how the intervention was proceeding. Likewise, teachers are part of public schooling which have timetables and large classes and require tools that can be integrated into their lessons.

Case studies 2 and 3 illuminate how the tools were developed to be responsive to the cultural and linguistic context. The CCR was revised until the content was considered culturally relevant by identifying concepts familiar to learners through cognitive debriefing. Furthermore, the stories used in the intervention as well as the outcome measure were revised until it was at a literacy level that was suited to learners who were learning English as a second language. Case study 3 invested in making the tool linguistically accessible through translating tools from English into IsiXhosa and Afrikaans. The translated tool created an opportunity to generate focused conversations thereby encouraging persons with disabilities to participate actively in defining their health needs, how they are met/unmet, and their priorities.

Contextually relevant tools therefore should be responsive to the multi-faceted nature of contexts by considering socio-political, economic, structural, cultural, and linguistic realities, among others.

Lesson 2: partnerships and collaboration with end-users are critical for success

The learning in these case studies was that partnerships should be initiated at the point of developing tools and maintained throughout, rather than only at the implementation phase. In these case studies, the partners varied and included nurses, teachers, learners, and community rehabilitation workers. This collaborative approach to developing tools signals a shift away from the researcher-as-expert approach, where researchers develop tools based on their expert knowledge, to a more participatory approach which valued end-users as collaborative partners in co-producing knowledge. In the process, partners exercised their agency in identifying needs and reflecting critically on how their needs were being met. Their participation lays the groundwork for increasing the uptake of the tool in their practice settings.

Lesson 3: a critical, scientific process is essential in developing new tools

The case studies show how qualitative and quantitative methods complemented each other in the development of tools and protocols and the assessment of feasibility. The value added was that knowledge was generated using systematic and rigorous methods in studies that were purposefully designed. In particular, the importance of a critical research paradigm [30] which acknowledges that knowledge is contextualized, contestable, power-laden, and driven by a need for social change was found to be valuable. This lesson is illustrated by drawing on two research methods.

Systematic literature review

In case studies 1 and 3, a systematic literature review contributed to the conceptual basis to draft the resource tool or protocol. For example, in case studies 1 and 3, the literature review appraised international literature related to disability, health, and hearing screening protocols. The literature was appraised to establish the applicability, strengths, and shortcomings, relative to the needs of the context in South Africa. The review illustrated the strengths and value of previously developed tools while also highlighting that it was necessary to develop measures that were fit for purpose for the South African context. The critical appraisal of established knowledge and its applicability was essential to assess the extent to which such knowledge could be meaningfully applied to the local context.

Expert panel: whose expert (ise) matters

To develop a contextually relevant resource, case study 3 showed that it was essential to identify the expertise in the field. An expert was defined as someone with relevant knowledge in an area of interest such as disability, rehabilitation, community-based rehabilitation, or the development of resource tools. Knowledge could be gained through practical experience/technical experience or through a professional qualification. While traditionally science-valued professionals and researchers, the expertise here was drawn by collectively engaging persons with disabilities, community rehabilitation workers, rehabilitation therapists, and academics.

The inclusion of people with disabilities was essential in case study 3. This is in alignment with the United Nations Convention on Rights of Persons with Disabilities UNCRPD [31], specifically article 4 and article 19. Article 4 of the UNCRPD seeks to ensure and promote “full realization of all human rights and fundamental freedoms for all persons with disabilities without discrimination of any kind on the basis of disability.” Article 19 states that community services should be responsive to the needs of persons with disabilities. The inclusion of an expert panel strengthened the validity of the resource tool and impacted positively on the development and refining of the tool [32, 33]. The experts shaped the essence of the tool, identified the content domains of the tool, and evaluated the strengths and shortcomings of the tool. The experts contributed to making the tool more suitable for the end-user. Methodologically, this approach contributed to the validity and robustness of the resource tool. Similarly, in case study 1 the expertise by experience was valued in including nurses in all stages of the research process. This inclusive approach to expertise resonates with the intention of Re-Aim framework which favors a scientifically based implementation approach that is contextualized and localized through the participation of key stakeholders [16].

Lesson 4: pilot and feasibility studies are a critical part of developing tools and assessing feasibility

In all the case studies there was a pilot or feasibility study to review various aspects of feasibility. The researchers learned that while a tool may be developed scientifically, the feasibility of implementation must also be assessed with the participation of the end-user, e.g., nurses, teachers, or community rehabilitation workers. For example, with the hearing screening protocol in case study 1, the researchers learned that the tool met the needs of nurses and was practically implementable. However, researchers also learned that there were limitations in the procedural aspects of implementation which impacted negatively on the sensitivity of the protocol. Similarly, in case study 2, the pilot study [20] informed the design of an RCT through assessing the potential treatment effect of the CCR intervention as well as the feasibility of recruiting and retaining participants. The study concluded that an RCT was feasible subject to strengthening several procedural aspects of the process.

The pilot study of RHIT aimed at assessing the applicability of the tool by community rehabilitation workers with the population of persons with disabilities. The findings of the study helped the researcher and community rehabilitation workers to understand that the tool was part of a dynamic interactive process with persons with disabilities rather than a once-off information-gathering tool [27]. In contexts where tools are in the early stages of development, pilot and feasibility studies have been invaluable. Typically, they are smaller-scale studies that are more cost-effective and manageable and yield findings that address early-stage challenges, thus contributing to developing sustainable interventions.

Lesson 5: the goal is to develop practical, usable tools and protocols

Each of the case studies demonstrated that it was feasible to develop tools that could be implemented practically. This goal has been achieved through relatively small-scale studies that show that systematic, scientific tool development is practical and possible — even within resource-constrained environments. The participatory approach provided an avenue to strengthen the relationships between researchers, service providers, patients, and end-users to work collaboratively to address the challenge of equitable health service delivery. While integrating tools into service delivery is a longer-term process that requires the interaction between policymakers, service users and providers, and researchers, these studies highlight that researchers have a key role to play in strengthening contextualized service delivery.

Conclusion

The development of tools is a critical part of strengthening public health systems, particularly in the Global South. The case studies illustrate that it is both practical and possible to use scientific approaches to advance the development of tools and assess the feasibility of implementation through pilot and feasibility studies. The participatory approach to co-producing tools contributed to developing tools that were more responsive to contextual needs. Community-based rehabilitation service delivery is a growing critical international need and the scientific development of contextually relevant tools will contribute to addressing this service delivery challenge.

Availability of data and materials

All raw data is available upon request.

References

  1. Galvaan R. Generative disruption through occupational science: enacting possibilities for deep human connection. J Occup Sci. 2021;28(1):6–18.

    Article  Google Scholar 

  2. Kronenberg F, et al. Can post-apartheid South Africa be enabled to humanise and heal itself? S Afr J Occup Ther. 2015;45(1):20–7.

    Article  Google Scholar 

  3. Kunene S, Taukobong N, Ramklass S. Community-based rehabilitation implementation framework to address patellofemoral pain amongst runners in under-resourced communities: Delphi consensus. S Afr J Physiother. 2021;77(1):1531.

    Article  PubMed  Google Scholar 

  4. Pillay M, Kathard H. Renewing our cultural borderlands. Top Lang Disord. 2018;38(2):143–60.

    Article  Google Scholar 

  5. Coovadia H, et al. The health and health system of South Africa: historical roots of current public health challenges. Lancet. 2009;374(9692):817–34.

    Article  PubMed  Google Scholar 

  6. Ataguba JE-O, Alaba O. Explaining health inequalities in South Africa: a political economy perspective. Dev South Afr. 2012;29(5):756–64.

    Article  Google Scholar 

  7. Ned L, et al. A situational mapping overview of training programmes for community-based rehabilitation workers in Southern Africa: strategies for strengthening accessible rural rehabilitation practice. Front Public Health. 2020:696:8.

  8. Ned L, et al. COVID-19 pandemic and disability: essential considerations. Soc Health Sci. 2020;18(2):136–48.

    Google Scholar 

  9. Cieza A, et al. Global estimates of the need for rehabilitation based on the Global Burden of Disease study 2019: a systematic analysis for the Global Burden of Disease Study 2019. Lancet. 2020;396(10267):2006–17.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  10. Finkenflügel H, Wolffers I, Huijsman R. The evidence base for community-based rehabilitation: a literature review. Int J Rehabil Res. 2005;28(3):187–201.

    Article  PubMed  Google Scholar 

  11. Hartley S, et al. Community-based rehabilitation: opportunity and challenge. Lancet. 2009;374(9704):1803–4.

    Article  PubMed  Google Scholar 

  12. Grandpierre V, et al. Barriers and facilitators to cultural competence in rehabilitation services: a scoping review. BMC Health Serv Res. 2018;18(1):1–14.

    Article  Google Scholar 

  13. Pillay M, Kathard H, Samuel M. The curriculum of practice: a conceptual framework for speech-language therapy and audiology practice with a black African first language clientele. S Afr J Commun Disord. 1997;44(1):109–17.

    CAS  PubMed  Google Scholar 

  14. Mayosi BM, Benatar SR. Health and health care in South Africa—20 years after Mandela. N Engl J Med. 2014;371(14):1344–53.

    Article  CAS  PubMed  Google Scholar 

  15. Bond C, et al. Pilot and feasibility studies: extending the conceptual framework. Pilot Feasibility Stud. 2023;9(1):24.

    Article  MathSciNet  PubMed  PubMed Central  Google Scholar 

  16. Glasgow RE, et al. RE-AIM planning and evaluation framework: adapting to new science and practice with a 20-year review. Front Public Health. 2019;7:64.

    Article  PubMed  PubMed Central  Google Scholar 

  17. Cloete T-L, et al. Identifying a context-effective school hearing screening test: an emic/etic framework. Int J Audiol. 2015;54(9):605–12.

    Article  PubMed  Google Scholar 

  18. Department, W.C.E., Annual Report 2012/2013 W.C.E. Department, Editor. Cape Town: Western Cape Government; 2013.

  19. McPherson B, Brouillette R. Audiology in developing countries. New York: Nova SCience Publishers; 2008. https://usu.instructure.com/courses/484693/files/67685139/download?verifier=sVjMXSHDKCFmp8eqmiYBqCWXdHjecRDQKtcdChWr&wrap=1.

  20. Mallick RB, et al. A pilot study to determine the feasibility of a cluster randomised controlled trial of an intervention to change peer attitudes towards children who stutter. S Afr J Commun Disord. 2018;65(1):1–8.

    Google Scholar 

  21. Filies S, Hartley R, Kaplan GR, Pettit L. Teachers’ and learners’ responses towards a classroom resource about communication and communication difficulties, in Communication Sciences and Disorders. Cape Town: University of Cape Town; 2009.

    Google Scholar 

  22. De Grass J, Gessesse H, Harrison J, Naidoo L, Sewpersad A, Vaggie Z. Changes in peers’ attitudes towards learners who stutter after the administration of a Classroom Communication Resource. In: Communication Sciences and Disorders. Cape Town: Cape Town; 2010.

    Google Scholar 

  23. Badroodien R, Bielovich J, Lilienfeld S, Naiker P, Stevens M, Weavind J. Changes in peer attitudes towards children who stutter after the administration of a Classroom Communication Resource. In: Communication Sciences and Disorders. Cape Town: University of Cape Town; 2011.

    Google Scholar 

  24. De Freitas S, Geben C, Parusnath P, Relleen A, Van den Berg N. Changes in negative peer attitudes towards children who stutter after the administration of a Classroom Communication Resource. In: Communication Sciences and Disorders. Cape Town: University of Cape Town; 2012.

    Google Scholar 

  25. Kathard H, et al. Classroom intervention to change peers’ attitudes towards children who stutter: a feasibility study. S Afr J Commun Disord. 2014;61(1):11.

    Google Scholar 

  26. Mallick R, et al. The Classroom Communication Resource (CCR) intervention to change peer’s attitudes towards children who stutter (CWS): study protocol for a randomised controlled trial. Trials. 2018;19(1):1–8.

    Google Scholar 

  27. Hansen A. The development of a tool to support the work of the Rehabilitation care worker in documenting information about rehabilitation and health needs among persons with disability in home and community settings. In: Health and Rehabilitation Sciences. Cape Town: Cape Town; 2018.

    Google Scholar 

  28. Health NDo. White Paper on National Health Insurance. South Africa: National Department of Health Pretoria; 2015.

    Google Scholar 

  29. Health, N.D.o. Framework and strategy for disability and rehabilitation services in South Africa: 2015–2020. N.D.o. Health, Editor. Pretoria: Department of Health. Republic of South Africa; 2015.

  30. Asghar J. Critical paradigm: a preamble for novice researchers. Life Sci J. 2013;10(4):3121–7.

    Google Scholar 

  31. Assembly UG. Convention on the rights of persons with disabilities. GA Res. 2006;61:106.

    Google Scholar 

  32. Kelly K. From encounter to text: collecting data in qualitative research. Res Pract. 2006;2:285–319.

    Google Scholar 

  33. Babbie E, Mouton J. The practice of social research: South African edition. Cape Town: Oxford University Press Southern Africa; 2001.

    Google Scholar 

Download references

Acknowledgements

The participants are acknowledged for their contributions to the studies.

Funding

National Research Foundation South Africa funded 2 studies.

1. Improving learner’s attitudes towards peers who stutter: a pilot intervention study.

2. Towards the identification of a contextually relevant school hearing screening program.

Author information

Authors and Affiliations

  1. Faculty of Health Sciences, University of Cape Town, F45 Old Main Building, Groote Schuur Hospital, Observatory, 7925, Cape Town, South Africa

    Harsha Kathard & Tracey-lee Cloete

  2. Department of Paediatrics and Child Health, Faculty of Health Sciences, Children’s Institute, University of Cape Town, 46 Sawkins Road, Rosebank, Cape Town, 7700, Cape Town, South Africa

    Rizwana Mallick

  3. Centre for Health Professions Education, Stellenbosch University, Matieland, 7602, Stellenbosch, South Africa

    Anthea Hansen

  4. Faculty Health Sciences, Mc Master University, 175 Longwood Road South, Hamilton, ON, L8P 0A1, Canada

    Lehana Thabane

Authors
  1. Harsha Kathard
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Rizwana Mallick
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Tracey-lee Cloete
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Anthea Hansen
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Lehana Thabane
    View author publications

    You can also search for this author in PubMed Google Scholar

Contributions

HK supervised each study and wrote this paper along with RM, AH, and TLC. RM, AH, and TLC each completed their respective studies. LT provided mentoring in writing this paper.

Corresponding authors

Correspondence to Harsha Kathard or Rizwana Mallick.

Ethics declarations

Ethics approval and consent to participate

Each study was approved by the University of Cape Town’s Health Sciences Research Ethics Committee. The ethical approval numbers were as follows:

Anthea Hansen: 095/2015: The development of a tool to support the work of the rehabilitation care worker in documenting information about rehabilitation and health needs among persons with disability in home and community settings.

Tracey Lee Cloete: 479/2007: Towards the identification of a contextually relevant school hearing screening protocol in the Western Cape.

Rizwana Mallick: 510/2013: Improving learner’s attitudes towards their peers who stutter: a pilot intervention study.

Harsha Kathard was primary supervisor and primary investigator on the studies.

Consent for publication

The University of Cape Town, where each study was conducted, provided consent for publication.

Competing interests

The authors declare that they have no competing interests.

Additional information

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated in a credit line to the data.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Kathard, H., Mallick, R., Cloete, Tl. et al. Lessons learned about development and assessment of feasibility of tools for health and rehabilitation services. Pilot Feasibility Stud 10, 21 (2024). https://doi.org/10.1186/s40814-023-01424-w

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1186/s40814-023-01424-w

Keywords

Pilot and Feasibility Studies

ISSN: 2055-5784