- Study Protocol
- Open Open Peer Review
Feasibility evaluation of a pain self-management app-based intervention among older people living with arthritic pain: study protocol
Pilot and Feasibility Studiesvolume 5, Article number: 57 (2019)
Optimal management of chronic arthritic pain experienced by older adults involves applying active self-management strategies every day. Cost-effective and innovative strategies to help build older people’s pain self-management capability are required. This study protocol is designed to evaluate the feasibility, acceptability, and preliminary outcomes of a pain self-management app among older people living in the community with arthritic pain.
This is a phase I feasibility study. A pre-post test study design will be used to trial a freely available pain self-management app named Rheumatoid Arthritis Information Support and Education (“RAISE”) for 14 days. Thirty community-dwelling older people living with arthritic pain who use a smartphone will be recruited from (1) various community-based social clubs/organizations/groups or (2) via Facebook groups with potentially high number of older members. In addition, snowballing sampling approach will also be utilized.
These participants will trial the RAISE app, which was selected following a systematic evaluation of all available chronic pain apps by the investigator team. A face-to-face or telephone-based meeting will be organized with all consenting participants in order to seek their informed consent, download and set up the intervention app on their mobile device, be provided with app training, and complete the pre-test data (Time 1 (T1)). Participants will be asked to use the RAISE app as desired for 14 days. Post-test data collection (Time 2 (T2)) will occur on day 15. Data collected includes participant’s demographic and clinical information, pain scores, pain self-efficacy, and online technology self-efficacy. Participants will be invited to take part in a semi-structured telephone interview at T2 to explore their experiences of using the app.
An evaluation of patterns of app use, recruitment, retention, attrition rates, and analysis of the missing data will inform the study and intervention feasibility. Preliminary outcomes are participant’s pain intensity and interference, pain self-efficacy, and online technology self-efficacy.
This study will help us better understand the feasibility and acceptability of using this novel intervention among community-dwelling older people living with arthritic pain. The results will also help inform future pain app studies.
Australia New Zealand Clinical Trials Registry: ACTRN12617000921381.
Unrelieved pain is one of the most common health conditions affecting the majority of older people (those aged over 65 years) [1,2,3]. Globally, about 70% of older adults suffer from arthritis-related pain [2, 3]. Although the global economic impact of arthritis remains unknown, it is estimated to cost high-income countries between 1–2.5% of their gross national product . As most older people live in the community, self-management strategies are central to improving their unrelieved chronic pain and minimizing the adverse impact of pain on their lives [5, 6]. Active self-management involves (i) medical management (i.e., medication adherence, dietary modification), (ii) behavior modification (i.e., modifying activities of living, physical, and recreational activities), and (iii) managing emotion (i.e., dealing with fear, frustration, and anger) . Building patients’ capacity to self-manage pain is underpinned by effective instruction, education, and support, augmented with regular medical, nursing, and/or allied health follow-up. Self-management strategies are central to maximizing effective coping with pain and minimizing the adverse impact of pain on older people’s lives [5, 6]. While structured pain self-management programs have traditionally been grounded in face-to-face coaching approaches, there has been a growing interest in the use of technology-mediated self-management intervention to promote and support self-management.
Although younger people outnumber older people in terms of technology engagement, the uptake of new technology among older people is increasing rapidly . The proportion of older people using smartphones has more than doubled since 2014 , with over 40% of people aged over 65 years now owning a smartphone . A growing proportion of older people regularly use the internet and source online health information . While digital technology uptake among older people of today is increasing and is yet to reach saturation, the next generations of older people (“baby boomers”) who have grown old with digital technology are likely to be even familiar users. Given this reality, there will be more opportunities to use digital technology-facilitated approaches to reach and meet the needs of the world’s rapidly growing and aging population.
Since the introduction of the smartphone in 2007, its subsequent widespread adoption has fueled the development of a range of health-related applications (apps) that can be accessed from these computerized mobile handsets . Smartphone apps use software that interact with users on an individual basis . Health-related apps form a significant proportion of all apps. Although exercise and wellness apps form the major proportion of the health app landscape, self-management apps for chronic conditions, including pain, are growing . There are currently over 350 pain self-management apps offering pain assessment recording, pain information, and pain self-management plans available on the internet, and this number is expected to increase [14, 15]. While several recent systematic reviews have evaluated the quality of currently available pain-related apps [14,15,16,17], only one review has examined the quality and usability of arthritic pain self-management apps for older people . This review identified that only 4 of the available 373 pain apps offered pain self-management advice and support in accordance with the Stanford Arthritis Self-Management Program and reflected current arthritic pain management evidence .
There is a paucity of pain app evidence that is applicable to older people, with most studies focusing primarily on younger people’s management of their chronic pain [18,19,20]. The two app-based interventions tested among older people have both focused on areas outside of pain, such as strength training  or falls . As older people with chronic pain indicate a willingness to learn and use smartphones and apps for pain self-management [23, 24], the feasibility, acceptability, and effectiveness of using a pain app to help older people better self-manage their arthritic pain warrant further investigation.
The aim of this study is to evaluate the feasibility, acceptability, and preliminary outcomes of a pain self-management app among older people living in the community with arthritic pain.
This is a phase I feasibility study. Based on the Medical Research Council’s continuum of evidence structure, this study is classed as a phase I study [25, 26]. Studies classed as phase I are designed to improve the understanding of components of an intervention and their interrelationships. Qualitative testing is recommended for use in these studies so as to facilitate the understanding of how the intervention might work . It is, however, important to note that development and evaluation of a complex intervention is not always a sequential or linear process, and these interventions may work best if they are tailored to local settings instead of a uniform/standardized approach .
Feasibility studies are used to determine whether an intervention is appropriate for further evaluation . Adhering to the conceptual framework outlined by Eldridge and colleagues , this study could be classed under “feasibility studies that are not pilot studies.” Feasibility studies differ from pilot studies as they are carried out before a main study so as to estimate important parameters required to design the main study, whereas a pilot study is a smaller version of the main study carried out to evaluate if all of the components of the main study can work together .
This study aims to recruit 30 older people living with arthritic pain, who use a smartphone or a tablet device, and who meet the following inclusion criteria:
Living in the community;
Aged 65 years or over;
Presence of arthritic pain for ≥ 3 months (participant reported);
Ability to read and write in English;
Ownership of a smartphone/tablet-computer;
Ability to give written informed consent
Exclusion criteria include the following:
Presence of cancer pain
Under end-of-life care pathways
Living in an institutional home
Setting and procedure for recruitment
The screening, recruitment, and consenting process for this study will be carried out by one of the investigators (PB). Prospective participants will be sought from various older people’s club/associations/groups, including Facebook groups across Metropolitan and Regional New South Wales (NSW), Australia. This approach of recruitment is considered because many older Australian utilize their free time keeping active and participating in leisure activities by engaging in social clubs . With over 60% of community-dwelling older Australians involved in a social or support group , members of older people-specific social clubs and organizations are expected to be a fair representation of the target population of this project.
Each club/association/group will be approached with a written invitation to participate. Utilizing a snowballing sampling approach, club members will be asked if they could provide a referral to any other club/organization/group that could be contacted with an invitation to participate. Interested clubs/organizations/groups will be asked to circulate the study’s poster among their members in paper or electronic form. Groups that meet in person will be offered an on-site presentation to promote the study and share the invitation to participate.
To facilitate online recruitment, a designated study Facebook page will be created. Administrators of interested Facebook-based groups will be asked to upload the study’s poster on the group’s Facebook page on behalf of the investigator team. Utilizing a snowballing sampling approach will enable study participants to share our study invite among their networks and to refer us to any contacts who they think may have interest in participating.
The first contact with potential participants will be made via one of the three following approaches: (i) during the on-site presentation, (face-to-face contact), (ii) when interested participants contact the investigator responding to the recruitment poster (telephone, email, or via Facebook), (or iii) when a face-to-face contact (prospective participant, club member, or study participant) provides a referral to another prospective participant (telephone or email contact).
Each potential participant will be asked the following three questions to assess if they meet the eligibility criteria: (a) Have you experienced arthritic pain for over 3 months? (b) Are you over 65 years of age? (c) Do you live in the community setting (not in an institutional home like residential aged care facility)? Participants answering “Yes” to all of the three questions will be considered eligible to participate in the study. Those meeting the eligibility criteria will be provided with a brief verbal overview of the study including a clear indication that there is no direct incentive to them in participating in this study. This will be followed by the provision of the written Participant Information and Consent Form. Potential participants will be prompted to ask any questions regarding the implications of participation before signing the consent form. After this time point, potential participants will be advised to get in touch with the study team when they are ready to provide their written consent. This could happen on the same meeting session (or day) of information provision, or could be up to 2 weeks before the end of the recruitment period.
The intervention to be tested in this study is the free, widely available and downloadable pain self-management app named Rheumatoid Arthritis Information Support and Education (“RAISE”) . The selection was made based on our recent systematic review of the quality and older people-specific usability of all available pain apps identified on the web as of 30 May 2016 . The WebMD Pain Coach app  generated the highest quality and usability score ; however, this app has recently been removed from the public domain. The app scoring the second highest score RAISE  will be selected for evaluation in this study. Written permission has been obtained from the developers of the RAISE app for its use in this study.
The RAISE app
The RAISE app has been designed by the collaborative effort of the Rheumatology Department of St. James Hospital in Ireland and Arthritis Ireland for the self-management of arthritic pain . The features of the RAISE app could be broadly classed as encompassing the following functions:
Assessment and documentation: The RAISE app offers an option to assess pain in a 0–5 Numeric Rating Scale (NRS) and keeps a time-stamped record of the NRS score. This pain intensity scale can be used as frequently as the user desires. Users can also record their activity level on a 0–5 NRS, and
Pain self-management education: The RAISE app provides education on a range of different topics relating to pain self-management such as a provision of education on pain/pain self-management processes, medication use, and communication with health professionals and pain-related problem-solving. Information on fatigue, sleep, and the management of distress along with CBT pain management instructions on relaxation, goal-setting, and activity pacing (20–30 min session) are provided. Finally, there are videos of stretching, isotonic and aerobic exercise with warmup and cooldown stages with the duration and frequency of exercise also indicated.
A meeting (face-to-face or via telephone) will be organized with all consenting participants in order to download and set up the RAISE app on the participant’s mobile device, provide participants with app training and brief them to use the app for 14 days, and collect the pre-test data (Time 1 (T1)). Participants will be shown all of the features of the app and then guided to navigate through the features of the app until they are comfortable using it. In addition, participants will be advised to contact one of the investigators if they require any assistance in using the app throughout the 14-day period.
A wireless-enabled device (wireless internet dongle) will be purchased and used for downloading the app to the face-to-face meeting participant’s device so that they do not have to use their mobile phone’s data allowance for the app download. If a face-to-face meeting is not feasible, and the participant is willing and able to use their own wireless or mobile internet for the app download, this session will be carried out over the phone (telemeeting). Participants will be advised to use the RAISE app as desired for the next 14 days. It is important to note that this study is not prescriptive in terms of how often participants will use the app. They receive brief training on how to use the intervention app to ensure they are comfortable with using it; however, the frequency with which they use it is up to them.
For the purpose of this study, following three preliminary outcomes will be measured before and after the intervention: (1) pain severity and interference, (2) pain self-efficacy—described as confidence people with ongoing pain have in performing activities while in pain , and (3) online technology self-efficacy—described as confidence in using various kinds of online technology . In addition to these preliminary outcomes, this study will also measure the following feasibility outcomes: (1) recruitment, refusal, and attrition rates; (2) proportion and patterns of missing data; and (3) ability to recruit 30 participants within 6 months of recruitment commencement.
Data collection will be carried out by one of the investigators who is a registered nurse with a Bachelors of Nursing (Honors) qualification and is currently undertaking a doctoral degree. She has over 5 years experience of working in healthcare research environment across various aged and chronic care trials in the aged care and hospital setting.
Data will be collected using the following questionnaires (refer Table 1):
Pain outcomes Case Report Form (CRF)—This CRF includes three valid and reliable outcomes measurement questionnaires, namely the Brief Pain Inventory-short form , the short form Pain Self-Efficacy Questionnaire (two-item scale) [40, 41], and the Online Technology Self-Efficacy Questionnaire .
The Brief Pain Inventory (BPI)-short form—The BPI-sf is a validated, widely used, self-administered questionnaire developed to assess the severity of pain and the impact of pain on daily functions .
Short form Pain Self-Efficacy Questionnaire (PSEQ-2)—The PSEQ-2 is a valid and reliable two-question tool designed to assess the confidence people with ongoing pain have in performing activities while experiencing unrelieved pain [40, 41]. This tool is deemed to be a robust measure of pain self-efficacy .
Online Technologies Self-Efficacy Scale (OTSES)—The OTSES is a valid tool that is designed to measure an individual’s self-efficacy in using online technologies .
Demographic and clinical survey—The survey captures participants’ demographic, social, and health-related information and includes the Charlson Comorbidity Index , the Life-Space Assessment questionnaire , and the Australian-modified Karnofsky Performance Scale .
Data collection commenced in July 2018 and will continue for 6 months or until all of the data has been collected for the 30th participants, whichever occurs first.
All participants will be invited to take part in a semi-structured telephone interview at the end of the intervention period. The semi-structured interviews will focus on evaluating the acceptability of the intervention. Participants will be specifically asked about the pattern of app use, including frequency and timing, and their experiences, attitudes, and perspectives on integrating the RAISE app into their pain self-management strategy. Participant’s perceptions of the barriers and facilitators to successful use of the intervention app, as well as their willingness and concerns regarding its use, will also be explored. The semi-structured interview will be carried out via telephone. It is anticipated that the interviews will last for approximately 30–45 min. The interviews will be audio recorded and transcribed verbatim for analysis.
This study will utilize the IBM Statistical Package for Social Science (SPSS) software for management and analysis of data. Descriptive statistics will be used to synthesize the sociodemographic data of the participants. Frequencies and percentages will be reported for categorical variables, normally distributed continuous variables will be presented as mean and standard deviations, and median and interquartile range will be reported for non-normally distributed continuous variables. Participant’s pre-test self-reported pain data (pain intensity and pain interference), pain self-efficacy, and online technology self-efficacy will be compared with their post-test reports.
The qualitative data will be managed using NVivo software. Coding and classification of the data will be carried out to make sense of the collected data and to highlight the features and messages of the semi-structured interviews . Data analysis will be carried out using an inductive process of thematic content analysis. The transcribed interviews will be read and re-read so as to promote immersion in the data and close examination of the interview content. Preliminary themes and sub-themes will be generated and continually refined.
Data integration and synthesis
Integration of data will take place after the completion of qualitative data collection. The data will be integrated through a triangulation approach . A “coding matrix” will be developed listing the findings from the quantitative and the qualitative study, followed by critical evaluation to find out if the findings from the two studies agree (convergence), if they offer same information on the same issue (complementarity), or if they contradict each other (dissonance) . The aim of this integration process is to develop “meta-themes” that will enable the creation of a composite picture of the whole phenomenon of interest. Based on this integration, a series of recommendations will be made to inform future pain app studies.
The ethical approval for this study was obtained from The University of Notre Dame Australia Ethics Committee (approval number: 017049S). This study is also registered in the Australia New Zealand Clinical Trials Registry (ANZCTR) under the trial ID: ACTRN12617000921381.
Data management plan
Study data will be recorded in electronic and hard copy form for the purpose of study administration and for the collection of participant data.
An Excel spreadsheet will be created to store participants’ confidential contact information together with their allocated study ID. This will be the only link between each participant and their study ID. This linkage of information is necessary to carry out the post-test data collection, to organize the semi-structured interviews with interested participants, and in cases where a participant later wishes to withdraw from the study and wants their data removed.
The audio recording of the semi-structured interviews will also be transcribed in electronic form (Microsoft Word file). Each interviewee will be provided with a study ID, and any identifiable information that may be present in the audio recording will be de-identified in the transcription process before transferring the data to NVivo software. These files will be stored in the researcher’s password-protected laptop computer and saved within password-protected folders for added security. All data entry work will be carried out by one of the investigators.
Hard copy recording
The consent forms of each participant will be obtained in hard copy or paper form. In addition, the pre-post test data will also be collected in hard copy form. The hard copy of the participant’s consents will be stored in a locked cabinet securely and separately from their study data.
All of the data storage will be done in a locked cabinet securely at the principal investigator’s office. The access to the study data will be provided only to the investigator team. At the completion of the study, all study material (electronic and hard copy) will be reconciled and stored as per the relevant state regulation regarding research data retention and disposal of that time.
Data analysis will start immediately after the data collection period. The result of this study will be published in peer-reviewed journals and presented in relevant conferences.
This phase I feasibility study will make an important contribution to determining the feasibility and acceptability and building the evidence base concerning the use of pain self-management apps for older people living with arthritic pain. In addition to being the first study to evaluate the feasibility and acceptability of a pain self-management app in the older population, this study will also provide preliminary insights into the impact of a self-management app in older people’s pain and self-efficacy-related outcomes. Given the globally aging population, the prevalence of chronic pain, an upward trend of smartphone adoption among older people, and the paucity of evidence in the area of pain self-management apps among older people, this study aims to address an important evidence gap.
Several limitations of this study should be considered. Firstly, this study is not prescriptive in terms of how often participants are to use the app. They will receive a brief training on how to use the intervention app to ensure they are comfortable with using it; however, the frequency with which they use it is up to them. This could lead to non-uniform app use pattern among the participants. However, as we intend to evaluate the feasibility and acceptability of the pain self-management app as it resembles the “real-world” situation, the varying pattern of app use will be considered and evaluated in a qualitative sub-study with the participants (reported elsewhere). Secondly, there is a possibility of selection bias as we aim to recruit via social clubs and associations which could exclude those who are less socially active and involved. To minimize this potential, we have also opted for snowballing recruitment approach where referrals to non-members from participating clubs/individuals are followed-up adequately for inclusion. However, with the utilization of snowballing sampling approach, it will be challenging to appropriately capture the refusal rate resulting from snowballing, and this will be a limitation of this study.
Despite the above-noted limitations, findings from this study will be relevant in informing future arthritic pain self-management research and similar app development endeavors. The findings of this study are expected to help develop a set of recommendations that could inform policymakers, clinicians, app developers, and consumers when developing, selecting, or implementing a pain self-management app.
World Health Organization. Global Health and Aging. National Institutes of Health publication no. 11–7737. 2011. Retrieved from http://www.who.int/ageing/publications/global_health.pdf.
Patel KV, et al. Prevalence and impact of pain among older adults in the United States: findings from the 2011 National Health and Aging Trends Study. PAIN®. 2013;154(12):2649–57.
Australian Bureau of Statistics. Arthritis and osteoporosis, in Australian Health Survey: first results, 2011–2012. Canberra: Australian Bureau of Statistics; 2012.
March LM, Bachmeier CJM. 10 economics of osteoarthritis: a global perspective. Baillières Clin Rheumatol. 1997;11(4):817–34.
Nicholas MK, et al. Is adherence to pain self-management strategies associated with improved pain, depression and disability in those with disabling chronic pain? Eur J Pain. 2012;16(1):93–104.
Schofield P, et al. Systematically searching for and assessing the literature for self-management of chronic pain: a lay users’ perspective. BMC Geriatr. 2014;14(1):86.
Lorig K, Holman HR. Self-management education: history, definition, outcomes, and mechanisms. Ann Behav Med. 2003;26(1):1–7.
Pew Research Center Health fact sheet 2017.
Pew Research Center. Older adults and technology use. 2014. Available: http://www.pewinternet.org/2014/04/03/older-adults-and-technology-use/.
Pew Research Center. Tech adoption climbs among older adults. 2017. Available: https://www.pewinternet.org/2017/05/17/tech-adoption-climbs-among-older-adults/. Accessed 17 July 2017.
Boulos MNK, et al. Mobile medical and health apps: state of the art, concerns, regulatory control and certification. Online J Public Health Inform. 2014;5(3):229.
Ventola CL. Mobile devices and apps for health care professionals: uses and benefits. Pharm Ther. 2014;39(5):356.
Bhattarai P, Newton-John TRO, Phillips JL. Quality and usability of arthritic pain self-management apps for older adults: a systematic review. Pain Med. 2017;19(3):471–84.
Lalloo C, et al. “There’s a pain app for that”: review of patient-targeted smartphone applications for pain management. Clin J Pain. 2015;31(6):557–63.
Wallace LS, Dhingra LK. A systematic review of smartphone applications for chronic pain available for download in the United States. J Opioid Manag. 2013;10(1):63–8.
Reynoldson C, et al. Assessing the quality and usability of smartphone apps for pain self-management. Pain Med. 2014;15(6):898–909.
Rosser BA, Eccleston C. Smartphone applications for pain management. J Telemed Telecare. 2011;17(6):308–12.
Stinson JN, et al. Development and testing of a multidimensional iPhone pain assessment application for adolescents with cancer. J Med Internet Res. 2013;15(3):e51.
Kristjánsdóttir ÓB, et al. A smartphone-based intervention with diaries and therapist-feedback to reduce catastrophizing and increase functioning in women with chronic widespread pain: randomized controlled trial. J Med Internet Res. 2013;15(1):e5.
Wesley KM, Fizur PJ. A review of mobile applications to help adolescent and young adult cancer patients. Adolesc Health Med Ther. 2015;6:141.
Van Het Reve E, et al. Tablet-based strength-balance training to motivate and improve adherence to exercise in independently living older people: part 2 of a phase II preclinical exploratory trial. J Med Internet Res. 2014;16(6):e159.
Yamada M, et al. Using a smartphone while walking: a measure of dual-tasking ability as a falls risk assessment tool. Age Ageing. 2011;40(4):516–9.
Currie M, Philip LJ, Roberts A. Attitudes towards the use and acceptance of eHealth technologies: a case study of older adults living with chronic pain and implications for rural healthcare. BMC Health Serv Res. 2015;15(1):1–12.
Parker SJ, et al. Older adults are mobile too!Identifying the barriers and facilitators to older adults’ use of mHealth for pain management. BMC Geriatr. 2013;13:43.
Campbell M, et al. Framework for design and evaluation of complex interventions to improve health. BMJ. 2000;321(7262):694–6.
Craig P, et al. Developing and evaluating complex interventions: the new Medical Research Council guidance. BMJ. 2008;337:a1655.
Bowen DJ, et al. How we design feasibility studies. Am J Prev Med. 2009;36(5):452–7.
Eldridge SM, et al. Defining feasibility and pilot studies in preparation for randomised controlled trials: development of a conceptual framework. PLoS One. 2016;11(3):e0150205.
Tickle-Degnen L. Nuts and bolts of conducting feasibility studies. Am J Occup Ther. 2013;67(2):171–6.
Patford J, Breen H. Homes away from home: registered clubs as leisure providers for older people living in the Tweed Heads region of Australia. Ann Leis Res. 2009;12(2):216–35.
Welfare, A.I.o.H.a. and Welfare. Older Australia at a glance. Australia: Australian Institute of Health and Welfare Canberra; 2007.
Paul L, et al. Increasing physical activity in older adults using STARFISH, an interactive smartphone application (app); a pilot study. J Rehabil Assistive Technol Eng. 2017;4:2055668317696236.
Silveira P, et al. Tablet-based strength-balance training to motivate and improve adherence to exercise in independently living older people: a phase II preclinical exploratory trial. J Med Internet Res. 2013;15(8):e159.
St James’s Hospital and Arthritis Ireland. RAISE V1.0.3. [Mobile application software] 2015; Available from: http://www.apple.com/au/itunes/.
WebMD. WebMD Pain Coach V1.3 [Mobile application software] 2016; Available from: https://play.google.com/store/apps/details?id=com.webmd.paincoach&referrer=ts%3D080b6f99-723c-11e6-87a2-002590a28fc7.
WebMD WebMD Pain Coach App. 2015.
Nicholas MK. The pain self-efficacy questionnaire: taking pain into account. Eur J Pain. 2007;11(2):153–63.
Miltiadou M, Yu CH. Validation of the Online Technologies Self-Efficacy Scale (OTSES); 2000.
Mendoza T, et al. Reliability and validity of a modified Brief Pain Inventory short form in patients with osteoarthritis. Eur J Pain. 2006;10(4):353.
Tonkin L. The pain self-efficacy questionnaire. Aust J Physiother. 2008;54(1):77.
Miles CL, et al. Measuring pain self-efficacy. Clin J Pain. 2011;27(5):461–70.
Nicholas MK, McGuire BE, Asghari A. A 2-item short form of the Pain Self-Efficacy Questionnaire: development and psychometric evaluation of PSEQ-2. J Pain. 2015;16(2):153–63.
Charlson ME, et al. A new method of classifying prognostic comorbidity in longitudinal studies: development and validation. J Chronic Dis. 1987;40(5):373–83.
Stalvey BT, et al. The Life Space Questionnaire: a measure of the extent of mobility of older adults. J Appl Gerontol. 1999;18(4):460–78.
Abernethy AP, et al. The Australia-modified Karnofsky Performance Status (AKPS) scale: a revised scale for contemporary palliative care clinical practice [ISRCTN81117481]. BMC Palliat Care. 2005;4(1):7.
Miles MB, Huberman AM, Saldana J. Qualitative data analysis: a methods sourcebook. SAGE Publications; 2013.
O’Cathain A, Murphy E, Nicholl J. Three techniques for integrating data in mixed methods studies. BMJ. 2010;341:c4587.
This study is supported by the University of Notre Dame Australia’s Collaborative Research Network, funded by the Australian Government.
Availability of data and materials
Ethics approval and consent to participate
This study was approved by the University of Notre Dame Australia Human Research Ethics Committee.
Consent for publication
The authors declare that they have no competing interests.
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.