Pilot randomised clinical trial of an eHealth, self-management support intervention (iVERVE) for stroke: feasibility assessment in survivors 12–24 months post-event
Pilot and Feasibility Studies volume 6, Article number: 172 (2020)
Electronic communication is used in various populations to achieve health goals, but evidence in stroke is lacking. We pilot tested the feasibility and potential effectiveness of a novel personalised electronic self-management intervention to support person-centred goal attainment and secondary prevention after stroke.
A phase I, prospective, randomised controlled pilot trial (1:1 allocation) with assessor blinding, intention-to-treat analysis, and a process evaluation. Community-based survivors of stroke were recruited from participants in the Australian Stroke Clinical Registry (AuSCR) who had indicated their willingness to be contacted for research studies. Inclusion criteria include 1–2 years following hospital admission for stroke and living within 50 km of Monash University (Melbourne). Person-centred goals were set with facilitation by a clinician using a standardised template. The intervention group received electronic support messages aligned to their goals over 4 weeks. The control group received only 2–3 electronic administrative messages. Primary outcomes were study retention, goal attainment (assessed using Goal Attainment Scaling method) and satisfaction. Secondary outcomes were self-management (Health Education Impact Questionnaire: 8 domains), quality of life, mood and acceptability.
Of 340 invitations sent from AuSCR, 73 responded, 68 were eligible and 57 (84%) completed the baseline assessment. At the goal-setting stage, 54/68 (79%) were randomised (median 16 months after stroke): 25 to intervention (median age 69 years; 40% female) and 29 to control (median age 68 years; 38% female). Forty-five (83%) participants completed the outcome follow-up assessment. At follow-up, goal attainment (mean GAS-T score ≥ 50) in the intervention group was achieved for goals related to function, participation and environment (control: environment only). Most intervention participants provided positive feedback and reported that the iVERVE messages were easy to understand (92%) and assisted them in achieving their goals (77%). We found preliminary evidence of non-significant improvements between the groups for most self-management domains (e.g. social integration and support: β coefficient 0.34; 95% CI − 0.14 to 0.83) and several quality-of-life domains in favour of the intervention group.
These findings support the need for further randomised effectiveness trials of the iVERVE program to be tested in people with new stroke.
ANZCTR, ACTRN12618001519246. Registered on 11 September 2018—retrospectively registered.
Key messages on feasibility
What uncertainties about feasibility existed prior to this study?
A novel, co-designed electronic self-management intervention to support person-centred goal attainment and secondary prevention after stroke was developed that would enable tailoring and the ability to personalise support messages. Prior to testing for effectiveness in a randomised controlled trial (RCT), we sought to assess the feasibility of implementing the complex (i.e. has multiple components) intervention design, the electronic randomisation and data collection processes, and obtain feedback from survivors of stroke to inform the design of future RCTs.
What are the key feasibility findings from this study?
Feasibility was determined from sufficient participants completing the trial (> 80%), feedback that the messages were useful and educational, requests to ‘stop’ messages were few and there was evidence of goal attainment and satisfaction with the program. System failures for sending messages were not detected. Practical barriers in this early test phase included the length of the intervention being too short (4 weeks) to fully understand all the implications of running the full pre-planned 12-week program and the inclusion of participants who had their stroke over 1 year before receiving the intervention.
What are the implications of the feasibility findings on the design of the main study?
The results provided information for us to refine our study processes and procedures related to setting personalised goals and assignment of messages and an indication the intervention would be more relevant to survivors of stroke following discharge from the hospital after a new stroke. A mixed-method process evaluation will be performed alongside the future RCTs with a phase II study to enable testing of the new procedures in recruiting patients directly from hospitals rather than from the community and to assess responder burden and retention rates from a longer intervention period.
Stroke is a leading cause of global disease burden . The presence of physical disability, loss of employment, inability to participate in pre-stroke activities, social isolation, anxiety  and depression  make returning to the community difficult . This can be further complicated by the need to manage the risk factors that caused the stroke to avoid further vascular events. These ongoing physical, physiological and psychosocial impacts are associated with unplanned readmission, reduced participation and quality of life, and unmet needs across a range of domains [5, 6]. For people with a chronic condition such as stroke, adjustments such as learning new behaviours or modifying one’s lifestyle are necessary, but also challenging . The ease with which adjustments occur is multifaceted and relies, in part, on a person’s self-efficacy, including beliefs and confidence about their capabilities in performing various everyday activities. Self-efficacy specifically influences health behaviours, the types of goals an individual will set and their ability to attain them . Facilitating self-efficacy, for example by providing self-management support, may influence how much effort individuals invest in achieving their health goals and their resilience when faced with difficulties or failure . Jones and Riazi have identified that self-efficacy is an important variable associated with outcomes such as quality of life, perceived health status, depression, activities of daily living and aspects of physical functioning . One approach to enhancing self-efficacy in people living with stroke is through self-management programs .
To maximise the effectiveness of self-management programs, effort must be made to set well-defined recovery goals and ensure goals are person-centred (and not clinician imposed) . Having ongoing support to achieve these goals is also key for goal attainment [10, 11], but often there are barriers faced once people return to community living after discharge from the hospital. The scale of providing such support to survivors of stroke living in the community requires innovation in approach and delivery. Research testing novel approaches for providing support programs is required, including new or improved technology-based products and processes. Building the evidence base for successful solutions may provide people with stroke who are living in the community with the necessary assistance to continue with their recovery and optimise their secondary prevention management .
The increase in the use of mobile phones and personal computers/tablets represents an important resource for lifestyle behaviour change and disease management [13, 14]. Online eHealth support tools, accessible from portable devices or personal computers, are one way of optimising self-management and support for goal attainment. This can include support messages or reminders using electronic communication such as short message service (SMS) or email, as well as in-app messaging. Although SMS and internet-based programs have been trialled in several populations , their use in survivors of stroke is rare and limited to medication adherence or to a subgroup of those with hypertension or depression [14, 16, 17]. There is a need to build the evidence base on comprehensive eHealth messaging to enhance support for recovery, secondary prevention and self-efficacy following stroke.
In 2016, we developed an innovative multicomponent intervention comprised of standardised person-centred goal-setting and an aligned electronic self-management support system . This intervention was specifically designed for people with stroke who are discharged home from the hospital. The system includes an online database to capture participant characteristics with automatic integration of patient characteristics, stroke recovery and prevention goals into a purpose-built iVERVE (inspiring Virtual Enabled Resources following Vascular Events) messaging system. The platform has > 1200 electronic messages that were developed using evidence-based behaviour change theory, clinical guidelines and independent review . This new intervention required testing for feasibility and acceptability in people with stroke before application in a fully powered effectiveness trial.
To assess the feasibility, acceptability and potential effectiveness of iVERVE as part of a pilot randomised controlled trial, among a convenience sample of survivors of stroke. Subsequently, this evidence would be used to inform the design of future trials.
We conducted, a prospective, two-group randomised (1:1) controlled pilot trial using a mixed-methods PROBE (prospective randomized, open-label, blinded-endpoint) design with an active control (Fig. 1). The trial was conducted in Melbourne, Australia.
The trial had an embedded, computer-generated randomisation process (schedule developed by an independent researcher otherwise uninvolved in the trial). Baseline and follow-up assessments were completed by an assessor who was blind to group allocation. A participant satisfaction survey was also completed. All participant trial data were entered into the Research Electronic Data Capture (REDCap) electronic data capture tool  hosted at Monash University. REDCap is a secure, web-based software platform designed to support data capture for research studies and has a range of features including interoperability with external sources .
The trial was retrospectively registered with Australian New Zealand Clinical Trials Registry: ACTRN12618001519246, registered on 11 September 2018. The Monash University Human Research Ethics committee (CF16/1920 - 2016000979) approved the study before data collection began. We report our methods and results in compliance with the CONSORT 2010 Statement, including the extension for randomised pilot and feasibility trials .
Patient and public involvement
Public involvement was obtained in two ways. First, survivors of stroke and advocates from the Stroke Foundation were included on the advisory committee as part of overseeing the development of the intervention . Second, we obtained feedback from survivors of stroke who were participants in the study during the conduct of this pilot trial. We will also disseminate a lay summary of the study results on our project-specific website http://recaps.com.au/ and provide this report to participants on request.
Participant recruitment and randomisation
Participants for this study were recruited from the Australian Stroke Clinical Registry (AuSCR). The AuSCR is a national clinical quality registry of people with acute stroke or transient ischaemic attack. It is designed to monitor and improve the quality of acute stroke care . Participants were included if they (1) agreed to participate in future research as described in their AuSCR 90–180-day follow-up survey, (2) were aged at least 18 years, (3) had been discharged from the hospital within 6–12 months of their last registered admission for stroke, (4) were living in the community (but not in residential aged care facilities), (5) were located within 50 km of Monash University (Monash Health, Clayton campus), and (6) had English as their first language or did not require an interpreter.
On behalf of the researchers, the AuSCR Office staff mailed an invitation pack that included a consent form and a pre-enrolment survey to potentially eligible participants. The reply-paid forms were returned to Monash University by interested participants. Subsequently, for those who completed the consent form and who confirmed their eligibility based on their responses to the pre-survey, an Outcome Assessor completed their baseline (T0) interviews by telephone. The blinded Outcome Assessor also completed follow-up calls after the 4-week program was completed (T1) (Fig. 1). Once the baseline assessment had been completed and before randomisation, a separate telephone interview was conducted by a clinician-researcher to help participants set 2–3 stroke recovery and prevention goals that were likely to be attainable within the 4-week timeframe of the intervention. The clinician-researcher was a qualified allied health professional with expert skills in setting recovery-focused health goals with patients after stroke. This was done using a project-specific standardised goal-setting template and procedure (see below) . To ensure standardisation in study procedures, Outcome Assessors and clinician-researchers received relevant training by members of the investigator team.
Participants were randomly allocated 1:1 to the control or the intervention group by an independent researcher. Randomisation was stratified by age (< 65, 65+ years) and modified Rankin Scale score [0–2 (no symptoms at all or no significant disability despite symptoms), 3–5 (slight disability, moderate disability or moderately severe disability)] .
We sought to recruit a maximum of 50 patients per group for this pragmatic feasibility (pilot) trial consistent with recommendations in the literature and other studies in this field [23,24,25,26,27].
Participants in the control group received their usual care in the community and to avoid unblinding to group allocation received goal-setting assistance for 2–3 goals and received 2–3 administrative messages over a 4-week period. This included a recommendation to access the Stroke Foundation (Australia) website for information about stroke through bit.ly/2tjtyhE, or phoning the Strokeline.
In addition to the goal-setting assistance received by the control group, the intervention group also received a comprehensive post-discharge support eHealth program that was delivered via the iVERVE system . This system was developed by an interdisciplinary team including communication engineers, clinicians, public health researchers and consumers, with independent review of messages. It enables the programming of electronic support and educational messages aligned to nominated goals that cover the four domains of the International Classification of Function (ICF) developed by the World Health Organization . Messages were created, based on behaviour change theory (including social cognitive theory, Information-Motivational-Behavioural theory and operant condition) and behaviour change techniques , under five main categories: administration and general motivation; secondary prevention; health/body function, activities and participation (combined ICF categories); and environment. The message bank included over 1200 messages. Participants in the intervention group received daily support messages matched to their personal recovery and prevention goals and level of functional ability. The messages could be tailored and delivered via SMS or email and were personalised (by name) and individualised, and some messages contained hyperlinks to trusted websites. Two-way communication was possible, e.g. ‘STOP’ messages could be received from participants’ telecommunications. The number of messages received did not exceed one per day and was dependent on the number of goals set. The intervention group also received one or two administrative or general motivational message per week.
Primary outcomes for this study were defined as the number of participants who completed the trial, the number of goals attained and the number of participants satisfied with the program. Goal attainment was measured using Goal Attainment Scaling (GAS) . The GAS is an established quantitative method that offers an individualised evaluation of non-linear constructs (i.e. patient-centred goals) based on mathematical principals to permit generalisability for use in group comparisons . Within GAS, progress towards goal achievement is measured with reference to the goal and scored on a 5-point scale from − 2 (no progress has been made or performance worse than baseline) to + 2 (performance greatly exceeded expectation). A zero score indicates achievement of the expected level of performance, as indicated in the goal statement . To promote reliability and consistency, a clinical member of the research team who was not part of the goal-setting or evaluation team pre-populated the expected GAS levels of performance (− 2 through + 2) .
Secondary outcomes were intervention dose (number of SMS/email messages successfully sent), costs of maintaining the iVERVE interface and sending messages, and satisfaction with the content of eHealth messages. Other secondary outcomes include self-management (measured with the validated Health Education Impact Questionnaire [heiQ])  which covers constructs related to enhancing self-efficacy as measured through self-management practices such as health-directed behaviours, self-monitoring and insight and skill acquisition to cope with symptoms and health problems . Higher scores characterise better skills . We have previously used this outcome in a trial of self-management programs for survivors of stroke . Given the large number of people after stroke who self-report anxiety and depression , we also measured emotional status (Hospital Anxiety and Depression Scale [HADS]) with lower scores indicating fewer symptoms . Health-related quality of life is measured by the EuroQoL-5 dimension-3 (EQ-5D-3L) level instrument and the visual analogue scale (VAS; 0–100 with higher scores indicating better self-reported health status) . We also collected information on participation using the Nottingham Extended Activities of Daily Living (NEADL; 0–66 with higher scores indicating independence with everyday activities) Scale . All of these health rating scales have previously been used in stroke studies and validated for use in stroke [38,39,40].
Outcomes were measured at baseline (T0) for health status and after the intervention (T1 after week 5).
The modified Rankin Scale  was used to assess the degree of disability or dependence at baseline to assist with the allocation of support messages based on the level of disability.
Feasibility assessment and process evaluation
Feasibility was assessed against the variables of recruitment of participants, dose of the intervention delivered, message transmission failures, completeness of baseline and outcome data, and respondent burden, including retention. We triangulated sources of information including administrative data, calls or email to a help-desk contact person and log-records of electronic messaging activity. Log-records were also used to calculate the costs of calls.
Recruitment proportion was determined by calculating the number of consented participants as a proportion of the eligible population and retention of consented participants. Characteristics of the non-responders were obtained from the AuSCR. Intervention fidelity was partly assessed by examining the number of text messages sent and those that failed to send; measures of acceptability included the number of respondents who sent ‘STOP’ texts and the reasons for the ‘STOP’ texts (also considered a perceived measure of burden). Feasibility of measurement and the burden of data collection were determined by assessing the number of clinical outcomes completed and recording the duration of the goal-setting interviews. In our prior research of a group-based self-management intervention, we have found that survivors of stroke, despite the different types of impairments, complete this type of health outcome battery with acceptable response rates .
A survey was sent to participants 1–2 weeks post-intervention to assess their feedback with various aspects of the intervention including goal-setting. This included closed questions and open text fields to describe the perceived benefits of the program, willingness to continue with the program or likelihood of recommending it to other survivors of stroke. Participants in the intervention group were asked additional questions to elicit their perceived benefits of receiving electronic health support. These included questions about the type and frequency of electronic messages, appropriateness of message content and perceptions about the adequacy of the length of support. A focus group was also undertaken with a sample of those in the intervention group  (data not reported).
Descriptive statistics were used to compare the participants’ characteristics by group allocation (intervention or control) and also with non-responders (those who did not reply to the invitation to participate, or were deemed ineligible after initial screening, or were uncontactable after initially responding, or chose not to participate once they learnt about the project). All outcome measures were analysed using an intention-to-treat analysis. Descriptive statistics were calculated for all variables over the two time points (T0, T1). Due to the skewed distribution of continuous outcomes, differences between the groups were reported as the median difference (95% CI). Median or logistic regression models were used with the outcome as the dependent variable (at the 4-week follow-up) and baseline scores entered as covariates. Independent variables, including group allocation, were entered into the regression. In the sensitivity analyses using median regression, bootstrap estimates were computed for 1000 replicates for 25th, 50th and 75th quantiles to calculate the change at 4 weeks relative to baseline measurements for assessing potential within-group differences. Where relevant, statistical significance was set at p < 0.05 (two-sided). Open-ended responses from the satisfaction surveys were analysed using inductive thematic analysis . Closed questions were summarised descriptively.
For GAS, the GAS-T method was used . Each goal was given a score over 5 levels ranging from − 2 to + 2. Goals were also weighted based on relative importance to the patient, as well as difficulty as perceived by the clinician involved in the collaborative goal-setting, with each graded on a scale of 0 (not at all difficult) to 3 (very difficult) . Individual scores were then combined to provide an overall goal attainment score. The GAS-transformed normally distributed score (i.e. T score) was calculated for each intervention group by goal category with a mean of 50 (SD 10) as the reference . The T score was categorised by attainment of goal status (e.g. goal not attained = T score < 50 and goal often attained = T score ≥ 50).
All analyses were undertaken using Stata/SE 15.01 (StataCorp 2017).
Feasibility outcomes: participation, retention and data completeness
Recruitment for this study began on 28 March 2017, and the final baseline assessments were completed on 8 August 2017, to ensure our pilot study would be completed in 2017. The completion of outcome assessments occurred between 29 June and 14 November 2017.
During the screening and recruitment phase, 340 eligible AuSCR registrants were invited to participate. Of the 73 who returned a consent form and were subsequently assessed for eligibility, five were deemed unsuitable for this study and did not proceed to the next stage (i.e. two participants had cognitive disabilities, two had been admitted to hospital and one had hearing problems making communication for telephone outcome assessments infeasible). Compared with the non-responders, participants were more likely to be younger and born in Australia (not statistically significant).
Among the 68 remaining candidates for inclusion in this study, 57 (84%) completed the baseline assessment. These participants were living at home ~ 12–24 months after their initial stroke event. However, eleven participants (16%) did not complete the baseline assessment for the following reasons: seven declined to participate, three did not return a consent form and one participant did not own a mobile phone or have an email address. At the goal-setting interview stage, three participants were uncontactable, leaving 54 (95%) participants who were randomised (Fig. 1). Twenty-five were allocated to the intervention group (median age 69 years; 40% female) and 29 were allocated to the control group (mean age 68 years; 38% female). Baseline characteristics were similar between the groups (Table 1). The demographics of the participants who completed all baseline measures and set goals were similar to individuals classified as non-responders (n = 286; ~ 40% female; Additional file 1: Table 1). The overall retention in the study was 45/54 (83%) (Fig. 1).
The median minutes (interquartile range) taken to complete assessments was 22 (15; 31) at baseline, 29 (22; 36) at follow-up and 35 (30; 45) for setting a maximum of three goals. At T1, the outcome assessment was unable to be collected from nine participants, with eight withdrawing (4 intervention and 4 control). One intervention participant was uncontactable. Outcome measures were able to be collected from 45 participants across two time points with > 95% complete data. Median time from start to completion of follow-up was 35 days.
Based on the raw GAS scaling scores, overall, 92% of participants scored − 1 or above indicating some progress towards achieving their goals during the 4-week period. For the whole sample, goal attainment using the mean GAS T scores across all goals was not achieved (mean 49, SD 13; Table 2). Among the intervention group, goal attainment was achieved in three out of the four goal categories: health/body function, activities, and participation and environment, whereas goal attainment in the control group was only achieved for goals relating to environment tasks.
The survey was completed by 27/54 (50%) of participants (13 intervention: 52%; 14 control: 48%). Most participants in both groups stated they would be happy to take part in a similar project in the future (intervention 69%, control 71%) and would recommend it to other people with stroke (intervention 85%, control 79%).
Satisfaction with goal-setting procedures
Over 85% of participants in both groups reported that the goal-setting form was helpful in developing their goals. Both groups agreed that the clinicians were helpful in developing their goals (intervention 92%, control 72%, p = 0.16).
Perceived benefit of the electronic health support (intervention group only)
No unintended harms or effects were reported. Most participants believed that text or email messages helped them achieve their goals (77%) and were a good way to receive education about stroke (Fig. 2). Participants were comfortable accessing their mobile phone or computer to read and respond to SMS or email messages and felt that the iVERVE messages were easy to understand. This group perceived many benefits to the electronic support messages (Fig. 3). Eleven of the 13 participants in the intervention group who responded to the survey considered the frequency of SMS/email messages received was appropriate. Overall, the messages were considered easy to receive and read (85%). However, only 54% (n = 7) reported that they understood how to access further information from the web links provided within the messages.
Potential benefits for self-management or health outcomes
Among participants in the intervention group, we noted several indicative improvements in different domains of the heiQ at 4 weeks (Additional file 1: Table 2). For example, in the univariable analyses in the intervention group, the median score for constructive attitudes and approaches was 5.8 at baseline and 6.0 at follow-up. The median change at 4 weeks relative to baseline measurements was 1.25 (95% CI 0.3, 2.2). In the sensitivity analyses, similar results in the intervention group were found at the 50th quantile compared with 25th and 75th quantiles for the median change at 4 weeks relative to baseline measurements (Additional file 1: Table 3). After adjusting for baseline measures, we found preliminary evidence of potential improvements for most of the self-management domains, in favour of the intervention group compared with the control group (Table 3). For example, for social integration and support, there a was positive increase (coefficient 0.34) in this domain at follow-up after adjustment for the effect of the intervention on outcomes. We also noted potential improvements to some quality-of-life dimensions (EQ-5D-3L): self-care, usual activities, and pain or discomfort.
Program costs and dose
Overall, 824 electronic messages (446 SMS; 378 emails) were sent during the intervention period (657 intervention; 167 control). The average number of messages sent was 15 for the intervention participants and 3 for control participants. There were no message failures and no calls to the help desk to report problems with the messages. In terms of returned messages, there were two ‘STOP’ requests and one request for ‘no more contact’ from the participants (2 intervention; 1 control). The total cost for delivering the 824 messages was 39 Australian dollars (AUD39, or 4.7 cents per message sent).
We provide preliminary evidence that the use of electronic messaging to support comprehensive person-centred goal achievement after stroke is feasible and has potential in terms of effectiveness. In particular, we found that our comprehensive iVERVE intervention was acceptable to people with stroke in providing support and health information on a broad range of recovery issues. Another aim of this pilot study was to establish the feasibility of our goal-setting method and acceptance of a purpose-built iVERVE messaging system. We were encouraged that a larger proportion of intervention participants believed that the health professionals had been helpful in facilitating development of person-centred goals across a range of domains since they received messages tailored to these goals, compared to the control group. Goal attainment differences between the groups in this sample of people with chronic stroke who trialled the intervention for 4 weeks were promising. Median T scores over 50, indicating goals often obtained, were noted for the intervention group for health/body function, activities and participation and environment, but not the control group. Limitations of using the GAS include the small sample size and short intervention period. It was also reassuring to find preliminary evidence of improvements for most of the self-management domains and several quality-of-life domains in favour of the intervention group compared with the control group.
Few studies have been conducted which include goal-setting with eHealth support. In the study by Wan et al., people with ischaemic stroke were randomised to control, or a goal-setting intervention without eHealth support messages . Participants in this latter study were assisted in establishing secondary prevention goals during a telephone call 1 week after discharge. Two additional follow-up calls (1 and 3 months post-discharge) were conducted by the stroke nurse to discuss progress towards their goals. The intervention was feasible and led to improved medication adherence at 6 months after discharge from the hospital , but there were no other differences between the groups on other health behaviour categories or disability outcomes. The authors concluded that there was a need for more effective intervention strategies with increased contact, to help participants reach guideline-recommended targets . Subsequently, these authors conducted a multicomponent intervention study in people with hypertension and ischaemic stroke to improve health behaviours and blood pressure control . The intervention, provided over 4 weeks, comprised face-to-face and telephone health belief education, a participant calendar handbook and weekly automated short message services. With the exception of smoking and alcohol consumption, health behaviours targeting other risk factors and blood pressure control improved , which lends support for incorporating secondary prevention as part of iVERVE. However, our approach is more comprehensive than this prior work and acknowledges the diverse impact of stroke on many aspects of life, as well as the need to enable support for secondary prevention.
Strengths of this study were the overall high level of acceptability for the intervention, the lack of message failures and the demonstrated ability to recruit participants from an established national clinical quality registry which created recruitment efficiencies for a pilot feasibility trial. Well-designed randomised controlled trials (RCTs) provide the highest level of quality for assessing the efficacy of interventions . However, achieving recruitment targets can be difficult, leading to extended study timeframes, additional costs or wastage of valuable research money when studies fail to reach targets . As an alternate strategy, clinical registries may provide vehicles to facilitate recruitment for clinical trials, particularly trials recruiting community-dwelling stroke survivors. We found that the use of the AuSCR was a cost-effective way to recruit for the current study, since between 60 and 64% of registrants at the 90–180-day follow-up indicate their willingness to be contacted for research . Compared to those unwilling to be contacted, these registrants were younger and more often male . The current study provides one of the first examples of leveraging this registry infrastructure to conduct a clinical trial in stroke. Clinical registries may also provide an efficient mechanism to monitor uptake of new evidence for different contexts and settings and can be complementary to conducting clinical trials [49, 50]. If our messaging intervention is found to be effective in a phase III RCT, it could be routinely monitored through national registry infrastructure such as AuSCR.
The limitations of this pilot study include the 4-week time frame for testing the intervention and the inclusion of participants who had their stroke over 1 year before receiving the intervention. For pragmatic reasons, we piloted the intervention for only 4 weeks (although the intervention has been designed as a 12-week program) since 4 weeks was considered sufficient to provide us with the information required for a future phase II trial regarding program acceptability, system integrity and feedback on when and how it might best be used from the perspective of someone living with stroke. Consistency in the delivery of the intervention was monitored by the number of messages that were sent, and if any failed to send. We did not collect information on what actions were undertaken to achieve goals. We acknowledged that the findings reported in this paper may not equate to those obtained if the full intervention had been tested. Overall, few (17%) participants withdrew or were uncontactable. However, we are unable to comment on whether a greater proportion may withdraw from a larger/longer study or one in which patients immediately discharged from the hospital are included. A process evaluation to examine responder burden and retention rates from a longer intervention period and the delivery of a greater number of text messages will be considered in a future study.
There is currently little evidence to guide best practice for supporting people with stroke in the community immediately post-discharge . In the era of widely available technology used by most of the population at all ages, low cost, scalable electronic support to increase self-management with professional facilitation of goal-setting may improve the transition to home and reduce hospital readmissions. In conducting this pilot trial, we have obtained important information to finalise various aspects of the intervention and the design of phase II/III trials in people with acute stroke discharged directly to home. Specifically, the data from this initial pilot study and our recently completed phase II study in acute stroke has informed the calculation of the sample size for our phase III study (N = 890) that has been funded by the National Health and Medical Research Council (1162596) to trial the intervention in people with stroke directly discharged from acute hospitals. This Recovery-focused Community support to Avoid readmissions and improve Participation after Stroke (ReCAPS) trial has recently commenced (ACTRN 12618001468213).
With improved survival after stroke and recognised unmet needs of those living in the community, our comprehensive iVERVE intervention holds promise for addressing a range of educational and self-management issues faced everyday by survivors of stroke. Trials to determine the potential effectiveness and cost-effectiveness in acute stroke are underway.
Availability of data and materials
Data from this clinical trial will be available upon reasonable request to the corresponding author following completion and publication of the phase III trial.
Australian New Zealand Clinical Trials Registry
Australian Stroke Clinical Registry
EuroQoL-5 dimension-3 level health-related quality of life questionnaire
Goal Attainment Scaling
Hospital Anxiety and Depression Scale
Health Education Impact Questionnaire
International Classification of Function
Inspiring Virtual Enabled Resources following Vascular Events
Nottingham Extended Activities of Daily Living
National Health and Medical Research Council
Prospective randomized, open-label, blinded-endpoint
Recovery-focused Community support to Avoid readmissions and improve Participation after Stroke
Randomised controlled trial
Research Electronic Data Capture
Short message service
Visual analogue scale
Feigin VL, Krishnamurthi RV, Parmar P, et al. Update on the Global Burden of Ischemic and Hemorrhagic Stroke in 1990-2013: the GBD 2013 study. Neuroepidemiology. 2015;45(3):161–76. https://doi.org/10.1159/000441085.
Campbell Burton CA, Murray J, Holmes J, et al. Frequency of anxiety after stroke: a systematic review and meta-analysis of observational studies. Int J Stroke. 2013;8(7):545–59. https://doi.org/10.1111/j.1747-4949.2012.00906.x.
Hackett ML, Pickles K. Part I: frequency of depression after stroke: an updated systematic review and meta-analysis of observational studies. Int J Stroke. 2014;9(8):1017–25. https://doi.org/10.1111/ijs.12357.
National Stroke Foundation. Walk in our shoes. Stroke survivors and carers report on support after stroke. Melbourne: National Stroke Foundation; 2007.
Andrew NE, Kilkenny M, Naylor R, et al. Understanding long-term unmet needs in Australian survivors of stroke. Int J Stroke. 2014;9(Suppl A100):106–12. https://doi.org/10.1111/ijs.12325.
Andrew N, Kilkenny M, Lannin N, et al. Is health related quality of life between 90 and 180 days following stroke associated with long-term unmet needs? Qual Life Res. 2016;25:2053–62.
Jones F, Riazi A. Self-efficacy and self-management after stroke: a systematic review. Disabil Rehabil. 2011;33(10):797–810. https://doi.org/10.3109/09638288.2010.511415.
Dixon G, Thornton EW, Young CA. Perceptions of self-efficacy and rehabilitation among neurologically disabled adults. Clin Rehabil. 2007;21(3):230–40. https://doi.org/10.1177/0269215506071784.
Lloyd A, Bannigan K, Sugavanam T, et al. Experiences of stroke survivors, their families and unpaid carers in goal setting within stroke rehabilitation: a systematic review of qualitative evidence. JBI Database System Rev Implement Rep. 2018;16(6):1418–53. https://doi.org/10.11124/JBISRIR-2017-003499.
Rosewilliam S, Roskell CA, Pandyan AD. A systematic review and synthesis of the quantitative and qualitative evidence behind patient-centred goal setting in stroke rehabilitation. Clin Rehabil. 2011;25(6):501–14. https://doi.org/10.1177/0269215510394467.
Hurn J, Kneebone I, Cropley M. Goal setting as an outcome measure: a systematic review. Clin Rehabil. 2006;20(9):756–72. https://doi.org/10.1177/0269215506070793.
Pollock A, St George B, Fenton M, et al. Top 10 research priorities relating to life after stroke – consensus from stroke survivors, caregivers, and health professionals. Int J Stroke. 2014;9(3):313–20. https://doi.org/10.1111/j.1747-4949.2012.00942.x.
Chow CK, Redfern J, Hillis GS, et al. Effect of lifestyle-focused text messaging on risk factor modification in patients with coronary heart disease: a randomized clinical trial. JAMA. 2015;314(12):1255–63. https://doi.org/10.1001/jama.2015.10945.
Wan LH, Zhang XP, You LM, et al. The efficacy of a comprehensive reminder system to improve health behaviors and blood pressure control in hypertensive ischemic stroke patients: a randomized controlled trial. J Cardiovasc Nurs. 2018;33(6):509–17. https://doi.org/10.1097/JCN.0000000000000496.
Piette JD, List J, Rana GK, et al. Mobile health devices as tools for worldwide cardiovascular risk reduction and disease management. Circulation. 2015;132(21):2012–27. https://doi.org/10.1161/CIRCULATIONAHA.114.008723.
Kamal AK, Shaikh Q, Pasha O, et al. A randomized controlled behavioral intervention trial to improve medication adherence in adult stroke patients with prescription tailored Short Messaging Service (SMS)-SMS4Stroke study. BMC Neurol. 2015;15:212. https://doi.org/10.1186/s12883-015-0471-5.
Smith GC, Egbert N, Dellman-Jenkins M, et al. Reducing depression in stroke survivors and their informal caregivers: a randomized clinical trial of a Web-based intervention. Rehabil Psychol. 2012;57(3):196–206. https://doi.org/10.1037/a0029587.
Cadilhac DA, Busingye D, Li JC, et al. Development of an electronic health message system to support recovery after stroke: Inspiring Virtual Enabled Resources following Vascular Events (iVERVE). Patient Prefer Adherence. 2018;12:1213–24. https://doi.org/10.2147/PPA.S154581.
Harris PA, Taylor R, Thielke R, et al. Research electronic data capture (REDCap)--a metadata-driven methodology and workflow process for providing translational research informatics support. J Biomed Inform. 2009;42(2):377–81. https://doi.org/10.1016/j.jbi.2008.08.010.
Eldridge SM, Chan CL, Campbell MJ, et al. CONSORT 2010 statement: extension to randomised pilot and feasibility trials. BMJ. 2016;355:i5239. https://doi.org/10.1136/bmj.i5239.
Cadilhac D, Lannin N, Anderson C, et al. Protocol and pilot data for establishing the Australian Stroke Clinical Registry (AuSCR). Int J Stroke. 2010;5(3):217–26.
Burn J. Reliability of the modified rankin scale. Stroke. 1992;23(3):438.
Drummond AE, Whitehead P, Fellows K, et al. Occupational therapy predischarge home visits for patients with a stroke (HOVIS): results of a feasibility randomized controlled trial. Clin Rehabil. 2013;27(5):387–97. https://doi.org/10.1177/0269215512462145.
Whitehead AL, Julious SA, Cooper CL, et al. Estimating the sample size for a pilot randomised trial to minimise the overall trial sample size for the external pilot and main trial for a continuous outcome variable. Stat Methods Med Res. 2016;25(3):1057–73. https://doi.org/10.1177/0962280215588241.
Hilari K, Behn N, Marshall J, et al. Adjustment with aphasia after stroke: study protocol for a pilot feasibility randomised controlled trial for SUpporting wellbeing through PEeR Befriending (SUPERB). Pilot Feasibility Stud. 2019;5:14. https://doi.org/10.1186/s40814-019-0397-6.
Thabane L, Ma J, Chu R, et al. A tutorial on pilot studies: the what, why and how. BMC Med Res Methodol. 2010;10:1. https://doi.org/10.1186/1471-2288-10-1.
Julious SA. Sample size of 12 per group rule of thumb for a pilot study. Pharm Stat. 2005;4:287–91. https://doi.org/10.1002/pst.185.
World Health Organisation. The international classification of functioning, disability and health (ICF) 2001 [Available from: http://apps.who.int/classifications/icfbrowser/ accessed 18.11.2016.
Turner-Stokes L. Goal attainment scaling (GAS) in rehabilitation: a practical guide. Clin Rehabil. 2009;23(4):362–70. https://doi.org/10.1177/0269215508101742.
Tennant A. Goal attainment scaling: current methodological challenges. Disabil Rehabil. 2007;29(20-21):1583–8. https://doi.org/10.1080/09638280701618828.
Krasny-Pacini A, Evans J, Sohlberg MM, et al. Proposed criteria for appraising goal attainment scales used as outcome measures in rehabilitation research. Arch Phys Med Rehabil. 2016;97(1):157–70. https://doi.org/10.1016/j.apmr.2015.08.424.
Osborne RH, Elsworth GR, Whitfield K. The Health Education Impact Questionnaire (heiQ): an outcomes and evaluation measure for patient education and self-management interventions for people with chronic conditions. Patient Educ Couns. 2007;66(2):192–201.
Elsworth GR, Nolte S, Osborne RH. Factor structure and measurement invariance of the Health Education Impact Questionnaire: does the subjectivity of the response perspective threaten the contextual validity of inferences? SAGE Open Med. 2015;3:2050312115585041. https://doi.org/10.1177/2050312115585041.
Cadilhac DA, Hoffmann S, Kilkenny M, et al. A phase II multicentered, single-blind, randomized, controlled trial of the stroke self-management program. Stroke. 2011;42(6):1673–9. https://doi.org/10.1161/STROKEAHA.110.601997 published Online First: 2011/04/16.
Thayabaranathan T, Andrew NE, Kilkenny MF, et al. Factors influencing self-reported anxiety or depression following stroke or TIA using linked registry and hospital data. Qual Life Res. 2018. https://doi.org/10.1007/s11136-018-1960-y.
Snaith RP. The Hospital Anxiety And Depression Scale. Health Qual Life Outcomes. 2003;1:29. https://doi.org/10.1186/1477-7525-1-29.
The EuroQol Group. EuroQol-a new facility for the measurement of health-related quality of life. Health Policy. 1990;16:199–208.
Nouri FM, Lincoln NB. An extended activities of daily living scale for stroke patients. Clin Rehabil 1987;1(4):301-305. doi: https://doi.org/https://doi.org/10.1177/026921558700100409.
Aben I, Verhey F, Lousberg R, et al. Validity of the Beck Depression Inventory, Hospital Anxiety and Depression Scale, SCL-90, and Hamilton Depression Rating Scale as screening instruments for depression in stroke patients. Psychosomatics. 2002;43(5):386–93. https://doi.org/10.1176/appi.psy.43.5.386.
Chen P, Lin K-C, Liing R-J, et al. Validity, responsiveness, and minimal clinically important difference of EQ-5D-5L in stroke patients undergoing rehabilitation. Qual Life Res. 2016;25(6):1585–96. https://doi.org/10.1007/s11136-015-1196-z.
Cadilhac DA, Kilkenny MF, Srikanth V, et al. Do cognitive, language, or physical impairments affect participation in a trial of self-management programs for stroke? Int J Stroke. 2016;11(1):77–84. https://doi.org/10.1177/1747493015607522.
Purvis T, Kilkenny M, Andrew N, et al. Inspiring virtual enabled resources following vascular events (iVERVE): participants’ perceptions [abstract]. Int J Stroke. 2018;13(1S):140.
Braun V, Clarke V. Using thematic analysis in psychology. Qual Res Psychol. 2006;3(2):77–101. https://doi.org/10.1191/1478088706qp063oa.
Turner-Stokes L, Baguley IJ, De Graaff S, et al. Goal attainment scaling in the evaluation of treatment of upper limb spasticity with botulinum toxin: a secondary analysis from a double-blind placebo-controlled randomized clinical trial. J Rehabil Med. 2010;42(1):81–9. https://doi.org/10.2340/16501977-0474.
Wan LH, Zhang XP, Mo MM, et al. Effectiveness of goal-setting telephone follow-up on health behaviors of patients with ischemic stroke: a randomized controlled trial. J Stroke Cerebrovasc Dis. 2016;25(9):2259–70. https://doi.org/10.1016/j.jstrokecerebrovasdis.2016.05.010.
National Health and Medical Research Council. How to use the evidence: assessment and application of scientific evidence. In: NHMRC, ed. Canberra: Biotext, 2000.
McGill K, Sackley CM, Godwin J, et al. A systematic review of the efficiency of recruitment to stroke rehabilitation randomised controlled trials. Trials. 2020;21(1):68. https://doi.org/10.1186/s13063-019-3991-2.
Cadilhac DA, Lannin NA, Breen S, et al. The Australian Stroke Clinical Registry Annual Report 2017: The Florey Institute of Neuroscience and Mental Health, vol. 60; 2018.
Frieden TR. Evidence for health decision making - beyond randomized, controlled trials. N Engl J Med. 2017;377(5):465–75. https://doi.org/10.1056/NEJMra1614394.
Schoenfeld AJ, Redberg RF. The value of using registries to evaluate randomized clinical trial study populations. JAMA Intern Med. 2017;177(6):889. https://doi.org/10.1001/jamainternmed.2017.0761.
Goncalves-Bradley DC, Lannin NA, Clemson LM, et al. Discharge planning from hospital. Cochrane Database Syst Rev. 2016;1:CD000313. https://doi.org/10.1002/14651858.CD000313.pub5.
We thank Prof Leonid Churilov (University of Melbourne) for advice on the set-up of the computer-generated randomisation program. We also acknowledge the staff from the Australian Stroke Clinical Registry who coordinated and facilitated the invitation mailout to registrants and the registrants who offer to be contacted for research projects. We are grateful to Frank Lan (telecommunications engineer) for his contributions to setting up the initial prototype for the iVERVE messaging system. Mariko Carey, Amy Waller, Alana Stewart and Ida Dempsey are also acknowledged as members of the management committee and working groups for iVERVE and consumer representatives. We acknowledge the following academics and clinicians who provided independent reviews on the initial bank of support and self-management messages: Caleb Ferguson, Brendon Haslam, Clare Kempnich, Dana Wong, Emma Gee, Erin Goedecke, Jodie Kramer, Karen Page, Kathleen Bagot, Liam Johnson, Elizabeth Lynch, Mark Nelson, Rene Stolwyk, Sharon Kramer, Tamara Tse and Toby Cumming. Rebecca Barnden (Peninsula Health) is acknowledged for her contribution to goal-setting processes with participants. Tharshanah Thayabaranathan and Joosup Kim are acknowledged for their contribution in completing telephone follow-up and outcome assessments and Megan Reyneke for assisting with the data management preparation for analyses.
This research was made possible through Monash University funding provided to DAC and a Monash University Faculty Strategic Grant (SG516-0431). The following authors were also supported by fellowships from the National Health and Medical Research Council: DAC (1063761 co-funded Heart Foundation, 1154273), NEA (1072053), AGT (1042600), MFK (1109426) and MLH (1141328), and the National Heart Foundation: NAL (102005).
Ethics approval and consent to participate
The Monash University Human Research Ethics committee (CF16/1920 - 2016000979) approved the study, and all participants provided written informed consent before data collection began. A post-recruitment amendment was submitted to the Monash University Human Research Ethics Committee (#7619) to approve the collection of de-identified variables from the AuSCR on non-responders (8 March 2018).
Consent for publication
All authors have consented to the publication of this research as presented in this manuscript.
DAC reports grants from the National Health and Medical Research Council (NHMRC, Australia) outside the submitted work and has received educational grants paid to her institution from Boehringer Ingelheim, Shire, Medtronic and Amgen unrelated to this project. DAC is the Data Custodian for the Australian Stroke Clinical Registry (AuSCR); NAL reports grants from NHMRC, Australia, outside the submitted work and is Chair of the Management Committee of the AuSCR; MFK reports grants from NHMRC outside the submitted work and is a member of the AuSCR Management Committee; AGT reports grants from NHMRC, Australia, outside the submitted work and is a member of the AuSCR Steering Committee. MLH reports grants from the NHMRC, during the conduct of the study. VT reports personal fees from Boehringer Ingelheim, personal fees from Pfizer/BMS, personal fees from Medtronic, personal fees from Bayer, personal fees from Amgen and personal fees from Allergan, outside the submitted work.
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Table 1. Characteristics of participants and non-responders. Table 2. Within group differences in self-management or health outcomes (T1-T0), for intervention and control groups. Table 3. Sensitivity analysis for within group differences in outcomes (T1-T0), for intervention and control groups
About this article
Cite this article
Cadilhac, D.A., Andrew, N.E., Busingye, D. et al. Pilot randomised clinical trial of an eHealth, self-management support intervention (iVERVE) for stroke: feasibility assessment in survivors 12–24 months post-event. Pilot Feasibility Stud 6, 172 (2020). https://doi.org/10.1186/s40814-020-00706-x
- Feasibility studies
- Healthcare technology