Skip to main content

Feasibility, acceptability, and fidelity of Physical Activity Routines After Stroke (PARAS): a multifaceted behaviour change intervention targeting free-living physical activity and sedentary behaviour in community-dwelling adult stroke survivors

Abstract

Background

Low levels of habitual physical activity and high levels of sedentary behaviour are commonly observed post-stroke. We aimed to assess the feasibility, acceptability and fidelity of a multifaceted, theory- and evidence-informed supported self-management intervention targeting physical activity and sedentary behaviour after stroke: Physical Activity Routines After Stroke (PARAS).

Methods

Adult stroke survivors and healthcare professionals were recruited from North East England stroke services. Stroke survivor physical activity and sedentary behaviour were targeted by a self-management behavioural intervention supported by healthcare professionals trained in intervention delivery. The main outcomes were protocol and intervention acceptability and feasibility and fidelity of intervention delivery.

Results

Eleven healthcare professionals (9 physiotherapists; 2 occupational therapists) participated in the study. Stroke survivor recruitment was lower than anticipated (19 versus target of up to 35). The healthcare professional training programme was feasible, with fidelity assessment of delivery supporting this finding. Data completeness was acceptable according to a priori criteria (>60%), except for stroke survivor questionnaire return rate (59%) and interview uptake (52%). No serious adverse events occurred. Healthcare professionals and stroke survivors perceived intervention delivery to be feasible and acceptable with minor modifications highlighted including the potential for earlier delivery in the stroke pathway.

Conclusions

The study protocol and intervention delivery were feasible and acceptable to stroke survivors and healthcare professionals with modifications required before large-scale evaluation.

Trial registration

ISRCTN35516780. Registered on October 24, 2018

Peer Review reports

Key messages about feasibility

  • The feasibility of delivering a multifaceted behaviour change intervention supporting stroke survivors to engage in habitual physical activity and reduce sedentary behaviour over the long-term has not been established.

  • The key feasibility findings of this study are that the study protocol and intervention delivery were feasible and acceptable to stroke survivors and healthcare professionals.

  • Implications of study findings for the main study design are minor intervention modifications are required including streamlining processes and the potential for earlier delivery in the stroke pathway, and minor protocol amendments are required including improved methods for questionnaire data collection.

Background

Physical inactivity and high levels of sedentary behaviour are common after stroke, regardless of disability [1, 2]. Targeting improvements in these behaviours can improve health outcomes and quality of life and reduce mortality [3,4,5]. How to optimally support stroke survivors to engage in habitual physical activity, and reduce sedentary behaviour over the long-term, has yet to be established [6]. Promising components of interventions targeting physical activity after stroke have been identified; however, a lack of explicit reference to theory and incomplete descriptions of active intervention ingredients impede replication and implementation [7].

We previously conducted multi-phase intervention development work to identify the optimal mode, form and content of an intervention targeting physical activity and sedentary behaviour after stroke [8]. This involved the application of a structured development process in accordance with the Medical Research Council (MRC) Framework for the Development and Evaluation of Complex Interventions [7, 9]. The developmental process included a systematic review [6], qualitative focus group study and co-design work with healthcare professionals (HCPs), stroke survivors and informal carers. Intervention mapping was used to guide the stages of development [10]. This approach has been used to develop interventions that target physical activity behaviour in a range of long-term health conditions [11]. Our previous development work culminated in a prototype multi-faceted intervention: Physical Activity Routines After Stroke (PARAS). The aim of the current study was to determine the feasibility of the study protocol and the feasibility and acceptability of the PARAS intervention to inform amendments prior to conducting a larger scale evaluation, if appropriate.

Study objectives

The study objectives were (1) to assess the feasibility of delivering the study protocol in terms of recruitment and retention, HCP training programme feasibility and fidelity of intervention delivery, data completeness and patient safety and (2) to determine the feasibility and acceptability of PARAS intervention delivery from the perspectives of stroke survivors and healthcare professionals.

Materials and methods

Specific details of the PARAS study protocol have been described previously [12] and are summarised below.

Study design

A multi-centre, single arm, feasibility study was conducted. No changes were made to the methodology reported in our study protocol [12] prior to or after study commencement. A favourable ethical opinion was granted by North East-Tyne and Wear South Research Ethics Committee (Ref 18/NE/0255). The study was conducted in accordance with the Declaration of Helsinki. The study was registered on 24/10/2018 (ISRCTN35516780).

Participants

Eligibility criteria

HCPs

HCPs working in community or outpatient stroke NHS rehabilitation services, who were willing to undertake PARAS intervention training and delivery and complete study outcome assessments, were eligible to participate.

Stroke survivors

Adult stroke survivors receiving community or outpatient rehabilitation in the study catchment area with agreed (either by stroke survivor or HCP) capacity, capability and likely benefit from a supported self-management programme targeting physical activity or sedentary behaviour were eligible. Stroke survivors who had contraindications to physical activity or had been advised by their GP or consultant to avoid increasing their physical activity levels, were excluded.

Study setting

The setting of the study was in NHS community and outpatient stroke services in the North East of England.

Identification and consent

HCPs

Three stroke rehabilitation departments in the North East of England were approached by the research team to participate. Members of the research team visited each department providing a verbal overview of the study and written information. Following the meetings, the departments discussed which members of their teams would be appropriately placed/willing to take part in the study. The individual HCPs identified were each given an information sheet and asked to provide informed written consent to participate.

Stroke survivors

Stroke survivors were identified by members of the stroke rehabilitation teams or clinical trial officers who discussed the study and provided an information sheet. A minimum of 24 h was given to consider participation and ask questions before written informed consent was obtained.

Sample size

The sample size was selected to allow adequate intervention testing within the constraints of local resources. We aimed to recruit up to 35 stroke survivors with reference to published guidelines on sample size for feasibility studies [13] and up to 12 HCPs.

PARAS intervention

PARAS is a theory and evidence-informed multi-faceted intervention, targeting HCP consultation behaviour and stroke survivor physical activity and sedentary behaviour. Intervention mapping was used as a framework for intervention development and is described in detail in a previously published paper [8]. The APEASE criterion: affordability, practicability, effectiveness and cost-effectiveness, acceptability, side effects/safety and equity [14] were applied to the intervention design to facilitate intervention implementation.

HCP component

The HCP component of the PARAS intervention targeted consultation behaviour via face-to-face training, a manual and provision of one-to-one feedback on intervention delivery. The face-to-face training was delivered to HCPs over one half day by SAM and DF. Training was provided detailing the study background and rationale and targeting knowledge and skills acquisition for intervention delivery. The latter involved training on the use of brief motivational techniques to support intervention delivery. These techniques included open questions, affirmation, reflection and summarising.

Training was followed-up by provision of a manual. Each HCP delivered the intervention to two stroke survivors. The study research team then listened to audio-recordings of this intervention delivery, and with reference to a checklist of intervention content, a record was made of the presence and absence of behavioural content. This record was used to provide feedback to the HCP before they delivered the intervention to the next participant.

Stroke survivor component

The stroke survivor component of the PARAS intervention was a theory- and- evidence informed supported self-management intervention (supported by a HCP). PARAS was delivered in community or outpatient settings, with timing of delivery, session length and frequency of HCP contacts based on individual need. A minimum frequency of intervention delivery to each participating stroke survivor was two HCP supported sessions (baseline and review), and there was no maximum number of sessions. The baseline consultation took place face-to-face, with reviews either face-to-face or by telephone.

During the baseline consultation, a HCP supported the stroke survivor to work through a number of intervention components e.g. goal-setting, action planning and coping planning. The stroke survivor was provided with a workbook to support this process. The HCP also provided the stroke survivor with several tools, selected based on individual need e.g., self-monitoring tools.

A time to conduct a follow-up review session was agreed with the HCP and stroke survivor. The aim of the session was to review goals, provide feedback and receive support to identify and overcome barriers to achieve an increase in physical activity or decrease sedentary behaviour, respectively. Brief motivational techniques were used to enable the consultation.

All the components and tools used in the HCP and stroke survivor components of the PARAS intervention can be viewed in Fig. 1

Fig. 1
figure 1

PARAS intervention components and tools

Data collection

To characterise the cohort and inform a future larger scale evaluation of the PARAS intervention, the following data were collected at baseline:

HCPs

Sex, profession, employment status (full-time/part-time), working pattern (static/rotational), number of years qualified and number of years specialising in stroke.

Stroke survivors

Sex, age, occupation pre-stroke, current work status (e.g. working full-time, retired, registered sick or disabled), marital status, education, stroke type and subtype, time since stroke and any assistive device used.

To determine the feasibility of the study protocol and the feasibility and acceptability of the PARAS intervention the following data were collected:

Case report form

Recruitment (number of patients screened for eligibility, deemed eligible and number consented) and retention rates (number of participants completing baseline and review consultations), intervention delivery (duration of contact (minutes), time between baseline and review consultation (days), mode of intervention delivery (face-to-face or telephone), components of intervention that were personalised (e.g. self-monitoring method, type of social support, physical activity or sedentary behaviour option selected) and goal achievement (i.e. achieved target behaviour and/or outcome depending on goal). The scores for the following outcomes were collected during the baseline and review consultations: Rivermead Mobility Index [15], Warwick-Edinburgh Well-being Scale [16] and Fatigue Assessment Scale [17]. Any new medical problems or serious adverse events were recorded during appointments.

Questionnaire

HCPs completed a pre- and post-training questionnaire to assess attitudes and skills with regards to physical activity and sedentary behaviour post-stroke and reactions to the training. HCPs and stroke survivors both completed a post-study questionnaire on the study protocol and the PARAS intervention (See Supplementary materials Appendix C and D). Each questionnaire presented several statements that captured responses using a series of Likert scales and open questions with free text response boxes.

Interview

At the point of recruitment, stroke survivors were asked if they would provide their consent to an interview after receipt of the PARAS intervention. Interviews were conducted in their homes by the study lead (SAM). A semi-structured interview topic guide was used to guide the discussion (Supplementary materials, Appendix A). Following conduct of the first two interviews, the topic guide was modified, where appropriate to explore issues that emerged as salient e.g. differentiating the PARAS intervention from usual care. All interviews were audio-recorded, transcribed verbatim by a professional company and data analysed using thematic analysis [18].

Focus group discussions

HCPs were invited to take part in a focus group discussion at the end of the study (October 2019) to explore views on the feasibility and acceptability of PARAS. A semi-structured topic guide was used to guide discussion (Supplementary materials, Appendix B). The focus group was facilitated by the lead researcher (SAM) and two health psychologists (PM and KA).

Fidelity assessment

Delivery of the PARAS intervention was audio-recorded by participating HCPs to enable feedback on intervention delivery by the research team for training purposes but also to measure fidelity of delivery assessment. The audio-recordings were transcribed, and findings triangulated with written notes on intervention delivery maintained by HCPs.

Progression criteria

Progression criteria were set prior to study delivery in accordance with a traffic light system described by Avery et al. [19]. The criteria aimed to determine whether the intervention and outcome assessments could be delivered/conducted faithfully, with reference to the study protocol. Minor amendments to delivery indicated progression to the next stage of study with/without minor adaptation (green) moderate adaptation (amber) or significant (red) adaptation. See Table 1 for a summary of progression criteria.

Table 1 Study progression criteria

Data analysis

To determine the feasibility of the study protocol and the feasibility and acceptability of the PARAS intervention mixed methodology was applied. Quantitative and qualitative data were combined to aid interpretation of findings in relation to progression criteria. Quantitative data enabled description of study cohort and analysis compared to numerical progression criteria (e.g. recruitment rate), whereas qualitative data were used to identify themes in relation to progression criteria.

Quantitative analysis

Data were described and summarised using appropriate summary statistics. The distribution of nominal and ordinal data was described using frequencies and percentages. The ratio data were summarised using appropriate measures of central tendency (e.g. mean) and dispersion (standard deviation and range).

Qualitative analysis

Two researchers (SAM and SJ) independently read, re-read and assigned codes to the focus group transcript and the first four stroke survivor interview transcripts using a framework of a priori and emergent coding. Any disparity between coders was discussed to resolve differences in interpretation. SAM analysed the subsequent four interview transcripts, and the final interview transcript was independently analysed by both SAM and SJ. Common themes were subsequently established. Analyses of data were also discussed during regular meetings with the wider research team to identify areas for closer inspection and to enhance analysis and interpretation. Responses to open questions in questionnaires were reviewed following analyses of interview and focus group data to establish any new emergent themes. Themes (T) and subthemes (ST) were supported with verbatim quotes to provide context and enable readers to establish credibility of our findings.

Fidelity analysis

SAM coded all consultation transcripts to assess PARAS intervention delivery using a standardised intervention content checklist. Consultations were coded for delivery of key intervention components, including behaviour change techniques (BCTs) and brief motivational techniques. SAM completed training to identify and code BCTs using the BCT Taxonomy Version 1 [20] to facilitate this process. The four coding categories were ‘not appropriate’, ‘not delivered’, ‘delivered’ (e.g. component included but skill of delivery and understanding not demonstrated), ‘delivered well’ (e.g. demonstrated understanding and skill in delivery, for example consistent and effective use of open questions by HCP throughout the consultation). Discussion within the research team facilitated resolution of any coding issues.

Results

Cohort characteristics

Healthcare professionals

HCPs were recruited from three stroke rehabilitation services across three North East NHS Trusts. Nine physiotherapists and two occupational therapists agreed to participate. Ten participating HCPs were female and one male. Eight HCPs were part-time and three were full-time workers. All but one HCP held a static post in stroke rehabilitation, as opposed to a rotational post-across different clinical areas. Time from qualification ranged from 7 to 32 years (average 16 years) and average time specialising in stroke was 13 years (range 1–26 years).

Stroke survivors

Table 2 provides an overview of the characteristics of the stroke survivors who received a baseline PARAS intervention consultation. All participants were able to walk, but the majority required a stick (72%) with two also requiring a wheelchair for longer distances. Scores on the Rivermead Mobility Index at baseline ranged from 7 to 15 (maximum score 15 with higher scores indicating better mobility). Only one patient was reported to have dysphasia.

Table 2 Stroke survivor characteristics

Protocol feasibility

Recruitment and retention

HCPs

The HCP recruits undertook training between September and October 2018. None of the HCPs dropped out during the study period. However, a proportion of HCPs was more active than others in terms of intervention delivery. One HCP delivered the intervention to three stroke survivors, six to two stroke survivors, three to one stroke survivor and one HCP did not deliver the intervention at all. The latter HCP reported that this was due to difficulty differentiating between usual care procedures and the intervention to be delivered i.e. the HCP felt they already delivered elements of the PARAS intervention as part of their usual care service. Most HCPs and stroke survivors did however indicate that the PARAS intervention was different to the rehabilitation they had previously delivered or received (T5, STA, STB, Table 3). Two participating HCPs transferred job roles during the study, meaning they could no longer deliver the intervention.

Table 3 Qualitative themes and sub themes and exemplar quotes extracted from stroke survivor interviews and healthcare professional focus group

Stroke survivors

Recruitment of stroke survivors took place between 18th October 2018 and 16th October 2019. Twenty-nine patients were screened against study eligibility criteria, were eligible and were approached to take part. Nineteen stroke survivors provided consent to take part in the study. One participant was recruited but did not receive the intervention as the HCP who was supporting the stroke survivor moved to a different clinical area. Of the 18 stroke survivors who received the baseline intervention consultation, only one did not complete the intervention (e.g. met goals and did not require further PARAS support from the HCP). This stroke survivor withdrew from the study during the baseline consultation as the questioning during the Warwick-Edinburgh Mental Well-Being assessment led to her becoming upset and not wishing to continue.

HCPs at each NHS trust indicated prior to study commencement that recruitment of up to five stroke survivor participants by each HCP was feasible. However, recruitment was subsequently reported as more difficult than expected (see Table 3, Theme (T) 1 and subtheme (ST) A, for supporting direct quotes). Reasons reported included, patients declining to participate, study procedures i.e. whether the study was discussed/promoted effectively to the patients by HCPs, and the time and commitment required by HCPs to recruit patients and deliver the intervention (T1, STB, Table 3). Data also indicated that HCPs’ felt uncomfortable having their sessions recorded and offered the intervention to people they perceived may engage/benefit from the intervention e.g. higher level, more motivated patients (T1, STC, Table 3). HCP questionnaire results also revealed that two HCPs changed job role during the study limiting their ability to recruit patients and deliver the PARAS intervention.

HCP training programme feasibility and fidelity of delivery

Eleven HCPs completed face-to-face training before delivering the PARAS intervention. Feedback on intervention delivery was provided after HCPs had delivered the intervention to two stroke survivors, therefore only seven HCPs received feedback.

Findings from the HCP pre- and post-training attitudes, skills and reactions questionnaires, and views on the study protocol are presented in Supplementary materials Appendix C. All HCPs reported enjoying the training, 9/10 responders (90%) reported that it provided them with intervention delivery knowledge and skills, and 7/10 (70%) reported they would recommend the training to other HCPs (30% were undecided). During focus group discussion, HCPs reported the training was ‘good’ and ‘useful’ and increased their consultation skills (T2, STA, Table 3). They reported that additional training on how to use open questions and motivate/engage stroke survivors, particularly those with more marked impairment, would have been useful (T2, STA, Table 3). Feedback received on PARAS intervention delivery was reported to improve delivery (T2, STB, Table 3); however, most HCPs were uncomfortable audio-recording their consultations (T2, STC, Table 3).

Receipt of training and delivery of PARAS led to improvements in self-reported knowledge and skills development in two key areas: brief motivational techniques, including the use of open questions, and how to support identification of barriers and problem-solving in a constructive meaningful way (T2, STA, Table 3).

Fidelity of intervention delivery

Findings relating to delivery of intervention components and behaviour change techniques (data generated from audio-recordings intervention delivery) are presented in Table 4. In summary, most intervention components were ‘delivered’ or ‘delivered well’ according to pre-specified criteria (see the “Materials and methods” section). Only one HCP recruited the required number of participants to receive feedback and act on the feedback provided whilst supporting another stroke survivor participant. Following the receipt of feedback, elements that were ‘not delivered’ or were ‘delivered’ rather than ‘delivered well’, were improved upon, with all intervention components being ‘well delivered’.

Table 4 Fidelity of delivery of intervention components across stroke survivor participants where audio-recordings were available (n=17)

Data completeness

Case-report forms (CRFs)

There were no missing data on CRFs at baseline. At review, all CRF data were complete except for scores for Rivermead Mobility Index; Warwick-Edinburgh Well-being Scale and Fatigue Assessment Scale for one stroke survivor which were left blank with no explanation provided.

Questionnaires, interviews, and focus group

All participating HCPs completed pre-training questionnaires 11/11 (100%), 10/11 (91%) completed post-training questionnaires and 9/11 (82%) completed study feedback questionnaires. Eight of the eleven (73%) HCPs took part in the focus group discussion and one HCP who could not attend emailed feedback for the focus group. Ten of the seventeen (59%) stroke survivors completed the post-study questionnaire and 9/17 (52%) took part in interviews.

Fidelity assessment

Audio-recordings of HCPs delivery of the intervention baseline consultation were conducted for 16/18 participating stroke survivors and 17/18 were conducted for review sessions. Missing recordings were due to one HCP accidently not recording the baseline consultation, and another chose not to record any session because they felt it would impact on therapeutic relations.

Safety

No serious adverse events were recorded. Two adverse events were recorded between baseline and review sessions. One participant developed a pressure area on their heel due to an ill-fitting ankle foot orthosis (AFO) (the HCP advised the participant to pause activity, the AFO was reviewed and replaced by an orthotist, and after the pressure area healed, the participant went on to achieve their goal). A second participant visited an accident and emergency department but was not admitted and this was unrelated to the intervention.

Feasibility of PARAS intervention delivery

The characteristics of the delivery of the PARAS stroke survivor intervention are presented in Table 5. Walking was the most frequently selected physical activity when setting behavioural goals. None of the stroke survivors opted to target a reduction in sedentary behaviour.

Table 5 PARAS stroke survivor intervention delivery characteristics

Questionnaire responses indicated that most intervention components were feasible to deliver i.e. delivery of intervention in line with the protocol and within usual care (supplementary materials, Appendix C and D). However, findings generated from the qualitative data highlighted modifications would be beneficial. Focus group data indicated that although HCPs believed the intervention was beneficial for patients, the delivery was time-consuming and required streamlining to enable routine delivery (T3, STA, Table 3). To streamline the process, HCPs suggested providing stroke survivors with some of the information prior to the baseline consultation (T3, STA, Table 3). They also suggested having the option of delivering PARAS earlier in the care pathway, for example during inpatient care, to enable the development of early self-management skills. This suggestion was supported by participating stroke survivors (T3, STB, Table 3).

HCP support

Questionnaire data (Supplementary materials, Appendix D) confirmed that all stroke survivors (100%) believed they received good HCP support. This finding was supported by interview data (T3, STC, Table 3). However, it was difficult to extrapolate whether this finding was in relation to PARAS, usual care received, or a combination of both i.e. whether inclusion of the PARAS intervention into usual care increased satisfaction with the level of support received.

Social support

Most stroke survivor participants were able to identify appropriate social support from family members and friends to achieve their behavioural goals. The exception was one participant who reported having no support as he lived with elderly parents and was diagnosed with agoraphobia.

Workbook and repository of physical activity options

Questionnaire findings indicated that 8/10 (80%) of participating stroke survivors found the workbook useful (Supplementary materials, Appendix D), and this finding was supported by interview data (T3, STD, Table 3). HCPs reported the PARAS activity repository providing local physical activity options supported delivery of the intervention (T2, STD, Table 3). Following delivery of the intervention to a stroke survivor with limited community mobility, one HCP suggested the need for more training and tools with which to target sedentary behaviour and for home-based activities.

Self-monitoring tools

The most common self-monitoring method selected was a pedometer and recording steps in a diary. Of the eight participants who selected a pedometer at baseline, four subsequently selected an alternative method of self-monitoring due to the pedometer not registering steps accurately. Of those four participants, two swapped to an app or an activity tracker but still reported problems with accuracy. Stroke survivors indicated stroke-related gait impairments were the reason for the inaccuracy of the pedometers and activity trackers (T3, STE, Table 3). Despite these problems, overall, the stroke survivors reported finding the self-monitoring tools motivational (T3, STD, Table 3). Two HCPs and one stroke survivor discussed the potential for an app to record goals, progress towards goals and self-monitoring (T3, STE, Table 3), but overall approaches used were acceptable. As no goals set by stroke survivors targeted sedentary behaviour, we could not determine feasibility of methods of monitoring this behaviour.

Intervention acceptability

Stroke survivors viewed the PARAS intervention positively with 50% of participants agreeing and 50% strongly agreeing (50%) they would recommend PARAS to others (Supplementary materials, Appendix D). Ninety percent of questionnaire respondents agreed/strongly agreed that they were more physically active or engaged in less sedentary behaviour as a consequence of taking part in PARAS. This finding was supported by interview and focus group findings (T4, STA, Table 3). In addition to qualitative data supporting increased physical activity, participants also reported several positive psychological benefits including increased motivation, mood and focus, and a sense of achievement (T4, STB, Table 3). Improvements in well-being reported during interviews were consistent with improvements on the WEMWBS where baseline mean average score increased from 49 (standard deviation (SD) = 13, range 24 to 66) to 53 (SD = 13, range 28 to 70). Stroke survivors reported that PARAS led to the development of self-regulatory skills including behavioural goal setting, coping planning and self-monitoring (T4, STC, Table 3). They also reported a greater understanding of their stroke recovery and potential which was associated with achievement or lack of achievement of goals set during the PARAS intervention (T4, STD, Table 3).

Interview data indicated that stroke survivors perceived a difference in the care they had received while taking part in the PARAS intervention. Several stroke survivors specifically reported that the goal-setting process used in PARAS was more person-centred than the approach used during usual care (T5, STA, Table 3). HCPs also reported a perceived difference between PARAS and the approach they used pre-PARAS in terms of the use of open questioning rather than prescription, and the application of behaviour change techniques not used before, such as coping planning (T5, STB, Table 3). HCPs considered that the supported self-management approach offered by PARAS could potentially reduce reliance on health services increasing sustainability (T5, STB, Table 3). Six of the nine HCP respondents stated they would like to continue to use PARAS and would recommend it to other HCPs.

Progression criteria

Findings predominantly met the ‘amber’ (amend) progression criteria (see Table 1 for criteria). Stroke survivor and HCP recruitment and retention met the amber criteria (i.e. at least 14 stroke survivors and at least 7 HCP recruited and retained). Outcome data collection met the green (i.e. a minimum of 85% of data collected) or amber criteria (i.e. a minimum of 60% of data collected), except for completion of stroke survivor questionnaires where outcome data collection fell just below the criteria threshold (59 versus 60%). Intervention acceptability and feasibility met the amber criteria (i.e. moderate changes to the intervention required), with more intervention content required to target sedentary behaviour, streamlining of delivery and the suggestion that the intervention could be delivered earlier in the care pathway. Although amendments are required, the intervention and associated study procedures were considered feasible to deliver.

Discussion

This study demonstrates that stroke survivors and HCPs perceive the PARAS intervention to be feasible and acceptable. Training received by HCPs delivering PARAS was well received and led to intervention components being delivered with good levels of fidelity. Findings suggest that modifications are required to refine study and intervention delivery before progression to the next stage of evaluation.

Stroke survivor participants were recruited predominantly by the HCPs who were delivering the intervention. Qualitative data indicated that HCPs were potentially selecting patients who they felt would participate and be most appropriate, rather than offering the intervention to all eligible patients. This ‘paternalistic approach’ is frequently observed in intervention research [21] and often means that those who could have benefited most were not invited to take part. Asking individuals other than those delivering the PARAS intervention to identify eligible stroke survivors may facilitate a more representative sample in a larger-scale evaluation and importantly enables all those who are eligible an opportunity to take part. Selection bias should therefore be addressed with future training ahead of intervention delivery The way in which the study was introduced/promoted to patients was also considered a recruitment barrier. This has been identified in previous stroke research highlighting a training need [22].

Other factors which may have impacted upon recruitment were the amount of time it took to deliver the intervention in addition to usual care and HCPs feeling obliged to take part in the study/training as their department had agreed to be a study site. Feeling compelled to take part in the study may also have impacted on the delivery of the intervention by HCPs. Audio-recording of intervention delivery was intended as a feedback mechanism to facilitate optimal intervention delivery and for measuring fidelity [23]. Findings, however, indicate that audio-recording impacted on recruitment, specifically selection of stroke survivors and recruitment overall. This is an important consideration when planning a future study i.e. alternative ways of assessing fidelity of delivery should be considered, and selection bias should be addressed in training delivered to HCPs.

Although the sample of stroke survivors was small, those who did participate indicated PARAS was beneficial in terms of providing them with the knowledge, motivation and self-regulation skills to increase their levels of physical activity with minimal/no side effects. This is an important early finding considering the importance of physical activity for cardiovascular and brain health after stroke [24]. With the high incidence of stroke recurrence (3-year cumulative risk score 6–25% [25]), modifying known stroke risk factors with relatively low-risk lifestyle interventions, such as physical activity, is a critically important component of stroke rehabilitation. In addition to improvements in physical activity, a range of psychological benefits were reported by stroke survivors, and these included an improvement in mood. Depression and anxiety disorders occur in up to half of stroke survivors during the first year after stroke [26]. With limited evidence on interventions to effectively target mental health [27], this is an important finding worthy of further exploration.

Although the PARAS intervention was designed to target both physical activity and sedentary behaviour, all participants elected to focus on increasing physical activity behaviour. As sedentary behaviour is a common problem following stroke [2, 28], associated with poor health outcomes [29] and reduced quality of life [30], this finding was somewhat surprising. A possible explanation is the HCPs felt more competent when promoting and supporting increased physical activity and potentially lacked the skills and confidence to effectively target sedentary behaviour. Previous research has reported that HCPs require further training to support stroke survivors to reduce sedentary behaviour [31] and stroke survivors have reported limited understanding of the health risks associated with sedentary behaviour [32]. The findings indicate there should be further iterative and co-development of PARAS intervention tools and training resources for targeting sedentary behaviour. This would enable stroke survivors to make a more informed, preference-based decision to change their physical activity and/or sedentary behaviour.

Self-monitoring of physical activity behaviour was reported to be an important active ingredient of the PARAS intervention, increasing motivation and confidence for engaging in physical activity. These findings are consistent with those reported in other interventional research in long-term health conditions [33] and highlight the importance of self-monitoring for behavioural change. The study findings, however, also emphasised the importance of selecting an appropriate self-monitoring device for each individual. Problems were identified with the accuracy of pedometers and activity trackers with individuals with altered gait, which participants reported was disappointing. This finding was perhaps not surprising, considering previous literature indicating the inaccuracy of pedometers in stroke survivors with low gait speed [34]. However, pedometers have been used successfully in stroke rehabilitation [35] and general population studies [36], and some participants do find them a helpful, relatively low-cost self-monitoring tool, indicating in the right circumstance they can be a useful tool. However, careful selection of the most appropriate self-monitoring tool for each individual is paramount to support behaviour change in the stroke population.

Although self-efficacy and outcome expectations are reported to be high in community dwelling stroke survivors, self-regulation and social support have been found to be infrequently used in the context of post-stroke recovery [37]. The incorporation of behaviour change techniques to support self-regulation and social support was shown to be important within PARAS, which is consistent with other similar small-scale studies in stroke [38,39,40]. However, large-scale efficacy trials have not yet confirmed this finding.

Although PARAS led to perceived benefits, several modifications to the intervention and its delivery were suggested. HCPs reported that delivery required streamlining, suggesting the inclusion of a preparation stage where stroke survivors are provided with the workbook and preparatory tasks, prior to the first consultation. With clinical services already stretched to deliver adequate levels of stroke rehabilitation [41], streamlining delivery and training, without losing potentially effective and acceptable components of the intervention, is imperative.

Although the delivery of PARAS was reported to be time-consuming, HCPs believed investing time initially on supporting self-management was worthwhile. They perceived supporting self-management could potentially reduce re-referral to stroke rehabilitation services and hospital readmission rates. Self-management capability has been found to be associated with lower health care utilisation in individuals with long-term conditions [42], supporting this finding. However, implementing this form of intervention into practice was shown to be complex in this study and further development of strategies for implementing complex interventions into rehabilitation need to be developed [43].

Our qualitative work indicated that both stroke survivors and HCPs believed that PARAS should be delivered earlier in the stroke pathway (e.g. during inpatient care), where appropriate. HCPs believed that it would facilitate reflection on physical activity progression and stroke survivors felt it would enable early development of positive behaviours. Early delivery could potentially reduce acute/sub-acute deconditioning [44], with the introduction of early self-management skills expediating recovery through increasing opportunity for intensity of practice [45]. It could also reduce deterioration in function often observed on discharge from rehabilitation particularly with older adults [46]. However, changing behaviour may be complex during inpatient stay when length of stay is short and with behaviour change potentially being more complex when the patient is not in their own environment. Alternatively, patients could be supported to use specific behaviour change techniques while in hospital and advised to adapt these for use at home.

HCPs found the training intervention beneficial, a finding supported by the high levels of fidelity of delivery observed. Audio-recording intervention delivery facilitated assessment of fidelity of delivery and receipt and is a strength of the PARAS study with rehabilitation research frequently criticised for lack of fidelity assessment [47]. However, some HCPs were reluctant to be recorded potentially impacting recruitment and delivery of the intervention and upscaling this labour-intensive process and provision of feedback to large groups of HCPs would be a significant challenge. Alternative fidelity assessment methodologies should therefore be considered during a future large-scale evaluation.

In terms of data collection, strategies to increase the completion of questionnaires and uptake of interviews are required ahead of a larger-scale evaluation. Telephone reminders and repeat mailing strategies may facilitate questionnaire return rate and interview uptake [48] or having the option of an online questionnaire alongside the paper-based version may increase return rate. Such strategies have demonstrated to be effective in the context of other health research [49]. In addition to the baseline measures collected, a measure of cognitive impairment would be useful help determine alongside other measures already inlcuded the type of patients who may benefit from this intervention.

Conclusion

PARAS demonstrated to be feasible and acceptable to both HCPs and stroke survivors and led to perceived benefit in terms of physical activity and well-being, but not sedentary behaviour. Fidelity of delivery was good, suggesting that the training delivered to HCPs met its objectives. Several modifications to improve PARAS were suggested by participants, including the introduction of a preparatory stage to reduce delivery time; potential to deliver the intervention earlier in the stroke pathway (i.e. during inpatient care), provision of more detailed guidance on appropriate use of self-monitoring tools and additional training for HCPs on how to support those with low levels of motivation or high levels of impairment and how to specifically target sedentary behaviour. Modifications required to improve study procedures included training to reduce recruitment selection bias and strategies to facilitate a higher response rate to the stroke survivor questionnaires and interviews. Identification of an alternative approach to fidelity assessment would also be appropriate to facilitate scalability.

Availability of data and materials

The datasets used and/or analysed during the current study are available from the corresponding author on reasonable request.

References

  1. Fini NA, Holland AE, Keating J, Simek J, Bernhardt J. How physically active are people following stroke? systematic review and quantitative synthesis. Phys Ther. 2017;97(7):707–17.

    Article  PubMed  Google Scholar 

  2. Moore SA, Hallsworth K, Plötz T, Ford GA, Rochester L, Trenell MI. Physical activity, sedentary behaviour and metabolic control following stroke: a cross-sectional and longitudinal study. PLoS One. 2013;8(1):e55263.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  3. Lee I-M, Shiroma EJ, Lobelo F, Puska P, Blair SN, Katzmarzyk PT, et al. Effect of physical inactivity on major non-communicable diseases worldwide: an analysis of burden of disease and life expectancy. Lancet. 2012;380(9838):219–29.

    Article  PubMed  PubMed Central  Google Scholar 

  4. Bailey DP, Hewson DJ, Champion RB, Sayegh SM. Sitting time and risk of cardiovascular disease and diabetes: a systematic review and meta-analysis. Am J Prev Med. 2019;57(3):408–16.

    Article  PubMed  Google Scholar 

  5. Moore SA, Hallsworth K, Jakovljevic DG, Blamire AM, He J, Ford GA, et al. Effects of community exercise therapy on metabolic, brain, physical, and cognitive function following stroke: a randomized controlled pilot trial. Neurorehabil Neural Repair. 2015;29(7):623–35.

    Article  PubMed  Google Scholar 

  6. Moore SA, Hrisos N, Flynn D, Errington L, Price C, Avery L. How should long-term free-living physical activity be targeted after stroke? A systematic review and narrative synthesis. Int J Behav Nutr Phys Act. 2018;15(1):1–19.

    Article  Google Scholar 

  7. Craig P, Dieppe P, Macintyre S, Michie S, Nazareth I, Petticrew M. Developing and evaluating complex interventions: the new Medical Research Council guidance. BMJ. 2008;337:a1655.

    Article  PubMed  PubMed Central  Google Scholar 

  8. Moore SA, Flynn D, Price CIM, Avery L. Using intervention mapping to develop and facilitate implementation of a multifaceted behavioural intervention targeting physical activity and sedentary behaviour in stroke survivors: Physical Activity Routines After Stroke (PARAS): intervention development study. Health Psychol Behav Med. 2022;10(1):439–66.

    Article  PubMed  PubMed Central  Google Scholar 

  9. Brug J, Oenema A, Ferreira I. Theory, evidence and Intervention mapping to improve behavior nutrition and physical activity interventions. Int J Behav Nutr Phys Act. 2005;2(1):1–7.

    Article  PubMed  PubMed Central  Google Scholar 

  10. Kok G. A practical guide to effective behavior change: how to apply theory-and evidence-based behavior change methods in an intervention; 2018.

    Google Scholar 

  11. Fernandez ME, Ruiter RA, Markham CM, Kok G. Intervention mapping: theory-and evidence-based health promotion program planning: perspective and examples. Front Public Health. 2019;7:209.

    Article  PubMed  PubMed Central  Google Scholar 

  12. Moore SA, Avery L, Price CI, Flynn D. A feasibility, acceptability and fidelity study of a multifaceted behaviour change intervention targeting free-living physical activity and sedentary behaviour in community dwelling adult stroke survivors. Pilot Feasibility Stud. 2020;6(1):1–13.

    Article  Google Scholar 

  13. Teare MD, Dimairo M, Shephard N, Hayman A, Whitehead A, Walters SJ. Sample size requirements to estimate key design parameters from external pilot randomised controlled trials: a simulation study. Trials. 2014;15(1):1–13.

    Article  Google Scholar 

  14. Michie S, Atkins L, West R. The behaviour change wheel. A guide to designing interventions. 1st ed. Great Britain: Silverback Publishing; 2014. p. 1003–10.

    Google Scholar 

  15. Collen FM, Wade DT, Robb G, Bradshaw C. The Rivermead mobility index: a further development of the Rivermead motor assessment. Int Disabil Stud. 1991;13(2):50–4.

    Article  CAS  PubMed  Google Scholar 

  16. Tennant R, Hiller L, Fishwick R, Platt S, Joseph S, Weich S, et al. The Warwick-Edinburgh mental well-being scale (WEMWBS): development and UK validation. Health Qual Life Outcomes. 2007;5(1):1–13.

    Article  Google Scholar 

  17. Michielsen HJ, De Vries J, Van Heck GL. Psychometric qualities of a brief self-rated fatigue measure: the Fatigue Assessment Scale. J Psychosom Res. 2003;54(4):345–52.

    Article  PubMed  Google Scholar 

  18. Clarke V, Braun V, Hayfield N. Thematic analysis. Qual Psychol. 2015;222(2015):248.

    Google Scholar 

  19. Avery KN, Williamson PR, Gamble C, Francischetto EOC, Metcalfe C, Davidson P, et al. Informing efficient randomised controlled trials: exploration of challenges in developing progression criteria for internal pilot studies. BMJ Open. 2017;7(2):e013537.

    Article  PubMed  PubMed Central  Google Scholar 

  20. Michie S, Richardson M, Johnston M, Abraham C, Francis J, Hardeman W, et al. The behavior change technique taxonomy (v1) of 93 hierarchically clustered techniques: building an international consensus for the reporting of behavior change interventions. Ann Behav Med. 2013;46(1):81–95.

    Article  PubMed  Google Scholar 

  21. Boxall L, Hemsley A, White N. Exploring recruitment issues in stroke research: a qualitative study of nurse researchers’ experiences. Nurs Res. 2016;23(5):8–14.

    Article  Google Scholar 

  22. Berge E, Stapf C, Al-Shahi Salman R, Ford GA, Sandercock P, van der Worp HB, et al. Methods to improve patient recruitment and retention in stroke trials. Int J Stroke. 2016;11(6):663–76.

    Article  PubMed  Google Scholar 

  23. Jelsma JGM, Mertens V-C, Forsberg L, Forsberg L. How to measure motivational interviewing fidelity in randomized controlled trials: practical recommendations. Contemp Clin Trials. 2015;43:93–9.

    Article  PubMed  Google Scholar 

  24. D’Isabella NT, Shkredova DA, Richardson JA, Tang A. Effects of exercise on cardiovascular risk factors following stroke or transient ischemic attack: a systematic review and meta-analysis. Clin Rehabil. 2017;31(12):1561–72.

    Article  PubMed  Google Scholar 

  25. Register LS. Cause of stroke recurrence is multifactorial; 2003.

    Google Scholar 

  26. Hackett ML, Pickles K. Part I: frequency of depression after stroke: an updated systematic review and meta-analysis of observational studies. Int J Stroke. 2014;9(8):1017–25.

    Article  PubMed  Google Scholar 

  27. Allida S, Cox KL, Hsieh CF, Lang H, House A, Hackett ML. Pharmacological, psychological, and non‐invasive brain stimulation interventions for treating depression after stroke. Cochrane Database Syst Rev. 2020;(1):CD003437. https://doi.org/10.1002/14651858.CD003437.pub4. Accessed 3 Aug 2022.

  28. Tieges Z, Mead G, Allerhand M, Duncan F, Van Wijck F, Fitzsimons C, et al. Sedentary behavior in the first year after stroke: a longitudinal cohort study with objective measures. Arch Phys Med Rehabil. 2015;96(1):15–23.

    Article  PubMed  Google Scholar 

  29. Biswas A, Oh PI, Faulkner GE, Bajaj RR, Silver MA, Mitchell MS, et al. Sedentary time and its association with risk for disease incidence, mortality, and hospitalization in adults: a systematic review and meta-analysis. Ann Intern Med. 2015;162(2):123–32.

    Article  PubMed  Google Scholar 

  30. Teychenne M, Costigan SA, Parker K. The association between sedentary behaviour and risk of anxiety: a systematic review. BMC Public Health. 2015;15(1):1–8.

    Article  Google Scholar 

  31. Morton S, Hall J, Fitzsimons C, Hall J, English C, Forster A, et al. A qualitative study of sedentary behaviours in stroke survivors: non-participant observations and interviews with stroke service staff in stroke units and community services. Disabil Rehabil. 2021;43:1–10.

  32. Ezeugwu VE, Garga N, Manns PJ. Reducing sedentary behaviour after stroke: perspectives of ambulatory individuals with stroke. Disabil Rehabil. 2017;39(25):2551–8.

    Article  PubMed  Google Scholar 

  33. Rehackova L, Araújo-Soares V, Steven S, Adamson A, Taylor R, Sniehotta F. Behaviour change during dietary Type 2 diabetes remission: a longitudinal qualitative evaluation of an intervention using a very low energy diet. Diabet Med. 2020;37(6):953–62.

    Article  CAS  PubMed  Google Scholar 

  34. Carroll SL, Greig CA, Lewis SJ, McMurdo ME, Sniehotta FF, Johnston M, et al. The use of pedometers in stroke survivors: are they feasible and how well do they detect steps? Arch Phys Med Rehabil. 2012;93(3):466–70.

    Article  PubMed  Google Scholar 

  35. Sullivan JE, Espe LE, Kelly AM, Veilbig LE, Kwasny MJ. Feasibility and outcomes of a community-based, pedometer-monitored walking program in chronic stroke: a pilot study. Top Stroke Rehabil. 2014;21(2):101–10.

    Article  PubMed  Google Scholar 

  36. Chaudhry UA, Wahlich C, Fortescue R, Cook DG, Knightly R, Harris T. The effects of step-count monitoring interventions on physical activity: systematic review and meta-analysis of community-based randomised controlled trials in adults. Int J Behav Nutr Phys Act. 2020;17(1):1–16.

    Article  Google Scholar 

  37. Bailey RR. Self-efficacy, self-regulation, social support, and outcomes expectations for daily physical activity in adults with chronic stroke: a descriptive, exploratory study. Occup Ther Health Care. 2019;33(2):129–41.

    Article  PubMed  PubMed Central  Google Scholar 

  38. English C, Healy GN, Olds T, Parfitt G, Borkoles E, Coates A, et al. Reducing sitting time after stroke: a phase II safety and feasibility randomized controlled trial. Arch Phys Med Rehabil. 2016;97(2):273–80.

    Article  PubMed  Google Scholar 

  39. Paul L, Wyke S, Brewster S, Sattar N, Gill JM, Alexander G, et al. Increasing physical activity in stroke survivors using STARFISH, an interactive mobile phone application: a pilot study. Top Stroke Rehabil. 2016;23(3):170–7.

    Article  PubMed  Google Scholar 

  40. Jones TM, Dear BF, Hush JM, Titov N, Dean CM. myMoves program: feasibility and acceptability study of a remotely delivered self-management program for increasing physical activity among adults with acquired brain injury living in the community. Phys Ther. 2016;96(12):1982–93.

    Article  PubMed  Google Scholar 

  41. Clarke DJ, Burton L-J, Tyson SF, Rodgers H, Drummond A, Palmer R, et al. Why do stroke survivors not receive recommended amounts of active therapy? Findings from the ReAcT study, a mixed-methods case-study evaluation in eight stroke units. Clin Rehabil. 2018;32(8):1119–32.

    Article  PubMed  PubMed Central  Google Scholar 

  42. Barker I, Steventon A, Williamson R, Deeny SR. Self-management capability in patients with long-term conditions is associated with reduced healthcare utilisation across a whole health economy: cross-sectional analysis of electronic health records. BMJ Qual Saf. 2018;27(12):989–99.

    Article  PubMed  PubMed Central  Google Scholar 

  43. Morris JH, Bernhardsson S, Bird M-L, Connell L, Lynch E, Jarvis K, et al. Implementation in rehabilitation: a roadmap for practitioners and researchers. Disabil Rehabil. 2020;42(22):3265–74.

    Article  PubMed  Google Scholar 

  44. Billinger SA, Coughenour E, MacKay-Lyons MJ, Ivey FM. Reduced cardiorespiratory fitness after stroke: biological consequences and exercise-induced adaptations. Stroke Res Treat. 2012;2012:959120.

    PubMed  Google Scholar 

  45. French B, Thomas LH, Coupe J, McMahon NE, Connell L, Harrison J, et al. Repetitive task training for improving functional ability after stroke. Cochrane Database Syst Rev. 2016;11(11):Cd006073.

    PubMed  Google Scholar 

  46. Persson CU, Danielsson A, Sunnerhagen KS, Grimby-Ekman A, Hansson P-O. Timed Up & Go as a measure for longitudinal change in mobility after stroke–Postural Stroke Study in Gothenburg (POSTGOT). J Neuroeng Rehabil. 2014;11(1):1–7.

    Article  Google Scholar 

  47. An M, Dusing SC, Harbourne RT, Sheridan SM, Consortium S-P. What really works in intervention? Using fidelity measures to support optimal outcomes. Phys Ther. 2020;100(5):757–65.

    Article  PubMed  Google Scholar 

  48. Nakash RA, Hutton JL, Jørstad-Stein EC, Gates S, Lamb SE. Maximising response to postal questionnaires–a systematic review of randomised trials in health research. BMC Med Res Methodol. 2006;6(1):1–9.

    Article  Google Scholar 

  49. Regmi PR, Waithaka E, Paudyal A, Simkhada P, van Teijlingen E. Guide to the design and application of online questionnaire surveys. Nepal J Epidemiol. 2016;6(4):640.

    Article  PubMed  PubMed Central  Google Scholar 

Download references

Acknowledgements

We would like to thank the following for their contributions:

1. Stroke survivors, their carers/relatives and health care professionals who took part in the study

2. The National Institute for Health Research (NIHR) North East Stroke Specialty Group Patient and Carer Panel for feedback on study development

3. Staff at Newcastle University, Teesside University and Northumbria Healthcare NHS Foundation Trust who have contributed to the project: Patricia McCue, Kirsten Ashley, Norman Marillier, Liz Costigan.

4. NIHR Clinical Research Network

Funding

This report is independent research supported by the Health Education England and the National Institute for Health Research (HEE/NIHR ICA Programme Clinical Lectureship, Dr. Sarah Anne Moore, ICA-CL-2015-01-012). The views expressed in this publication are those of the author(s) and not necessarily those of the NIHR. The funding body had no role in the design and writing of the study protocol and does not have a role in the data collection, management, analysis and interpretation of data, writing of the report and the decision to submit the report for publication.

Author information

Authors and Affiliations

Authors

Contributions

SAM, LA, DF and CIM made substantial contributions to the conception and design of the study. SAM made a substantial contribution to the acquisition of the data. SAM, DF, LA, CIM and SJ made substantial contributions to the analysis and interpretation of the data. SAM drafted the paper, and DF, LA, CIM and SJ substantially revised the paper. The authors approved the submitted the final version and have agreed to be accountable for their own contribution.

Corresponding author

Correspondence to Sarah A. Moore.

Ethics declarations

Ethics approval and consent to participate

A favourable ethical opinion was granted by the North East-Tyne and Wear South Research Ethics Committee (Ref 18/NE/0255). The study was conducted in accordance with the Declaration of Helsinki.

Consent for publication

Not applicable.

Competing interests

The authors declare that they have no competing interests.

Additional information

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Supplementary Information

Additional file 1: Appendix A.

Stroke survivor interview guide. Appendix B. HCP focus group discussion guide. Appendix C. HCP pre- and post-training and protocol questionnaire Likert scores. Appendix D. Stroke survivor post intervention questionnaire Likert scores.

Rights and permissions

Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated in a credit line to the data.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Moore, S.A., Flynn, D., Jones, S. et al. Feasibility, acceptability, and fidelity of Physical Activity Routines After Stroke (PARAS): a multifaceted behaviour change intervention targeting free-living physical activity and sedentary behaviour in community-dwelling adult stroke survivors. Pilot Feasibility Stud 8, 197 (2022). https://doi.org/10.1186/s40814-022-01139-4

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1186/s40814-022-01139-4

Keywords