Skip to main content

eRAPID electronic patient self-Reporting of Adverse-events: Patient Information and aDvice: a pilot study protocol in pelvic radiotherapy



An estimated 17,000 patients are treated annually in the UK with radical radiotherapy (RT) for pelvic cancer. New treatment approaches in RT have increased survivorship and changed the subjective toxicity profile for patients who experience acute and long-term pelvic-related adverse events (AE). Multi-disciplinary follow-up creates difficulty for monitoring and responding to these events during treatment and beyond. Originally developed for use in systemic oncology therapy eRAPID (electronic patient self-Reporting of Adverse-events: Patient Information and aDvice) is an online system for patients to report AEs from home. eRAPID enables patient data to be integrated into the electronic patient records for use in clinical practice, provides patient management advice for mild and moderate AE and advice to contact the hospital for severe AE. The system has now been developed for pelvic RT patients, and we aim to test the intervention in a pilot study with staff and patients to inform a future randomised controlled trial (RCT).


Eligible patients are those attending St James’s University hospital cancer centre and The Christie Hospital Manchester undergoing pelvic radiotherapy+/−chemotherapy/hormonotherapy for prostate, lower gastrointestinal and gynaecological cancers. A prospective 1:1 randomised (intervention or usual care) parallel group design with repeated measures and mixed methods will be employed. We aim to recruit 168 patients following recommendations for sample size estimates for pilot studies. Participants using eRAPID will report AE (at least weekly) from home weekly for 6 weeks and 6 weeks post-treatment (12-week total) then at 18 and 24 weeks. Hospital staff will review eRAPID reports and use information during consultations. Notifications will be sent to the relevant clinical team when severe symptoms are reported. We will measure patient-reported outcomes using validated questionnaires (Functional Assessment in Cancer Therapy Scale-General (FACT-G), European Organisation for Research and Treatment of Cancer Core Quality of Life questionnaire (EORTC-QLQ-C30), process of care impact (hospital records of patient contacts and admissions) and economic variables (EQ5D-5L, patient use of resources)). Staff and patient experiences will be explored via semi-structured interviews.


The objectives are to establish feasibility, recruitment, integrity of the system and attrition rates, determine effect sizes and aid selection of the primary outcome measure for a future RCT. We will also refine the intervention by exploring staff and patient views. The overall goal of this complex intervention is to improve the safe delivery of cancer treatments, enhance patient care and standardise documentation of AE within the clinical datasets.

Trial registration NCT02747264.

Peer Review reports


An estimated 17,000 patients are treated annually in the UK with radical radiotherapy (RT) for pelvic cancer [1]. New treatment approaches such as intensity-modulated radiotherapy (IMRT), image-guided radiotherapy (IGRT), fractionated delivery [2] and concomitant chemoradiotherapy (chemoradiotherapy (CRT)) have changed the subjective toxicity profile of radiotherapy (RT). Patients survive longer but suffer acute and long-term pelvic-related AE. Multi-disciplinary follow-up creates difficulty for monitoring and responding to these events during treatment and beyond [3]. In order to support patients and fully understand the effects of new treatments, improved and more timely documentation of acute, intermediate and late AE is essential [4].

Prostate patients with localised cancer have good long-term prognosis but endure the long-term effects of pelvic RT [5]. In both cervical and ano-rectal cancer CRT improves outcomes at the expense of additional chemotherapy specific toxicities and the late bowel, urinary and sexual side effects from RT [6, 7]. Overall, for patients treated with pelvic RT 59% women and 45% men will have long-term gastrointestinal (GI) side effects, e.g. bowel urgency [8]. Long-term genitourinary (GU) side effects (e.g. urinary urgency) are experienced by 49% women and 46% men, and 24% women and 53% men state their ability to have a sexual relationship is affected [8].

Assessment and documentation of RT-related AE is generally inconsistent; therefore, improving the systematic and consistent recording of AE would inform strategies to reduce the impact of AEs on patients, clinicians and the health service [4, 6]. Late effects of pelvic RT only fully develop and affect patients’ months/years post-treatment, when centralised follow-up in specialised RT clinics is often infrequent. A cost-effective model to allow remote measurement of RT-AE would help patients to get appropriate specialist advice and support when late toxicity emerges. Systematic data collection would also allow comparisons and evaluation of the benefits of new RT approaches.

In RT, AE are generally reported by clinicians using the RTOG scale for acute AE and the Late Effects on Normal Tissues–Subjective, Objective, Management and Analytic (LENT-SOMA) [9]. Scale, which has been incorporated into the National Cancer Institute’s (NCI) Common Terminology Criteria for Adverse Events (CTCAE v.3), now superseded by v.4 [10]. However, traditionally clinician-reported AEs are heavily focussed on safety and the rare more severe grades of toxicity.

Patient-reported outcomes (PROs)

Asking patients to report their own symptoms via patient-reported outcomes (PROs) has proven extremely acceptable to patients in the oncology clinic setting [10,11,12,13]. Reviews suggest they improve symptom/function monitoring, physician patient communication, decision-making [14,15,16,17,18,19], timing and accuracy of symptom reporting [20]. PROs have been increasingly recommended by the United States Food and Drug Administration (FDA) [21] and here in the UK in the 2008 Darzi report [22]. The Department of Health (DOH) subsequently produced guidelines to aid their implementation [23], and we now have some nationwide use of PROs in the NHS [24]. In terms of monitoring toxicity, the CTCAE scale has recently been adapted for patients to self-report (NCI-PRO-CTCAE) [25, 26]. These items have concordance with nurse-evaluated AE [27] and similar items created for self-report correlate with quality of life (QOL) measures [28]. Increasingly, patients are being asked to monitor their own health status and self-manage symptoms. In response to this, we have developed the eRAPID system to improve the detection, and management of AE in cancer patients by providing the means by which patients can report symptoms from home [29, 30].

Electronic PROs (ePROs)

The use of ePROs in health research has risen exponentially during the past 20 years for a number of conditions including cancer [31, 32]. Patients have shown they can routinely complete PROs electronically, [11] and paper and electronic completions are comparable [33]. Further, RT patients and staff said they would find an internet PRO reporting tool acceptable. Clinicians thought this would improve their consultations with having graphical representation of the PRO data [34]. It is also clear that patients are willing and able to use PROs from home internet or mobile devices [35, 36].

Examples of successful implementation of electronic symptom reporting in oncology clinical practice include PatientViewpoint [37], a flexible PRO platform, the symptom tracking and reporting system (STAR) for patients to report chemotherapy AE [35], and the Tell Us™ [38] system for advanced cancer patients in hospices undergoing palliative care (all in the USA). In Canada, they have developed an interactive online system (ISAAC) [39] and in the UK the ASyMS mobile phone system [40]. Electronic patient-reported outcome systems have proven very acceptable even for patients coping with extreme symptom burden and reduced QOL; indeed, a mean monthly PROM completion rate of 83% at 34 weeks was achieved with patients receiving cancer treatment [41]. In RT, the VisionTree Optimal Care online reporting tool has proven acceptable to patients and increased QOL completion compliance to 90% compared to paper completion of 50% [42].

eRAPID development

In Leeds, we recently commissioned the development of a web-based questionnaire builder system called QTool (built by X-Lab, a private software company and funded by Macmillan Cancer Support and Cancer Research UK) ( QTool Version1 was used in a large prospective study of cancer survivors [43]; however, the PROs were not viewed by clinicians. Utilising this technology eRAPID is an online system to support the collection and clinical integration of patients’ symptom/AE reports during cancer treatment [30]. Between 2010 and 2013, the eRAPID developmental work was conducted (funded by a National Institute of Health Programme Development Grant RP-DG-1209-10,031). Developed originally for use in systemic treatment, the system enables patients to report AE via PROs [44] and the questionnaire data is integrated into the electronic patient records (EPR) for clinicians to view. Algorithmic questionnaire scoring [44, 45] generates severity dependent management advice to either call the hospital or self-manage symptoms (accessible via a custom build website). Currently, an RCT in systemic therapy is underway recruiting 500 patients [46]. We have now adapted the system for use in upper gastrointestinal surgery and RT.

Multi-site eRAPID radiotherapy development

Developmental work was conducted to adapt the eRAPID system for RT in two centres (Leeds and The Christie Hospital Manchester) and for patients undergoing pelvic radiotherapy for urological, gastrointestinal and gynaecological cancer. A rigorous systematic approach was adopted according to the criteria for reporting the development and evaluation of complex interventions in healthcare [47] and the Medical Research Council (MRC) guidelines [48].

In this two-centre study, professional and patient care pathways and the role of eRAPID were explored via audit and interviews with staff, patients and relatives [49,50,51]. Additionally, we identified the AEs associated with urological, gastrointestinal and gynaecological cancers from patient interviews [50] and via systematic reviews of PRO reporting for these groups [52,53,54]. In a mapping exercise to matching questionnaire items to common adverse events revealed the best questionnaire coverage for adverse events for all tumour groups were the male and female pelvic questionnaires (MPC and FPC) [55]. For a clinical perspective Delphi (consensus methodology) was used with staff to make decisions on the most appropriate items for each AE [56]. This led to the inclusion of additional items from the EPIC (Expanded Prostate Cancer Index) and the EORTC-QLQC-30 and PR 25 (prostate module). In addition, to cover chemotherapy-related AE items were taken from item pool developed for eRAPID (systemic therapy) [44]. See (Additional file 1: Appendix 1) for example of AE items used either as standard, branching (having a prior qualifying question) or as a drop-down (allowing selection of more appropriate options).

The AE questionnaires are scored according to specific algorithms developed in consultation with key staff and patients. Clinically meaningful cut scores for symptom severity were developed through consenus and discussion based methods [57]. The scorning and algorithms allows the generation of severity-dependent management advice for either mild (self-management advice), moderate (self-management and advice to contact the hospital when appropriate) or severe (advice to contact the hospital immediately). The self-management advice for mild level symptoms was developed from local and reputable national resources [58] and uploaded to two designated websites for Leeds and The Christie patients. AE. The online system is now successfully implemented at Leeds Teaching Hospitals NHS Trust (LTHT) and The Christie Hospital Manchester.

The eRAPID intervention in radiotherapy

The developmental work led to the eRAPID complex intervention [44, 46] consisting of the following components (see Figs. 1 and 2):

  • Patients login to QTool using unique usernames and password and complete the eRAPID symptom questionnaire from home on computers/mobile phones/tablets or using designated kiosks (Leeds). Immediate tailored automated advice, calculated from a series of algorithms, is generated.

  • If severe symptoms are reported, patients are advised to contact the hospital.

  • For mild/moderate problem information about self-managing, these issues are provided via brief instructions in QTool and hyperlinks to more detailed advice on the eRAPID RT patient websites tailored to Leeds and The Christie local information.

  • The patient-reported data is immediately available for staff to review in the individuals’ EPR in Leeds Teaching Hospitals NHS Trust (PPM), The Christie Clinical Web Portal (CWP).

  • Notifications for severe symptom reports are sent directly to staff via email. Clinicians can then login to PPM and CWP and view the patients’ symptom reports and take appropriate action where needed.

Fig. 1
figure 1

eRAPID system architecture overview

Fig. 2
figure 2

Screenshots of eRAPID intervention Patient login (a-f) a Login eRAPID portal, b access eRAPID websites for (QTool) login (Leeds and Manchester), c login to online symptom report, d complete symptom report, e recieve advice to manage low-level symptoms, f login to online symptom report. Clinician view of symptom reports in electronic patient record (EPR) (g & h) g symptom reports in EPR (tabular view), h symptom reports in EPR (grapical view)

Aims and objectives

We aimed to conduct the initial pilot study of the eRAPID system in radiotherapy from the perspective of cancer patients and health professionals. The objectives are to establish feasibility and determine effect sizes of the potential benefits of the intervention for a future RCT.

The specific aims are to:

  • Establish recruitment and attrition rates

  • Establish adherence to symptom reporting and record the number of calls made to the hospital by patients

  • Test the integrity of the study protocol and data collection forms

  • Test the integrity of information systems designed to collect and collate the data

  • Aid selection of the most appropriate primary outcome measure and determine effect size

  • Refine the intervention by exploring patient and staff views.



The study procedures below reflect the protocol version 1.3 as approved by the National Research Ethics Service (now part of the Health Research Authority). The approval was from Yorkshire & The Humber Leeds East Research Ethics Committee on 13 September 2016 (REC reference 16/YH/0371). Local approvals from the Leeds Teaching Hospitals NHS Trust and The Christie Research and Innovation Department were also obtained. Protocol amendments will be communicated via written statements and verbally reiterated where appropriate to the funder, trial teams, clinicians, steering and project management groups and trial registries.

Patient sample

The sample will include two groups of participants at both The Christie Hospital Manchester (C) and Leeds Teaching Hospitals NHS Trust (L):

  1. 1.

    Patients receiving radical RT for prostate cancer (including radiotherapy for prostate cancer +/− hormonotherapy+/− brachytherapy boost) (C & L).

  2. 2.

    Patients receiving pelvic chemoradiotherapy including cervical (C & L), anal (C & L), rectal (L), vaginal (L), vulval (C) and endometrial (C).

Inclusion criteria

Patients will be eligible if

  • They have a diagnosis of (1) prostate cancer requiring radical radiotherapy treatment (including radiotherapy +/− brachytherapy boost) or (2) anal, rectal, cervical, endometrial, vaginal or vulval cancer requiring chemoradiotherapy.

  • Aged 18 years or over.

  • Attending St James’ University Hospital or The Christie Hospital Manchester.

  • Able and willing to give informed consent.

  • Read and understand English have access to the internet at home.

Exclusion criteria

Patients were excluded if taking part in other clinical trials involving the completion of extensive PRO or QOL measures or exhibiting overt psychopathology/cognitive dysfunction.

Patient pathways

The chemoradiotherapy pathways (cervical, anal, rectal, endometrial, vaginal and vulval patients) are very similar at both centres. However, the cervical patients in Leeds get a brachytherapy (BT) boost at 5 weeks and The Christie patients undergo this at 6 weeks. At Leeds after completion of radiotherapy, rectal patients (post-surgery) are followed up by the surgeons. Patients will be encouraged to complete AE reporting for radiotherapy toxicity but will be informed the surgical team will not be looking at the patient-reported data at 12 and 24 weeks. However, outcome measures will still be collected at 24 weeks. The radical prostate treatment pathway is similar at both centres (The Christie and Leeds); however, The Christie offers a 6-week follow-up via the telephone. All treatment pathways were mapped, and a detailed flow charts were made including timelines, toxicities, treatment visits and health personnel involved [59].

Comparability between centres

Although the Leeds and The Christie treatment schedules differ slightly for each of the cancer sites, the treatment volumes will be comparable. Similarly, the timescales of toxicity will also be comparable, e.g. acute bowel effects from pelvic RT usually start from 8th to 9th fraction, i.e. at end of the second week.


This study is conducted at two centres (The Christie (C) and Leeds (L) employing a prospective randomised two-arm parallel group design with repeated measures and mixed methods. Participants will be randomised to either the intervention arm (eRAPID RT plus usual care) or the control arm (usual care) with 1:1 allocation). See Fig. 3 for the Trial Flow diagram.

Fig. 3
figure 3

Trial flow diagram for the eRAPID radiotherapy feasibility pilot study

eRAPID intervention

Only patients randomised to the intervention will complete the eRAPID online symptom/AE report within 24 h of study entry (forming the baseline symptom report) and then weekly (or when experiencing symptoms) for 12 weeks (6 weeks during treatment and 6 weeks post-treatment) and at 18 and 24 weeks. Patients in the eRAPID intervention arm will also complete self-efficacy and patient activation measures and a questionnaire to assess their ability to use the online system (system usability scale).

All patients (either eRAPID or usual care) complete baseline measures (pre-randomisation) on paper and at 6, 12 and 24 weeks.

The timings of online completion and the outcome measures were chosen based on the RT schedules and the follow-up pathways, aiming to find a schedule of completions that fits but allows for the slight differences between the two centres.

Usual cancer care

Patients are provided with verbal and written information on treatment benefits and expected AEs, and instructions on how to manage AE and contact the hospital including out-of-hours. They have a nurse/clinical oncologist/radiographer assessment before starting treatment and are given information on how to manage AE and out-of-hours contact numbers.


Patients will be recruited from RT departments, outpatient clinics and day-case wards at Leeds Teaching Hospital NHS Trust and at The Christie Hospital Manchester (CHM). Eligible patients will be identified by screening of clinic, in-patient or day-case lists by the clinical or administration staff. Consultants responsible for the care of patients are informed via letter or email.

After introduction from clinical staff, a researcher (who has received Good Clinical Practice training (GCP) will explain the study, provide an information sheet (Additional file 1: Appendix 2) and obtain consent (Additional file 1: Appendix 3) at this or the patient’s next visit. Participants are free to withdraw from the trial at any time without giving reasons and without prejudicing any further treatment. Reassurance is given that anonymity will be maintained (patients are issued a study number), and data collected will be treated in the strictest confidence and held in accordance with the Data Protection Act 1998.


Participants are randomised with 1:1 allocation to intervention and control groups, performed centrally at the University of Leeds Clinical Trials Research Unit (CTRU) using the 24-h telephone system. Patients randomised to the intervention arm receive training in using the eRAPID system.

Patients are already stratified by cancer centre (Leeds or Manchester) and will be further stratified by cancer site, e.g. prostate or cancer requiring chemo RT (cervix, anal, rectal, vaginal, endometrial and vulval). A diagrammatic representation of the stratification factors is presented in Fig. 4.

Fig. 4
figure 4

Stratification factors for eligible patients by hospital and cancer site



Staff are trained by the researchers reinforced by a user-manual providing scenarios of an ‘example’ patient and how to interact, interpret and access the PRO data in the EPR and incorporate this data into their consultations. It is stressed that PRO data should be seen as a supplementary resource to aid management decisions. We will explore and reassure staff that using eRAPID will not extend consultation times.


Researchers demonstrate how to use eRAPID system and provide a unique user name and password to access the system, on an eRAPID ‘postcard’. Participants are given step-by-step user guide and if encounter problems (e.g. lost user names/password or problems logging on) are advised to contact the research team. Prompts to complete the eRAPID questionnaire can be sent via email or text message.

Sample size and recruitment rate

Thirty patients per arm for each treatment type will provide valuable information on outcomes [60] (Tables 1 and 2) Allowing for 30% overall attrition, we aim to recruit a minimum of 42 patients per-arm (n = 84 for each treatment type) at a rate of around 15 patients per month for approximately 15 months giving an overall total of 168 patients, with a 24-week follow-up.

Table 1 eRAPID RT study questionnaires and Case Report Forms (CRFs): researcher completed
Table 2 eRAPID RT study questionnaires and Case Report Forms (CRFs): participant completed

Statistical analysis of the recruitment and attrition rates, clinical process measures and patient outcome data is the responsibility of the CTRU Trial Statistician under the supervision of the Supervising Statistician. A full statistical analysis plan has been written by the CTRU Trial Statistician. A health economic data analysis will be undertaken by a health economist from the academic Unit of Health Economics (AUHE), based on the health economics analysis plan (HEAP). Interview data will be processed by the research teams in the two participating centres. All analyses will be conducted according to the intention to treat (ITT) principle using SAS statistical software.

Data collection and management

An overview of data to be collected during the study is outlined in Tables 1 and 2.

Baseline assessments

All participants complete baseline questionnaires, including socio-demographics and current computer usage. Clinical baseline data will be obtained from participants’ medical notes including sex, age, diagnosis, co-morbidities, smoking status and planned treatment. Patients will then be randomised to receive either usual care or the eRAPID intervention (in addition to usual care). Participants receiving the eRAPID intervention will also be asked whether they want to receive reminders via email or text message to complete their weekly online AE reports. Patients randomised to the eRAPID arm will complete the first online report within 24 h as a baseline symptom report.

On-going online symptom reporting from home

Patient in the eRAPID arm will complete the AE symptom report from home on a weekly basis during treatment (up to 6 weeks) and for 6 weeks after (12 weeks in total).

Patient outcome measures

The following measures will be used to enable comparison between participants in the control and eRAPID intervention arms and will be collected on paper. Measures will be completed on paper at baseline then 6, 12 and 24 weeks from randomisation. The research team will either provide the measures at routine hospital appointments or post them to participants (and provide pre-paid envelopes for their return).

Use of resources form (completed at 6, 12 and 24 weeks)

Resource use will be assessed using a patient questionnaire (detailing contacts with GPs/community services, hospital visits), developed for a trial assessing treatment for chemotherapy-related nausea/vomiting ( This has been revised for use in RT from staff and patient input.

Quality of life and wellbeing

To assess the quality of life and wellbeing of the study participants, the following validated measures will be used as patient-reported outcomes:

EQ-5D-5L [61] (completed at baseline, 6, 12 and 24 weeks)

The EQ-5D is a standardised health outcome measure developed by the EuroQol Group. EQ-5D has been used with a range of health conditions and treatments providing a simple descriptive profile and single index value for health status for use as part of a health economic evaluation. The instrument assesses five dimensions: mobility, self-care, usual activities, pain/discomfort and anxiety/depression with five response levels (ranging from no problems to extreme problems). The instrument also includes a scale to rate health from 0 to 100 (worst-best health you can imagine).

Functional Assessment in Cancer Therapy Scale-General [62] (FACT-G, completed at baseline, 6, 12 and 24 weeks)

The FACT-G is a cancer-specific measure widely used in clinical trials. It has four subscales: physical wellbeing, social or family wellbeing, emotional wellbeing, and functional wellbeing. Question responses range from 0 to 4. Higher scores on the questionnaire indicate better HRQL (score range, 0 to 108).

EORTC-QLQ-C30 [63] (completed at baseline, 6, 12 and 24 weeks)

The EORTC-QLQ-C30 is a 30-item questionnaire consisting of five functional scales (physical, emotional, cognitive, social, role), three symptom scales (fatigue, pain, nausea/vomiting), a global health-related quality of life scale and six single items (anorexia, insomnia, dyspnoea, diarrhoea, constipation, financial difficulties). Questions are rated on a 4 or 7-point response scale, and overall scale scores are calculated from 0 to 100 with higher scores indicating better quality of life.

Self-efficacy and patient engagement in health care

Self-Efficacy for Managing Chronic Disease 6-Item Scale [64, 65] (completed at baseline and 12 weeks)

This 6-item scale contains items taken from several self-efficacy scales. It covers several domains common across many chronic diseases such as symptom control, role function, emotional functioning and communicating with physicians.

The Patient Activation Measure [66] (PAM, completed at baseline and 12 weeks)

The PAM is a tool for measuring the level of patient engagement in their healthcare. The PAM 13-item scale explores beliefs, knowledge and confidence for engaging in health behaviours. Each item is rated on a four-point scale from strongly disagree to strongly agree, and an overall score from 0 to 100 can be calculated. These scores can be subdivided to categorise people into one of four activation categories ranging from 1-low activation to 4-high activation.

Patient satisfaction with the eRAPID technology

System Usability Scale [67] (SUS, completed at 24 weeks––eRAPID intervention arm only)

The SUS is a 10-item instrument to assess subjective views of usability of different systems including hardware, software, mobile devices, websites and applications. The 10 items cover the ease of using the system, its complexity and user confidence. Each item is rated from 1 to 5, and a composite score of overall usability can be calculated ranging from 0 to 100.

Clinical process measures

To assess any association between the eRAPID intervention and improved detection and management of AEs, the data will be collected from hospital triage forms, medical records and hospital databases to record:

  • Number of scheduled and unscheduled hospital contacts (admissions, clinic visits, phone calls with staff)

  • Changes to supportive medications, radiotherapy regimens and chemotherapy dose changes

  • Contacts with GP/district nurse/community services

  • Number of clinician alerts generated from eRAPID severe symptom reports and actions taken by staff.

In addition to the above, at routine radiotherapy review, staff will be asked to provide:

  • Clinician reports on use of eRAPID patient data during consultations

  • Clinician records of CTCAE matching those AE questions completed by patients on the eRAPID questionnaire at routine clinic visits at 4–6 weeks after treatment completion (exact time-point will be different for different disease groups)

End of study interviews and questionnaires

At the end of the study, a subset of patients and staff will be interviewed and asked about their views of the eRAPID system. All participants will be asked to complete a short end of study questionnaire about their experiences with the eRAPID intervention.

Participant interviews and questionnaires

At the end of the study, a purposive sample (by gender and age) of up to 5 participants per disease group from the intervention arm will be invited to interview. They will be asked about the relevance and burden of completing routine PROMs throughout the study, and if the eRAPID system had any impact on their care.

Where possible, participants who withdrew will be asked to complete a voluntary brief feedback form to assess potential reasons for withdrawal.

Staff interviews and questionnaires

Up to five health professionals from each disease group will be interviewed at the end of the study to determine their views of eRAPID, the perceived value and use of patient data in clinical practice, exploring if eRAPID improves the detection, documentation and management of AE and support treatment decision-making. Perceptions of staff training needs and recommendations for improving the system will also be explored.

Statistical analysis

Baseline characteristics

Data from the baseline socio-demographic, computer usage and clinical data questionnaires will be tabulated using frequencies and summary statistics for each treatment group and overall.

Recruitment missing data and attrition

The feasibility of the recruitment strategy will be evaluated by summarising the screening, eligibility and consent processes, including the number of participants involved at each stage. Where available, reasons for ineligibility and non-participation in the study will be summarised. Retention during follow-up, including the number of participant’s withdrawing from the study and the timing of and reasons for withdrawal will be presented. Acceptability and potential conditions for improved acceptability will be explored as part of the patient and staff interviews.

Clinical process measures

The number of telephone calls to hospital staff and weekly/additional AE reports completed using the eRAPID system will be summarised. Clinician and staff acceptability will be explored during the staff interviews. Initial interviews will determine any anticipated barriers to the use of eRAPID, whereas exit interviews will explore actual issues that prevented staff from incorporating information into routine practice. Clinicians will be asked when and how they made use of the additional information, and how this benefitted them.

Integrity of the study protocol and data collection forms

Any deviations from the study protocol, such as ineligible patients being registered into the study, will be reported. The time taken to complete the paper and QTool forms and the amount of missing data will be summarised.

Integrity of the information systems

Descriptive accounts of any issues with server downtime leading to the unavailability of either the QTool questionnaire or patient-reported data in PPM and CWP will be collected in order to evaluate the overall performance and reliability of the IT system. If these are found to be unacceptable, the relevant server hosts will be contacted. Data from the participant phone call logs will be categorised to assess any common problems encountered and to determine if any changes should be made to the eRAPID training session/user guide to support participants more effectively. The System Usability Scale (SUS) will be compared against available SUS scores for other systems.

eRAPID system performance

Throughout the study, the eRAPID IT systems will be monitored for unscheduled server down time (leading to the unavailability of the QTool questionnaire website, eRAPID website and patient symptom data in PPM and CWP). This is facilitated via a service level agreement with University of Leeds IT services and protected by the NHS firewall. The service provider is committed to providing 99.9% uptime, and no unscheduled downtime has occurred during the current study. Additionally, a log of phone calls to the research team regarding issues/problems surrounding the use of eRAPID will be maintained.

Selection of patient outcome measures

Patient outcome measures (see Table 2) will be summarised at each time point, and 95% confidence intervals constructed for the differences between treatment arms. In addition, the number of questionnaires completed and the extent of missing data will be presented. To aid selection for a future RCT, any ceiling and/or floor effects from the questionnaires will be noted.

Health economic data

Patient-generated data based on the use of resources form will be analysed descriptively for reported frequencies of events and missing data. Comparisons will be made between the number of hospital contacts and admissions made by researchers with that provided by patients.

Qualitative data

Interviews will be recorded and transcribed. Data will be managed by NViVO software and analysed using thematic analysis [68, 69]. To improve reliability and consistency within the coding process, two researchers will independently conduct the analysis before meeting to discuss and resolve inconsistencies. Understanding of the data will be further refined by using constant comparison, contrastive analysis and looking for negative cases.

Trial monitoring

Trial management group (TMG)

The TMG, comprising the Chief Investigator (CI), Patient Reported Outcomes Group (POG) and the Observational and Supportive Team (OST) at The Christie, patient representatives, CTRU team and other key external members of staff involved in the trial will be assigned responsibility for the clinical setup, on-going management, promotion of the trial and for the interpretation and publishing of the results. Specifically, (i) protocol completion; (ii) case report form development; (iii) obtaining approval from the main REC and supporting applications for Site Specific Assessments; (iv) completing cost estimates and project initiation; (v) facilitating the Trial Steering Committee (TSC); (vi) monitoring of screening, recruitment, treatment and follow-up procedures and (vii) auditing consent procedures, data collection, trial endpoint validation and database development.

Trial Steering Committee (TSC)

The independent Steering Committee for the overall eRAPID programme will provide supervision of the RT trial, in particular trial progress, adherence to protocol, participant safety and consideration of new information. In line with NIHR guidance, the TSC includes an Independent Chair, three other independent members including a patient representative. The Committee meets in person annually as a minimum, with six monthly meeting via teleconference. The TSC receives the TMG reports and reports to the Sponsor and the funder (NIHR). The CI and other members of the Trial Management Group (TMG) may attend the TSC meetings and present and report progress. In addition, representatives of the NIHR and of the Sponsor are invited to all meetings and receive minutes.

Data monitoring (DMEC)

Routine data collection will be monitored for quality and completeness in Leeds by POG and in Manchester by the OST, using verification, validation and checking processes. Missing data, except individual data items collected from weekly symptom questionnaires, will be chased until they are received or confirmed as not available.

Any serious concerns about data will be referred to the main trial data monitoring committee for systemic therapy which is independent of the sponsor and competing interests [45].

Safety monitoring plan

Monitoring acute admissions, cumulative deaths, cause of death and other detrimental effects to patients will assess the possibility of severe AEs being missed as a result of the intervention. These will be reviewed monthly by the CI, reported at each meeting of the TMG, and a 3-monthly report will be submitted for review to the TSC. In addition, the CI will review on a monthly basis patient-reported AE, note any serious reactions and report where appropriate via the online Yellow card scheme


Research ethics committee (REC) will be sought for modifications to the protocol, and any approved changes will be communicated in written form (and reiterated verbally) to all concerned parties including funders, investigators, staff and trial participants registries and regulators.

Clinical governance

The overall clinical responsibility and welfare of the patients will remain with the individual treating clinicians within each disease group.

Dissemination policy

The trial is registered with an authorised registry, according to the International Committee of Medical Journal Editors (ICMJE) guidelines, prior to the start of recruitment. Credit for the main results will be given to all those who have collaborated in the trial, through authorship and contributorship. Uniform requirements for submission to medical journals will guide authorship decisions. The CI, relevant research, CTRU and AUHE staff will be named as authors in any publication. In addition, all collaborators will be listed as contributors for the main trial publication, giving details of roles in planning, conducting and reporting the trial. To maintain the scientific integrity of the trial, data will not be released prior to the first publication of the analysis of the primary endpoint, either for trial publication or oral presentation purposes, without the permission of the TSC. In addition, individual collaborators must not publish data concerning their participants directly relevant to the questions posed in the trial until the first publication of the analysis of the primary endpoint. See Abbreviations below.


This paper describes the protocol for the eRAPID feasibility study in patients undergoing pelvic radiotherapy. eRAPID is a complex web-based intervention designed to improve the systematic reporting of AE during cancer treatment and improve patient care and experiences. We aim to determine the acceptability and feasibility from both the perspective of patients undergoing pelvic radiotherapy+/− chemo-radiotherapy and their health professionals to determine effect sizes and select an appropriate outcome measure for a future RCT. We also aim to refine the intervention by exploring patient and staff views.

The immediate severity-related guidance generated from eRAPID on how to manage AE is a unique feature of our system compared to other ePRO web-portals [35, 38]. We hypothesise that eRAPID will ultimately have benefits for patients and staff. For patients, it may enable earlier symptom detection and improved self-management, lead to more timely admissions to manage more serious AE, improve supportive medication use and appropriate health service contacts. For staff, it may reduce the number of contacts, save time spent on enquiring about and recording AEs, focus attention and support decision-making during consultations.

The ultimate success of eRAPID will depend on how patients and staff engage with and appreciate the potential benefits of the system. This pilot study will determine the acceptability and feasibility of the complex intervention for patients and staff and determine any changes required to improve the system prior to evaluation in an RCT. The study is funded as part of 5-year programme and has the potential to provide a cost-effective solution for follow-up for pelvic radiotherapy patients by reducing hospital or primary care contacts. In addition, it will help to create a comprehensive database of RT AE and deliver vital PRO information on treatments.



Adverse events


Advanced Symptom Management System


Academic Unit of Health Economics


Brachytherapy––a technique where radioactive therapeutic seeds or rods are implanted into the cancerous area (prostate or cervix)


The Christie Hospital Manchester


Concomitant Chemoradiation


Common Terminology Criteria for Adverse Events


Clinical Trials Research Unit


Clinical Web Portal (electronic patient record system at The Christie Manchester)


Data Monitoring and Ethics committee


European Organisation for Research and Treatment of Cancer Core Quality of Life questionnaire


European Organisation for Research and Treatment of Cancer Core Prostate Module


Expanded Prostate Cancer Index


Electronic patient records


Electric patient-reported outcome


Electronic patient-reported outcome measures


Standardised instrument for use as a measure of health status


Electronic patient self-Reporting of Adverse-events: Patient Information and aDvice


Functional Assessment in Cancer Therapy Scale-General


Federal Drug Agency


Female pelvic questionnaire (questionnaire developed at The Christie Manchester to monitor patients receiving RT to the pelvis)


Good Clinical Practice


Health Economics Analysis Plan


Intensity-modulated radiation therapy an advanced high-precision mode using linear accelerators


Online system for Interactive Symptom Assessment and Collection


Late effects Normal Tissue-Subjective, Objective, Management, analytic scales


Leeds Teaching Hospitals NHS Trust


Male pelvic questionnaire (questionnaire developed at The Christie Manchester to monitor patients receiving RT to the pelvis)


Medical research council


National Confidential Enquiry into Patient Outcome and Death


National Health Service


National Institute for Health Research


Observational and supportive team (The Christie)


The Patient Activation Measure (tool for measuring the level of patient engagement in their healthcare)


Patient Pathway Manager (electronic patient record system used in Leeds Teaching Hospitals)


Patient-reported outcomes


Patient-Reported Outcomes version of the Common Terminology Criteria for Adverse Events


Patient-reported outcome measures


Quality of life


Web-based questionnaire builder system (built by X-Lab)


Randomised Controlled Trial




Radiation therapy oncology group (toxicity criteria)


Statistical Analysis Software


Symptom Tracking and Symptom Reporting


Trial Management Group


Trial Steering Committee


A private software company based in Leeds


  1. Henson CC, Andreyev HJ, Symonds RP, Swindell R, Davidson SE. Late-onset bowel dysfunction after pelvic radiotherapy: a national survey of current practice and opinions of clinical oncologists. Clin Oncol. 2011;23(8):552–7.

    Article  CAS  Google Scholar 

  2. Viani GA, Rossi BT, Suguikawa E, Zuliani G, Stefano EJ. Treatment outcomes with hypofractionated high-dose radiation therapy for prostate cancer. Rep Pract Oncol Radiother. 2016;21(3):172–7.

    Article  Google Scholar 

  3. Jackson A, Marks LB, Bentzen SM, Eisbruch A, Yorke ED, et al. The lessons of QUANTEC: recommendations for reporting and gathering data on dose-volume dependencies of treatment outcome. Int J Radiat Oncol Biol Phys. 2010;76:S155–60.

    Article  PubMed  PubMed Central  Google Scholar 

  4. Andreyev HJ, Wotherspoon A, Denham JW, Hauer-Jensen M. “Pelvic radiation disease”: new understanding and new solutions for a new disease in the era of cancer survivorship. Scand J Gastroenterol. 2011;46(4):389–97.

    Article  PubMed  Google Scholar 

  5. Viani GA, Stefano EJ, Afonso SL. Higher-than-conventional radiation doses in localized prostate cancer treatment: a meta-analysis of randomized, controlled trials. Int J Radiat Oncol Biol Phys. 2009;74:1405–18.

    Article  PubMed  Google Scholar 

  6. Kirwan JM, Symons SP, Green JA, Tierney J, Collingwood M, Williams CJ. A systematic review of acute and late toxicity of concomitant chemoradiation for cervical cancer. Rad Oncol. 2003;68:217–26.

    Article  Google Scholar 

  7. Hofheinz RD, Wenz F, Post S, Matzdorf A, laechelt S, Hartmann JT, et al. Chemoradiotherapy with capecitabine versus fluorouracil for locally advanced rectal cancer: a randomised, multicentre, non-inferiority, phase 3 trial. Lancet Oncol. 2012;3:579–88.

    Article  Google Scholar 

  8. Adams E, Boulton MG, Horne A, Rose PW, Durant L, Collingwood M, et al. The effects of pelvic radiotherapy on cancer survivors: symptom profile, psychological morbidity and quality of life. Clin Oncol. 2014;26:10–7.

    Article  CAS  Google Scholar 

  9. LENT SOMA scales for all anatomic sites. Int J Radiat Oncol Biol Phys. 1995;31:1049–91.

  10. National Institutes of Health and National Cancer Institute. Common Terminology Criteria for Adverse Events (CTCAE) Version 4.0. Bethesda: U.S. Department of Health and Human Sciences; Nat Inst Health Nat Canc Inst; 2009.

  11. Velikova G, Booth L, Smith AB, Brown PM, Lynch P, Brown JM, et al. Measuring quality of life in routine oncology practice improves communication and patient well-being: a randomized controlled trial. J Clin Onc. 2004;22:714–24.

    Article  Google Scholar 

  12. Velikova G, Brown JM, Smith AB, Selby PJ. Computer-based quality of life questionnaires may contribute to doctor-patient interactions in oncology. Br J Cancer. 2002;86:51–9.

    Article  PubMed  PubMed Central  CAS  Google Scholar 

  13. Velikova G, Keding A, Harley C, Cocks K, Booth L, Smith AB, et al. Patients report improvements in continuity of care when quality of life assessments are used routinely in oncology practice: secondary outcomes of a randomised controlled trial. Eur J Can. 2010;46:2381–8.

    Article  Google Scholar 

  14. Espallargues M, Valderas JM, Alonso J. Provision of feedback on perceived health status to health care professionals: a systematic review of its impact. Med Care. 2000;38:175–86.

    Article  PubMed  CAS  Google Scholar 

  15. Greenhalgh J, Meadows K. The effectiveness of the use of patient-based measures of health in routine practice in improving the process and outcomes of patient care: a literature review. J Eval Clin Pract. 1999;5:401–16.

    Article  PubMed  CAS  Google Scholar 

  16. Haywood K, Marshall S, Fitzpatrick R. Patient participation in the consultation process: a structured review of intervention strategies. Patient Educ Couns. 2006;63:12–23.

    Article  PubMed  Google Scholar 

  17. Marshall S, Haywood K, Fitzpatrick R. Impact of patient-reported outcome measures on routine practice: a structured review. J Eval Clin Pract. 2006;12:559–68.

    Article  PubMed  Google Scholar 

  18. Takeuchi EE, Keding A, Awad N, Hofman NU, Campbell LJ, Selby PJ, et al. Impact of patient-reported outcomes in oncology: a longitudinal analysis of patient-physician communication. J Clin Oncol. 2011;29:2910–7.

    Article  PubMed  Google Scholar 

  19. Valderas JM, Alonso J, Guyatt GH. Measuring patient-reported outcomes: moving from clinical trials into clinical practice. Med J Aust. 2008;189:93–4.

    PubMed  Google Scholar 

  20. Bennett AV, Jensen RE, Basch E. Electronic patient-reported outcome systems in oncology clinical practice. CA Cancer J Clin. 2012;62:336–47.

    Article  Google Scholar 

  21. Basch E. The missing voice of patients in drug-safety reporting. N Engl J Med. 2010;362:865–9.

    Article  PubMed  PubMed Central  CAS  Google Scholar 

  22. Darzi A. High quality care for all: NHS next stage review (final report). (Department of Health London. Gateway reference 10106 2008). Accessed 23 May 2013.

  23. Department of Health. Guidance on the routine collection of patient reported outcome measures (PROMs) for the NHS in England. (London, 2008). Accessed 19 Jun 2017.

  24. Black N. Patient reported outcome measures could help transform healthcare. BMJ. 2013;346:f167.

    Article  PubMed  Google Scholar 

  25. Dueck AC, Mendoza TR, Reeve BB. Validation study of the patient-reported outcomes version of the common terminology criteria for adverse events (PRO-CTCAE). J Clin Oncol. 2010;28(15_suppl).

  26. Dueck AC, Mendoza TR, Mitchell SA. Validity and reliability of the US National Cancer Institute’s Patient-Reported Outcomes Version of the Common Terminology Criteria for Adverse Events (PRO-CTCAE). JAMA Oncol. 2015;1(8):1051–9.

    Article  PubMed  PubMed Central  Google Scholar 

  27. Basch E, Iasonos A, McDonough T, Barz A, Culkin A, Kris MG, et al. Patient versus clinician symptom reporting using the National Cancer Institute Common Terminology Criteria for Adverse Events: results of a questionnaire-based study. Lancet Oncol. 2006;7:903–9.

    Article  PubMed  Google Scholar 

  28. Basch E, Goldfarb S. Electronic patient-reported outcomes for collecting sensitive information from patients. J Support Oncol. 2009;7:98–9.

    PubMed  Google Scholar 

  29. Ziegler L, Harley C, Holch P, Keding A, Bamforth L, Warrington L, et al. Towards safer delivery and monitoring of cancer treatments. Electronic Patient Self-Reporting of Adverse-Events: Patient Information and aDvice (eRAPID). Psycho-Oncologia. 2012;21:15.

    Google Scholar 

  30. Holch P, Warrington L, Bamforth LCA, Keding A, Ziegler LE, Absolom K, et al. Development of an integrated electronic platform for patient self-report and management of adverse events during cancer treatment. Ann Oncol. 2017;28(9):2305–11.

    Article  PubMed  CAS  PubMed Central  Google Scholar 

  31. Johansen MA, Berntsen GK, Schuster T, Henricksen E, Horsch A. Electronic symptom reporting between patient and provider for improved health care service quality: a systematic review of randomized controlled trials. Part 2: methodological quality and effects. J Med Internet Res. 2012;14:e126.

    Article  PubMed  PubMed Central  Google Scholar 

  32. Johansen MA, Berntsen GK, Schuster T, Henricksen E, Horsch A. Electronic symptom reporting between patient and provider for improved health care service quality: a systematic review of randomized controlled trials. Part 1: state of the art. J Med Internet Res. 2012;14:e118.

    Article  PubMed  PubMed Central  Google Scholar 

  33. Farnell DJ, Mandall P, Anandadas C, Routledge J, Burns MP, Logue J, et al. Development of a patient-reported questionnaire for collecting toxicity data following prostate brachytherapy. Radiother Oncol. 2010;97:136–42.

    Article  PubMed  Google Scholar 

  34. Mullen KH, Berry DL, Zierler BK. Computerized symptom and quality-of-life assessment for patients with cancer part II: acceptability and usability. Oncol Nurs Forum. 2004;31:E84–9.

    Article  PubMed  Google Scholar 

  35. Basch E, Artz D, Dulko D, Scher K, Sabbatini P, Hensley M, et al. Patient online self-reporting of toxicity symptoms during chemotherapy. J Clin Oncol. 2005;23:3552–61.

    Article  PubMed  Google Scholar 

  36. Bush N, Donaldson C, Moinpur M, Haberman M, Milliken V, Markel V, et al. Development, feasibility and compliance of a web-based system for very frequent QOL and symptom home self-assessment after hematopoietic stem cell transplantation. Qual Life Res. 2005;14:77–93.

    Article  PubMed  CAS  Google Scholar 

  37. Snyder CF, Aaronson NK. Use of patient-reported outcomes in clinical practice. Lancet. 2009;374:369–70.

    Article  PubMed  Google Scholar 

  38. Dy SM, Roy J, Ott GE, McHale M, Kennedy C, Kutnner JS, et al. Tell Us: a web-based tool for improving communication among patients, families, and providers in hospice and palliative care through systematic data specification, collection, and use. J Pain Symptom Manag. 2011;42:526–34.

    Article  Google Scholar 

  39. Online system for Interactive Symptom Assessment And Collection (ISAAC) during cancer treatment, Accessed 3 Dec 2016.

  40. McCann L, Maguire R, Miller M, Kearney N. Patients’ perceptions and experiences of using a mobile phone-based advanced symptom management system (ASyMS) to monitor and manage chemotherapy related toxicity. Eur J Cancer Care. 2009;18:156–64.

    Article  CAS  Google Scholar 

  41. Judson TJ, Bennett AV, Rogak LJ, Sit L, Barz A, Kris MG, Clifford A, et al. Feasibility of long-term patient self-reporting of toxicities from home via the Internet during routine chemotherapy. J Clin Oncol. 2013;31:2580–5.

    Article  PubMed  PubMed Central  Google Scholar 

  42. Movsas B, Hunt D, Watkins-Bruner D, Lee WR, Thorpe H, Goldstein D, Moore J, et al. Can electronic web-based technology improve quality of life data collection? Analysis of radiation therapy oncology group 0828. Pract Radiat Oncol. 2014;4:187–91.

    Article  PubMed  Google Scholar 

  43. Ashley L, Keding A, Brown J, Velikova G, Wright P. Score equivalence of electronic and paper versions of the Social Difficulties Inventory (SDI-21): a randomised crossover trial in cancer patients. Qual Life Res. 2013;22:1435–40.

    Article  PubMed  Google Scholar 

  44. Holch P, Warrington L, Potrata B, Ziegler L, Hector C, Keding A, Harley C, et al. Asking the right questions to get the right answers: using cognitive interviews to review the acceptability, comprehension and clinical meaningfulness of patient self-report adverse event items in oncology patients. Acta Oncol. 2016;55(9–10):1220–6.

    Article  PubMed  Google Scholar 

  45. Hector C, Holch P, Warrington L, Morris C, Ziegler L, Absolom K, Keding A, et al. Development of online patient-advice for the self-management of low-level chemotherapy related toxicities (eRAPID): involvement of patients and staff. Psycho-Oncologia. 2013;22:11.

    Google Scholar 

  46. Absolom K, Holch P, Warrington L, Samy F, Hulme C, Hewison J, et al. Electronic patient self-Reporting of Adverse-events: Patient Information and aDvice (eRAPID): a randomised controlled trial in systemic cancer treatment. BMC Cancer. 2017;17(1):318.

    Article  PubMed  PubMed Central  Google Scholar 

  47. Möhler R, Köpke S, Meyer G. Criteria for reporting the development and evaluation of complex interventions in healthcare: revised guideline (CReDECI 2). Trials. 2015;16:204.

    Article  PubMed  PubMed Central  Google Scholar 

  48. Campbell M, Fitzpatrick R, Haines A, Sandercock P, Tyrer P. Framework for design and evaluation of complex interventions to improve health. BMJ. 2000;321:694–6.

    Article  PubMed  PubMed Central  CAS  Google Scholar 

  49. Warrington L, Holch P, Kenyon L, Hector C, Kozlowska K, Kenny AM, et al. An audit of acute oncology services: patient experiences of admission procedures and staff utilisation of a new telephone triage system. Support Care Canc. 2016;24(12):5041–8.

    Article  Google Scholar 

  50. Holmes M, Holch P, Rodgers Z, Dickinson S, Davidson S, Routledge J, et al. Patient and relative attitudes to the implementation of eRAPID (Electronic patients self-Reporting of Adverse-events: Patients Information and aDvice) during and after pelvic radiotherapy: a qualitative interview study. Psycho-Oncol. 2016;25:1–22.

    Article  Google Scholar 

  51. Rogers Z, Holch P, Holmes M, Davidson S, Routledge J, Henry A, et al. Health care professional (HCP) attitudes to the implemntation of eRAPID (electronic patient self-Reporting of Adverse-events: Patient Information and aDvice) during and after pelvic radiotherapy: a qualitative interview study. Psycho-Oncol. 2016;25:1–22.

    Article  Google Scholar 

  52. Holch P, Henry AM, Davidson S, Gilbert A, Routledge J, Shearsmith L, et al. Acute and late adverse events associated with radical radiation therapy prostate cancer treatment: a systematic review of clinician and patient toxicity reporting in randomized controlled trials. Int Jour Rad Onc Biol Phys. 2016;97(3):495–510.

    Article  Google Scholar 

  53. Gilbert A, Sebag-Montefiore D, Davidson S, Velikova G. Use of patient-reported outcomes to measure symptoms and health related quality of life in the clinic. Gynecol Oncol. 2015;136:429–39.

    Article  PubMed  Google Scholar 

  54. Gilbert A, Ziegler L, Martlam M, Davidson S, Efficace F, Sebag-Montifiore D, Velikova G. Systematic review of radiation therapy toxicity reporting in randomized controlled trials of rectal cancer: a comparison of patient-reported outcomes and clinician toxicity reporting. Intl Jour Rad Onc Bio Phys. 2015;92(3):555–67.

    Article  Google Scholar 

  55. Farnell DJ, Routledge J, Hannan R, Logue JP, Cowan RA, Wylie JP, et al. Efficacy of data capture for patient-reported toxicity following radiotherapy for prostate or cervical cancer. Euro J Canc. 2010;46:534–40.

    Article  Google Scholar 

  56. Holch P, Holmes M, Rodgers Z, Routledge J, Henry A, Franks K, et al. Seeking consensus from staff and patients on appropriate self-reported outcome (PRO) items for radical prostate patients in the eRAPID (Electronic patients self-Reporting of Adverse-events: Patient Information and aDvice) project: a Delphi study. Psycho-Oncologia. 2016;25:1–22.

    Article  Google Scholar 

  57. Cook K, Victorson D, Cella D, Schalet BD, Miller D. Creating meaningful cut-scores for Neuro-QOL measures of fatigue, physical functioning, and sleep disturbance using standard setting with patients and providers. Qual Life Res. 2015;24:575–89.

    Article  PubMed  Google Scholar 

  58. Gibson A, Holch P, Carter R, Clayton B, Dickinson S, Davidson S, et al. Development of online patient advice for the self-management of low-level radiotherapy and chemotherapy related toxicities (eRAPID): involvement of patients and staff. Psycho-Oncologia. 2017;26(suppl 2):10–28.

    Google Scholar 

  59. Rogers Z, Holch P, Holmes M, Davidson S, Routledge J, Henry A, et al. Healthcare professional (HCP) attitudes to the implementation of eRAPID (electronic patient self-Reporting of Adverse-events: Patient Information and aDvice) during and after pelvic radiotherapy: a qualitative interview study. Psycho-Oncologia. 2016;25:1–22.

    Article  Google Scholar 

  60. Lancaster GA, Dodd S, Williamson PR. Design and analysis of pilot studies: recommendations for good practice. J Eval Clin Pract. 2004;10:307–12.

    Article  PubMed  Google Scholar 

  61. Brooks RG, Jendteg S, Lindgren B, persson U, Björk S. EuroQol: health-related quality of life measurement. Results of the Swedish questionnaire exercise. Health Pol. 1991;18:37–48.

    Article  CAS  Google Scholar 

  62. Cella DF, Tulsky DS, Gray G, Sarafian B, Linn E, Monomi A, et al. The Functional Assessment of Cancer Therapy scale: development and validation of the general measure. J Clin Oncol. 1993;11:570–9.

    Article  PubMed  CAS  Google Scholar 

  63. Aaronson NK, Ahmedzai S, Bergman B, Bullinger M, Cull A, Duez NJ, et al. The European Organization for Research and Treatment of Cancer QLQ-C30: a quality-of-life instrument for use in international clinical trials in oncology. J Nal Canc Inst. 1993;85:365–76.

    Article  CAS  Google Scholar 

  64. Lorig KR, Chastain RL, Ung E, Shoor S, Holman HR. Development and evaluation of a scale to measure perceived self-efficacy in people with arthritis. Arth Rheum. 1989;32:37–44.

    Article  CAS  Google Scholar 

  65. Lorig KR, Sobel DS, Stewart AL, Brown BW, Bandura A, Ritter P, et al. Evidence suggesting that a chronic disease self-management program can improve health status while reducing hospitalization: a randomized trial. Med Care. 1999;37:5–14.

    Article  PubMed  CAS  Google Scholar 

  66. Hibbard JH, Stockard J, Mahoney ER, Tusler M. Development of the Patient Activation Measure (PAM): conceptualizing and measuring activation in patients and consumers. Health Serv Res. 2004;39:1005–26.

    Article  PubMed  PubMed Central  Google Scholar 

  67. Brooke J. “SUS: a “quick and dirty” usability scale”. In: Jordan PW, Thomas B, Weerdmeester BA, McClelland AL, editors. Usabil Eval in Ind. London: Taylor and Francis; 1996.

    Google Scholar 

  68. Potrata B, Cavet J, Blair S, Howe T, Molassiotis A. Understanding distress and distressing experiences in patients living with multiple myeloma: an exploratory study. Psycho-Oncol. 2011;20:127–34.

    Article  Google Scholar 

  69. Mukherjee SD, Coombes ME, Levene M, Cosby J, Kowaleski B, Arnold A. A qualitative study evaluating causality attribution for serious adverse events during early phase oncology clinical trials. Investig New Drugs. 2011;29:1013–20.

    Article  CAS  Google Scholar 

Download references


This paper presents independent research funded by the National Institute for Health Research (NIHR) under its Programme Grants for Applied Research Programme (reference number RP-PG-0611-20008). The views expressed are those of the author(s) and not necessarily those of the NHS, the NIHR or the Department of Health.

This work was conducted at the Section of Patient-Centred Outcomes Research, Patient Reported Outcomes Group, Leeds Institute of Cancer Studies and Pathology, University of Leeds, St James’s Hospital, Leeds UK, LS9 7TF.

The authors would like to thank the eRAPID radiotherapy management group for their contribution: Professors G. Velikova, J. Blazeby and J. Brown; Drs S. Davidson, A. Gilbert, P. Holch, S. Pini, A Henry, K. Franks, A. Choudry and C Harley; and Mrs. J. Routledge, K. Jenner, H. Richards, and C. Morris.

Contact for trial sponsor

Clare Skinner, Faculty Head of Research Support, Worsley Building, University of Leeds, LS2 9JT: email:, Tel: 0113 343 4897


This study is part of a 5-year research programme. eRAPID presents independent research funded by the National Institute for Health Research (NIHR) under its Programme Grants for Applied Research Programme (grant reference number RP-PG-0611-20008).

Availability of data and materials

The datasets generated during and/or analysed during the current study are available from the corresponding author on reasonable request.

Author information

Authors and Affiliations




PH, KA and GV contributed to the development of the intervention and setup of the study. AH, KF, KA and AG helped in clinical expertise and study steering and were the management group. SD and JR contributed in clinical expertise and study management at The Christie Hospital. SP helped in study management and trial implementation at St. James’s Hospital. CM was the patient representative. GV assisted in grant development and overall eRAPID study management. JB involved in statistical plan/analysis. CH provided the economic evaluaton of the manuscript and HEAP. All authors have contributed to, read and approved the final manuscript.

Corresponding author

Correspondence to Patricia Holch.

Ethics declarations

Ethics approval and consent to participate

The paper reflects the protocol version 1.3 as approved by the National Research Ethics Service (now part of the Health Research Authority). The approval was from Yorkshire & The Humber Leeds East Research Ethics Committee on 13 September 2016 (REC reference 16/YH/0371).

Competing interests

The authors declare that they have no competing interests.

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Additional file

Additional file 1:

Appendix 1. Radiotherapy eRAPID symptom report items. Appendix 2. Patient information sheet. Appendix 3. Patient consent form. (DOCX 50 kb)

Rights and permissions

Open Access This article is distributed under the terms of the Creative Commons Attribution 4.0 International License (, which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made. The Creative Commons Public Domain Dedication waiver ( applies to the data made available in this article, unless otherwise stated.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Holch, P., Pini, S., Henry, A.M. et al. eRAPID electronic patient self-Reporting of Adverse-events: Patient Information and aDvice: a pilot study protocol in pelvic radiotherapy. Pilot Feasibility Stud 4, 110 (2018).

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: