Developing the ‘gripes’ tool for junior doctors to report concerns: a pilot study
© The Author(s). 2016
Received: 10 May 2016
Accepted: 16 September 2016
Published: 29 September 2016
Junior doctors often have concerns about quality and safety but show low levels of engagement with incident reporting systems. We aimed to develop and pilot a web-based reporting tool for junior doctors to proactively report concerns about quality and safety of care, and optimise it for future use.
We developed the gripes tool with input from junior doctors and piloted it at a large UK teaching hospital trust. We evaluated the tool through an analysis of concerns reported over a 3-month pilot period, and through interviews with five stakeholders and two focus groups with medical students and junior doctors about their views of the tool.
Junior doctors reported 111 concerns during piloting, including a number of problems previously unknown to the trust. Junior doctors felt the tool was easy to use and encouraged them to report. Barriers to engagement included lack of motivation of junior doctors to report concerns, and fear of repercussions. Ensuring transparency about who would see reported concerns, and providing feedback across whole cohorts of junior doctors about concerns raised and how these had been addressed to improve patient safety at the trust, were seen having the potential to mitigate against these barriers. Sustainability of the tool was seen as requiring a revised model of staffing to share the load for responding to concerns and ongoing efforts to integrate the tool and data with other local systems for gathering intelligence about risks and incidents. Following piloting the trust committed to continuing to operate the gripes tool on an ongoing basis.
The gripes tool has the potential to enable trusts to proactively monitor and address risks to patient safety, but sustainability is likely to be dependent on organisational commitment to staffing the system and perceptions of added value over the longer term.
For healthcare organisations to learn, and to proactively improve quality and safety of patient care, it is essential to enable healthcare staff to report incidents and concerns . In the wake of the Francis enquiry in the UK, particular attention has been focused on efforts to support staff in raising concerns about patient safety [2, 3], with junior doctors being identified as having an important role to play as the ‘eyes and ears’ of the NHS . Junior doctors are in a unique position to identify concerns about patient safety: they spend much of their time in clinics or on hospital wards and are closely involved in day to day care of patients. They may also become aware of wider organisational problems that impact across different wards or units within hospitals and may be more likely to notice unacceptable practices . Although junior doctors often have concerns about quality and safety, they show low levels of engagement with incident reporting systems [5, 6].
Developing a system which encourages junior doctors to report their concerns to the organisations in which they are training requires an awareness of barriers to reporting and features of a system which might make doctors more likely to engage . The most common disincentives to reporting concerns described by junior doctors are a lack of belief in local reporting systems, a perception that local reporting does not result in any action, a lack of role modelling by senior doctors, uncertainty about what to report, inflexibility of reporting systems, and lack of feedback [8, 9]. The high-profile negative treatment of whistleblowers in the NHS is a potential barrier to raising concerns . More broadly, fear of blame or repercussions, acceptance of errors as inevitable, and rejection of managerial scrutiny are also recognised as significant barriers to reporting [10, 11].
The GMC’s national training survey in the UK is a route through which junior doctors can raise concerns about patient safety in the organisations in which they are training . In 2013, 5.2 % of responders raised concerns and 28 % of these concerns were new or unknown to the organisations involved. In 2014, partly due to changes to the wording of the survey, only 0.8 % of junior doctors reported concerns but over half of these were previously unknown to the organisations involved . With recognition that there would be value in encouraging junior doctors to report their concerns directly with the organisation in which they were training, rather than reporting retrospectively through the training survey, we aimed to develop and evaluate a web-based reporting tool for junior doctors to proactively report concerns about quality and safety.
Incident reporting systems are used extensively across healthcare settings ; for example, all trusts in England have systems through which staff are required to report errors and adverse events, and trusts are required to upload reported incidents to the National Reporting and Learning System (NRLS) . These systems are, however, targeted at capturing ‘serious’ incidents, errors, and near misses and are not designed to capture the full range of concerns that staff may have about quality and safety of care. Improving patient safety requires going beyond a reactive approach to mistakes. A more proactive monitoring of concerns is likely to generate a deeper understanding of the local organisational influences and preconditions which may present risks to patient safety, and improves organisational capacity for learning, by presenting opportunities to intervene in problems before they escalate and result in actual harm to patients [15, 16].
We conducted a pilot study to field test the tool, to identify barriers and facilitators to successful implementation, and to gain insight into how to optimise for future use the tool and systems for responding to concerns.
The participating trust was a large teaching hospital trust located in a city in the Midlands of England. The trust had three hospital sites in different locations, with between 700 and 800 junior doctors working in the trust. The trust had a number of reporting systems already in place including the Datix incident reporting system, a staff concerns reporting telephone line, an online forum ‘The Staff Room’, directors’ breakfasts, a bullying and harassment line, and a whistleblowing policy.
We developed the gripes tool for junior doctors to report concerns (a ‘gripe’ is defined in the Oxford English Dictionary as ‘a minor complaint’). This comprised an online reporting form and an associated system for responding to concerns. The form was available via the trust website which doctors could access whenever they logged into a trust computer and included fields to select category of concern (lack of staffing resources; IT problems; problems of quality of care; problems with patient management and flow; training or supervision; communication or information transfer; teamwork or working culture; problems with care processes, policies, or guidelines; equipment problems; ward environment; other) as well as a text field to describe the concern. The design of the form and the choice of categories on concern to include in the form were informed by preliminary focus groups with junior doctors about their views on reporting concerns . The tool was promoted to junior doctors through design of a gripes logo, posters placed in clinical areas, pop-up advertising on the main trust website, and face-to-face promotion in junior doctor meetings and walk-rounds across the trust. The submission system for the form was set up to allow anonymised reporting with no personal details or information about usernames being attached to the report, but junior doctors could choose to include their email address in the report in order to get a response if they wished.
A three-person team managed the gripes system and took daily responsibility for monitoring and responding to the concerns reported. The team comprised a registrar seconded on a clinical education fellowship with dedicated time away from clinical duties; the director of safety and risk at the trust (an executive role that involves taking responsibility and providing clinical leadership for safety across the trust); and an information analyst. Prompt feedback about actions taken in response to concerns was provided to individual junior doctors who reported concerns, if contact details were provided. Concerns were resolved by the gripes team where possible or escalated by team through various routes (e.g. through IT services, the trust executive quality board, the trust chief executive).
The tool was piloted at the participating trust from 8 February to 8 May 2015. The Template for Intervention Description and Replication (TIDieR) checklist  (Additional file 1) provides a full description of the intervention and its implementation.
We evaluated the gripes tool through analysis of reported concerns and a qualitative evaluation to optimise the intervention and to explore barriers and facilitators to implementation.
Concerns were analysed descriptively, to summarise the number reported, and patterns of reporting. We interviewed five stakeholders (members of the gripes team and trust senior executives) about their experiences of operating the system and managing concerns. We conducted two focus groups with nine participants overall (one specialty trainee, one core trainee, two foundation year 2 doctors, one foundation year 1 doctor, and four final year medical students) to examine user views of the tool and how it could be improved. Participants were recruited by email using local lists and snowball sampling. Informed consent was gained from participants. Focus groups were facilitated by TM and CT, with a topic guide used flexibly to promote discussion. Interviews and focus groups were digitally recorded and transcribed verbatim.
Qualitative data from the focus groups and interviews were analysed thematically . Initial reading and open-coding of a selection of transcripts was used to develop a coding frame; this was applied to the full data set using NVivo 10. The coding frame was revised iteratively, with revisions informed by discussions within the research team. In presenting findings, we attribute quotations to either stakeholders (SH) or focus group participants (FG).
Categories of concerns
Category of concern
No. of times category selected
1. Lack of staffing resources
2. IT problems
3. Problems of quality of care
4. Problems with patient management and flow
5. Training or supervision
6. Communication or information transfer
7. Teamwork or working culture
8. Problems with care processes, policies, or guidelines
9. Equipment problems
10. Ward environment
11. Other (e.g. problem with access cards, suggestion for revision to clerking proformas)
The gripes team categorised four concerns that had been reported through the gripes tool as ‘incidents’ that should have been reported via the trust’s official incident reporting system. These included reports of falls and a medication error. The team identified that all four concerns had also been reported as incidents. As such, there was no evidence that the introduction of the gripes tool had resulted in incidents going unreported through the appropriate system.
In responding to these reported concerns, the gripes team sorted the concerns into groups, so that they could be passed onto relevant individuals or departments within the trust to be dealt with. The groups, and the corresponding proportion of concerns, were the following: ‘information, management, and technology’ (32 %, n = 36); ‘staffing and rotas’ (28 %, n = 31); ‘patient care concerns’ (23 %, n = 26); ‘organisational issues’ (9 %, n = 10); and ‘equipment problems’ (4 %, n = 4).
Following a bank holiday weekend, several doctors reported inadequate patient reviews for outlying patients on certain wards. The concern was escalated to senior management and quickly rectified without detriment to patient safety. A plan was created to avoid future reoccurrences.
Several locum doctors reported that they had no access to electronic prescribing systems and investigations, which affected their ability to work safely and efficiently. The junior doctor administrators were alerted to this and amended the induction process for temporary staff joining the trust.
Optimising the tool: engaging junior doctors
Focus group participants highlighted a number of ways to optimise the gripes tool and system to help promote junior doctor engagement, including further simplification of the form, promotion of the tool and feedback of actions taken in response to concerns, transparency about who would see reported concerns, and consideration of making the tool available off trust premises.
Further simplification of the gripes form
I think the less categories maybe the better the quality of gripe you’ll get. (FG)
Promotion of the tool
If you were to have a consultant […] to mention to the doctors on the ward that if there are unsatisfactory things we now have this new tool. (FG)
You could have for each group of doctors, like for the F1s [doctors in foundation year training], they have an F1 gripe champion. They get sent all the F1 gripes, and then they have a role where they regularly liaise with [senior staff] and say ‘these are the gripes we’re receiving’ (FG)
Listening and responding to concerns
The gripes team registrar reviewed concerns daily, provided prompt feedback to all who provided their contact details, and where possible worked with the junior doctor who reported the concern to try to resolve the problem. The trust director of safety and risk also reviewed concerns regularly and, in consultation with the registrar, took responsibility for escalating more serious or complex problems: working with other senior staff in the trust to coordinate solutions and develop action plans and reporting back to higher levels of the organisation.
For my friend that was the power of it, she’s told me about it, because […] she got a real response from a real person. She was like ‘oh, they responded’. (FG)
If you were sort of saying there is a GRIPE tool, this is how you can get hold of it, look what we’ve done in the past however months, then that would kind of encourage. [You could do it] at that induction teaching session (FG)
If people see results and things are resolved because of it, then they will use it. (FG)
Anonymity and confidentiality
That’s probably one of the biggest barriers. […] A reason I wouldn’t use it, is the fear of where it might go, […] maybe I wouldn’t use it because I’d be a bit afraid of what might happen because of what I said. (FG)
I’d like to know that there are a group of junior doctors […] people like me, who can relate to my problems. […] ‘We’re junior doctors as well, we’ll listen to your gripes and we’ll do something about it.’ (FG)
The more it annoys you and you actually, to an extent actually think you might be fearful of saying it, that makes it even more important you actually do report it. So I think for me it’s actually knowing something is coming out of this, otherwise I’m not wasting my time. (FG)
Accessibility of the tool
Could you gripe once you have got back home after a shift? Because obviously you can't access that from home. […] Probably email, […] or an app accessible from home. (FG)
Optimising the tool: considerations of value and sustainability
Stakeholders particularly reflected on the value of continued use of the gripes tool and on optimising the sustainability of models for operating the system.
Value of the tool: part of a bigger picture
I think it’s been useful because I know we’ve identified some safety concerns that we didn’t know about before. […] There’s things come up about staffing in areas that we didn’t know were a problem. (SH)
[It can be] a sort of barometer […] to say Ward X is getting hot, something is happening on Ward X. […], or we’re getting a lot of things about rotas. (SH)
What’s a long term value going forward if we’re just seeing the same things reported? I guess if we’re not seeing, if we are seeing the same things reported we haven’t remedied them. (SH)
We also do one paper every month which is triangulating all of those eight [reporting mechanisms] together, and it says these are the things that have been reported through all of those sources, and these are the top things that seem to be coming out. (SH)
Sustainability: staffing the system
I think it would be incredibly difficult to sustain it within current resources, because essentially most of it, [we] have been doing it, we’ve been doing it in our own time. (SH)
[We’ve] discussed a model whereby when the concerns come in they get allocated to an associate medical director with that portfolio […]. So the issues will be sent to the relevant associate medical director, with [director of safety and risk]’s team keeping an oversight of all the issues. (SH)
I think it has to be permanently open. […] I think the live thing in the shorter term is definitely more preferable because it improves your trust in that something is happening. If you actually get it embedded in the culture there would be no problem with [a delay in feedback] because you will be having positive feedback from things that have happened before. (FG)
The problem of concerns that are not easily resolved
The response to the IT concerns is going to be disappointing to the doctors. Because until we put in the new electronic patient record, and the […] investment that comes with that […] it is unlikely that the users are going to see a big change in their experience. So what you are going to end up saying, sending them back is that we are really sorry, we know the IT systems aren’t very good, there is not a lot we can do about it at the moment, and that, those kind of responses are a tricky one. (SH)
This study involved the development and evaluation of a tool for junior doctors to report concerns about quality or safety of care to the organisation in which they were training. The tool generated 111 reports of concerns during the 3-month pilot period. Junior doctors may have a unique perspective on quality and safety problems, but there are also particular challenges in engaging them in reporting concerns to their training organisation. Our evaluation demonstrated that a well-designed reporting system can overcome barriers for junior doctors in reporting concerns about quality and safety of care. Using a simple form, and allowing junior doctors’ flexibility in what and how they reported, helped to address the oft-reported barrier that incident reporting systems are difficult and time-consuming to use  and enabled junior doctors to tell the organisation about the things that really mattered to them . The trust has committed to running the system on an ongoing basis. The tool was relaunched following the pilot in December 2015, attracting a further 56 reported concerns between mid-December and mid-April 2016.
This pilot indicates that the gripes tool offers an approach for organisations to gather knowledge about risks to patient safety from junior doctors, who are well-placed to see these risks in the course of their day to day practice. Given that there are multiple tools and systems for reporting concerns in operation across hospitals, this is only one part of a bigger picture. Gripes data is likely to be of most value when triangulated or used alongside data on problems and incidents from a range of other sources including incident reporting systems and soft intelligence from staff and patients about problems in care .
Simply introducing another reporting form, however, without genuine commitment to working collaboratively with staff to ensure concerns are listened to and addressed , is unlikely to be effective and may even be counterproductive. As Macrae suggests, ‘the incident reports themselves do not matter nearly as much as the practical work of investigating and understanding a particular aspect of an organisational system and then working collaboratively to improve it’ . The pilot highlighted the challenges inherent in efforts to implement a sustainable system for responding to concerns. During the pilot period, the trust director of safety and risk invested significant time in reviewing and dealing with more complex concerns. This level of commitment was seen as unsustainable beyond the pilot period, necessitating a change in approach for the longer-term roll out of the tool. The revised approach being taken by the trust going forward involves a review of each concern by the gripes registrar who deals with straightforward problems such as missing equipment. All concerns are forwarded to the trust director of safety and risk who monitors patterns of concerns, but also forwards more complex concerns to a team of six trust directors, each of whom takes responsibility for one of six categories of concern (lack of staffing resources; IT issues; training and supervision; equipment and ward environment; team work and communication; quality and safety of care). All IT related concerns are also sent directly to the trust IT department. Current plans in the UK to introduce ‘freedom to speak up’ guardians into NHS trusts offer another, as yet untested, option for responsibility for managing and responding to concerns .
Healthcare staff are less likely to engage with a reporting system if they do not receive feedback on the outcome of their reports or do not perceive that local reporting results in action [8, 9]. Correspondingly, participants in our study suggested that evidence that the system was making a difference—that concerns were being listened to and acted upon—was the most critical factor motivating them to use the tool. Ensuring the feedback reaching all junior doctors across the trust is likely to require multiple approaches used in combination ; the current gripes registrar is working on a project to develop viable approaches to feedback which will include email and face-to-face updates to the whole cohort of junior doctors at the trust, on concerns reported through gripes and actions taken.
This pilot study was limited in that it was run in a single large trust; the replicability of the gripes system in other contexts is likely to be in part dependent on the availability of resources to support its operation. Stakeholders suggested that the tool worked well because it was part of a wider shift within the trust towards developing a positive organisational climate of listening to staff concerns. The extent to which such a system will embed in other contexts is likely to be dependent on the local organisational climate in relation to listening to staff concerns.
The use of a simple online reporting tool for junior doctors provides an approach for organisations to proactively detect problems in clinical systems at the frontline of care. The next steps will be assessing the sustainability of the system over an extended period of time, in particular, whether the system continues to generate new knowledge over time and continues to add value to other means of gathering intelligence about risk and incidents.
We would like to thank the junior doctors who participated in the focus groups. This was a demonstrator project for the Leicestershire Improvement Innovation and Patient Safety unit (LIIPS), and we thank them for their support.
The evaluation was supported by funding from Mary Dixon-Woods’ Wellcome Trust Senior Investigator Award (WT097899).
Availability of data and materials
Study data will not be shared, due to confidentiality of reported concerns and qualitative data.
The study was planned by SC, TM, and CT. SC provided the oversight of the study and supervision of the trainee. MD and TC implemented the intervention. CT led the evaluation; the data analysis was conducted by AM and CT. AM and CT drafted the paper. All contributors were involved in the revisions of the paper. All authors read and approved the final manuscript.
All authors declare that they have no competing interests.
Consent for publication
Ethics approval and consent to participate
Ethical approval for the study was gained from the University of Leicester Research Ethics Committee (July 2013, ref: ccp3-ba11). Informed consent was gained from participants.
Open AccessThis article is distributed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated.
- Department of Health. An organisation with a memory—report of an expert group on learning from adverse events in the NHS. 2000.Google Scholar
- Department of Health. A promise to learn: a commitment to act. Improving the safety of patients in England. National Advisory Group on the Safety of Patients in England. 2013.Google Scholar
- Francis R. Freedom to speak up: an independent review into creating an open and honest reporting culture in the NHS. 2015.Google Scholar
- Department of Health. Report of the Mid Staffordshire NHS Foundation Trust public inquiry: executive summary. London: Stationery Office; 2013.Google Scholar
- Ahmed M, Arora S, Carley S, Sevdalis N, Neale G. Junior doctors’ reflections on patient safety. Postgrad Med J. 2012;88(1037):125.View ArticlePubMedGoogle Scholar
- Robson J, De Wet C, McKay J, Bowie P. Do we know what foundation year doctors think about patient safety incident reporting? Development of a web based tool to assess attitude and knowledge. Postgrad Med J. 2011;87(1033):750.View ArticlePubMedGoogle Scholar
- Evans SM, Berry JG, Smith BJ, Esterman A, Selim P, O’Shaughnessy J, DeWit M. Attitudes and barriers to incident reporting: a collaborative hospital study. Qual Saf Health Care. 2006;15(1):39–43.View ArticlePubMedPubMed CentralGoogle Scholar
- GMC. National training survey 2014: concerns about patient safety. 2014.Google Scholar
- Hooper P, Kocman D, Carr S, Tarrant C. Junior doctors’ views on reporting concerns about patient safety: a qualitative study. Postgrad Med J. 2015;91(1075):251–6.View ArticlePubMedGoogle Scholar
- Waring JJ. Beyond blame: cultural barriers to medical incident reporting. Soc Sci Med. 2005;60(9):1927–35.View ArticlePubMedGoogle Scholar
- Sujan M. An organisation without a memory: a qualitative study of hospital staff perceptions on reporting and organisational learning for patient safety. Reliab Eng Syst Saf. 2015;144:45–52.View ArticleGoogle Scholar
- GMC. National training survey 2013: concerns about patient safety. 2013.Google Scholar
- Vincent C. Incident reporting and patient safety. Brit Med J. 2007;334(7584):51.View ArticlePubMedPubMed CentralGoogle Scholar
- NHS Improvement. Patient safety incident reporting and responding to patient safety alerts. Patient safety alert: NHS/PSA/RE/2016/003. 2016.Google Scholar
- Hollnagel E. Thought paper: proactive approaches to safety management. London: The Health Foundation; 2012.Google Scholar
- Sujan M, Ingram C, McConkey T, Cross S, Cooke MW. Hassle in the dispensary: pilot study of a proactive risk monitoring tool for organisational learning based on narratives and staff perceptions. BMJ Qual Saf. 2011;20(6):549–56.View ArticlePubMedGoogle Scholar
- Hoffmann TC, Glasziou PP, Boutron I, Milne R, Perera R, Moher D, Altman DG, Barbour V, Macdonald H, Johnston M. Better reporting of interventions: template for intervention description and replication (TIDieR) checklist and guide. Brit Med J. 2014;348.Google Scholar
- Braun V, Clarke V. Using thematic analysis in psychology. Qual Res Psychol. 2006;3:77–101.View ArticleGoogle Scholar
- Dixon-Woods M, Baker R, Charles K, Dawson J, Jerzembek G, Martin G, McCarthy I, McKee L, Minion J, Ozieranski P, Willars J, Wilkie P, West M. Culture and behaviour in the English National Health Service: overview of lessons from a large multimethod study. BMJ Qual Saf. 2013;23(2):106–15.View ArticlePubMedPubMed CentralGoogle Scholar
- Macrae C. Learning from patient safety incidents: creating participative risk regulation in healthcare. Health Risk Soc. 2008;10(1):53–67.View ArticleGoogle Scholar
- Macrae C. The problem with incident reporting. BMJ Qual Saf. 2015;25(2):71–5.View ArticlePubMedGoogle Scholar
- Benn J, Koutantji M, Wallace L, Spurgeon P, Rejman M, Healey A, Vincent C. Feedback from incident reporting: information and action to improve patient safety. Qual Saf Health Care. 2009;18(1):11–21.View ArticlePubMedGoogle Scholar