Skip to main content

Improving quality through simulation; developing guidance to design simulation interventions following key events in healthcare

Abstract

Simulation educators are often requested to provide multidisciplinary and/or interprofessional simulation training in response to critical incidents. Current perspectives on patient safety focus on learning from failure, success and everyday variation. An international collaboration has led to the development of an accessible and practical framework to guide the implementation of appropriate simulation-based responses to clinical events, integrating quality improvement, simulation and patient safety methodologies to design appropriate and impactful responses. In this article, we describe a novel five-step approach to planning simulation-based interventions after any events that might prompt simulation-based learning in healthcare environments. This approach guides teams to identify pertinent events in healthcare, involve relevant stakeholders, agree on appropriate change interventions, elicit how simulation can contribute to them and share the learning without aggravating the second victim phenomenon. The framework is underpinned by Deming’s System of Profound Knowledge, the Model for Improvement and translational simulation. It aligns with contemporary socio-technical models in healthcare, by emphasising the role of clinical teams in designing adaptation and change for improvement, as well as encouraging collaborations to enhance patient safety in healthcare. For teams to achieve this adaptive capacity that realises organisational goals of continuous learning and improvement requires the breaking down of historical silos through the creation of an infrastructure that formalises relationships between service delivery, safety management, quality improvement and education. This creates opportunities to learn by design, rather than chance, whilst striving to close gaps between work as imagined and work as done.

Simulation educators are often requested to provide multidisciplinary and/or multi-professional simulation training in response to a critical incident that has resulted in a significant adverse event. This raises the question: Should we adopt a systematic approach to designing simulation-based interventions after key events in healthcare environments?

“Simulation is a learning tool that supports development through experiential learning by creating or replicating a particular set of conditions which resemble real life situations; it should provide a safe environment where participants can learn from their mistakes without any danger to patients, allowing individuals to analyse and respond to these realistic situations, with the aim of developing or enhancing their knowledge, skills, behaviours and attitudes” [1]. Simulation-based education and training has a crucial role in improving the quality and safety of care for patients [2]; however, we should not assume that training will solve all issues surrounding critical incidents. Simulation not only provides opportunities for training and debriefing on safety behaviours, but can also play a significant role in improving healthcare systems [3].

A collaboration between Health Education and Improvement Wales (HEIW), Improvement Cymru, the Association for Simulation Practice in Healthcare (ASPiH), the Society for Simulation in Europe (SESAM) and international simulation experts was established. Its purpose was to design an accessible and practical framework to guide implementation of appropriate simulation-based responses following key clinical events, utilising quality improvement (QI) methodology to inform simulation design. The intended outcome is that when simulation is considered in the response to key events, it is used for the right reasons and in the most beneficial way whilst contributing to wider processes that support improvement.

This framework aims to be useful to anyone in the health and care community that wishes to engage in developing simulation-based responses following an event. Notably, it emphasises the importance of including individuals with simulation expertise within the team designing the response.

Development process

A literature search was carried out on different databases including Medline, Embase, Cumulated Index of Nursing & Allied Health Literature, Educational Resources Information Centre and Scopus. The search focused on simulation (including augmented reality and virtual reality), patient safety, quality improvement and error or event. A total of 113 articles were identified, none of which provided broad guidance on how to design simulation activities following a key event in healthcare.

A multi-professional working group was then established within NHS Wales in order to identify relevant needs and priorities when designing simulation interventions following key events. This group included patient safety leads, simulation educators, quality improvement experts, clinicians and managers. Discussions held in this group highlighted the need to develop guidance based on robust quality improvement methodology and translated into a practical “step-by-step” framework.

An advisory group was set up engaging national and international simulation and QI leads, to review the concept and its applicability, and further develop the content. A panel of six international experts provided iterative peer review, both after the initial concept design and after the document was finalised. The draft framework was trialled during a conference workshop where 32 multi-professional potential users were divided into four groups and asked to produce an initial design of a simulation-based response to a learning event. During the 90-min session, participants completed the allocated task successfully and their feedback contributed to the latest iteration of the document.

The framework, based on QI principles, provides a step-by-step guide to the design of simulation-based interventions in order to improve patient safety (Table 1). It describes how to incorporate best practice, signposting to relevant resources and guidance for intervention evaluation.

Table 1 Summary of the 5 steps to design simulation interventions following events in healthcare

The QI philosophy underpinning the framework is Deming’s System of Profound Knowledge. He described the foundations of improvement science and focused on identifying ways to define the essential components, interactions and variation within systems [4], hence promoting transformation through an essential outside “lens” which can benefit anyone and any organisation. We also refer to well recognised and commonly used QI approaches such as the Model for Improvement [5] and Plan-Do-Study-Act (PDSA) cycles [6].

Other approaches bolstering the framework include the psychology of change [7], which describes key elements necessary to engage people in co-designing improvement; translational simulation [8], which explores how simulation can improve patient outcomes; safety II [9], which changes our learning focus exclusively from risk and failure and widens it to understand the determinants of success and performance variability; and the description of healthcare socio-technical systems provided by the Systems Engineering Initiative for Patient Safety (SEIPS) [10].

This five-step framework aims to be useful across the health and care community to guide the development of simulation responses following a key event.

The 5 steps

What is a key event in healthcare?

Current perspectives on patient safety have shifted from focussing on learning from risk and failure (safety I) to understanding learning from failure, success and everyday variation (safety II) [9]. Therefore, we define key events as any circumstance that might trigger the consideration of simulation to promote learning and improvement in a proactive or reactive fashion, including mission rehearsal during introduction of new processes, challenging clinical situations with positive outcomes, near misses or critical events. Examples of key events include simulation-based testing of a new patient care pathway or simulation to reinforce positive behaviours following a well-managed major haemorrhage. The key event becomes a driver for learning and change, contributing to workforce engagement in patient centred system design and improvement.

Who needs to be involved in the process?

Healthcare systems are inherently complex, and a collaborative approach has the benefit of providing multiple perspectives on a given system, leading to a better understanding of all processes, their connections and impact of potential changes. All individuals who are part of the system under review, and those taking part in the intervention (including teams with expertise in simulation and quality improvement), should be identified to facilitate better understanding of the problem and the design of future improvements. These might include doctors, nurses, allied healthcare professionals, ancillary staff, administrative staff, managers, patients, user groups and educators. A stakeholder analysis must identify these people before the intervention is designed. Its potential impact on all individuals and teams involved is explored, including groups who may be negatively affected as a result of the intervention or change.

What needs to be done?

The individuals and teams that will contribute to intervention design should now explore the system, i.e. the individuals, items and processes working towards a common healthcare goal [11]. This will help focus the response and determine how best to use simulation expertise. QI utilises a number of different approaches and techniques that can facilitate understanding the system and inform the design of change, for instance process mapping. Simulation may be a powerful tool during process mapping [12], as it allows us to immerse ourselves in the process, allowing the integration of learning and change without disrupting clinical practice.

Once we have a better understanding of the system, the Model for Improvement guides us to identify what needs to be done by proposing 3 questions: What are we trying to accomplish? How will we know that a change is an improvement? What changes can we make that will result in an improvement? [13].

Consideration should be given to whether simulation is the appropriate tool to utilise following a key event or if a different approach might be more effective.

How will simulation contribute?

Simulation can take many forms depending on location, modality and fidelity [14]. Before developing a simulation-based response, we should consider collaboratively how to best utilise simulation expertise. Simulation may assist with one or more of the following: testing the system, providing education and training (by itself or in the context of blended learning), or contributing to event debriefing, i.e. facilitation of shared reflective practice and system-focussed collaborative learning from the original key event.

  • System testing simulation [15] allows us to explore existing or new processes and pathways, identifying latent threats before they lead to harm or evaluating ease of use of checklists and preparing for the use of new equipment or facilities. It may be carried out “in situ” (at the point of care) or in simulation facilities, depending on the circumstances.

  • Simulation-based education and training may bridge gaps in knowledge, skills and attitudes and focus on technical abilities, application of drills, non-technical skills and/or team performance [16, 17].

  • Debriefing is an inherent element of simulation-based education and training [18]. It consists of facilitated discussions guiding participants to reflect on simulated experiences. Debriefing conversations following real events in healthcare are referred to as clinical debriefing [19, 20]. This is a guided meeting during which teams discuss, interpret and learn from recent events.

Any intervention for change should be evaluated with due consideration to outcome, process and balancing measures [6].

How should we share the learning?

Whilst following the above steps, learning can be derived from each stage of the framework as well as its entirety, i.e. from the key event, stakeholder analysis, greater understanding of the system through the use of improvement techniques, changes carried out and their evaluation.

This learning must be fed back to the teams and stakeholders involved as well as disseminated to the wider departments and organisation where appropriate, including patient safety teams. This might translate into organisational change, as lessons learned in the planning and delivery of the simulation intervention are adapted to different environments. Such interventions carry a risk of exacerbating the second victim phenomenon. It is therefore paramount to ensure the psychological safety of all individuals and teams involved during the trigger event [21].

Discussion

It is rare that expertise in simulation and QI are available simultaneously. However, organisations are encouraged to integrate simulation-based methodologies into their safety management and quality improvement infrastructure, as well as identify opportunities for collaboration between safety management groups, quality improvement teams and education leads [22]. This framework supports all these teams in identifying events that can lead to the development of learning opportunities through simulation-based practice.

When simulation is used with a focus on improving healthcare processes and outcomes, it can be referred to as translational simulation [23]. Simulation for improvement can be classified as either proactive or reactive: the former includes its use for induction and training of new staff, prior to the introduction of new processes or innovations, for system redesign, or as part of routine system testing. Reactive simulation interventions comprise those following challenging situations with positive outcomes, identification of system weaknesses, near misses or critical events. Although the framework to guide simulation interventions following key events in healthcare focuses on the design of reactive simulation interventions, the principles described can also be applied to proactive simulation.

Whilst we have developed this guidance aiming to provide a practical process, we acknowledge that it might not be universally applicable due to local infrastructure or other relevant characteristics. Any comments on its usefulness, as well as any feedback on challenges to implementation or suggestions for its improvement, are welcome via the corresponding author.

Conclusion

This guidance introduces applicable quality improvement principles, considers how simulation-based methodologies could be most beneficial in each context and presents a new way to combine QI and simulation approaches synergistically. Furthermore, it aligns with contemporary socio-technical models in healthcare, which emphasise the role of clinical teams in designing adaptation and change for improvement [10]. The psychology of change framework also highlights the importance of activating clinicians’ agency as a key element to advancing and sustaining collaborative improvement [5]. We believe that this guidance is a novel approach which will be of benefit to health and care teams preparing for, or responding to, adverse events, as well as promoting the concept of learning from everyday work.

Access to the full framework may be obtained via HEIW, ASPiH and SESAM websites. It can be downloaded from https://heiw.nhs.wales/files/improving-quality-through-simulation-framework/.

Availability of data and materials

Data sharing not applicable to this article as no datasets were generated or analysed during the current study.

Abbreviations

ASPiH:

Association for Simulation Practice in Healthcare

HEIW:

Health Education and Improvement Wales

NHS:

National Health Service, UK

PDSA:

Plan-Do-Study-Act

QI:

Quality improvement

SESAM:

Society for Simulation in Europe

SEIPS:

Systems Engineering Initiative for Patient Safety

References

  1. Anderson A, IHI psychology of change framework to advance and sustain, Hawker C, Jones B, Cook SC, Mitra S, Hoole A, Bartholomew B, Diaz-Navarro C. Developing an All-Wales definition of simulation-based education. Int J Healthc Simul. 2022;2(1):A40–1.

    Google Scholar 

  2. McGaghie WC, Draycott TJ, Dunn WF, Lopez CM, Stefanidis D. Evaluating the impact of simulation on translational patient outcomes. Simul Healthc. 2011;6(7):S42–7.

    Article  PubMed  PubMed Central  Google Scholar 

  3. Brazil V, Purdy EI, Bajaj K. Connecting simulation and quality improvement: how can healthcare simulation really improve patient care? BMJ Qual Saf. 2019;28(11):862–5.

    Article  PubMed  Google Scholar 

  4. The Deming System of Profound Knowledge® (SoPK). The W. Edwards Deming Institute. Available from: https://deming.org/explore/sopk/. Cited 2023 Mar 27

  5. Langley GJ, Moen RD, Nolan KM, Nolan TW, Norman CL, Provost LP. The improvement guide: a practical approach to enhancing organizational performance. Hoboken: Wiley; 2009.

  6. Institute for Healthcare Improvement (2022) Plan, Do Study Act Worksheet. Boston, Institute for Healthcare Improvement. Available from www.ihi.org. Cited 2023 Mar 27

  7. Hilton K, Anderson A. IHI psychology of change framework to advance and sustain improvement. Institute for Healthcare Improvement. 2018.

  8. Nickson CP, Petrosoniak A, Barwick S, Brazil V. Translational simulation: from description to action. Adv Simul. 2021;6:1–1.

    Article  Google Scholar 

  9. Hollnagel E, Wears RL, Braithwaite J. From Safety-I to Safety-II: a white paper. The resilient health care net. Australia: Published simultaneously by the University of Southern Denmark, University of Florida, USA, and Macquarie University; 2015.

    Google Scholar 

  10. Carayon P, Wooldridge A, Hoonakker P, Hundt AS, Kelly MM. SEIPS 3.0: human-centered design of the patient journey for patient safety. Appl Ergonom. 2020;84:103033.

    Article  Google Scholar 

  11. Braithwaite J. Changing how we think about healthcare improvement. BMJ. 2018;17:361.

    Google Scholar 

  12. Barach P, Johnson JK. Understanding the complexity of redesigning care around the clinical microsystem. BMJ Qual Saf. 2006;15:i10–6.

    Article  Google Scholar 

  13. Berwick DM. A primer on leading the improvement of systems. BMJ. 1996;312(7031):619–22.

    Article  PubMed  PubMed Central  Google Scholar 

  14. Hamstra SJ, Brydges R, Hatala R, Zendejas B, Cook DA. Reconsidering fidelity in simulation-based training. Acad Med. 2014;89(3):387–92.

    Article  PubMed  Google Scholar 

  15. Colman N, Doughty C, Arnold J, Stone K, Reid J, Dalpiaz A, Hebbar KB. Simulation-based clinical systems testing for healthcare spaces: from intake through implementation. Adv Simul. 2019;4:1–9.

    Article  Google Scholar 

  16. Alanazi AA, Nicholson N, Thomas S. The use of simulation training to improve knowledge, skills, and confidence among healthcare students: a systematic review. Int J Allied Health Sci Pract. 2017;15(3):2.

    Google Scholar 

  17. Gjeraa K, Møller TP, Østergaard D. Efficacy of simulation-based trauma team training of non-technical skills. A systematic review. Acta Anaesthesiologica Scandinavica. 2014;58(7):775–87.

    Article  PubMed  Google Scholar 

  18. Sawyer T, Eppich W, Brett-Fleegler M, Grant V, Cheng A. More than one way to debrief: a critical review of healthcare simulation debriefing methods. Simul Healthc. 2016;11(3):209–17.

    Article  PubMed  Google Scholar 

  19. Diaz-Navarro C, Leon-Castelao E, Hadfield A, Pierce S, Szyld D. Clinical debriefing: TALK© to learn and improve together in healthcare environments. Trends Anaesth Crit Care. 2021;1(40):4–8.

    Article  Google Scholar 

  20. Meguerdichian M, Bajaj K, Ivanhoe R, Lin Y, Sloma A, de Roche A, Altonen B, Bentley S, Cheng A, Walker K. Impact of the PEARLS healthcare debriefing cognitive aid on facilitator cognitive load, workload, and debriefing quality: a pilot study. Adv Simul. 2022;7(1):1–9.

    Article  Google Scholar 

  21. Quillivan RR, Burlison JD, Browne EK, Scott SD, Hoffman JM. Patient safety culture and the second victim phenomenon: connecting culture to staff distress in nurses. Joint Commission J Qual Patient Safety. 2016;42(8):377–AP2.

    Article  Google Scholar 

  22. Purva M, Nicklin J. ASPiH standards for simulation-based education: process of consultation, design and implementation. BMJ Simul Technol Enhanced Learn. 2018;4(3):117.

    Article  Google Scholar 

  23. Brazil V. Translational simulation: not ‘where?’ but ‘why?’ A functional view of in situ simulation. Adv Simul. 2017;2(1):1–5.

    Article  Google Scholar 

Download references

Acknowledgements

We are grateful to the NHS Wales task and finish group for their early contribution to this work and to the voluntary peer reviewers of the “Improving quality through simulation” framework: Dominique Bird, Victoria Brazil, Pier Luigi Ingrassia, Esther Leon-Castelao, Sigrun Qvindesland, Anton Saayman and Demian Szyld.

Funding

No grant or other funding has been received to support this work. Funding for Open Access publication has been provided by Health Education and Improvement Wales.

Author information

Authors and Affiliations

Authors

Contributions

All authors have contributed to the production of this work, and all authors have read and approved the final version of the manuscript.

Corresponding author

Correspondence to Cristina Diaz-Navarro.

Ethics declarations

Ethics approval and consent to participate

Ethical approval was not required for this work, as it did not involve human participants, human data or human tissue. The manuscript does not include any personal information requiring consent.

Competing interests

The authors declare that they have no competing interests. David Grant is on the International Advisory Group for the journal.

Additional information

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated in a credit line to the data.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Diaz-Navarro, C., Jones, B., Pugh, G. et al. Improving quality through simulation; developing guidance to design simulation interventions following key events in healthcare. Adv Simul 9, 30 (2024). https://doi.org/10.1186/s41077-024-00300-8

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1186/s41077-024-00300-8

Keywords