Skip to main content
Download PDF

Simulation as a toolkit—understanding the perils of blood transfusion in a complex health care environment

Advances in Simulation volume 1, Article number: 32 (2016) Cite this article

Abstract

Background

Administration of blood is a complex process requiring vigilance and effective teamwork. Despite strict policies and training on blood administration, errors still occur and can lead to mistransfusion with adverse patient outcomes. We used an in situ simulated scenario within an operating room (OR) to identify weaknesses in the current process and hazards that could contribute to mistransfusion.

Methods

A process checklist of critical steps of safe transfusion was developed based on a large academic centre’s internal hospital policy and practice. Ten standardized operating room scenarios were conducted involving management of postoperative bleeding. Scenarios lasted 20 min or until blood transfusion was started. Debriefing followed immediately. Video recordings were reviewed, scored, and evaluated for team performance. Latent safety threats were identified. Focus groups further helped to identify rationale for decisions made. Participants completed questionnaires to evaluate the exercise.

Results

Forty-three experienced OR professionals participated. Of the 19 steps identified as essential for the safe administration of blood components, the median number of steps correctly completed per team was 11. The largest number of errors occurred when different team members interacted and during the immediate pre-transfusion check. We report that this type of learning immediately increased participants’ self-reported ability to perform in a team (90%) and to improve clinical care (88%).

Conclusions

In situ simulation is valuable in identifying common susceptibilities in blood administration error in a complex healthcare organization. Administrators and clinicians may wish to use simulation as an opportunity for system improvement in the delivery of quality care.

Background

Errors resulting in incompatible transfusions at hospitals have been estimated to occur at a rate of 1 in 38,000–160,000 units transfused [1, 2]. Transfusion errors can have severe consequences for patients including death. A number of factors have been reported to be responsible for transfusion errors including multiple team members involved in distribution of blood components, environmental issues specific to the location of transfusion, overall clinical acuity/distractibility of team members, patient identification issues, and not using a standard checklist [3]. Despite these identified contributors, the majority of transfusion errors are thought to occur immediately prior to point of contact with the patient [4–7]. Other factors which can contribute may depend on local environment or institutional practices [3–6, 8–10]. In order to prevent transfusion errors, most institutions have a pre-transfusion checklist. The compliance of bedside practitioners with this checklist has been shown to be poor and even if done well may not prevent mistransfusion [3].

Communication and teamwork failures underlie the vast majority of adverse events in complex healthcare environments and may be unique to the clinical area itself [11–15]. It is therefore critical to understand the failures within and across teams in addressing errors in particular clinical settings. Interdisciplinary team members may have differing training, experience, knowledge, and value systems [16, 17]. Additionally, members of an interdisciplinary team may not have had the opportunity to train together to manage a crisis situation.

Simulation-based training (SBT) involves immersion of trainees and staff in a “realistic” yet safe environment. SBT has been shown to improve both individual skills and team behavior across a variety clinical disciplines [18–22].

Simulation-based research has also been used to identify safety threats and latent hazards in several clinical environments [23–26]. In situ simulation is increasingly the modality of choice to identify these gaps [27]. It allows teams to practice skills and problem-solve in their actual clinical environments as well as identify contextually specific environmental and/or system threats, also known as latent hazards [26, 27].

Although several studies have incorporated blood transfusion into their simulation scenarios, very few have involved actual interprofessional teams; none have used in situ simulation specifically to improve policy and process for the urgent administration of blood in the operating room (OR) [10, 28–30].

In this exploratory study, we report the use of in situ high fidelity simulation to (1) assess adherence to blood transfusion policy, (2) identify common safety threats when administering blood products in the operating room, and (3) assess the impact of the simulation on participants’ attitudes and beliefs.

Methods

This study was a collaborative project between the Allan Waters Family Simulation Centre, the Perioperative Services and Transfusion Medicine (TM) Services at St. Michael’s Hospital, Toronto. St. Michael’s Hospital is an academic tertiary care trauma centre located in Toronto, Ontario. The OR environment was chosen as the locale for this study as this was the actual environment in our institution in which a serious transfusion error had been previously reported. The study was reviewed and approved by the institutional Ethics Review Board at St. Michael’s Hospital; informed consent was obtained from all participants.

A simulated scenario involving a postoperative bleed from a recent renal transplant patient was developed and tested. A patient hospital identification (ID) number, hospital electronic record, as well as appropriate blood component labels were generated by the TM laboratory. Bedsides, clinicians used the current hospital Patient Blood Transfusion Record which included a 5-point verification checklist used at the bedside immediately prior to transfusion. The patient hospital card, ID bracelet, hospital chart, and simulated blood components were created by the simulation team. A simulated surgical patient was created using Wireless 3G Sim Man (Laerdal, Norway) with a modified Trauma-Man torso. Changes in vital signs and clinical status could thereby be assessed and acted upon by the OR team in real-time.

Ten interprofessional OR teams including surgical assists, scrub nurses, anesthetists, respiratory therapists, and patient support assistants (PSAs) were invited to participate in the simulation. Each team consisted of one anaesthesiologist and two surgical nurses who worked alongside confederate surgeons (who were familiar with the script and scenario detail). PSAs were also recruited, since in our facility, they are the individuals who retrieve blood components from transfusion medicine. All participants had received training on the new blood transfusion hospital medicine policy by the nurse educator for both perioperative and transfusion medicine departments in the 4 months preceding the study. This included a didactic in-class session, review of the preoperative transfusion policy, and new transfusion medicine checklist. The medical laboratory technologists (MLTs) were aware of the simulated patient and the simulation exercise but were instructed to treat any blood requests as closely as possible to a real situation. All teams were debriefed by the authors (LP, DMC) following the scenarios using a standardized framework with advocacy inquiry technique [30]. All participants were subsequently invited to focus groups to explore the value of the experience and as a surrogate measure of impact.

The scenarios ran until the first simulated red blood component (RBC) was spiked (physically attached to the intravenous system). Simulations were video-recorded including the use of an OR video feed and GoPro, Inc. technology for the PSAs and porters. The time from ordering of blood products to hand-over of blood products to the OR team was recorded.

A team of local experts (Educators, Directors and Managers of TM + Perioperative Services) identified 19 chronological steps required for overall adherence to the hospital policy in the ordering and administration of blood components in the perioperative environment. Adherence to overall blood transfusion policy was scored in a binary fashion (yes or no), with the maximum score for each team to obtain was 19. The overall steps were divided into four categories in order to facilitate error detection: (1) ordering blood components (four steps), (2) obtaining blood components from TM (four steps), (3) transfer of blood components to the OR staff (two steps), and (4) administration of blood components (nine steps) (Fig. 1). The immediate verification checklist used by bedside clinicians was included in this last category (steps 14–18). Events identified as latent hazards were placed into the following categories: knowledge gaps, environmental hazards, communication failures, and system issues as per a previously reported matrix [26]. The videos were reviewed by two members of the research team (DMC,MC) by consensus, in order to identify steps that were completed and/or missed by each team and to classify latent hazards.

Fig. 1
figure 1

Simulated operating room setup

Full size image

Statistical analysis

Two trained independent raters (PH, FA) reviewed and evaluated performance using two standardized instruments: Anesthesiologist Nontechnical Skills (ANTS) [31] and Clinical Teamwork Scale (CTS) [32]. The ANTS tool is used to address leadership skills within a team, while the CTS represents overall team performance over ten domains, and has been validated in a variety of complex interprofessional health teams. The median and mean scores were calculated for both the ANTS and CTS scales.

Focus groups were conducted 3–6 months following the SBT. A sub-group of participants were probed to discuss their experiences of the SBT, most effective or helpful parts of the SBT, the impact of the SBT on their communication in an interdisciplinary team, and on their attitudes toward teamwork in a crisis situation. Focus groups were audiotaped and transcribed.

Participants subsequently completed the Changes in Inter-professional Attitude Questionnaire (CIAQ) immediately after the simulation and 3 months later to further estimate the impact and retention of the exercise.

The CIAQ questionnaire includes three categories: partnership and shared decision-making, cooperation, and coordination. CIAQ scores were averaged across participants in each of the three categories. The 5-point Likert type responses were averaged to 3-point Likert: (i) agree more than before, (ii) my attitude has not changed, and (iii) disagree more than before. Participants’ responses were summed for each of the four categories. The median and mean scores were calculated for ANTS and CTS scales.

Qualitative data were analyzed using an inductive content analysis [33, 34]. Data were divided into meaning units on the basis of the aim of the study. The meaning units were grouped into codes. Codes with common descriptive content were grouped into categories. Next, the numbers of categories were reduced by combining similar headings into broader categories or themes. Two main categories were generated to provide an overall description of the content of the qualitative data. Research rigor was achieved according to the four criteria of credibility, dependability, conformability, and transferability to ensure trustworthiness [35].

Results

Ten perioperative teams each composed of one anaesthesiologist (n = 9), two nurses (n = 17), two confederate surgeons, one technical assistant (TA) (n = 4), or patient support assistant (PSA) (n = 9) completed the SBT over 2 days. Respiratory therapists (n = 2) were also included as requested by teams. The participants had a wide range of experiences in the OR, but the majority had more than 5 years of experience on staff (median 11 years, range 1–44). A subgroup of perioperative participants (five OR nurses, four PSA, two surgical assistants, three anesthesia fellows) in addition to four transfusion medicine staff (one transfusion safety nurse and three medical laboratory technologists) participated in the focus groups.

The median score for correctly following the 19 steps was 11.5 (range 8–13). Only two teams were able to complete 68% of the steps in the blood transfusion (13/19). Eight of 19 steps were typically not performed by the majority of the OR teams, including two steps (steps 17 and 18) which were clearly noted on the Verification Checklist which the teams used in the OR (Table 1). The average time to obtain simulated blood components from the transfusion medicine laboratory was 8.4 min (SD = 1.2 mins).

Table 1 Aggregate number of steps followed by all teams
Full size table

The largest number of error occurred during handover of the blood components between team members in several environments and when checks were to be repeated (Table 1). There was inconsistent communication between the following teams: PSA and TM staff, PSA and OR nursing staff, and finally OR nurses with anesthetists.

Knowledge and communication gaps were common and included a lack of clarity by PSAs in communicating to TM why blood was ordered and not specifying which OR the patient was in. Other knowledge gaps included poor understanding from all team members regarding why blood components needed to be checked by the OR desk prior to OR arrival. Environmental hazards included OR drapes which were consistently covering the ID band. System issues identified included variant location of the patient consent form for blood transfusion, removal of patient ID card from the OR to stamp requisitions, and delay in retrieval due to elevator wait times (the location of TM lab is on a different floor in our hospital, thereby delaying blood retrieval). Finally, an error relating to communication occurred when the nurse read out loud to the anesthetist; the patient number assigned to the blood product failed to identify a mismatched hospital number in 5 out of 10 scenarios.

Other items of concern discovered during the scenario included retrieval of real un-crossmatched-RBC units from transfusion medicine which were brought into the OR room. In this case, the PSA team insisted on “un-crossmatched” RBC instead of accepting only a “cross-matched” simulated RBC. This highlights the fundamental misunderstanding by the team of when un-crossmatched RBC should be used: un-crossmatched RBCs are to be used only when crossmatched RBCs are not immediately available. Since simulated un-crossmatched RBC was not prepared for this scenario an actual un-crossmatched RBC was released. Secondly, red blood cell units assigned for different patients were brought into the same OR on two occasions, which, is against our institutional policy, and, increases the risk of transfusion error. Finally, the patient ID armband was hidden under OR drapes (physical error) and was unused by eight of the ten teams for confirming patient identification. Instead, the team relied on transfusion record, patient chart, etc., which leave and come back to the OR and should not be used for identification pre-transfusion.

The majority of participants perceived partnership, cooperation, and coordination as the strongest elements among their team members during the SBT (Table 2). CAIQ results demonstrated a strong impression that this type of exercise immediately increased participants’ ability to perform in a team, improved clinical care for their patients, and improved role awareness for the participants (Table 3). A chi-square test of independence was calculated comparing AITCS and CAIQ immediately and 3 months post-SBT. There was no significant difference between the immediate and 3 months post-SBT questionnaire results (AITCS: X 2(1) = 0.99, p < .05), (CIAQ: X 2(1) = 0.98, p < .05).

Table 2 Assessment of Inter-professional Team Collaboration Scale (AITCS) (n = 41)
Full size table
Table 3 Changes in Interprofessional Attitudes Questionnaire (CIAQ) (n = 41)
Full size table

The mean overall score for the ANTS was 2.7 (SD = 0.8, range 1.2 to 3.8, max 4). The overall score for CTS was M = 5.1 (SD = 1.6, range 3 to 7) with 0 = Unacceptable, 1,2,3 = Poor, 4,5,6 = Average, 7,8,9 = Good, and 10 = Perfect. The inter-rater reliability for ANTS and CTS were r = 0.39 and r = 0.30, respectively, indicating poor inter-rater reliability. Individual raters’ score for ANTS and CTS are summarized and presented in Table 4.

Table 4 CTS and ANTS overall and subscale scores (n = 10)
Full size table

Focus group results

Participants valued the simulated scenarios as a unique educational experience (Table 5). Participants discussed and compared the SBT relative to a real-life operation. Three categories were identified which characterized SBT as valuable in that it was (1) a controlled activity, (2) a focused learning activity, and (3) allowed conscious learning (Appendix 1).

There was a strong indication that SBT highlights the role of each of the team members in an urgent blood transfusion scenario which may otherwise not be clear. Furthermore, participants’ overall perception of the SBT was that this exercise can be used as an assessment and a learning tool (Appendix 2). One participant thought it should be integrated into an orientation package for new staff members.

Discussion

This study revealed that in situ simulation is valuable in identifying potential causes of error for infrequent but high-risk procedures in a complex healthcare environment. Approximately 40% of the overall process steps required for adherence to policy in the administration of blood components were missed; all of which could potentially contribute to adverse events. Even the printed five-step verification checklist available to teams and required immediately prior to transfusion was performed only 60% of the time, a number which is similar to previously reported studies [36]. Significant high-risk errors occurred, even though the participants had just been trained on a specific updated blood transfusion policy. Furthermore, the majority of the participants rated this scenario as less stressful than an actual case, presumably underestimating the number of errors that could occur in a real clinical situation. Our study highlights the frequency with which steps are missed and are likely underreported by clinical teams in real scenarios. Redundancies in the process steps and the two person-check immediately prior to transfusion likely prevent more mistransfusions from occurring.

We identified that the majority of the errors occurred during handoff of the blood components from one team to another and during the period immediately before administration. The latter observation has been reported previously [3]. The debriefings and focus groups identified why steps were missed. For example, one PSA did not stop at the main OR desk for another “check” of the blood components because he understood the request from the surgeon to be “urgent”. This “missed step” could have prevented another patient’s blood components from being brought into the same OR. Integration of SBT may therefore be useful in targeting problematic areas for particular teams in understanding and ultimately adhering to important policy steps. Even in our simulated scenarios, unordered components and components destined for other patients were brought into the OR despite an existing policy that prohibited this practice. We used this simulation exercise as an educational opportunity to reemphasize to staff why this is risky practice and to introduce tools to prevent this in the future.

Our study is the first report to use an interprofessional simulated crisis scenario to examine the entire process of obtaining and administering blood to a patient in the OR. Other studies using simulation in blood transfusion were limited in their focus to only one or two disciplines [36–39], involved obstetrical teams investigated a single confounding factor to transfusion error such as distraction [30], or looked only at the usability of components [40].

In our in situ simulated scenarios, the participants valued the educational experience (Table 3). Our teams reported that simulation-based OR team training positively could improve teamwork, increase awareness of colleagues’ roles, and could be a valuable training exercise in critical care environments. This impression persisted even 3 months after the simulation exercise potentially that this educational exercise had a lasting impact.

Interestingly, team performance and team communication as assessed by two independent raters were marked as poor. This is in direct contrast to the self-reported scales of performance by participants. The discrepancy between observed measures of leadership and teamwork and self-assessment has been reported previously in the simulation literature [19]. Interestingly, both video reviewers identified similar deficits in role responsibility (CTS scale) and decision-making (ANTS) (Table 4). Previous reports of interruption and distraction were not specifically examined in our simulations and could further contribute to mistransfussion events [36].

Focus group data suggest that SBT is a controlled, focused, and conscious learning activity that can be used as a combined educational and quality improvement tool. Participants perceived that being open to scrutiny and the potential for embarrassment during the exercise stimulated learning. Finally, our SBT helped participants recognize and appreciate each interdisciplinary team members’ roles and responsibilities in a crisis situation.

It is possible that we underestimated the hazards which could occur in real life, since our study was carried out 2 months following implementation of a new blood transfusion policy. Many of the participants noted that the perceived stress level of the simulated environment was relatively low and that more distractions can occur in a real life operating room which interferes with safe blood transfusion practice.

This study has several limitations. First, the hazards for unsafe blood transfusion practice identified in our “simulated OR” may not translate directly to an actual OR but clearly points to opportunities for targeted education and reflection. We could not assess the performance of all the perioperative team members in our institution, so it is possible that the other teams may have performed better. However, the consistency of the errors from the teams we observed would suggest otherwise. Furthermore, we were unable to have real surgeons participate in the exercise, and their presence may have affected team performance and procedural vigilance. The 19-point Process Checklist we used was specific to our institution and our preoperative team; other institutions may have a different process for obtaining and administering blood products.

Team performance was rated as poor using two different team assessment tools (ANTS and CTS). However, evidence shows that when teamwork and communication skills are learned and practiced, they can lead to improvements in clinical care [41]. Identification of risk and latent hazards in a policy or process provides an opportunity for performance assessment and in our opinion “targeted” education.

Similar studies could also be conducted in other high stakes environment such as intensive care unit or the emergency room, since these environments may have unique stressors and hazards. SBT could be used to assess performance following implementation of new technologies aimed at reducing mistransfusion such as electronic positive patient identification by barcoding. Evidence shows that new computer-based technology is available and may mitigate blood transfusion errors [42]. Arriaga et al. reported the use of novel surgical-crisis checklists in order to improve adherence to gold-standard lifesaving processes [22]. These were mostly clinical algorithms related to unexpected patient deteriorations. It is unclear at this time if readily available checklists that supplement the verification checklists or other cognitive aids could improve adherence to blood transfusion policy in the OR environment, but warrants further study.

Whether the frequency or severity of blood transfusion error decrease over time as a result of the training remains to be seen and may in fact be difficult to assess. However, as a direct result of this initiative, we will be introducing several educational and operational initiatives to minimize the risk of blood component transfusion error. Firstly, other safety initiatives in the hospital (e.g., ER trauma training) will incorporate blood transfusion error analysis. Secondly, scripted communicated guides will be developed and implemented for PSAs to facilitate clear communication among transfusion medicine members and OR staff. Finally, patient ID bands will now be placed on more accessible areas of the patient to facilitate ID band verification prior to spiking of blood components. Our organization is also now considering purchasing frequency devices to ensure safety.

Conclusions

In summary, in situ simulation is a useful tool in understanding adherence to policy, latent safety hazards in complex hospital environments such as the OR. Clinical staff may not be adhering to existing failures between team members outside the immediate circle of care of the patient, environmental hazards in the OR, knowledge gaps around existing policy recommendations, and system issues unique to hospital layout. Organizations may be particularly interested in in situ simulation as a strategy to identify and amend gaps in existing policy and engage front-line workers in patient safety initiatives.

Abbreviations

ANTS:

Anesthesiologists Nontechnical Skills

CIAQ:

Changes in Inter-professional Attitude Questionnaire

CTS:

Clinical Teamwork Scale

ID:

Patient hospital identification number

MLTs:

Medical laboratory technologists

OR:

Operating room

PSAs:

Patient support assistants

RBC:

Red blood component

SBT:

Simulation-based training

TA:

Technical assistant

TM:

Transfusion medicine

TR:

Transfusion record

References

  1. Transfusion Transmitted Injuries Surveillance System (TTISS)—Public Health agency of Canada. http://www.phac-aspc.gc.ca/hcai-iamss/ttiss-ssit. Accessed 5 Nov 2015

  2. Linden JV, Wagner K, Voytovich AE, Sheehan J. Transfusion errors in New York State: an anaylsis of 10 years’ experience. Transfusion. 2000;40(10):1207–13.

    Article  CAS  PubMed  Google Scholar 

  3. Murphy MF, Casbard AC, Ballard S, Shulman IA, Heddle N, Aubuchon JP, Wendel S, Thomson A, Hervig T, Downes K, Carey PM, Dzik WH. BEST Research Collaborative. Prevention of bedside errors in transfusion medicine (PROBE‐TM) study: a cluster‐randomized, matched‐paired clinical areas trial of a simple intervention to reduce errors in the pretransfusion bedside check. Transfusion. 2007;47(5):771–80.

    Article  PubMed  Google Scholar 

  4. Beyea SC, Majewski C. Blood transfusion in the OR—are you practicing safely? AORN J. 2003;78(6):1007–10.

    Article  PubMed  Google Scholar 

  5. Lundy D, Laspina S, Kaplan H, Rabin Fastman B, Lawlor E. Seven hundred and fifty‐nine (759) chances to learn: a 3‐year pilot project to analyse transfusion‐related near‐miss events in the Republic of Ireland. Vox Sang. 2007;92(3):233–41.

    Article  CAS  PubMed  Google Scholar 

  6. Maskens C, Downie H, Wendt A, Lima A, Merkley L, Lin Y, Callum J. Hospital‐based transfusion error tracking from 2005 to 2010: identifying the key errors threatening patient transfusion safety. Transfusion. 2014;54(1):66–73.

    Article  PubMed  Google Scholar 

  7. Fastman BR, Kaplan HS. Errors in transfusion medicine: have we learned our lesson? Mt Sinai J Med. 2011;78:854–64.

    Article  PubMed  Google Scholar 

  8. Burrows JM, Callum JL, Belo S, Etchells E, Leeksma A. Variable pre-transfusion patient identification practices exist in the perioperative setting. Can J Anesth. 2009;56(12):901–7.

    Article  PubMed  Google Scholar 

  9. Elhence P, Veena S, Sharma RK, Chaudhary RK. Root cause analysis of transfusion error: identifying causes to implement changes. Transfusion. 2010;50(12pt2):2772–7.

    Article  PubMed  Google Scholar 

  10. Hogg G, Pirie ES, Ker J. The use of simulated learning to promote safe blood transfusion practice. Nurse Educ Pract. 2006;6(4):214–23.

    Article  PubMed  Google Scholar 

  11. Patronella G, Latocca R, De Vito G, D’Orso MI, Riva MA, Cesana G. Sentinel events for work-related stress in hospital and their monitoring in the decade 2001–2010. G Ital Med Lav Ergon . 2011;33(3 Suppl):3269.

    Google Scholar 

  12. Leonard M, Graham S, Bonacum D. The human factor: the critical importance of effective teamwork and communication in providing safe care. Qual Saf Health Care. 2004;13 Suppl 1:i85–90.

    Article  PubMed  PubMed Central  Google Scholar 

  13. Yule P, Cooper RP. Express: a Web-based technology to support human and computational experimentation. Behav Res Methods Instrum Comput. 2003;35(4):605–13.

    Article  PubMed  Google Scholar 

  14. Firth-Cozens J. Cultures for improving patient safety through learning: the role of teamwork. Qual Health Care. 2001;10(Suppl I):ii26–31.

    PubMed  PubMed Central  Google Scholar 

  15. Baker GR, Norton PG, Flintoft V, Blais R, Brown A, Cox J, Etchells E, Ghali WA, Herbert P, Majumdar SR, O’Beirne M, Palacios-Derflingher L, Reid RJ, Sheps S, Tamblyn R. The Canadian Adverse Events Study: the incidence of adverse events among hospital patients in Canada. Can Med Assoc J. 2004;170(11):1678–86.

    Article  Google Scholar 

  16. Kohn LT, Corrigan JM, Donaldson MS, editors. To err is human: building a safer health system. National Academies Press; 2000.

  17. Murray WB, Foster PA. Crisis resource management among strangers: principles of organizing a multidisciplinary group for crisis resource management. J Clin Anesth. 2000;12(8):633–8.

    Article  CAS  PubMed  Google Scholar 

  18. Salas E, Paige JT, Rosen MA. Creating new realities in healthcare: the status of simulation-based training as a patient safety improvement strategy. BMJ Qual Saf. 2013;22(6):449–52.

    Article  PubMed  Google Scholar 

  19. Boet S, Bould MD, Fung L, Qosa H, Perrier L, Tavares W, Reeves S, Tricco AC. Transfer of learning and patient outcome in simulated crisis resource management: a systematic review. Can J Aneasth. 2014;61(6):571–82.

    Article  Google Scholar 

  20. Shapiro MJ, Morey JC, Small SD, Langford V, Kaylor CJ, Jagminas L, Suner S, Sailsbury ML, Simon R, Jay GD. Simulation based teamwork training for emergency department staff: does it improve clinical team performance when added to an existing didactic teamwork curriculum? Qual Saf Health Care. 2004;13:417–21.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  21. Cook DA, Hatala R, Brydges R, Zendejas B, Szostek JH, Wang AT, Erwin PJ, Hamstra SJ. Technology-enhanced simulation for health professions education. A systematic review and meta-analysis. JAMA. 2011;306(9):978–88.

    Article  CAS  PubMed  Google Scholar 

  22. Arriaga AF, Bader AM, Wong JM, Lipsitz SR, Berry WR, Ziewacz JE, Hepner DL, Boorman DJ, Pozner CN, Smink DS, Gawande AA. Simulation-based trial of surgical-crisis checklists. N Engl J Med. 2013;368:246–53.

    Article  CAS  PubMed  Google Scholar 

  23. Nishisaki A, Keren R, Nadkami V. Does simulation improve patient safety? Self-efficacy, competence, operational performance, and patient safety. Anesthesiol Clin. 2007;25(2):225–36.

    Article  PubMed  Google Scholar 

  24. Geis GL, Pio B, Pendergrass TL, Moyer MR, Patterson MD. Simulation to assess the safety of new healthcare teams and new facilities. Sim Healthcare. 2011;6:125–33.

    Article  Google Scholar 

  25. Kobayashi L, Overly FL, Fairbanks RJ, Patterson M, Kaji AH, Bruno EC, Kirchhoff MA, Strother CG, Sucova A, Wears RL. Advanced medical simulation applications for emergency medicine microsystems evaluation and training. Acad Emerg Med. 2008;15:1058–70.

    Article  PubMed  Google Scholar 

  26. Patterson MD, Geis GL, Falcone RA, LeMaster T, Wears RL. In situ simulation: detection of safety threats and teamwork training in a high risk emergency department. BMJ Qual Saf. 2013;22:468–77.

    Article  PubMed  Google Scholar 

  27. Cheng A, Grant V, Auerbach M. Using simulation to improve patient safety dawn of a new era. JAMA Pediatr. 2005;169:5.

    Google Scholar 

  28. Green R, Curry N. Simulation training improves clinical knowledge of major haemorrhage management in foundation year doctors. Transfus Med. 2014;24(6):379–84.

    Article  CAS  PubMed  Google Scholar 

  29. Venture KM, Barry JS, Davis D, Baiamonte VL, Wentworth AC, Pietras M, Coughlin L, Barley G. Using in situ simulation to evaluate operational readiness of a children’s hospital-based obstetrics unit. Simul Healthc. 2014;9(2):102–11.

    Article  Google Scholar 

  30. Cheng A, Eppich W, Grant V, Sherbino J, Zendejas B, Cook DA. Debriefing for technology-enhanced simulation: a systematic review and meta-analysis. Med Educ. 2014;48(7):657–66.

  31. Fletcher G, Flin R, McGeorge P, Glavin R, Maran N, Patey R. Anaesthetists’ Non-Technical Skills (ANTS): evaluation of a behavioural marker system. Br J Anaesth. 2003;90:580–8.

    Article  CAS  PubMed  Google Scholar 

  32. Guise JM, Deering SH, Kanki BG, Osterweil P, Li H, Mori M, Lowe NK. Validation of a tool to measure and promote clinical teamwork. Simul Healthc 2008; Winter;3(4):217–23.

  33. Berg BL. Qualitative research methods for the social sciences. Allyn and Bacon. 5th ed. Boston: Pearson; 2004.

  34. Graneheim UH, Lundman B. Qualitative content analysis in nursing research: concepts, procedures and measures to achieve trustworthiness. Nurse Educ Today. 2004;24(2):105–12.

    Article  CAS  PubMed  Google Scholar 

  35. Lincoln YS, Guba EG, editors. Qualitative Research Guidelines Project. Naturalistic Inquiry. Sage; 1985.

  36. Liu D, Grudgeiger T, Sanderson PM, Jenkins SA, Leane TA. Interruptions and blood transfusion checks: lessons from the simulated operating room. Anesth Analg. 2009;108:1.

    Article  Google Scholar 

  37. Morgan S, Rioux-Masse B, Oancea C, Cohn C, Harmon J Jr., Konia M. Simulation-based education for transfusion medicine. Transfusion. 2015;55(4):919–25.

  38. Hilton G, Daniels K, Goldhaber-Fiebert SN, Lipman S, Carvalho B, Butwick A. Checklists and multidisciplinary team performance during simulated obstetric hemorrhage. Int J Obstet Anesth. 2016;25:9–16.

    Article  CAS  PubMed  Google Scholar 

  39. Sellu DH, Davis RE, Vincent CA. Assessment of blood administration competencies using objective structures clinical examination. Transfus Med. 2012;22(6):409–17.

    Article  CAS  PubMed  Google Scholar 

  40. Anders S, Miller A, Joseph P, et al. Blood product positive patient identification: comparative simulation-based usability test of two commercial products. Transfusion. 2011;51(11):2311–8.

    Article  PubMed  Google Scholar 

  41. McCulloch P, Mishra A, Handa A, et al. The effects of aviation-style non-technical skills training on technical performance and outcome in the operating theatre. Qual Safe Health Care. 2009;18(2):109–15.

    Article  CAS  Google Scholar 

  42. Nuttall GA, Stubbs JR, Oliver Jr WC. Transfusion errors: causes, incidence, and strategies for prevention. Curr Opin Anesth. 2014;27(6):657–9.

    Article  Google Scholar 

Download references

Acknowledgements

We would like to acknowledge The Allen Waters Family Simulation centre and in particular the tremendous work of Nazarin Khadadoust, Roger Chow, and Kari White. Further, the efforts of Joyce Grandy were instrumental to making this happen. Finally, a huge thanks to Ms. Kathleen Hollamby for putting it all together.

Funding

This project was supported by the Quality Innovation Fund at St. Michael’s Hospital, 2013–2014.

Availability of data and materials

Study data and material can be made available upon authors’ request.

Authors’ contributions

DMC, LP, and PH conceived of the paper and participated in its design and coordination. DMC, MC, and LP ensured rigorous data collection and analysis and drafted the manuscript. KP participated in the study design and helped draft the manuscript. JL participated in the study design. FA and PH reviewed and scored the videotaped performances. All authors read and approved the final manuscript.

Authors’ information

Dr. Campbell is the Medical Director of the Allan Waters Family Simulation Centre and the Director of the Neonatal Intensive Care Unit & Deputy Chief Pediatrics at St. Michael’s Hospital. Dr. Campbell is cross-appointed at the Hospital for Sick Children and works as a staff neonatologist. He holds an academic rank as an Associate Professor, University of Toronto Department of Pediatrics.

Dr. Campbell’s two main areas of interest are clinical neonatology (nutrition and ventilation) and the use of simulation for neonatal resuscitation team-training.

Dr. Campbell’s clinical neonatal experience and simulation background have formed a large part of his academic career as an educator, administrator, and researcher. Dr. Campbell received simulation training at Stanford University at the Center for Advanced Perinatal Education (CAPE) and is the current simulation co-lead, at the University of Toronto’s Division of Neonatal-Perinatal medicine. This past year, he was appointed as an Associate Scientist at the Li Ka Shing Knowledge Institute at St. Michael’s Hospital for his work in simulation education and research. Dr. Campbell is a member of the Canadian Pediatric Society National Resuscitation Program (NRP) Executive Committee and Current Chair of the NRP Research Committee. Dr. Campbell has received international recognition for his work in simulation which has led to his election to the Board of Directors of the International Pediatric Simulation Society (IPSS).

Competing interests

The authors declare that they have no competing or conflicts of interest relevant to the manuscript submitted to Advances in Simulation and approve the manuscript for submission. We confirm that this manuscript has not been published elsewhere and is not under consideration by another journal.

Consent for publication

Informed consent was received from all participants involved in this study.

Ethics approval and consent to participate

This project received REB approval from the Research Ethics Board at St. Michael’s Hospital, Toronto, Ontario, Canada. REB# 13–337, February 7, 2014.

Author information

Authors and Affiliations

  1. St. Michael’s Hospital, Toronto, ON, Canada

    Douglas M. Campbell, Laya Poost-Foroosh, Katerina Pavenski, Maya Contreras, Jason Lee & Patricia Houston

  2. University of Toronto, Toronto, ON, Canada

    Douglas M. Campbell, Katerina Pavenski, Maya Contreras, Fahad Alam, Jason Lee & Patricia Houston

  3. Sunnybrook Health Sciences Centre, Toronto, ON, Canada

    Fahad Alam

  4. Department of Pediatrics, University of Toronto, St. Michael’s Hospital, 15-014CC, 30 Bond Street, Toronto, ON, M5B 1W8, Canada

    Douglas M. Campbell

Authors
  1. Douglas M. Campbell
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Laya Poost-Foroosh
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Katerina Pavenski
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Maya Contreras
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Fahad Alam
    View author publications

    You can also search for this author in PubMed Google Scholar

  6. Jason Lee
    View author publications

    You can also search for this author in PubMed Google Scholar

  7. Patricia Houston
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Douglas M. Campbell.

Appendices

Appendix 1: Focus group data

Comparison of SBT to an actual operating room event

Category 1: Controlled activity

Participants described SBT as a safe environment with no harmful consequences for patients; thus, the activity is less stressful than a real life occurrence; however, there is a different type of stress associated with participating in SBT.

“The PSA that was assigned to my team was like right there and in real life that would not happen… I would have to call for that PSA, even in a crisis situation; they wouldn't be kind of hovering in the background ready to go.”

Category 2: Focused learning

Participants described SBT as a learning experience with specific learning objective which distinguishes the activity from a real-life occurrence. Team members have fewer tasks relative to a similar real life scenario; as a result, there are fewer distractions which enable participants to focus on the learning objectives of the SBT.

“when you focus on one tiny aspect of your role, and in this aspect it was the delivery of the blood to the operating room, when you're just focused on that one thing and you find out that everyone has a different way of doing things,… so when you have one little tiny aspect and you look at how people deliver their care, it sort of again you know, hyper focuses on situation and how each person interprets their role and their job in that situation and so it highlights maybe problems or ways that we're doing that potentially could be problems.”

Category 3: Conscious learning

Participants described SBT as a conscious learning experience in terms of what they do and how they do it. Participants compared the SBT setting to a movie set where actors are being watched. One participant described being more alert because he anticipated that there would be an unexpected event in the scenario.

“I thought initially communication was fairly adequate. Actually, it might have been because it was under the Ambit of a witnessed exercise.”

Participants’ views of the SBT

Participants described SBT as both an assessment and a learning tool. Each of the categories with relevant interview excerpts is described below.

Category 1: SBT as an assessment tool

Participants described their experience of SBT as positive in terms of realizing potential gaps in a complex interdisciplinary scenario that may lead to an adverse event.

“I felt that the team was very focussed on the scenario and what they were doing and communicated well. I felt in a different OR setting [real life] there would have been more bodies with more distractions and that takes new communication…it [SBT] clarified how well the team can work without the distractors and how distractors can be the thing that really takes form teamwork.”

SBT was also highlighted as a tool for self-assessment and reflection. The distinctive features of SBT enable participants to evaluate their performance in a simulated crisis situation.

“It allows you to step back and assess your performance without any negative connotations or impact for the patient. So I definitely didn’t feel a high level of stress throughout the simulation because the most negative thing that could happen is I could be embarrassed about it and that is really not a big deal in the context of things.”

“it allowed me the time to think throughout of what I was doing or not doing without unnecessarily worrying about the patient so it allowed, by taking the patient out of the dynamic, it allowed me more time to look at the dynamic within the room and realize how I respond to people in that setting and what I could do better and what I don’t do.”

Category 2: SBT as a learning tool

Participants underlined that SBT is a valuable tool for learning by doing without any actual harm to real patients. SBT was perceived as a tool that facilitates learning of a complex process such as urgent blood transfusion in an interprofessional environment. The training is especially valuable to novice healthcare professionals and those who are new to the organization with limited knowledge of policy and procedures. One participant described how the exercise is a learning experience in task management:

“The most effective parts were actually probably highlighting the steps that actually happened for the blood transfusion. Small things like checking the band like the nurses always do and I probably don’t pay…wasn’t even aware that that was how important it was in that step so I became more aware of the steps within the protocol of what you need to do and that was probably the main thing I got out of it.”

SBT provides an opportunity for the comparison of a complex process between a real-life occurrence and simulated scenario and detecting potential barriers in the real life situation. For example, one participant described her struggle in a real-life situation based on her experience in SBT:

“I think the struggle in that scenario in real life is actually of the anesthetist, not only minding the patient and trying to figure out what is going on, but ensuring that the nurse in the room isn’t being…who has a very important job isn’t being dragged off to do less important jobs by people who don’t realize the priority. In the scenario it was managed quite well but I think in real life, I think that is what happens and that is difficult because you are usually trying to counteract someone more senior who wants to use your key resources.”

In addition to assessment and learning tool, SBT underlines teamwork. Participants perceived SBT extremely valuable in terms of understanding and appreciating each team member’s role in a complex process and realizing how each team member contributes to the process of care. This finding is in line with AITCS and CIAQ results.

“I think it’s very good for understanding the roles of different people in the OR because I’ll be completely honest, I didn’t know what a PSA was…. I found that out from the exercise what actual role was and they are actually a very helpful an important part of the team.”

“I wanted to actually to ask that maybe the scenario or the simulation had you to realize that -- that for example, this scrub nurse might need -- might need a little bit of help. You know, the realization that she needs to have some support.”

Appendix 2: Focus group summary

Table 5 Focus group summary
Full size table

Rights and permissions

Open Access This article is distributed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Campbell, D.M., Poost-Foroosh, L., Pavenski, K. et al. Simulation as a toolkit—understanding the perils of blood transfusion in a complex health care environment. Adv Simul 1, 32 (2016). https://doi.org/10.1186/s41077-016-0032-z

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1186/s41077-016-0032-z

Keywords

Advances in Simulation

ISSN: 2059-0628

Contact us