- Open Access
“Hand-it-on”: an innovative simulation on the relation of non-technical skills to healthcare
Advances in Simulationvolume 1, Article number: 30 (2016)
Non-technical skills (NTS) are an integral part of the abilities healthcare professionals need to optimally care for patients. Integrating NTS into the already complex tasks of healthcare can be a challenge for clinicians. Integrating NTS into simulation-based training increases the demands for simulation instructors with regard to scenario design, conduct, and debriefing. We introduce a simulation game, Hand-it-on, that can trigger discussions on how NTS can influence work processes. Hand-it-on aims to help clinicians and simulation instructors alike to improve their understanding of NTS concepts and where they can apply them in their work. It complements existing approaches to teaching NTS by limiting the complexity of the game and by removing medical content, allowing learners to concentrate on NTS. Hand-it-on is relevant for groups and teams working across the range of different healthcare contexts. During Hand-it-on, participants stand in a circle and hand on everyday objects to each other according to simple rules, resulting in many events that can be debriefed in relation to safe patient care. We describe both the conduct of Hand-it-on and ideas on how to debrief participants. We provide variations that can be used in different contexts, focusing the exercise on different learning goals. We also offer the theoretical rationale for using an out-of-context simulation in combination with other forms of teaching. Although we did not evaluate Hand-it-on formally, oral feedback from participants and the replication of Hand-it-on by many simulation teams support its value.
Non-technical skills (NTS) are defined as “the cognitive and social skills that complement technical skills and medical knowledge in task performance” . There are many connections between NTS and the care of patients [2, 3]. NTS can help to avoid errors or their negative consequences, for example when speaking up in the light of safety breaches . Compromised NTS can have a negative effect on safety, for example in case of cognitive shortcuts [5, 6] or stereotyping  possibly resulting in fixation errors, barriers for inter-professional work, or the relation to patients. Studies show the positive impact of NTS on the care of patients [8, 9]. Several professional bodies describe NTS as an integral part of care [10–13]. We acknowledge the debate around the term NTS possibly implying a lesser value of non-technical than technical skills, using a negation to define a concept, and that NTS describe only a subset of the so-called “human factors” . However, as it is widely established, we use the term for the purpose of this article.
Developing a deep understanding of the concepts underlying NTS is a challenge for healthcare professionals and simulation instructors alike . Taxonomies of NTS are meant to facilitate their understanding and use. The “Anaesthetists’ Non-Technical Skills System” ANTS , a so called behavioral marker system, is such a taxonomy. ANTS describes observable behaviors related to NTS. It comprises four categories “Situation Awareness”, “Decision Making”, “Task Management”, and “Team-working”. Each category in turn contains three to five elements further describing the category. Each element is described by positive and negative behavioral examples. We use ANTS in this paper as an example for an NTS framework. It is widely used and stimulated the development of similar frameworks in different disciplines. However, Hand-it-on and its debriefing can be adapted to any framework describing non-technical skills [17–21].
Training non-technical skills
There are also different teaching approaches to facilitate the learning of NTS and their practical application, simulations being a prominent example [8, 9, 22–27]. Game-like approaches are another example and are increasingly being used in healthcare for a variety of topics and within a growing field of disciplines [28–30]. We discuss the use of games in the next section in more detail.
We present a simulation-based game, “Hand-it-on”, that aims to complement existing approaches to support the learning of NTS. Hand-it-on uses simple, non-medical tasks combined in a way so that a complex pattern of interaction between the participants emerges. Participants stand in a circle and hand on objects to each other according to specific rules. The experience part of Hand-it-on provides the basis for the reflections during the debriefing, where most insights occur. During the debriefing the dynamics of Hand-it-on are analyzed and then related to actual healthcare. First, we provide a rationale for using out-of-context simulation games, here, Hand-it-on, in healthcare education. We then describe its typical conduct, along with possible variations and their purpose. We provide ideas for the debriefing. Lastly, we describe some typical take-home messages. We aim to stimulate the replication (and evaluation) of Hand-it-on by others.
Rationale for using Hand-it-on
Conceptually speaking combines Hand-it-on elements of simulations and games. It enables generation of learning opportunities in a simulated situation (participants, simulate working in an “organization” and engage in simulated tasks), without endangering any patients. Its game-like character draws on several learning principles and makes use of certain learning mechanisms . We first discuss the principles: Hand-it-on generates intrinsic motivation as most people perceive it as fun to play it. While the tasks participants perform are artificial, participants can (in our experience) easily see them as a representation of tasks they do in clinical care, especially during the discussion in the debriefing. Hand-it-on provides ample opportunity for learners to try out different behaviors and supports such an approach by its playfulness. Finally it is a highly experiential learning situation, which is combined with reflection in the following debriefing. Those principles are implemented in practice via a range of mechanisms . There are rules for the actions of participants and (vaguely) defined goals. Hand-it-on is constructed as a fictional setting (an organization is simulated) that provides some background information for the tasks to be done. It is possible to implement increasing levels of difficulties (see the discussion of possible variations below). There is a high degree of participant interaction as well as some elements of surprise and uncertainty. There is feedback while the game is running—from the other players, from the processes themselves, and from the game leader. There is also feedback and reflection during the debriefing. Finally, Hand-it-on is a highly social group learning activity. Research shows that those principles and mechanisms are related to high engagement of learners , while the evidence that this results in changed behaviors or even improved outcomes are still sparse [30, 31].
By removing medical content and basing Hand-it-on on the straightforward task of handing on everyday objects from one person to another, participants can concentrate on the essence of what is occurring during the organization of the processes. Many other simulation modalities, such as manikin-based simulations, challenge participants on three different dimensions of complexity : the actions taken during diagnosis and treatment of the depicted patient; the issues from using the simulator as a complex technical device; and the issues of NTS and how they relate to patient care. The combination of all three aspects can burden participants’ learning [32, 33]. Hand-it-on removes the medical challenges and uses simple tasks, reducing complexity from the task itself and from using the simulator as device and setting the focus on the third, namely, NTS in their relation to healthcare. These connections can be discussed in the debriefing.
Working with such out-of-context exercises can remove threats to participants’ self-image as a clinician. For most, there is little at stake as a healthcare professional when handing on objects to another person. Typically, none of the participants is an expert at the tasks involved, thus the existing order in hierarchy and/or expertise of the participants is less relevant during the game’s conduct.
Hand-it-on caters to different learning styles . The highly active and physical nature of Hand-it-on renders the game particularly suitable for learners who prefer active engagement during learning. The physical aspects also support the learning on a more bodily plane, which, for example, was shown to support the acquisition of concepts in different educational contexts . An in-depth discussion of the activity during the debriefing caters to participants with a more theoretical-learning orientation .
Apart from the cost regarding the time and remuneration of those involved and of that of securing a venue, Hand-it-on is virtually cost free. Most of the equipment is inexpensive and can be re-used.
Challenges related to the transfer of learning
However, due to its abstract nature, Hand-it-on requires some translation between the dynamics that unfold during its conduct and the dynamics in actual workplaces. It is not the intention that participants learn how to better hand on objects to each other. The intention is that participants acquire knowledge and skills that they can use in their clinical practice. We aim to create reflection on clinical practice and participants’ attitude towards NTS and safety in organizations. Hand-it-on requires the so-called “far transfer” [36, 37]. Participants and instructors need to discuss connections between what happens during the exercise and what happens in clinical work. An example is dealing with unclear instructions. Some of the instructions for Hand-it-on are purposely vague. During the debriefing, the implications of those vague instructions for the conduct of the game are discussed. The group can then compare those implications with unclear instructions in actual healthcare. By experiencing how to handle unclear instructions in Hand-it-on and by discussing this aspect in the debriefing, participants can develop ideas on how to improve this aspect in clinical care. By requiring participants to act in the unfamiliar context of Hand-it-on, NTS can become evident in a new light, possibly triggering deeper reflections on their meaning . One known strategy to support the learning of complex concepts is to discuss examples of such concepts in different contexts . Table 1 shows human factors related references that supplement the ANTS categories and provide some guidance on what to note during the conduct of Hand-it-on in relation to the categories.
Considerations before using Hand-it-on
The target group for Hand-it-on is diverse. Healthcare professionals from all disciplines, specialties, and experience levels can participate. Hand-it-on is suitable for people working in the various group and team constellations in healthcare, whether ad hoc groups, fixed teams or other constellations. Hand-it-on can be used in courses for healthcare providers and also in faculty development programs. The conduct and debriefing of Hand-it-on can be adapted to focus on the constellation most relevant for any particular setting.
The optimal number of participants for Hand-it-on is 9–13. With fewer participants, the tasks become easier, participants are then less challenged and may therefore not fully engage; more participants can be included in observer roles or in the variation for larger groups, described below.
By its nature, Hand-it-on can be used with different focus points. Table 2 describes possible learning goals; for each conduct of the game, one or two are typically chosen. We assume that instructors using Hand-it-on adjust it to their context and that they value experiential learning. Instructors should have at least a basic knowledge of the NTS concepts. This makes it easier to recognize relevant events during the game and to use those observations during debriefings . Tables 3 and 4 provide ideas for observing the conduct of Hand-it-on and its debriefing.
It is essential that instructors thoroughly brief participants to establish a learning atmosphere [40, 41]. This could include providing the rationale for the exercise and establishing ground rules. Further relevant theoretical background could be provided, such as a discussion of the ANTS  categories and elements.
Any learning setting requires a certain amount of “psychological safety” [42, 43]. In our experience, this game feels very safe for participants, despite some of the instructions being vague. While such vagueness could potentially threaten psychological safety, Hand-it-on seems to be sufficiently “game-like” for participants to perceive the vagueness as a trigger for discussion and reflection rather than as a threat. Humor can help in setting the scene for Hand-it-on.
Nevertheless, some participants might not perceive the relevance of such a “game”. We have seen that participants accept the value of Hand-it-on if a mutual rapport is established between the instructors and them and if the instructors themselves are convinced of the value of Hand-it-on. Providing this is the case, instructors will be able to transport this conviction to the participants. The arguments provided in the introduction of this paper (avoiding cognitive overload, focussing on NTS, increasing psychological safety by removing healthcare content, addressing of different learning styles, low cost) can also be used to support the use of out-of-context exercises.
Logistics of implementing Hand-it-on
The typical duration of Hand-it-on is about 50–60 min, including: (1) briefing participants and running Hand-it-on; (2) doing a debriefing; (3) running Hand-it-on again; and (4) leading a second debriefing. Depending on the depth of discussion, the duration can be extended to 90 min or longer.
To conduct Hand-it-on, apart from participants, three objects are needed. The objects should not break if they are dropped and should not cause injury. Examples of objects are a ruler, a coin, and an inflated balloon. There should be enough space for participants to stand in a circle and extend their arms without touching each other. A flipchart or whiteboard for notes during debriefing can be helpful.
The conduct of Hand-it-on: the guide for instructors
The participants stand in a circle and simulate “an organization” with a set of different tasks. According to specific rules, the tasks are simulated by handing objects to each other (Fig. 1). While passing objects, many events typically occur that can be debriefed (e.g., incorrect passing order, helping a colleague decide what to do, objects being dropped, optimizations of the work). The concrete goals selected for any conduct of Hand-it-on will determine what to focus on during the observation (Tables 1 and 2). More than one round can be run, so participants can experience differences in their performance after debriefing.
Conducting Hand-it-on is based on the following steps (see Fig. 1a):
Prepare participants for a basic understanding of NTS (e.g., pre-course reading assignment or a discussion of NTS).
Set the scene by establishing concrete learning goals for the session. Describe how such an out-of-context simulation can be useful.
Throughout the exercise observe what happens and possibly take notes.
Prepare the objects and keep them out of sight until they are to be used.
Ask participants to stand in a circle so there is sufficient room for them to stretch out their arms to their sides without touching each other.
Stand outside the circle next to a participant. Do not take part in the handling of the objects after passing them into the “organization”. Explain: “We are simulating an organization. I am senior management in your organization. Every organization has a core process. The core process in your organization is to pass this ruler from one person to another.”
Hand the ruler to the person next to you and indicate with your hand the direction in which the ruler should be passed by pointing at the next three persons to receive it. Say: “The core process is running all the time, so please continue with this process throughout the exercise.” Correct the group if needed.
Let the group pass around the ruler for about two rounds.
Explain while the group continues: “Besides the core process, there are also routine tasks in your organization. The routine task in your organization is to hand on this coin to every second person. It also runs all the time.” Hand the coin to the person next to you and indicate who should receive it. Correct if needed.
Let Hand-it-on run for about four rounds of the core process (ruler), while the routine task also runs in parallel.
Fetch the balloon and stand with the same person again. Say: “You know that there are sometimes unexpected events. Usually, you try to get rid of them as soon as possible”. While you say this, you hit the balloon so it flies to a participant as far away as possible. It is important to demonstrate the movement of the balloon because participants will typically mirror the action.
Allow the exercise to run for approximately three rounds of the core process, with the routine task and the unexpected event in parallel and then stop for the debriefing.
If time allows, start another round of Hand-it-on after debriefing. Ask participants to develop ideas on how to “keep what was good and to improve what could be improved” in relation to the learning goal discussed. Observe changes compared with the first round. Further, observe how many of the intended changes discussed during debriefing were implemented in the actual re-conduct of the game. Consider varying the “clarity” of priorities between rounds: Senior management could request that the objects are passed on more quickly or that no errors occur. Debrief again after such an additional round.
If an object, typically the balloon, falls outside the circle, retrieve it and pass it into the circle again. If participants combine objects (e.g., handing the balloon around together with the ruler), decide whether it is acceptable or correct as necessary—the learning goals for the session will help in making this decision. Note the size of the circle because it tends to get smaller, making the tasks easier. Adjust the circle size, if necessary.
For larger groups (approx. 20 to 30 participants), split the group in two. One group is organized as previously described, the other—consisting of four or five participants—stands in the middle of the larger circle. These participants stand close to each other (Fig. 1b); they are assigned only one task, but one that requires concentration, such as handing on a full glass of water. As this group will concentrate on this task only, it is less critical to have an object that might break, if it falls down. The purpose of this variation is to discuss the relationship between different parts of an organization. Here the two “departments”, the inner and the outer circle, are engaged in similar tasks that are, however, to be performed under different conditions. The three tasks in the outer circle are performed more dynamically and quickly, performed in a larger group where not all members can clearly see each other because the inner-circle members are obstructing their view. The inner circle has one task only, but one that requires concentration. It is much slower and can soon become boring. As there are only few people in this inner circle, all are directly involved and all are “seen” by others. To some extent, the inner group stands in the way of the outer group, especially when dealing with the balloon. The differences in group composition and tasks make interesting points for the debriefing, for example in relation to stereotyping of members of other departments, patient groups, etc. . An additional advantage of this variation is the possibility to engage larger groups.
Other variations of the conduct of Hand-it-on are described in Table 5. Each variation emphasizes certain learning opportunities.
Note that the instructions for Hand-it-on are intentionally vague to allow participants to interpret them as they think fitting: It is not clear what role “senior management” has. It is also unclear how relatively important the different tasks are to each other and which should be prioritized. There is no statement concerning any speed/accuracy trade-off: should participants work as error-free as possible or should they try to hand on the objects as quickly as possible? There are no prompts regarding role distribution. This vagueness generates much of the dynamic of Hand-it-on and also reflects the vagueness of many of the real-world tasks people are assigned. Combined with the game character of Hand-it-on, this vagueness triggers extensive reflection, which can be analyzed in the debriefing.
Hand-it-on will spawn many issues for discussion during debriefing and these can be used to create learning opportunities for the participants regarding the set learning goals. Table 4 shows typical examples of observable events and relates them to possible applications in healthcare. Participants can usually find numerous examples from their own practice to relate to what happened during Hand-it-on. Table 4 provides debriefing ideas.
Any simulation scenario and debriefing are embedded in the context of a simulation setting , for example, a training course. The course comprises different phases, such as the introduction, theory modules, scenarios, debriefings, and a course ending. Those phases influence each other and are all important in preparing for the best possible debriefing . Here, we assume that relevant concepts had been discussed before conducting Hand-it-on, for example, a discussion of NTS. Displaying the ANTS categories and elements in poster format could also support the debriefing. We further assume that the instructor collected interesting observations during the conduct of Hand-it-on.
The debriefing can be run in different ways, depending on the goals chosen for the session and depth of discussion. Typically, it takes a minimum of 15 min but can easily be extended to 45 min or longer. The flexibility of the timing is another advantage of using Hand-it-on. In our practice, the group usually remains standing for the debriefing. This seems to support the active nature of Hand-it-on but might not be received well by those who find standing for prolonged periods difficult. In this case, the setting can be adjusted and those who wish to sit down can. Our approach is to stimulate and steer the discussion leaving most speaking time to participants [39, 44]. Depending on the group, we would emphasize either the game-like character of the exercise or the seriousness of the learning opportunities it creates. The first option would help to relax the group, whereas the second would help people who question the seriousness of the possible learning. We described further ideas for the debriefing in Tables 4 and 5.
We typically build our debriefing on four phases: setting the scene for the debriefing with a description of the debriefing model and the time frame; asking participants to describe what happened during the game in the description phase; analyzing what happened during the game in more detail according to set learning goals or other focus points (see Tables 4 and 5 for ideas) in the analysis phase; and asking participants to formulate take home messages in the application phase. In the description phase the emphasis lies on the description: what phenomena could be observed (see Tables 1 and 3)? In the analysis phase, we focus on how those phenomena came to be within the context of the game and ask participants to relate the phenomena and their explanations to the actual work settings and influences there. For example, it might be observed that in the variation for large groups, the members of the two departments make “funny” comments about the members of the other departments. The observations could be described in the debriefing, prompting a discussion of what triggered them. Finally, it could be discussed with the groups what kind of “funny” comments between departments (professions, disciplines, etc.) are made in real work settings and how the comments impact the care of patients. The discussion could be related to stereotyping  or other relevant concepts. Tables 4 and 5 provide numerous ideas on how to structure the discussion in the analysis phase. In the application phase, we try to help participants formulate take home messages as concrete as possible.
Potential risks and limitations
We did not formally evaluate Hand-it-on. Oral feedback from sessions where we conducted it was positive and several groups have adopted the game into their teaching practice. We discuss possible risks and limitations in the following section.
Conceptually speaking, Hand-it-on can pose a risk if instructors wrongly interpret participants’ actions and consequently provide incorrect or incomplete feedback during debriefing, or if instructors do not challenge wrong interpretations by the participants. This risk could be lessened if faculty members familiarize themselves with the NTS concepts and facilitation techniques.
Hand-it-on might favor people with active learning styles who are “game-minded”. Not all participants will be able to easily see the connections between handing on objects to each other and working in healthcare settings. Here, the debriefing is paramount. Instructors can facilitate the discussion of such connections.
It would be interesting to investigate Hand-it-on in terms of cognitive load theory, distinguishing different types of cognitive load. Intrinsic load describes the complexity of the topic to be learned; extraneous load describes the complexity of the material used to support the learning; and germane load relates to cognitive activities connected to the processing of information . While a full conceptualization of Hand-it-on based on cognitive load theory is beyond the scope of this paper, the game seems to trade-off low intrinsic (simplex tasks) and extraneous load (simple rules) with a high germane load that stems from the need to “far transfer”  the learning to the clinical setting.
To date, we have run Hand-it-on in approximately 25 occasions, reaching about 500 participants from a broad range of backgrounds. We have met them in different settings, including conferences and faculty development programs. Several faculty development groups across the world have adopted Hand-it-on. We see this as a “proof-of-concept”. We now describe some of the key learning messages from our practice with Hand-it-on to further support its value as a complement to other teaching methods. They are based on our impressions during the conduct of Hand-it-on and how we remember discussions during debriefings. They are not based on scientific investigations.
Hand-it-on can pave the way for intense discussions in the debriefing. One discussion topic concerns the difference between “work as imagined” and “work as done” . What is assumed about how a group works in an organization (work as imagined) is not necessarily what actually happens (work as done) and Hand-it-on helps participants understand this difference. When re-started after debriefing, Hand-it-on can illustrate that not all planned intentions to optimize a process (work as imagined) will work in practice (work as done). This is seen, for example, when participants discover that they assigned different priorities to the intended changes and that only some participants implemented the changes, despite all having agreed to them.
Another focus point for the debriefing of Hand-it-on can be how participants produce good practice—an important aspect of modern safety theories, such as Hollnagel’s concept of Safety II . The debriefing can focus on how the participants made sure that no sequence errors occurred. How can these ideas be applied to more complex clinical settings? Concentrating on such process aspects is facilitated in Hand-it-on as the complexity of the content is low.
The discussions after Hand-it-on can illustrate the connection between the NTS and the care of patients: established “technical” procedures (passing sequence or the movements that are used to hand on an object) might not be known to all involved (situation awareness), might not be accepted by all (leadership and followership), might be found by chance after non-systematic considerations (decision making), or might be difficult to implement while keeping the core process running (task management).
Hand-it-on can also be used to reflect on the influence of emotions on people’s behavior. Not all that happens can be explained by attempts to hand on the objects/to optimize the care of patients and their relatives. Some actions are done to avoid boredom, to “spice things up”, or for other egocentric motives. Nance et al. describe how this can unfold in clinical practice in a very illustrative way .
We describe an innovative simulation-based game, Hand-it-on, that uses simple tasks to illustrate the connection between NTS and care of patients. By removing medical content from Hand-it-on, we aim to focus on NTS and their role in healthcare. The features of the game, seen from a theoretical viewpoint, are intended to support the learning on the level of principles that can be applied in different settings. The events that occur during Hand-it-on can be used to create learning opportunities around the interplay of technical skills and NTS. Anecdotal evidence from running Hand-it-on for approximately 500 participants over the recent years supports the perception of positive effects of the exercise. Whether those effects translate into improved care remains to be investigated.
Copenhagen academy for medical education and simulation
Flin RH, O’Connor P, Crichton M. Safety at the Sharp End. Aldershot: Ashgate Publishing, Ltd; 2008.
Gjeraa K, Jepsen RMHG, Rewers M, Østergaard D, Dieckmann P. Exploring the relationship between anaesthesiologists’ non-technical and technical skills. Acta Anaesthesiol Scand. 2016;60(1):36–47.
Flin R, Maran N. Basic concepts for crew resource management and non-technical skills. Best Pract Res Clin Anaesthesiol. 2015;29(1):27–39.
Kolbe M, Burtscher MJ, Wacker J, Grande B, Nohynkova R, Manser T, et al. Speaking up is related to better team performance in simulated anesthesia inductions: an observational study. Anesth Analg. 2012;115(5):1099–108.
Hollnagel PE. Safety-I and Safety–II. Aldershot: Ashgate Publishing, Ltd; 2014.
Gigerenzer G, Selten R. Bounded Rationality. Boston: MIT Press; 2002.
Dieckmann P, Lyk-Jensen HT. A psychological analysis of an anesthesia related incident. Trends Anaesthesia Critical Care. 2016.
Yule S, Parker SH, Wilkinson J, McKinley A, MacDonald J, Neill A, et al. Coaching Non-technical Skills Improves Surgical Residents’ Performance in a Simulated Operating Room. J Surg Educ. 2015;72(6):1124–30.
Kemper PF, de Bruijne M, van Dyck C, So RL, Tangkau P, Wagner C. Crew resource management training in the intensive care unit. A multisite controlled before-after study. BMJ Qual Saf. 2016;25(8):577-87.
Mellin-Olsen J, Staender S, Whitaker DK, Smith AF. The Helsinki Declaration on Patient Safety in Anaesthesiology. Eur J Anaesthesiol. 2010;27(7):592–7.
Moreno RP, Rhodes A, Donchin Y, European Society of Intensive Care. Patient safety in intensive care medicine: the Declaration of Vienna. Intensive Care Med. 2009;35:1667–72.
Greif R, Lockey AS, Conaghan P, Lippert A, De Vries W, Monsieurs KG, et al. European Resuscitation Council Guidelines for Resuscitation 2015: Section 10. Education and implementation of resuscitation. Resuscitation. 2015;95:288–301.
European Union of Medical Specialists (UEMS). Training requirements for the specialty of anaesthesiology, pain and intensive care medicine. European Standards of Postgraduate Medical Specialist Training. UEMS Anaesthesiol. Sect. Board 2013; Available online: http://www.eba-uems.eu/resources/PDFS/Training/Anaesthesiology-Training-Requirements-March-2013.pdf; Accessed: 25. Jan 2016.
Nestel D, Walker K, Simon R, Aggarwal R, Andreatta P. Nontechnical skills: an inaccurate and unhelpful descriptor? Simul Healthc. 2011;6(1):2–3.
Dieckmann P, Glavin R, Jepsen RMHG, Krage R. Non-Technical skills bingo—a game to facilitate the learning of complex concepts. Advances in Simulation. 2016;1(23).
Flin R, Fletcher G, Glavin R, Maran N, Patey R. Anaesthetists’ Non-technical Skills (ANTS) System Handbook. UK: University of Aberdeen; 2003.
Spanager L, Lyk-Jensen HT, Dieckmann P, Wettergren A, Rosenberg J, Ostergaard D. Customization of a tool to assess Danish surgeons’ non-technical skills in the operating room. Dan Med J. 2012;59(11):A4526.
Jepsen RMHG, Spanager L, Lyk-Jensen HT, Dieckmann P, Ostergaard D. Customisation of an instrument to assess anaesthesiologists’ non-technical skills. Int J Med Educ. 2015;6:17–25.
Lyk-Jensen HT, Jepsen RMHG, Spanager L, Dieckmann P, Østergaard D. Assessing Nurse Anaesthetists’ Non-Technical Skills in the operating room. Acta Anaesthesiol Scand. 2014;58(7):794–801.
Rall M, Gaba DM, Howard SK, Dieckmann P. Human performance and patient safety. Miller’s anesthesia. Philadelphia: Elsevier; 2015
Healthcare Research and Quality Agency. Teamstepps. Available online: http://www.ahrq.gov/professionals/education/curriculum-tools/teamstepps/index.html; Accessed: 20. Apr2016. Government Printing Office; 2006
Skelton T, Nshimyumuremyi I, Mukwesi C, Whynot S, Zolpys L, Livingston P. Low-Cost simulation to teach anesthetists’ non-technical skills in Rwanda. Anesth Analg. 2016. (Published Ahead of Print)
Gregory A, Hogg G, Ker J. Innovative teaching in situational awareness. Clin Teach. 2015;12(5):331–5.
Abrahamsen HB, Sollid SJM, Öhlund LS, Røislien J, Bondevik GT. Simulation-based training and assessment of non-technical skills in the Norwegian Helicopter Emergency Medical Services: a cross-sectional survey. Emerg Med J. 2015;32(8):647–53.
Pena G, Altree M, Field J, Sainsbury D, Babidge W, Hewett P, et al. Nontechnical skills training for the operating room: A prospective study using simulation and didactic workshop. Surgery. 2015;158(1):300–9.
Spanager L, Dieckmann P, Beier-Holgersen R, Rosenberg J, Oestergaard D. Comprehensive feedback on trainee surgeons’ non-technical skills. Int J Med Educ. 2015;6:4–11.
Gaba DM, Fish KJ, Howard SK, Burden A. Crisis management in anesthesiology. 2014.
Bauman PhD RN EB. Game-Based Teaching and Simulation in Nursing and Health Care. Berlin: Springer; 2012.
Abdulmajed H, Park YS, Tekian A. Assessment of educational games for health professions: a systematic review of trends and outcomes. Med Teach. 2015;37 Suppl 1:S27–32.
Wang R, DeMaria S, Goldberg A, Katz D. A Systematic Review of Serious Games in Training Health Care Professionals. Simul Healthc. 2016;11(1):41–51.
Perrotta C, Featherstone G, Aston H, Houghton E. Game-based learning: latest evidence and future directions. Slough: National Foundation for Educational Research; 2013
Rystedt H, Lindwall O. The Interactive Construction of Learning Foci in Simulation-Based Learning Environments: A Case Study of an Anaesthesia Course. PsychNology J. 2004;2(2):168–88.
Young JQ, Van Merrienboer J, Durning S, Ten Cate O. Cognitive Load Theory: Implications for medical education: AMEE Guide No. 86. Med Teach. 2014;36(5):371–84.
Kolb AY, Kolb DA. Learning Styles and Learning Spaces: Enhancing Experiential Learning in Higher Education. Academy of Management Learning & Education. Academy of Management. 2005;4(2):193–212.
Alessi SM, Trollip SR. Multimedia for learning. Boston: Pearson College Division; 2001.
Baldwin TT, Ford JK. Transfer of training: A review and directions for future research. Personnel Psychol. 1988;41(1):63–105.
Leberman S, McDonald L, Doyle S. The transfer of learning. Oxon: Routledge; 2016
Iedema R, Mesman J, Carroll K. Visualising Health Care Practice Improvement. London: Radcliffe Pub; 2013.
Eppich W, Cheng A. Promoting Excellence and Reflective Learning in Simulation (PEARLS): development and rationale for a blended approach to health care simulation debriefing. Simul Healthc. 2015;10(2):106–15.
Dieckmann P. Using Simulations for Education, Training and Research. Lengerich: Pabst; 2009.
Rudolph JW, Raemer DB, Simon R. Establishing a safe container for learning in simulation: the role of the presimulation briefing. Simul Healthc. 2014;9(6):339–49.
Edmondson AC. Psychological Safety and Learning Behavior in Work Teams. 1998.
Kolbe M, Grande B, Spahn DR. Briefing and debriefing during simulation-based training and beyond: Content, structure, attitude and setting. Best Pract Res Clin Anaesthesiol. 2015;29(1):87–96.
Steinwachs B. How to facilitate a debriefing. Simulation Gaming. 1992;23(2):186–95.
Nance JJ. Why hospitals should fly. Bozeman: Second River Healthcare; 2008
Schulz CM, Endsley MR, Kochs EF, Gelb AW, Wagner KJ. Situation awareness in anesthesia: concept and research. Anesthesiology. 2013;118(3):729–42.
Dekker PS. The field guide to understanding human error. Burlington: Ashgate Publishing, Ltd; 2013
Kahneman D. Thinking. Macmillan: Fast and Slow; 2011.
Kolbe M, Burtscher MJ, Manser T. Co-ACT--a framework for observing coordination behaviour in acute care teams. BMJ Qual Saf. 2013;22(7):596–605.
Bogdanovic J, Perry J, Guggenheim M, Manser T. Adaptive coordination in surgical teams: an interview study. BMC Health Serv Res. 2015;15:128.
Hollnagel E. The ETTO Principle: efficiency-thoroughness trade-off. Burlington: Ashgate Publishing; 2012
Improving Hand-off Communication. Joint Commission Resources. 2007.
Amalberti R, Vincent C, Auroy Y, de Saint Maurice G. Violations and migrations in health care: a framework for understanding and management. Qual Saf Health Care. 2006;15 Suppl 1:i66–71.
Gaba DM. The future vision of simulation in healthcare. Simul Healthc. 2007;2(2):126–35.
Senge PM. The fifth discipline. New York: Doubleday/Currency; 2010
We thank Raimund Gebhardt, Germany, for substantial input in the current paper. We also thank all those who took part in Hand-it-on and with their comments helped us to refine and improve the concept.
The work on this publication was funded by our institution, the Copenhagen Academy for Medical Education and Simulation.
Availability of data and materials
The conceptual material to run Hand-it-on is described in the paper. The objects needed to run it should be widely available.
All authors contributed to the conception, design, and implementation of Hand-it-on, conducting it in practice and in collecting the experience that is the base for this paper. PD drafted the article with substantial input from LGZ and AMH. All authors approved the final version of the article and take responsibility for its content. All authors agreed to be accountable for the work. All authors read and approved the final manuscript.
Dieckmann heads the EuSim group, providing faculty development programs, Helsø is course director for EuSim courses and Zeltner is a researcher at the Copenhagen Academy for Medical Education and Simulation (CAMES) and was involved in EuSim projects. CAMES has a collaboration agreement with Laerdal.
Consent for publication
We do not report data from any individual and thus believe it is not necessary to provide a statement of consent for publication.
Ethical approval and consent to participate
We do not report data on human participants and thus believe it is not necessary to seek ethical approval.