- Open Access
Research challenges in prehospital care: the need for a simulation-based prehospital research laboratory
© The Author(s) 2019
- Received: 2 October 2018
- Accepted: 5 February 2019
- Published: 13 February 2019
There is a need for improved research in the field of prehospital care. At the same time, there are many barriers in prehospital research due to the complex context, posing unique challenges for research, development, and evaluation. The present paper argues for the potential of simulation for prehospital research, e.g., through the development of an advanced simulation-based prehospital research laboratory. However, the prehospital context is different from other healthcare areas, which implies special requirements for the design of this type of laboratory, in terms of simulation width (including the entire prehospital work process) and depth (level of scenario detail). A set of features pertaining to simulation width, scenario depth, equipment, and personnel and competence are proposed. Close tailoring between these features and the prehospital research problems and context presents great potential to improve and further prehospital research.
This commentary article discusses the challenges of conducting research in the prehospital field and how prehospital simulation, currently underused for research purposes, has great potential to address these.
Prehospital care has changed rapidly during the last couple of decades. It has quickly transformed from a transport organization to an integrated part of the healthcare system . This fast transition poses major challenges to the organizations . Emergency medical systems (EMS) clinicians have to carry out more advanced patient assessment and interventions, compared to the old system which was more focused on a “load and go” strategy, with quick on-scene assessments and transports to the nearest emergency department (ED). In addition to more advanced care for critically ill or injured patients , EMS clinicians must also make decisions regarding the level of care, including alternatives for the patient such as stay at home with self-care advice , transport to primary care facility , transport to the nearest ED, or bypassing the ED for direct transport to specialist assessment or treatment center . Hence, the broad range of clinical skills needed in order to be prepared for many different types of patients requires high-level clinical reasoning and decision making skills . Prehospital care may also be conducted in difficult environments, in all kind of weather conditions, 24 h a day, and a long way from medical support [8, 9].
Despite increased research efforts in the prehospital area, there are still many unsolved research challenges . When reviewing the evidence base for 11 important prehospital research topics (e.g., patient priorities and decision making, patient assessment and management, workforce safety and hazards, and information and performance measurement), the Department of Health, UK , found poor evidence in eight of the 11 topics, pointing towards a need for more and/or better research. Other studies, e.g., a Delphi study from the UK  and studies from Canada  and Australia  confirm these needs. Hence, further development of prehospital research is essential in order to reach an evidence level comparable to other parts of the healthcare sector.
Although these research gaps are partly due to prehospital care being a relatively young research area , they are more related to practical barriers to effective research in this context , e.g., trials involving acutely sick or injured patients who cannot consent to treatment or study enrolment. Furthermore, it is physically difficult for researchers to have control over the study, and low study protocol compliance among EMS clinicians has been reported . Another problem is the lack of contextual knowledge among researchers engaging in prehospital research. Often, these have hospital-based backgrounds [12, 16] and thus limited knowledge regarding the prehospital research context. When designing realistic, high-validity simulations for research purposes, thorough knowledge about not only physical environments but also work practices, protocol, equipment, and culture is crucial. To do this, close collaboration between EMS professionals and researchers is necessary. As suggested by Leonard et al. , successful EMS partnerships in prehospital research are obtained by early involvement of EMS clinicians already during research planning and pilot studies. A simulation laboratory, such as the one proposed in this paper, could ideally work as a center of excellence or research hub for researcher-clinician partnerships.
The aim of this paper is to argue for the development and use of prehospital simulation laboratories and their potential to improve research in the field of prehospital care overall and strengthen the success rates for prehospital clinical studies.
Already in 2004, Gaba  discussed the future role of simulation as a research method, in particular for addressing central research areas such as organizational practices and human factors. He also highlighted the role of simulation in the development and evaluation of new equipment and methods in healthcare. The future is here, and with advances in healthcare simulation, there is now a potential for simulation in a number of research areas. To date, simulation-based research projects are relatively sparse in the prehospital research literature (excl. training). Furthermore, similar to the practices in how simulation traditionally is used for training purposes, they often focus on specific tasks or skills and/or are designed in a way that does not take the full complexity of the prehospital process and different contexts into account.
The area with the largest number of published prehospital research articles using simulation as a research tool is the assessment of different airway techniques with 59 published articles in the time period 1984–2012. Assessment of cardiac pulmonary resuscitation is another area, where simulation was frequently used with 35 published articles during the same time period . Some studies have used simulation for technology evaluation. Brummer et al.  performed a randomized controlled simulation experiment to evaluate the effect of night vision goggles on advanced life support skills among paramedics. Teleconsultation from the scene was evaluated in a controlled simulation experiment by Skorning et al. . Hagiwara et al.  used simulation in a randomized controlled trial to determine the effect of a computerized decision support system (CDSS) in compliance with guidelines and time spent on scene. The effects of video consultations in connection to advanced airway interventions were investigated in simulation-based experiments [23, 24]. Hagiwara et al. (forthcoming) used advanced simulation techniques to evaluate the effect of a CDSS in connection to the prehospital assessment of patients with stroke symptoms.
Simulation with advanced human patient simulators has been discussed as a suitable method for cognitive engineering and patient safety research, with emphasis on its advantage to provide a controlled laboratory environment without placing patients at risk . There are some examples also from the prehospital field. Lammers et al.  used simulation to study patient safety risks in connection to prehospital assessment and treatment of pediatric patients. Simulation has also been used to study stress and the impact of stress on EMS clinicians in a couple of studies [27, 28]. In addition, cognitive processes among EMS clinicians have been investigated in simulation-based studies [9, 29, 30]. Manikins with temperature sensors have been used to determine the effect of wet clothing removal in prehospital care  and the impact of heat stress of chemical protective clothing in connection to prehospital resuscitation . These simulation-based studies are good examples of what simulation can add to the prehospital research in the future.
Addressing the overall complexity of the research context
One of the biggest challenges when conducting prehospital research is the lack of control over several elements of the study. This includes difficulties with inclusion procedures where the responsibility falls under the EMS clinician, e.g., it is not feasible to add a research nurse or assistant to the existing ambulance team. Hence, the researcher has no direct access to or control over the process. There are many possible advantages to use simulation as a preparation before a clinical trial, e.g., pre-testing the study protocol procedures in realistic situations with the EMS clinicians involved in the data collection. It can also be used to improve training of the study protocol, increase participant enrolment, and decrease early protocol violations . Hence, a simulation laboratory can provide means for improving the quality of prehospital clinical studies.
Development and evaluation of new technology and methods
Development and evaluation of prehospital equipment and technology are examples of areas where simulation-based studies have great potential. Simulation has already been used in these areas, but the problem with some of the studies [22, 23] is the lack of contextualization in the simulation. The traditional prehospital simulation is often performed in a decontextualized environment where only one or at best a few phases of an ambulance mission are represented. If the goal of a study, for example, is to evaluate a decision support system, it is of great value to be able to study the effects in all phases of an ambulance mission. With a contextual simulation scenario where all phases in an ambulance mission are present and the simulation context induces a high degree of immersion to the participant, it is possible to closely study the effects of new technologies on, e.g., work process and teamwork. In simulations, it is also possible to evaluate technologies in a premature or early stage of development where necessary certificates for clinical use might be lacking. Another benefit for simulation evaluation is increased user involvement in the development process. There is a strong correlation between user-involvement and system success .
Studies on patient safety
Simulation has been highlighted to be an effective approach to increase patient safety by training healthcare teams . Simulation also has the potential to be an effective research method to closely study prehospital patient safety risks and to evaluate patient safety interventions. In simulation, it is possible to set up a scenario and run realistic experiments. In the analysis phase, the video recordings make it possible to study the patient safety issues thoroughly. Simulation can replace some data collected in a clinical setting, which may otherwise require many hundreds of hours of observations until a particular situation of interest occurs again naturally, as opposed to being provoked by the circumstances of a specific scenario. This is especially important in prehospital care, where it is difficult to predict the number and locations of the situations or patients of interest for a particular study. In a simulation laboratory, there are no issues with informed patient consent, especially when patient simulators are used (although standard consent would still be needed from anyone participating in a research activity, e.g., EMS clinicians or simulated patients). Obtaining informed consent from real patients , as well as from the EMS clinicians on duty, is a major obstacle in conducting prehospital research in real life. This is due to the characteristics of many ambulance patient groups, e.g., patients with stroke symptoms, cardiac arrest, or multiple trauma, from whom it is impossible to obtain consent from and thus are excluded from prehospital clinical research. Another possibility in line with this is to recreate an adverse event and be able to analyze the event closely.
Organizational development and quality improvement
Another area for prehospital simulation laboratory related to research is organizational development. Prehospital organizations could use a simulation-based prehospital research laboratory in many creative ways. Before procurement of new equipment, the organization could use simulation to determine if the equipment is appropriately suited for the task. It could also help them in defining requirements and specifications of new equipment. When introducing new equipment, techniques, and methods, simulation can provide benefits such as developing and providing the user suitable process recommendations, e.g., for work processes or guidelines. Hence, the implementation of new medical guidelines is another area where simulation has an important future role .
Due to the characteristics of the prehospital context, it is not optimal to use the same types of simulation-based facilities, such as the ones often used in hospitals or for training purposes where only one or two locations and/or rooms are represented, and many of the prehospital activities, tasks, and dimensions are excluded. We argue that to be able to conduct advanced prehospital simulation research, it is critical that simulations include the full context, phases, and details of the entire prehospital work process, e.g., different types of fidelity as proposed by Lioce et al.  and further discussed by Engström et al. , as well as advanced technology and equipment for high-quality data collection and analysis. A recent research interdisciplinary (serious games, information science, prehospital care) project (SAREK)  developed a simulation platform for prehospital training and research . The simulation platform was created to support patient care provision in live role-playing scenarios using simulated patients (actors or patient simulators). The platform integrated physical spaces and rooms, components such as a real ambulance and EMS equipment, and equipment for visualization. It also included software support, such as wall projections, sounds, and images, for creating different types of scenario environments.
The goal of this system was to enable realistic prehospital simulation scenarios covering all phases and parts of an ambulance mission from dispatch to handover of the patient at the emergency department. The project aimed to increase both the width and depth of the simulation. The width means that all phases, as defined by Carter and Thompson  and Jensen et al. , included in a typical ambulance mission are represented. Lioce et al.  propose this as one important dimension when designing simulation scenarios or cases. The depth means that all activities in the phases are represented as realistically as possible. To achieve depth, several approaches were used such as the use of standard equipment, the use of technology for sound and environmental simulation, and an effort to reduce disturbing interaction with people not involved in the scenarios. This means, for example, that a scenario starts with an alarm call made through a simulated ambulance dispatch unit and that the participating ambulance team will receive information via radio calls in the car. Upon arrival on scene, the team will then have the same information that they usually have about what to expect (e.g., what type of scene/location, patient, initial symptoms, and potentially other circumstances). After a short transfer from the ambulance into the scene room, they have to make an initial assessment of the patient and the environment and use whatever cues there are to determine whether the place is safe or not before they initiate treatment. [38, 40, 43] This approach is different from the traditional way of doing prehospital simulation, where the team typically will get a lot of verbal information from a scenario instructor and then have to ask the instructor for environmental and/or additional information not possible to gather or interpret from the scenario design or training environment. The simulation platform was evaluated in two experiments and tested for immersion among the scenario participants [38, 43, 44].
When designing this type of facility, close collaboration is required between users of the simulation and the people designing and developing the simulation facility.  Here, users include both people participating in simulations and people who manage or use either the simulation facility or the participants. The use of participatory design approaches, in combination with establishing constructive long-term partnerships and arenas between researchers, designers, and EMS organizations are crucial. The authors’ own experience is that simulation as activity and place works as a collaborative hub or artifact that enables and facilitates common ground across professions and disciplines. Hence, the features of future prehospital research laboratories could be derived from a combination of the reviewed work and the SAREK project. Great emphasis and efforts should be placed on the simulation width and depth and the competence partnerships in order to reach a high level of contextualization. Next, we outline some ideas on how to achieve this.
Fully equipped ambulance which also will function as a driving simulator
Realistic equipment for dispatch and communication
Rooms for on-scene simulation (house of outdoor settings)
Rooms for the handover phase (emergency department, intensive care unit, etc.)
Possibilities to carry out documentation in accordance with the standard practice, using realistic/real prehospital documentation systems
Projection of image and sound during driving in the simulator
Projection of image and sound to be able to create realistic and different on-scene scenarios
Environmental noise and sounds including crowds, traffic, music, rain, thunder, fire/car alarms, discussion, or pets/animals
A room for environmental simulation with possibilities to create different weather conditions such as rain, wind, and different temperatures
Fully equipped emergency room
Real ambulance equipment
Facilities and equipment for makeup and dressing of actors
Advanced simulation manikins of different ages
Equipment for video and audio recording
Programs for storing and analysis of video and sound material
Movement tracking devices
Eye tracking devices
IT infrastructure which supports IT components used in prehospital care
Equipment for monitoring simulation participants
Facilities for interviews and debriefing
Control room for running simulations
Personnel and competence resources
Researcher with deep knowledge of the prehospital context
Researcher with experience of simulation research
Researcher with experience of information science
Simulation expertise, e.g., simulation techniques and methods
Simulation technology technicians
Prehospital care differs a lot from hospital care in terms of physical environments, mobility, work processes, and range of patients. There are phases and tasks not present in hospital care such as driving and radio communication, and changing and unstable environments provide challenges to performing patient care. While there is a need for more research in the prehospital context, the context itself presents obstacles and difficulties to this, e.g., as lack of control and an insufficient EMS clinician involvement. Hence, we argue for the development of advanced simulation laboratories dedicated to the prehospital context. This can be compared to the use of living labs approaches  in disciplines such as human-computer interaction, interaction design, and computer-supported collaborative work where emphasis on context, work processes, and practices is increasingly considered important [47, 48]. To be able to create immersive prehospital scenarios, it is important that a simulation laboratory offers the means for close tailoring between required competence, methods and equipment/facilities, and the research problems and context presented.  Hence, it needs to provide both the width and depth of real prehospital scenarios. This can be attained through serious game-inspired techniques and methods, including sound and image projections, role-playing, and inclusion of all phases in an ambulance mission, along with data collection equipment and people with experience and competence in simulation development and design. An advanced prehospital simulation-based laboratory presents great promises to increase the scientific knowledge of prehospital care.
The project has no funding.
Availability of data and materials
All authors contributed in writing the manuscript and read and approved the final manuscript.
Ethics approval and consent to participate
Consent for publication
The authors declare that they have no competing interests.
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Open AccessThis article is distributed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated.
- Bigham BL, Bull E, Morrison M, Burgess R, Maher J, Brooks SC. Patient safety in emergency medical services: executive summary and recommendations from the Niagara summit. CJEM. 2011;13(1):13–8.Google Scholar
- Cone DC. Knowledge translation in the emergency medical services: a research agenda for advancing prehospital care. Acad Emerg Med. 2007;14:1052–7.PubMedView ArticleGoogle Scholar
- The Ems Examination Task Force American Board Of Emergency M, Perina DG, Pons PT, Blackwell TH, Bogucki S, Brice JH, et al. The core content of emergency medical services medicine. Prehosp Emerg Care. 2012;16:309–22.View ArticleGoogle Scholar
- Tohira H, Fatovich D, Williams TA, Bremner AP, Arendts G, Rogers IR, et al. Is it appropriate for patients to be discharged at the scene by paramedics? Prehosp Emerg Care. 2016;20:539–49.PubMedView ArticleGoogle Scholar
- Norberg G, Wireklint Sundström B, Christensson L, Nyström M, Herlitz J. Swedish emergency medical services’ identification of potential candidates for primary healthcare: retrospective patient record study. Scand J Prim Health Care. 2015;33:311–7.PubMedPubMed CentralView ArticleGoogle Scholar
- Hagiwara M, Bremer A, Claesson A, Axelsson C, Norberg G, Herlitz J. The impact of direct admission to a catheterisation lab/CCU in patients with ST-elevation myocardial infarction on the delay to reperfusion and early risk of death: results of a systematic review including meta-analysis. Scand J Trauma Resusc Emerg Med. 2014;22:67.PubMedPubMed CentralView ArticleGoogle Scholar
- Bigham BL, Buick JE, Brooks SC, Morrison M, Shojania KG, Morrison LJ. Patient safety in emergency medical services: a systematic review of the literature. Prehosp Emerg Care. 2012;16:20–35.PubMedView ArticleGoogle Scholar
- Hagiwara M, Suserud B-O, Jonsson A, Henricson M. Exclusion of context knowledge in the development of prehospital guidelines: results produced by realistic evaluation. Scand J Trauma Resusc Emerg Med. 2013;21:46.PubMedPubMed CentralView ArticleGoogle Scholar
- Jensen JL. Paramedic clinical decision-making: result of two Canadian studies. J Paramed Pract. 2011;1:63–71.View ArticleGoogle Scholar
- Snooks H, Evans A, Wells B, Peconi J, Thomas M. What are the highest priorities for research in pre-hospital care? Results of a review and Delphi consultation exercise. J Emerg Prim Health Care. 2008;6:20.Google Scholar
- Turner J. Building the evidence base in pre-hospital urgent and emergency care: a review of research evidence and priorities for future research. Department of Health; 2010. https://www.gov.uk/government/publications/building-the-evidence-base-in-pre-hospital-urgent-and-emergency-care-a-review-of-research-evidence-and-priorities-for-future-research: Accessed November 29, 2017.
- Jensen JL, Bigham BL, Blanchard I, Dainty K, Socha D, Carter A, et al. The Canadian national EMS research agenda: a mixed methods consensus study. CJEM. 2013;15:73–82.PubMedView ArticleGoogle Scholar
- Tippett V, Clark M, Woods S, FitzGerald G. Towards a national research agenda for the ambulance and pre-hospital sector in Australia. J Emerg Primary Health Care. 2003;1:1–2.Google Scholar
- Lockey DJ. Research questions in pre-hospital trauma care. PLoS Med. 2017;14:1002345.View ArticleGoogle Scholar
- Nichol G, Huszti E. Design and implementation of resuscitation research: special challenges and potential solutions. Resuscitation. 2007;73:337–46.PubMedView ArticleGoogle Scholar
- Sayre MR, White LJ, Brown LH, McHenry SD. National EMS research agenda. Prehosp Emerg Care. 2002;6(3 Suppl):S1–43.Google Scholar
- Leonard JC, Scharff DP, Koors V, Brooke Lerner E, Adelgais KM, Anders J, et al. A qualitative assessment of factors that influence emergency medical services partnerships in prehospital research. Acad Emerg Med. 2012;19:161–73.PubMedView ArticleGoogle Scholar
- Gaba DM. The future vision of simulation in health care. Qual Saf Health Care. 2004;13(suppl 1):2–10.View ArticleGoogle Scholar
- Abelsson A, Rystedt I, Suserud B-O, Lindwall L. Mapping the use of simulation in prehospital care - a literature review. Scand J Trauma Resusc Emerg Med. 2014;22:22.PubMedPubMed CentralView ArticleGoogle Scholar
- Brummer S, Dickinson ET, Shofer FS, McCans JP, Mechem CC. Effect of night vision goggles on performance of advanced life support skills by emergency personnel. Mil Med. 2006;171:280–2.PubMedView ArticleGoogle Scholar
- Skorning M, Bergrath S, Rörtgen D, Beckers SK, Brokmann JC, Gillmann B, et al. Teleconsultation in pre-hospital emergency medical services: real-time telemedical support in a prospective controlled simulation study. Resuscitation. 2012;83:626–32.PubMedView ArticleGoogle Scholar
- Hagiwara MA, Sjöqvist BA, Lundberg L, Suserud BO, Henricson M, Jonsson A. Decision support system in prehospital care: a randomized controlled simulation study. Am J Emerg Med. 2013;31:145–53. https://doi.org/10.1016/j.ajem.2012.06.030.
- Söderholm HM, Sonnenwald DH, Manning JE, Cairns B, Welch G, Fuchs H. Exploring the potential of video technologies for collaboration in emergency medical care: Part II. Task performance. J Am Soc Inf Sci. 2008;59(14):2335–2349.Google Scholar
- Söderholm HM, Sonnenwald DH. Visioning future emergency healthcare collaboration: perspectives from large and small medical centers. J Assoc Inf Sci Technol. 2010;61:1808–23.View ArticleGoogle Scholar
- Segall NW, Taekman JM. Human patient simulation as a research tool in cognitive engineering. Syst Man Cybern. 2007;ISIC2007:2256–60.Google Scholar
- Lammers R, Byrwa M, Fales W. Root causes of errors in a simulated prehospital pediatric emergency. Acad Emerg Med. 2012;19:37–47.PubMedView ArticleGoogle Scholar
- Hinchey PR, De Maio VJ, Patel A, Cabañas JG. Air medical providers' physiological response to a simulated trauma scenario. Air Med J. 2011;30:86–92.PubMedView ArticleGoogle Scholar
- Leblanc VR, Regehr C, Tavares W, Scott AK, Macdonald R, King K. The impact of stress on paramedic performance during simulated critical events. Prehosp Disaster Med. 2012;27:369–74.PubMedView ArticleGoogle Scholar
- Studnek JR, Fernandez AR, Shimberg B, Garifo M, Correll M. The association between emergency medical services field performance assessed by high-fidelity simulation and the cognitive knowledge of practicing paramedics. Acad Emerg Med. 2011;18:1177–85.PubMedView ArticleGoogle Scholar
- Alexander M. Reasoning processes used by paramedics to solve clinical problems. Ann Arbor: The George Washington University; 2009.Google Scholar
- Henriksson O, Lundgren P, Kuklane K, Holmér I, Naredi P, Bjornstig U. Protection against cold in prehospital care: evaporative heat loss reduction by wet clothing removal or the addition of a vapor barrier--a thermal manikin study. Prehosp Disaster Med. 2012;27:53–8.PubMedView ArticleGoogle Scholar
- Rissanen S, Jousela I, Jeong J-R, Rintamäki H. Heat stress and bulkiness of chemical protective clothing impair performance of medical personnel in basic lifesaving tasks. Ergonomics. 2008;51:1011–22.PubMedView ArticleGoogle Scholar
- Brindley PG, Dunn WF. Simulation for clinical research trials: a theoretical outline. J Crit Care Med. 2009;24:164–7.View ArticleGoogle Scholar
- Bano M, Zowghi D. A systematic review on the relationship between user involvement and system success. Inf Softw Technol. 2015;58:148–69.View ArticleGoogle Scholar
- Aggarwal R, Mytton OT, Derbrew M, Hananel D, Heydenburg M, Issenberg B, et al. Training and simulation for patient safety. Qual Saf Health Care. 2010;19(Suppl 2):34–43.View ArticleGoogle Scholar
- Garbayo L, Stahl J. Simulation as an ethical imperative and epistemic responsibility for the implementation of medical guidelines in health care. Med Health Care Philos. 2017;20:37–42.PubMedView ArticleGoogle Scholar
- Lioce L, Meakim CH, Fey MK, Chmil JV, Mariani B, Alinier G. Standards of best practice: simulation standard IX: simulation design. Clin Simul Nurs. 2015;11(6):309–315.Google Scholar
- Engström H, Andersson Hagiwara M, Backlund P, Lebram M, Lundberg L, Johannesson M, et al. The impact of contextualization on immersion in healthcare simulation. Adv Simul. 2016;1:1–11.View ArticleGoogle Scholar
- Backlund P, Engström H, Hagiwara M, Johannesson M, Maurin Söderholm H. Enhancing immersion with contextualized scenarios: role-playing in prehospital care training. Games and Virtual Worlds for Serious Applications (VS-Games). 2015; 167-170. doi: https://doi.org/10.1109/VS-GAMES.2015.7295772.
- Backlund P,Engström H, Johannesson M, Lebram M, Andersson Hagiwara M, Lundberg L, Maurin Söderholm, H. The S.A.R.E.K simulation environment: technical description of a flexible training environment for prehospital care. http://urn.kb.se/resolve?urn=urn:nbn:se:his:diva-13558; 2017. Accessed November 29, 2017.
- Carter H, Thompson J. Defining the paramedic process. Aust J Prim Health. 2015;21:22–6.PubMedView ArticleGoogle Scholar
- Jensen J, Croskerry P, Travers A. EMS: consensus on paramedic clinical decisions during high-acuity emergency calls: results of a Canadian Delphi study. CJEM. 2011;13.Google Scholar
- Backlund P, Maurin Söderholm H, Engström H, Andersson Hagiwara M, Lebram M. Breaking out of the bubble putting simulation into context to increase immersion and performance. Simul Gaming; 2018. https://doi.org/10.1177/1046878118772612.
- Hagiwara MA, Backlund P, Söderholm HM, Lundberg L, Lebram M, Engström H. Measuring participants’ immersion in healthcare simulation: the development of an instrument. Adv Simul. 2016;1:1–9.View ArticleGoogle Scholar
- Scerbo MW, Murray WB, Alinier G, Antonius T, Caird J, Stricker E, Rice J, Kyle R. A path to better healthcare simulation systems: leveraging the integrated systems design approach. Simul Healthc. 2011;6(7):S20–3.PubMedView ArticleGoogle Scholar
- Sharp H. In: Preece J, Rogers Y, editors. Interaction design: beyond human-computer interaction. 4th ed. Chichester: Wiley; 2015.Google Scholar
- Kuutti K, Bannon LJ. The turn to practice in HCI: towards a research agenda. In: Proceedings of the SIGCHI conference on human factors in computing systems. Toronto: ACM; 2014. p. 3543–52. 2557111.Google Scholar
- Neale DC, Carroll JM, Rosson MB. Evaluating computer-supported cooperative work: models and frameworks. In: Proceedings of the 2004 ACM conference on computer supported cooperative work. Chicago: ACM; 2004. p. 112–21. 1031626.Google Scholar