- Research
- Open access
- Published:
Evaluating the effects of simulation training on stroke thrombolysis: a systematic review and meta-analysis
Advances in Simulation volume 9, Article number: 11 (2024)
Abstract
Background
Ischaemic strokes are medical emergencies, and reperfusion treatment, most commonly intravenous thrombolysis, is time-critical. Thrombolysis administration relies on well-organised pathways of care with highly skilled and efficient clinicians. Simulation training is a widespread teaching modality, but results from studies on the impact of this intervention have yet to be synthesised. This systematic review and meta-analysis aimed to synthesise the evidence and provide a recommendation regarding the effects of simulation training for healthcare professionals on door-to-needle time in the emergency thrombolysis of patients with ischaemic stroke.
Methods
Seven electronic databases were systematically searched (last updated 12th July 2023) for eligible full-text articles and conference abstracts. Results were screened for relevance by two independent reviewers. The primary outcome was door-to-needle time for recombinant tissue plasminogen activator administration in emergency patients with ischaemic stroke. The secondary outcomes were learner-centred, improvements in knowledge and communication, self-perceived usefulness of training, and feeling ‘safe’ in thrombolysis-related decision-making. Data were extracted, risk of study bias assessed, and analysis was performed using RevMan™ software (Web version 5.6.0, The Cochrane Collaboration). The quality of the evidence was assessed using the Medical Education Research Study Quality Instrument.
Results
Eleven studies were included in the meta-analysis and nineteen in the qualitative synthesis (n = 20,189 total patients). There were statistically significant effects of simulation training in reducing door-to-needle time; mean difference of 15 min [95% confidence intervals (CI) 8 to 21 min]; in improving healthcare professionals’ acute stroke care knowledge; risk ratio (RR) 0.42 (95% CI 0.30 to 0.60); and in feeling ‘safe’ in thrombolysis-related decision-making; RR 0.46 (95% CI 0.36 to 0.59). Furthermore, simulation training improved healthcare professionals' communication and was self-perceived as useful training.
Conclusion
This meta-analysis showed that simulation training improves door-to-needle times for the delivery of thrombolysis in ischaemic stroke. However, results should be interpreted with caution due to the heterogeneity of the included studies.
Background
Stroke is the second-leading cause of mortality worldwide [1]. The vast majority of strokes have an ischaemic pathogenesis [2,3,4] though underlying mechanisms may be variable and complex [3]. From the onset of clinical symptoms, the ischaemic core is surrounded by neurons that may remain viable for several hours prior to the development of irreversible ischaemic injury [5, 6]. This affords a treatment window where prompt restoration of blood supply may permit the survival of the threatened neurons, known as the penumbra [6,7,8,9]. The determinants of whether cerebral ischaemia leads to infarction are anatomical (relating to the presence and extent of protective collateral circulation) and time-critical, with respect to having access to reperfusion treatment [10, 11]. Stroke patients identified early have the greatest potential to benefit from reperfusion either via mechanical thrombectomy (currently restricted mainly to specialised centres) [12] but more commonly with intravenous thrombolysis using recombinant tissue plasminogen activator (rtPA), through therapeutic benefit diminishes with time [6,7,8,9].
Consequently, emphasis on awareness of stroke symptoms and the time-critical nature of assessment has increased through organisations like Brain Attack Coalition [13] and public health campaigns. The adoption of tools such as Facial drooping, Arm weakness, Speech difficulties, and Time (FAST), now used widely by paramedics, improves recognition and enables pre-alert of the receiving hospital to patient arrival [14]. Reduced time from the hospital door to rtPA administration (door-to-needle time) [15] alone decreases mortality and haemorrhagic transformation associated with ischaemic stroke [6, 16], with a target of under 60 min set internationally [17,18,19]. Therefore, clinical pathways for emergency stroke patients have to be responsive and efficient throughout, from first notification by ambulance services to the Emergency Department (ED), patient reception, computed tomography (CT) imaging, through to obtaining specialist radiology and clinical assessment to determine the best course of action, with the aim of swiftly initiating intravenous thrombolysis if appropriate [20]. Barriers to administering rtPA to those patients who may benefit include clinician uncertainty regarding the administration of treatment with the potential to cause harm and lack of practice in delivery [21, 22]. Current stroke guidelines urge the establishment of educational initiatives to improve outcomes in patients presenting as emergencies with ischaemic stroke [23].
Simulation training has been widely used as an educational modality in several specialties with “time-dependent” processes such as trauma care and life support [24,25,26]. However, adoption has been slower within the neurological sciences [27], and evidence suggests that human factors are the most significant rate-limiting component in the delivery of emergency care to stroke patients [28]. In this clinical context, simulation training may provide an opportunity for teams to increase knowledge and develop the processes, skills, and teamwork required to optimise the safe delivery of intravenous thrombolysis in educationally beneficial representations of real-world environments [12, 29].
The effectiveness of simulation training on the investigated outcomes can be assessed using Kirkpatrick’s Four-Level Training Evaluation model, which identifies the effects of particular training on the organisation level and patients as a whole [30], and is considered the reference standard for evaluation of training in healthcare contexts [31].
Although there are numerous primary studies on the effects of simulation training on door-to-needle time, to the authors’ knowledge, no meta-analysis on this topic exists. This systematic review and meta-analysis aimed to address the gap in the literature by assessing the effects of simulation training for healthcare professionals on door-to-needle time delivery of emergency thrombolysis in ischaemic stroke.
Methods
Study design
This systematic review and meta-analysis were performed per the guidelines of the Cochrane Handbook of Systematic Reviews of Interventions [32] and the Preferred Reporting Items for Systematic Review and Meta-Analysis (PRISMA) statement [33]. Appendix 1 details the PRISMA checklist. The objective was to synthesise the available evidence regarding the effects of simulation training for healthcare professionals on door-to-needle time delivery of emergency thrombolysis in ischaemic stroke patients.
Study eligibility
Any study investigating healthcare professional simulation training with respect to intravenous thrombolysis administration in stroke patients versus no intervention was eligible for inclusion, with the primary outcome being door-to-needle time and learner-centred secondary outcomes. Simulation training or activity was defined as the complete set of events and actions that occur from initiation to termination of a particular simulation event [34]. No intervention was defined as any period without simulation training.
Table 1 illustrates the eligibility criteria.
Study identification
The literature search was first conducted on 17th May 2023 and last updated on 12th July 2023 using EMBASE, PubMed, PsycINFO, ERIC, CINAHL, Scopus, and Google Scholar. The entry date was 1990 when the results of the first recombinant tissue plasminogen activator (rtPA) trial were published, which was followed by the United States Food and Drug Administration’s approval for rtPA as a treatment for acute ischaemic stroke in 1996 [35].
The search was performed by two independent researchers (SA and AA). The search strategy included MeSH and text search terms, agreed upon by the research team, combined with Boolean operators “AND” and “OR”. Details of the search strategies are listed in Appendix 2.
Electronic search strategies were limited to adult humans (over 18 years old), and no restrictions on language or publication types were applied. Citation lists of included publications were manually scrutinised for additional relevant studies, and a manual search of international conference abstract databases was performed, including the Association for Simulated Practice in Healthcare [36], Society for Simulation in Europe [37], International Meeting on Simulation in Healthcare [38], Australasian Simulation Congress [39], and the International Clinical Skills Conference [40].
Study selection
All titles and abstracts retrieved were independently screened for relevance. Using Microsoft Excel®, duplicates were manually removed, and non-relevant articles were excluded. The full texts of all identified studies were retrieved and assessed for eligibility independently by two researchers (SA and AA). Studies meeting the eligibility criteria were included following the Cochrane Handbook for Systematic Reviews of Interventions. Discrepancies between SA and AA were discussed and agreed upon with a senior reviewer (AM), ensuring no potentially relevant papers were discarded.32
Data extraction
Data were extracted based on the guidelines for health care simulation research [41] and inputted into a Microsoft Excel® spreadsheet (Appendix 3). Non-English articles were translated completely. All corresponding authors of included studies with any missing data were contacted.
Data synthesis
Quantitative analysis was performed using RevMan™ (Web version 5.6.0, The Cochrane Collaboration) [42]. A meta-analysis was performed for the primary outcome, with results expressed as mean difference with 95% confidence intervals (CI) and secondary outcome results expressed as risk ratio (RR) with 95% CI. Where possible, median and interquartile range (IQR) values were converted to mean \(\left(\overline{{\text{x}} }\right)\), and standard deviation (SD) using the \(\overline{{\text{x}} }=\frac{{Q}_{1}+median+{Q}_{3}}{3}\) and \({\text{SD}}=\frac{{Q}_{3}-{Q}_{1}}{1.35}\) formulae [43] (Q1 = 25th and Q3 = 75th percentiles). A p-value of < 0.05 was considered statistically significant. Heterogeneity between studies was assessed by the I2 score, using the random-effects meta-analysis model to account for data heterogeneity [32]. Two sensitivity analyses were performed for the primary outcome. The first included studies eligible for meta-analysis with low-to-moderate risk of bias and the second, studies of moderate-to-high methodological quality. Subgroup analysis was not performed for the primary outcome due to insufficient details on patient characteristics being available.
Assessment of risk of bias and study quality
The Cochrane ‘Risk of Bias in Non-Randomised Studies of Interventions’ (ROBINS-I) tool was used to assess the risk of bias [44], with graphs generated by Robvis [45]. Appendix 4 includes details of the ROBINS-I assessment. The quality of the included studies was assessed using the Medical Education Research Study Quality Instrument (MERSQI); low-quality studies scored MERSQI ≤ 12 [46].
Results
Identification of studies and study selection
The complete search strategy identified 1590 potentially relevant articles. After duplicate removal and independent assessment of titles and abstracts for relevance, 287 were selected for full-text review. Nineteen studies [47,48,49,50,51,52,53,54,55,56,57,58,59,60,61,62,63,64,65] met the inclusion criteria and were included in the systematic review, ten full-text articles [47, 51, 52, 55,56,57,58, 60, 63, 65] and nine conference abstracts [48,49,50, 53, 54, 59, 61, 62, 64]. Eleven studies with complete data were included in the meta-analysis [47, 49, 51, 52, 55,56,57,58, 60, 63, 65].
Figure 1 outlines the PRISMA flow diagram following the Cochrane Handbook for Systematic Reviews of Interventions [32].
Study characteristics
Of the nineteen included studies published between 2016 and 2023, seven were conducted in the USA [50, 51, 53, 55, 58, 61, 64] three in Germany [47, 52, 63], two in Australia [54, 59] and one each in Austria [62], Brazil [56], Czech Republic [65], France [57], Japan [49], Norway [60], and the United Kingdom (UK) [48]. One full-text article published in German was translated [47]. Eleven studies included a total number of 20,189 patients [47, 49, 51, 52, 55,56,57,58, 60, 63, 65], and the remaining eight studies did not report patient numbers [48, 50, 53, 54, 59, 61, 62, 64]. Thirteen studies included 1197 healthcare professionals [47, 50,51,52,53, 55,56,57,58, 60, 61, 63, 65]; and the remaining six did not report participant numbers.48,49,54,59,62,64 All studies compared door-to-needle times before and after simulation training. Thirteen studies reported multidisciplinary cooperation [47,48,49, 52,53,54, 56, 57, 59, 60, 62, 63, 65], five focused on physicians [50, 51, 55, 58, 61], and one on nurses [64]. Manikins were used for simulation training in five studies [47, 50, 52, 56, 63], four studies used hospital staff as patients [53, 57, 58, 65] four used simulated patients [55, 59,60,61], (one specifically recruiting previous stroke patients) [60], and six did not specify [48, 49, 51, 54, 62, 64].
Three studies utilised Crew Resource Management aspects in reducing door-to-needle times [47, 52, 63]. Crew Resource Management is a training concept focusing on non-technical and behavioural skills such as situational awareness, decision-making, leadership, and teamwork [66, 67].
Four studies evaluated improvements in knowledge [47, 51, 52, 55], and four assessed the self-perceived usefulness of simulation training [52, 60, 63, 65]. Two studies assessed feeling ‘safe’ in thrombolysis-related decision-making [47, 52], and two evaluated improvements in communication [47, 65]. Concurrent with the introduction of simulation training, five studies underwent stroke protocol revisions [49, 54, 55, 60, 62] three used multifaceted interventions [47, 48, 54] and one began another door-to-needle time-related project in their Emergency Department (ED) 6 months after the introduction of the simulation intervention [51].
Table 2 presents the characteristics of the included studies. Appendix 5 presents a list of excluded studies (n = 32 studies).
Outcomes
The outcomes are divided into primary and secondary outcomes.
Primary outcome
Door-to-needle time
Eleven studies were eligible for meta-analysis on door-to-needle time (n = 20,189 patients) [47, 49, 51, 52, 55,56,57,58, 60, 63, 65]. Meta-analysis showed a statistically significant effect favouring post-simulation training in reducing door-to-needle time compared to pre-simulation training, with a pooled effect size of − 14.2 (95% CI − 20.6, − 7.7) (Fig. 2). The heterogeneity was high (I2 = 98%). The quality of studies ranged from 11.5 to 14.5 on the MERSQI scale.
The studies not included in the meta-analysis due to incomplete data [48, 50, 53, 54, 59, 61, 62, 64] individually showed reduced door-to-needle times post-simulation training. Three studies reported median reductions to 54 [59], 51 [54], and 32 min [62], respectively, and four studies reported mean reductions of 17 [48], 11 [64], 9.7 [50], and 9 min [53], respectively. In addition, one study reported a 100% improvement post-simulation [61]. The quality of studies ranged from 9.0 to 12.0 on the MERSQI scale.
Sensitivity analysis
Sensitivity analysis was performed for the primary outcome of door-to-needle time in nine studies with an overall low-to-moderate risk of bias [47, 49, 51, 52, 55,56,57,58, 63]. Meta-analysis results remained consistent with a statistically significant pooled effect size favouring post-simulation training, mean difference − 15.7 (95% CI − 24.1 to − 7.3) min (Fig. 3).
A sensitivity analysis was also performed in seven studies [52, 56,57,58, 60, 63, 65] of moderate-to-high methodological quality on the MERSQI scale (≥ 12.5 out of 18), also with a statistically significant pooled effect in favour of post-simulation training, mean difference − 11.6 (95% CI − 19.8 to − 3.5) min (Fig. 4).
Secondary outcomes
Improvement in acute stroke knowledge
Four studies [47, 51, 52, 55] assessed improvement in knowledge through surveys, reporting improvements ranging from 46.6% pre-simulation training to 84.6% post-simulation training. Meta-analysis showed a statistically significant effect in favour of post-simulation training in improving healthcare professionals’ acute stroke knowledge, with a pooled RR of 0.42 (95% CI 0.30 to 0.60) (Fig. 5).
Feeling ‘safe’ in thrombolysis-related decision-making
Two studies [47, 52] assessed healthcare professionals' feelings of ‘safety’ in thrombolysis-related decision-making, reporting improvements ranging from 26.7 to 74.3%. Meta-analysis showed a statistically significant effect favouring post-simulation training with respect to improved feelings of safety in thrombolysis-related decision-making, with a pooled RR of 0.46 (95% CI 0.36 to 0.59) (Fig. 6).
Self-perceived usefulness of simulation training
Four studies assessed the self-perceived usefulness of simulation training using Likert scales, showing relatively high scores of 95.5% [63], 90.0% [60], 88.4% [52], and 85.0% [65], respectively (Table 3A). The average improvement score was 89.7%. No pre-simulation data was available; therefore, meta-analysis was not possible.
Two studies [47, 63] expressed interest in regular simulation sessions; one reported that 93.6% of participants would welcome annual training [63], another desired annual (46.0%) and semi-annual (49.0%) repetition of training [47].
Improvement in communication
Two studies [47, 65] assessed improvements in communication post-simulation, reporting 90.0% [47] and 77.0% [65] improvement (Table 3B). No pre-simulation data was available; therefore, meta-analysis was not possible.
Publication bias
A Funnel plot of the eleven studies included in the meta-analysis with respect to door-to-needle time was generated. Visual inspection reveals asymmetry (Fig. 7).
Risk of Bias (ROBINS-I) in included studies
The risk of bias was assessed using a ROBINS-I risk-of-bias graph (Fig. 8A, B). Most studies had good participant selection of healthcare professionals and outcome measurements, with low deviations from intended interventions. Bias from confounding, missing data, and selective reporting of results were difficult to assess due to insufficient information. One study had an overall low risk of bias [57], eight had a moderate risk of bias [47, 49, 51, 52, 55, 56, 58, 63], two had a serious risk of bias [60, 65], and eight had insufficient information [48, 50, 53, 54, 59, 61, 62, 64].
Heterogeneity
No studies were excluded based on methodological heterogeneity. There was a high estimate of statistical heterogeneity (I2 = 98%) in those studies included in our primary analysis with respect to door-to-needle time for intravenous thrombolysis in ischaemic stroke patients (Fig. 2).
Discussion
In this systematic review and meta-analysis, we found that simulation had a beneficial effect, reducing door-to-needle time for the emergency delivery of intravenous thrombolysis in patients with ischaemic stroke by about 15 min. For each minute in a middle cerebral artery stroke without treatment, around 1.9 million neurons are lost [68]. Each 15-min reduction in delay to treatment may achieve a 4% increase in good clinical outcomes [69]. As such, numerous guidelines are advocating for a downward revision in door-to-needle target times, aiming for under 30 min [70]. Given the well-established relationship between early recombinant tissue plasminogen activator (rtPA) administration and improved patient outcomes [70], an improvement of this magnitude has important clinical implications.
Despite notable methodological and statistical heterogeneity among the included studies, sensitivity analysis corroborated the collective impact favouring post-simulation training. Methodological variances arose from several sources. The studies were conducted across ten different countries, each with particular healthcare system nuances. Though international stroke care standards are recognised, these may be harder to fulfil in some settings than others, and the areas for gain with regard to improving door-to-needle times may vary greatly. For example, delays may be apparent to a greater or lesser extent at different points in the patient journey, dependent on resources such as a dedicated stroke physician or access to computed tomography (CT) scanning. Such variations would be challenging to control for, even in multicentre randomised controlled trials. Moreover, study participants varied significantly in terms of numbers and healthcare professions, including physicians of various levels of experience, from stroke care specialists to radiologists, paramedics, and nurses. There was also diversity in the approaches to conducting simulations, both in terms of the environments the simulations were conducted in, ranging from in situ simulations to classroom-based scenarios, and how patients were represented within the simulations, ranging from patient actors to manikins.
While implementing simulation training, five studies concurrently revised their stroke protocol, raising the possibility of validation bias, and three used multifaceted interventions, increasing confounding and difficulty attributing complete improvements in door-to-needle time to simulation training alone. However, simulation training cannot be considered a stand-alone activity in itself but rather one part of a multi-faceted approach to quality improvement, systems redesign and testing, and team/organisational culture [71, 72]. Translational simulation for transformative rather than pedagogical purposes is being recognised as a growing field as a means to promote change within clinical systems [73,74,75]. Considering that simulation training is an entanglement of activities in process and quality improvement, such as testing new protocols, a different sensitivity analysis, and separating studies with concurrent interventions, was not conducted.
Despite the explained methodological diversity across the studies, there was adequate consistency in reported outcomes related to door-to-needle time and learner experiences to synthesise the results. Our findings align with existing literature on the application of simulation training to enhance aspects of care in other emergency patient scenarios, such as cardiac arrest [76], cardiac catheterisation [77], extracorporeal membrane oxygenation [78], and maternal cardiac arrest [79].
With respect to our learner-centred secondary outcomes, we found that stroke subject knowledge, clinical perception of safety in thrombolysis decision-making, self-perceived usefulness, and communication were all found to increase after simulation training, mirroring the existing literature from other clinical environments [80,81,82]. Drawing a direct causative relationship is not possible for these qualitative outcomes, but it seems likely that the suitability of simulation training for understanding and improving macro-ergonomics and human factors is important [83].
The successful and timely administration of intravenous thrombolysis involves highly complex systems and multidisciplinary teams. Expert consensus acknowledges simulation training as particularly beneficial for testing, practising, executing, and evaluating peri-operative microsystems [84]. These microsystems are also high-risk, complex hospital systems involving large multidisciplinary teams caring for patients having surgical procedures, and our findings support the possibility that this also applies to acute stroke management. Additionally, simulation training is well-recognised for its benefits in multidisciplinary team education [85, 86], which may contribute to our findings of an overall reduction in door-to-needle time. Simulation training in neurocritical care has been slower to gain acceptance compared to other medical disciplines [87]. This may be partly due to the challenge of replicating time-sensitive neurological emergencies like stroke and status epilepticus using simulation manikins or actors [86, 87].
Kirkpatrick’s model for evaluation of training is a four-step model which categorises learning outcomes into four levels: (1) reaction, (2) learning, (3) behaviour, and (4) results [88]. In clinical environments, Level 4 outcomes can be represented by patient-centred outcomes. This review implies that both Level 2 (learner-reported outcomes) and Level 4 outcomes (door-to-needle time) align with Kirkpatrick’s scale. A recent systematic review that covered a wide range of medical education simulations only identified 13 studies for inclusion and reported a paucity of studies employing Kirkpatrick’s Level 4 outcomes to evaluate simulation training [89].
While the overall quality of the studies included in this review is, at best, moderate, it is worth noting that this study is not the first to question the quality of studies in simulation training. Even when reviewing randomised controlled trials of simulations [90], authors found a high risk of bias (86%), a lack of reported findings (4%), an absence of registered protocols, as well as various issues with blinding and concealment. While simulation training appears to be a valuable technique in various aspects of medical education, there is sufficient equipoise for further high-quality, standardised studies evaluating Kirkpatrick’s Level 4 outcomes.
Strengths
This meta-analysis is the first to assess the effects of simulation training on door-to-needle time regarding emergency thrombolysis delivery to patients with ischaemic stroke and has important strengths. First, it was conducted according to PRISMA guidelines [32] and encompassed a comprehensive search strategy with no language restrictions. Second, the authors of all included studies with missing data were contacted regarding the existence of any other data to ensure methodological robustness. Third, methodological data extraction utilised a custom-created extraction sheet. Fourth, the ROBINS-I tool was applied to accurately assess the risk of bias, facilitating the estimation of the true effects of simulation training [44]. Lastly, two sensitivity analyses were performed to ensure the quality and robustness of the results [91].
Limitations
The limitations of this meta-analysis primarily pertain to the weaknesses of the source articles. First, the limited number of studies and variance in methods (only one was a randomised control study), sample sizes, study periods, and number of strokes may influence the validity of the findings. We found a high degree of heterogeneity among the included studies, and though we used a random-effects model to account for this, we recognise this as a weakness, affecting the strength of our conclusions. Second, the concurrent introduction of simulation training and revision of stroke protocols in some studies raises the possibility of validation bias. While this is important for meta-analysis, simulation training is not a stand-alone activity and, therefore, must be interpreted within the context of quality improvement. Third, the critical appraisal using the ROBINS-I tool was performed by one independent reviewer, which may have increased the risk of bias. Fourth, the asymmetry of the funnel plot indicates heterogeneity and publication bias among the included studies. Fifth, translational simulation was not included as a search term, and therefore, the search strategy may have failed to capture evidence on this aspect. Sixth, the reported medians and interquartile ranges (IQR) were converted to means and standard deviations (SD), respectively, which may have introduced bias and imprecise estimates. Seventh, a sensitivity analysis separating studies with concurrent interventions was not performed due to simulation training being an entanglement of activities in process and quality improvements, which may have increased the risk of bias when assessing the pure effect of simulation. Lastly, we acknowledge that this review was not registered with PROSPERO.
Future directions
There is a need for robust and standardised multi-institutional studies with randomised controlled trial designs using Kirkpatrick’s Level 4 outcomes and larger sample sizes, inclusive of all healthcare professionals involved in the delivery of emergency thrombolysis in ischaemic stroke. Future studies should standardise the reporting of simulation-based interventions using standardised reporting tools [41], clearly demarcating its different types using rigorous and reproducible outcome measures, namely the Kirkpatrick Model [92]. Future work should consider that simulation for healthcare improvement is one part of any contemporary quality improvement strategy, and as such, the results of simulation-based studies need to be interpreted and considered alongside simultaneous contextual changes such as protocol refinements or process changes within complex systems.
Conclusion
This meta-analysis showed a significant beneficial effect of simulation training in reducing door-to-needle time delivery of emergency thrombolysis in ischaemic stroke. Additionally, simulation training was associated with improved knowledge, communication, and a feeling of ‘safety’ in thrombolysis-related decision-making. The results should be interpreted with caution due to the heterogeneity of the included studies. Further high-quality research is warranted to strengthen the evidence base and establish confidence in the effect measures.
Availability of data and materials
Data is available upon request.
Abbreviations
- CT:
-
Computed tomography
- CI:
-
Confidence interval
- ED:
-
Emergency department
- FAST:
-
Facial drooping, Arm weakness, Speech difficulties and Time
- IQR:
-
Interquartile range
- MERSQI:
-
Medical Education Research Study Quality Instrument
- PICO:
-
Participants, Intervention, Comparisons and Outcomes
- PRISMA:
-
Preferred Reporting Items for Systematic Review and Meta-Analysis
- rtPA:
-
Recombinant tissue plasminogen activator
- RevMan:
-
Review Manager
- ROBINS-I:
-
Risk of Bias in Non-Randomised Studies of Interventions
- RR:
-
Risk ratio
- SD:
-
Standard deviation
- UK:
-
United Kingdom
- USA:
-
United States of America
References
Feigin VL, Brainin M, Norrving B, Martins S, Sacco RL, Hacke W, et al. World Stroke Organization (WSO): Global Stroke Fact Sheet 2022. 2022;17(1):18–29.
Musuka TD, Wilton SB, Traboulsi M, Hill MD. Diagnosis and management of acute ischemic stroke: speed is critical. CMAJ. 2015;187(12):887–93.
Kuriakose D, Xiao Z. Pathophysiology and treatment of stroke: present status and future perspectives. Int J Mol Sci. 2020;21(20):7609.
Uzun Jacobson E, Bayer S, Barlow J, Dennis M, MacLeod MJ. The scope for improvement in hyper-acute stroke care in Scotland. ORCH. 2015;6:50–60.
Patel P, Yavagal D, Khandelwal P. Hyperacute management of ischemic strokes: JACC focus seminar. J Am Coll Cardiol. 2020;75(15):1844–56.
Emberson J, Lees KR, Lyden P, Blackwell L, Albers G, Bluhmki E, et al. Effect of treatment delay, age, and stroke severity on the effects of intravenous thrombolysis with alteplase for acute ischaemic stroke: a meta-analysis of individual patient data from randomised trials. Lancet. 2014;384(9958):1929–35.
Rodrigues FB, Neves JB, Caldeira D, Ferro JM, Ferreira JJ, Costa J. Endovascular treatment versus medical care alone for ischaemic stroke: systematic review and meta-analysis. BMJ. 2016;353:i1754.
Hacke W, Kaste M, Bluhmki E, Brozman M, Davalos A, Guidetti D, et al. Thrombolysis with alteplase 3 to 4.5 hours after acute ischemic stroke. NEJM. 2008;359(13):1317–29.
Marler J. Tissue plasminogen activator for acute ischemic stroke. NEJM. 1995;333(24):1581–8.
Bhalla A, Patel M, Birns J. An update on hyper-acute management of ischaemic stroke. Clin Med. 2021;21(3):215–21.
Bader MK, Palmer S. What’s the “hyper” in hyperacute stroke? Strategies to improve outcomes in ischemic stroke patients presenting within 6 hours. AACN Adv Crit Care. 2006;17(2):194–214.
Casolla B, Leciñana MAd, Neves R, Pfeilschifter W, Svobodova V, Jung S, et al. Simulation training programs for acute stroke care: objectives and standards of methodology. ESJ. 2020;5(4):328–35.
Alberts MJ, Latchaw RE, Jensen Mary E, Bass R, Ruff R, Foell K, et al. Revised and updated recommendations for the establishment of primary stroke centers: a summary statement from the brain attack coalition. Stroke. 2011;42(9):2651–65.
Brown C, Macleod M. The positive predictive value of an ambulance prealert for stroke and transient ischaemic attack. Eur J Med J. 2018;25(6):411–5.
Fonarow GC, Smith EE, Saver JL, Reeves MJ, Hernandez AF, Peterson ED, et al. Improving door-to-needle times in acute ischemic stroke: the design and rationale for the American Heart Association/American Stroke Association’s Target: Stroke Initiative. Stroke. 2011;42(10):2983–9.
Lansberg MG, Schrooten M, Bluhmki E, Thijs VN, Saver JL. Treatment time-specific number needed to treat estimates for tissue plasminogen activator therapy in acute stroke based on shifts over the entire range of the modified rankin scale. Stroke. 2009;40(6):2079–84.
Tong X, Wiltz JL, George MG, Odom EC, Coleman King SM, Chang T, et al. A decade of improvement in door-to-needle time among acute ischemic stroke patients, 2008 to 2017. Circ Cardiovasc Qual Outcomes. 2018;11(12):e004981.
Saver JL, Smith EE, Fonarow GC, Reeves MJ, Zhao X, Olson DM, et al. The golden hour and acute brain ischemia: presenting features and lytic therapy in over 30,000 patients arriving within 60 minutes of onset. Stroke. 2010;41(7):1431–9.
Powers WJ, Rabinstein AA, Ackerson T, Adevoe OM, Bambakidis NC, Becker K. 2018 Guidelines for the early management of patients with acute ischemic stroke: a guideline for healthcare professionals from the American Heart Association/American Stroke Association. J Vasc Surg. 2018;67(6):1934.
Monks T, Pitt M, Stein K, James M. Maximizing the population benefit from thrombolysis in acute ischemic stroke: a modeling study of in-hospital delays. Stroke. 2012;43(10):2706–11.
Eissa A, Krass I, Bajorek BV. Barriers to the utilization of thrombolysis for acute ischaemic stroke. J Clin Pharm Ther. 2012;37(4):399–409.
Lahr MMH, van der Zee D, Luijckx G, Vroomen PCAJ, Buskens E. A simulation-based approach for improving utilization of thrombolysis in acute brain infarction. Med Care. 2013;51(12):1101–5.
Powers W, Rabinstein A, Ackerson T, Adeoye O, Bambakidis N, Becker K, et al. Guidelines for the early management of patients with acute ischemic stroke: 2019 Update to the 2018 Guidelines for the Early Management of Acute Ischemic Stroke: A Guideline for Healthcare Professionals From the American Heart Association/American Stroke Association. Stroke. 2019;50(12):e344–418.
Larraga-García B, Quintana-Díaz M, Gutiérrez Á. Simulation-based education in trauma management: a scoping review. IJERPH. 2022;19(20):13546.
Chakravarthy B, Ter Haar E, Bhat SS, McCoy CE, Denmark TK, Lotfipour S. Simulation in medical school education: review for emergency medicine. WestJEM. 2011;12(4):461–6.
Binstadt ES, Dahms RA, Carlson AJ, Hegarty CB, Nelson JG. When the learner is the expert: a simulation-based curriculum for emergency medicine faculty. WestJEM. 2019;21(1):141–4.
Morris NA, Chang W, Tabatabai A, Gutierrez CA, Phipps MS, Lerner DP, et al. Development of neurological emergency simulations for assessment: content evidence and response process. Neurocrit Care. 2021;35(2):389–96.
Willems LM, Kurka N, Bohmann F, Rostek P, Pfeilschifter W. Tools for your stroke team: adapting crew-resource management for acute stroke care. Pract Neurol. 2019;19(1):36–42.
Al-Elq AH. Simulation-based medical teaching and learning. J Family Community Med. 2010;17(1):35–40.
Yardley S, Dornan T. Kirkpatrick’s levels and education “evidence.” Med Educ. 2012;46(1):97–106.
Kirkpatrick DL, Kirkpatrick JD. Evaluating training programs: the four levels. 3rd ed. San Francisco: Berrett-Koehler Publishers, Inc.; 2006.
Higgins JPT. Cochrane handbook for systematic reviews of interventions. 2011; Available at: https://handbook-5-1.cochrane.org/. Accessed 4 June 2023.
Moher D, Liberati A, Tetzlaff J, Altman D. Preferred reporting items for systematic reviews and meta-analyses: the PRISMA statement. BMJ. 2009;339:b2535.
The Society for Simulation in Healthcare. Healthcare simulation dictionary, Second Edition (2.1). 2020; Available at: https://www.ssih.org/Portals/48/v2_1-Final.pdf. Accessed 6 Sep, 2023.
Zivin JA. Acute stroke therapy with tissue plasminogen activator (tPA) since it was approved by the U.S. Food and Drug Administration (FDA). Ann Neurol. 2009;66(1):6–10.
Association for Simulated Practice in Healthcare. ASPiH. 2023; Available at: https://aspih.org.uk/. Accessed 25 June, 2023.
Society for Simulation in Europe. SESAM. 2023; Available at: https://www.sesam-web.org/. Accessed 25 June, 2023.
International Meeting on Simulation in Healthcare. IMSH. 2023; Available at: https://imsh2023.org/. Accessed 25 June, 2023.
Australasian Simulation Congress. ASC 2023. 2023; Available at: https://www.simulationcongress.com/. Accessed May, 2023.
International Clinical Skills Conference. ICSC. 2023; Available at: https://internationalclinicalskillsconference.com/. Accessed May, 2023.
Cheng A, Kessler D, Mackinnon R, Chang TP, Nadkarni VM, Hunt EA, et al. Reporting guidelines for health care simulation research: extensions to the CONSORT and STROBE Statements. Clin Simul Nurs. 2016;12(8):iii–xiii.
The Cochrane Collaboration. Review Manager Web (RevMan Web). 2022;5.6.0.
Wan X, Wang W, Liu J, Tong T. Estimating the sample mean and standard deviation from the sample size, median, range and/or interquartile range. BMC Med Res Methodol. 2014;14(1):135.
Sterne JA, Hernán MA, Reeves BC, Savović J, Berkman ND, Viswanathan M, et al. ROBINS-I: a tool for assessing risk of bias in non-randomised studies of interventions. BMJ. 2016;355: i4919.
McGuinness LA, Higgins J. Risk-of-bias VISualization (robvis): an R package and Shiny web app for visualizing risk-of-bias assessments. Res Syn Meth. 2020;1-7.
Reed DA, Beckman TJ, Wright SM, Levine RB, Kern DE, Cook DA. Predictive Validity Evidence for Medical Education Research Study Quality Instrument Scores: Quality of Submissions to JGIM’s Medical Education Special Issue. J Gen Intern Med. 2008;23(7):903–907.
Tahtali D, Bohmann F, Rostek P, Misselwitz B, Reihs A, Heringer F, et al. Crew resource management and simulator training in acute stroke therapy. Nervenarzt. 2016;87(12):1322–31.
Waterson F, Braithwaite I, Tuck I, Alcock R. A multi-modal approach to quality improvement: reducing “door-To-CT” time in potentially thrombolysable stroke patients. EMJ. 2016;33(12):909.
Ohara N, Kobayashi J, Goda T, Ikegami T, Watanabe K, Asada K, et al. Reducing door-to-needle times in acute ischemic stroke: multidisciplinary team-based approach at a single center. Stroke. 2017;48(suppl_1).
Richardson A, Ermak D, Krishnaiah B, Said-Said S, El-Ghanem M. Multidisciplinary simulation of stroke alerts in resident education leads to a 20% decrease in door to needle times. Stroke. 2017;48(suppl_1).
Ruff IM, Liberman AL, Caprio FZ, Maas MB, Mendelson SJ, Sorond FA, et al. A resident boot camp for reducing door-to-needle times at academic medical centers. Neurol Clin Prac. 2017;7(3):237–45.
Tahtali D, Bohmann F, Kurka N, Rostek P, Todorova-Rudolph A, Buchkremer M, et al. Implementation of stroke teams and simulation training shortened process times in a regional stroke network—a network-wide prospective trial. PLoS ONE. 2017;12(12):e0188231.
Tse-Chang K, Mendoza A, MacKenzie J, Woolfolk K, Jones K, Keasler D. Simulation based acute stroke responders training improves door-to-thrombolytic time. Stroke. 2017;48(suppl_1).
Windle E, Summers I, van Dijk J, Sanders L. Off-site and in situ simulation to improve performance and process for “Code Stroke". IJS. 2017;12(3_suppl):3–59.
Zidan A, Afzal U, Mao Y, Y Bradshaw D, G J. Stroke code simulation lab. Gen Med Open. 2017;1(2).
Carvalho VS, Picanço MR, Volschan A, Bezerra DC. Impact of simulation training on a telestroke network. Int J Stroke. 2018;14(5):500–7.
Haesebaert J, Nighoghossian N, Mercier C, Termoz A, Porthault S, Derex L, et al. Improving access to thrombolysis and inhospital management times in ischemic stroke: a stepped-wedge randomized trial. Stroke. 2018;49(2):405–11.
Mehta T, Strauss S, Beland D, Fortunato G, Staff I, Lee N. Stroke simulation improves acute stroke management: a systems-based practice experience. J Grad Med Educ. 2018;10(1):57–62.
Sanders L, Summers I, Scarff P, Windle E, van Dijk J. Code Stroke simulation training is associated with a sustained reduction in door-to-needle times. Int J Stroke. 2018;13(1):3–48.
Ajmi SC, Advani R, Fjetland L, Kurz KD, Lindner T, Qvindesland SA, et al. Reducing door-to-needle times in stroke thrombolysis to 13 min through protocol revision and simulation training: a quality improvement project in a Norwegian stroke centre. BMJ Qual Saf. 2019;28(11):939–48.
Singh N, Kumar V, Nazzal Y. Resident stroke simulation improves decision-making and door to needle time in Community Hospital. Neurology. 2019;92(15S):P3.3-052.
Bubel N, Pikija J, Mutzenbach J, Rosler C, Leitner U, Ganser B, et al. Reducing door to needle time and improving team interaction by establishing team training in acute ischemic stroke care. Int J Stroke. 2020;15(1S):608.
Bohmann FO, Gruber K, Kurka N, Willems LM, Herrmann E, du Mesnil de Rochemont R, et al. Simulation‐based training improves process times in acute stroke care (STREAM). Eur Neurol. 2022;29(1):138–148.
Rhew D, Upham JE. Really, Did a code stroke simulation improve compliance in patient care requirements? Stroke. 2022;53(Suppl_1):AWP31.
Svobodová V, Maršálková H, Volevach E, Mikulík R. Simulation-based team training improves door-to-needle time for intravenous thrombolysis. BMJ Open Qual. 2023;12(1):e002107.
Flin R, Maran N. Basic concepts for crew resource management and non-technical skills. Best Prac Res Clin Anaesthesiol. 2015;29(1):27–39.
Buljac-Samardžić M, Dekker-van Doorn CM, Maynard MT. What do we really know about crew resource management in healthcare?: An umbrella review on crew resource management and its effectiveness. J Patient Saf. 2021;17(8):e929–58.
Saver JL. Time is brain–quantified. Stroke. 2006;37(1):263–6.
Saver JL, Fonarow GC, Smith EE, Reeves M, Grau-Sepulveda M, Pan W, et al. Time to treatment with intravenous tissue plasminogen activator and outcome from acute ischemic stroke. JAMA. 2013;309(23):2480–8.
Kamal N, Benavente O, Boyle K, Buck B, Butcher K, Casaubon LK, et al. Good is not good enough: the benchmark stroke door-to-needle time should be 30 minutes. CJNS. 2014;41(6):694–6.
Rider A, Schertzer K. Quality improvement in medical simulation. Treasure Island: StatPearls Publishing; 2024.
Purdy E, Borchert L, El-Bitar A, Isaacson W, Bills L, Brazil V. Taking simulation out of its “safe container”—exploring the bidirectional impacts of psychological safety and simulation in an emergency department. Adv Simul. 2022;7(1):5.
Brazil V, Lowe B, Ryan L, Bourke R, Scott C, Myers S, et al. Translational simulation for rapid transformation of health services, using the example of the COVID-19 pandemic preparation. Adv Simul. 2020;5(1):1–9.
Weldon SM, Buttery AG, Spearpoint K, Kneebone R. Transformative forms of simulation in health care – the seven simulation-based ‘I’s: a concept taxonomy review of the literature. IJoHS. 2023:1–13.
Brazil V. Translational simulation: not ‘where?’ but ‘why?’ A functional view of in situ simulation. Adv Simul. 2017;2(1):20.
McCoy CE, Rahman A, Rendon JC, Anderson CL, Langdorf MI, Lotfipour S, et al. Randomized controlled trial of simulation vs. standard training for teaching medical students high-quality cardiopulmonary resuscitation. WestJEM. 2019;20(1):15–22.
Al-Mukhtar O, Bilgrami I, Noaman S, Lapsley R, Ozcan J, Marane C, et al. Arrest in the cardiac catheterization laboratory: initial experience with the role of simulation setup and training. Am J Med Qual. 2021;36(4):238–46.
Loza-Avalos S, DeAtkine E, Cox J, Lussier B, Leveno M, Dultz LA, et al. ECMO simulation: How much, who to train, and a review of cost, fidelity and performance. Perfusion. 2023:2676591231200988.
Shields AD, Vidosh J, Thomson BA, Minard C, Annis-Brayne K, Kavanagh L, et al. Validation of a simulation-based resuscitation curriculum for maternal cardiac arrest. Obstet Gynecol. 2023;142(5):1189–98.
Alanazi A, Nicholson N, Thomas S. The use of simulation training to improve knowledge, skills, and confidence among healthcare students: a systematic review. IJAHSP. 2017;15(3).
Hegland PA, Aarlie H, Strømme H, Jamtvedt G. Simulation-based training for nurses: systematic review and meta-analysis. Nurse Educ Today. 2017;54:6–20.
Boling B, Hardin-Pierce M. The effect of high-fidelity simulation on knowledge and confidence in critical care training: an integrative review. NEP. 2016;16(1):287–93.
Pruden C, Beecham GB, Waseem M. Human Factors in Medical Simulation. StatPearls Treasure Island (FL): StatPearls Publishing LLC; 2023.
Gardner AK, Johnston M, Korndorffer JR, Haque I, Paige JT. Using simulation to improve systems-based practices. Jt Comm J Qual Patient Saf. 2017;43(9):484–91.
Morse JC, Brown CW, Morrison I, Wood C. Interprofessional learning in immediate life support training does effect TEAM performance during simulated resuscitation. BMJ STEL. 2019;5(4):204–9.
Brown CW, Howard M, Morse J. The use of trauma interprofessional simulated education (TIPSE) to enhance role awareness in the emergency department setting. JIC. 2016;30(3):388–90.
Morris NA, Czeisler BM, Sarwal A. Simulation in neurocritical care: past, present, and future. Neurocrit Care. 2019;30(3):522–33.
Kirkpatrick JD, Kirkpatrick WK. Kirkpatrick’s four levels of training evaluation. Alexandria: ATD Press; 2016.
Johnston S, Coyer FM, Nash R. Kirkpatrick’s evaluation of simulation and debriefing in health care education: a systematic review. J Nurs Educ. 2018;57(7):393–8.
Chauvin A, Truchot J, Bafeta A, Pateron D, Plaisance P, Yordanov Y. Randomized controlled trials of simulation-based interventions in Emergency Medicine: a methodological review. Intern Emerg Med. 2018;13(3):433–44.
Page MJ, Moher D, Bossuyt PM, Boutron I, Hoffmann TC, Mulrow CD, et al. PRISMA 2020 explanation and elaboration: updated guidance and exemplars for reporting systematic reviews. BMJ. 2021;372:n160.
Smidt A, Balandin S, Sigafoos J, Reed VA. The Kirkpatrick model: a useful tool for evaluating training outcomes. J Intellect Dev Dis. 2009;34(3):266–74.
Acknowledgements
University of Aberdeen Statistics Department.
A small grant supported open-access publishing by NHS Grampian Charities. JGC is supported by NHS Research Scotland.
Funding
There was no direct financial support for this work. None of the authors have any financial disclosures to declare.
Author information
Authors and Affiliations
Contributions
All authors designed the study. Sameera Aljuwaiser and Abdel-Rahman Abdel Fattah performed the literature search and data extraction. Sameera Aljuwaiser performed study analysis and writing up the paper under the supervision of Alyaa Mostafa. All authors reviewed and edited multiple versions of the manuscript and are responsible for the results. All authors read and approved the final manuscript.
Corresponding author
Ethics declarations
Ethics approval and consent to participate
Not applicable.
Consent for publication
Not applicable.
Competing interests
The authors declare that they have no competing interests.
Additional information
Publisher’s Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Supplementary Information
Additional file 1: Appendix 1.
PRISMA 2020 Checklist. Appendix 2. Search strategies. Appendix 3. Sample data extraction sheet. Appendix 4. Details on the assessment of risk of bias ROBINS-I results. Appendix 5. Table of excluded studies.
Rights and permissions
Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated in a credit line to the data.
About this article
Cite this article
Aljuwaiser, S., Abdel-Fattah, A., Brown, C. et al. Evaluating the effects of simulation training on stroke thrombolysis: a systematic review and meta-analysis. Adv Simul 9, 11 (2024). https://doi.org/10.1186/s41077-024-00283-6
Received:
Accepted:
Published:
DOI: https://doi.org/10.1186/s41077-024-00283-6