Skip to main content

Implementing the transvaginal ultrasound simulation training (TRUSST) programme for obstetric registrars

Abstract

Background

Transvaginal ultrasound (TVUS) training opportunities are limited due to its intimate nature; however, TVUS is an important component of early pregnancy assessment. Simulation can bridge this learning gap.

Aim

To describe and measure the effect of a transvaginal ultrasound simulation programme for obstetric registrars.

Materials and methods

The transvaginal ultrasound simulation training (TRUSST) curriculum consisted of supported practice using virtual reality transvaginal simulators (ScanTrainer, Medaphor) and communication skills training to assist obstetric registrars in obtaining required competencies to accurately and holistically care for women with early pregnancy complications.

Trainee experience of live transvaginal scanning was evaluated with a questionnaire. Programme evaluation was by pre-post self-reported confidence level and objective pre-post training assessment using Objective Structured Assessment of Ultrasound Skills (OSAUS) and modified Royal Australian and New Zealand College of Obstetrics and Gynaecology assessment scores. Quantitative data was compared using paired t tests.

Results

Fifteen obstetric registrars completed the programme. Numbers of performed live transvaginal ultrasound by trainees were low. Participants reported an increase in confidence level in performing a TVUS following training: mean pre score 1.6/5, mean post score 3/5. Objective assessments improved significantly across both OSAUS and RANZCOG scores following training; mean improvement scores 7.6 points (95% CI 6.2–8.9, p < 0.05) and 32.5 (95% CI 26.4–38.6, p < 0.05) respectively. It was noted that scores for a systematic approach and documentation were most improved: 1.9 (95% CI 1.4–2.5, p < 0.05) and 2.1 (95% CI 1.5–2.7, p < 0.05) respectively.

Conclusion

The implementation of a simulation-based training curriculum resulted in improved confidence and ability in TVUS scanning, especially with regard to a systematic approach and documentation.

Introduction

Diagnostic delay regarding pregnancy viability is challenging for women and can adversely affect their perception of hospital care. The introduction of early pregnancy assessment units provides continuity of care and patient satisfaction [1]. When skilled clinicians are available, point of care TVUS results in a lower rate of admissions from 40.3 to 17.1% and can alter clinical management in 54.1% of patients [2]. Despite the Royal Australian and New Zealand College of Obstetrics and Gynaecology (RANZCOG) introducing ultrasound competencies for new trainees since 2016, many existing trainees have had minimal training in transvaginal ultrasound (TVUS).

Opportunities to learn transvaginal scanning are fewer than transabdominal scanning due to its intimate nature. Supplementing training with simulation may result in faster upskilling and provide greater standardisation of the learning experience. The demonstrated benefits of simulation training include improved confidence [3, 4], a better learning experience [5] and improved performance—both self-assessed [3] as well as objectively assessed [6]. From a service-based point of view, TVUS simulation training reduces the supervision and repetition of scans required [3, 6] therefore presumably makes a more efficient and cost-effective service. Additionally, objective, automated measures of performance available on virtual reality (VR) simulators may provide a reproducible assessment of base-level psychomotor competency required prior to live scanning, similar to the role of VR laparoscopic trainers [7]. Grantcharov and Reznick [8] demonstrated the importance of pre-patient training following acquisition of cognitive knowledge when teaching procedural skills.

The objective of this project was to assess trainee live TVUS experience and evaluate the introduction of the transvaginal ultrasound simulation training (TRUSST) programme, a simulation-based programme for TVUS scanning by obstetric registrars. This programme was developed to address limited opportunities, trainee’s lack of confidence and a lack of standardised skill development in TVUS.

Materials and methods

Participants/setting

Obstetric registrars training at a tertiary level hospital in 2018 were invited to participate in the programme during rostered education time. The hospital provides a 24/7 Early Pregnancy Assessment service and assesses on average 17 patients with early pregnancy complications daily. Consent was obtained from all participants and approval for the programme was granted by the Mater Health Service Human Research Ethics committee (Reference HREC/18/MHS/4).

Curriculum development

A modular curriculum was developed with input from our Sonography Educator, Clinical Simulation Director, Maternal Fetal Medicine consultants and the Bereavement Service. A virtual reality (VR) transvaginal simulator (ScanTrainer, Medaphor, Cardiff, UK) was used to teach the skills required to diagnose early pregnancy complications using TVUS. The programme consisted of an online video tutorial and face-to-face sessions as well as supervised practice and unlimited independent practice using ScanTrainers. Key learning objectives included demonstration of appropriate communication skills for counselling and consenting patients, using a standard framework for scanning and obtaining required images in early pregnancy assessment. Registrars were required to reach a pre-set level of proficiency prior to gaining further experience through supervised scanning on patients—this was determined by the supervisors subjectively ensuring that participants had reached a level to minimise discomfort and inefficiency with patients.

A short online learning video ensured baseline knowledge of scanning technique covering ultrasound physics, views and probe care. The initial face-to-face 3-h session discussed possible presentations of early pregnancy complications, introducing the content and relevance of TVUS skills. This promoted a scaffolding approach and addressed various levels of Miller’s Pyramid [9] whilst encouraging participant interaction and active learning. Next, Malouf’s [10] technique of “tell-show-do-review” was used, with learners first observing a TVUS assessment, it was then deconstructed and explained in separate steps before practising those steps. A visual aid was provided as a framework to prompt each step of the scan, aiming to assist with differing learning styles [11]. The second session utilised role play to practice and refine techniques for consenting patients for intimate procedures and counselling them for inconclusive and bad news scenarios with input and feedback from a bereavement counsellor. The largest component was hands-on supervised practice on a ScanTrainer with a supervisor, for learners to gain the procedural skills required and promote practice fixation. Time and practice are required to develop competence and autonomy [12] and simulation provided a risk and emotion-free environment to achieve conditioning [13]. The trainees had exposure to the ScanTrainer modules as well as additional uploaded de-identified real patient sweeps that the sonography educator created.

Measures

Participants completed a pre-post survey which collected demographic data and the number of TVUS performed under supervision and independently. Pre-post Likert scales evaluated trainee confidence with assessing the need for a TVUS, performing a TVUS, making a management plan based on a TVUS report, as well as their comfort level counselling patients with early pregnancy loss and inconclusive results. Free text comments regarding the programme were collected.

Participants’ scanning skills were assessed on the simulator by trained supervisors using an uploaded standard early pregnancy scan. Comparable new scans were used in the post-training assessment to ensure participants had not had prior exposure to, or familiarity with, the test cases. Raters used the validated Objective Structured Assessment of Ultrasound Skills (OSAUS) score [14] but with three components removed as they were deemed not relevant by the sonography educator to the assessed scan. OSAUS components include image optimisation, systematic examination, interpretation of images and documentation of examination, with a total score out of 20. The locally relevant RANZCOG first trimester transvaginal ultrasound assessment of procedural and surgical skills (APSS) sheet was out of a total of 72 as gestational sac measurement was not applicable to the assessed scan and fetal heart motion was unable to be measured on uploaded images. Two tools are used to ensure that results are both relevant to a validated score as well as local training requirements.

Statistics

Data was analysed using IBM SPSS Statistics Version 24. Data was tested for normal distribution using Shapiro-Wilk method, and differences between the pre-training and post-training groups were assessed using a paired samples t test.

Results

Fifteen obstetric registrars completed the programme with demographic characteristics shown in Table 1. Trainees spent between 2 and 21 h on the ScanTrainer. The number of transvaginal scans, both supervised and unsupervised, performed by the registrars pre- and post-training is shown in Table 2. Scan numbers highlight a deficiency in current trainee experience with transvaginal ultrasound scanning, with only one trainee having performed over 10 TVUS. RANZCOG recommend a minimum of 80 h of scanning within the first 2 years of training.

Table 1 Participant characteristics
Table 2 Real patient scanning experience pre- and post-training

Participants reported an increase in confidence or comfort across all five evaluation questions (Fig. 1), with an average increase of 1.4 point (95% CI 0.9–1.9, p < 0.05) on the 5-point Likert scale in confidence performing a TVUS. The participant comments suggest that the provision of a “structure to perform a scan” and a “standardisation of the expected skill level”, with “personal supervised support and guidance”, contributed to this improvement. Comments for suggested improvements recurrently consisted of “more practice scanning cases”, “more protected time required” and “more access to then progress skills to live patient scanning”.

Fig. 1
figure1

Self-evaluation of confidence (n = 15): mean score with 1.0 SD

Participants demonstrated a significant improvement in the pre- and post-training assessments in both assessment tools. On the OSAUS score (/20), the participants’ mean score was 8.7/20 (SD 3.2) pre-training and 16.3 (SD 1.8) post-training—mean improvement score 7.6 points (95% CI 6.2–8.9, p < 0.05), whilst mean RANZCOG scores (/72) increased from 28 (SD 13.1) to 60.5 (SD 4.5) pre- to post-training, mean improvement score 32.5 points (95% CI 26.4–38.6, p < 0.05). Figure 2 demonstrates that not only did the mean score increase but the variability in score also reduced when using either score. When the OSAUS score was broken down into the individual criteria—each being scored between 1 and 5, with 5 being consistently performing the component accurately—systematic approach and documentation were most improved with mean score improvements of 1.9 (95% CI 1.4–2.5, p < 0.05) and 2.1 (95% CI 1.5–2.7, p < 0.05) respectively.

Fig. 2
figure2

Mean test scores pre- and post-training using the OSAUS and RANZCOG scores with 1.0 SD

Discussion

The TRUSST programme provided trainees with an opportunity to improve TVUS confidence and skills with a structured learning approach.

Reported live scan numbers were low, highlighting a deficiency in current trainee experience with TVUS. Six registrars had rostered time in Maternity Fetal Medicine accounting for the higher number of scans for some registrars. However, two thirds of participants had still only performed fewer than 25 supervised TVUS despite a busy Early Pregnancy Assessment Unit. The International Society of Ultrasound in Obstetrics and Gynaecology [15] recommend that a minimum of 100 transvaginal scans are required prior to proficiency, which may not be achievable during RANZCOG training. Potential lack of TVUS opportunities is not an issue isolated to this specific hospital with participants likely to be representative of RANZCOG trainees in general as they included a range of levels and had been to a variety of training hospitals throughout Queensland prior to rotation to our unit. While simulation programmes such as TRUSST have the potential to assist in meeting the gap in skill development, low number of scans performed post-training would suggest further investigation into barriers to accessing live training is required.

One such barrier may be trainee confidence, and participants reported poor confidence levels prior to training. The TRUSST programme resulted in improved confidence levels in participants performing a TVUS, and while confidence does not equate to competence, it can be a barrier to performing procedures, especially intimate ones [16].

Although our study demonstrated improvement in scanning skill on the simulator, Tolsgaard et al. [17] demonstrated a sustained improvement in scanning abilities on live patients 2 months following simulation training with clinical experience compared to clinical experience alone.

Consistent with demonstrated improvements in systematic approach scores, the scanning framework visual aid was frequently commented on as highly beneficial component of the programme in addition to the opportunity to use the ScanTrainer. It was also noted subjectively that this improved systematic approach reduced the time taken to scan and conclude the findings. Time taken to scan was not formally recorded but could be included in future studies, not to encourage fast scans, but to emphasise the importance of a systematic approach for efficiency, accuracy and patient comfort. Similar improvements have been seen with laparoscopic VR simulators which have been shown to reduce operating time, increase accuracy and decrease errors [18].

Tolsgaard et al. [17] suggest that TVUS simulation is applicable to not only psychomotor skill development but may also be used for competency assessment. Simulator assessment of competency prior to live performance is common across many procedural skills and has led to improvements in patient care [19]. Competency assessment may be an important area of focus for future research and curriculum development in TVUS skills. To obtain mastery of point of care ultrasound Lewiss, Hoffmann, Beaulieu, and Phelan [20] suggest that competence is required in three components: image acquisition, interpretation and integration into the clinical picture. Dynamic simulators such as ScanTrainer allow for both normal and abnormal findings, and the use of M-Mode, and may be maximally beneficial in developing skills in image acquisition [20]. While potentially superior to static simulators in this regard, there still remains a lack of variety in its standard cases, limiting potential learning in image interpretation and implications for clinical management. Access to a Cloud-based image library can expand case variety; however, many cases are not necessarily specific to the needs of obstetric trainees. In ongoing curriculum development, the addition of further virtual patients by uploaded de-identified image sweeps from real patients may provide added case exposure, improving opportunities for trainee to engage in clinical interpretation, critical thinking and self-analysis [21].

Limitations in this study include the small number of participants, and that it was a single-centre study in a tertiary hospital with access to a ScanTrainer so may not be applicable to other centres. These are common limitations in studies assessing the development of technical skills [22]. It also does not take into consideration the cost effectiveness of the training with regard to department efficiency and patient care; this could be examined in a further study. We acknowledge that by reducing the components on both the OSAUS and RANZCOG scores, the validity of these scores may be compromised, but in terms of assessing scanning skills on a simulator, these were felt necessary. Perhaps a full scenario could be used in future training or studies using a hybrid model with a standardised patient and the simulator combined. Real patients would be preferable; however, especially for pre-training, this is unethical and unfair on these patients with such an emotional and intimate situation. Lastly, real patient scanning skills have not been assessed within this study, although have been demonstrated with VR TVS previously [6, 23].

Conclusions

In conclusion, the TRUSST programme resulted in significant improvements in simulated scanning using quantitative measures as well as improved participant confidence in performing a TVUS, and counselling patients with early pregnancy complication. This simulation programme can provide a standardised training experience in an area where live patient exposure is difficult to access. Future improvements to the curriculum should aim to increase the variety of full pelvic scan cases to increase content validity supported by protected training time for simulated training. Further studies are required to fully assess the impact of the TRUSST programme on patient care and department efficiency.

Availability of data and materials

The datasets during and/or analysed during the current study available from the corresponding author on reasonable request.

Abbreviations

TVUS:

Transvaginal ultrasound

TRUSST:

Transvaginal ultrasound simulation training

OSAUS:

Objective Structured Assessment of Ultrasound Skills

RANZCOG:

Royal Australian and New Zealand College of Obstetrics and Gynaecology

References

  1. 1.

    Bradley E, Hamilton-Fairley D. Managing miscarriage in early pregnancy assessment units. Hosp Med (London, England : 1998). 1998;59(6):451.

    CAS  Google Scholar 

  2. 2.

    Haider Z, Condous G, Khalid, et al. Impact of the availability of sonography in the acute gynecology unit. Ultrasound Obstet Gynecol. 2006;28(2):207–13. https://doi.org/10.1002/uog.2801.

    CAS  Article  PubMed  Google Scholar 

  3. 3.

    Ahmad R, Alhashmi G, Ajlan A, Eldeek B. Impact of high-fidelity transvaginal ultrasound simulation for radiology on residents' performance and satisfaction. Acad Radiol. 2015;22(2):234–9. https://doi.org/10.1016/j.acra.2014.09.006.

    Article  PubMed  Google Scholar 

  4. 4.

    Chao C, Chalouhi GE, Bouhanna P, Ville Y, Dommergues M. Randomized clinical trial of virtual reality simulation training for transvaginal gynecologic ultrasound skills. J Ultrasound Med. 2015;34(9):1663–7. https://doi.org/10.7863/ultra.15.14.09063.

    Article  PubMed  Google Scholar 

  5. 5.

    Girzadas DV Jr, Antonis MS, Zerth H, et al. Hybrid simulation combining a high fidelity scenario with a pelvic ultrasound task trainer enhances the training and evaluation of endovaginal ultrasound skills. Acad Emerg Med. 2009;16(5):429–35. https://doi.org/10.1111/j.1553-2712.2009.00399.x.

    Article  PubMed  Google Scholar 

  6. 6.

    Tolsgaard MG, Ringsted C, Rosthøj S, et al. The effects of simulation-based transvaginal ultrasound training on quality and efficiency of care: a multicenter single-blind randomized trial. Ann Surg. 2017;265(3):630–7. https://doi.org/10.1097/SLA.0000000000001656.

    Article  PubMed  Google Scholar 

  7. 7.

    Grantcharov T, Reznick R. Teaching procedural skills. Br Med J. 2008;336:1129–31. https://doi.org/10.1136/bmj.39517.686956.47.

    Article  Google Scholar 

  8. 8.

    Janssens S, Beckmann M, Bonney D. Introducing a laparoscopic simulation training and credentialing program in gynaecology: an observational study. Aust N Z J Obstet Gynaecol. 2015;55:374–8. https://doi.org/10.1111/ajo.12355.

    Article  PubMed  Google Scholar 

  9. 9.

    Miller GE. The assessment of clinical skills/competence/performance. Acad Med. 1990;65(9 Suppl):S63–7. https://doi.org/10.1097/00001888-199009000-00045.

    CAS  Article  PubMed  Google Scholar 

  10. 10.

    Malouf D. How to teach adults in a fun and exciting way (Vol. 2nd). Crows Nest: Allen & Unwin; 2003.

    Google Scholar 

  11. 11.

    Hainsworth D. Instructional methods. In: Bastaable S, editor. Nurse as educator: principles of teaching and learning for nursing practice. 3rd ed. Boston: Jones and Bartlett; 2008. p. 473–511.

    Google Scholar 

  12. 12.

    Wearne, S. (Producer). 2011, 1/01). Teaching procedural skills in general practice. Australian Family Physician. Retrieved from http://www.racgp.org.au/afp. Accessed 12 Oct 2019.

  13. 13.

    Ker J, Bradley P. Simulation in medical education. In: Swanwick T, editor. Understanding Medical Education: Evidence, Theory and Practice. West Sussex: Wiley-Blackwell; 2010. p. 164–80.

    Chapter  Google Scholar 

  14. 14.

    Tolsgaard MG, Ringsted C, Dreisler E, et al. Reliable and valid assessment of ultrasound operator competence in obstetrics and gynecology. Ultrasound Obstet Gynecol. 2014;43(4):437–43. https://doi.org/10.1002/uog.13198.

    CAS  Article  PubMed  Google Scholar 

  15. 15.

    International Society of Ultrasound in Obstetrics and Gynecology Recommendations. Ultrasound Obstet Gynecol 2013; 2013. https://doi.org/10.1002/uog.13208. Published online in Wiley Online Library.

    Book  Google Scholar 

  16. 16.

    Bhoopatkar H, Wearn A, Vnuk A. Medical students’ experience of performing female pelvic examinations: Opportunities and barriers. Aust N Z J Obstet Gynaecol. 2017;57(5):514–9. https://doi.org/10.1111/ajo.12634.

    Article  PubMed  Google Scholar 

  17. 17.

    Tolsgaard MG, Ringsted C, Dreisler E, et al. Sustained effect of simulation-based ultrasound training on clinical performance: a randomized trial: Simulation-based training. Ultrasound Obstet Gynecol. 2015;46(3):312–8. https://doi.org/10.1002/uog.14780.

    CAS  Article  PubMed  PubMed Central  Google Scholar 

  18. 18.

    Feldman LS, Sherman V, Fried GM. Using simulators to assess laparoscopic competence: Ready for widespread use? Surgery. 2004;135(1):28–42. https://doi.org/10.1016/S0039-6060(03)00155-7.

    Article  PubMed  Google Scholar 

  19. 19.

    McGaghie WC, Issenberg SB, Barsuk JH, Wayne DB. A critical review of simulation-based mastery learning with translational outcomes. Med Educ. 2014;2014(48):375–85. https://doi.org/10.1111/medu.12391.

    Article  Google Scholar 

  20. 20.

    Lewiss RE, Hoffmann B, Beaulieu Y, Phelan MB. Point-of-care ultrasound education: the increasing role of simulation and multimedia resources. J Ultrasound Med. 2014;33(1):27–32. https://doi.org/10.7863/ultra.33.1.27.

    Article  PubMed  Google Scholar 

  21. 21.

    Mitchell R, Regan-Smith M, Fisher MA, Knox I, Lambert DR. A new measure of the cognitive, metacognitive, and experiential aspects of residents' learning. Acad Med. 2009;84(7):918–26. https://doi.org/10.1097/ACM.0b013e3181a85609.

    Article  PubMed  Google Scholar 

  22. 22.

    van Hove PD, Tuijthof GJ, Verdaasdonk EG, et al. Objective assessment of technical surgical skills. Br J Surg. 2010;97:972–87.

    Article  Google Scholar 

  23. 23.

    Madsen ME, Nørgaard LN, Tabor A, Konge L, Ringsted C, Tolsgaard MG. The predictive value of ultrasound learning curves across simulated and clinical settings. J Ultrasound Med. 2017;36:201–8. https://doi.org/10.7863/ultra.16.01037.

    Article  PubMed  Google Scholar 

Download references

Acknowledgements

Mater Foundation for their support. Ross Horely at MedaPhor for his technical assistance and loan of an additional ScanTrainer for the period of the study.

Funding

Mater Foundation for their funding for the simulation Fellowship and their purchase of the ScanTrainer.

Sarah Janssens is a recipient of a Betty McGrath Health Practitioner Research Fellowship.

Author information

Affiliations

Authors

Contributions

Byford, Sally: principal investigator, produced, organised and taught programme, collated all data and wrote the manuscript. Janssens, Sarah: supervisor and simulation director approving all programme content and teaching. Edited and assisted with manuscript and data interpretation and statistics. Cook, Rachel: main contributor to scanning component of the programme and main contact with MedaPhor. Edited and approved manuscript. All authors read and approved the final manuscript.

Corresponding author

Correspondence to Sally Byford.

Ethics declarations

Ethics approval and consent to participate

Approval for the programme was granted by the Mater Health Service Human Research Ethics committee (Reference HREC/18/MHS/4).

Obstetric registrars training at The Mater Mother’s Hospital, Brisbane, in 2018 were invited to participate in the program during rostered education time. All participants signed a consent form including participation and publication.

Consent for publication

All participants signed a consent form including participation and publication.

Competing interests

The authors have no conflicts of interest to declare.

Additional information

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated in a credit line to the data.

Reprints and Permissions

About this article

Verify currency and authenticity via CrossMark

Cite this article

Byford, S., Janssens, S. & Cook, R. Implementing the transvaginal ultrasound simulation training (TRUSST) programme for obstetric registrars. Adv Simul 6, 1 (2021). https://doi.org/10.1186/s41077-020-00152-y

Download citation

Keywords

  • Transvaginal ultrasound
  • Simulation
  • ScanTrainer
  • Education
  • Early pregnancy