Skip to main content

Midwifery students better approximate their self-efficacy in clinical lactation after reflecting in and on their performance in the LactSim OSCE

Abstract

Background

Midwives are expected to support women with lactation initiation and maintenance. Midwifery students engaged in a simulation-based exercise (LactSim OSCE) where they role-played the clinician and the breastfeeding patient by wearing a high-fidelity breast model. We provided participants opportunities for reflecting in and on practice to compare their perceived self-confidence in clinical lactation skills to actual clinical performance. We also describe feasibility of implementing the LactSim OSCE with an emphasis on preparation and time spent on tasks during the OSCE.

Methods

Audio-video recordings from the LactSim OSCE were viewed and assessed using a technical skills checklist by an independent rater and by the study participants as part of the self-reflection. Mixed data on participants’ self-efficacy in clinical lactation, experience with the LactSim OSCE, and self-assessment of clinical performance were collected in survey instruments and a focus group. Time spent on each component and clinical lactation skill during the LactSim OSCE was documented.

Results

Immediately following the LactSim OSCE, participants’ confidence in clinical lactation was high (5.7/7), but after a guided video reflection exercise, their self-efficacy was 4.4/7. Participants spent approximately 2 of the allotted 10 min per case scenario discussing the OSCE logistics due to inadequate preparation. Participants spent approximately 2 min of the total encounter performing hands-on clinical lactation skills by touching, looking at, or using the high-fidelity breast model worn by their peer.

Conclusion

We described the development and evaluation of the first simulated experience in clinical lactation with all three components of fidelity: conceptual, psychological, and physical. Multiple opportunities for reflecting on performance allowed the nurse-midwifery students to evaluate their competence in decision-making, technical, and counseling skills which resulted in a more realistic approximation of their perceived self-confidence in breastfeeding skills. Another innovation of this pilot work is the documentation of how long a learner spends on various tasks relevant to lactation support in a simulated encounter. Our findings highlight the importance of providing multiple opportunities for self-reflection using guided video reflection and checklists for objective self-assessment in the clinical lactation field.

Background

Midwives are frontline providers of postpartum care, supporting mothers with breastfeeding initiation and maintenance [1, 2]. Nurse-midwifery students report feeling unprepared to support breastfeeding families upon graduation because they receive inadequate training in clinical lactation [3]. Throughout nursing, midwifery, and medical school, there are limited opportunities to actively practice skills because mothers often do not want trainees crowding their rooms and touching their newborns [4]. Healthcare professional students leave their maternal-child rotations with experience as an observer, not an active healthcare provider [4].

High-fidelity simulation is the ideal learning modality for technical and non-technical skills acquisition and transfer to patient care [5, 6]. The objective structured clinical exam (OSCE) is an approach where a standardized patient actor interacts with a health professional student in a mock clinical scenario. The clinical case scenario (conceptual fidelity) combined with the realistic nature of the clinic room and mock patient (psychological fidelity) enables the student to suspend disbelief and practice clinical skills in a way that leads to improved learning outcomes [7, 8]. A breastfeeding-related OSCE has been described in midwifery education, but only with low-fidelity breast models (physical fidelity) [9,10,11]. Best practices in lactation simulation have not been defined.

An OSCE in clinical lactation (LactSim OSCE) with all three elements of fidelity including conceptual, psychological, and physical is now possible due to the development of a high-fidelity Lactation Simulation Model (LSM) [8, 12]. We developed a hybrid, high-fidelity LactSim OSCE where nurse-midwifery students took turns role-playing as a breastfeeding patient by wearing the LSM. The primary objective of this pilot study was to provide participants multiple opportunities for reflecting in and on practice to determine and compare participants’ perceived self-confidence in clinical lactation skills to their clinical performance in the LactSim OSCE. The secondary objective was to describe the feasibility of implementing the LactSim OSCE within a midwifery curriculum by describing preparatory materials, logistics, and time spent on tasks during the OSCE.

Methods

Overview of study and study participants

Nurse-midwifery graduate students (N = 15) were enrolled in regularly scheduled coursework. In September of their final year, study participants were exposed to basic and advanced breastfeeding management topics through two simulation-based workshops consisting of lectures with integrated hands-on activities with high-fidelity LSMs (Grabowski A, Anderson OS, Chuisano SA, Zielinski RE, Hammer L, Sadovnikova A: Integrating high-fidelity lactation simulation into the nurse-midwifery classroom, in preparation). Study participants completed the LactSim OSCE in January prior to starting their final clinical rotations. Investigators held a focus group in April to obtain participant’s feedback on the September workshops and LactSim OSCE. Consent was obtained from 12 of the 15 midwifery students for retrospective analysis of collected data. Participants were not required to complete all study activities and surveys. The University Institutional Review Board approved the secondary analysis of existing data (HUM00148905).

LactSim OSCE framework

Three LactSim OSCEs were developed to represent common breastfeeding challenges that could occur within the first 6 weeks postpartum and fall under the domain of midwifery care and align with the USBC and IBLCE core competencies for health professionals (Table 1, Case 3 in Supplement 1) [13, 14]. The LactSim OSCE was designed for either a trained actor (standardized patient) or a student learner to play the role of the breastfeeding mother.

Table 1 LactSim OSCE cases used in pilot study

Preparation for the LactSim OSCE

Most participants engaged in a voluntary practice session co-facilitated by two International Board-Certified Lactation Consultants (IBCLC) a week prior to the LactSim OSCE. The investigators developed a packet of preparatory materials (Supplement 2) with suggested readings, learning objectives, patient and clinician scripts and cue cards, and objectives and tasks for the learner in the clinician’s role. Two of the study investigators, one acting as a patient and one as a clinician, filmed a series of instructional videos for each case [15]. All preparatory materials were intended to be made available to the participants a week before the LactSim OSCE. The participants were told that the LactSim OSCE would not be graded and that they should prepare for all three cases and that they would be randomly assigned to play the role of clinician or patient for only two of the three cases. Participants were aware that in-room facilitators would observe the encounter and provide individualized feedback during the debrief.

LactSim OSCE design

Upon arrival at the simulation facility, participants completed a self-efficacy questionnaire (Table 2) to report their confidence in clinical lactation skills (Pre-test). Participants were randomly divided into pairs and then assigned to begin in either room A (case 2) or B (case 1). Participants had 10 min to complete each case followed by 5 min of feedback from the in-room facilitator. Each pair then switched to the opposite room and switched roles. All encounters were audio-video recorded using built-in technology in the simulation facility. Immediately after both cases, participants completed the self-efficacy questionnaire (Post-test) and an encounter evaluation questionnaire (Table 2). Within a month of the OSCE, participants watched the case in which they role-played as a clinician and completed the “Reflection on Practice” questionnaire (Table 2). Video is increasingly being incorporated into high-fidelity simulation scenarios as a method for students to reflect on their performance and further develop clinical judgement [16].

Table 2 Summary of outcome measures and evaluation tools

Relationship between participants’ self-efficacy and clinical performance

The self-efficacy questionnaire was modeled after similar questionnaires used in breastfeeding education [17, 18]. Four investigators with clinical lactation and maternal care experience developed and reviewed the technical skills checklist. Both the self-efficacy questionnaire and the technical skills checklist were assessed by four investigators for face and content validity [19]. Within a month of the LactSim OSCE, participants completed the “Reflection-On-Practice” questionnaire which consisted of a technical skills checklist (Table 3) with skills a clinician should perform during the LactSim OSCE (68 items, case 1; 42 items, case 2), a pre-post rating of perceived competence in clinical skills, and a written self-reflection. Participants used the checklist to follow along as they watched the audio-video recording of their performance as the clinician and document when they saw or heard themselves complete a predefined clinical skill. Before and after watching their video, participants were asked to rate their perceived competence in performing breastfeeding skills. To reflect on practice, participants answered two open-ended questions where they had to select with a timestamp and then elaborate upon a specific moment during which they performed breastfeeding skills well and another moment where they recognized a need for improvement. Participants were able to provide feedback about any topic at the end of the questionnaire via an open-ended question: “Anything else you’d like to add?” Answers to the open-ended questions were summarized via thematic analysis.

Table 3 Technical skills checklist used by the participants as part of the “Reflection on Practice” questionnaire

An investigator acting as an independent rater watched the recordings and used the technical skills checklist to rate participants’ performance. The rater’s responses were then compared directly to each student’s response in the “Reflection on Practice” questionnaire, and the results were summarized as a percent agreement between the rater and study participant. When participants answered that they could hear themselves performing the skill, but the performance of the skill could not be visualized due to technical limitations, the rater counted this as “yes.” If the participant responded that the skill was not applicable to the case or they were “unsure” if the skill were applicable, the rater categorized these responses as “no.”

Evaluation of the feasibility of the LactSim OSCE

In the encounter evaluation questionnaire, participants answered questions about how they prepared for the LactSim OSCE, how to improve the role-playing experience, and whether case scenarios, expectations, allotted time, in-room facilitator feedback, and equipment were adequate. A codebook (Supplement 3) was developed based on the technical skills checklist by three investigators to quantify key themes found in the open-ended questions. Two investigators independently coded the responses. Disagreements were discussed and rectified.

Time on task can be used to assess feasibility of completion of the simulation in the time provided as well as thoroughness of task completion [20]. By determining the amount of time (measured in seconds) students spend on each task within the simulation, investigators can ensure sufficient time is provided and develop a framework for the number of simulation hours required in clinical lactation to transfer skills to patient care. Time spent per task was assessed by two investigators by viewing the audio-video recordings and using a codebook (Supplement 5) to document the time it took for case set-up, interaction between participants during the case (encounter), including engagement with the LSM, interaction between participants and facilitator, and 5-minute feedback session (debrief). Engagement with the LSM was adapted from the “Technical Skills Checklist” and further defined as any interaction between participants or facilitator and the LSM, including utilizing one’s hands directly on the LSM for skills like hand expression, attaching a tool like a breast pump or newborn doll to the LSM, or pointing to the LSM as one would occur during the visual inspection portion of a breast examination. An investigator served as the patient-actor for one of the participants due to the odd number of students; this participant’s video was excluded from analysis and instead used to make iterative improvements to the codebook. After the video codebook was developed, two investigators watched the cases to code each action and interaction, making note of the time (minutes and seconds) per action and interaction. Agreement was analyzed for each case overall, by dyad and by theme. Percent agreement above 90% was deemed acceptable [21]. Facilitator’s interjections and questions posted by participants outside of their role as a clinician or patient were transcribed and analyzed thematically for trends.

A focus group was included as part of a sequential explanatory mixed-methods approach in which the qualitative data from the discussion would help to supplement and interpret survey responses [22]. The focus group, conducted in a classroom setting, provided a neutral space for the participants to articulate what worked well, what could be improved, and expand upon their experience with the LactSim OSCE with an impartial facilitator. An investigator served as the notetaker and did not interact with the participants during the session. The session was not audio-video recorded due to lack of an available recording device to suit the focus group room. Three investigators from the study team reviewed data from the LactSim OSCE to develop discussion questions for the focus group (Supplement 3).

Statistical analysis

Study participants were not required to complete study documents or participate in study activities. Data were analyzed in aggregate, when appropriate. Statistical analyses were performed in GraphPad Prism (V8.3) and Excel with the XLSTAT package. Descriptive statistics were used to determine the mean and standard deviation and to summarize findings from the qualitative data codebooks. To determine the reliability and consistency of instruments, Cronbach’s α and percent agreement were calculated. Factor analysis could not be performed due to sampling inadequacy. Only items 1–8, 10, 11, 13–15, 20, 21, 27, and 28 from the self-efficacy questionnaire were included in data analysis as they aligned directly with the learning objectives for cases 1 and 2 (Supplement 6). A Wilcoxon matched-pairs signed rank test was used to measure the change in self-efficacy.

Results

Study participants

Data from nine female participants, all in their second year of the nurse-midwifery program, were included in the final analyses. Five participants had at least some prior clinical or personal breastfeeding experience. All participants had performed at least one breast examination, provided breastfeeding education to patients, and utilized the LSM during the September simulation-based workshops in a classroom setting (Grabowski A, Anderson OS, Chuisano SA, Zielinski RE, Hammer L, Sadovnikova A: Integrating high-fidelity lactation simulation into the nurse-midwifery classroom, in preparation). One student was removed from all analyses, as she did not have a partner for the OSCE and talked through the case instead of performing the skills. Additional demographic information has been described elsewhere [12].

Participants’ overall feedback on the LactSim OSCE experience

Nine participants (N = 9/9) reported that the case scenarios were “just right” based on their current breastfeeding skill and knowledge level. One participant wrote that the LactSim OSCE was a “great experience overall” and another participant wrote, “Thank you for allowing me to take part in this wonderful experience.” One student indicated that she would benefit from watching the preparatory videos again. The participants agreed (5.9/7) the expert in-room facilitator provided tangible and realistic suggestions for improvement. The participants (n = 7) indicated that the LSMs are made very well, improved the realism of the encounter (5.7/7), and they were key for supporting hands-on practice in clinical lactation [12]. During the focus group, the participants indicated that role-playing is a great modality for learning because of the ability to practice being face-to-face with a mock breastfeeding patient.

Participants’ immediate feedback on the LactSim OSCE experience

Three main themes emerged from the mixed data within the evaluation questionnaire: more preparation, more time for the case, and clearer expectations. Participants (n = 7/9) reported that they prepared for the OSCE by reading through the cases and guidelines. Many of the participants attended the voluntary practice session (n = 6/9) the week prior, and one participant practiced the scenarios with a classmate ahead of time. The majority of participants (n = 5/9) wanted “better background on how to present as the patient” and “better acting skills,” highlighting the need to better prepare participants to serve as “mock patients” in simulated scenarios. Most participants (n = 6/9) wrote that “it is important to allow for more time [because it] was difficult to accurately discuss and educate a patient on so much in that time frame.” Some participants (n = 3/9) were “unclear about the objectives” of the LactSim OSCE.

Participants’ reflection-on-practice

Four participants from case 1 and three from case 2 completed the technical skills checklist within the “Reflection on Practice” questionnaire. Participants reported low confidence (4.4/7) in their breastfeeding skills ability upon beginning the questionnaire, with no change (4.4/7, P > .9) following the reflection-on-practice exercise. In case 1, each participant (n = 4/4) noted something different when asked to select a moment when they performed a clinical skill well: (1) “summarized lymphatic massage, spoon feeding, positions of baby,” (2) “described hand expression well, did well with correcting mother’s hand expression technique,” (3) “Assessing the patient’s complaint difficulty latching/flat nipple,” and (4) “reverse pressure softening.” When asked to select an area for growth, most participants (n = 3/4) highlighted that they did not perform a complete breast examination.

When reviewing case 2, two participants wrote that they demonstrated pumping and flange sizing well, and one participant reported that she did a good job gathering the patient’s history and discussing the patient’s milk supply. When asked to reflect on what could have gone better, all participants provided different responses: (1) “I didn’t really notice the shape of the nipple and how that may be related to how deep or shallow the latch of the baby may be. [Facilitator] pointed this out to me. I did a breast assessment at around 9:11, but I realize it was not as thorough as it should have been. I did not palpate to the axilla, or the shape of the nipples,” (2) “While performing the breast exam I forgot to do a full exam of the nipples. I also felt that I ran out of time and did not have time to show the patient how to fully put together the breast pump and use it hands on.” (3) “In retrospect, I could have gone through a couple different feeding positions with mom to ensure proper hold and latch.”

Overall, there was adequate agreement between the independent rater and the student for case 1 (49/68, 72.06%) and for case 2 (29/42, 69.05%) as to which clinical lactation skills were performed during the LactSim OSCE. The majority of the disagreement (68.75%, 22 of the 32 total instances of disagreements) occurred when the student indicated they had completed the skill, while the rater disagreed. The skills with the most disagreement in both cases were related to breast assessment (n = 15/32) (Supplement 7).

Relationship between perceived self-efficacy and clinical performance

There was a discrepancy between perceived self-efficacy immediately before and after the LactSim OSCE and the participants’ self-assessment of their performance during the guided video reflection exercise. Participants’ (N = 6) confidence in clinical lactation was high before (5.4/7) and after (5.6/7) completing the LactSim OSCE. Participants (N = 7) reported lower confidence (4.4/7) in their overall breastfeeding skills immediately before and after completing the “Reflection on Practice” exercise which better approximated their self-assessment of their performance.

For example, the average score for self-efficacy in breast assessment was 6.25/7 (range 5–7 for n = 4 participants), suggesting a high degree of confidence in that skill. Three of those four participants wrote that they needed additional practice with breast assessment in their “Reflection on Practice” questionnaire, with comments such as: (1) “could have done a better job doing a more thorough breast examination at the beginning and examining both nipples better,” (2) “really the whole video but especially here I didn’t address the flat left nipple,” (3) “Should have completed a thorough breast [examination] with inspection and palpation. Did not palpate the patient’s breast.”

Evaluation of the LactSim OSCE feasibility and instrument validity

Four co-authors agreed that 10 min would be sufficient for the practice of the indicated tasks in each case (Table 1) as the participants had significant prior exposure to breastfeeding management and simulation-based practice (Grabowski A, Anderson OS, Chuisano SA, Zielinski RE, Hammer L, Sadovnikova A: Integrating high-fidelity lactation simulation into the nurse-midwifery classroom, in preparation). Participants were not able to utilize the full 10 min for each LactSim OSCE case because they spent the first 2:09 min and 2:15 min of cases 1 and 2, respectively, discussing the set-up and logistics (Fig. 1a). While facilitators were only meant to observe, the cases were interrupted several times either by the in-room facilitator or the participants, with interruptions totaling 35 and 38 s for case 1 and case 2, respectively. After accounting for the setup and interruptions, the participants had an average of 7:36 and 7:45 min to complete the encounter in case 1 and case 2, respectively. Participants in case 1 spent 34% (2:35 min) of the encounter engaging with the LSM while participants in case 2 touched, pointed at, or used the LSM for 21% (1:38 min) of the total case time (Fig. 1b). There was significant variation in the amount of time spent on each breastfeeding skill between participants (Fig. 1c).

Fig. 1
figure1

Utilization of time during the LactSim OSCE. a Time spent on case set up, interruptions, encounter, and debrief. b Time spent utilizing the LSM during the encounter. c LSM utilization by subcategory

The conversations between facilitators and participants during case interruptions further emphasized the importance of adequate student preparation for the role of a mock patient. The facilitator in case 1 assumed the role of a “support person” on six occasions, with comments like: “I’m just concerned about how she is going to manage all of this, all this hard breast situation, what is she going to do about that?” and “What is she going to do with that flat nipple on that other side?” The majority of the facilitator’s interruptions in case 2 were to help (n = 4/9) with logistics, such as setting up the breast pump and providing clarification (n = 4/9) of the case goals when participants appeared to be unsure. The most common (n = 7/13) reason for interruptions initiated by participants in both cases was to ask the facilitator a clarifying question about the LSM’s feature, such as, “Is she supposed to have plugged ducts because I feel some in here?”

Four investigators agreed that the self-efficacy questionnaire and the technical skills checklist had correct content and were appropriate for the level of the learner. The self-efficacy questionnaire had a high degree of internal consistency as the Cronbach’s α was > 0.87 even after a question was removed at random. The qualitative data codebooks for both the encounter evaluation questionnaire and “Reflection on Practice” questionnaire were reliable as the inter-rater agreement between the two coders was respectively 90.4% and 94.4%. The codebook developed for audio-video recordings was used with a high degree of agreement between raters (case 1 91.1%, case 2 94.4%).

Discussion

This pilot study is the first description of a high-fidelity OSCE in clinical lactation with all three components of fidelity in which health professional students role-play as either the clinician or the breastfeeding patient. A strength of this study is that nurse-midwifery students had multiple opportunities for self-reflection in and on their LactSim OSCE experience, supporting higher engagement and learning [23,24,25]. We are the first to describe how long a learner spends on various tasks relevant to an encounter with a breastfeeding patient in a simulation-based training exercise. Time spent on task has been reported for breast assessment simulations and is important to consider when designing effective training exercises [26, 27]. The ultimate goal would be to establish how much time to dedicate to the practice of each clinical lactation skill in a simulated encounter for learners to then translate that skill to the care of breastfeeding patients to improve health outcomes.

The LactSim OSCE approach was similar to the lactation and infant feeding OSCE described by Muldoon et al., where nurse-midwifery students had a voluntary preparatory session prior to the OSCE and during the OSCE students sequentially completed two scenarios each of 10-min duration while acting as either the clinician or the breastfeeding patient [9]. In contrast with our work, a breast model was not used in the OSCE described in Muldoon et al., and students disagreed that the lactation and infant feeding OSCE reflected a real-life clinical scenario [9]. Moreover, learners in the Muldoon et al. work were not provided with opportunities to reflect upon their clinical performance [9].

Previous work suggests that a high self-efficacy in clinical lactation skills is common among nurse-midwifery students in the final year of their training program [28]. While self-efficacy in clinical skills is a standard metric in high-fidelity simulations, our findings indicate that perceived self-efficacy was not a reliable outcome metric of immediate learning gains from the LactSim OSCE [29]. The participants’ high perceived self-confidence in breast assessment, hand expression, and newborn positioning and attachment in the immediate period following the LactSim OSCE did not align with the self-assessment of their clinical performance in the “Reflection-on-Practice” exercise. The Dunning-Kruger effect is evident when healthcare professionals and trainees overestimate their abilities, highlighting the importance of including outcome measures other than self-efficacy when evaluating an educational intervention [30, 31].

When a trainee self-assesses his or her level of competency in simulation-based training experiences, the result is a highly reliable and valid educational outcome [23]. Our findings underscore the importance of providing multiple opportunities for self-reflection using guided video reflection and checklists for objective self-assessment in the clinical lactation field [23, 32, 33].

Limitations

A limitation of our study was the small sample size, lack of completion of study materials by participants, and significant time limitation during the OSCE. Due to technical difficulties, the study participants did not receive the preparatory materials until the night before the LactSim OSCE which limited the amount of time they had to prepare. The nurse-midwifery students in our study may have felt more prepared to serve as the clinician and breastfeeding patient if they had access to the preparatory videos and materials earlier, but in previous work, early access to preparatory materials did not align with perceived feelings of preparedness [9]. Interruptions by in-room facilitators to help move the scenario along are not uncommon in the simulation literature, further underscoring the need for adequate preparation by each student, instructors, and facilitators [20]. The audio-video recording capability within the simulation facility did not allow for a full view of the clinic room. In future studies, two camera angles could be used: one facing the patient and one from behind and above the patient’s head so that the skills performed on the high-fidelity breast model can be visualized clearly without the clinician’s body blocking the camera.

Conclusion

In this sequential, explanatory, mixed-methods study we describe the first example of an OSCE in clinical lactation (LactSim OSCE) with all three components of fidelity where nurse-midwifery students role-played as either the clinician or the breastfeeding patient by wearing a high-fidelity breast model. An important contribution of this work to the field of breastfeeding education is the development of a framework for how to evaluate clinical lactation skills in a simulation exercise and the documentation on time spent per task by the students. The documentation of time spent per task serves as preliminary guidance for clinical faculty and simulation staff on how to develop and execute a lactation simulation scenario [20]. The Reflection-on-Practice questionnaire provided a safe space for each participant to view and evaluate their clinical performance in the LactSim OSCE and identify targeted areas for improvement. Study participants experienced significant gains in clinical knowledge relevant to lactation support due to multiple opportunities provided by the investigator team for written and oral reflection in and on practice.

Availability of data and materials

The datasets used and/or analyzed during the current study are available from the corresponding author on reasonable request.

References

  1. 1.

    Burns E, Schmied V, Fenwick J, Sheehan A. Liquid gold from the milk bar: constructions of breastmilk and breastfeeding women in the language and practices of midwives. Soc Sci Med. 2012;75(10):1737–45.

    CAS  PubMed  Article  Google Scholar 

  2. 2.

    Swerts M, Westhof E, Bogaerts A, Lemiengre J. Supporting breast-feeding women from the perspective of the midwife: a systematic review of the literature. Midwifery. 2016;37:32–40.

    PubMed  Article  Google Scholar 

  3. 3.

    Renfrew MJ, Craig D, Dyson L, McCormick F, Rice S, King SE, et al. Breastfeeding promotion for infants in neonatal units: a systematic review and economic analysis. Health Technol Assess. 2009;13(40):1.

    CAS  PubMed  Article  Google Scholar 

  4. 4.

    Jeffries PR, Bambini D, Hensel D, Moorman M, Washburn J. Constructing maternal-child learning experiences using clinical simulations. J Obstet Gynecol Neonatal Nurs. 2009;38(5):613–23.

    PubMed  Article  Google Scholar 

  5. 5.

    Martins JCA, Baptista RCN, Coutinho VRD, Fernandes MID, Fernandes AM. Simulation in nursing and midwifery education: World Health Organization; 2018. Available from: http://www.euro.who.int/__data/assets/pdf_file/0011/383807/snme-report-eng.pdf?ua=1. Accessed 15 Apr 2020.

  6. 6.

    Sherwood RJ, Francis G. The effect of mannequin fidelity on the achievement of learning outcomes for nursing, midwifery and allied healthcare practitioners: systematic review and meta-analysis. Nurse Educ Today. 2018;69:81–94.

    PubMed  Article  Google Scholar 

  7. 7.

    Choi W, Dyens O, Chan T, Schijven M, Lajoie S, Mancini ME, et al. Engagement and learning in simulation: recommendations of the Simnovate Engaged Learning Domain Group. BMJ Simul Technol Enhanc Learn. 2017;3(Suppl 1):S23–32.

    Article  Google Scholar 

  8. 8.

    INACSL. Standards of Best Practice: SimulationSM Simulation Design. Clin Simul Nurs. 2016;12:S5–12.

    Article  Google Scholar 

  9. 9.

    Muldoon K, Biesty L, Smith V. “I found the OSCE very stressful”: student midwives’ attitudes towards an objective structured clinical examination (OSCE). Nurse Educ Today. 2014;34(3):468–73.

    PubMed  Article  Google Scholar 

  10. 10.

    Schillerstrom JE, Lutz ML, Ferguson DM, Nelson EL, Parker JA. The women’s health objective structured clinical exam: a multidisciplinary collaboration. J Psychosom Obstet Gynaecol. 2013;34(4):145–9.

    PubMed  Article  Google Scholar 

  11. 11.

    Healer E. The use of objective structured clinical examination (OSCE) in the assessment of breastfeeding knowledge. MIDIRS Midwifery Dig. 2014;24(4):419–23.

    Google Scholar 

  12. 12.

    Sadovnikova A, Chuisano SA, Ma K, Grabowski A, Stanley KP, Mitchell KB, et al. Development and evaluation of a high-fidelity lactation simulation model for health professional breastfeeding education. Int Breastfeed J. 2020;15(1):8.

    PubMed  PubMed Central  Article  Google Scholar 

  13. 13.

    International Board of Lactation Consultant Examiners (IBCLE) International Board Certified Lactation Consultant® (IBCLC®) Detailed Content Outline. Available from: https://iblce.org/wp-content/uploads/2017/05/ibclc-detailed-content-outline-for-2016-for-publication.pdf. [cited 2020 May 31].

  14. 14.

    United States Breastfeeding Committee. Core competencies in breastfeeding care and services for all health professionals. Available from: http://www.usbreastfeeding.org/core-competencies. [cited 2020 May 31].

  15. 15.

    Introduction to Lactation Simulation Model (LSM) case series. Available from: https://www.youtube.com/watch?v=qGE7VRm-8Oo&list=PLvMvEiKfYCKRyGTQXheqMiBbcIDLrtvTx. [cited 2020 Jun 1].

  16. 16.

    Bussard ME. Self-reflection of video-recorded high-fidelity simulations and development of clinical judgment. J Nurs Educ. 2016;55(9):522–7.

    PubMed  Article  Google Scholar 

  17. 17.

    Melchionda MM, Aletti G, Mauri PA. Validation of a self-efficacy survey for Italian midwifery students with regard to breastfeeding support. Nurse Educ Pract. 2019;37:9–14.

    PubMed  Article  Google Scholar 

  18. 18.

    Blackman I, Sweet L, Byrne J. Using Rasch analysis to identify midwifery students’ learning about providing breastfeeding support. Women Birth J Aust Coll Midwives. 2015;28(3):228–35.

    Article  Google Scholar 

  19. 19.

    Cook DA, Hatala R. Validation of educational assessments: a primer for simulation and beyond. Adv Simul. 2016;1(1):31.

    Article  Google Scholar 

  20. 20.

    Maas NA, Flood LS. Implementing high-fidelity simulation in practical nursing education. Clin Simul Nurs. 2011;7(6):e229–35.

    Article  Google Scholar 

  21. 21.

    McHugh ML. Interrater reliability: the kappa statistic. Biochem Medica. 2012;22(3):276–82.

    Article  Google Scholar 

  22. 22.

    Creswell JW, Clark VLP. Designing and conducting mixed methods research. New York: SAGE Publications; 2011. 489 p.

  23. 23.

    Issenberg SB, McGaghie WC, Petrusa ER, Lee Gordon D, Scalese RJ. Features and uses of high-fidelity medical simulations that lead to effective learning: a BEME systematic review. Med Teach. 2005;27(1):10–28.

    PubMed  Article  Google Scholar 

  24. 24.

    Sawyer T, Eppich W, Brett-Fleegler M, Grant V, Cheng A. More than one way to debrief: a critical review of healthcare simulation debriefing methods. Simul Healthc J Soc Simul Healthc. 2016;11(3):209–17.

    Article  Google Scholar 

  25. 25.

    Hayes C, Jackson D, Davidson PM, Daly J, Power T. Pondering practice: enhancing the art of reflection. J Clin Nurs. 2018;27(1–2):e345–53.

    PubMed  Article  Google Scholar 

  26. 26.

    Pugh CM, Salud LH. Association for Surgical Education. Fear of missing a lesion: use of simulated breast models to decrease student anxiety when learning clinical breast examinations. Am J Surg. 2007;193(6):766–70.

    PubMed  Article  Google Scholar 

  27. 27.

    Azari DP, Pugh CM, Laufer S, Kwan C, Chen C-H, Yen TY, et al. Evaluation of simulated clinical breast exam motion patterns using marker-less video tracking. Hum Factors. 2016;58(3):427–40.

    PubMed  Article  Google Scholar 

  28. 28.

    Prepelita T, Ricchi A, Messina P, Molinazzi MT, Cappadona R, Fieschi L, et al. Self-efficacy in breastfeeding support: a research on Italian midwifery students. Acta Bio-Medica Atenei Parm. 2020;91(2-S):27–34.

    Google Scholar 

  29. 29.

    Labrague LJ, McEnroe-Petitte DM, Bowling AM, Nwafor CE, Tsaras K. High-fidelity simulation and nursing students’ anxiety and self-confidence: a systematic review. Nurs Forum (Auckl). 2019;54(3):358–68.

    Article  Google Scholar 

  30. 30.

    Kruger J, Dunning D. Unskilled and unaware of it: how difficulties in recognizing one’s own incompetence lead to inflated self-assessments. J Pers Soc Psychol. 1999;77(6):1121–34.

    CAS  PubMed  Article  Google Scholar 

  31. 31.

    Cucchetti A, Evans D, Casadei-Gardini A, Piscaglia F, Maroni L, Odaldi F, et al. The perceived ability of gastroenterologists, hepatologists and surgeons can bias medical decision making. Int J Environ Res Public Health. 2020;17(3):1058.

    PubMed Central  Article  Google Scholar 

  32. 32.

    Karabacak U, Unver V, Ugur E, Kocatepe V, Ocaktan N, Ates E, et al. Examining the effect of simulation based learning on self-efficacy and performance of first-year nursing students. Nurse Educ Pract. 2019;36:139–43.

    PubMed  Article  Google Scholar 

  33. 33.

    Wang PZT, Xie WY, Nair S, Dave S, Shatzer J, Chahine S. A comparison of guided video reflection versus self-regulated learning to teach knot tying to medical students: a pilot randomized controlled trial. J Surg Educ. 2020; Available from: http://www.sciencedirect.com/science/article/pii/S1931720420300489. [cited 2020 May 31].

Download references

Acknowledgements

We would like to acknowledge Kaoer Ma for her initial consultation on data analyses and Jeffrey Plott for designing the new prototypes of the Lactation Simulation Models used in this study.

Funding

LiquidGoldConcept, Inc. developed and provided two Lactation Simulation Model prototypes free of charge for this pilot study.

Author information

Affiliations

Authors

Contributions

OA, RZ, MS, LH, SM, and AS developed three Lactation Simulation Objective Structured Clinical Exams (LactSim OSCE) cases. LH and MZ led voluntary practice sessions prior to LactSim OSCE. OA, RZ, MS, LH, SM, and AS developed a packet of preparatory materials for participants. AS and LH filmed a series of instructional videos for each case. On the day of the OSCE, LH and MS served as in-room facilitators, and RZ managed time. Focus group questions were developed by OA, AS, and RZ. Focus group was held by OA, with AS being a notetaker and not interacting with participants. OA, AS, and AG developed codebooks for open-ended questions. AG and MB independently coded responses, with OA and AS resolving differences. AG, MB, and AS developed codebook for audio-video recordings. AG and MB independently coded audio-video recordings. AG served as an independent rater for the audio-video recordings. AG performed all statistical analyses. Manuscript was written and prepared by OA, AS, AG, and SC. All authors reviewed and approved the final version of the manuscript.

Corresponding author

Correspondence to Olivia S. Anderson.

Ethics declarations

Ethics approval and consent to participate

Consent was obtained from the midwifery students for retrospective analysis of collected data. Participants were not required to complete all study activities and surveys. The University Institutional Review Board approved the secondary analysis of existing data (HUM00148905).

Consent for publication

Not applicable.

Competing interests

  1. 1.

    Aria Grabowski, MPH*

    1. a.

      No competing interest to disclose

  2. 2.

    Olivia S. Anderson, PhD, RD*

    1. a.

      No competing interest to disclose

  3. 3.

    Ruth Zielinski, PhD

    1. a.

      No competing interest to disclose

  4. 4.

    Melisa Scott, CNM, IBCLC

    1. a.

      No competing interest to disclose

  5. 5.

    Lisa Hammer, MD, IBCLC

    1. a.

      Lisa Hammer has received stock options from LiquidGoldConcept, Inc and serves as the breastfeeding medicine advisor for LiquidGoldConcept, Inc.

  6. 6.

    Muriel Bassil, MPH

    1. a.

      No competing interest to disclose

  7. 7.

    Samantha Chuisano, MPH

    1. a.

      Samantha Chuisano is a stockholder, employee, and Chief Operating Officer of LiquidGoldConcept, Inc.

  8. 8.

    Anna Sadovnikova, IBCLC, MPH, MA

    1. a.

      Anna Sadovnikova is the President, Chief Executive Officer, and shareholder of LiquidGoldConcept, Inc.

Additional information

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Supplementary information

Additional file 1: Supplement 1.

Case 3 Learning Objectives.

Additional file 2: Supplement 2.

Prep Materials.

Additional file 3: Supplement 3.

Open Ended Questions Codebook.

Additional file 4: Supplement 4.

Focus Group Discussion Questions.

Additional file 5: Supplement 5.

Video Codebook

Additional file 6: Supplement 6.

Self-Efficacy Questions by Case.

Additional file 7: Supplement 7.

Disagreements between participants and independent rater in Technical Skills Checklist.

Rights and permissions

Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated in a credit line to the data.

Reprints and Permissions

About this article

Verify currency and authenticity via CrossMark

Cite this article

Grabowski, A., Anderson, O., Zielinski, R. et al. Midwifery students better approximate their self-efficacy in clinical lactation after reflecting in and on their performance in the LactSim OSCE. Adv Simul 5, 28 (2020). https://doi.org/10.1186/s41077-020-00143-z

Download citation

Keywords

  • Breastfeeding education
  • High-fidelity simulation
  • Lactation simulation model
  • Midwifery education
  • Observed structured clinical examination
  • Self-reflection
  • Abbreviations
  • LactSim Lactation simulation
  • OSCE Objective structured clinical exam
  • LSM Lactation simulation model
  • IBCLC International Board-Certified Lactation Consultant