- Open Access
Exploring undergraduate nursing student interactions with virtual patients to develop ‘non-technical skills’ through case study methodology
Advances in Simulationvolume 4, Article number: 2 (2019)
Virtual patients are a recent addition to the educational arsenal to develop non-technical skills in undergraduate health professionals. The Virtual Simulated Patient Resource (www.vspr.net.au) is a web-based resource that uses branching, narrative virtual patients to develop knowledge, attitude and practice of all categories of non-technical skills in undergraduate health professionals. However, there is limited literature exploring how the interaction with a virtual patient influences the development of knowledge, attitude and practice of non-technical skills in undergraduate nursing students.
An intrinsic case study method, using focus groups and individual interviews, enabled exploration of the experience of undergraduate nursing students when interacting with a virtual patient to develop non-technical skills. Purposive sampling identified participants to address the research question. Framework analysis supported by a codebook enabled deductive and inductive data analysis.
Forty-five first-year and 31 third-year students consented to participate. Findings indicated that the different years interacted differently with the virtual patients. Four themes were recognised in the data: how the virtual patients enabled learning non-technical skills, learning surrounding the virtual patient encounter, changing the way students perceive practice and potential limitations to learning.
Interactions with virtual patients influence learning knowledge, attitudes and practice of non-technical skills in undergraduate nursing students via authenticity in the virtual patient interaction, socialisation to the professional role, vicarious learning and learning by making mistakes. Potential limitations to learning from virtual patient interactions include fear, overconfidence, groupthink and confusion. To manage limitations to learning, facilitation approaches, opportunities for reflection, constructive feedback and debriefing may be key. This study demonstrates learning non-technical skills via interactions with virtual patients can change the way students perceive practice, with learning transferable to the clinical setting to support safe and competent patient care.
Virtual patients (VPs) are defined as “interactive computer simulations of real-life clinical scenarios for the purpose of healthcare and medical training, education, or assessment” . Traditionally, VPs have been used to develop diagnostic and clinical reasoning in medical and nursing students [2, 3]. Advances in technology and educational methodology have supported the evolution of VPs to address wider areas of learning, including “non-technical skills” (NTS). Interactions with VPs are suggested to be effective in developing categories of NTS including communication, teamwork and decision-making across all health professions . However, there are limited publications exploring how the experience of interacting with VPs influences students’ learning knowledge, skill, attitudes and practise of NTS. Understanding student learning experiences is important to ensure learning activities facilitate students’ academic development.
An integrative review identified features of interactions with VPs in developing NTS in undergraduate health professionals. Three themes were reported: socialisation to the professional role, transfer of learning to the clinical setting and authenticity . However, studies included in the review only addressed isolated categories of NTS. No publication addressed the full suite of NTS categories of communication, situation awareness, teamwork, leadership, decision-making, coping with stress or managing fatigue. There is debate regarding the use of the term non-technical skills to describe these complex behaviours identified as critical components of safe and competent practice for health professionals . We use the term in this paper whilst acknowledging its limitations.
The purpose of this study was to explore experiences of undergraduate nursing students when interacting with VPs designed to develop a broad range of NTS such as communication, situation awareness, teamwork, leadership, decision-making, coping with stress or managing fatigue. The study investigated how students’ interactions with VPs influenced learning and practice of NTS.
The question underpinning this research was: How do interactions with VPs influence learning NTS in first and third-year undergraduate nursing students?
The virtual simulated patient resource
The Virtual Simulated Patient Resource (VSPR) (www.vspr.net.au. Melbourne, Victoria. Australia) is a freely available web-based resource, funded by Health Workforce Australia and the Department of Health, Victoria, Australia. The primary author led the design, development and authorship of the VSPR. The resource uses e-Learning modules and branching narrative VPs to develop knowledge, skills, attitudes and practice of all categories of NTS, including communication, situation awareness, teamwork, leadership, decision-making, coping with stress or managing fatigue in undergraduate health professionals . The study investigated how students’ interactions with VPs influenced learning and practice of NTS.
Grounded in constructivist theory, interactions with VPs support construction of new knowledge and understanding by interrogating prior knowledge and experience . Students engaged in the simulation as themselves. The narrative VP used a “choose your own adventure game” approach with short video vignettes, depicting a patient’s story over time. The simulation progressed when students selected from two choices appearing on the screen following the video vignette. A decision tree using a branching algorithm determined the next video in the simulation sequence. Consequences of decisions resulted in positive or negative effects on the patient’s outcomes, providing intrinsic feedback to students on their actions. VP interactions were completed as independent and/or small group activities. In small group activities, learning was supported by group discussion at the end of each video vignette and a concluding facilitator-guided debriefing. Students have unrestricted access to the modules and VPs in the VSPR enabling repetition. Seven VP scenarios are available in the VSPR (Table 1).
This paper reports part of a larger multisite exploratory, qualitative research project using case study methodology  with focus groups and individual interviews. We were intent on insight, discovery and interpretation of the learning experience participants have when engaging with a particular case, in this instance, the VPs in the VSPR . The year level of the undergraduate nursing student comprised the unit of analysis. The themes identified in Peddle et al.  provided the conceptual organisation for this case study, identifying areas of needed understanding, directing data collection and guiding interpretations . University Human Ethics Research Committee granted ethical approval (Ethics approval ID number: CF12/3958 – 20120018910). Reciprocal ethical approval was obtained at all study sites.
Population and sample
Purposive convenience sampling was used to identify suitable participants to address the research question. First- and third-year undergraduate nursing students from two university nursing schools in Victoria, Australia, using VSPR were invited to participate. Recruitment comprised either invitations disseminated through online subject forums or verbally after simulation activities. The primary author (MP) undertook all recruitment from March to April 2017. Forty-five first-year and 31 third-year students consented to participate.
A topic guide supported data collection via focus groups and individual interviews. The topic guide was piloted for acceptability, usability and question clarity, with outcomes guiding amendments to the question schedule and approaches (Additional file 1). Data collection occurred in person, in a private room, except for one focus group that used video-conferencing to a regional location. The primary author (MP) facilitated all focus groups and interviews except one, which due to scheduling issues was facilitated by another faculty member using the same topic guide. All focus groups and interviews were audio-recorded and professionally transcribed. In accordance with ethics approval, informed written consent was obtained prior to participation.
Framework analysis supported by a codebook was used to analyse data. Framework analysis is appropriate in deductive, inductive or combined qualitative analysis , as it assists in organising and managing text so it can be systematically compared  and interpreted .
Themes identified in an integrative review by Peddle et al.  were used as theory driven, a priori codes in the codebook, guiding deductive data analysis. Two authors (MB and MP) independently coded a focus group transcript to test applicability of the codebook. Results were compared and modifications made to the codebook. Inductive data analysis enabled recognition of data-driven codes. Each code was discussed and added to the codebook by agreement. All codes in the codebook were given labels, defined with reference to existing literature and provided a description .
Codes were entered as nodes in NVivo (QSR International Pty Ltd. Melbourne, Victoria, Australia, Version 11), and one author (MP) coded all subsequent transcripts (n = 18). During the coding process, one author (MP) exported data from randomly selected nodes, which were examined by an additional author (MB) for coherency, consistency and fit. Specific areas of concern were discussed, leading to codes being reorganised and retitled on consensus. An extended summary of each code was developed, with illustrative quotes selected from the data from different units of analysis (year level of students). Codes along with associated illustrative quotes were reviewed, revised and grouped.
One individual interview and ten focus groups were conducted with first-year students, and one interview and six focus groups with third-year students. First-year focus groups and the interview ranged from 14 to 37 min, with third-year focus groups and interview ranging from 20 to 53 min. Individual interviews were conducted where only one student accepted the invitation to participate but could not reschedule and wanted their voice to be heard in the research.
The unit of analysis in this case study was the year level of the student. An important finding highlighted by all students was that prior experience—as indicated by the year level—altered perception of cues and information in scenarios and affected options selected. Data indicated that first-year students, with limited or no prior experience in healthcare, experienced challenges with terms, language and situations portrayed complicating learning. On the other hand, third-year students conveyed that their prior experience enabled them to readily distinguish significant cues and important information, enabling them to perceive the care situation more easily.
Four themes were recognised in the data: how the VP enabled learning NTS, learning surrounding the VP encounter, changing the way students perceive practice and potential limitations to learning (Table 2).
How the VP enabled learning NTS
Five categories describe how interactions with VPs facilitated learning NTS: socialisation to role, learning through making mistakes, vicarious learning, authenticity and design. The first two categories have multiple sub-categories.
Socialisation to role
The ‘socialisation to role’ category explores how the student came to understand the norms, expectations and behaviours expected in practice. There are two sub-categories: “this is how I should be” and “develops self-confidence”.
“This is how I should be”
All students articulated that interacting with VPs enabled them to think and feel like nurses: “It’s really making me see, putting myself in them and this is going to be me, this is what I’ve got to do, this is how it’s going to be, this is the relationship I need to have” (Yr1/Grp11/Participant 3). Students developed insight into the environment, characters and events that may occur during practice, enabling identification of appropriate behaviours in specific situations: “It just gives you examples of how things might go…” (Yr3/Grp1/Participant1). Interactions with VPs enabled students to value their role, demonstrated application of professional standards in practice and developed insight into working in interprofessional teams: “… it places you in a situation where it’s not just the patient. It’s putting you in situations like - staff members and doctors...” (Yr3/Grp4/Participant 5). Interactions with VPs enabled recognition of at-risk situations and behaviours and strategies to ask for help: “…it gives an example of the best way to… go to a buddy nurse and ask for help” (Yr3/Grp1/Participant 3). All students described how interacting with VPs role-modelled professional practice.
However, whilst some first-year students expressed that interacting with VPs validated preconceived expectations, for others, the simulation provided opportunities to reframe or clarify misconceptions: “You go in thinking the doctors tell you what to do and give you a checklist on what you have to do and stuff. That’s just what everyone portrays a nurse is – [then] you have the realisation that it’s not at all” (Yr1/Grp10/Participant1). Additionally, first-year students highlighted role modelling of communication with patients as important, whereas third-year students appreciated role modelling of specific communication skills including set handover structures such as Introduction, Situation, Background, Assessment, Recommendation (ISBAR) speaking up and reporting patient deterioration.
Both year levels indicated interacting with VPs developed confidence in their abilities to respond and manage practice situations: “I feel more confident in how to handle situations like that now. I feel a lot more prepared in handling a patient and [undertaking] risk assessments” (Yr1/Grp4/Participant1).
However, where first year students described using the scenarios for skill development, third-year students described how they used the scenarios as a point of reference to “benchmark” (Yr3/Grp2/Participant1), reflect on and assess their practice. Third year students qualified this enabled reinforcement or correction of knowledge and practice, developing self-confidence: “I always look at the nurse who’s doing it and I see the mistakes they are doing. And “oh, I can do better than that!” Sometimes I actually see stuff that I…[am] missing - then I’m actually self-correcting. That actually builds confidence” (Yr3/Grp5/Participant6).
The authenticity of the VP enabled students to see relevance of the VP interaction to their professional development as it represented real practice that was familiar. There are three sub-categories: “real but not real”; “the same thing happens”; and “sometimes bad things happen”.
“Real but not real”
Most students reported the VPs as ‘real’, with authentic characters, situations, environments and events that appealed to students, enabling immersion and engagement, motivating learning. Authenticity in the interaction heightened awareness that medical errors can happen and how errors occur in practice with competent, experienced professionals: “These are actually people who are already professionals; they are registered nurses, doctors” (Yr1/Grp5/Participant 1). Many students conveyed that interacting with VPs made them cognisant of the imperfect reality of clinical practice, stating it was valuable to see ‘real’ practice: “Not everybody is going to be like a perfect friendly robot. You’re going to have co-workers who are going to be difficult. You’re going to have people and patients who aren’t going to be always respectful” (Yr1/Grp10/Participant 2). Many students were surprised how quickly clinical scenarios changed, with this variability adding authenticity to the experience: “Just to keep in mind that anything could happen to the patient and [it] might escalate very quickly” (Yr3/Grp7/Participant 4). Though, students from both years qualified that they could tell the experience was not real: “Like it didn’t feel not real, it seems pretty realistic for the most part” (Yr1/Grp1/Participant1) “…but you just know it’s not real” (Yr3/Grp 3/Participant1).
“The same thing happened”
Students described the situations, events, performance of characters and responses from patients as relatable and familiar, endorsing the interaction as relevant and credible: “When I did my placement, the same thing happened. When doctors were doing rounds, they included physio and the nurse… having arguments, as well” (Yr3/Grp4/Participant2). Students identified the scenarios emphasised various roles, multiple points of interaction and multitasking present in patient care activities, accentuating genuine risks associated when working in a team: “It shows you how hard it is to kind of communicate when you’ve got 1,000 things going on” (Yr1/Grp11/Participant 2).
“Sometimes bad things happen”
Many students thought the depiction of poor patient outcomes necessary for learning: “I think it’s useful to demonstrate severe consequences because there’s a lot of risk involved and sometimes bad things will happen and I think it’s something that we need to be exposed to” (Yr1/Grp10/Participant2). Some students valued experiencing poor patient outcomes via simulation rather than in practice: “To know what the terrible repercussions will be and I’d rather do it on this” (Yr3/Grp1/Participant2). Students described how interacting with the VP highlighted the likelihood they may experience poor professional practice: “…you know that there would be nurses like that out there that…does her poor version of [practice]. It’s scary” (Yr3/Grp3/Participant2).
However, third-year students were able to qualify that the patient outcomes depicted in the VP scenarios were believable. Furthermore, third-year students valued how interactions deepened their understanding of negative patient outcomes related to poor NTS.
Learning through making mistakes
Learning through making mistakes afforded students opportunities to see consequences of actions, galvanising some into action and prompting thinking through decisions.
All students stated it was beneficial to experience consequences of decisions made in the scenario especially when they ‘got it wrong’ (Yr3/Grp1/Participant1) and could visualise poor patient outcomes: “I think it allows you to make mistakes without actually hurting someone and learning…” (Yr1/Grp6/Participant1). Many students deliberately selected incorrect options to see the negative consequences, reporting the experience galvanised them into action: “It just shows that if you don’t speak up - what can come of it. It gives you the courage to speak up” (Yr3/Grp4/Participant7). Students appreciated understanding how mistakes and errors are managed: “That was quite a big eye opener. There are consequences for your patient [from]… mistakes but also their family as well and you’ve got to be the one to stand up and take responsibility for it” (Yr1/Grp10/Participant3).
Students from all year levels identified how interacting with VPs “really made you think” (Yr1/Grp3/Participant3) about decisions and potential consequences: “We got one of the questions wrong… Then it was like ‘oh my gosh, we didn’t even realise! We’re just like “Yes that sounds right”. We didn’t really think about it” (Yr1/Grp3/Participant2). Students clarified the interaction got them thinking ahead trying to predict outcomes: “Like you’re really thinking ahead and your sort of thinking what can go wrong or…how could this improve for the patient situation” (Yr3/Grp2/Participant1).
Strong emotional responses triggered by interacting with VPs afforded students feeling present in the care interaction, experiencing professional behaviours and the emotional burden of practice.
Students valued opportunities to experience clinical situations without the situation happening to them, learning via experiences of others: “It’s giving you an insight into an experience you haven’t got” (Yr3/Grp3/Participant1) and preparing them for future practice situations: “…instead of…freezing in the moment you have kind of seen it before” (Yr3/Grp1/Participant1). Many indicated they were present, participating in care activities, controlling the situation with responsibility for the patient: “I feel like…we were in the scene; like you were there…I saw myself as that nurse and whatever she said, I said. And how the doctor spoke with her, I just saw myself in…her shoes” (Yr1/Grp2/Participant1). However, some students felt like observers, with a “birds-eye view” (Yr3/Grp7/Particpant3).
Interacting with VPs triggered emotions including frustration related to practitioner performance and choice, pride when positive patient outcomes were achieved, and guilt, terror and fear when negative patient outcomes eventuated. Students indicated interactions developed empathy with patients as well as health professionals: “It sort of puts us in her shoes and thinking what would I be doing next if I was this person” (Yr3/Grp3/Participant3).
However, only first-year students reported interactions with VPs enabled them to experience emotions they would likely experience in practice, giving insight into reactions and the emotional burden of practice: “…it also shows you the emotional burden you’re going to be taking on. If you make a mistake, it’s real… from one little mistake, by not communicating. The patient gets hurt so it’s real” (Yr1/Grp11/Participant2).
The VP design, including the organisation and visualisation, were beneficial to learning, supporting interpretation and easier recall. The VPs were reported to be well organised, easy to navigate and aesthetically pleasing. Students liked the flow of the VPs with short, sharp, detailed videos complementing learning. Students appreciated the variation to teaching approaches in curricula, opportunities for repetition reinforcing learning and consistency afforded for all students across learning experiences. Most students reported the visual depiction of the VP a major benefit for learning, with videos easier to interpret and recall in practice and the information staying with them longer: “If I see a video and I see how it’s done and I see how you’re meant to act, how your tone of voice is; that for me works better. I need to visualise something to get a better understanding” (Yr1/Grp3/Participant2). Students stated the VPs were easy to engage with and appreciated “not [being] thrown in the deep end” (Yr3/Grp2/Participant1). Students preferred the real human reactions and interactions portrayed in the VPs over mannequin-based simulation, commenting: “the patient actually responds” (Yr1/Grp4/Participant1).
Learning surrounding the virtual patient encounter
Students identified that learning content and activities surrounding the VP interaction supported learning knowledge, skill, attitudes and practice of NTS. There were three sub-categories: “we’ve all got to work together”, “reflective practice” and “connects with content”.
“We all got to work together”
Students reported learning in small group approaches was powerful. They valued group discussions enabling them to identify missed cues, view situations differently and clarify concepts: "if you watch it by yourself you don’t realise it but you’re focusing on one thing, but…when you start talking, everyone will go, “Didn’t you see that guy do this?” and, “What about when she did that?” And I’m like, “Oh, I didn’t even see that” (Yr3/Grp7/Participant3). Students valued opportunities to practise NTS including, appreciating other perspectives, managing conflict, considering different ways of thinking and collaborating with others to solve problems: “I like how the video made a classroom full of people with different skills work together… that’s what’s going to happen when we’re actually in the healthcare industry. So, it was good practice communicating and working with different people” (Yr1/Grp3/Participant2).
Interacting with VPs promoted student reflection on practice: “It’s very good for reflective practice, learning what you’ve done, where you went wrong, how you’d improve it next time, why you shouldn’t have done that” (Yr1/Grp8/Participant3). Students across all year levels clarified they would reflect on their interactions with the VP and complete follow-up activities to make sense of learning. Other students explained they would repeat the interaction when they needed a refresher.
“Connects with the content”
Students reported interacting with VPs reinforced concepts learnt in other subjects. Students clarified the interaction offered more detail and a means to integrate learning as a cohesive whole: “I feel like it does connect with the content that we’ve been learning so far. I wasn’t thinking in my head ‘I don’t need to watch this, this is not relevant’. I was thinking ‘this is really important and I should use this resource’…even when I was doing lab, I felt like it was in touch with what my lab teacher was going through” (Yr1/Grp3/Participant1).
Changing the way students perceive practice
Students identified how interacting with VPs enabled application of specific strategies in practice. Three sub-categories were identified: practical value, “that’s not the way we do it here” and “we are all involved in patient safety”.
Many students described application of skills learnt from interactions with VPs to situations in practice. Students clarified how the realistic presentation of situations in VPs made it easier to recall the scenarios in practice: “So, if you were in that same situation, you think back to this video it’ll be in your head” (Yr1/Grp8/Participant4). Many students described intentions to implement NTS demonstrated in VPs in their practice: “When you do watch it…you pick up little things, yes, that’s good…I’ll take that away with me. I like how she said that, I am [going to] use that” (Yr3/Grp1/Participant3). Students reported using reflective practices developed to reflect on their practice: “just to think after your working day, what I could do better, what went wrong and why it wrong and just thinking what can you improve” (Yr1/Grp5/Participant1).
However, first-year students identified benefits to technical aspects of practice such as one first-year student describing how participating in the VPs enabled her to manage a resident who had a fall. While third-year students identified how interactions shaped unconscious patterning: “It’s like we indirectly take stuff from them…I don’t go on placement and say I am [going to] do exactly this that I saw in the video. Then you do it and you realise… ok…I learnt that from the video” (Yr3/Grp1/Participant3).
“That’s not the way we do it here!”
All students reported discord when transferring NTS learnt interacting with VPs to the clinical setting several weeks after the activity. A first-year student described: “Placement was a bit confronting for me it was…not what I expected. We had been taught a lot of – ‘This is the way things should go.’ But…in the placement things did not necessarily go like that. I think that perhaps not all the things we learnt at the university were in place in the workplace” (Yr1/Grp1/Participant2). Third-year students described shortcuts taken, practice not evidence-based and gaps in knowledge regarding NTS.
“We’re all involved in patient safety”
Students reported interacting with VPs assisted understanding the link between NTS and patient safety: “The point is that…it doesn’t matter what kind of level you are…we’re all involved in a patient’s safety.” (Yr1/Grp5/Participant1).
However, most first-year students were not aware of, or did not have, clarity around NTS in practice. Conversely, most third-year students articulated clear understanding of NTS: “It could be fatal on the patient’s outcome, as well. It could lead to either further complications, or it could lead to death of the patient” (Yr3/Grp4/Participant2).
Potential limitations to learning
Five categories were associated with potential limitations to learning including: fear, overconfidence, barrier of the classroom, confusion and groupthink.
Only first-year students raised the potential negative impacts of poor patient outcomes on learning. First-year students were surprised by “all the bad outcomes” (Yr1/Grp5/Participant1), expressing fear and being “freaked-out” (Yr1/Grp5/Participant1). These students suggested portrayal of poor patient outcomes might cause overthinking, hesitation or second-guessing oneself in practice.
Only first-year students indicated that interactions with VPs had corrected overconfidence: “… I thought I would not make the patient fall. That’s it, I’ve got it! And then when I’m making the choices I’m like, oh okay” (Yr1/Grp8/Participant4). Conversely, third-year students highlighted risks in developing overconfidence following the VP interaction: “You get confidence but not real confidence” (Yr3/Grp3/Participant2) and "I look at all the procedures and I’m like, “Yeah, I can do this.” (Yr3/Grp5/Participant6). Other third-year students indicated: “Like if it was an emergency and they made you go to the phone, you wouldn’t be so confident, but…it wouldn’t phase you” (Yr3/Grp3/Participant2).
Barrier of the classroom
Some students from both year levels could not move beyond the barrier of the classroom environment and engage in the learning: “I could tell like it’s sort of set up, just like the way people communicate. Like they know what they’re going to say, which doesn’t really happen in real life, but the situation was real, but I could just tell that it wasn’t real” (Yr1/Grp4/Participant 2). Some qualified they were waiting and expecting something to happen making the experience feel contrived. One student clarified that to consolidate learning achieved from interacting with VPs, they would need to experience the situation in practice.
Several students across both year levels reported they found some options in the VP interaction confusing, with wording difficult to understand such as “Vital signs within reportable limits” and “Patient observations demonstrate a significant pattern.” However, nearly all students qualified; once the next video in the VP sequence played, they could make sense of the question.
However, first-year students reported issues with fundamental medical terminology and understanding clinical features of the scenario, whereas third-year students expressed frustration at limited options available: “With the options, I thought it was limited, because you only had two choices. I thought, if there was maybe…four choices, at least you were more able to…critically think a bit more” (Yr3/Grp4/Participant9), clarifying choices appeared “black and white” (Yr3/FG5/Participant2) with no right options available at times.
Students indicated it was a “majority rules” (Yr1/Grp6/Particpant1) approach and communicated at times “there was a bit of tension in the class with the other students” (Yr1/FG9/Participant2) and discussions “kind of turned into an argument” (Yr1/FG7/Participant2), with “people being disrespectful” (Yr1/FG7/Participant1) due to dissenting opinions. At times, when "somebody brought up one point we all kind of changed our minds’ (Yr1/Grp9/Participant1), others chose to remain quiet: “I picked the correct answer first but then when everyone else said it was the other one I was kind of like okay I’ll kind of be a bit quiet” (Yr1/Grp8/Participant5) and conform to groupthink.
This research reinforces findings indicating interactions with VPs develop knowledge, skills, attitudes of NTS in undergraduate health professionals via socialisation to professional role and authenticity in the VP interaction, with skills transferrable to practice. It clarifies that learning NTS via VP interactions can change the way students perceive practice. New themes in this research suggest learning through making mistakes, vicarious learning, design of the VP and learning surrounding the VP interaction are significant factors facilitating learning NTS via VP interactions. Lastly, this research highlighted potential limitations to learning and practise of NTS including fear, overconfidence, classroom barrier, confusion and groupthink.
A number of particularly interesting findings from this research add to existing understandings of VPs. These are learning through mistakes, vicarious learning, groupthink, impact of overconfidence on practice and consideration of the prior experience of the learner. Each of these findings is discussed in turn.
Learning through mistakes is proposed to have a powerful impact on learning . When learners make mistakes, they have strong emotional responses, which may encourage, motivate [13,14,15] and promote deep learning, supporting knowledge retention and transfer of learning . Additionally, simulated mistakes can amplify student awareness of the possibility of clinical errors in practice [15, 16]. The design of the VP in this study, to demonstrate negative patient outcomes, supported discussion, developing critical thinking  and identification of gaps in knowledge and skill . Students reported that experiencing and exploring mistakes in interactions with VPs facilitated learning. They described strong emotional reactions to negative outcomes such as guilt, terror and fear, as well as sometimes deliberately seeking to make mistakes to see what the consequences were. This led to them to reflect on how they would act in practice and seeing patient safety as everyone’s responsibility.
Conversely, this study highlighted that learning through mistakes could negatively influence learning, causing students to be scared or “freak-out” about possibilities of harming patients in practice. Experiencing negative consequences can be traumatic for some learners, leading to defensive practice  including fear of failure in practice and hesitation in initiating patient care . In this research, whilst interaction with the VP made real for learners the possibilities of making mistakes in practice, they also sparked feelings of guilt, terror and fear. When VPs depict error and adverse events resulting in serious harm or death to patients, consideration may be needed by faculty to provide opportunities for reflection. Reflection can enable re-contextualisation of the experience and facilitation of learning  to translate the experience of “getting it wrong” into positive learning about NTS.
Vicarious learning proposes it is possible to learn through another’s first-hand experience . Vicarious learning is advocated to be an important strategy for novice learners who have a deficit of prior knowledge and experience . Timbrell  suggests vicarious learning assists novices to generate personal meanings from secondhand experiences, supporting transfer of learning to clinical practice . In this research, students indicated interactions with VPs placed them in the clinical situation, involving them in the patient care situation, enabling them to contemplate how they may think, respond and act in future clinical situations. Additionally, vicarious learning enables coding of observed behaviours to be used to guide future action . In this study, students highlighted interactions with VPs supported framing future behaviours, “I’m going to use that”, to guide practice.
Novice learners benefit from small group discussions as they provide opportunities for learners to recognise important factors and cues, connect knowledge and assess and analyse their own understanding . However, this research shows a potential limitation to learning NTS is “groupthink”. Groupthink is when humans influence or bias each other’s decision-making . In this research, learners reported exactly this. Groupthink can result in poorer decisions, as members of the group may not consider all options, or some group members may impose self-censorship to avoid inconsistency . If learners perceive an environment as psychologically safe, they are more likely to engage in open discussion and share ideas without fear of repercussions . Strategies to facilitate this safe environment where participation and learning is enhanced and disengagement is minimised  in interactions with VPs warrants further exploration.
Improved self-confidence is often cited as an outcome from simulation-based learning . This research identifies that there is also a risk of developing overconfidence, or “miscalibration of one’s own sense of accuracy and actual accuracy” . Overconfident practitioners are deemed more likely to make mistakes  as they are less likely to “consult with colleagues or utilise tools, protocols or practice guidelines to aid their decision-making” . Moreover, overconfidence is linked to diagnostic error . Strategies to reduce risks of developing overconfidence include refining expertise via further education and training, reflective practice to increase self-awareness and constructive feedback to assist learners be better calibrated to their personal performance . This study suggests a need for balance between reflection and constructive feedback to assist learners better align perceived competency with actual competency in interactions with VPs.
Other limitations to learning in VP interactions included frustration at the wording of options to progress the simulation and third-year students perceiving “no right” options available to respond to the clinical situation. This study highlighted that students’ prior experience influenced perception of cues and ability to interpret significance of information, which in turn affected options selected. As learners developed expertise, they moved from reliance on objective facts and rules to using past concrete experiences and seeing the situation as a whole, rather than a compilation of its parts .
First-year students are novice learners; hence, when wording and question formulation deviated from the rule bound principles, they experienced confusion and frustration . These students possessed limited understanding of NTS and appreciated role modelling of specific behaviours in practice that assisted in clarifying misconceptions. However, lack of experience for first-year students may have created confusion, which at times detracted from their learning. Moreover, first-year students suggested that interactions with VPs that result in poor patient outcomes might develop fear of practice.
Accordingly, third-year students, as advanced beginners, were able to perceive the situation holistically and based on their prior concrete experiences, at times suitable options to respond to clinical situations were not available . Third-year nursing students demonstrated clear understandings of NTS, using the believable, realistic, VP scenarios to benchmark and assess their own practice. However, these students indicated there were risks in developing overconfidence in practice and that at times, no right options were available to progress the simulation, due to their prior clinical experience.
Strengths and limitations
Theoretical suppositions were used to guide data analysis as per case study methodology. Data collection occurred across 2-year levels at two distinct sites. Transferring findings to other student cohorts is supported by the naturalistic study setting, with multiple data sources. Themes, categories and sub-categories were created, labelled and defined by MP and MB by agreement. Data were examined for consistency, coherency and fit with conflicts resolved through discussion and consensus from all authors. Focus groups and interviews facilitated a detailed, in-depth understanding of the learning experience of undergraduate nursing students. However, caution must be exercised as focus group composition may not be representative of the wider population and there is risk that data arises from dominant participants. During data collection, the primary author was on research leave and had no formal relationship with the students who participated in the research. Moreover, it is important to note that the primary author led the design, development and authorship of the VSPR. Hence, the primary author worked closely with co-authors to ensure rigour in the research, transparency in analysis and trustworthiness of findings.
The focus of this research was undergraduate nursing students. Additional research is required to examine the learning experience of students interacting with VP from other professions. Additionally, the role of faculty and debriefing in reconceptualising learning from negative patient outcomes, specific facilitation strategies to prevent groupthink, and the influence of reflection and constructive feedback on overconfidence warrant further investigation.
There were a number of possible recommendations for practice arising from this research. This study suggests that in order to facilitate learning NTS though VP interaction for undergraduate nursing students, faculty can provide opportunities for reflection, supported by constructive feedback, to enable learners to reconceptualise experiences and feelings into learning. Additionally, faculty are advised to be conscious of the potential for groupthink and have the ability to maintain awareness in the classroom, whilst enabling a supportive and secure learning environment. Finally, faculty can be mindful that the level of complexity of the learning in the VP interaction fits with the level of experience of the learner.
Interactions with VPs in VSPR influence learning knowledge, attitudes and practice of NTS in undergraduate nursing students via authenticity in the VP interaction, socialisation to the professional role, vicarious learning and learning by making mistakes. This research highlights the importance of connection of the VP interaction to learning surrounding the activity to maximise learning outcomes. To manage potential limitations to learning from VP interactions including fear, overconfidence, groupthink and confusion; facilitation approaches, opportunities for reflection, constructive feedback and debriefing may be key. This study demonstrates learning NTS via interactions with VPs can change how students perceive practice, with learning transferable to the clinical setting to support safe and competent patient care.
Introduction, Situation, Background, Assessment, Recommendation
Virtual Simulated Patient Resource
Ellaway R, Poulton T, Fors U, McGee JB, Albright S. Building a virtual patient commons. Med Teach. 2008;30(2):170–4.
Bateman J, Allen M, Samani D, Kidd J, Davies D. Virtual patient design: exploring what works and why. A grounded theory study. Med Educ. 2013;47(6):595–606.
Forsberg E, Ziegert K, Hk H, Fors U. Clinical reasoning in nursing, a think-aloud study using virtual patients – a base for an innovative assessment. Nurse Educ Today. 2014;34(4):538–42.
Peddle M, Bearman M, Nestel D. Virtual patients and nontechnical skills in undergraduate health professional education: an integrative review. Clin Simul Nurs. 2016;12(9):400–10.
Nestel D, Walker K, Simon R, Aggarwal R, Andreatta P. Nontechnical skills: an inaccurate and unhelpful descriptor? Simul Healthc. 2011;6(1):2–3.
Peddle M, McKenna L, Bearman M, Nestel D. Development of non-technical skills through virtual patients for undergraduate nursing students: an exploratory study. Nurse Educ Today. 2019;73:94–101 In press.
Grapczynski CA, Schuurman S, Booth AD, Bambini D, Beel-Bates C. The integrated model for interprofessional education: a design for preparing health professions’ students to work in interprofessional teams. J Allied Health. 2015;44(2):108–14.
Merriam SB. Qualitative research: a guide to design and implementation. San Francisco: Jossey-Bass; 2009.
Merriam S. Qualitative research and case study applications in education. San Francisco: Jossey-Bass Inc. Publishers; 1998.
Stake RE. The art of case study research. Thousand Oaks, London, New Delhi: Sage; 1995.
Gale NK, Heath G, Cameron E, Rashid S, Redwood S. Using the framework method for the analysis of qualitative data in multi-disciplinary health research. BMC Med Res Methodol. 2013;13(1):117.
Fereday J, Muir-Cochrane E. Demonstrating rigor using thematic analysis: a hybrid approach of inductive and deductive coding and theme development. Int J Qual Methods. 2006;5(1):80–92.
King A, Holder MG, Ahmed RA. Errors as allies: error management training in health professions education. BMJ Qual Saf. 2013;22(6):516–9.
Fischer MA, Mazor KM, Baril J, Alper E, DeMarco D, Pugnaire M. Learning from mistakes. J Gen Intern Med. 2006;21(5):419–23.
Reime MH, Johnsgaard T, Kvam FI, Aarflot M, Breivik M, Engeberg JM, et al. Simulated settings; powerful arenas for learning patient safety practices and facilitating transference to clinical practice. A mixed method study. Nurse Educ Pract. 2016;21:75–82.
Ziv A, Ben-David S, Ziv M. Simulation based medical education: an opportunity to learn from errors. Med Teach. 2005;27(3):193–9.
Gardner A, Rich M. Error management training and simulation education. Clin Teach. 2014;11(7):537–40.
Allan HT, Magnusson C, Evans K, Ball E, Westwood S, Curtis K, et al. Delegation and supervision of healthcare assistants’ work in the daily management of uncertainty and the unexpected in clinical practice: invisible learning among newly qualified nurses. Nurs Inq. 2016;23(4):377–85.
Lean J, Moizer J, Newbery R. Enhancing the impact of online simulations through blended learning: a critical incident approach. Education+ Training. 2014;56(2/3):208–18.
Roberts D. Vicarious learning: a review of the literature. Nurse Educ Pract. 2010;10(1):13–6.
Timbrell J. Instructional storytelling: application of the clinical judgment model in nursing. J Nurs Educ. 2017;56(5):305–8.
Bahn D. Social learning theory: its application in the context of nurse education. Nurse Educ Today. 2001;21(2):110–7.
Konia MR, Richtsfeld M, Johnson AD, Lougee M, Cohn C, Morgan S. An observational study of 3 different transfusion medicine teaching methods for medical students. Transfus Med Rev. 2018;32(2):117–22.
Kaba A, Wishart I, Fraser K, Coderre S, McLaughlin K. Are we at risk of groupthink in our approach to teamwork interventions in health care? Med Educ. 2016;50(4):400–8.
Roussin CJ, Larraz E, Jamieson K, Maestre JM. Psychological safety, self-efficacy, and speaking up in interprofessional health care simulation. Clin Simul Nurs. 2018;17:38–46.
Rudolph JW, Raemer DB, Simon R. Establishing a safe container for learning in simulation: the role of the presimulation briefing. Simul Healthc. 2014;9(6):339–49.
Alanazi AA, Nicholson N, Thomas S. The use of simulation training to improve knowledge, skills, and confidence among healthcare students: a systematic review. Internet Journal of Allied Health Sciences and Practice. 2017;15(3):2.
Berner ES, Graber ML. Overconfidence as a cause of diagnostic error in medicine. Am J Med. 2008;121(5):S2–S23.
Clarke ML. Peer tutoring of junior nursing students: student experiences and perceptions of self-efficacy and benefit: Liberty University; 2016.
Harris W, Rotheram A, Pearson S, Lucas P, Edwards D, Bowerman L, et al. Paramedic confidence in estimating external blood loss. Australasian Journal of Paramedicine. 2017;14(3):535.
Benner, P. From novice to expert : Excellence and power in clinical nursing practice. Menlo Park, Calif: Addison-Wesley Pub., Nursing Division; 1984.
Availability of data and materials
The authors declare that the data supporting the findings of this study are available within the article.
Ethics approval and consent to participate
University Human Ethics Research Committee granted ethical approval (Ethics approval ID number: CF12/3958 – 20120018910). Reciprocal ethical approval was obtained at all study sites. In accordance with ethics approval, informed written consent was obtained prior to participation.
Consent for publication
All authors declare that they have no competing interests.
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
: Focus group and interview guide. (DOCX 13 kb)