References

Agu CF, Stewart J, McFarlane-Stewart N, Rae T. COVID-19 pandemic effects on nursing education: looking through the lens of a developing country. Int Nurs Rev. 2021; 68:(2)153-158 https://doi.org/10.1111/inr.12663

AlKhaibary AA, Ramadan FZ, Aboshaiqah AE, Baker OG, AlZaatari SZ, AlZaatari SZ. Determining the effects of traditional learning approach and interactive learning activities on personal and professional factors among Saudi intern nurses. Nurs Open. 2021; 8:(1)327-332 https://doi.org/10.1002/nop2.633

Alsafi Z, Abbas AR, Hassan A, Ali MA. The coronavirus (COVID-19) pandemic: adaptations in medical education. Int J Surg. 2020; 78:64-65 https://doi.org/10.1016/j.ijsu.2020.03.083

Banning M. The think aloud approach as an educational tool to develop and assess clinical reasoning in undergraduate students. Nurse Educ Today. 2008; 28:(1)8-14 https://doi.org/10.1016/j.nedt.2007.02.001

Dewart G, Corcoran L, Thirsk L, Petrovic K. Nursing education in a pandemic: academic challenges in response to COVID-19. Nurse Educ Today. 2020; 92 https://doi.org/10.1016/j.nedt.2020.104471

Hansen BS, Rørtveit K, Leiknes I, Morken I, Testad I, Joa I, Severinsson E. Patient experiences of uncertainty - a synthesis to guide nursing practice and re search. J Nurs Manag. 2012; 20:(2)266-277 https://doi.org/10.1111/j.1365-2834.2011.01369.x

Haslam MB. What might COVID-19 have taught us about the delivery of Nurse Education, in a post-COVID-19 world?. Nurse Educ Today. 2021; 97 https://doi.org/10.1016/j.nedt.2020.104707

Hungerford C, Walter G, Cleary M. Clinical case reports and the viva voce: a valuable assessment tool, but not without anxiety. Clin Case Rep. 2015; 3:(1)1-2 https://doi.org/10.1002/ccr3.225

Nursing and Midwifery Council. Realising professionalism: standards for education and training. Part 2: standards for student supervision and assessment. 2018. http://tinyurl.com/y7kfynub (accessed 24 February 2023)

Orrock P, Grace S, Vaughan B, Coutts R. Developing a viva exam to assess clinical reasoning in pre-registration osteopathy students. BMC Med Educ. 2014; 14:(1) https://doi.org/10.1186/1472-6920-14-193

Ramos-Morcillo AJ, Leal-Costa C, Moral-García JE, Ruzafa-Martínez M. Experiences of nursing students during the abrupt change from face-to-face to e-learning education during the first month of confinement due to COVID-19 in Spain. Int J Environ Res Public Health. 2020; 17:(15) https://doi.org/10.3390/ijerph17155519

Roberts D. The clinical viva: an assessment of clinical thinking. Nurse Educ Today. 2013; 33:(4)402-406 https://doi.org/10.1016/j.nedt.2013.01.014

Severinsson E, Holm AL. Knowledge gaps in nursing leadership - focusing on health care systems organisation. J Nurs Manag. 2012; 20:(6)709-712 https://doi.org/10.1111/j.1365-2834.2012.01472.x

Shoghi M, Sajadi M, Oskuie F, Dehnad A, Borimnejad L. Strategies for bridging the theory-practice gap from the perspective of nursing experts. Heliyon. 2019; 5:(9) https://doi.org/10.1016/j.heliyon.2019.e02503

Stuckey L, Wright A. Innovations in Education in Response to COVID-19: Online Medication Commercials. Nurse Educ. 2020; 45:(4) https://doi.org/10.1097/NNE.0000000000000852

Swift A, Banks L, Baleswaran A COVID-19 and student nurses: A view from England. J Clin Nurs. 2020; 29:(17-18)3111-3114 https://doi.org/10.1111/jocn.15298

Torbjørnsen A, Hessevaagbakke E, Grov EK, Bjørnnes AK. Enhancing students learning experiences in nursing programmes: an integrated review. Nurse Educ Pract. 2021; 52 https://doi.org/10.1016/j.nepr.2021.103038

Clinical learning for pre-registration nursing students: a viva voce approach during COVID-19

09 March 2023
Volume 32 · Issue 5

Abstract

The COVID-19 pandemic restricted face-to-face contact between students and educators, limiting continual assessment of student's clinical skill development. This led to rapid transformational online adaptations to nursing education. This article will present and discuss the introduction of a clinical ‘viva voce’ approach, which has been used at one university to formatively assess students' clinical learning and reasoning skills using virtual methods. The Virtual Clinical Competency Conversation (V3C) was developed using the ‘Think aloud approach’ and involved facilitated one-to-one discussion based on two questions from a bank of 17 predefined clinically focused questions. A total of 81 pre-registration students completed the formative assessment process. Overall, feedback from students and academic facilitators was positive and facilitated both learning and consolidation in a safe and nurturing way. Further local evaluation is continuing to measure the impact of the V3C approach on student learning now that some aspects of face-to-face education have resumed.

Although it is not yet possible to fully realise the long-term implications of the COVID-19 pandemic on global nurse education, there have been substantial changes to the provision of education for nursing students due to the pandemic spanning high-, medium- and low-income countries (Agu et al, 2021). Currently, both for many nurse educators and students, the scholastic journey has become unrecognisable from the pedagogical approach that we have become accustomed to. Although this pandemic has been one of the greatest challenges for nursing in over a century of professional practice, for nurse educators it has sown the seeds of change and forced many new adaptations to be made to what have been firmly established educational practices (Swift et al, 2020; Haslam, 2021).

Background

Before COVID-19, clinical skills within higher education institutions were commonly assessed using a mixture of high- and low-fidelity simulation and assessment, involving both nursing-specific and interdisciplinary approaches to learning. During the first wave of the global pandemic, there was a move to limit all face-to-face contact between students and educators, leading to primarily online learning (Dewart et al, 2020; Ramos-Morcillo et al, 2020). This involved extended periods of using only screen-based learning and assessment (Alsafi et al, 2020). An example involves the move to using video footage of physical assessment skills to facilitate the learning of both technical and critical reasoning skills. Similarly, in academic assessment, in many instances, traditional written and/or on-campus examinations have been replaced by remote, online, open-book alternatives (Alsafi et al, 2020). Other innovations reported in the literature include online video-based assessments that enable students to create and perform in medication advertising, which utilises skills akin to those of influencers and social media professionals (Stuckey and Wright, 2020).

Throughout 2020 and 2021, while nursing students continued to study, these students filled vital gaps in the global nursing workforce. In some cases, the demand for emergency registration resulted in nursing students achieving registered status earlier than they had expected. For the educators, there was a need to support these working students through the challenges of the healthcare workplace, while continuing to ensure that they achieved the standards required to join or remain on the register (Nursing and Midwifery Council (NMC), 2018; Dewart et al, 2020). For many, this involved finding new ways of measuring the learning and maintaining of both technical and reasoning-related skills.

Despite these experiences over the past 30 months, there has been a careful return to more face-to-face teaching activities in many universities in the UK since September 2021. Alongside this move, it has been recognised that nurse educators must continue to apply the innovative learning experiences acquired at the height of the global pandemic when developing educational interventions. This is particularly important because there is substantial evidence showing that use of interventions that apply educators' knowledge and pedagogical skills flexibly to meet the needs of students inevitably improves the student experience (Torbjørnsen et al, 2021).

The aim of this article is to report on one successful adaptation to the pre-registration master of science academic programme for both adult and mental health nurses in the Florence Nightingale Faculty of Nursing, Midwifery and Palliative Care at King's College London. The educational intervention was established from a need for students to demonstrate the development of their clinical skills across the academic programme. During the spring of 2020 there was a need to create remote methods for measuring clinical learning, focusing on communication, technical skill acquisition and the development of clinical reasoning, using a style that complemented the education that student nurses received while in the clinical practice setting.

The resulting intervention involved a remote clinical viva voce approach adapted from previously published methods (Roberts, 2013; Orrock et al, 2014; Hungerford et al, 2015), used as a formative assessment. Within the academic programme, the viva voce technique was named the Virtual Clinical Competency Conversation (V3C), and these terms will be used interchangeably in this article to aid understanding of the process.

Applying a viva voce approach

The development of the viva voce approach to measuring clinical learning is theoretically driven, and has been previously applied successfully in UK nurse education (Roberts, 2013). Following suit, our viva voce technique employed the ‘Think aloud approach’, whereby learners are encouraged to vocalise their thought processes to provide the educator with insights into the cognitive processes that underpin the discussion in question (Banning, 2008). In action, this involves the student verbalising their thought processes to an educator after being given a clinical question that incorporated components of decision-making, critical reasoning and technical skills description. The ‘Think aloud approach’ recognises six key ‘cognitive operators’, measured in relation to nursing practices in this viva voce approach (Banning, 2008):

  • Connecting cues to identify potential interactions
  • Using descriptive methods to describe concepts and processes
  • Evaluating and interpreting information
  • Providing a justification for actions and decisions
  • Formulating information to reach a conclusion
  • Developing a plan that safeguards and encompasses likely potential outcomes.

Questions were developed incorporating components of the local clinical practice assessment document, relevant to the students' stage of training, focusing particularly on areas of the curriculum that would normally be covered through clinical simulations. Table 1 presents the selected topics areas for inclusion in the V3C.


Table 1. V3C topics selected from the curriculum
Technical knowledge and practical application Patient assessment and risk stratification approaches Planning and evaluating care Communication and human factors
Aseptic non-touch technique (ANTT) Vital signs, national early warning score (NEWS) Management of a patient who has taken an overdose Situation, background, assessment, recommendation (SBAR)
Catheterisation of a female/male patient Cardiac pathophysiology and assessment Managing a patient with an infectious disease Diagnostic overshadowing
Wound care and infection control Respiratory pathophysiology and assessment Managing an unconscious patient Closed loop communication and effective sharing of the mental model
Safe collection of specimens Neurological assessment and Glasgow coma scale Managing a patient with a diabetic emergency Accurately sharing complex information
Injection technique Gastrointestinal pathophysiology and assessment Managing a haemorrhaging patient Information sharing with patients and family members
Enteral feeding Musculoskeletal assessment Managing challenging behaviours and using support plans Confidentiality, capacity and consent

For these topic areas a bank of 17 questions were developed, discussed and agreed across the teaching teams from the mental health and adult departments. The following are example questions from within the questioning framework used with both adult and mental health student nurses:

  • You find a collapsed patient in the ward bathroom. The patient is breathing and showing signs of life. Describe your immediate actions and the priorities in your subsequent assessment process
  • A 74-year-old female patient was admitted to hospital after developing bilateral lower limb oedema. First, consider what pathophysiological processes could cause this. Second, describe the steps you would follow when planning the potential care needs for this patient.

Implementation of the clinical viva voce approach

Between October and November 2020, 81 pre-registration students (mental health, n=33; adult, n=48) participated in a formative clinical conversation with one of eight academic facilitators. Students were asked two questions from a range of topics (Table 1) relating to either a skill or potential clinical scenario (or both). In addition to the aforementioned areas of nursing practice, aspects of communication and human factors were integrated within the process. No distinction was made between questions asked of mental health and adult nursing students to ensure that they had opportunities to explore learning and experience in both fields of nursing.

Each student was invited to select one topic and the facilitator asked the corresponding question (Figure 1). The facilitator then selected the second question from the prepared topic list. Each V3C lasted up to 30 minutes, with the requirement for every student to demonstrate requisite knowledge, skills and values around preserving patient safety and practising effectively. During the V3C, each student was encouraged to draw on theoretical and clinical practice experience to reflect their depth of knowledge and understanding. A series of prompts and queries was used to enable students to explore responses.

Figure 1. The viva voce process

The conversation was to be reinforced as a learning process and a formative component of the module assessment. The facilitators assessed the student against practice standards. At the end of the V3C, the facilitator informed the student whether their responses had demonstrated safe practice in keeping with NMC (2018) requirements and within the scope of practice as a part 2 MSc student nurse. Achieving the standard did not impact on the student's final module grade. Where student's responses demonstrated unsafe practice, a second V3C was arranged with another assessor, normally the respective module leader (Figure 1).

Evaluating the clinical viva voce process

In autumn/winter 2020/2021, feedback and reflection on the V3C activity were conducted by academic facilitators and participating students. The reflective process focused on exploring the student experience of this learning model.

As part of regular evaluation activity, anonymous student evaluation feedback was collected at various time points, which consisted of student comments made in group reflection; feedback was hand noted with consent. No other details were recorded. This non-identifiable feedback was used as a process of clinical supervision and a vehicle to start evaluating the V3C activity.

Due to the programme structure, the mental health students were the first to participate in the V3C activity, which enabled the project team to engage in an iterative, cyclic evaluation process to be refined before the adult branch students participated. This method of reflective evaluation was employed primarily to facilitate an ongoing development process to ensure the intervention met the needs of the education team and students. Table 2 presents key aspects of the early initial reflective evaluation from the mental health students.


Table 2. Initial reflective feedback from mental health students on how the V3C activities might be organised better
Time point Feedback
Before the viva voce Outlining that the conversation will be for approximately 30 minutes, 10–15 minutes per question, which may be skill and/or scenario based
Providing relevant resources students could access to prepare
During the viva voce Enabling students to feel involved and engaged as co-collaborators; the academic at the start of the session could briefly state the topics they would be discussing and then follow up by asking the student which of these they would like to talk about first. The academic then could select the corresponding question for that topic and move on to the second topic thereafter
Reminding students that the purpose of the conversation was to discuss and review safe practice and not to ‘pass/fail’
Stating that any concerns about safe practice (knowledge, skills or values) will be raised in the conversation and discussed, as well as, if necessary, being brought to the attention of the respective module leader

Following completion of the V3C activity with the adult field students, further reflective evaluation sessions were conducted. The remaining anonymous feedback was reviewed by members of the project team, grouped together and categorised. Key areas of focus included:

  • Student guidance
  • Clinical topics
  • Student expectations
  • Timing of the activity
  • Student experience
  • Focus.

Overall, the evaluative comments were positive from both students and academic facilitators. Table 3 presents a summary of the key secondary evaluation feedback on the V3C activity. Box 1 presents a personal reflection from one adult and one mental health student on the V3C process.


Table 3. Summary of secondary evaluation feedback from students
Category Evaluation feedback
Student guidance
  • Content to be more specific, eg clarifying whether questions would be skills based or scenario based
  • The guidance list of topics was too long for some, whereas others felt that the list was comprehensive and enabled deep revision of content
  • Clarification of the time within which students were expected to answer the question was required, as well as the level or depth to prepare responses
  • An example question could have been provided
  • There was an expectation of biological knowledge rather than principles of safe practice. Some students wanted clarification of process in relation to MSc and Nursing and Midwifery Council requirements about safe practice
Clinical topics
  • Some said that the topics were too broad and needed a more specific focus of questions and scenarios
  • The extensive nature of the topics encouraged revision of all content, not just some
  • Greater consistency across V3C facilitators was required, by ensuring that all students are asked one scenario-based question and one skills-based question
  • An understanding surrounding safe practice within their scope of practice as student nurses was gained
Student expectations
  • It was a rewarding experience at the end of the module that met expectations about own learning
  • The V3Cs were not what students expected and some said they had spent a lot of time revising. Others said the that questions were too general and simple
Timing of the activity
  • Most students felt that a ‘short and sharp’ approach worked best. Others wanted a longer time with the academic to explore more than two questions
  • There were varied views re: the notification time to prepare for V3Cs. Some students thought 1 week was not enough notice to revise and prepare, others said that they preferred less time to revise because it assisted in managing their sense of anxiety
  • In terms of the timing of the V3Cs within the programme, some students said that holding the V3Cs at the end of the module was good, allowing revision and consolidation of learning. Others felt that the V3Cs should not be held just before submitting the summative assessment and attending other module requirements
Student experience
  • Some individuals found that the experience made them anxious while trying to revise many topics in such a short space of time. Others found the preparation process to be a lot of work when there were additional learning requirements to be met
  • Most students said they found it to be a rewarding experience and that it provided a confidence boost
Focus
  • The one-to-one experience provided by the V3C enabled a more detailed focus on individual students to share knowledge, skills and values
  • Most students commented that they felt more relaxed during the session than anticipated, which allowed them to open up and talk
  • Immediate feedback on progress was commonly reported as a major benefit of the V3C process

Box 1.Students' personal reflections

Adult MSc student Mental health MSc student
The V3C process turned out to be an ideal opportunity to reflect on our knowledge, skills and values from simulation sessions and clinical practice. It allowed us to identify gaps in our knowledge and formulate comprehensive notes and learning strategies.I found the short time line for preparation meant it was necessary to move quickly and consolidate the knowledge and skills I already had, which boosted my self-confidence. V3C was an accurate reflection of real nursing with a good opportunity to prioritise key information, utilise skills to commit to memory and then recall them under a slightly more pressured environment.Regular V3Cs would be a beneficial process that not only reinforces the learning of the students, but also informs the facilitators who teach us how their content is being received, and what further work is needed to support students to become competent, knowledgeable, and most importantly safe nurses in practice. The experience was intriguing and interesting due to the session being conducted virtually and during the COVID-19 pandemic. I have enjoyed the process of revising the suggestive topics and found it very useful in expanding my knowledge and clinical skills in physical health.However, I felt that the one-to-one session was relatively simple and too short. I expected complex questions but only two simple questions were asked and I felt disappointed that they were instead a test of knowledge than my clinical judgement or the type of skills I will be using. I also felt that information should be provided on whether the questions will be scenario-based or skill based.Nonetheless, the most exciting part of this experience was revising the topics using a study group with other classmates. It played a significant factor in building my knowledge and kept me motivated during this experience.

Within this reflective evaluation feedback, most students acknowledged that the viva voce process enabled and reinforced learning. Furthermore, this increased motivation to consolidate knowledge gained during the clinically focused modules included in the MSc programme. Several students felt that this process helped them to recognise how much they knew about these clinical topics. Students also commented that the process helped them recognise the substantial content taught on the MSc programmes. There was an overall sense within the evaluation feedback that students felt rewarded because they had achieved their own learning expectations through this activity. Similarly, the academic facilitators were reassured by students' level of knowledge and awareness of safe, effective practice. The V3C activity also helped students to self-identify gaps within their knowledge heightening areas for further learning.

This self-awareness associated with self-identification of these areas for learning is an important step in the development of a health professional with reflective abilities. Furthermore, knowledge gaps are critical factors that can negatively impact both nurse and patient outcomes (Severinsson and Holm, 2012). It is therefore vital that nursing students learn how to address any gaps and develop their understanding and professional skills to facilitate the delivery of high-quality care, while maintaining patient safety and satisfaction throughout their careers (Hansen et al, 2012). The reflective feedback suggests that the V3C process enabled this through encouraging reflection, self-testing of knowledge and consolidation of learning.

Most students felt that there was a benefit in having a one-to-one clinically focused conversation with an academic facilitator. Many identified that they preferred this learning strategy to the more commonly used group tutorial approach for clinical discussions. Within nursing education, teaching and learning strategies that integrate one-to-one dialogue between students and teachers, improve the learning experience for individuals (AlKhaibary et al, 2021). Students felt that the informal approach and nature of the questioning used by academic facilitators made them feel more relaxed, more comfortable and enabled them to be open to the potential of this educational intervention.

Finally, students alluded to the theory-practice gap, with most recognising the challenge of meeting both academic and clinical requirements for completion of a registered nurse education programme. Combining academic teaching and theory with clinical practice and experience has always been considered a consistent challenge when educating nursing students (Shoghi et al, 2019). Students fed back that the V3Cs had helped ‘draw the two together’ demonstrated that this approach assisted in reducing the theory-practice gap. Many students felt that this activity boosted their confidence, enabling them to progress in both their academic programme and clinical education.

Positioning a clinical viva voce in post-COVID-19 nurse education

The reflective evaluation feedback from students led further refinements to be made to the process prior to implementation of the second iteration of the V3C activity:

  • The students will receive a specified selection of topic areas to prepare, taken from the framework presented in Table 1. It is hoped that this will enable students to focus their preparation and revision
  • For academic facilitators, it was decided that scenario-based questions about clinical skills and technical processes provided greater learning opportunities than role-play-based scenarios
  • A consistent questioning strategy will be used by all facilitators, eg all students are asked one scenario-based question and one skills-based question
  • Academic facilitators will develop rubrics for each potential question to help guide student preparation and standardise the expectation from facilitators
  • A similar concept could involve formative peer teaching, with a student explaining the skill to a peer while being observed by a facilitator. Further, one-to-one or peer teaching sessions could be recorded virtually and then reviewed by the student, their peers and their facilitator. This would promote enhanced reflection and provide a record of their communication skills and knowledge
  • More frequent use of the V3C approach across all MSc modules could be applied; for example, applied in bite-sized chunks that could test knowledge, using a suggested quiz-based format
  • It is necessary to further consider when, within the programme, the V3C activity is scheduled, to ensure minimum impact on summative assessment.

Limitations

While considering the limited evaluation feedback from a small sample of students, it was identified that the educational intervention required ongoing testing and development. Thus, a decision was made to introduce the V3C activity within the adult and mental health MSc programmes on a regular basis with the current and future cohorts, with a continuing iterative process of refinement.

Conclusion

The clinical viva voce approach has been introduced at one university as an adaptation to reduced face-to-face learning within nursing education due to the COVID-19 pandemic. This is an innovative method of enabling students to discuss aspects of clinical practice while providing an opportunity for them to voice their decision-making and critical thinking abilities in a safe space. It is anticipated that this would allow students to consider the importance of the cognitive components of their clinical work, rather than the pure process-driven technical skills that they would be expected to learn in clinical practice.

Overall, a mixed-methods evaluation of the educational benefits of this approach is needed. Academic facilitators will continue to collect experiential data from students and staff. This will enable the V3C activity to be refined and embedded as part of the new hybrid learning style that underpins the pre-registration MSc programme, largely prompted by the COVID-19 pandemic.

KEY POINTS

  • The Virtual Clinical Competency Conversation (V3C) is an education innovation contributing to virtual learning, enhancing the nursing student experience
  • Virtual, formative assessment of pre-registration nursing students can be achieved through questions and scenario problem-solving on technical knowledge and practical application, patient assessment and risk-stratification approaches, and planning and evaluating care
  • Assessment of nursing students against Nursing and Midwifery Council requirements is critical to ensure patient safety is achieved in keeping with their scope of practice.
  • The V3C approach has been embedded in an MSc programme as part of the new online learning style, increasing student motivation and confidence, while reinforcing safe and effective practice

CPD reflective questions

  • In your own experience, what challenges have impacted on the learning of nursing students within your own practice area? How have you changed the way you support nursing students' learning due to these challenges?
  • Do you think that your needs as a practice supervisor and practice assessor have changed during the COVID-19 pandemic?
  • How can you ensure that your teaching and assessment skills are up to date?
  • Consider which components of the viva voce approach could you implement in your own practice as a supervisor and assessor of student nurses