ABEM Webinar: Update on New Virtual Oral Exam

Introduction

• Speaker: Carl Chanovsky, Chair of the Test Administration Committee
• Purpose: Update on progress of the new virtual oral exam
• Acknowledgment of pandemic challenges and participants' busy schedules

Overview of Virtual Oral Exam Development

• Explanation on the need for the oral exam:
  • Measures different skills than the qualifying exam (QE) or written exam
  • 36% of essential knowledge, skills, and activities (KSAs) are not covered in written exams
  • Evaluates:
    • Empathy
    • Decision-making
    • Complex reasoning
    • Data acquisition
    • Problem-solving
    • Clinical judgment

History and Implementation

• Cancellations of in-person exams in Chicago have created a backlog of 2,300 board-eligible physicians
• Challenges faced:
  • E-oral platform does not support remote assessments
  • Complexity of remote exam administration
• Formation of the Virtual Oral Exam Task Force
• First virtual exam scheduled for December 16-18, 2020
• Additional exams planned for early March, mid-April, and late May or early June
• Future administration format pending based on pandemic developments and vaccine rollout

Scheduling Details

• Candidates from canceled 2020 administrations will be prioritized
• Notifications for December candidates have been sent; others should contact ABEM to get on the waitlist
• Early January notifications for the first three administrations in 2021

Exam Day Format

• Two exam sessions per day, each lasting 3 hours
• 25 minutes allocated for each case:
  • 15 minutes for the candidate
  • 5 minutes for scoring by examiners
  • 5 minutes to transition between cases
• One 10-minute break per session
• Candidates will stay in one Zoom room while examiners move between rooms

Types of Cases

• No triples in the virtual format
• Total of 7 cases: 6 single cases and 1 structured interview case
• Static stimuli only (no moving images or videos) will be shared on screen
• Exam format consistent with previous oral exams; candidates will not interact directly with stimuli

Structured Interview Case

• A new format aimed at assessing thought processes and decision-making
• Focus on how candidates explain their reasoning and actions
• Demonstration of this case provided during the webinar, available on the ABEM website

Security and Technical Considerations

• High-stakes exam with strict security measures
  • No external assistance (no one else in the room, no textbooks, no devices)
  • Private, quiet testing location required
• Technical checks and support provided before exams
• Sessions will be recorded for quality and compliance verification

Candidate Preparation

• Candidates will receive a note sheet with normal lab values, abbreviations, and exam policies
• Some technical requirements:
  • Laptop/desktop with camera and microphone
  • Reliable internet connection
  • Preferably using Chrome browser
• Recommendations for minimizing technical issues during the exam

Scoring and Performance

• Scoring criteria to be shared with candidates before the exam
• Structured interview's assessment based on rationale and thought processes; all exams weighted equally
• Candidates can refer to previously shown stimuli during the exam by requesting them

Conclusion

• Encouragement for candidates to prepare and reach out with questions
• Emphasis on transparency and support from ABEM as they navigate the virtual exam format.