Introduction: Mastery learning, which deconstructs a complex task into sequential sub-steps combined with deliberate practice to achieve each step in sequence, represents an important method to enhance simulation-based procedural skills training. However, the evidence to support the effectiveness of this theory to improve learning is lacking. This study compared mastery learning using deliberate practice with self-guided practice on skill performance of a rarely performed, life-saving procedure, a bougie-assisted cricothyroidotomy (BAC). Methods: In this multi-centre, randomized study at five North American emergency medicine (EM) residency training programs, we assigned 166 EM postgraduate trainees to either mastery learning and deliberate practice (ML + DP) or self-guided practice for BAC. Three blinded airway experts independently evaluated BAC skill performance by video review before (pre-test) and after (post-test) each training session. The primary outcome was post-test skill performance using a 5-point global rating score (GRS). A secondary outcome, defined a priori, was performance time to complete the BAC skill (chronometry). Results: There was no significant difference in post-test BAC performance after ML + DP or self-guided practice. Performance scores improved for both groups by 13% from the pre-test to post-test (F (1,138) = 43, p < 0.001). Overall, time to complete the BAC improved significantly from pre-test (87.6 seconds) to posttest (54.1 seconds), (F, 1,149) = 122, p < 0.001). At post-test, the ML + DP group performed the skill 7.4 seconds faster than the self-guided practice group (F (1,150) = 6.77, p < 0.01). Conclusion: Mastery learning coupled with deliberate practice provides systematic and focused feedback during skill acquisition. However, it is resource intensive and its efficacy is not fully defined. In this study, MP + DP did not result in improved global performance; it did result in faster performance times, a relevant finding for time-sensitive procedures. These results are important for educators who seek to optimize technical skills training in a competency-based model of medical education. Our findings suggest that time-sensitive procedures might benefit from ML + DP teaching strategies to enhance time to procedural performance.

Innovation Concept: Consultation skills (the collaborator role) are key for safe and effective Emergency Medicine practice. The tool described uses educational techniques familiar to Emergency Physicians and residents (rapid cycle deliberate practice and focused debriefing) to incorporate teaching of this skill into on-shift clinical teaching of Emergency Medicine residents. Methods: We searched the literature for consultation teaching methods. We developed a tool to teach consultation as part of on-shift clinical teaching using pedagogical concepts familiar to Emergency Medicine residents, rapid cycle deliberate practice and focused debriefing. The developed tool has three phases; 1) Introduction to a framework for good consultation skills, 2) Managing push-back and understanding competing frames of reference and 3) Direct observation and feedback on the actual consultation. The tool is designed to be used during a clinical shift. Over a series of consecutive cycles the resident refines a consultation and is eventually directly observed during the actual interaction with a consultant. Curriculum, Tool or Material: For each of the three phases the tool provides a framework for the preceptor to use to guide the presentation and discussion. During phases 1 and 2 the resident will present the consultation a number of times and the preceptor will provide focused debriefing allowing the presentation to be refined and optimized. During phase 3 the preceptor provides direct observation of the actual consultation followed by focused debriefing. Phase 1: Focuses on understanding the learners current skill level and presents a framework for a high quality consultation. Phase 2: Introduces the concept of competing frames of reference and push-back and patient centred strategies for managing this situation. Phase 3: The actual consultation interaction between resident and consultant is observed and debriefed. Conclusion: Consultation skills are important in the day to day practice of Emergency Medicine but rarely the subject of specific teaching. The tool presented can be used during clinical shifts to teach consultation skills using pedagogy familiar to both Emergency Physicians adEM residents.

Introduction: Emergency medicine (EM) residents are expected become proficient in a number of rarely performed, high risk procedures. We developed Critical Care Skills Training Day for senior FRCP and CCFP EM residents at a single university program to fill a gap in resident confidence with these procedures. The day applies principles of deliberate practice with focused feedback using simulation-based training for several rarely performed procedures including thoracotomy, fibre-optic intubation, pericardiocentesis, resuscitative hysterotomy and central line insertion. The objectives of this work was to improve the residents’ scores of self-perceived comfort independently performing these procedures by completion of the training day. Methods: Clinician educators, residency program directors and simulation specialists designed and taught the curriculum. We used pre- and post-training day surveys blending Likert, multiple choice and free text comments to measure comfort performing each procedure, overall satisfaction and usefulness of this training. Descriptive statistics were used to analyze results. Pre-post differences were assessed using paired sample T-tests. Comments and themes from course evaluations were used to make yearly iterative changes. Results: A total of 95 residents completed the curriculum between 2016-2018. 89 completed evaluations (93%). Residents reported significant (p < 0.05) improvement in comfort independently performing fibre optic intubation, thoracotomy and central line insertion. The day was rated very highly, 9.4/10 (SD, 0.72), over 3 years. Feedback was positive with participants identifying opportunities for repeated practice, feedback from instructors and practical tips to improve performance as valuable aspects. Iterative changes were made yearly in response to resident feedback including introduction of new procedures, incorporating skills into sim-based cases, and different training models for skill training. Conclusion: Critical Care Skills Training Day for EM residents was created using the principle of deliberate practice to fill a perceived gap in resident training. Residents who completed the annual curriculum showed a marked increase in comfort independently performing several of the procedures. Ongoing challenges include the length of the day, economies of scale, and training models available for the rare procedures. Future directions include the integration of longitudinal objective performance evaluations to align with the competency by design curriculum.

Introduction: Medical images (e.g. radiographs) are the most commonly ordered tests in emergency medicine. As such, emergency medicine physicians are faced with the task of learning the skill of interpreting these images to an expert performance level by the time they provide opinions that guide patient management decisions. However, discordant interpretations of these images between emergency physicians and expert counterparts (e.g. radiologists) is a common cause of medical error. In pediatrics, this problem is even greater due to the changing physiology with age. Methods: ImageSim (https://imagesim.com/) is an evidence-based on-line learning platform derived and validated over an 11 year period (https://imagesim.com/research-and-efficacy/). This learning system incorporates the concepts of cognitive simulation, gamification, deliberate practice, and performance-based competency in the presentation and interpretation of medical images. Specifically, ImageSim presents images as they are experienced in clinical practice and incorporates a normal to abnormal ratio is representative of that seen in emergency medicine. Further, it forces the participant to commit to the case being normal or abnormal and if abnormal, the participant has to visually locate the specific area of pathology on the image. The participant submits a response and gets text and visual feedback with every case. After each case, the participant gets to play again until they reach a desired competency threshold (80% is bronze resident; 90% silver staff emergency medicine physician; 97% gold radiologist). Importantly, the learning experience also emphasizes deliberate practice such that the learning system provides hundreds of case examples and therefore each participants performance has the opportunity to improve along their individual learning curve. Results: Course selection was made based on known medical image interpretation knowledge gaps for practicing emergency physicians. Currently, ImageSim live courses include pediatric musculoskeletal radiographs (2,100 cases, 7 modules) and pediatric chest radiographs (434 cases). In 2018, we will also release a pediatric point-of-care ultrasound course (400 cases, 4 modules) and the pre-pubertal female genital examination (150 cases). For a demo, go to https://imagesim.com/demo/. Using ImageSim, the deliberate practice of about 120 cases (1 hour time commitment) increases accuracy on average by 15%. Currently integrated into 10 emergency medicine training programs and there are about 300 continuing medical education world-wide participants. Conclusion: While acquiring mastery for these images may take years to acquire via clinical practice alone, this learning system can potentially help achieve this in just a few hours.

Introduction: Deliberate practice (DP) is the evolution of practice using continually challenging and focused practice on a particular task. DP involves immediate feedback, time for problem-solving and evaluation, and opportunities for repeated performance. Microskills training breaks down larger tasks into multiple smaller subtasks and then adds opportunities for feedback and adjustment for each subtask. Microskills training is routinely used to achieve excellence in competitive sports, martial arts, military operations, and music. Surgical cricothyrotomy is a rarely performed safety critical task. Methods: Two doctors and three nurses developed stepwise team microskills checklists from case review, simulations and published evidence. The checklist was tested, evaluated and developed during four days of simulation faculty team training. The final 30 item checklist was used to facilitate skills training for doctors, nurses, respiratory therapists and ACPs in one level 2, and two level 3 trauma centers from April 2017 to October 2017. Commonly available airway trainers were retrofitted with the 3-D printed larynx. The microskills checklist was used in four phases: 1. Group discussion of each microskill step; 2. Groups of three team members; operator, assistant and microskill facilitator (using the checklist) to enable the deliberate analysis of the teams current performance. Each subtask is performed with immediate peer and where necessary faculty feedback - changes are recorded; 3. Total task run through without interruption - changes are recorded; 4. Repetition and feedback using different team members, manikins, including time pressure. User satisfaction surveys were collected after the skills training session Results: Teams were composed of Registered Nurses (8), Physicians (9), and Respiratory Therapists (2). All of the teams experienced a change in practice. The median number of microskills changed for MDs 12/21, RNs 6/12. The commonest changes in practice were equipment preparation (all teams). All professions agreed strongly that the approach produces a positive change in practice (median score 5/5). Conclusion: Microskills checklists facilitate cricothyrotomy skill development in interprofessional teams in this provisional analysis.

Introduction: Deliberate practice (DP) is the evolution of practice using continually challenging and focused practice on a particular task. DP involves immediate feedback, time for problem-solving and evaluation, and opportunities for repeated performance. Mircroskills training breaks down larger tasks into multiple smaller subtasks and then adds opportunities for feedback and adjustment for each subtask. Microskills training is routinely used to achieve excellence in competitive sports, martial arts, military operations, and music. Endotracheal intubation is a complex task with a clinically significant complication and failure rate. Methods: Two doctors and three nurses developed stepwise team microskills checklist from case review, simulations and published evidence. The checklist was tested, evaluated and developed during four days of simulation faculty team training. The final 36 item checklist was used to facilitate skills training for doctors, nurses, respiratory therapists and ACPs in one level 2, and two level 3 trauma centers from April 2017 to October 2017. The microskills checklist was used in four phases: 1. Group discussion of each microskill step 2. Groups of three team members; operator, assistant and microskill facilitator (using the checklist) to enable the deliberate analysis of the teams current performance. Each subtask is performed with immediate peer and where necessary faculty feedback. Changes are recorded. 3. Total task run though without interruption. Changes are recorded. 4. Repetition and feedback using different team members, manikins, including time pressure. User satisfaction surveys were collected after the skills training session Results: Results. Teams were composed of Registered Nurses (8), Physicians (9), and Respiratory Therapists (2). All of the teams experienced a change in practice. The median number of microskills changed for MDs 13/30, RNs 7/16. The commonest changes in practice were patient positioning (all teams). All professions agreed strongly that the approach produces a positive change in practice (median score 4.8/5). Conclusion: Microskills checklist facilitate endotracheal intubation with a bougie skill development in interprofessional teams in this provisional analysis.

Point-of-care ultrasound (PoCUS) has become an essential skill in the practice of emergency medicine (EM). Various EM residency programs now require competency in basic PoCUS applications. The education literature suggests that deliberate practice is necessary for skill acquisition and mastery. We used an educational theory, Ericsson’s model of deliberate practice, to create a PoCUS curriculum for our Royal College of Physicians and Surgeons of Canada EM residency.

Although international recommendations around curriculum requirements exist, this will be one of the first papers to describe the implementation of a specific PoCUS training program. This paper details the features of the program and lessons learned during its initial 3 years. Sharing this experience may serve as a nidus for scholarly discussion around how to best approach medical education in this area.