COMMENTARY
Milestones: Quo Vadis?
G
raduate medical education (GME) worldwide is undergoing a fundamental transition from a knowledge-based to a competency-based medical education (CBME) system.1 In the United States, the Next Accreditation System (NAS) of the Accreditation Council for Graduate Medical Education (ACGME) is using defined competency endpoints with intermediate milestones as the framework for CBME.2 Four articles in this month’s issue of Academic Emergency Medicine illustrate the historical context of emergency medicine (EM) milestone development,3 describe the validation study used to refine the EM milestones,4 give us an example of how a multiorganizational group of stakeholders provides a roadmap for one milestone (PC-12),5 and remind us that GME milestones are on a continuum of development from undergraduate medical education, to GME, to continuing medical education.6 Milestones are descriptors of the expected abilities of physicians at defined stages of expertise development. Milestones are essential to a competency-based approach and are under development in many countries at this time. Beeson et al.3 describe the historical context of the EM milestone development. Representatives of eight stakeholder organizations comprised the EM milestone-working group (EM MWG). In a relatively short time, the EM MWG developed the first draft of milestones, and through collaboration with the ACGME Review Committee in Emergency Medicine, was able to incorporate EM milestones in the EM core program requirements. As an early adopter of NAS, EM has set the standard for the design, alignment, and integration of milestones into the educational framework of the future and can serve as a model for other specialties. Korte et al.4 describe the survey used as a validation study of the EM draft milestones. Despite a short 16day survey period, the study received responses from over 60% of residencies on 24 EM subcompetencies and 255 milestones. Based on the results, the EM MWG eliminated one subcompetency and changed the number of subcompetency milestones to 227. Lewiss et al.5 describe the efforts of a multiorganizational committee composed of representatives from four stakeholder organizations to address EM milestone PC-12 (goal-directed focused ultrasound). This comprehensive article describes the historical perspective of emergency ultrasound (EUS) training, a
The authors have no relevant financial information or potential conflicts of interest to disclose. A related article appears on pages 724, 730, 740, and 736.
© 2013 by the Society for Academic Emergency Medicine doi: 10.1111/acem.12155
description of core EUS skills needed by graduating EM residents, suggested blueprints for residency training, and a description of assessment tools. Santen et al.6 remind us that the NAS is on a continuum of professional development from medical student, to resident, to practicing physician. In their provocative article, the authors indicate that graduating medical students have not been fully taught or assessed on the Level 1 EM milestones requisite for entering EM residencies. The authors propose that responsibilities for Level 1 milestones be shared between medical schools and residencies. This, however, creates other challenges: how will medical school and residency obligations be determined for Level 1 milestone assessment? Will all medical schools coordinate among themselves with minimum Level 1 milestone requirements? How can program directors assure that incoming interns have met the Level 1 milestones at medical school graduation, unless standardized assessment tools exist for graduating medical students? Is there a need to develop entry-to-residency “bootcamps,” as other specialties have done?7 The Postgraduate Orientation Assessment (POA) is one potential approach.8 The POA is a tool to assess incoming residents in general competencies common to all specialties. In our opinion, pairing the general POA with specialty-specific assessment tools can ensure that all residents are at Level 1 milestones when starting residencies. Until medical schools develop reliable assessment tools for graduating medical students for Level 1 milestones for all specialties, we propose the adoption of a general POA tool plus specialty-specific Level 1 milestone assessments at the local residency institution as a key component of residency orientation. Where are we going? The future of CBME will require significant changes in the learning environment, resident assessment frequency, and faculty development. The learning environment will need to evolve to be based on outcomes and focused on the learner and be nonhierarchical.9 Assessment of professional competence will need to be based on multiple assessment methods, each with a minimum of 8 to 10 observations to ensure reliable inferences.10 Faculty will have to take on new roles to coach residents progressing through the milestones and assess their achievements.11 Effective faculty performance will be measured on the assessment skill set they demonstrate as much as the knowledge or procedural skills they may have.12 These changes will result in the transformation of education from a hierarchy focused on the teacher to a network focused on the learner. The resulting energy released
ISSN 1069-6563 PII ISSN 1069-6563583
749 749
750
by this transformation will serve as fuel for innovative networks of educators involved in CBME. EM has the room with a view on the changing health care system.13 It can also serve as the canary in the coal mine for the NAS’s journey into CBME. Felix Ankel, MD (
[email protected]) Department of Emergency Medicine Regions Hospital St. Paul, MN Douglas Franzen, MD Department of Emergency Medicine Virginia Commonwealth University Richmond, VA Jason Frank, MD Department of Emergency Medicine University of Ottawa Ottowa, Ontario, Canada Supervising Editor: David C. Cone, MD.
References 1. Iobst WF, Sherbino J, Cate OT, et al. Competencybased medical education in postgraduate medical education. Med Teach. 2010; 32:651–6. 2. Nasca TJ, Philibert I, Brigham T, Flynn TC. The next GME accreditation system–rationale and benefits. N Engl J Med. 2012; 366:1051–6. 3. Beeson MS, Carter WA, Christopher TA, et al. The development of the emergency medicine milestones. Acad Emerg Med. 2013; 20:000–00.
Ankel et al. • MILESTONES: QUO VADIS?
4. Korte RC, Beeson MS, Russ CM, Carter WA. The emergency medicine milestones: a validation study. Acad Emerg Med. 2013; 20:000–00. 5. Lewiss RE, Pearl M, Nomura JT, et al. CORD-AEUS: Consensus document for the emergency ultrasound milestone project. Acad Emerg Med. 2013; 20:000–00. 6. Santen SA, Rademacher N, Heron S, Khandelwal S, Hauff S, Hopson L. How competent are emergency medicine interns for level 1 milestones: who is responsible? Acad Emerg Med. 2013; 20:12–685. 7. Okusanya OT, Kornfield ZN, Reinke CE, et al. The effect and durability of a pregraduation boot cAMP on the confidence of senior medical student entering surgical residencies. J Surg Educ. 2012; 69:536–43. 8. Lypson ML, Frohna JG, Gruppen LD, Woolliscroft JO. Assessing residents’ competencies at baseline: identifying the gaps. Acad Med. 2004; 79:564–70. 9. Carraccio C, Wolfsthal SD, Englander R, Ferentz K, Martin C. Shifting paradigms: from flexner to competencies. Acad Med. 2002; 77:361–7. 10. van der Vleuten CP, Schuwirth LW, Scheele F, Driessen EW, Hodges B. The assessment of professional competence: building blocks for theory development. Best Pract Res Clin Obstet Gynaecol. 2010; 24:703–19. 11. Dath D, Iobst W. The importance of faculty development in the transition to competency-based medical education. Med Teach. 2010; 32:683–6. 12. Holmboe ES, Ward DS, Reznick RK, et al. Faculty development in assessment: the missing link in competency-based medical education. Acad Med. 2011; 86:460–7. 13. Asplin BR, Knopp RK. A room with a view: on-call specialist panels and other health policy challenges in the emergency department. Ann Emerg Med. 2001; 37:500–3.
