Results of the 2012 NRMP Program Director Survey August 2012 www.nrmp.org Requests for permission to use these data as well as questions about the content of this publication or the National Resident Matching Program data and reports may be directed to Mei Liang, Director of Research, NRMP, at mliang@nrmp.org Questions about the NRMP should be directed to Mona Signer, Executive Director, NRMP, at msigner@nrmp.org Suggested Citation National Resident Matching Program, Data Release and Research Committee: Results of the 2012 NRMP Program Director Survey National Resident Matching Program, Washington, DC 2012 Copyright © 2012 National Resident Matching Program Table of Contents Introduction The National Resident Matching Program (NRMP) conducted a survey of the directors of all programs participating in the 2012 Main Residency Match℠ The primary purpose of the survey was to shed light on the factors that program directors use in both (1) selecting applicants to interview and (2) ranking applicants for The Match The overall response rate for all specialties in this report was 44.8 percent Transitional Year and 21 specialties with 10 or more responses are included in this report Their response rates are listed in the table below Response rates for those specialties ranged from a high of 66.1 percent for Physical Medicine and Rehabilitation to a low of 30.9 for General Surgery The survey was fielded during the 19 days between the rank order list deadline and Match Week so that program match outcomes would not influence respondents' answers Numbers of responses are presented in most of the graphs Some graphs use data from multiple survey questions In those cases, different N's are listed Numbers of applicants ranked and positions in the Match are extracted from the NRMP database Graphs are suppressed for specialties with less than five responses The survey solicited information on: · the number of applications received, screened, and reviewed, as well as the number of applicants interviewed and ranked · the percentage of interview slots offered prior to the November release date of the Medical Student Performance Evaluation (MSPE/Dean's Letter) · whether the program typically interviews and ranks specific applicant groups · the use of test scores in considering which applicants to interview, and · the factors used for both interview selection and for ranking applicants Specialty Anesthesiology Child Neurology Dermatology Emergency Medicine Family Medicine General Surgery Internal Medicine Internal Medicine/Pediatrics Neurological Surgery Neurology Obstetrics and Gynecology Orthopaedic Surgery Otolaryngology Pathology Pediatrics Physical Medicine and Rehabilitation Plastic Surgery Psychiatry Radiation Oncology Radiology Transitional Year Vascular Surgery All others Total NRMP Program Director Survey Results, 2012 This report presents results by specialty on selected items from the survey The NRMP hopes that program directors, medical school officials, and applicants find these data useful as they prepare for and participate in The Match _ The NRMP's data reporting and research activities are guided by its Data Release and Research Committee NRMP data and reports can be found at: www.nrmp.org/data/ Surveys Sent Number Responding Response Rate 191 104 117 153 451 530 731 76 98 142 251 161 107 147 253 56 57 190 85 199 110 35 127 4,371 88 46 53 98 235 164 296 35 42 59 113 87 51 78 131 37 27 88 45 88 49 13 37 1,960 46.1% 44.2% 45.3% 64.1% 52.1% 30.9% 40.5% 46.1% 42.9% 41.5% 45.0% 54.0% 47.7% 53.1% 51.8% 66.1% 47.4% 46.3% 52.9% 44.2% 44.5% 37.1% 29.1% 44.8% All Specialties Combined NRMP Program Director Survey Results, 2012 Figure All Specialties Percentage of Programs Citing Each Factor in Selecting Applicants to Interview USMLE/COMLEX Step score 82% Letters of recommendation in the specialty 81% 77% Personal Statement 71% Grades in required clerkships 70% USMLE/COMLEX Step score Grades in clerkship in desired specialty 69% Graduate of U.S allopathic medical school 69% Medical Student Performance Evaluation (MSPE/Dean's Letter) 68% Class ranking/quartile 67% Gaps in medical education 67% Personal prior knowledge of the applicant 63% Perceived commitment to specialty 63% Honors in clinical clerkships 62% Applicant was flagged with Match violation by the NRMP 62% Volunteer/extracurricular experiences 61% Other life experience 61% Honors in clerkship in desired specialty 61% Consistency of grades 60% Audition elective/rotation within your department 60% 0% N=1,666 NRMP Program Director Survey Results, 2012 20% 40% 60% 80% 100% Figure All Specialties Percentage of Programs Citing Each Factor in Selecting Applicants to Interview (continuted) Evidence of professionalism and ethics 55% Interpersonal skills 55% Perceived interest in program 54% Graduate of highly regarded U.S medical school 53% Leadership qualities 53% Alpha Omega Alpha (AOA) membership 51% Demonstrated involvement and interest in research 51% 50% Feedback from current residents 49% Visa status* 45% Honors in basic sciences 36% Fluency in language spoken by your patient population 34% Interest in academic career 28% Away rotation in your specialty at another institution 27% USMLE/COMLEX Step score* Other post-interview contact 23% Gold Society membership 23% 0% N=1,666 * International Medical Graduates only NRMP Program Director Survey Results, 2012 20% 40% 60% 80% 100% Figure All Specialties Mean Importance Ratings* of Factors in Ranking Applicants Applicant was flagged with Match violation by the NRMP 4.8 Interactions with faculty during interview and visit 4.7 Interpersonal skills 4.7 Interactions with housestaff during interview and visit 4.6 Feedback from current residents 4.5 Evidence of professionalism and ethics 4.5 Grades in clerkship in desired specialty 4.2 Perceived commitment to specialty 4.2 Letters of recommendation in the specialty 4.2 Graduate of U.S allopathic medical school 4.1 USMLE/COMLEX Step score 4.1 Leadership qualities 4.1 Honors in clerkship in desired specialty 4.0 Gaps in medical education 4.0 Grades in required clerkships 4.0 USMLE/COMLEX Step score 4.0 Honors in clinical clerkships 3.9 Class ranking/quartile 3.9 Medical Student Performance Evaluation (MSPE/Dean's Letter) 3.8 Personal prior knowledge of the applicant 3.8 N=1,666 *Ratings on a scale from (not at all important) to (very important) NRMP Program Director Survey Results, 2012 5 Figure All Specialties Mean Importance Ratings* of Factors in Ranking Applicants (continuted) 3.8 Consistency of grades 3.7 Perceived interest in program Visa status** 3.7 Audition elective/rotation within your department 3.7 3.6 Graduate of highly regarded U.S medical school 3.4 Alpha Omega Alpha (AOA) membership Fluency in language spoken by your patient population 3.3 Personal Statement 3.3 3.2 Other life experience Demonstrated involvement and interest in research 3.1 Honors in basic sciences 3.0 Volunteer/extracurricular experiences 3.0 USMLE/COMLEX Step score** 3.0 Other post-interview contact 2.8 Interest in academic career 2.8 2.8 Gold Society membership 2.6 Second interview/visit Away rotation in your specialty at another institution 2.4 N=1,666 *Ratings on a scale from (not at all important) to (very important) ** International Medical Graduates only NRMP Program Director Survey Results, 2012 All Specialties Programs That Use USMLE Step and Step Clinical Knowledge (CK) Scores When Considering Which Applicants to Interview Figure Percentage of Programs That Use USMLE Step Score Would your program consider applicants who fail their exam on the 1st attempt? Scores required? 100% N=1,844 100% N=1,494 80% 80% 63% 60% 40% 61% 60% 36% 40% 26% 20% 0% 20% 1% Yes, pass only Yes, target score 0% No 13% Never Seldom Often Percentage of Programs That Use USMLE Step (CK) Score Would your program consider applicants who fail their exam on the 1st attempt? Scores required? 100% N=1,771 N=1,303 100% 80% 80% 60% 40% 40% 33% 20% 20% 0% Yes, pass only 59% 60% 48% Yes, target score 32% 20% 0% No 8% Never Seldom often USMLE Step and Step CK Scores Programs Consider When Granting Interviews Scores Below Which Programs Generally Does Not Grant Interviews Scores Above Which Programs Almost Always Grant Interviews 280 280 260 260 240 240 220 220 200 200 180 180 160 160 140 140 120 120 100 USMLE Step N=997 100 USMLE Step CK N=708 USMLE Step N=689 USMLE Step CK N=506 The boxes in the boxplots above represent the interquartile range (or IQR, which is the range between the 25th and 75th percentiles) and the line in thebox is the median The x-shaped symbol in the box is the mean NRMP Program Director Survey Results, 2012 Figure VS-1 Vascular Surgery Percentage of Programs Citing Each Factor in Selecting Applicants to Interview USMLE/COMLEX Step score 100% Letters of recommendation in the specialty 100% Personal Statement 100% Grades in required clerkships 71% USMLE/COMLEX Step score 71% Grades in clerkship in desired specialty 86% Graduate of U.S allopathic medical school 86% Medical Student Performance Evaluation (MSPE/Dean's Letter) 100% 86% Class ranking/quartile Gaps in medical education 100% Personal prior knowledge of the applicant 100% Perceived commitment to specialty 100% Honors in clinical clerkships 100% Applicant was flagged with Match violation by the NRMP 57% 100% Volunteer/extracurricular experiences 86% Other life experience 100% Honors in clerkship in desired specialty 86% Consistency of grades 100% Audition elective/rotation within your department 0% 20% N=7 NRMP Program Director Survey Results, 2012 171 40% 60% 80% 100% Figure VS-1 Vascular Surgery Percentage of Programs Citing Each Factor in Selecting Applicants to Interview (continued) Evidence of professionalism and ethics 86% Interpersonal skills 86% Perceived interest in program 100% Graduate of highly regarded U.S medical school 100% 71% Leadership qualities Alpha Omega Alpha (AOA) membership 100% Demonstrated involvement and interest in research 100% 86% Feedback from current residents 100% Visa status* 86% Honors in basic sciences 57% Fluency in language spoken by your patient population 100% Interest in academic career 57% Away rotation in your specialty at another institution 71% USMLE/COMLEX Step score* 43% Other post-interview contact 14% Gold Society membership 0% 20% N=7 * International Medical Graduates only NRMP Program Director Survey Results, 2012 172 40% 60% 80% 100% Figure VS-2 Vascular Surgery Mean Importance Ratings* of Factors in Ranking Applicants Applicant was flagged with Match violation by the NRMP 4.9 Interactions with faculty during interview and visit 4.9 4.6 Interpersonal skills Interactions with housestaff during interview and visit 4.7 4.4 Feedback from current residents 4.8 Evidence of professionalism and ethics Grades in clerkship in desired specialty 4.4 Perceived commitment to specialty 4.5 4.8 Letters of recommendation in the specialty 4.1 Graduate of U.S allopathic medical school USMLE/COMLEX Step score 4.3 Leadership qualities 4.3 4.4 Honors in clerkship in desired specialty 3.2 Gaps in medical education 3.8 Grades in required clerkships 3.9 USMLE/COMLEX Step score 4.0 Honors in clinical clerkships 3.9 Class ranking/quartile Medical Student Performance Evaluation (MSPE/Dean's Letter) 3.5 3.9 Personal prior knowledge of the applicant N=7 *Ratings on a scale from (not at all important) to (very important) NRMP Program Director Survey Results, 2012 173 Figure VS-2 Vascular Surgery Mean Importance Ratings* of Factors in Ranking Applicants (continued) 3.2 Consistency of grades 4.1 Perceived interest in program 3.3 Visa status** 4.3 Audition elective/rotation within your department 4.2 Graduate of highly regarded U.S medical school 3.9 Alpha Omega Alpha (AOA) membership Fluency in language spoken by your patient population 4.0 3.3 Personal Statement 2.7 Other life experience Demonstrated involvement and interest in research 3.7 3.1 Honors in basic sciences 2.8 Volunteer/extracurricular experiences 3.0 USMLE/COMLEX Step score** Other post-interview contact 3.4 Interest in academic career 3.4 2.6 Gold Society membership 2.0 Second interview/visit Away rotation in your specialty at another institution 3.0 N=7 *Ratings on a scale from (not at all important) to (very important) ** International Medical Graduates only NRMP Program Director Survey Results, 2012 174 Vascular Surgery Programs That Use USMLE Step and Step Clinical Knowledge (CK) Scores When Considering Which Applicants to Interview Figure VS-3 Percentage of Programs That Use USMLE Step Score Would your program consider applicants who fail their exam on the 1st attempt? Scores required? N=11 100% 90% 80% 90% 80% 70% 70% 60% 60% 50% 50% 40% 40% 30% 20% 30% 18% 20% 10% 0% N=8 88% 100% 82% 0% Yes, pass only Yes, target score 13% 10% 0% 0% No Never Seldom Often Percentage of Programs That Use USMLE Step (CK) Score Would your program consider applicants who fail their exam on the 1st attempt? Scores required? N=11 100% 100% 90% 90% 80% 80% 70% 60% 70% 60% 55% 50% 50% 40% 30% N=5 100% 40% 30% 27% 18% 20% 10% 20% 10% 0% 0% Yes, pass only Yes, target score No 0% Never Seldom 0% often Average USMLE Step and Step CK Scores Programs Consider When Granting Interviews Scores Below Which Programs Generally Does Not Grant Interviews Scores Above Which Programs Almost Always Grant Interviews 280 280 260 260 240 240 220 USMLE Step CK not reported because of low response rate 200 180 USMLE Step CK not reported because of low response rate 220 200 180 160 160 140 140 120 120 100 100 USMLE Step USMLE Step N=7 N=7 The boxes in the boxplots above represent the interquartile range (or IQR, which is the range between the 25th and 75th percentiles) and the line in the box is the median The x-shaped symbol is the mean NRMP Program Director Survey Results, 2012 175 Vascular Surgery Percentage of Programs That Use USMLE Step Clinical Skill (CS), Step 3, and COMLEX-USA Scores* When Considering Which Applicants to Interview Figure VS-4 Percentage of Programs That Use USMLE Step CS and Step Scores USMLE Step USMLE Step CS N=11 100% 90% 90% 80% N=8 100% 80% 73% 70% 70% 60% 60% 50% 50% 40% 30% 30% 20% 10% 0% 38% 38% Yes, target score No 40% 27% 25% 20% N=11 Yes, pass only N=8 10% 0% No Yes, pass only Percentage of Programs That Use COMLEX-USA Level and Level 2-CE Scores Not reported because of low response rate Not reported because of low response rate Percentage of Programs That Use COMLEX-USA Level 2-PE and Level Scores Not reported because of low response rate Not reported because of low response rate * Osteopathic applicants only NRMP Program Director Survey Results, 2012 176 Vascular Surgery Program's Interview Activities Figure VS-5 Percentage of Program's Interview Slots Extended Prior to the November 1st MSPE/Dean's Letter Release Date 100% N=12 90% 83% 80% 70% 60% 50% 40% 30% 20% 8% 10% 0% 0% 25-49% 75-99% 50-74% 8% 100% 0% 1-24% 0% 0% Average Number of Applications Received, Applicants Interviewed and Ranked and Positions in The Match Average Percentage of Applications Rejected and Reviewed 1,000 100% 900 90% 800 80% 700 70% 600 60% 500 50% 400 40% 300 30% 200 20% 100 62% 37% 10% 79 21 Number of applications received 18 Number of applicants interviewed Number of applicants ranked Number of positions in The Match N=12 N=12 N=13* 0% Percentage of applications rejected N=13* Percentage of applicants receiving an interview N=12 N=12 * Data from the NRMP database Percentage of Programs that Typically Interview and Rank Each Applicant Groups 100% 100% 25% of Vascular Surgery programs consider all applicants N=12 90% 80% 75% 70% 60% 50% 50% 50% 42% 40% 30% 42% 25% 20% 10% 0% U.S Senior U.S Grad NRMP Program Director Survey Results, 2012 Osteopathic Canadian 177 Fifth Pathway U.S IMG Non-U.S IMG Transitional Year (N=49) NRMP Program Director Survey Results, 2012 178 Figure TY-1 Transitional Year Percentage of Programs Citing Each Factor in Selecting Applicants to Interview USMLE/COMLEX Step score 64% Letters of recommendation in the specialty 64% 72% Personal Statement 64% Grades in required clerkships 62% USMLE/COMLEX Step score 46% Grades in clerkship in desired specialty 67% Graduate of U.S allopathic medical school Medical Student Performance Evaluation (MSPE/Dean's Letter) 77% Class ranking/quartile 59% Gaps in medical education 59% Personal prior knowledge of the applicant 59% 49% Perceived commitment to specialty 56% Honors in clinical clerkships Applicant was flagged with Match violation by the NRMP 64% Volunteer/extracurricular experiences 67% Other life experience 67% 38% Honors in clerkship in desired specialty 56% Consistency of grades 36% Audition elective/rotation within your department 0% 10% 20% 30% 40% 50% 60% 70% 80% N=39 NRMP Program Director Survey Results, 2012 179 Figure TY-1 Transitional Year Percentage of Programs Citing Each Factor in Selecting Applicants to Interview (continued) Evidence of professionalism and ethics 62% Interpersonal skills 62% 64% Perceived interest in program 46% Graduate of highly regarded U.S medical school 54% Leadership qualities 41% Alpha Omega Alpha (AOA) membership 44% Demonstrated involvement and interest in research 54% Feedback from current residents 51% Visa status* 41% Honors in basic sciences 28% Fluency in language spoken by your patient population 18% Interest in academic career 15% Away rotation in your specialty at another institution 21% USMLE/COMLEX Step score* 36% Other post-interview contact 26% Gold Society membership 0% 20% N=39 * International Medical Graduates only NRMP Program Director Survey Results, 2012 180 40% 60% 80% 100% Figure TY-2 Transitional Year Mean Importance Ratings* of Factors in Ranking Applicants Applicant was flagged with Match violation by the NRMP 4.7 Interactions with faculty during interview and visit 4.6 Interpersonal skills 4.5 Interactions with housestaff during interview and visit 4.3 4.2 Feedback from current residents 4.4 Evidence of professionalism and ethics 3.3 Grades in clerkship in desired specialty 3.8 Perceived commitment to specialty 3.6 Letters of recommendation in the specialty 4.2 Graduate of U.S allopathic medical school USMLE/COMLEX Step score 3.9 Leadership qualities 3.9 3.2 Honors in clerkship in desired specialty 4.2 Gaps in medical education 4.1 Grades in required clerkships USMLE/COMLEX Step score 3.9 Honors in clinical clerkships 3.9 Class ranking/quartile 3.9 Medical Student Performance Evaluation (MSPE/Dean's Letter) 4.1 3.7 Personal prior knowledge of the applicant N=39 *Ratings on a scale from (not at all important) to (very important) NRMP Program Director Survey Results, 2012 181 Figure TY-2 Transitional Year Mean Importance Ratings* of Factors in Ranking Applicants (continued) 3.8 Consistency of grades 4.2 Perceived interest in program 3.9 Visa status** 3.6 Audition elective/rotation within your department 3.7 Graduate of highly regarded U.S medical school 3.4 Alpha Omega Alpha (AOA) membership Fluency in language spoken by your patient population 3.7 3.4 Personal Statement 3.3 Other life experience Demonstrated involvement and interest in research 2.8 Honors in basic sciences 2.8 3.1 Volunteer/extracurricular experiences 2.6 USMLE/COMLEX Step score** 2.9 Other post-interview contact Interest in academic career 2.6 Gold Society membership 2.7 2.4 Second interview/visit Away rotation in your specialty at another institution 1.8 N=39 *Ratings on a scale from (not at all important) to (very important) ** International Medical Graduates only NRMP Program Director Survey Results, 2012 182 Transitional Year Programs That Use USMLE Step and Step Clinical Knowledge (CK) Scores When Considering Which Applicants to Interview Figure TY-3 Percentage of Programs That Use USMLE Step Score Would your program consider applicants who fail their exam on the 1st attempt? Scores required? N=47 100% 90% 80% 80% 70% 62% 60% 70% 63% 60% 50% 40% N=35 100% 90% 50% 38% 40% 30% 29% 30% 20% 20% 10% 0% Yes, pass only Yes, target score 9% 10% 0% 0% No Never Seldom Often Percentage of Programs That Use USMLE Step (CK) Score Would your program consider applicants who fail their exam on the 1st attempt? Scores required? N=46 N=32 100% 100% 90% 90% 80% 80% 70% 70% 60% 57% 60% 50% 40% 30% 40% 30% 28% 20% 15% Yes, pass only Yes, target score 34% 20% 10% 10% 0% 56% 50% 0% No 9% Never Seldom often Average USMLE Step and Step CK Scores Programs Consider When Granting Interviews Scores Below Which Programs Generally Does Not Grant Interviews Scores Above Which Programs Almost Always Grant Interviews 280 280 260 260 240 240 220 220 200 200 180 180 160 160 140 140 120 120 100 100 USMLE Step USMLE Step CK USMLE Step N=21 N=19 N=10 USMLE Step CK N=9 The boxes in the boxplots above represent the interquartile range (or IQR, which is the range between the 25th and 75th percentiles) and the line in the box is the median The x-shaped symbol is the mean NRMP Program Director Survey Results, 2012 183 Transitional Year Percentage of Programs That Use USMLE Step Clinical Skill (CS), Step 3, and COMLEX-USA Scores* When Considering Which Applicants to Interview Figure TY-4 Percentage of Programs That Use USMLE Step CS and Step Scores USMLE Step CS USMLE Step N=46 100% 87% 90% N=23 100% 90% 80% 80% 70% 70% 60% 60% 50% 50% 40% 40% 30% 30% 20% N=46 10% 0% 20% 13% 65% 22% N=23 10% Yes, pass only 0% No Yes, pass only 13% Yes, target score No Percentage of Programs That Use COMLEX-USA Level and Level 2-CE Scores COMLEX-USA Level 2-CE* COMLEX-USA Level 1* 100% 100% N=30 90% N=29 90% 80% 80% 70% 70% 60% 60% 50% 40% 50% 40% 37% 30% 40% 30% 23% 20% 31% Yes, pass only Yes, target score 20% 10% 38% 31% 10% 0% Yes, pass only Yes, target score 0% No No Percentage of Programs That Use COMLEX-USA Level 2-PE and Level Scores COMLEX-USA Level 3* COMLEX-USA Level 2-PE* 100% 100% N=30 90% 80% N=19 90% 80% 70% 60% 70% 57% 50% 50% 40% 40% 33% 30% 30% 20% Yes, pass only Yes, target score 11% 10% 0% No * Osteopathic applicants only NRMP Program Director Survey Results, 2012 26% 20% 10% 10% 0% 63% 60% 184 Yes, pass only Yes, target score No Transitional Year Program's Interview Activities Figure TY-5 Percentage of Program's Interview Slots Extended Prior to the November 1st MSPE/Dean's Letter Release Date 100% N=46 90% 80% 70% 60% 50% 40% 30% 28% 24% 20% 13% 1-24% 15% 11% 25-49% 10% 9% 0% 0% 50-74% Average Number of Applications Received, Applicants Interviewed and Ranked and Positions in The Match 75-99% 100% Average Percentage of Applications Rejected and Reviewed 1,000 100% 900 90% 800 80% 700 70% 60% 600 500 508 52% 50% 400 300 30% 200 42% 40% 20% 10% 81 76 Number of applicants interviewed Number of applicants ranked 100 10 Number of applications received N=48 N=47 N=49* 0% Number of positions in The Match Percentage of applications rejected N=49* Percentage of applicants receiving an interview N=45 N=46 * Data from the NRMP database Percentage of Programs that Typically Interview and Rank Each Applicant Groups 100% 100% 23% of Transitional Year programs consider all applicants N=47 90% 80% 68% 70% 57% 60% 50% 38% 40% 30% 34% 32% U.S IMG Non-U.S IMG 26% 20% 10% 0% U.S Senior U.S Grad NRMP Program Director Survey Results, 2012 Osteopathic Canadian 185 Fifth Pathway ... Matching Program (NRMP) conducted a survey of the directors of all programs participating in the 2012 Main Residency Match℠ The primary purpose of the survey was to shed light on the factors that program. .. All others Total NRMP Program Director Survey Results, 2012 This report presents results by specialty on selected items from the survey The NRMP hopes that program directors, medical school officials,... Committee: Results of the 2012 NRMP Program Director Survey National Resident Matching Program, Washington, DC 2012 Copyright © 2012 National Resident Matching Program Table of Contents Introduction The