It was the best of exams. It was the worst of exams.

From the awesome and scathing “What Went Wrong With the ABR Examinations?” in JACR:

The new examination format also does a poor job of emulating how radiology needs to be practiced. Each candidate is alone in a cubicle, interacting strictly with a computer. There is no one to talk to and no opportunity to formulate a differential diagnosis, suggest additional imaging options, or provide suggestions for further patient management. The examination consists entirely of multiple-choice questions, a highly inauthentic form of assessment.

Only partially true. Questions can ask you for further management. Additionally, it’s possible to formulate questions (via checkbox) that allow you select reasonable inclusions for a differential. This isn’t the same as having a list memorized but is in some ways more accurate in the world of Google, StatDX etc. Of course, this kind of question isn’t meaningfully present, but multiple choice format itself doesn’t necessarily preclude all meaningful lines of testing.

Another rationale for the new examination regimen was integrity. Yet instead of reducing candidate reliance on recalled examination material, the new regimen has increased it, spawning at least six commercial online question bank sites. The fact that one of the most widely used print examination preparation resources is pseudonymously authored is a powerful indicator that the integrity of the examination process has been undermined, effectively institutionalizing mendacity.

Every board exam has qbank products. Part of why Crack the Core is pseudonymously authored isn’t just the recalls; it’s presumably also related to his amusing but completely unprofessional teaching style. I very much doubt the Core Exam is more “recalled” than anything available for the prior exams. What we should be doing is acknowledging that any standardized test will be prepared for this way via facsimile questions, and there is literally no way to avoid it. It’s not as though Step 1 is any different.

Many of the residents we speak with regard the core examination not as a legitimate assessment of their ability to practice radiology but as a test of arcana. When we recently asked a third-year resident hunkered down over a book what he was studying, he replied, “Not studying radiology, that’s for sure. I am studying multiple-choice tests.” The fact that this sentiment has become so widespread should give pause to anyone concerned about the future of the field.

Yes, this is true. But it also strikes me that the old school boards wrapped a useful and worthwhile skill in a bunch of gamesmanship, BS, and pomp. Nonetheless I can’t dispute that casemanship skills have real-world parallels and that the loss of them may have resulted in some young radiologists sounding like idiots when describing a novel case in front of a group of their peers.

In essence, the ABR jettisoned a highly effective oral board examination that did a superb job of preparing candidates for the real-world practice of radiology and replaced it with an examination that merely magnifies the defects of the old physics and written examinations. The emphasis is now on memorization rather than real-time interaction and problem solving. In our judgment, candidates are becoming less well prepared to practice radiology.

It seems increasingly true that anyone more than a couple years out of residency has now fully fetishized the oral boards. It’s definitely true that traditional case taking skills have rapidly atrophied; residency may feel long but institutional memory is short. Old school casemanship isn’t really the same thing as talking to clinicians, but it certainly has more in common with that than selecting the “best” answer from a list of choices.

It is an important skill/ability to succinctly and correctly describe a finding and its associated diagnosis. Some residents now are still able to get the diagnosis but may struggle with describing the findings appropriately when on the spot. But I don’t how much that matters in the long term and if this lack self-corrects over time. I would be interested in seeing if any of the old vs new debate has would have any impact on the quality of written reports, the fundamental currency of our field in the 21st century. I’ve seen plenty of terrible reports and unclear language from older radiologists, so the oral boards barrier couldn’t have been that formative.

The fact is that neither exam is a good (or even reasonable) metric. Frankly, a closed-book exam in and of itself is inherently unrealistic from daily practice. But any exam that trades in antiquated “Aunt Minnies” or relies on demonstrating “common pathology in unusual ways” are really dealing in academic mind games and not really testing baseline radiologic competence.

Guide to The Core Exam

Below are the current entries in the ABR Core Exam Series:

The Core Exam Experience
Detailed post describing the process of registering for the exam, selecting testing location and lodging, the actual test day experience, and the exam itself including the exam breakdown, scoring, and results

Approaching the Core Exam
Detailed post discussing approaching the exam, study schedules, picking resources, and exam content including physics & non-interpretive skills

Resources for the Core Exam
Breakdown and brief reviews of commonly used Core resources

Core Exam Question Banks Review
Separate reviews of the currently available Core Exam qbanks

Book Review: Crack the Core, Radiologic Physics War Machine, CTC Case Companion
Unnecessarily in-depth reviews of Prometheus Lionhart’s Crack the Core book series

Book Review: Core Radiology
TL;DR – I liked it

Radiology Core Exam Question Banks Review

The following is a review and comparison of the available online question banks for the Core Exam.1

There are currently five contenders: RadPrimer, Qevlar, Face The Core, Rock The Boards, and BoardVitals. I’ve tossed in Physics 300 at the end, a dedicated physics question app.

Because RadPrimer is free for many if not most residents and is big, the other resources have an upward climb to be worth your time and money. I was able to secure reader discounts for Rock The Boards and BoardVitals. BV has a refer-a-friend program that would earn me a few bucks (I get nothing from RTB).2

TL;DR: RadPrimer does just fine on its own despite its limitations. Physics 300 is buggy but fantastic for physics review. Qevlar is the overall #2. Face The Core is a reasonable adjunct, which you can buy a la carte per subject.

Continue reading

  1. Not included are the various casebook series such as A Core Review which overlap as well and are discussed in this post. More detailed and generate thoughts on approaching the Core Exam are here.

  2. The referral part of BV comes with the link. You can use the coupon code below by itself if you wanted to buy it and didn’t want me to get anything.