Just caught up reading like 4 pages and doesn’t seem anyone’s budged an inch. I think
@freelancePsychic had the best good-faith summary of the two most polarized camps. It would be nice if everyone actually read the document before posting lol they also go into pros/cons in the reading materials on the incus website + the podcasts + the final recommendations...
the most important takeaways from all of those materials that are being almost completely ignored in this discussion, in my opinion, are:
A) changes to Step 1 scoring are extremely unlikely to happen without changes in other parts of UME/GME precisely because different stakeholders on either side of the Match have such different goals and priorities. The only thing that is ever discussed is some mythical universe where Step 1 goes P/F overnight and then absolutely nothing else happens as a consequence of that; a universe which was never going to materialize by the impetus of InCUS or not judging from the comments of PDs and Med Ed folks online alone.
B) stakeholders don’t think there’s enough research on many of these issues to make the best possible decision so kicking the can down the road until there’s more study on alternatives is just as likely at this point as anything else.
I stand my ground of:
1) high-stakes standardized exams are a bad way to do anything except train people for high-stakes standardized exams.
2) the scoring of an exam should reflect the resolution of the exam to suss out meaningful differences, broadly defined. If the range at which that is possible is big, the scoring needs to be coarse relative to performance; if it’s small, scoring needs to be fine relative to performance. For Step 1 it is ****ing massive and quintiles/quartiles seems the most sensible compromise
3) hard cap application number per specialty applied
4) more standardized, multidimensional metrics for PDs to use to make better informed decisions that are more likely to yield meaningful selection criteria; e.g. SLOE-type system across the board.