It just puts me in a tough spot of being naturally defensive since I was given no indication whatsoever about possibly getting a low SLOE. And my mid rotation feedback was fairly generic and residents who did 90% of my evals said overwhelming positive comments to me. Now, it's entirely possible that when the program leadership sat down and wrote all the SLOEs, they were forced to put some as low 1/3 to save face with other EM programs ie "look at us we don't exaggerate, our program is legit" yada yada. Like if a program is known for giving everyone high SLOEs then it not only hurts those applicants, but also the reputation of the program itself. Finally, for most of the other students I rotated with, the program was their home site and their could have been some bias in terms of giving more favorable SLOEs to students that they were more familiar with. These reasons seem *more plausible* than the alternative of me having repeatedly poor performances on shift and getting a low SLOE at the end. Ultimately, it leaves students like me who have put a lot of time and effort into creating a decent EM app (not to mention studying my butt off for boards lol) -- and who are just normal, non-obnoxious, considerate individuals -- into a seemingly unfair situation of not being able to match EM based off a single SLOE. It's an unfortunate and extremely frustrating feeling. And I am extremely confident that if a regression analysis or chi-squared analysis were done to compare the board pass rates or whatever other marker of a program's success against top, middle, and low SLOEs, the difference would be low to moderate and maybe even statistically insignificant. If there is evidence to the contray I would actually want to read that.
This whole process becomes even more frustrating as for me since my sub-i was my first rotation after a 4-month COVID hiatus and all my internal medicine months were canceled. If more SLOEs were to be allowed, then I would say it would make the process more fair.
If it comes to pass that I am at-risk to match EM, I guess it is what it is -- I controlled and maximized all aspects of my app except for the one that I seemingly was out of my control. I'm not gonna hang my head in despair because I know I did everything I could for myself.
I don’t think it has anything to do with being more legitimate and everything to do with not everyone is equal or the same. If you have 30 students, a handful are going to be top tier and be right at the top of your list, the bulk of them are going to be somewhere in the middle, and a handful of them are going to be below that. Its a bell curve. Not everyone that rotates is going to be at the top of the list.
Its not programs trying to ”pretend to be legititimate” by not grading too skewed. Its just that’s how bell curves work.
No one said you had a poor performance. That’s not what a Low 1/3 sloe entails. What it entails is, your performance wasn’t as good as others. Those are too different things. You can be totally ok, with nothing negative about you. But at that place, for them, that may put you in the lower part of their list because you are ok, you aren’t excelling.
You can argue about the SLOE all you want, but you aren’t going to change it because programs actually find it valuable information. So its not going away. It’s like voters complaining about the electoral college. Like yeah, I get that it you may not like the electoral college, but the chance of getting enough states to change the constitution is nearly impossible.
For every student hurt by the SLOE process, there are far more that it has helped. Because without SLOEs, many people who were clinically excellent, far better than others, who just scored lower on their board exams (which were NEVER validated as a measure of clinical success), would basically be out of luck. The SLOE process allows people who are actually good at EM to show that they are really good at it.
Could you imagine if the NFL draft was based only on taking a test about football? No game tape. No combine? Sure, teams still get the draft wrong, but do you think teams would be more or less accurate drafting if they never saw anyone play and they just had everyone take a test? Can you show me the research studies that show that watching game tape as a scout is a better way to evaluate a football player than having them take a test about the rules of football?
Look its my job to find the best residents I can. I recognize that not every SLOE will be 100% accurate, good or bad. But in the end, that’s the best thing I have to predict who will be good to work with and not be a problem in training. You still have to take it in context and know its not perfect, but its the best thing you have to gauge it until someone comes up with something better. Because I can tell you, I’ve matched people whose sloes say things like “doesnt take direction well” or “takes feedback poorly” and guess what... they were right.