'Passion' is way overrated. If you follow 'passion', you are more likely end up poor. I'm passionate about playing D&D and sipping mai tais, but nobody wants to pay me to do that.
In all seriousness, pathology job market sucks not because pathology sucks, BUT BECAUSE PATHOLOGY IS GREAT. The work is chill and relatively low stress, but the tradeoffs are severe: much lower pay, less autonomy and lower job stability (especially for new trainees) than most other specialties.
Solution: follow Web's advice. Be very very creative in developing multiple streams of income, outside of pathology, and outside of medicine if you see opportunities. You WILL have to hustle way more than other specialties. If you just stick to your 9-5 pathology job, you WILL be taken advantage of by large labs, corporations, clinicians, MBAs, clients, and the government. If you are nimble and adaptable, you will prosper.