Not a VA employee here either but have seen one in action in med school, residency, and now fellowship. My N=3
Pros - volume of patients seems to be less, more laid back, benefits good, little malpractice risk, less call requirements usually, any state licence works (don't have to get an new one if you move to different state)
Cons - pay potential lower, NO control over support staff, VA bureaucracy
The VA bureaucracy is the deal breaker in my opinion. It can really be utterly ridiculous at times and frustrating. You have to be okay with that. I would work part time at a VA if I end up in academics but dont' think I could do it FT.