Not really. If you don't want to be there, don't waste their time with the interview. Fellowship programs put a lot of effort into interview days and unlike residency it is very much a small affair almost all 1:1. It would be uncomfortable for you if you know already the place isn't for you.