I love answering this question because it happens more often than you'd think- especially for NICU/PICU/EM types, since general peds is sooo completely different and has a huge emphasis on preventative medicine rather than critical care. The down side is that you're in for a long 3 years... but when it comes time to match into a fellowship, you won't face the same degree of competition as your IM counterparts. On top of that, if you get good recommendations from being an outstanding general peds resident at a strong program, then you should have your choice of fellowship matches. If you can't tolerate gen peds enough to be at least moderately enthusiastic, you run the risk of looking like a resident who's difficult to work with.
A similar-minded friend straight up told our program director that he thinks learning about developmental milestones is boring, but he was making it his personal mission to somehow become interested in it at all costs. Not sure what the moral of that story is, except that honesty is okay if you're willing to meet in the middle. And go to a program with a cool PD. Or one with a lot of elective time to spend in your subspecialty. Or both.
As for being touchy-feely, you're going to find a few people like that in every program. It's pediatrics. But, your interview day will give you some ideas about which programs attract more or less of that personality type and there are plenty of people in the field who are like you. In fact, I kind of like some of our "mean" attendings. It's a nice change of pace.
EDIT: Fair warning, you will have to use phrases like "cooing" and "tummy time" simply because there's no other way to explain it. However, I've made it a goal to complete all of residency without saying "kiddo" or using fever as a verb.