~high-five~ it's a compliment in your line of work, I'm certain.
I guess the authorities took away their children, you happen to represent the same authorities and therefore they dislike you as well.
Just like criminals think the are in jail, because of the cop who caught them or because someone ratted them out, while they are actually in jail for committing a crime. Taking responsibility isn't easy.
Sound like you are actually one of the only people in government doing a good job.