They are afraid.
It's not really their fault in a way. These attitudes were deeply engrained in them from children. Old people can be really racist. My great grandmother used to carry around a rag to wipe things in case a black person had touched it. Hard to blame my grandmother for being racist too (she's no where near as bad, but just a few comments here and there).