I wouldn't call a person racist unless they took active steps to enforce their prejudice. However, prejudice betrays a lazy mind. Stereotyping replaces thought.
If it was just racist thoughts or opinions it's not a problem, but these opinions tend to define actions which create problems!
Being racist is evidence of a lack of education and general stupidity. So, it is okay? Not really.
We don't want to get into the realm of thought police. It would be nice to have a population educated enough to realize that the concept of "race" is silly.