He probably had to choose between looks and personality...
both are in different direction!
there are several possibilities that could happen
first, because he does not know how to look at you
second, he does not want to look nervous by you
or the worst, he does not want to see you