Whatever the reason this is HIS problem, not yours. I wouldn't take it PERSONAL. I would take it as him having his own problem for some reason.
First day on the job - concentrate on the job, not your love life. That is what they are paying your for.
He's probably shy around new people. He'll warm up later as he gets to know you better.