I mean, I can. Just not on a 24-hour clock.
I can tell time on a face clock. I can tell time on a freaking sundial. I can even tell you the approximate time by glancing at the sun's position in the sky*.
But I'm continually mixing up 20:00 and 10pm.
*doesn't work so well at night