It's hard to keep track of who voted for you if the question runs for days and is left to the vote. I too only thank the Asker and (to be honest) I can never remembered who might have voted me up. I think that's what most do ... if not everyone. But then again, I'm not entirely sure :)
Is it? I'm sorry you feel that way
Oh I am so sorry, I misunderstood. You're right, of course, it's difficult remembering what I answered yesterday ... LOL
If it came via vote, then there's no sense in thanking the asker.