Is It Time To Walk Away

My husband and I have been married 5 years in the last 5 years he has only worked maybe a grand total of 2 years. Over the past few years the arguements have gotten increasingly worse the first time he shoved me into a chair during an arguement, that escalated into him bending my thumb back to almost touching my wrist, the most recent time I smacked him and he slapped me across the face and knocked me to the floor. He doesn't work now, barely cares for the 3 children we have, and only cleans the house when I complain enough about it or get up and do it myself. I think I love my husband but find myself thinking I'm not in love with him anymore. Any advise as to what I should do would be greatly appreciated.