As hard as it may sound..if he is causing you pain..just leave for the sake of your well being. It will be hard but eventually you will come to terms you are worth much more.
I can really relate to your situation. Mine sadly withered away as i finally took a stand and left.
Why not try communicating your concerns to him? Maybe he isnt aware he is hurting you. As far as the understanding and self centered part. Loving you should mean also understanding you or at least trying to understand your needs and feelings and not just ignore it. He needs good wake up call -__-