It is not going to get any better. You are wasting your time with him to be honest. Get a new guy, and maybe this time don't cheat ;).
There has to be a reason why you cheated, or was it just the same reason men cheat? someone new to eff? anyway this guy holds a grudge against you and you will never be happy with him, you may be scared of feeling lost but this relationship wont help you, you are feeling lonely and upset anyway, so why be in this relationship? you would be wasting your time.
You have to do what you have to do. If you want to stay then by all means, stay. But this kind of disrespect wouldn't be tolerated in my house. And i don't think you should tolerate it either. Jussayn. There are other options.