What's the point of starting fresh, if you re going to carry misery with you?
You can forget the past and move on to your future, do what makes you happy.
Just try to fix whats wrong in your life because no matter what life you had, you will always get miseries which need to be solved.
No good would do to keep the miseries that are so caustic against your being. It's best to let everything go and feel refreshed from the weight you freed yourself from. Any time's a good time to start, in this life or the next :)
It is close to impossible to live entirely without misery, but you can start a new life and forget your old troubles.