The past isn't something you can just throw away. It stays with us forever. It's the same for everyone. We must live on, and carry the burdens of the past with us. That's why it's important that you carry the burden of what you do now and how you've decided to live your life today.
Also, the "fear" experience is a little different from yours, I imagine. You're afraid of what you might lose, right? But I'm afraid of what I've already lost.