Aiwa, no not relinquish your memories. But stop letting then influence that what you do NOW. Only if you do that, overcome the ego, will you be able to be truly happy.
Now, don't ask me how to do that...am still working on it :P