It is indeed very strange that you lost confidence just because you have not driven for four years! Frankly, I don't think you should ever drive as you could be a source of danger to other drivers.