Yes, it is advisable to do so especially the credit card. It takes around a week or more from the date of application for the bank to cancel the credit card. You may wish to act quickly.