The only thing you cant get without a residency permit is a cheque book. Most banks will issue you an account with a debit card but not a seperate visa account also without a deposit for the credit limit amount.

I used IBQ when I first came here and was here for 5 months with no RP and they gave me an account, debit card and online facilities etc