The core difference is that conventional banks acquire deposits and give loans on "Interest" whereas the Islamic banks, do so on "Profit & Loss Sharing Basis" like a business partnership does.

Interest has ruined many societies, which is why it is forbidden in Islamic ways of business.