Well, annoying as it may be, the airline have done nothing wrong in my eyes.

But as you were involuntarily bumped you are entitled by right to various things (first and foremost a ticket on another flight or compensation for your bumped ticket). Make sure you get what you're entitled to.