Isn't that the point of jail?

Jails are supposed to prevent crime, by acting as a deterrant to would be thieves, as well as a place of punishment, and a place of rehabilitation.

If people know that they can just break the law and avoid any legal consequences then this world is going to get pretty scary.

Punish him! Let him serve as an example to others why stealing is wrong.