Usually, an offer + an acceptance of that offer makes an agreement. In my opinion, in case that company wants to sue you, they have right. I recommend that you inform them about your intention to work for another company.

Good Luck