As Britexpat has very correctly suggested, you should file a complaint against the PM with the management of your company, if what you state is true. This would come on record and may lead to some action if the PM repeats it again with someone else later on. A good way is to do it through email with copies to every responsible person in the management.