You have the right to complain. No other Airlines are checking the validity of the RP while you are getting an on arrival visa. They should have let you travel after taking a written affidavit from you that you will be responsible if Dubai Immigration is not allowing you to enter. Even the Immigration in Dubai will not check it and I dont know why Flydubai did this to you. I used to travel frequently getting the on arrival visa and I never had any such problems from Emirates or from Qatar Airways. I think the perso who was in the check in desk was not aware of the rules and regulations properly and you should submit your complaint with the copy of your tickets and should tell them that you were allowed to travel by the Airlines who did not ask for anything like that. They must give you the compensation for your suffering and financial loss. Write a strong letter to their Customer Service asking for compensation.