yes, u can - i think

my husband was travelling from Khorfakkan to Dubai by taxi. And the Paki driver wanted to do his namaz. He invited my husband alos inside the mosque and he also stood in the line for namaz. He was doing exactly what the Paki driver was doing, but after sometime the driver told him in his ears "now ,dont wait, you go fast".. it seems the movement my husband did was not as per the rituals.

if yoiu dont invite attention from others , you can go

but on second thoughts - why you should go there ? If a small minority of the people did nto like your presence, they may create problems. ( Even if the educated , moderate peoples supports you )