You can write a petition letter, ask your colleagues who are not in favor of the timings to sign (of course sign in their own will) and submit to your management. If they refuse to address your concern then go to labor department.

Yes, it's time consuming and there's a risk of sacking you from the job, or it can come up with a positive result too ;)

Goodluck!