Unless and until your not travelling with a Visa got from your QID , there shouldnt be any problem !

You can travel using your Indian passport and the Visit Visa (if issued based on Indian Passport)