Yeah both of you will be Deported After short period of Jail.
and Its very Hard to give birth to a child without Marriage Certificate. you Both Better get Legal Marriage Certificate now, coz Once you GF start Visiting the HMC for Follow up they will ask for Marriage Certificate and both Passport Copies.
So now you dont have time to wait even for a month more if u dont want Problems.
Wish you Luck.