Rome was built by slave labor but at that time the slaves would have been actually been Roman (or at least European) and some Africans coming through Carthage. If there were any Asians (and I'm sure there were a few) they would have been Arab or Indian and more likely prisoners of war turned into slaves rather than born slaves.