I knew someone who didn't "pass" the test. He had tb, I think...
He was sent back home and of course, didn't get the job. Your contract will say that the job will be terminated if you don't succesfully pass the health check.

It is scary, but try not to think about it too much. Or get yourself checked in Australia before hand for your peace of mind.