Why do you need to keep cats away from babies?

Both my cats are constantly around my baby and even sleep on the bed with us. We have never had any health issues.You just need to use common sense!!