If it is a family - oriented restaurant and you youngsters were hanging - around aimlessly; then the guy was right to shout on you and get you away.
Try respecting the family values here in Qatar.