I think you should let them go.
They won't be the only kids out on their own for the first time, or the only Muslims. There will be plenty of other kids in the exact same boat as them, and more than likely there will be clubs and organizations for them to join.

Also, many universities offer a female only dorm (men can only visit during the day and are not allowed to spend the night) where your daughter may feel more comfortable.