Why is that bad? Is it too late to remove them or have they already started to pollinate the females?
This is why a lot of people take a cutting or clone, and force flower it, to make sure, before they get too far along. But, if you've got 4 females, that's better than the 50-50 odds. and that's 4 plants you can clone out and grow.