I agree with you for the most part.
I have observed (anecdotally, no numbers to back this up) that women seem to be more prone to stress fractures with high mileage.
I don't know if this is just high mileage, per say. A lot of this might be due to the triad sequence (inadequate caloric intake --> inadequate body fat --> inadequate estrogen production --> ammenhorrea --> brittle bones -->
stress fracture) and not high mileage alone. Women are more likely to have inadequate caloric intake at 100 mpw than, say, 50 mpw.
For women who do menstruate regularly, there is increased risk of iron deficiency anemia with high mileage. (Again, though, this is something that can be easily corrected with diet or supplements.)
Women do generally have weaker bones. (There is plenty of evidence that we have higher rates of osteoporosis, etc.)
None of this is to say that women CAN'T or DON'T handle high mileage. Many of the top runners rely on high mileage and get to be top runners because of it.
Women just have to be careful about these potential pitfalls that men don't have to worry about.