That's your problem right in your logic: If someone goes out hard they are not just going to see them go away. They'll tuck in right behind not letting gaps form. You're the one assuming they will let the front runner go away.
The dinamics are different from a time trial vs balanced competition