The problem is that both college and pro football stadiums have been built without the ability to have a track or had the track removed for more seating. LA coliseum is going to have to undergo a massive renovation to build in a track for 2028. The only exceptions are Franklin Field and a few lesser Div I schools (Buffalo, EMU, Bucknell). The track only stadiums that are big enough are Mt. Sac, U. Texas and Drake. Everything else is under 10k. So, Eugene ends up winning every year by default.
I also think the stadium looks especially empty during the day and late afternoon because the sun blasts the eastern stands. I would imagine that fans who have seats on that side just end up moving over so they are not staring into the sun the whole time. They should have built the stadium so that the straightaway stands face north or south and get shade most of the day.