Hi Bakugo.
Let me try and see if I can get where you're coming from. Forgive me if I'm teaching you to suck eggs, I dont mean to and I'm only trying to help.
When you go out and run easy at 6.40 for a mile, it's likely you're full of oxygen (legs and lungs) and aren't feeling it aerobically until miles 3+ appx. If you are getting tired, then it's not easy to your body somewhere (legs or lungs, most likely lungs) even though it felt good to begin with. So why would your body allow you to go out at a pace that you can't sustain when you knew (and hence your body knew) that you wanted to run for say 60 mins.
Short Answer: Your body doesnt know what it needs. It's telling you lies.
Long Answer: There is a theory that with running, your body knows best and should always be listened to. That's wrong. What I can see is that mentally you're strong. The thought of doing 6.40 easy for 60mins doesn't scare you, even though your body can't handle the pace. That's a good thing. Mental toughness is important and that easy pace would intimidate some people. What I've found is that your body(all our bodies) doesn't/don't care about the future. It doesn't care about how you'll feel in 45 mins from now. It only cares about now. So it tells you 6.40 is easy. And it is. For now. Then 1min,2min etc... and then you blow up. I don't know WHY it does that but it does. I think it's the answer to that WHY that you're looking for here. It's an answer I don't think you'll get here but I dont think the answer to it matters. Although I understand you may still want it. I certainly don't have an answer but I do have a way forward.
'Run easy' means different things to different people. For you it doesn't mean 6.40. Try 7.40 for an hour. Maybe 8 mins. Maybe more (8.30 or slower). It's getting hard early for you because you may be racing your 800m in say 2 mins-2.20 and feel ok-ish (4.40ish/mile pace). It feels ok because you're trained for that speed. 6.40 feels hard because you aren't trained for that (relatively slower) speed. So train what you don't have. You train for 6.40 (in your case) by running to it not from it. Eg. start at 7.40 and work down over some months. Not start at 6.40 and extend it. If you're tiring at 3 miles odd or a bit sooner then 6.40 is significantly faster than what you're capable right now but no indication of what your ceiling may be, how fast you can go.
Better advice can be given with more info (PB's, distance run?week,years running etc.). Let it suffice to say that 6.40 and tiring say after 3 miles implies say a 19min 5k currently and 6.40 is not easy for you for a long-ish run, no matter what your body tries to tell you. So govern your body with the knowledge that is avail. on these boards.
My only othe point is to find your max. aerobic pace, say via heartrate. As you point out, you can run for 9 mins,10 mins or more/mile and find it easy and it would all be Aerobic. It would all be easy. The gains though, at that speed, as you correctly suspect, would be limited. You want to run as fast as you can in the easy range,at the limit, when you find it. Then bring that down over time. I do feel though, that it'd be around 8 minute miling, maybe quicker,maybe slower but not by much. +/- 15 secs say.
Hope I helped you and if not you then someone.