Your post, to me, implies that you're not running at the elite or super high level, when you refer to "part of a running group." Given that, it wouldn't surprise me if the marathoners/ultrarunners are generally stronger than the pure marathoners. In my experience the "normal" people who are also crossing over into ultrarunning are spending a lot more time on their feet than are the pure marathoners. They're doing either longer long runs, or similarly long long runs but doing them back-to-back on the weekends. So, outside of the elite realm, the people you saw might be more ready for whatever pace/mileage you were at when getting passed.
This goes out the window, I think, at the higher levels, because the disparity in training either doesn't exist as much (everyone's doing bunches of miles) and/or the focus is different (broadly speaking, ultrarunners doing more of their mileage with significant vert and at slower pace).