That's why I said "at least most of the way." The eagles could have dropped them off in Gondor or something. Plus they showed up lickety-split right after Sauron was defeated, so they had to have been on the way when he was still looking westward, so it seems like he must have seen them coming anyway.