I hear you on this. It's going to be a challenge.
It was interesting to note that the OP mentioned he was looking forward to pursuing his passion, woodworking, in retirement. I share that with the OP, and getting ready to retire shortly, i've been fixing up my basement shop and am even looking forward to re-kindling the passion i had in earlier careers as woodworker and craftsman and furniture maker. So I hope i can keep that edge by applying it in new (or re-newed) directions. But honestly, i am worried about losing that edge, and i plan to travel a lot with my wife, and give it my best shot.
The other side of the coin is this: is grinding out an extra five or ten years at your current job really optomizing your limited time left in this life? How much are you growing as a person, and using your time to its fullest? Ultimately, it comes down to how you handle it, whichever you choose. I guess it's a bit of a gamble to try new things. And it comes at a time of life when taking risks and embracing the unknown don't come naturally.
So, that's what's going through my head, Nobody said it would be easy.