For sure, go for it. Walking around is way less stressful on the feet than running, so you can afford to go super-minimal in that regard.
The most important thing to strengthen your feet, ankles, etc. is that the shoe is flexible in the sole - completely flexible, like the frees.
I've been running in modified adizero pro's for the last year. They're just about perfect. The modifications are removal of the heel counter, and a criss-cross patern of lateral and vertical cuts made into the sole. The cuts are as deep as the sole is thick. There are about 10 lateral cuts and 3 vertical. Their purpose is to make the sole as flexible as possible.
As they are, just about the only purpose they serve is to keep sharp pebbles from stabbing my feet, which is the way shoes should be.
They feel like heaven to run in. I've been running around 100 miles a week for the last month, 80 in the month before that, and I have had zero problems. My feet and legs feel perfectly normal, which is more than I could ever say when I used to run in the big ol' clunkers - even during a mere 30 mile week.
The biggest obstacle in getting away from conventional shoes is your feet adapting - there will be some shock, as muscles and movements that have been long neglected are forced into action. Take it easy for a while. Don't increase your training load for a little while, as your body is already adapting to a new stress.
I could say a million positive things about minimal shoes and a million negative things about conventional shoes, but it sounds like you need no convincing.
Have fun getting back in tune with your feet.