The real reason people talk about Colorado more than California is because of the urban centers close to mountains. The people you hear talking about moving for the mountain lifestyle are young, and young people don't really want to give up their urban, social lifestyle for the mountains. Bishop, Truckee, and Mammoth are pretty sleepy little towns that become sh!tshows when the tourists come.
I assure you there are tons of people from the SF bay that are thinking about moving to Tahoe and Bishop right now.