As someone who got my first job out of college based on where I went to school, I would say yes. To pass up an ivy, stanford, duke, northwestern for a state school is not a good idea.
But like others have said, if you are looking at a mediocre private school then don't bother. Stick with the state school.