Of course it's important. If your advisor has connections, it may help when you are applying. For example, if he had co-authored papers with a professor at Harvard, and you applied for Harvard, the professor may give more credit to you due to his recommendation. I mean it is possible...