In my opinion, taking notes is just an efficient approach to help you concentrate on the listening material. Sometimes, you cann't guarantee your attention can be kept through the whole listening, even though you probably have excellent aptitude in listening. In many cases, it is unnecessary for us to look over our notes again when answering questions.