看來 You should not olny listen a lot, but listen and repeat a lot. If you've got correct pronunciation & intonation, you'll also listen bettter.
Also try "shadowing" . 演戲對嘴不出聲,但是每個發音細節都做出. You're 0.5 to 1 sec after the speaker. Try this while you listen. This could be a big help. (can't go to XDF, maybe you can use a tutor via MSN audio and white board. Mmn, Maybe someday I'll try teach En this way.)