when you improve math, you will find nobody care so much if you are not math phd. Of course it is important, but not so important as expected. If your target is top 10, the story might be a little different.
but how many math courses can you take in one year in a phd program? (in one semester actually, since you have to sumbit your new application before the 2nd semester begins)