I actually had the opposite experience in high school. I could program, but my math was terribly poor. My last math teacher was also a computer science teacher, so he helped me to make connections between concepts in programming and concepts in math that allowed me to grasp things I otherwise would not grasp.

So, no, you don't have to be very good at math. It can help, and is needed in certain fields, but I don't think it's needed to be a math whiz. If anything, it can help your math.