I believe the concern with whale hunting is less related to the suffering of the whales and more related to biological diversity. Hunting has already driven many whale species to extinction with several others on that same path.

Whales are of particular concern because, once their population is reduced, it is very hard for them to reestablish a large and healthy population. I believe because they have such low offspring rates.