Many kinds of defecting aren't punished much. For example we don't refuse to buy things made with slave labor. Some people do, but they're an extreme minority. So being a slave owner is rewarding.