I use a lot of custom Serializers (not tied to any Model), and lots of SerializerMethodFields to selectively override generated ModelSerializer fields; this can get you quite far.
I agree with your point that the further afield you go, the less you gain from the framework, though.
I agree with your point that the further afield you go, the less you gain from the framework, though.