I think there's an interesting general optimisation problem here of balancing the accuracy/performance of a software/hardware system, against the goal of making that system easier to iterate on and develop.

Presumably this is a matter of working out if you are at a local maximum or not, and thinking about what properties the ideal solution will have. It also matters if you have other competitors that might be racing towards the ideal solution faster than you, potentially patenting their progress along the way.