They do approximate any function... within the range they're trained on. And that range is human limited, at least today.

Also, there is a good enough point where improvements for a given use case are on heavy diminishing returns