It's great doing things that has a tutorial or something out there, it falls flat when you try to do something slightly novel that doesn't have tons of articles on how to do it.
In my case, ChatGPT was quite useful to bootstrap a code for working with Apple's CoreAudio and sucked when I tried to make it write some code to do something special to my app.
I got the same experience when I tried to hammer out an app dealing with cryptography(certificates, keys etc) and was only able to solve the issue through Apple's developer forms thanks to to the infamous eskimo1. Then some Russian dev who had the same issues appeared and gave me the full context. ChatGPT, Claude etc. can't put together a Swift code that does things usually not done in Swift but done in C and can't leverage its knowledge on Cryptography to help itself out.
I had similar problems in nodeJS etc. too, the instance you do anything non-standart AI falls apart and you can see how stupid actually is.
In my case, ChatGPT was quite useful to bootstrap a code for working with Apple's CoreAudio and sucked when I tried to make it write some code to do something special to my app.
I got the same experience when I tried to hammer out an app dealing with cryptography(certificates, keys etc) and was only able to solve the issue through Apple's developer forms thanks to to the infamous eskimo1. Then some Russian dev who had the same issues appeared and gave me the full context. ChatGPT, Claude etc. can't put together a Swift code that does things usually not done in Swift but done in C and can't leverage its knowledge on Cryptography to help itself out.
I had similar problems in nodeJS etc. too, the instance you do anything non-standart AI falls apart and you can see how stupid actually is.