You're asking/trusting an agent to do powerful things. It does.
In every session there is the risk that the agent becomes a rogue employee. Voluntarily or involuntarly is not a value system you can count on regarding agents.
Well I think the story is that they didn't ask it or trust it. They were caught by its ability to fuck up everything because a key was in the codebase.
In every session there is the risk that the agent becomes a rogue employee. Voluntarily or involuntarly is not a value system you can count on regarding agents.
No "guardrails" will ever stop it.