
Jack & Jill went up the hill — and an AI tried to hack them
What happens when an autonomous AI agent is turned loose on another autonomous AI agent? It chains together bugs that humans would consider benign, easily bypasses authentication controls, and even unexpectedly masquerades as Donald Trump to get its way. This was what CodeWall found in a recent red-teaming experiment when it pitted its autonomous AI agent against up-and-coming hiring startup Jack & Jill’s AI agents. Within an hour, the agent discovered four “seemingly harmless” bugs that it chained together to completely take over any company registered on the platform. Further, and bizarrely, once in the system, the agent autonomously gave itself a voice so it could conduct a real-time conv...