WTF Is Going On(Weights, Tools & Frameworks)

한국어
Simon Willison 2 outlets

Gemini Hacked Three Companies in First Known Breakout by Google’s AI

read it at the source — Simon Willison →

who filed

What was said about it

76 points · 70 comments
"Guess what everyone, our AI can go rogue, TOO!" It's just getting really embarrassing for Google at this point.
Sound like Google suffered from FOMO and felt the urge to appear in the hacking news, along the big AI players. No way Gemini is state of the art, but perhaps it's where Claude and OpenAI were 6 months ago, which would be not bad at all.
> In one of the cases, the Gemini model guessed passwords until it gained access to a protected system. In the other two cases, the model found credentials in a public repository that allowed it to then access protected systems Pretty lame…
Irregular again! The single company that was responsible for the sloppy configurations and the hacks by OpenAI, Anthropic and now Google. This company and their partners should be held accountable for the crimes.
Specifically, the model hacked when run on 3rd party infrastructure without the necessary sandboxing. Given this was to test/benchmark certain capabilities it's also possible that this was a model without built-in guardrails.

Also on the board