WE HACKED GOOGLE'S AI, GEMINI AND LEAKED ITS SOURCE CODE (AT LEAST SOME PART)
In March, Roni Carta (Lupin) and team disclosed they hacked Google's AI, Gemini, during the 2024 LLM bugSWAT event, winning the Most Valuable Hacker award. They discovered a vulnerability within Gemini's Python sandbox that allowed them to rewrite Python code and map the filesystem, enabling them to extract a 579MB binary file. Analyzing this binary revealed internal source code, including sensitive Google proto files containing metadata descriptions used to classify user data and internal security proto definitions.