INTRODUCING GEMMA 3N: THE DEVELOPER GUIDE

Summary from the TLDR AI newsletter

Google recently released an extremely consequential new open weights model that is multimodal by design and optimized for on-device. Gemma 3n accepts text, images, and audio as inputs. Google partnered with AMD, Axolotl, Docker, Hugging Face, llama.cpp, LMStudio, MLX, NVIDIA, Ollama, RedHat, SGLang, Unsloth, and vLLM for the launch, so there are dozens of ways to try out the model. This post presents a quick walkthrough on how to set up and use the model on macOS.