Google DeepMind introduced Gemma 4 12B on June 3, 2026, launching a mid-sized multimodal model designed to run locally on consumer laptops. The release bridges the gap between the organization's edge-focused E4B model and its larger 26B Mixture of Experts architecture, packaging agentic capabilities inside a smaller memory footprint. Gemma 4 models have now accumulated over 150 million downloads across the developer community.
The model operates on an encoder-free architecture that routes visual and audio inputs directly into the primary language model backbone. Rather than using traditional separate encoders, Google DeepMind replaced the vision encoder with a lightweight embedding module using a single matrix multiplication, positional embedding, and normalizations. Audio signals project directly into the same dimensional space used for text tokens, making Gemma 4 12B the company's first mid-sized model featuring native audio inputs.
Hardware and deployment
Engineered to run locally, Gemma 4 12B requires 16GB of RAM, VRAM, or unified memory. The model comes equipped with Multi-Token Prediction drafters to lower latency during operation and achieves benchmark performance near Google DeepMind's 26B model at less than half of the memory footprint. Google DeepMind released pre-trained and instruction-tuned checkpoints on Hugging Face and Kaggle under an Apache 2.0 license.
Testing options include LM Studio, Ollama, the Google AI Edge Gallery App, the Google AI Edge Eloquent app, and the LiteRT-LM CLI. Local inference pipelines support Hugging Face Transformers, llama.cpp, MLX, SGLang, and vLLM, with Unsloth available for model fine-tuning. Google DeepMind also released an official Skills Repository containing a library of skills designed for agent development.
For production deployments, endpoints can be created using Google Cloud services including the Gemini Enterprise Agent Platform Model Garden, Cloud Run, and Google Kubernetes Engine. Community projects built on the Gemma architecture prior to this release range from wearable robotic arms for physical assistance to enterprise AI security tools.
