Join the conversation

Join the community of Machine Learners and AI enthusiasts.

Sign Up
danielhanchen 
posted an update 4 days ago
Post
8696
Gemma 4 12B can now run locally on just 8GB RAM via Dynamic GGUFs.

Google's new model, Gemma 4 12B Unified supports image, audio and 256K context.
You can run and train the model via Unsloth Studio.

GGUF: unsloth/gemma-4-12b-it-GGUF
Guide: https://unsloth.ai/docs/models/gemma-4

This won't run on anything less than 16GB. I tested it with 8GB and 12GB; you need at least 16GB to run this model(Q4) in LM Studio.

·

Maybe because LMstudio eats 3GB RAM on it's own?