Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

Inference Endpoints

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

4,118

Base only

Active filters: 6-bit

mlx-community/Ornith-1.0-35B-6bit

Image-Text-to-Text • 8B • Updated 13 days ago • 2.62k • 6

mlx-community/Qwen3.6-27B-6bit

Image-Text-to-Text • 6B • Updated Apr 22 • 1.05k • 9

mlx-community/Qwen3.5-122B-A10B-6bit

Image-Text-to-Text • 27B • Updated Feb 24 • 2.5k • 3

mlx-community/Qwen3.6-35B-A3B-6bit

Image-Text-to-Text • 8B • Updated Apr 16 • 3.87k • 8

mlx-community/gemma-4-12B-6bit

Any-to-Any • 3B • Updated Jun 3 • 165 • 2

mlx-community/Ornith-1.0-9B-6bit

Text Generation • 2B • Updated 13 days ago • 3.54k • 4

georgeis55/Nemotron-Labs-3-Puzzle-75B-A9B-MLX-6bit

Text Generation • 75B • Updated 3 days ago • 440 • 2

Float16-cloud/llama3.2-typhoon2-3b-instruct-mlx-6bit

Text Generation • 0.7B • Updated Dec 21, 2024 • 1

MaziyarPanahi/Phi-4-mini-instruct-GGUF

Text Generation • 4B • Updated Mar 1, 2025 • 112k • 14

rdsm/openhands-lm-32b-v0.1-mlx-6bit

Text Generation • 7B • Updated Mar 31, 2025 • 14 • 1

dphn/Dolphin-Llama3-8B-Instruct-exl2-6bpw

Updated Apr 28, 2025 • 29 • 31

pierstab71/gpt-oss-120b-mlx-6Bit

Text Generation • 117B • Updated Sep 7, 2025 • 28 • 1

lmstudio-community/Qwen3-VL-4B-Instruct-MLX-6bit

Image-Text-to-Text • 1B • Updated Oct 28, 2025 • 107k • 1

mlx-community/Qwen3.5-9B-6bit

Image-Text-to-Text • 2B • Updated Mar 2 • 730 • 5

mlx-community/gemma-4-31b-it-6bit

Image-Text-to-Text • 7B • Updated 5 days ago • 1.36k • 6

mlx-community/gemma-4-26b-a4b-it-6bit

Image-Text-to-Text • 6B • Updated 5 days ago • 1.48k • 7

mlx-community/gemma-4-e4b-it-6bit

Image-Text-to-Text • 2B • Updated 5 days ago • 1.48k • 3

mlx-community/gemma-4-e4b-6bit

Any-to-Any • 2B • Updated Apr 3 • 79 • 3

TheCluster/Qwen3.5-122B-A10B-Heretic-v2-MLX-mixed-6bit

Image-Text-to-Text • 122B • Updated Apr 11 • 236 • 2

Ex0bit/MYTHOS-26B-A4B-PRISM-PRO-DQ-MLX

Image-Text-to-Text • 6B • Updated Apr 11 • 2.24k • 21

Jundot/gemma-4-26B-A4B-it-oQ6

6B • Updated Apr 16 • 227 • 4

lmstudio-community/Qwen3.6-35B-A3B-MLX-6bit

Image-Text-to-Text • 8B • Updated Apr 16 • 597k • 3

unsloth/Qwen3.6-27B-UD-MLX-6bit

Image-Text-to-Text • 11B • Updated Apr 22 • 2.66k • 13

mlx-community/Qwen3.6-27B-AEON-Ultimate-Uncensored-BF16-mlx-6Bit

Text Generation • 27B • Updated May 13 • 108 • 6

froggeric/Qwen3.6-35B-A3B-Uncensored-Heretic-MLX-6bit

Image-Text-to-Text • 8B • Updated May 6 • 940 • 3

Jundot/Qwen3.6-27B-oQ6-fp16-mtp

7B • Updated May 12 • 531 • 5

Jundot/Qwen3.6-35B-A3B-oQ6-fp16-mtp

8B • Updated May 12 • 633 • 5

lmstudio-community/Qwen3.6-27B-MLX-6bit

Image-Text-to-Text • 6B • Updated Jun 2 • 1.03M • 3

mlx-community/gemma-4-12B-it-6bit

Image-Text-to-Text • 3B • Updated Jun 8 • 734 • 2

mlx-community/gemma-4-12B-it-assistant-6bit

Any-to-Any • 92.5M • Updated Jun 3 • 131 • 1