Edit Models filters

Model Tree

Apps

Docker Model Runner

Unsloth Desktop

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

606

Base only

Active filters: llm-compressor

RedHatAI/Qwen3-VL-32B-Instruct-FP8-dynamic

Text Generation • 33B • Updated Dec 10, 2025 • 2.82k • 1

RedHatAI/Qwen3-VL-32B-Instruct-FP8-block

Text Generation • 33B • Updated Dec 10, 2025 • 88

RedHatAI/Qwen3-VL-32B-Instruct-NVFP4

Text Generation • 20B • Updated Dec 10, 2025 • 4.83k • 7

RedHatAI/Qwen3-Next-80B-A3B-Instruct-NVFP4

Text Generation • Updated Dec 12, 2025 • 628 • 5

RedHatAI/Qwen3-Next-80B-A3B-Instruct-FP8-dynamic

Text Generation • 80B • Updated Jan 14 • 1.3k • 1

RedHatAI/Qwen3-Next-80B-A3B-Instruct-FP8-block

Text Generation • 80B • Updated Jan 14 • 23

coughmedicine/Huihui-Qwen3-Next-80B-A3B-Instruct-abliterated-nvfp4

Updated Dec 13, 2025 • 52 • 2

timerring/magnum-v4-12b-fp8

Text Generation • 12B • Updated Jan 2 • 5

RedHatAI/Qwen3-Next-80B-A3B-Thinking-FP8-block

Text Generation • 80B • Updated Jan 5 • 24

RedHatAI/Qwen3-Next-80B-A3B-Thinking-FP8-dynamic

Text Generation • 80B • Updated Jan 14 • 28

RedHatAI/Qwen3-Next-80B-A3B-Thinking-NVFP4

Text Generation • Updated Jan 5 • 167

mratsim/MiniMax-M2.1-FP8-INT4-AWQ

Text Generation • 39B • Updated Jan 14 • 34 • 39

kaitchup/LFM2.5-1.2B-Instruct-FP8-Dynamic

1B • Updated Jan 9 • 23 • 1

kaitchup/LFM2.5-1.2B-JP-FP8-Dynamic

1B • Updated Jan 9 • 8 • 1

kaitchup/LFM2.5-1.2B-Instruct-W4A16-G128

1B • Updated Jan 9 • 9 • 1

kaitchup/LFM2.5-1.2B-JP-W4A16-G128

1B • Updated Jan 9 • 8 • 1

kaitchup/LFM2.5-1.2B-JP-NVFP4

0.9B • Updated Jan 9 • 31 • 1

kaitchup/LFM2.5-1.2B-Instruct-NVFP4

0.9B • Updated Jan 27 • 19 • 2

kaitchup/LFM2.5-1.2B-Instruct-awq-asym

1B • Updated Jan 9 • 132 • 1

kaitchup/LFM2.5-1.2B-JP-awq-asym

1B • Updated Jan 9 • 21 • 1

xhxlb/IQuest-Coder-V1-40B-Instruct-int4

Text Generation • 6B • Updated Jan 8 • 3

EmbeddedLLM/Qwen3-VL-30B-A3B-Instruct.w4a16

Text Generation • 5B • Updated Jan 13 • 19 • 1

EmbeddedLLM/Qwen3-VL-30B-A3B-Thinking.w4a16

Text Generation • 5B • Updated Jan 13 • 19

mratsim/MiniMax-M2.1-BF16-INT4-AWQ

Text Generation • 39B • Updated Jan 14 • 20 • 7

RedHatAI/granite-4.0-h-tiny-FP8-dynamic

Text Generation • 7B • Updated Apr 28 • 302 • 3

kaitchup/LFM2.5-1.2B-Thinking-AWQ-W4A16-ASYM

1B • Updated Jan 22 • 198

kaitchup/LFM2.5-1.2B-Thinking-FP8-Dynamic

1B • Updated Jan 22 • 72

kaitchup/LFM2.5-1.2B-Thinking-MXFP4

0.8B • Updated Jan 22 • 9

kaitchup/LFM2.5-1.2B-Thinking-NVFP4

0.9B • Updated Jan 27 • 7

kaitchup/LFM2.5-1.2B-Thinking-W4A16-G128

1B • Updated Jan 22 • 7