Edit Models filters

Model Tree

Apps

Docker Model Runner

Unsloth Desktop

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

1,573

Base only

Active filters: int4

yunfengwang/MiniCPM5-2B-MNN-4bit

Text Generation • Updated 5 days ago • 50

JoaoZaokk/LTX-2.5-22B-distilled-W4A8-ConvRot

Text-to-Video • Updated 3 days ago • 84

Slaven71/Qwen3.8-27B-Uncensored-W4A16-RTX3090-MTP4

Image-Text-to-Text • 28B • Updated 4 days ago • 203

JoaoZaokk/Wan2.2-TI2V-5B-W4A8-ConvRot

Image-to-Video • Updated 4 days ago • 36

InfiniCloud/llm-jp-4-32b-a3b-thinking-GPTQ-INT4-G64

Text Generation • 32B • Updated 4 days ago • 20

InfiniCloud/llm-jp-4-33b-thinking-GPTQ-INT4-G64

Text Generation • 6B • Updated 4 days ago • 21

JoaoZaokk/Qwen-Image-2512-W4A8-ConvRot

Text-to-Image • Updated 4 days ago • 22

divakar7c5/wealthwand-qwen3-1.7b-int4-onnx

Text Generation • Updated 4 days ago

SirGreblik/GLM-5.2-colibri-int4-g64-with-int8-mtp

Text Generation • Updated 4 days ago • 26

circulus/flux2-klein-4b-int4-ov

Updated 4 days ago

circulus/qwen3-0.6b-int4-ov

Updated 4 days ago • 13

circulus/qwen3-4b-int4-ov

Updated 4 days ago • 13

Jeff98/Qwen3.5-9B-uncensored-int4-ov

Image-Text-to-Text • Updated 3 days ago • 50 • 1

CompressedMichael/Qwen3-VL-30B-A3B-Instruct-GPTQ-INT4

Image-Text-to-Text • 5B • Updated 4 days ago • 21

esilva/SlopCoder-Mongo-0.5B-ONNX

Text Generation • Updated 3 days ago

esilva/SlopCoder-Mongo-1.5B-full-ONNX

Text Generation • Updated 3 days ago

JoaoZaokk/Krea-2-Turbo-W4A4-ConvRot

Text-to-Image • Updated 3 days ago • 9 • 1

malvavisc0/OxCoder-9B-gptq-int4

Text Generation • 9B • Updated 3 days ago • 52 • 1

HarmenWessels/K2-Horizon-0.9B-int4-symg128-ov

Text Generation • Updated 3 days ago • 21

HarmenWessels/MiniCPM5-2B-int4-symg128-ov

Text Generation • Updated 3 days ago • 16

HarmenWessels/K2-Horizon-3.7B-int4-symg128-ov

Text Generation • Updated 3 days ago • 19

HarmenWessels/K2-Horizon-7B-int4-symg128-ov

Text Generation • Updated 3 days ago • 13

donghovietnam/madlad400-3b-mt-onnx-luca

Translation • Updated 1 day ago

dushandz/FLUX.2-klein-4B-CoreAI

Text-to-Image • Updated 3 days ago

HarmenWessels/Ministral-3-14B-Reasoning-int4-symg128-ov

Text Generation • Updated 3 days ago • 12

urakozz/Agnes-3.0-Flash-W4A16-AutoRound-GPTQ

Image-Text-to-Text • 7B • Updated 1 day ago • 28

grevinden/qwen3.8-27b-w4a16-autoround-rtx3090

Text Generation • 6B • Updated 3 days ago • 72

pedrodpj/gemma-4-e4b-it-int4-gs128

Image-Text-to-Text • Updated 3 days ago • 15

INCModel3/DeepSeek-V4.1-Flash-W4A16-Engram-AutoRound

Text Generation • 301B • Updated 3 days ago • 168

TheUnderscore/Qwen3.5-9B-The-Defiant-Fable-Uncensored-Heretic-NEO-IMATRIX-MAX-MTP-W4A16-AWQ

Image-Text-to-Text • 10B • Updated 2 days ago • 93