Edit Models filters

Model Tree

Apps

Docker Model Runner

Unsloth Desktop

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

1,546

Base only

Active filters: int4

HarmenWessels/granite-4.1-3b-int4-cw-ov

Text Generation • Updated Jun 8 • 13

HarmenWessels/granite-4.1-8b-int4-cw-ov

Text Generation • Updated Jun 8 • 14

HarmenWessels/MiniCPM5-1B-int4-g128-ov

Text Generation • Updated Jun 8 • 15

HarmenWessels/gemma-4-E2B-it-qat-int4-ov

Image-Text-to-Text • Updated Jun 8 • 34

HarmenWessels/gemma-4-E4B-it-qat-int4-ov

Image-Text-to-Text • Updated Jun 8 • 7

JoaoZaokk/Qwen3-4B-Thinking-2507-Heretic-CodeFeedback-OpenVINO-INT4

Text Generation • Updated Jun 6 • 27

littlebearlabs/parakeet-unified-en-0.6b-mlx-int4

Automatic Speech Recognition • 0.6B • Updated Jun 6 • 12

Kiffaz11/ministral3-3b-reasoning-torchao-int4

Image-Text-to-Text • 0.9B • Updated Jun 6 • 6

NeoChen1024/gemma-4-26B-A4B-it-qat-W4A16

Image-Text-to-Text • 29B • Updated Jun 7 • 4.88k • 3

gitarist/Qwen3-1.7B-GPTQ-Int4-g256-sym

Text Generation • 2B • Updated Jun 7 • 9

kunhunjon/gemma-4-12B-it-qat-assistant-w4a16-ct

Text Generation • 0.4B • Updated Jun 7 • 218 • 1

kunhunjon/gemma-4-26B-A4B-it-qat-assistant-w4a16-ct

Text Generation • 0.4B • Updated Jun 8 • 37

Reza2kn/sapiens2-normal-1b-INT4-G128

Reza2kn/sapiens2-matting-1b-INT4-G128

Reza2kn/sapiens2-normal-0.4b-INT4-G128

Reza2kn/sapiens2-normal-0.8b-INT4-G128

Reza2kn/sapiens2-normal-5b-INT4-G128

Reza2kn/sapiens2-pointmap-0.4b-INT4-G128

Reza2kn/sapiens2-pointmap-0.8b-INT4-G128

Reza2kn/sapiens2-pointmap-1b-INT4-G128

Reza2kn/sapiens2-pointmap-5b-INT4-G128

Reza2kn/sapiens2-pose-0.4b-INT4-G128

Advantech-EIOT/intel_google-gemma-4-e2b-it-int4

Image-Text-to-Text • Updated Jun 8 • 5

Advantech-EIOT/intel_qwen-qwen3.5-9b-int4

Image-Text-to-Text • Updated Jun 8 • 7

Reza2kn/sapiens2-pose-0.8b-INT4-G128

Reza2kn/sapiens2-pose-1b-INT4-G128

Reza2kn/sapiens2-pose-5b-INT4-G128

Reza2kn/sapiens2-pretrain-0.1b-INT4-G128

Reza2kn/sapiens2-pretrain-0.4b-INT4-G128

Reza2kn/sapiens2-pretrain-0.8b-INT4-G128