Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

870

Base only

Active filters: modelopt

ggufbench/gemma-4-26B-A4B-it-NVFP4-GGUF

25B • Updated May 9 • 434 • 1

tss-deposium/gemma-4-E4B-text-only-nvfp4

Text Generation • 6B • Updated May 8 • 29

pekkAi/gemma-4-E4B-it-ultra-uncensored-heretic-nvfp4

Any-to-Any • 6B • Updated May 8 • 3.48k

ApacheOne/expimodel

LLMWildling/gemma4-39b-a6b-preview

Text Generation • 22B • Updated May 10 • 14 • 1

mygitphase/guhan-30b-fp8

Text Generation • 32B • Updated May 10 • 5

Reza2kn/nvidia_stt_fa_fastconformer_hybrid_large-NVFP4

Automatic Speech Recognition • Updated May 10 • 6

Reza2kn/MohammadGholizadeh_parakeet-ctc-1.1b-persian-NVFP4

Automatic Speech Recognition • Updated May 10 • 16

tss-deposium/PaddleOCR-VL-1.5-nvfp4

Image-Text-to-Text • 0.6B • Updated May 10 • 10

tss-deposium/PaddleOCR-VL-1.5-mxfp4

Image-Text-to-Text • 0.8B • Updated May 10 • 8

litcloud/Qwen3.6-27B-Text-NVFP4-MTP

Text Generation • 17B • Updated May 10 • 1.13k • 1

vultr/DeepSeek-V4-Pro-NVFP4

Updated Jun 3 • 14

feizhai123/hunyuan-image3-modelopt-mixed-experts-nvfp4-dense-fp8

Text-to-Image • 44B • Updated May 11 • 26

nvidia/Kimi-K2.6-NVFP4

Text Generation • Updated May 15 • 645k • 42

gsting/Qwen3-Coder-Next-abliterated-FP8

80B • Updated May 11 • 14 • 1

sakamakismile/Huihui-Mistral-Medium-3.5-128B-abliterated-NVFP4

87B • Updated May 16 • 64

Yuqi123/Qwen3.5-0.8B-modelopt-fp8

0.8B • Updated May 20 • 20

Yuqi123/Qwen3.5-4B-modelopt-fp8

4B • Updated May 20 • 5

nerkyor/Qwen3.6-35B-A3B-NVFP4-modelopt

Text Generation • Updated May 12 • 38 • 1

LLMWildling/gemma4-52b-a6b

Text Generation • 28B • Updated May 19 • 9

LLMWildling/gemma4-52b-a6b-canopy

Text Generation • 28B • Updated May 19 • 2

bahadirakdemir/gemma-4-31B-it-assistant-fp8

Text Generation • 0.5B • Updated May 13 • 272 • 2

Kaleto/Anubis-Pro-105B-NVFP4

Text Generation • 60B • Updated May 20 • 207 • 1

ManniX-ITA/Gemma-4-26B-A4B-it-NVFP4A16

14B • Updated May 14 • 8

Kaleto/Behemoth-X-123B-v2.2-NVFP4

Text Generation • 69B • Updated May 20 • 99 • 1

nvidia/llama-nemotron-embed-vl-1b-v2-fp8

Sentence Similarity • 2B • Updated Jun 11 • 487 • 11

ManniX-ITA/Gemma-4-31B-it-NVFP4A16

Text Generation • 17B • Updated May 18 • 6

ManniX-ITA/gemma-4-31b-he1-it-NVFP4A16

Text Generation • 17B • Updated May 19 • 6

connorhzp/Qwen3.6-27B-AEON-Ultimate-Uncensored-Multimodal-NVFP4-MTP-XS

Text Generation • 17B • Updated May 15 • 24

Kaleto/DeepSeek-R1-Distill-Llama-70B-NVFP4

Text Generation • 41B • Updated May 20 • 534 • 1