Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

Inference Endpoints

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

75

Base only

Active filters: w4a4

ariaotp/INT4-ConvRot-W4A4-ComfyUI

Updated 2 days ago • 25

sakamakismile/Huihui-ThinkingCap-Qwen3.6-27B-abliterated-NVFP4

Image-Text-to-Text • 17B • Updated 11 days ago • 6.37k • 24

sakamakismile/Qwen3.6-27B-MTP-pi-tune-NVFP4

Image-Text-to-Text • 17B • Updated Jun 17 • 67.5k • 11

LAXMAYDAY/Krea-2-Raw-int4-tensorwise-mixed

Updated 17 days ago • 5

sakamakismile/ThinkingCap-Qwen3.6-27B-NVFP4

Image-Text-to-Text • 17B • Updated 16 days ago • 5.44k • 20

zzzmahesh/Meta-Llama-3-8B-Instruct-quantized.w4a4

Text Generation • 8B • Updated Sep 3, 2024 • 4 • 1

JongYeop/Llama-3.1-8B-Instruct-NVFP4-W4A4

5B • Updated Jan 29 • 37

JongYeop/Llama-3.1-70B-Instruct-NVFP4-W4A4

41B • Updated Feb 2 • 7

JongYeop/Qwen2.5-VL-3B-Instruct-FP4-W4A4-LM-Only

Image-Text-to-Text • 3B • Updated Feb 22 • 272

JongYeop/Qwen2.5-VL-7B-Instruct-FP4-W4A4-LM-Only

Image-Text-to-Text • 5B • Updated Feb 22 • 10

JongYeop/Qwen2.5-VL-3B-Instruct-MXFP4-W4A4-LM-Only

Image-Text-to-Text • 2B • Updated Mar 5 • 3

JongYeop/Qwen2.5-VL-7B-Instruct-MXFP4-W4A4-LM-Only

Image-Text-to-Text • 5B • Updated Mar 5 • 4

nivvis/Qwen3.5-35B-A3B-heretic-v2-NVFP4

Image-Text-to-Text • Updated Mar 18 • 9

dervig/m51Lab-MiniMax-M2.7-REAP-139B-A10B-NVFP4-GB10

Text Generation • 79B • Updated Apr 17 • 1.17k • 4

Ex0bit/Qwen3.6-35B-A3B-PRISM-NVFP4

Text Generation • Updated May 3 • 41.3k • 20

YuYu1015/Huihui-Qwen3.6-35B-A3B-abliterated-NVFP4

Text Generation • 21B • Updated Jun 8 • 535 • 2

YuYu1015/Huihui-Qwen3.6-27B-abliterated-NVFP4

Text Generation • 19B • Updated Apr 26 • 150 • 1

BitsPlease/HiSQRot4

Text-to-Video • Updated May 8

nerkyor/Lynn-V4-Pro-Distill-Qwen-35B-A3B-NVFP4-v8-RTN

Text Generation • 20B • Updated May 14 • 22

ultranationalism/nunchaku-z-image-turbo-svdq

Text-to-Image • 4B • Updated May 24 • 1

pyloxsystems/hochelaga-8b-nvfp4

Text Generation • 5B • Updated 29 days ago • 32

dangvansam/chandra-ocr-2-NVFP4

Image-Text-to-Text • 3B • Updated May 26 • 2.42k

YihongJin/Qwen3-Omni-30B-A3B-Instruct-NVFP4-W4A4-experts-mse

21B • Updated May 31 • 7

YihongJin/Qwen3-Omni-30B-A3B-Instruct-NVFP4-W4A4-experts-oproj-mse-preview

21B • Updated May 31 • 8

YihongJin/Qwen3-Omni-30B-A3B-Instruct-NVFP4-W4A4-full-thinker-mse-preview

20B • Updated May 31 • 8

YihongJin/Qwen3-Omni-30B-A3B-Instruct-NVFP4-W4A4-experts-oproj-mse

21B • Updated May 31 • 5

YihongJin/Qwen3-Omni-30B-A3B-Instruct-NVFP4-W4A4-full-thinker-awqclip

20B • Updated May 31 • 18.2k

coolthor/Huihui-Qwen3.6-35B-A3B-abliterated-NVFP4-W4A4

Image-Text-to-Text • 21B • Updated Jun 2 • 301

hoja-solutions/Llama-3.1-70B-LatamGPT-SFT-1.0-NVFP4

Text Generation • 41B • Updated Jun 2 • 5

ucmp137538/Omega-QVLA-pi05-LIBERO-W4A4

Robotics • Updated Jun 3 • 1