Inference Providers
Active filters: Int4
JunHowie/Qwen3-14B-GPTQ-Int4
Text Generation • 15B • Updated • 2.85k
• 5
AXERA-TECH/DeepSeek-R1-Distill-Qwen-1.5B-GPTQ-Int4
Updated • 25
• 1
AXERA-TECH/DeepSeek-R1-Distill-Qwen-7B-GPTQ-Int4
Updated • 23
• 1
AXERA-TECH/Qwen2.5-1.5B-Instruct-GPTQ-Int4
Text Generation • Updated • 97
AXERA-TECH/Qwen2.5-3B-Instruct-GPTQ-Int4
Updated • 14
AXERA-TECH/Qwen2.5-0.5B-Instruct-GPTQ-Int4
Text Generation • Updated • 61
AXERA-TECH/Qwen2.5-7B-Instruct-GPTQ-Int4
JunHowie/Qwen3-0.6B-GPTQ-Int4
Text Generation • 0.6B • Updated • 649
• 1
JunHowie/Qwen3-1.7B-GPTQ-Int4
Text Generation • 2B • Updated • 64
• 1
JunHowie/Qwen3-32B-GPTQ-Int4
Text Generation • 33B • Updated • 762
• 4
JunHowie/Qwen3-30B-A3B-GPTQ-Int4
Text Generation • 5B • Updated • 28
• 1
JunHowie/Qwen3-8B-GPTQ-Int4
Text Generation • 8B • Updated • 969
• 4
JunHowie/Qwen3-4B-GPTQ-Int4
Text Generation • 4B • Updated • 214
• 2
JunHowie/Qwen3-4B-Instruct-2507-GPTQ-Int4
Text Generation • 4B • Updated • 935
• 4
JunHowie/Qwen3-4B-Thinking-2507-GPTQ-Int4
Text Generation • 4B • Updated • 40
• 1
JunHowie/Qwen3-30B-A3B-Instruct-2507-GPTQ-Int4
Text Generation • 31B • Updated • 643
JunHowie/Qwen3-30B-A3B-Thinking-2507-GPTQ-Int4
Text Generation • 31B • Updated • 72
JunHowie/Qwen2-7B-Instruct-GPTQ-Int4
Text Generation • 8B • Updated • 8
JunHowie/Seed-OSS-36B-Instruct-GPTQ-Int4
Text Generation • 36B • Updated • 10
QuantTrio/KAT-Dev-GPTQ-Int4
Text Generation • 33B • Updated • 16
• 1
QuantTrio/Kimi-Dev-72B-GPTQ-Int4
Text Generation • 73B • Updated • 33
• 2
AXERA-TECH/Qwen3-VL-2B-Instruct-GPTQ-Int4
Image-Text-to-Text • Updated • 41
• 1
AXERA-TECH/Qwen3-VL-4B-Instruct-GPTQ-Int4
Image-Text-to-Text • Updated • 30
AXERA-TECH/Qwen3-VL-8B-Instruct-GPTQ-Int4
Image-Text-to-Text • Updated • 14
• 1
AXERA-TECH/Qwen3-VL-2B-Instruct-GPTQ-Int4-AX630C
Image-Text-to-Text • Updated • 11
AXERA-TECH/Qwen3-VL-2B-Instruct-GPTQ-Int4-AX630C-P256-CTX384
Image-Text-to-Text • Updated • 9
AXERA-TECH/Qwen3-VL-2B-Instruct-GPTQ-Int4-AX630C-P320-CTX448
Image-Text-to-Text • Updated • 20
AXERA-TECH/Qwen3-1.7B-GPTQ-Int4
Text Generation • Updated • 17
AXERA-TECH/Xiaomi-MiMo-VL-Miloco-7B-AX650-GPTQ-Int4
Image-Text-to-Text • Updated • 4
AXERA-TECH/Qwen2.5-VL-3B-Instruct-GPTQ-Int4
Image-Text-to-Text • Updated • 8