Edit Models filters

Model Tree

Apps

Docker Model Runner

Unsloth Desktop

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

3,039

Base only

Active filters: on-device

prism-ml/Ternary-Bonsai-2-27B-gguf

Text Generation • 27B • Updated about 15 hours ago • 3.25M • 2.11k

Cactus-Compute/needle3

Text Generation • Updated 7 days ago • 81.1k • 241

prism-ml/Ternary-Bonsai-2-27B-mlx-2bit

Text Generation • 27B • Updated 4 days ago • 57.3k • 379

openbmb/MiniCPM5-2B

Text Generation • 3B • Updated 14 days ago • 727k • 1.69k

huihui-ai/Huihui-Qwen3.8-27B-abliterated-GGUF

Image-Text-to-Text • 27B • Updated 5 days ago • 2.24M • 902

openbmb/MiniCPM5-2B-GGUF

Text Generation • 3B • Updated 14 days ago • 228k • 328

dealignai/Bonsai-2-27B-Ternary-CRACK-GGUF

Text Generation • 27B • Updated 8 days ago • 60.1k • 146

prism-ml/Ternary-Bonsai-27B-gguf

Text Generation • 27B • Updated 26 days ago • 644k • • 1.4k

dealignai/Bonsai-2-27B-1bit-CRACK-GGUF

Text Generation • 27B • Updated 8 days ago • 32.1k • 81

prism-ml/Bonsai-27B-gguf

Text Generation • 27B • Updated Jul 17 • 439k • 875

prism-ml/Bonsai-27B-mlx-1bit

Text Generation • 2B • Updated Jul 14 • 1.11M • 258

ganmoor-ai-labs/finanalyzer-indian-bank-statements

Text Generation • 2B • Updated 7 days ago • 513 • 12

Cactus-Compute/needle2

Text Generation • Updated 23 days ago • 25.4k • 328

Abiray/MiniCPM5-2B-heretic-abliterated-GGUF

Text Generation • 3B • Updated 18 days ago • 23.4k • 33

chaoliangUNSW/Jev-Style-0.8B-Decision-v3-GGUF

Text Classification • 0.8B • Updated 43 minutes ago • 659 • 8

openbmb/MiniCPM5-1B

Text Generation • 1B • Updated Aug 17 • 551k • 1.15k

FINAL-Bench/POCKET-Qwen3.8-Flash-Next-GGUF

Text Generation • 177B • Updated about 24 hours ago • 71 • 50

openbmb/MiniCPM5-2B-MLX

Text Generation • 3B • Updated 14 days ago • 178k • 51

oddadmix/Kokoro-7M-Distill

Text-to-Speech • Updated 10 days ago • 581 • 30

FINAL-Bench/POCKET-Zimage-CPU

Text-to-Image • 6B • Updated about 24 hours ago • 54 • 32

prism-ml/Ternary-Bonsai-27B-mlx-2bit

Text Generation • 27B • Updated Jul 14 • 1.1M • 201

desert-ant-labs/voz

Automatic Speech Recognition • Updated 2 days ago • 221 • 42

bartowski/MiniCPM5-2B-GGUF

Text Generation • 3B • Updated 16 days ago • 21k • 34

prism-ml/Ternary-Bonsai-8B-gguf

Text Generation • 8B • Updated Jun 10 • 377k • 159

Supertone/supertonic-3

Text-to-Speech • Updated May 18 • 28.5k • 970

PeppX/gemma-4-e2b-uncensored-litertlm

Updated Jul 17 • 3k • 25

desert-ant-labs/redact

Token Classification • Updated 2 days ago • 7.28k • 24

ginigen-ai/Edge-4B-TELL

Any-to-Any • 7B • Updated 7 days ago • 1.42k • 34

Cactus-Compute/needle

30.4M • Updated Jul 13 • 327 • 350

prism-ml/Bonsai-8B-gguf

Text Generation • 8B • Updated Apr 18 • 119k • 786