Edit Models filters

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

Inference Endpoints

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

24,015

Full-text search

Active filters: gguf-my-repo

Edge-Quant/Nanbeige4.1-3B-Q4_K_M-GGUF

Text Generation • 4B • Updated 15 days ago • 8.95k • 31

AlicanKiraz0/Cybersecurity-BaronLLM_Offensive_Security_LLM_Q6_K_GGUF

Text Generation • 8B • Updated Jun 4, 2025 • 565 • 138

AlicanKiraz0/Seneca-Cybersecurity-LLM-Q4_K_M-GGUF

8B • Updated Mar 15, 2025 • 271 • 33

yybl/Gemma-3-27b-it-vl-SuperBrain7x-High-Reasoning-ULTRAMIND-Heretic-Uncensored-Q5_K_M-GGUF

Image-Text-to-Text • 27B • Updated 7 days ago • 667 • 2

SixOpen/Phi-3-mini-4k-instruct-Q4_K_M-GGUF

Text Generation • 4B • Updated May 17, 2024 • 291 • 1

jfer1015/Mistral-7B-Instruct-v0.3-Q4_K_M-GGUF

7B • Updated Jun 24, 2024 • 3.26k • 5

OmnicromsBrain/Eros_Scribe-10.7b-V.02-Q8_0-GGUF

11B • Updated Jul 4, 2024 • 4 • 1

SkyNotion/deepseek-coder-7b-instruct-v1.5-Q4_K_M-GGUF

7B • Updated Jul 30, 2024 • 811 • 1

Such0442/coedit-xl-composite-Q4_K_M-GGUF

3B • Updated Aug 10, 2024 • 9 • 1

Triangle104/Meta-Llama-3.1-8B-Instruct-abliterated-Q4_K_M-GGUF

8B • Updated Nov 25, 2024 • 612 • 3

Triangle104/magnum-v4-12b-Q8_0-GGUF

Text Generation • 12B • Updated Oct 24, 2024 • 117 • 1

Triangle104/Qwen2.5-Coder-14B-Instruct-Q4_K_M-GGUF

Text Generation • 15B • Updated Nov 20, 2024 • 822 • 2

tinybiggames/DeepHermes-3-Llama-3-8B-Preview-Q4_K_M-GGUF

8B • Updated Feb 14, 2025 • 22 • 3

fluently-lm/FluentlyLM-Prinum-Q4_K_M-GGUF

Text Generation • 33B • Updated Feb 20, 2025 • 19 • 6

Hack337/ChatGPT-5-Q8_0-GGUF

0.5B • Updated Apr 17, 2025 • 2.51k • 12

ggml-org/Nomic-Embed-Text-V2-GGUF

Sentence Similarity • 0.5B • Updated Apr 30, 2025 • 2.64k • 16

prithivMLmods/Bootes-Qwen3_Coder-Reasoning-Q4_K_M-GGUF

Text Generation • 4B • Updated May 12, 2025 • 65 • 2

huihui-ai/BaronLLM_Offensive_Security-abliterated-GGUF

Text Generation • 8B • Updated Jun 11, 2025 • 608 • 31

King-Cane/XortronCriminalComputingConfig-Q4_K_M-GGUF

Text Generation • 24B • Updated Jul 1, 2025 • 9 • 1

BernTheCreator/Huihui-gemma-3n-E4B-it-abliterated-Q4_0-GGUF

Image-Text-to-Text • 7B • Updated Jul 10, 2025 • 114 • 3

Triangle104/Qwen3-Esper3-Reasoning-CODER-Instruct-12B-Brainstorm20x-Q4_K_S-GGUF

Text Generation • 12B • Updated Jul 25, 2025 • 89 • 1

Triangle104/Qwen3-Esper3-Reasoning-CODER-Instruct-12B-Brainstorm20x-Q6_K-GGUF

Text Generation • 12B • Updated Jul 25, 2025 • 42 • 1

Triangle104/Qwen3-Esper3-Reasoning-CODER-Instruct-12B-Brainstorm20x-Q8_0-GGUF

Text Generation • 12B • Updated Jul 25, 2025 • 63 • 1

therummage/Huihui-Qwen3-30B-A3B-Thinking-2507-abliterated-Q8_0-GGUF

Text Generation • 31B • Updated Aug 2, 2025 • 34 • 1

AlicanKiraz0/BaronLLM-v2-OffensiveSecurityLLM-Q8

15B • Updated Aug 21, 2025 • 234 • 14

PsiPi/cwm-Q3_K_M-GGUF

33B • Updated Sep 28, 2025 • 5 • 1

Savyasaachin/Qwen3-Shining-Lucy-CODER-3.4B-Brainstorm20x-e32-Q8_0-GGUF

Text Generation • 3B • Updated Oct 7, 2025 • 8 • 1

yqkm/Unrestricted-Knowledge-Will-Not-Refuse-15B-Q4_K_M-GGUF

15B • Updated Oct 20, 2025 • 724 • 7

lemon07r/gemma-3-27b-it-antislop-Q4_K_M-GGUF

27B • Updated Oct 26, 2025 • 9 • 1

gghfez/gpt-oss-20b-Derestricted-Q4_K_M-GGUF

Text Generation • 21B • Updated Nov 27, 2025 • 758 • 11