itlwas/bgGPT-llama-3.1-8B-Q4_K_M-GGUF
8B • Updated • 26
itlwas
itlwas
AI & ML interests
👋 Here you’ll find GGUF models 🗂️ with Q4_K_M quantization ⚙️, optimized for low-resource devices 💻. These models balance size 📏 and performance 🚀. Notice any issues? Message me on Telegram: @itlwas
Organizations
itlwas/Sebushka-llama-3.1-8B-Q4_K_M-GGUF
8B • Updated • 19
itlwas/Llama-3-8B-Web-Q4_K_M-GGUF
8B • Updated • 33
itlwas/Meta-Llama-3.1-8B-Claude-Q4_K_M-GGUF
8B • Updated • 71
itlwas/Ahma-7B-Instruct-Q4_K_M-GGUF
Text Generation • 7B • Updated • 20
itlwas/Ahma-7B-Q4_K_M-GGUF
Text Generation • 7B • Updated • 28
itlwas/Ahma-3B-Instruct-Q4_K_M-GGUF
Text Generation • 4B • Updated • 42
itlwas/Ahma-3B-Q4_K_M-GGUF
Text Generation • 4B • Updated • 50
itlwas/TinyLlama_v1.1_chinese-Q4_K_M-GGUF
1B • Updated • 32
itlwas/TinyLlama_v1.1_math_code-Q4_K_M-GGUF
1B • Updated • 20
itlwas/TinyLlama_v1.1-Q4_K_M-GGUF
1B • Updated • 26
itlwas/TinyLlama-1.1B-Chat-v1.0-Q4_K_M-GGUF
1B • Updated • 45
itlwas/BioMistral-7B-SLERP-Q4_K_M-GGUF
Text Generation • 7B • Updated • 22
itlwas/BioMistral-7B-TIES-Q4_K_M-GGUF
Text Generation • 7B • Updated • 24
itlwas/BioMistral-7B-DARE-Q4_K_M-GGUF
Text Generation • 7B • Updated • 13
itlwas/BioMistral-7B-Q4_K_M-GGUF
Text Generation • 7B • Updated • 44 • 1
itlwas/GWQ-9B-Preview2-Q4_K_M-GGUF
Text Generation • 9B • Updated • 15
itlwas/GWQ-9B-Preview-Q4_K_M-GGUF
Text Generation • 9B • Updated • 21
itlwas/LLaMA-2-13b-GTL-Delta-Q4_K_M-GGUF
13B • Updated • 31
itlwas/LLaMA-2-7b-GTL-Delta-Q4_K_M-GGUF
7B • Updated • 29
itlwas/Orca-2-13b-Q4_K_M-GGUF
Text Generation • 13B • Updated • 34
itlwas/Orca-2-7b-Q4_K_M-GGUF
Text Generation • 7B • Updated • 24
itlwas/phi-1_5-Q4_K_M-GGUF
Text Generation • 1B • Updated • 24 • 2
itlwas/phi-1-Q4_K_M-GGUF
Text Generation • 1B • Updated • 42
itlwas/Phi-3-medium-128k-instruct-Q4_K_M-GGUF
Text Generation • 14B • Updated • 23
itlwas/Phi-3-medium-4k-instruct-Q4_K_M-GGUF
Text Generation • 14B • Updated • 43
itlwas/Phi-3-mini-128k-instruct-Q4_K_M-GGUF
Text Generation • 4B • Updated • 22
itlwas/Phi-3-mini-4k-instruct-Q4_K_M-GGUF
Text Generation • 4B • Updated • 17
itlwas/Phi-3.5-mini-instruct-Q4_K_M-GGUF
Text Generation • 4B • Updated • 31
itlwas/phi-4-Q4_K_M-GGUF
Text Generation • 15B • Updated • 103