Hugging Face
Models
Datasets
Spaces
Community
Docs
Enterprise
Pricing
Log In
Sign Up
ubergarm
/
DeepSeek-V3-0324-GGUF
like
34
Text Generation
GGUF
mla
imatrix
deepseek_v3
conversational
ik_llama.cpp
License:
mit
Model card
Files
Files and versions
xet
Community
7
Deploy
Use this model
main
DeepSeek-V3-0324-GGUF
798 GB
1 contributor
History:
16 commits
ubergarm
Note ik_llama.cpp can run your existing GGUFs
7c08a2c
8 months ago
DeepSeek-V3-0324-IQ1_S_R4
Upload folder using huggingface_hub
9 months ago
DeepSeek-V3-0324-IQ2_K_R4
Add DeepSeek-V3-0324-IQ2_K_R4
11 months ago
DeepSeek-V3-0324-IQ4_K_R4
Release DeepSeek-V3-0324-IQ4_K_R4 and benchmarks
11 months ago
images
update README and add vram usage image
11 months ago
.gitattributes
Safe
1.67 kB
Add DeepSeek-V3-0324-IQ2_K_R4
11 months ago
DeepSeek-V3-0324.imatrix
Safe
987 MB
xet
Add initial test imatrix data
11 months ago
README.md
49.9 kB
Note ik_llama.cpp can run your existing GGUFs
8 months ago
