This is an mlx-OptiQ conversion of EldritchLabs/MN-Crimson-Cafe-12B.

This is an RP/Writing model. See the original model card for the details.

Downloads last month
16
Safetensors
Model size
12B params
Tensor type
U32
·
BF16
·
MLX
Hardware compatibility
Log In to add your hardware

4-bit

Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support

Model tree for jaithree/MN-Crimson-Cafe-12B-OptiQ-4bit

Quantized
(3)
this model