espetro/kev-4b-mistralrs

Kev-4B for kev-rs (mistral.rs)

Export of jaredpalmer/kev-4b in the layout kev-rs (the Kev server in the espetro/mistral.rs fork) loads directly:

• model/: Qwen/Qwen3.5-4B-Base with the Kev LoRA merged in bf16, as a plain HF checkpoint
• head.safetensors: the Kev pointer head (q, k)
• kev.json: base, head_dim, temperature, dtype, special-token ids

Produced by kev-rs/scripts/export_checkpoint.py --dtype bf16. Parity against the bf16 torch reference (kev-rs parity, smoke-v1 development set): 0/40 argmax flips, max |dp| 0.055. An fp32 export lives on the fp32 branch of this repo.

kev-rs serve --checkpoint espetro/kev-4b-mistralrs --run jaredpalmer/kev-4b
# or quantized in-situ at load:
kev-rs serve --checkpoint espetro/kev-4b-mistralrs --run jaredpalmer/kev-4b --isq 8

Same Apache-2.0 license as the source checkpoint and base model.