Mamba2-1.3B-wd

Checkpoint from the len-gen-regularization length-generalization experiments. Loads with stock transformers:

from transformers import AutoModelForCausalLM, AutoTokenizer

tok = AutoTokenizer.from_pretrained("vapavlo/Mamba2-1.3B-wd")
model = AutoModelForCausalLM.from_pretrained("vapavlo/Mamba2-1.3B-wd")
Downloads last month
6
Safetensors
Model size
1B params
Tensor type
F32
·
BF16
·
Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support