BidirLM-270M-Base / tokenizer.json

Fix tokenizer adding a duplicate BOS on transformers 5.x

afaec98 verified 4 months ago

16 MB

This file is stored with Xet . It is too big to display, but you can still download it.

Xet efficiently stores Large Files inside Git, intelligently splitting files into unique chunks and accelerating uploads and downloads. More info.