Afolabiwilson

Emeritus-21

·

Wilsonafolabi

AI & ML interests

None yet

Recent Activity

reacted to SeaWolf-AI's post with 🔥 about 23 hours ago

🚀 We pretrained a language model from scratch on an inference-only NPU, with real backpropagation. 🤗 Model: https://huggingface.co/FINAL-Bench/VKORE-46M-NPU 📝 Technical write-up: https://huggingface.co/blog/FINAL-Bench/backpropagation-on-an-inference-only-npu-pretraini "NPUs are inference-only, you can't train on them." We built a counterexample: VKORE-46M-NPU, trained from scratch on a first-gen (2025) inference NPU, 32 chips, no pretrained weights. A 46M decoder-only model (RoPE · SwiGLU · RMSNorm · GQA), char-level, TinyStories. 📏 Why trust it: a falling-loss curve proves nothing. So we trained the same model under identical init, data, and schedule on the NPU and on a GPU reference. · Loss trajectories correlate at 0.99 · Throughput converged to a comparable level The NPU backward pass and optimizer updates do numerically the same work as the GPU, not an approximation that merely trends down. 🧩 One accelerator now covers pretraining · LoRA · inference · quantization. We call this layer VKORE: "CUDA for NPUs." ⚖️ Public: weights, model card, NPU-vs-GPU comparison. Private (patent-pending, paper to follow): the core training technique. 46M char-level is toy scale on purpose: it proves the training path, not model quality. Larger models and real data are next. Feedback from folks working on custom autograd backends and low-precision training kernels on non-GPU accelerators is very welcome. 🙌

liked a model 22 days ago

convaiinnovations/laya

liked a Space about 1 month ago

Emeritus-21/Hand-written-text-recognition-testing

View all activity

Organizations

New activity in Emeritus-21/Book-Recommender_system 7 months ago

About the model

#1 opened 7 months ago by

New activity in MCP-1st-Birthday/Meeting-Orbit 11 months ago

Create mcp_server.py

#1 opened 11 months ago by

New activity in Liontix/Qwen3-8B-Claude-Sonnet-4-Reasoning-Distill-GGUF 11 months ago

Distillation Requests

#1 opened about 1 year ago by

New activity in Emeritus-21/book-dataset over 1 year ago

[bot] Conversion to Parquet

#1 opened over 1 year ago by

parquet-converter

New activity in huggingface/InferenceSupport over 1 year ago

Emeritus-21/yorubanumerals-expertsystem

#2160 opened over 1 year ago by