Article
Scaling Indic Pretraining: 2.8 Trillion Tokens and an Open Data Generation Pipeline
nvidia
• • 50
Markus Kliegl
mkliegl-nv
AI & ML interests
None yet
Recent Activity
liked a dataset about 4 hours ago
nvidia/Nemotron-Pretraining-Indic-Specialized-v1 updated a collection about 4 hours ago
Nemotron-Pre-Training-Datasets liked a dataset about 4 hours ago
nvidia/Nemotron-Pretraining-Indic-CC-v1Organizations
published an article 14 days ago
published an article 5 months ago
Article
Task-Seeded Synthetic Q&A Generation for Nemotron Pretraining
nvidia
• • 18 published an article about 1 year ago
Article
NVIDIA Releases Improved Pretraining Dataset: Preserves High Value Math & Code, and Augments with Multi-Lingual
nvidia
• • 6