NVIDIA to Release Training Data Covering 22 Indian Languages and About 2.8 Trillion Tokens With IIT Madras and AI4Bharat
NVIDIA, IIT Madras, and AI4Bharat have announced plans to release around 2.8 trillion tokens of training data for 22 Indian languages, along with the generation pipeline. The release stands out not only for its data volume, but also for opening up the process from translation and quality evaluation to correction.
