Telecharger Cours

QuRating: Selecting High-Quality Data for Training Language Models

Abstract. Selecting high-quality pre-training data is important for creating capable language models, but existing methods rely on simple heuristics.



Download