Beyond Human Data: Scaling Self-Training for Problem-Solving with Language Models.

Avi Singh John D. Co-Reyes Rishabh Agarwal Ankesh Anand Piyush Patil Xavier Garcia Peter J. Liu James Harrison Jaehoon Lee Kelvin Xu Aaron Parisi Abhishek Kumar Alex Alemi Alex Rizkowsky Azade Nova Ben Adlam Bernd Bohnet Gamaleldin F. Elsayed Hanie Sedghi Igor Mordatch Isabelle Simpson Izzeddin Gur Jasper Snoek Jeffrey Pennington Jiri Hron Kathleen Kenealy Kevin Swersky Kshiteej Mahajan Laura Culp Lechao Xiao Maxwell L. Bileschi Noah Constant Roman Novak Rosanne Liu Tris Warkentin Yundi Qian Yamini Bansal Ethan Dyer Behnam Neyshabur Jascha Sohl-Dickstein Noah Fiedel

Published in: CoRR (2023)

Keyphrases

language model
probabilistic model
language modeling
xml documents
data points
document retrieval
retrieval model
training data
bayesian networks
knowledge discovery
labeled data
test collection