Jan Leike

Publication Activity (10 Years)

Years Active: 2013-2024
Publications (10 Years): 49

Top Topics

Asymptotic Optimality

Reinforcement Learning

Reward Function

Top Venues

Publications

Nat McAleese, Rai Michael Pokorny, Juan Felipe Ceron Uribe, Evgenia Nitishinskaya, Maja Trebacz, Jan Leike
LLM Critics Help Catch LLM Bugs. CoRR (2024)
Jan Hendrik Kirchner, Yining Chen, Harri Edwards, Jan Leike, Nat McAleese, Yuri Burda
Prover-Verifier Games improve legibility of LLM outputs. CoRR (2024)
Hunter Lightman, Vineet Kosaraju, Yuri Burda, Harrison Edwards, Bowen Baker, Teddy Lee, Jan Leike, John Schulman, Ilya Sutskever, Karl Cobbe
Let's Verify Step by Step. ICLR (2024)
Leo Gao, Tom Dupré la Tour, Henk Tillman, Gabriel Goh, Rajan Troll, Alec Radford, Ilya Sutskever, Jan Leike, Jeffrey Wu
Scaling and evaluating sparse autoencoders. CoRR (2024)
Hunter Lightman, Vineet Kosaraju, Yura Burda, Harrison Edwards, Bowen Baker, Teddy Lee, Jan Leike, John Schulman, Ilya Sutskever, Karl Cobbe
Let's Verify Step by Step. CoRR (2023)
Collin Burns, Pavel Izmailov, Jan Hendrik Kirchner, Bowen Baker, Leo Gao, Leopold Aschenbrenner, Yining Chen, Adrien Ecoffet, Manas Joglekar, Jan Leike, Ilya Sutskever, Jeff Wu
Weak-to-Strong Generalization: Eliciting Strong Capabilities With Weak Supervision. CoRR (2023)
Long Ouyang, Jeffrey Wu, Xu Jiang, Diogo Almeida, Carroll L. Wainwright, Pamela Mishkin, Chong Zhang, Sandhini Agarwal, Katarina Slama, Alex Ray, John Schulman, Jacob Hilton, Fraser Kelton, Luke Miller, Maddie Simens, Amanda Askell, Peter Welinder, Paul F. Christiano, Jan Leike, Ryan Lowe
Training language models to follow instructions with human feedback. NeurIPS (2022)
William Saunders, Catherine Yeh, Jeff Wu, Steven Bills, Long Ouyang, Jonathan Ward, Jan Leike
Self-critiquing models for assisting human evaluators. CoRR (2022)
Long Ouyang, Jeff Wu, Xu Jiang, Diogo Almeida, Carroll L. Wainwright, Pamela Mishkin, Chong Zhang, Sandhini Agarwal, Katarina Slama, Alex Ray, John Schulman, Jacob Hilton, Fraser Kelton, Luke Miller, Maddie Simens, Amanda Askell, Peter Welinder, Paul F. Christiano, Jan Leike, Ryan Lowe
Training language models to follow instructions with human feedback. CoRR (2022)
Matthew Rahtz, Vikrant Varma, Ramana Kumar, Zachary Kenton, Shane Legg, Jan Leike
Safe Deep RL in 3D Environments using Human Feedback. CoRR (2022)
Mark Chen, Jerry Tworek, Heewoo Jun, Qiming Yuan, Henrique Ponde de Oliveira Pinto, Jared Kaplan, Harrison Edwards, Yuri Burda, Nicholas Joseph, Greg Brockman, Alex Ray, Raul Puri, Gretchen Krueger, Michael Petrov, Heidy Khlaaf, Girish Sastry, Pamela Mishkin, Brooke Chan, Scott Gray, Nick Ryder, Mikhail Pavlov, Alethea Power, Lukasz Kaiser, Mohammad Bavarian, Clemens Winter, Philippe Tillet, Felipe Petroski Such, Dave Cummings, Matthias Plappert, Fotios Chantzis, Elizabeth Barnes, Ariel Herbert-Voss, William Hebgen Guss, Alex Nichol, Alex Paino, Nikolas Tezak, Jie Tang, Igor Babuschkin, Suchir Balaji, Shantanu Jain, William Saunders, Christopher Hesse, Andrew N. Carr, Jan Leike, Joshua Achiam, Vedant Misra, Evan Morikawa, Alec Radford, Matthew Knight, Miles Brundage, Mira Murati, Katie Mayer, Peter Welinder, Bob McGrew, Dario Amodei, Sam McCandlish, Ilya Sutskever, Wojciech Zaremba
Evaluating Large Language Models Trained on Code. CoRR (2021)
Carina E. A. Prunkl, Carolyn Ashurst, Markus Anderljung, Helena Webb, Jan Leike, Allan Dafoe
Institutionalising Ethics in AI through Broader Impact Requirements. CoRR (2021)
Adam Gleave, Michael Dennis, Shane Legg, Stuart Russell, Jan Leike
Quantifying Differences in Reward Functions. ICLR (2021)
Jeff Wu, Long Ouyang, Daniel M. Ziegler, Nisan Stiennon, Ryan Lowe, Jan Leike, Paul F. Christiano
Recursively Summarizing Books with Human Feedback. CoRR (2021)
Carina E. A. Prunkl, Carolyn Ashurst, Markus Anderljung, Helena Webb, Jan Leike, Allan Dafoe
Institutionalizing ethics in AI through broader impact requirements. Nat. Mach. Intell. 3 (2) (2021)
Siddharth Reddy, Anca D. Dragan, Sergey Levine, Shane Legg, Jan Leike
Learning Human Objectives by Evaluating Hypothetical Behavior. ICML (2020)
David Krueger, Tegan Maharaj, Jan Leike
Hidden Incentives for Auto-Induced Distributional Shift. CoRR (2020)
Stuart Armstrong, Jan Leike, Laurent Orseau, Shane Legg
Pitfalls of Learning a Reward Function Online. IJCAI (2020)
David Krueger, Jan Leike, Owain Evans, John Salvatier
Active Reinforcement Learning: Observing Rewards at a Cost. CoRR (2020)
Stuart Armstrong, Jan Leike, Laurent Orseau, Shane Legg
Pitfalls of learning a reward function online. CoRR (2020)
Adam Gleave, Michael Dennis, Shane Legg, Stuart Russell, Jan Leike
Quantifying Differences in Reward Functions. CoRR (2020)
Siddharth Reddy, Anca D. Dragan, Sergey Levine, Shane Legg, Jan Leike
Learning Human Objectives by Evaluating Hypothetical Behavior. CoRR (2019)
Dzmitry Bahdanau, Felix Hill, Jan Leike, Edward Hughes, Seyed Arian Hosseini, Pushmeet Kohli, Edward Grefenstette
Learning to Understand Goal Specifications by Modelling Reward. ICLR (Poster) (2019)
Borja Ibarz, Jan Leike, Tobias Pohlen, Geoffrey Irving, Shane Legg, Dario Amodei
Reward learning from human preferences and demonstrations in Atari. CoRR (2018)
Miljan Martic, Jan Leike, Andrew Trask, Matteo Hessel, Shane Legg, Pushmeet Kohli
Scaling shared model governance via model splitting. CoRR (2018)
Jan Leike, Marcus Hutter
On the computability of Solomonoff induction and AIXI. Theor. Comput. Sci. 716 (2018)
Dzmitry Bahdanau, Felix Hill, Jan Leike, Edward Hughes, Pushmeet Kohli, Edward Grefenstette
Learning to Follow Language Instructions with Adversarial Reward Induction. CoRR (2018)
Dzmitry Bahdanau, Felix Hill, Jan Leike, Edward Hughes, Pushmeet Kohli, Edward Grefenstette
Jointly Learning "What" and "How" from Instructions and Goal-States. ICLR (Workshop) (2018)
Jan Leike, David Krueger, Tom Everitt, Miljan Martic, Vishal Maini, Shane Legg
Scalable agent alignment via reward modeling: a research direction. CoRR (2018)
Jan Leike, Matthias Heizmann
Geometric Nontermination Arguments. TACAS (2) (2018)
Borja Ibarz, Jan Leike, Tobias Pohlen, Geoffrey Irving, Shane Legg, Dario Amodei
Reward learning from human preferences and demonstrations in Atari. NeurIPS (2018)
Sean Lamont, John Aslanides, Jan Leike, Marcus Hutter
Generalised Discount Functions applied to a Monte-Carlo AI u Implementation. AAMAS (2017)
Jan Leike, Tor Lattimore, Laurent Orseau, Marcus Hutter
On Thompson Sampling and Asymptotic Optimality. IJCAI (2017)
Sean Lamont, John Aslanides, Jan Leike, Marcus Hutter
Generalised Discount Functions applied to a Monte-Carlo AImu Implementation. CoRR (2017)
Paul F. Christiano, Jan Leike, Tom B. Brown, Miljan Martic, Shane Legg, Dario Amodei
Deep Reinforcement Learning from Human Preferences. NIPS (2017)
Jan Leike, Miljan Martic, Victoria Krakovna, Pedro A. Ortega, Tom Everitt, Andrew Lefrancq, Laurent Orseau, Shane Legg
AI Safety Gridworlds. CoRR (2017)
John Aslanides, Jan Leike, Marcus Hutter
Universal Reinforcement Learning Algorithms: Survey and Experiments. IJCAI (2017)
Paul F. Christiano, Jan Leike, Tom B. Brown, Miljan Martic, Shane Legg, Dario Amodei
Deep reinforcement learning from human preferences. CoRR (2017)
John Aslanides, Jan Leike, Marcus Hutter
Universal Reinforcement Learning Algorithms: Survey and Experiments. CoRR (2017)
Jan Leike, Jessica Taylor, Benya Fallenstein
A Formal Solution to the Grain of Truth Problem. CoRR (2016)
Jan Leike, Matthias Heizmann
Geometric Nontermination Arguments. CoRR (2016)
Daniel Filan, Jan Leike, Marcus Hutter
Loss Bounds and Time Complexity for Speed Priors. AISTATS (2016)
Jan Leike
Nonparametric General Reinforcement Learning. CoRR (2016)
Matthias Heizmann, Daniel Dietsch, Marius Greitschus, Jan Leike, Betim Musa, Claus Schätzle, Andreas Podelski
Ultimate Automizer with Two-track Proofs - (Competition Contribution). TACAS (2016)
Jan Leike, Tor Lattimore, Laurent Orseau, Marcus Hutter
Thompson Sampling is Asymptotically Optimal in General Environments. UAI (2016)
Daniel Filan, Marcus Hutter, Jan Leike
Loss Bounds and Time Complexity for Speed Priors. CoRR (2016)
Jan Leike
Exploration Potential. CoRR (2016)
Jan Leike, Tor Lattimore, Laurent Orseau, Marcus Hutter
Thompson Sampling is Asymptotically Optimal in General Environments. CoRR (2016)
Jan Leike, Jessica Taylor, Benya Fallenstein
A Formal Solution to the Grain of Truth Problem. UAI (2016)
Jan Leike, Matthias Heizmann
Ranking Templates for Linear Loops. Log. Methods Comput. Sci. 11 (1) (2015)
Jan Leike, Marcus Hutter
On the Computability of AIXI. CoRR (2015)
Jan Leike, Marcus Hutter
Bad Universal Priors and Notions of Optimality. CoRR (2015)
Jan Leike, Marcus Hutter
Bad Universal Priors and Notions of Optimality. COLT (2015)
Jan Leike, Marcus Hutter
Solomonoff Induction Violates Nicod's Criterion. CoRR (2015)
Matthias Heizmann, Daniel Dietsch, Jan Leike, Betim Musa, Andreas Podelski
Ultimate Automizer with Array Interpolation - (Competition Contribution). TACAS (2015)
Mayank Daswani, Jan Leike
A Definition of Happiness for Reinforcement Learning Agents. CoRR (2015)
Jan Leike, Marcus Hutter
On the Computability of Solomonoff Induction and Knowledge-Seeking. ALT (2015)
Jan Leike, Marcus Hutter
On the Computability of AIXI. UAI (2015)
Tom Everitt, Jan Leike, Marcus Hutter
Sequential Extensions of Causal and Evidential Decision Theory. CoRR (2015)
Jan Leike, Marcus Hutter
Solomonoff Induction Violates Nicod's Criterion. ALT (2015)
Jan Leike, Marcus Hutter
On the Computability of Solomonoff Induction and Knowledge-Seeking. CoRR (2015)
Tom Everitt, Jan Leike, Marcus Hutter
Sequential Extensions of Causal and Evidential Decision Theory. ADT (2015)
Mayank Daswani, Jan Leike
A Definition of Happiness for Reinforcement Learning Agents. AGI (2015)
Jan Leike, Matthias Heizmann
Ranking Templates for Linear Loops. TACAS (2014)
Jan Leike, Marcus Hutter
Indefinitely Oscillating Martingales. ALT (2014)
Matthias Heizmann, Jochen Hoenicke, Jan Leike, Andreas Podelski
Linear Ranking for Linear Lasso Programs. CoRR (2014)
Jan Leike
Ranking Function Synthesis for Linear Lasso Programs. CoRR (2014)
Jan Leike, Matthias Heizmann
Geometric Series as Nontermination Arguments for Linear Lasso Programs. CoRR (2014)
Jan Leike, Ashish Tiwari
Synthesis for Polynomial Lasso Programs. VMCAI (2014)
Jan Leike, Matthias Heizmann
Ranking Templates for Linear Loops. CoRR (2014)
Jan Leike, Marcus Hutter
Indefinitely Oscillating Martingales. CoRR (2014)
Jan Leike, Ashish Tiwari
Synthesis for Polynomial Lasso Programs. CoRR (2013)
Matthias Heizmann, Jochen Hoenicke, Jan Leike, Andreas Podelski
Linear Ranking for Linear Lasso Programs. ATVA (2013)