Simon Osindero

Publication Activity (10 Years)

Years Active: 2002-2024
Publications (10 Years): 67

Top Topics

Sparse Approximation

Reinforcement Learning

Top Venues

Publications

Piotr Mirowski, David Warde-Farley, Mihaela Rosca, Matthew Koichi Grimes, Yana Hasson, Hyunjik Kim, Mélanie Rey, Simon Osindero, Suman V. Ravuri, Shakir Mohamed
Neural Compression of Atmospheric States. CoRR (2024)
Jake Bruce, Michael Dennis, Ashley Edwards, Jack Parker-Holder, Yuge Shi, Edward Hughes, Matthew Lai, Aditi Mavalankar, Richie Steigerwald, Chris Apps, Yusuf Aytar, Sarah Bechtle, Feryal M. P. Behbahani, Stephanie C. Y. Chan, Nicolas Heess, Lucy Gonzalez, Simon Osindero, Sherjil Ozair, Scott E. Reed, Jingwei Zhang, Konrad Zolna, Jeff Clune, Nando de Freitas, Satinder Singh, Tim Rocktäschel
Genie: Generative Interactive Environments. CoRR (2024)
Chrisantha Fernando, Dylan Banarse, Henryk Michalewski, Simon Osindero, Tim Rocktäschel
Promptbreeder: Self-Referential Self-Improvement Via Prompt Evolution. CoRR (2023)
Viorica Patraucean, Lucas Smaira, Ankush Gupta, Adrià Recasens Continente, Larisa Markeeva, Dylan Banarse, Skanda Koppula, Joseph Heyward, Mateusz Malinowski, Yi Yang, Carl Doersch, Tatiana Matejovicova, Yury Sulsky, Antoine Miech, Alex Frechette, Hanna Klimczak, Raphael Koster, Junlin Zhang, Stephanie Winkler, Yusuf Aytar, Simon Osindero, Dima Damen, Andrew Zisserman, João Carreira
Perception Test: A Diagnostic Benchmark for Multimodal Video Models. CoRR (2023)
Viorica Patraucean, Lucas Smaira, Ankush Gupta, Adrià Recasens, Larisa Markeeva, Dylan Banarse, Skanda Koppula, Joseph Heyward, Mateusz Malinowski, Yi Yang, Carl Doersch, Tatiana Matejovicova, Yury Sulsky, Antoine Miech, Alexandre Fréchette, Hanna Klimczak, Raphael Koster, Junlin Zhang, Stephanie Winkler, Yusuf Aytar, Simon Osindero, Dima Damen, Andrew Zisserman, João Carreira
Perception Test: A Diagnostic Benchmark for Multimodal Video Models. NeurIPS (2023)
Alexander Sasha Vezhnevets, John P. Agapiou, Avia Aharon, Ron Ziv, Jayd Matyas, Edgar A. Duéñez-Guzmán, William A. Cunningham, Simon Osindero, Danny Karmon, Joel Z. Leibo
Generative agent-based modeling with actions grounded in physical, social, or digital space using Concordia. CoRR (2023)
David Warde-Farley, Vinod Nair, Yujia Li, Ivan Lobov, Felix Gimeno, Simon Osindero
Solving MaxSAT with Matrix Multiplication. CoRR (2023)
Anirudh Goyal, Abram L. Friesen, Andrea Banino, Theophane Weber, Nan Rosemary Ke, Adrià Puigdomènech Badia, Arthur Guez, Mehdi Mirza, Peter C. Humphreys, Ksenia Konyushkova, Michal Valko, Simon Osindero, Timothy P. Lillicrap, Nicolas Heess, Charles Blundell
Retrieval-Augmented Reinforcement Learning. ICML (2022)
Sebastian Borgeaud, Arthur Mensch, Jordan Hoffmann, Trevor Cai, Eliza Rutherford, Katie Millican, George van den Driessche, Jean-Baptiste Lespiau, Bogdan Damoc, Aidan Clark, Diego de Las Casas, Aurelia Guy, Jacob Menick, Roman Ring, Tom Hennigan, Saffron Huang, Loren Maggiore, Chris Jones, Albin Cassirer, Andy Brock, Michela Paganini, Geoffrey Irving, Oriol Vinyals, Simon Osindero, Karen Simonyan, Jack W. Rae, Erich Elsen, Laurent Sifre
Improving Language Models by Retrieving from Trillions of Tokens. ICML (2022)
Jordan Hoffmann, Sebastian Borgeaud, Arthur Mensch, Elena Buchatskaya, Trevor Cai, Eliza Rutherford, Diego de Las Casas, Lisa Anne Hendricks, Johannes Welbl, Aidan Clark, Tom Hennigan, Eric Noland, Katie Millican, George van den Driessche, Bogdan Damoc, Aurelia Guy, Simon Osindero, Karen Simonyan, Erich Elsen, Jack W. Rae, Oriol Vinyals, Laurent Sifre
Training Compute-Optimal Large Language Models. CoRR (2022)
Piotr Mirowski, Dylan Banarse, Mateusz Malinowski, Simon Osindero, Chrisantha Fernando
CLIP-CLOP: CLIP-Guided Collage and Photomontage. ICCC (2022)
Aidan Clark, Diego de Las Casas, Aurelia Guy, Arthur Mensch, Michela Paganini, Jordan Hoffmann, Bogdan Damoc, Blake A. Hechtman, Trevor Cai, Sebastian Borgeaud, George van den Driessche, Eliza Rutherford, Tom Hennigan, Matthew Johnson, Katie Millican, Albin Cassirer, Chris Jones, Elena Buchatskaya, David Budden, Laurent Sifre, Simon Osindero, Oriol Vinyals, Jack W. Rae, Erich Elsen, Koray Kavukcuoglu, Karen Simonyan
Unified Scaling Laws for Routed Language Models. CoRR (2022)
Angelos Filos, Eszter Vértes, Zita Marinho, Gregory Farquhar, Diana Borsa, Abram L. Friesen, Feryal Behbahani, Tom Schaul, André Barreto, Simon Osindero
Model-Value Inconsistency as a Signal for Epistemic Uncertainty. ICML (2022)
Aidan Clark, Diego de Las Casas, Aurelia Guy, Arthur Mensch, Michela Paganini, Jordan Hoffmann, Bogdan Damoc, Blake A. Hechtman, Trevor Cai, Sebastian Borgeaud, George van den Driessche, Eliza Rutherford, Tom Hennigan, Matthew J. Johnson, Albin Cassirer, Chris Jones, Elena Buchatskaya, David Budden, Laurent Sifre, Simon Osindero, Oriol Vinyals, Marc'Aurelio Ranzato, Jack W. Rae, Erich Elsen, Koray Kavukcuoglu, Karen Simonyan
Unified Scaling Laws for Routed Language Models. ICML (2022)
Anirudh Goyal, Abram L. Friesen, Andrea Banino, Theophane Weber, Nan Rosemary Ke, Adrià Puigdomènech Badia, Arthur Guez, Mehdi Mirza, Ksenia Konyushkova, Michal Valko, Simon Osindero, Timothy P. Lillicrap, Nicolas Heess, Charles Blundell
Retrieval-Augmented Reinforcement Learning. CoRR (2022)
Piotr Mirowski, Dylan Banarse, Mateusz Malinowski, Simon Osindero, Chrisantha Fernando
CLIP-CLOP: CLIP-Guided Collage and Photomontage. CoRR (2022)
Jordan Hoffmann, Sebastian Borgeaud, Arthur Mensch, Elena Buchatskaya, Trevor Cai, Eliza Rutherford, Diego de Las Casas, Lisa Anne Hendricks, Johannes Welbl, Aidan Clark, Tom Hennigan, Eric Noland, Katherine Millican, George van den Driessche, Bogdan Damoc, Aurelia Guy, Simon Osindero, Karen Simonyan, Erich Elsen, Oriol Vinyals, Jack W. Rae, Laurent Sifre
An empirical analysis of compute-optimal large language model training. NeurIPS (2022)
Chrisantha Fernando, S. M. Ali Eslami, Jean-Baptiste Alayrac, Piotr Mirowski, Dylan Banarse, Simon Osindero
Generative Art Using Neural Visual Grammars and Dual Encoders. CoRR (2021)
Jacob Menick, Erich Elsen, Utku Evci, Simon Osindero, Karen Simonyan, Alex Graves
Practical Real Time Recurrent Learning with a Sparse Approximation. ICLR (2021)
Jack W. Rae, Sebastian Borgeaud, Trevor Cai, Katie Millican, Jordan Hoffmann, H. Francis Song, John Aslanides, Sarah Henderson, Roman Ring, Susannah Young, Eliza Rutherford, Tom Hennigan, Jacob Menick, Albin Cassirer, Richard Powell, George van den Driessche, Lisa Anne Hendricks, Maribeth Rauh, Po-Sen Huang, Amelia Glaese, Johannes Welbl, Sumanth Dathathri, Saffron Huang, Jonathan Uesato, John Mellor, Irina Higgins, Antonia Creswell, Nat McAleese, Amy Wu, Erich Elsen, Siddhant M. Jayakumar, Elena Buchatskaya, David Budden, Esme Sutherland, Karen Simonyan, Michela Paganini, Laurent Sifre, Lena Martens, Xiang Lorraine Li, Adhiguna Kuncoro, Aida Nematzadeh, Elena Gribovskaya, Domenic Donato, Angeliki Lazaridou, Arthur Mensch, Jean-Baptiste Lespiau, Maria Tsimpoukelli, Nikolai Grigorev, Doug Fritz, Thibault Sottiaux, Mantas Pajarskas, Toby Pohlen, Zhitao Gong, Daniel Toyama, Cyprien de Masson d'Autume, Yujia Li, Tayfun Terzi, Vladimir Mikulik, Igor Babuschkin, Aidan Clark, Diego de Las Casas, Aurelia Guy, Chris Jones, James Bradbury, Matthew Johnson, Blake A. Hechtman, Laura Weidinger, Iason Gabriel, William S. Isaac, Edward Lockhart, Simon Osindero, Laura Rimell, Chris Dyer, Oriol Vinyals, Kareem Ayoub, Jeff Stanway, Lorrayne Bennett, Demis Hassabis, Koray Kavukcuoglu, Geoffrey Irving
Scaling Language Models: Methods, Analysis & Insights from Training Gopher. CoRR (2021)
Siddhant M. Jayakumar, Razvan Pascanu, Jack W. Rae, Simon Osindero, Erich Elsen
Top-KAST: Top-K Always Sparse Training. CoRR (2021)
Angelos Filos, Eszter Vértes, Zita Marinho, Gregory Farquhar, Diana Borsa, Abram L. Friesen, Feryal Behbahani, Tom Schaul, André Barreto, Simon Osindero
Model-Value Inconsistency as a Signal for Epistemic Uncertainty. CoRR (2021)
Steven Hansen, Guillaume Desjardins, Kate Baumli, David Warde-Farley, Nicolas Heess, Simon Osindero, Volodymyr Mnih
Entropic Desired Dynamics for Intrinsic Control. NeurIPS (2021)
Sebastian Borgeaud, Arthur Mensch, Jordan Hoffmann, Trevor Cai, Eliza Rutherford, Katie Millican, George van den Driessche, Jean-Baptiste Lespiau, Bogdan Damoc, Aidan Clark, Diego de Las Casas, Aurelia Guy, Jacob Menick, Roman Ring, Tom Hennigan, Saffron Huang, Loren Maggiore, Chris Jones, Albin Cassirer, Andy Brock, Michela Paganini, Geoffrey Irving, Oriol Vinyals, Simon Osindero, Karen Simonyan, Jack W. Rae, Erich Elsen, Laurent Sifre
Improving language models by retrieving from trillions of tokens. CoRR (2021)
Jacob Menick, Erich Elsen, Utku Evci, Simon Osindero, Karen Simonyan, Alex Graves
A Practical Sparse Approximation for Real Time Recurrent Learning. CoRR (2020)
Siddhant M. Jayakumar, Razvan Pascanu, Jack W. Rae, Simon Osindero, Erich Elsen
Top-KAST: Top-K Always Sparse Training. NeurIPS (2020)
Jörg Bornschein, Francesco Visin, Simon Osindero
Small Data, Big Decisions: Model Selection in the Small-Data Regime. CoRR (2020)
Jordan Hoffmann, Simon Schmitt, Simon Osindero, Karen Simonyan, Erich Elsen
AlgebraNets. CoRR (2020)
Chrisantha Fernando, Daria Zenkova, Stanislav Nikolov, Simon Osindero
From Language Games to Drawing Games. CoRR (2020)
Jörg Bornschein, Francesco Visin, Simon Osindero
Small Data, Big Decisions: Model Selection in the Small-Data Regime. ICML (2020)
Sergey Bartunov, Jack W. Rae, Simon Osindero, Timothy P. Lillicrap
Meta-Learning Deep Energy-Based Memory Models. ICLR (2020)
Simon Osindero
Contrastive Topographic Models: Energy-based density models applied to the understanding of sensory coding and cortical topography. CoRR (2020)
Siddhant M. Jayakumar, Wojciech M. Czarnecki, Jacob Menick, Jonathan Schwarz, Jack W. Rae, Simon Osindero, Yee Whye Teh, Tim Harley, Razvan Pascanu
Multiplicative Interactions and Where to Find Them. ICLR (2020)
Wojciech M. Czarnecki, Razvan Pascanu, Simon Osindero, Siddhant M. Jayakumar, Grzegorz Swirszcz, Max Jaderberg
Distilling Policy Distillation. AISTATS (2019)
Tom Schaul, Diana Borsa, David Ding, David Szepesvari, Georg Ostrovski, Will Dabney, Simon Osindero
Adapting Behaviour for Learning Progress. CoRR (2019)
Andrei A. Rusu, Dushyant Rao, Jakub Sygnowski, Oriol Vinyals, Razvan Pascanu, Simon Osindero, Raia Hadsell
Meta-Learning with Latent Embedding Optimization. ICLR (Poster) (2019)
Sergey Bartunov, Jack W. Rae, Simon Osindero, Timothy P. Lillicrap
Meta-Learning Deep Energy-Based Memory Models. CoRR (2019)
Wojciech Marian Czarnecki, Simon Osindero, Razvan Pascanu, Max Jaderberg
A Deep Neural Network's Loss Surface Contains Every Low-dimensional Pattern. CoRR (2019)
Pedro A. Ortega, Jane X. Wang, Mark Rowland, Tim Genewein, Zeb Kurth-Nelson, Razvan Pascanu, Nicolas Heess, Joel Veness, Alexander Pritzel, Pablo Sprechmann, Siddhant M. Jayakumar, Tom McGrath, Kevin J. Miller, Mohammad Gheshlaghi Azar, Ian Osband, Neil C. Rabinowitz, András György, Silvia Chiappa, Simon Osindero, Yee Whye Teh, Hado van Hasselt, Nando de Freitas, Matthew Botvinick, Shane Legg
Meta-learning of Sequential Strategies. CoRR (2019)
Wojciech Marian Czarnecki, Razvan Pascanu, Simon Osindero, Siddhant M. Jayakumar, Grzegorz Swirszcz, Max Jaderberg
Distilling Policy Distillation. CoRR (2019)
Simon Schmitt, Jonathan J. Hudson, Augustin Zídek, Simon Osindero, Carl Doersch, Wojciech M. Czarnecki, Joel Z. Leibo, Heinrich Küttler, Andrew Zisserman, Karen Simonyan, S. M. Ali Eslami
Kickstarting Deep Reinforcement Learning. CoRR (2018)
João Carreira, Viorica Patraucean, Laurent Mazaré, Andrew Zisserman, Simon Osindero
Massively Parallel Video Networks. ECCV (4) (2018)
Chrisantha Thomas Fernando, Jakub Sygnowski, Simon Osindero, Jane Wang, Tom Schaul, Denis Teplyashin, Pablo Sprechmann, Alexander Pritzel, Andrei A. Rusu
Meta-Learning by the Baldwin Effect. CoRR (2018)
Wojciech Marian Czarnecki, Siddhant M. Jayakumar, Max Jaderberg, Leonard Hasenclever, Yee Whye Teh, Nicolas Heess, Simon Osindero, Razvan Pascanu
Mix & Match Agent Curricula for Reinforcement Learning. ICML (2018)
Chrisantha Fernando, Jakub Sygnowski, Simon Osindero, Jane Wang, Tom Schaul, Denis Teplyashin, Pablo Sprechmann, Alexander Pritzel, Andrei A. Rusu
Meta-learning by the baldwin effect. GECCO (Companion) (2018)
Andrei A. Rusu, Dushyant Rao, Jakub Sygnowski, Oriol Vinyals, Razvan Pascanu, Simon Osindero, Raia Hadsell
Meta-Learning with Latent Embedding Optimization. CoRR (2018)
Chrisantha Fernando, Jakub Sygnowski, Simon Osindero, Jane Wang, Tom Schaul, Denis Teplyashin, Pablo Sprechmann, Alexander Pritzel, Andrei A. Rusu
Meta-learning by the Baldwin effect. GECCO (Companion) (2018)
Wojciech Marian Czarnecki, Siddhant M. Jayakumar, Max Jaderberg, Leonard Hasenclever, Yee Whye Teh, Simon Osindero, Nicolas Heess, Razvan Pascanu
Mix&Match - Agent Curricula for Reinforcement Learning. CoRR (2018)
João Carreira, Viorica Patraucean, Laurent Mazaré, Andrew Zisserman, Simon Osindero
Massively Parallel Video Networks. CoRR (2018)
Max Jaderberg, Wojciech Marian Czarnecki, Simon Osindero, Oriol Vinyals, Alex Graves, David Silver, Koray Kavukcuoglu
Decoupled Neural Interfaces using Synthetic Gradients. ICML (2017)
Wojciech Marian Czarnecki, Grzegorz Swirszcz, Max Jaderberg, Simon Osindero, Oriol Vinyals, Koray Kavukcuoglu
Understanding Synthetic Gradients and Decoupled Neural Interfaces. CoRR (2017)
Alexander Sasha Vezhnevets, Simon Osindero, Tom Schaul, Nicolas Heess, Max Jaderberg, David Silver, Koray Kavukcuoglu
FeUdal Networks for Hierarchical Reinforcement Learning. ICML (2017)
Wojciech Marian Czarnecki, Simon Osindero, Max Jaderberg, Grzegorz Swirszcz, Razvan Pascanu
Sobolev Training for Neural Networks. CoRR (2017)
Luca Maria Aiello, Rossano Schifanella, Miriam Redi, Stacey Svetlichnaya, Frank Liu, Simon Osindero
Beautiful and Damned. Combined Effect of Content Quality and Social Ties on User Engagement. IEEE Trans. Knowl. Data Eng. 29 (12) (2017)
Luca Maria Aiello, Rossano Schifanella, Miriam Redi, Stacey Svetlichnaya, Frank Liu, Simon Osindero
Beautiful and damned. Combined effect of content quality and social ties on user engagement. CoRR (2017)
Max Jaderberg, Valentin Dalibard, Simon Osindero, Wojciech M. Czarnecki, Jeff Donahue, Ali Razavi, Oriol Vinyals, Tim Green, Iain Dunning, Karen Simonyan, Chrisantha Fernando, Koray Kavukcuoglu
Population Based Training of Neural Networks. CoRR (2017)
Wojciech M. Czarnecki, Simon Osindero, Max Jaderberg, Grzegorz Swirszcz, Razvan Pascanu
Sobolev Training for Neural Networks. NIPS (2017)
Alexander Sasha Vezhnevets, Simon Osindero, Tom Schaul, Nicolas Heess, Max Jaderberg, David Silver, Koray Kavukcuoglu
FeUdal Networks for Hierarchical Reinforcement Learning. CoRR (2017)
Wojciech Marian Czarnecki, Grzegorz Swirszcz, Max Jaderberg, Simon Osindero, Oriol Vinyals, Koray Kavukcuoglu
Understanding Synthetic Gradients and Decoupled Neural Interfaces. ICML (2017)
Alexander Vezhnevets, Volodymyr Mnih, Simon Osindero, Alex Graves, Oriol Vinyals, John P. Agapiou, Koray Kavukcuoglu
Strategic Attentive Writer for Learning Macro-Actions. NIPS (2016)
Yannis Kalantidis, Clayton Mellina, Simon Osindero
Cross-Dimensional Weighting for Aggregated Deep Convolutional Features. ECCV Workshops (1) (2016)
Max Jaderberg, Wojciech Marian Czarnecki, Simon Osindero, Oriol Vinyals, Alex Graves, Koray Kavukcuoglu
Decoupled Neural Interfaces using Synthetic Gradients. CoRR (2016)
Alexander Vezhnevets, Volodymyr Mnih, John P. Agapiou, Simon Osindero, Alex Graves, Oriol Vinyals, Koray Kavukcuoglu
Strategic Attentive Writer for Learning Macro-Actions. CoRR (2016)
Miriam Redi, Damon Crockett, Lev Manovich, Simon Osindero
What Makes Photo Cultures Different? ACM Multimedia (2016)
Chen-Yu Lee, Simon Osindero
Recursive Recurrent Nets with Attention Modeling for OCR in the Wild. CoRR (2016)
Chen-Yu Lee, Simon Osindero
Recursive Recurrent Nets with Attention Modeling for OCR in the Wild. CVPR (2016)
Yannis Kalantidis, Clayton Mellina, Simon Osindero
Cross-dimensional Weighting for Aggregated Deep Convolutional Features. CoRR (2015)
Mehdi Mirza, Simon Osindero
Conditional Generative Adversarial Nets. CoRR (2014)
Simon Osindero, Geoffrey E. Hinton
Modeling image patches with a directed hierarchy of Markov random fields. NIPS (2007)
Simon Osindero, Max Welling, Geoffrey E. Hinton
Topographic Product Models Applied to Natural Scene Statistics. Neural Comput. 18 (2) (2006)
Geoffrey E. Hinton, Simon Osindero, Yee Whye Teh
A Fast Learning Algorithm for Deep Belief Nets. Neural Comput. 18 (7) (2006)
Geoffrey E. Hinton, Simon Osindero, Max Welling, Yee Whye Teh
Unsupervised Discovery of Nonlinear Structure Using Contrastive Backpropagation. Cogn. Sci. 30 (4) (2006)
David A. Ross, Simon Osindero, Richard S. Zemel
Combining discriminative features to infer complex trajectories. ICML (2006)
Geoffrey E. Hinton, Simon Osindero, Kejie Bao
Learning Causally Linked Markov Random Fields. AISTATS (2005)
Edward Meeds, Simon Osindero
An Alternative Infinite Mixture Of Gaussian Process Experts. NIPS (2005)
Yee Whye Teh, Max Welling, Simon Osindero, Geoffrey E. Hinton
Energy-Based Models for Sparse Overcomplete Representations. J. Mach. Learn. Res. 4 (2003)
Max Welling, Geoffrey E. Hinton, Simon Osindero
Learning Sparse Topographic Representations with Products of Student-t Distributions. NIPS (2002)