Samy Bengio

Publication Activity (10 Years)

Years Active: 1987-2024
Publications (10 Years): 108

Top Venues

CoRR

NeurIPS

ICLR

ICML

Publications

Emmanuel Abbe, Samy Bengio, Aryo Lotfi, Colin Sandon, Omid Saremi
How Far Can Transformers Reason? The Locality Barrier and Inductive Scratchpad. CoRR (2024)
Hattie Zhou, Arwen Bradley, Etai Littwin, Noam Razin, Omid Saremi, Joshua M. Susskind, Samy Bengio, Preetum Nakkiran
What Algorithms can Transformers Learn? A Study in Length Generalization. ICLR (2024)
Enric Boix-Adserà, Omid Saremi, Emmanuel Abbe, Samy Bengio, Etai Littwin, Joshua M. Susskind
When can transformers reason with abstract symbols? ICLR (2024)
Dan Berrebbi, Ronan Collobert, Samy Bengio, Navdeep Jaitly, Tatiana Likhomanenko
Continuous pseudo-labeling from the start. ICLR (2023)
Stéphane d'Ascoli, Samy Bengio, Josh M. Susskind, Emmanuel Abbe
Boolformer: Symbolic Regression of Logic Functions with Transformers. CoRR (2023)
Emmanuel Abbe, Samy Bengio, Aryo Lotfi, Kevin Rizk
Generalization on the Unseen, Logic Reasoning and Degree Curriculum. CoRR (2023)
Emmanuel Abbe, Samy Bengio, Aryo Lotfi, Kevin Rizk
Generalization on the Unseen, Logic Reasoning and Degree Curriculum. ICML (2023)
Enric Boix-Adserà, Omid Saremi, Emmanuel Abbe, Samy Bengio, Etai Littwin, Joshua M. Susskind
When can transformers reason with abstract symbols? CoRR (2023)
Enric Boix-Adserà, Etai Littwin, Emmanuel Abbe, Samy Bengio, Joshua M. Susskind
Transformers learn through gradual rank increase. CoRR (2023)
Emmanuel Abbe, Samy Bengio, Enric Boix-Adserà, Etai Littwin, Joshua M. Susskind
Transformers learn through gradual rank increase. NeurIPS (2023)
Hattie Zhou, Arwen Bradley, Etai Littwin, Noam Razin, Omid Saremi, Josh M. Susskind, Samy Bengio, Preetum Nakkiran
What Algorithms can Transformers Learn? A Study in Length Generalization. CoRR (2023)
Samira Abnar, Omid Saremi, Laurent Dinh, Shantel Wilson, Miguel Ángel Bautista, Chen Huang, Vimal Thilak, Etai Littwin, Jiatao Gu, Josh M. Susskind, Samy Bengio
Adaptivity and Modularity for Efficient Generalization Over Task Complexity. CoRR (2023)
Emmanuel Abbe, Samy Bengio, Elisabetta Cornacchia, Jon M. Kleinberg, Aryo Lotfi, Maithra Raghu, Chiyuan Zhang
Learning to Reason with Neural Networks: Generalization, Unseen Data and Boolean Measures. CoRR (2022)
Chiyuan Zhang, Samy Bengio, Yoram Singer
Are All Layers Created Equal? J. Mach. Learn. Res. 23 (2022)
Tatiana Likhomanenko, Ronan Collobert, Navdeep Jaitly, Samy Bengio
Continuous Soft Pseudo-Labeling in ASR. CoRR (2022)
Emmanuel Abbe, Samy Bengio, Elisabetta Cornacchia, Jon M. Kleinberg, Aryo Lotfi, Maithra Raghu, Chiyuan Zhang
Learning to Reason with Neural Networks: Generalization, Unseen Data and Boolean Measures. NeurIPS (2022)
Tatiana Likhomanenko, Ronan Collobert, Navdeep Jaitly, Samy Bengio
Continuous Soft Pseudo-Labeling in ASR. ICBINB (2022)
Dan Berrebbi, Ronan Collobert, Samy Bengio, Navdeep Jaitly, Tatiana Likhomanenko
Continuous Pseudo-Labeling from the Start. CoRR (2022)
Michael L. Iuzzolino, Michael C. Mozer, Samy Bengio
Training cascaded networks for speeded decisions using a temporal-difference loss. CoRR (2021)
Chiyuan Zhang, Maithra Raghu, Jon M. Kleinberg, Samy Bengio
Pointer Value Retrieval: A new benchmark for understanding the limits of neural network generalization. CoRR (2021)
Michael L. Iuzzolino, Michael C. Mozer, Samy Bengio
Improving Anytime Prediction with Parallel Cascaded Networks and a Temporal-Difference Loss. NeurIPS (2021)
Chiyuan Zhang, Samy Bengio, Moritz Hardt, Benjamin Recht, Oriol Vinyals
Understanding deep learning (still) requires rethinking generalization. Commun. ACM 64 (3) (2021)
Yang Li, Si Si, Gang Li, Cho-Jui Hsieh, Samy Bengio
Learnable Fourier Features for Multi-Dimensional Spatial Positional Encoding. CoRR (2021)
Yang Li, Si Si, Gang Li, Cho-Jui Hsieh, Samy Bengio
Learnable Fourier Features for Multi-dimensional Spatial Positional Encoding. NeurIPS (2021)
Yiding Jiang, Parth Natekar, Manik Sharma, Sumukh K. Aithal, Dhruva Kashyap, Natarajan Subramanyam, Carlos Lassance, Daniel M. Roy, Gintare Karolina Dziugaite, Suriya Gunasekar, Isabelle Guyon, Pierre Foret, Scott Yak, Hossein Mobahi, Behnam Neyshabur, Samy Bengio
Methods and Analysis of The First Competition in Predicting Generalization of Deep Learning. NeurIPS (Competition and Demos) (2020)
Yiding Jiang, Behnam Neyshabur, Hossein Mobahi, Dilip Krishnan, Samy Bengio
Fantastic Generalization Measures and Where to Find Them. ICLR (2020)
Yiding Jiang, Pierre Foret, Scott Yak, Daniel M. Roy, Hossein Mobahi, Gintare Karolina Dziugaite, Samy Bengio, Suriya Gunasekar, Isabelle Guyon, Behnam Neyshabur
NeurIPS 2020 Competition: Predicting Generalization in Deep Learning. CoRR (2020)
Yijie Guo, Jongwook Choi, Marcin Moczulski, Shengyu Feng, Samy Bengio, Mohammad Norouzi, Honglak Lee
Memory Based Trajectory-conditioned Policies for Learning from Sparse Rewards. NeurIPS (2020)
Chiyuan Zhang, Samy Bengio, Moritz Hardt, Michael C. Mozer, Yoram Singer
Identity Crisis: Memorization and Generalization Under Extreme Overparameterization. ICLR (2020)
Aniruddh Raghu, Maithra Raghu, Samy Bengio, Oriol Vinyals
Rapid Learning or Feature Reuse? Towards Understanding the Effectiveness of MAML. ICLR (2020)
Yang Li, Julien Amelot, Xin Zhou, Samy Bengio, Si Si
Auto Completion of User Interface Layout Design Using Transformer-Based Tree Decoders. CoRR (2020)
Calvin Luo, Hossein Mobahi, Samy Bengio
Data Augmentation via Structured Adversarial Perturbations. CoRR (2020)
Sara Hooker, Nyalleng Moorosi, Gregory Clark, Samy Bengio, Emily Denton
Characterising Bias in Compressed Models. CoRR (2020)
Jan Chorowski, Ron J. Weiss, Samy Bengio, Aäron van den Oord
Unsupervised speech representation learning using WaveNet autoencoders. CoRR (2019)
Chiyuan Zhang, Samy Bengio, Yoram Singer
Are All Layers Created Equal? CoRR (2019)
Wei-Lin Chiang, Xuanqing Liu, Si Si, Yang Li, Samy Bengio, Cho-Jui Hsieh
Cluster-GCN: An Efficient Algorithm for Training Deep and Large Graph Convolutional Networks. CoRR (2019)
Yiding Jiang, Dilip Krishnan, Hossein Mobahi, Samy Bengio
Predicting the Generalization Gap in Deep Networks with Margin Distributions. ICLR (Poster) (2019)
Chiyuan Zhang, Samy Bengio, Moritz Hardt, Yoram Singer
Identity Crisis: Memorization and Generalization under Extreme Overparameterization. CoRR (2019)
Yiding Jiang, Behnam Neyshabur, Hossein Mobahi, Dilip Krishnan, Samy Bengio
Fantastic Generalization Measures and Where to Find Them. CoRR (2019)
Vighnesh Birodkar, Hossein Mobahi, Samy Bengio
Semantic Redundancies in Image-Classification Datasets: The 10% You Don't Need. CoRR (2019)
Daniel Duckworth, Arvind Neelakantan, Ben Goodrich, Lukasz Kaiser, Samy Bengio
Parallel Scheduled Sampling. CoRR (2019)
Zhourong Chen, Yang Li, Samy Bengio, Si Si
You Look Twice: GaterNet for Dynamic Filter Selection in CNNs. CVPR (2019)
Aniruddh Raghu, Maithra Raghu, Samy Bengio, Oriol Vinyals
Rapid Learning or Feature Reuse? Towards Understanding the Effectiveness of MAML. CoRR (2019)
Been Kim, Emily Reif, Martin Wattenberg, Samy Bengio
Do Neural Networks Show Gestalt Phenomena? An Exploration of the Law of Closure. CoRR (2019)
Yang Li, Lukasz Kaiser, Samy Bengio, Si Si
Area Attention. ICML (2019)
Yijie Guo, Jongwook Choi, Marcin Moczulski, Samy Bengio, Mohammad Norouzi, Honglak Lee
Efficient Exploration with Self-Imitation Learning via Trajectory-Conditioned Policy. CoRR (2019)
Maithra Raghu, Chiyuan Zhang, Jon M. Kleinberg, Samy Bengio
Transfusion: Understanding Transfer Learning with Applications to Medical Imaging. CoRR (2019)
Maithra Raghu, Chiyuan Zhang, Jon M. Kleinberg, Samy Bengio
Transfusion: Understanding Transfer Learning for Medical Imaging. NeurIPS (2019)
Wei-Lin Chiang, Xuanqing Liu, Si Si, Yang Li, Samy Bengio, Cho-Jui Hsieh
Cluster-GCN: An Efficient Algorithm for Training Deep and Large Graph Convolutional Networks. KDD (2019)
Vighnesh Birodkar, Hossein Mobahi, Dilip Krishnan, Samy Bengio
A Closed-Form Learned Pooling for Deep Classification Networks. CoRR (2019)
Jan Chorowski, Ron J. Weiss, Samy Bengio, Aäron van den Oord
Unsupervised Speech Representation Learning Using WaveNet Autoencoders. IEEE ACM Trans. Audio Speech Lang. Process. 27 (12) (2019)
Samy Bengio, Krzysztof Dembczynski, Thorsten Joachims, Marius Kloft, Manik Varma
Extreme Classification (Dagstuhl Seminar 18291). Dagstuhl Reports 8 (7) (2018)
Ari S. Morcos, Maithra Raghu, Samy Bengio
Insights on representational similarity in neural networks with canonical correlation. NeurIPS (2018)
Yang Li, Samy Bengio, Gilles Bailly
Predicting Human Performance in Vertical Menu Selection Using Deep Learning. CoRR (2018)
Jan Chorowski, Ron J. Weiss, Rif A. Saurous, Samy Bengio
On Using Backpropagation for Speech Texture Generation and Voice Conversion. ICASSP (2018)
Lukasz Kaiser, Aurko Roy, Ashish Vaswani, Niki Parmar, Samy Bengio, Jakob Uszkoreit, Noam Shazeer
Fast Decoding in Sequence Models using Discrete Latent Variables. CoRR (2018)
Gamaleldin F. Elsayed, Dilip Krishnan, Hossein Mobahi, Kevin Regan, Samy Bengio
Large Margin Deep Networks for Classification. NeurIPS (2018)
Lukasz Kaiser, Samy Bengio
Discrete Autoencoders for Sequence Models. CoRR (2018)
Lajanugen Logeswaran, Honglak Lee, Samy Bengio
Content preserving text generation with attribute controls. NeurIPS (2018)
Yang Li, Lukasz Kaiser, Samy Bengio, Si Si
Area Attention. CoRR (2018)
Ari S. Morcos, Maithra Raghu, Samy Bengio
Insights on representational similarity in neural networks with canonical correlation. CoRR (2018)
Gamaleldin F. Elsayed, Dilip Krishnan, Hossein Mobahi, Kevin Regan, Samy Bengio
Large Margin Deep Networks for Classification. CoRR (2018)
Lukasz Kaiser, Samy Bengio, Aurko Roy, Ashish Vaswani, Niki Parmar, Jakob Uszkoreit, Noam Shazeer
Fast Decoding in Sequence Models Using Discrete Latent Variables. ICML (2018)
Chiyuan Zhang, Oriol Vinyals, Rémi Munos, Samy Bengio
A Study on Overfitting in Deep Reinforcement Learning. CoRR (2018)
Ashish Vaswani, Samy Bengio, Eugene Brevdo, François Chollet, Aidan N. Gomez, Stephan Gouws, Llion Jones, Lukasz Kaiser, Nal Kalchbrenner, Niki Parmar, Ryan Sepassi, Noam Shazeer, Jakob Uszkoreit
Tensor2Tensor for Neural Machine Translation. CoRR (2018)
Zhourong Chen, Yang Li, Samy Bengio, Si Si
GaterNet: Dynamic Filter Selection in Convolutional Neural Network via a Dedicated Global Gating Network. CoRR (2018)
Lajanugen Logeswaran, Honglak Lee, Samy Bengio
Content preserving text generation with attribute controls. CoRR (2018)
Alexey Kurakin, Ian J. Goodfellow, Samy Bengio, Yinpeng Dong, Fangzhou Liao, Ming Liang, Tianyu Pang, Jun Zhu, Xiaolin Hu, Cihang Xie, Jianyu Wang, Zhishuai Zhang, Zhou Ren, Alan L. Yuille, Sangxia Huang, Yao Zhao, Yuzhe Zhao, Zhonglin Han, Junjiajia Long, Yerkebulan Berdibekov, Takuya Akiba, Seiya Tokui, Motoki Abe
Adversarial Attacks and Defences Competition. CoRR (2018)
Yiding Jiang, Dilip Krishnan, Hossein Mobahi, Samy Bengio
Predicting the Generalization Gap in Deep Networks with Margin Distributions. CoRR (2018)
Yang Li, Samy Bengio, Gilles Bailly
Predicting Human Performance in Vertical Menu Selection Using Deep Learning. CHI (2018)
Yang Li, Nan Du, Samy Bengio
Time-Dependent Representation for Neural Event Sequence Prediction. ICLR (Workshop) (2018)
Ashish Vaswani, Samy Bengio, Eugene Brevdo, François Chollet, Aidan N. Gomez, Stephan Gouws, Llion Jones, Lukasz Kaiser, Nal Kalchbrenner, Niki Parmar, Ryan Sepassi, Noam Shazeer, Jakob Uszkoreit
Tensor2Tensor for Neural Machine Translation. AMTA (1) (2018)
Yuxuan Wang, R. J. Skerry-Ryan, Daisy Stanton, Yonghui Wu, Ron J. Weiss, Navdeep Jaitly, Zongheng Yang, Ying Xiao, Zhifeng Chen, Samy Bengio, Quoc V. Le, Yannis Agiomyrgiannakis, Rob Clark, Rif A. Saurous
Tacotron: A Fully End-to-End Text-To-Speech Synthesis Model. CoRR (2017)
Ramakrishna Vedantam, Samy Bengio, Kevin Murphy, Devi Parikh, Gal Chechik
Context-Aware Captions from Context-Agnostic Supervision. CVPR (2017)
Jan Chorowski, Ron J. Weiss, Rif A. Saurous, Samy Bengio
On Using Backpropagation for Speech Texture Generation and Voice Conversion. CoRR (2017)
Laurent Dinh, Razvan Pascanu, Samy Bengio, Yoshua Bengio
Sharp Minima Can Generalize For Deep Nets. CoRR (2017)
Laurent Dinh, Jascha Sohl-Dickstein, Samy Bengio
Density estimation using Real NVP. ICLR (Poster) (2017)
Oriol Vinyals, Alexander Toshev, Samy Bengio, Dumitru Erhan
Show and Tell: Lessons Learned from the 2015 MSCOCO Image Captioning Challenge. IEEE Trans. Pattern Anal. Mach. Intell. 39 (4) (2017)
Alexey Kurakin, Ian J. Goodfellow, Samy Bengio
Adversarial Machine Learning at Scale. ICLR (Poster) (2017)
Azalia Mirhoseini, Hieu Pham, Quoc V. Le, Benoit Steiner, Rasmus Larsen, Yuefeng Zhou, Naveen Kumar, Mohammad Norouzi, Samy Bengio, Jeff Dean
Device Placement Optimization with Reinforcement Learning. CoRR (2017)
Yuxuan Wang, R. J. Skerry-Ryan, Daisy Stanton, Yonghui Wu, Ron J. Weiss, Navdeep Jaitly, Zongheng Yang, Ying Xiao, Zhifeng Chen, Samy Bengio, Quoc V. Le, Yannis Agiomyrgiannakis, Rob Clark, Rif A. Saurous
Tacotron: Towards End-to-End Speech Synthesis. INTERSPEECH (2017)
Chiyuan Zhang, Samy Bengio, Moritz Hardt, Benjamin Recht, Oriol Vinyals
Understanding deep learning requires rethinking generalization. ICLR (2017)
Laurent Dinh, Razvan Pascanu, Samy Bengio, Yoshua Bengio
Sharp Minima Can Generalize For Deep Nets. ICML (2017)
Azalia Mirhoseini, Hieu Pham, Quoc V. Le, Benoit Steiner, Rasmus Larsen, Yuefeng Zhou, Naveen Kumar, Mohammad Norouzi, Samy Bengio, Jeff Dean
Device Placement Optimization with Reinforcement Learning. ICML (2017)
Irwan Bello, Hieu Pham, Quoc V. Le, Mohammad Norouzi, Samy Bengio
Neural Combinatorial Optimization with Reinforcement Learning. ICLR (Workshop) (2017)
Ramakrishna Vedantam, Samy Bengio, Kevin Murphy, Devi Parikh, Gal Chechik
Context-aware Captions from Context-agnostic Supervision. CoRR (2017)
Yang Li, Nan Du, Samy Bengio
Time-Dependent Representation for Neural Event Sequence Prediction. CoRR (2017)
Lukasz Kaiser, Ofir Nachum, Aurko Roy, Samy Bengio
Learning to Remember Rare Events. CoRR (2017)
Alexey Kurakin, Ian J. Goodfellow, Samy Bengio
Adversarial examples in the physical world. ICLR (Workshop) (2017)
Ciprian Chelba, Mohammad Norouzi, Samy Bengio
N-gram Language Modeling using Recurrent Neural Network Estimation. CoRR (2017)
Lukasz Kaiser, Ofir Nachum, Aurko Roy, Samy Bengio
Learning to Remember Rare Events. ICLR (Poster) (2017)
Alexey Kurakin, Ian J. Goodfellow, Samy Bengio
Adversarial examples in the physical world. CoRR (2016)
Joonseok Lee, Seungyeon Kim, Guy Lebanon, Yoram Singer, Samy Bengio
LLORMA: Local Low-Rank Matrix Approximation. J. Mach. Learn. Res. 17 (2016)
Jianmin Chen, Rajat Monga, Samy Bengio, Rafal Józefowicz
Revisiting Distributed Synchronous SGD. CoRR (2016)
Georg Heigold, Ignacio Moreno, Samy Bengio, Noam Shazeer
End-to-end text-dependent speaker verification. ICASSP (2016)
Navdeep Jaitly, Quoc V. Le, Oriol Vinyals, Ilya Sutskever, David Sussillo, Samy Bengio
An Online Sequence-to-Sequence Model Using Partial Conditioning. NIPS (2016)
Irwan Bello, Hieu Pham, Quoc V. Le, Mohammad Norouzi, Samy Bengio
Neural Combinatorial Optimization with Reinforcement Learning. CoRR (2016)
Lukasz Kaiser, Samy Bengio
Can Active Memory Replace Attention? NIPS (2016)
Mohammad Norouzi, Samy Bengio, Zhifeng Chen, Navdeep Jaitly, Mike Schuster, Yonghui Wu, Dale Schuurmans
Reward Augmented Maximum Likelihood for Neural Structured Prediction. CoRR (2016)
Alexey Kurakin, Ian J. Goodfellow, Samy Bengio
Adversarial Machine Learning at Scale. CoRR (2016)

Samy Bengio.css-eqlu8i{font-size:small;padding-left:4px;}

Publication Activity (10 Years)

Top Topics

Top Venues

Samy Bengio