Marc'Aurelio Ranzato

Publication Activity (10 Years)

Years Active: 2006-2024
Publications (10 Years): 69

Top Venues

CoRR

ICLR (Poster)

CVPR

ICML

Publications

Arthur Douillard, Qixuan Feng, Andrei A. Rusu, Adhiguna Kuncoro, Yani Donchev, Rachita Chhaparia, Ionel Gog, Marc'Aurelio Ranzato, Jiajun Shen, Arthur Szlam
DiPaCo: Distributed Path Composition. CoRR (2024)
Bo Liu, Rachita Chhaparia, Arthur Douillard, Satyen Kale, Andrei A. Rusu, Jiajun Shen, Arthur Szlam, Marc'Aurelio Ranzato
Asynchronous Local-SGD Training for Language Modeling. CoRR (2024)
Adam Fisch, Amal Rannen-Triki, Razvan Pascanu, Jörg Bornschein, Angeliki Lazaridou, Elena Gribovskaya, Marc'Aurelio Ranzato
Towards Robust and Efficient Continual Language Learning. CoRR (2023)
Arthur Douillard, Qixuang Feng, Andrei A. Rusu, Rachita Chhaparia, Yani Donchev, Adhiguna Kuncoro, Marc'Aurelio Ranzato, Arthur Szlam, Jiajun Shen
DiLoCo: Distributed Low-Communication Training of Language Models. CoRR (2023)
Massimo Caccia, Alexandre Galashov, Arthur Douillard, Amal Rannen-Triki, Dushyant Rao, Michela Paganini, Laurent Charlin, Marc'Aurelio Ranzato, Razvan Pascanu
Towards Compute-Optimal Transfer Learning. CoRR (2023)
Lucio M. Dery, Abram L. Friesen, Nando de Freitas, Marc'Aurelio Ranzato, Yutian Chen
Multi-step Planning for Automated Hyperparameter Optimization with OptFormer. CoRR (2022)
Naman Goyal, Cynthia Gao, Vishrav Chaudhary, Peng-Jen Chen, Guillaume Wenzek, Da Ju, Sanjana Krishnan, Marc'Aurelio Ranzato, Francisco Guzmán, Angela Fan
The Flores-101 Evaluation Benchmark for Low-Resource and Multilingual Machine Translation. Trans. Assoc. Comput. Linguistics 10 (2022)
Aidan Clark, Diego de Las Casas, Aurelia Guy, Arthur Mensch, Michela Paganini, Jordan Hoffmann, Bogdan Damoc, Blake A. Hechtman, Trevor Cai, Sebastian Borgeaud, George van den Driessche, Eliza Rutherford, Tom Hennigan, Matthew J. Johnson, Albin Cassirer, Chris Jones, Elena Buchatskaya, David Budden, Laurent Sifre, Simon Osindero, Oriol Vinyals, Marc'Aurelio Ranzato, Jack W. Rae, Erich Elsen, Koray Kavukcuoglu, Karen Simonyan
Unified Scaling Laws for Routed Language Models. ICML (2022)
Jörg Bornschein, Alexandre Galashov, Ross Hemsley, Amal Rannen-Triki, Yutian Chen, Arslan Chaudhry, Xu Owen He, Arthur Douillard, Massimo Caccia, Qixuang Feng, Jiajun Shen, Sylvestre-Alvise Rebuffi, Kitty Stacpoole, Diego de Las Casas, Will Hawkins, Angeliki Lazaridou, Yee Whye Teh, Andrei A. Rusu, Razvan Pascanu, Marc'Aurelio Ranzato
NEVIS'22: A Stream of 100 Tasks Sampled from 30 Years of Computer Vision Research. CoRR (2022)
Lucas Caccia, Jing Xu, Myle Ott, Marc'Aurelio Ranzato, Ludovic Denoyer
On Anytime Learning at Macroscale. CoLLAs (2022)
Yutian Chen, Xingyou Song, Chansoo Lee, Zi Wang, Qiuyi Zhang, David Dohan, Kazuya Kawakami, Greg Kochanski, Arnaud Doucet, Marc'Aurelio Ranzato, Sagi Perel, Nando de Freitas
Towards Learning Universal Hyperparameter Optimizers with Transformers. CoRR (2022)
Yutian Chen, Xingyou Song, Chansoo Lee, Zi Wang, Richard Zhang, David Dohan, Kazuya Kawakami, Greg Kochanski, Arnaud Doucet, Marc'Aurelio Ranzato, Sagi Perel, Nando de Freitas
Towards Learning Universal Hyperparameter Optimizers with Transformers. NeurIPS (2022)
Anton Bakhtin, Yuntian Deng, Sam Gross, Myle Ott, Marc'Aurelio Ranzato, Arthur Szlam
Residual Energy-Based Models for Text. J. Mach. Learn. Res. 22 (2021)
Ann Lee, Michael Auli, Marc'Aurelio Ranzato
Discriminative Reranking for Neural Machine Translation. ACL/IJCNLP (1) (2021)
Tom Veniat, Ludovic Denoyer, Marc'Aurelio Ranzato
Efficient Continual Learning with Modular Networks and Task-Driven Priors. ICLR (2021)
Jiajun Shen, Peng-Jen Chen, Matt Le, Junxian He, Jiatao Gu, Myle Ott, Michael Auli, Marc'Aurelio Ranzato
The Source-Target Domain Mismatch Problem in Machine Translation. EACL (2021)
Lucas Caccia, Jing Xu, Myle Ott, Marc'Aurelio Ranzato, Ludovic Denoyer
On Anytime Learning at Macroscale. CoRR (2021)
Naman Goyal, Cynthia Gao, Vishrav Chaudhary, Peng-Jen Chen, Guillaume Wenzek, Da Ju, Sanjana Krishnan, Marc'Aurelio Ranzato, Francisco Guzmán, Angela Fan
The FLORES-101 Evaluation Benchmark for Low-Resource and Multilingual Machine Translation. CoRR (2021)
Junxian He, Jiatao Gu, Jiajun Shen, Marc'Aurelio Ranzato
Revisiting Self-Training for Neural Sequence Generation. ICLR (2020)
Anton Bakhtin, Yuntian Deng, Sam Gross, Myle Ott, Marc'Aurelio Ranzato, Arthur Szlam
Energy-Based Models for Text. CoRR (2020)
Lajanugen Logeswaran, Ann Lee, Myle Ott, Honglak Lee, Marc'Aurelio Ranzato, Arthur Szlam
Few-shot Sequence Learning with Transformers. CoRR (2020)
Sandeep Subramanian, Ronan Collobert, Marc'Aurelio Ranzato, Y-Lan Boureau
Multi-scale Transformer Language Models. CoRR (2020)
Sergey Edunov, Myle Ott, Marc'Aurelio Ranzato, Michael Auli
On The Evaluation of Machine Translation SystemsTrained With Back-Translation. ACL (2020)
Yuntian Deng, Anton Bakhtin, Myle Ott, Arthur Szlam, Marc'Aurelio Ranzato
Residual Energy-Based Models for Text Generation. ICLR (2020)
Yuntian Deng, Anton Bakhtin, Myle Ott, Arthur Szlam, Marc'Aurelio Ranzato
Residual Energy-Based Models for Text Generation. CoRR (2020)
Tom Veniat, Ludovic Denoyer, Marc'Aurelio Ranzato
Efficient Continual Learning with Modular Networks and Task-Driven Priors. CoRR (2020)
Francisco Guzmán, Peng-Jen Chen, Myle Ott, Juan Miguel Pino, Guillaume Lample, Philipp Koehn, Vishrav Chaudhary, Marc'Aurelio Ranzato
Two New Evaluation Datasets for Low-Resource Machine Translation: Nepali-English and Sinhala-English. CoRR (2019)
Junxian He, Jiatao Gu, Jiajun Shen, Marc'Aurelio Ranzato
Revisiting Self-Training for Neural Sequence Generation. CoRR (2019)
Tianxiao Shen, Myle Ott, Michael Auli, Marc'Aurelio Ranzato
Mixture Models for Diverse Machine Translation: Tricks of the Trade. ICML (2019)
Sergey Edunov, Myle Ott, Marc'Aurelio Ranzato, Michael Auli
On The Evaluation of Machine Translation Systems Trained With Back-Translation. CoRR (2019)
Francisco Guzmán, Peng-Jen Chen, Myle Ott, Juan Miguel Pino, Guillaume Lample, Philipp Koehn, Vishrav Chaudhary, Marc'Aurelio Ranzato
The FLORES Evaluation Datasets for Low-Resource Machine Translation: Nepali-English and Sinhala-English. EMNLP/IJCNLP (1) (2019)
Arslan Chaudhry, Marcus Rohrbach, Mohamed Elhoseiny, Thalaiyasingam Ajanthan, Puneet Kumar Dokania, Philip H. S. Torr, Marc'Aurelio Ranzato
Continual Learning with Tiny Episodic Memories. CoRR (2019)
Senthil Purushwalkam, Maximilian Nickel, Abhinav Gupta, Marc'Aurelio Ranzato
Task-Driven Modular Networks for Zero-Shot Compositional Learning. ICCV (2019)
Anton Bakhtin, Sam Gross, Myle Ott, Yuntian Deng, Marc'Aurelio Ranzato, Arthur Szlam
Real or Fake? Learning to Discriminate Machine from Human Generated Text. CoRR (2019)
Peng-Jen Chen, Jiajun Shen, Matt Le, Vishrav Chaudhary, Ahmed El-Kishky, Guillaume Wenzek, Myle Ott, Marc'Aurelio Ranzato
Facebook AI's WAT19 Myanmar-English Translation Task Submission. CoRR (2019)
Jiajun Shen, Peng-Jen Chen, Matt Le, Junxian He, Jiatao Gu, Myle Ott, Michael Auli, Marc'Aurelio Ranzato
The Source-Target Domain Mismatch Problem in Machine Translation. CoRR (2019)
Senthil Purushwalkam, Maximilian Nickel, Abhinav Gupta, Marc'Aurelio Ranzato
Task-Driven Modular Networks for Zero-Shot Compositional Learning. CoRR (2019)
Peng-Jen Chen, Jiajun Shen, Matt Le, Vishrav Chaudhary, Ahmed El-Kishky, Guillaume Wenzek, Myle Ott, Marc'Aurelio Ranzato
Facebook AI's WAT19 Myanmar-English Translation Task Submission. WAT@EMNLP-IJCNLP (2019)
Arslan Chaudhry, Marc'Aurelio Ranzato, Marcus Rohrbach, Mohamed Elhoseiny
Efficient Lifelong Learning with A-GEM. ICLR (Poster) (2019)
Guillaume Lample, Alexandre Sablayrolles, Marc'Aurelio Ranzato, Ludovic Denoyer, Hervé Jégou
Large Memory Layers with Product Keys. NeurIPS (2019)
Guillaume Lample, Sandeep Subramanian, Eric Michael Smith, Ludovic Denoyer, Marc'Aurelio Ranzato, Y-Lan Boureau
Multiple-Attribute Text Rewriting. ICLR (Poster) (2019)
Tianxiao Shen, Myle Ott, Michael Auli, Marc'Aurelio Ranzato
Mixture Models for Diverse Machine Translation: Tricks of the Trade. CoRR (2019)
Guillaume Lample, Alexandre Sablayrolles, Marc'Aurelio Ranzato, Ludovic Denoyer, Hervé Jégou
Large Memory Layers with Product Keys. CoRR (2019)
Myle Ott, Michael Auli, David Grangier, Marc'Aurelio Ranzato
Analyzing Uncertainty in Neural Machine Translation. ICML (2018)
Sandeep Subramanian, Guillaume Lample, Eric Michael Smith, Ludovic Denoyer, Marc'Aurelio Ranzato, Y-Lan Boureau
Multiple-Attribute Text Style Transfer. CoRR (2018)
Guillaume Lample, Alexis Conneau, Marc'Aurelio Ranzato, Ludovic Denoyer, Hervé Jégou
Word translation without parallel data. ICLR (Poster) (2018)
Myle Ott, Michael Auli, David Grangier, Marc'Aurelio Ranzato
Analyzing Uncertainty in Neural Machine Translation. CoRR (2018)
Guillaume Lample, Myle Ott, Alexis Conneau, Ludovic Denoyer, Marc'Aurelio Ranzato
Phrase-Based & Neural Unsupervised Machine Translation. CoRR (2018)
Arslan Chaudhry, Marc'Aurelio Ranzato, Marcus Rohrbach, Mohamed Elhoseiny
Efficient Lifelong Learning with A-GEM. CoRR (2018)
Guillaume Lample, Alexis Conneau, Ludovic Denoyer, Marc'Aurelio Ranzato
Unsupervised Machine Translation Using Monolingual Corpora Only. ICLR (Poster) (2018)
Guillaume Lample, Myle Ott, Alexis Conneau, Ludovic Denoyer, Marc'Aurelio Ranzato
Phrase-Based & Neural Unsupervised Machine Translation. EMNLP (2018)
Anton Bakhtin, Arthur Szlam, Marc'Aurelio Ranzato, Edouard Grave
Lightweight Adaptive Mixture of Neural and N-gram Language Models. CoRR (2018)
Sergey Edunov, Myle Ott, Michael Auli, David Grangier, Marc'Aurelio Ranzato
Classical Structured Prediction Losses for Sequence to Sequence Learning. NAACL-HLT (2018)
Guillaume Lample, Ludovic Denoyer, Marc'Aurelio Ranzato
Unsupervised Machine Translation Using Monolingual Corpora Only. CoRR (2017)
Jiwei Li, Alexander H. Miller, Sumit Chopra, Marc'Aurelio Ranzato, Jason Weston
Learning through Dialogue Interactions by Asking Questions. ICLR (Poster) (2017)
Sam Gross, Marc'Aurelio Ranzato, Arthur Szlam
Hard Mixtures of Experts for Large Scale Weakly Supervised Vision. CVPR (2017)
Jiwei Li, Alexander H. Miller, Sumit Chopra, Marc'Aurelio Ranzato, Jason Weston
Dialogue Learning With Human-in-the-Loop. ICLR (Poster) (2017)
Sam Gross, Marc'Aurelio Ranzato, Arthur Szlam
Hard Mixtures of Experts for Large Scale Weakly Supervised Vision. CoRR (2017)
David Lopez-Paz, Marc'Aurelio Ranzato
Gradient Episodic Memory for Continuum Learning. CoRR (2017)
Alexis Conneau, Guillaume Lample, Marc'Aurelio Ranzato, Ludovic Denoyer, Hervé Jégou
Word Translation Without Parallel Data. CoRR (2017)
Sam Wiseman, Sumit Chopra, Marc'Aurelio Ranzato, Arthur Szlam, Ruoyu Sun, Soumith Chintala, Nicolas Vasilache
Training Language Models Using Target-Propagation. CoRR (2017)
Guillaume Lample, Neil Zeghidour, Nicolas Usunier, Antoine Bordes, Ludovic Denoyer, Marc'Aurelio Ranzato
Fader Networks: Manipulating Images by Sliding Attributes. NIPS (2017)
Sergey Edunov, Myle Ott, Michael Auli, David Grangier, Marc'Aurelio Ranzato
Classical Structured Prediction Losses for Sequence to Sequence Learning. CoRR (2017)
Guillaume Lample, Neil Zeghidour, Nicolas Usunier, Antoine Bordes, Ludovic Denoyer, Marc'Aurelio Ranzato
Fader Networks: Manipulating Images by Sliding Attributes. CoRR (2017)
Joost R. van Amersfoort, Anitha Kannan, Marc'Aurelio Ranzato, Arthur Szlam, Du Tran, Soumith Chintala
Transformation-Based Models of Video Sequences. CoRR (2017)
David Lopez-Paz, Marc'Aurelio Ranzato
Gradient Episodic Memory for Continual Learning. NIPS (2017)
Marc'Aurelio Ranzato, Sumit Chopra, Michael Auli, Wojciech Zaremba
Sequence Level Training with Recurrent Neural Networks. ICLR (Poster) (2016)
Jiwei Li, Alexander H. Miller, Sumit Chopra, Marc'Aurelio Ranzato, Jason Weston
Learning Through Dialogue Interactions. CoRR (2016)
Jiwei Li, Alexander H. Miller, Sumit Chopra, Marc'Aurelio Ranzato, Jason Weston
Dialogue Learning With Human-In-The-Loop. CoRR (2016)
Soumith Chintala, Marc'Aurelio Ranzato, Arthur Szlam, Yuandong Tian, Mark Tygert, Wojciech Zaremba
Scale-invariant learning and convolutional networks. CoRR (2015)
Grégoire Mesnil, Tomás Mikolov, Marc'Aurelio Ranzato, Yoshua Bengio
Ensemble of Generative and Discriminative Techniques for Sentiment Analysis of Movie Reviews. ICLR (Workshop) (2015)
Marc'Aurelio Ranzato, Geoffrey E. Hinton, Yann LeCun
Guest Editorial: Deep Learning. Int. J. Comput. Vis. 113 (1) (2015)
Yaniv Taigman, Ming Yang, Marc'Aurelio Ranzato, Lior Wolf
Web-scale training for face identification. CVPR (2015)
Tomás Mikolov, Armand Joulin, Sumit Chopra, Michaël Mathieu, Marc'Aurelio Ranzato
Learning Longer Memory in Recurrent Neural Networks. ICLR (Workshop) (2015)
David Eigen, Marc'Aurelio Ranzato, Ilya Sutskever
Learning Factored Representations in a Deep Mixture of Experts. ICLR (Workshop Poster) (2014)
Marc'Aurelio Ranzato
On Learning Where To Look. CoRR (2014)
Ning Zhang, Manohar Paluri, Marc'Aurelio Ranzato, Trevor Darrell, Lubomir D. Bourdev
PANDA: Pose Aligned Networks for Deep Attribute Modeling. CVPR (2014)
Omry Yadan, Keith Adams, Yaniv Taigman, Marc'Aurelio Ranzato
Multi-GPU Training of ConvNets. ICLR (Workshop Poster) (2014)
Yaniv Taigman, Ming Yang, Marc'Aurelio Ranzato, Lior Wolf
DeepFace: Closing the Gap to Human-Level Performance in Face Verification. CVPR (2014)
Marc'Aurelio Ranzato, Arthur Szlam, Joan Bruna, Michaël Mathieu, Ronan Collobert, Sumit Chopra
Video (language) modeling: a baseline for generative models of natural videos. CoRR (2014)
Yaniv Taigman, Ming Yang, Marc'Aurelio Ranzato, Lior Wolf
Web-Scale Training for Face Identification. CoRR (2014)
Georg Heigold, Vincent Vanhoucke, Andrew W. Senior, Patrick Nguyen, Marc'Aurelio Ranzato, Matthieu Devin, Jeffrey Dean
Multilingual acoustic models using distributed deep neural networks. ICASSP (2013)
Marc'Aurelio Ranzato, Volodymyr Mnih, Joshua M. Susskind, Geoffrey E. Hinton
Modeling Natural Images Using Gated MRFs. IEEE Trans. Pattern Anal. Mach. Intell. 35 (9) (2013)
Andrew W. Senior, Georg Heigold, Marc'Aurelio Ranzato, Ke Yang
An empirical study of learning rates in deep neural networks for speech recognition. ICASSP (2013)
Misha Denil, Babak Shakibi, Laurent Dinh, Marc'Aurelio Ranzato, Nando de Freitas
Predicting Parameters in Deep Learning. CoRR (2013)
Andrea Frome, Gregory S. Corrado, Jonathon Shlens, Samy Bengio, Jeffrey Dean, Marc'Aurelio Ranzato, Tomás Mikolov
DeViSE: A Deep Visual-Semantic Embedding Model. NIPS (2013)
Ning Zhang, Manohar Paluri, Marc'Aurelio Ranzato, Trevor Darrell, Lubomir D. Bourdev
PANDA: Pose Aligned Networks for Deep Attribute Modeling. CoRR (2013)
Misha Denil, Babak Shakibi, Laurent Dinh, Marc'Aurelio Ranzato, Nando de Freitas
Predicting Parameters in Deep Learning. NIPS (2013)
Matthew D. Zeiler, Marc'Aurelio Ranzato, Rajat Monga, Mark Z. Mao, K. Yang, Quoc Viet Le, Patrick Nguyen, Andrew W. Senior, Vincent Vanhoucke, Jeffrey Dean, Geoffrey E. Hinton
On rectified linear units for speech processing. ICASSP (2013)
Quoc V. Le, Marc'Aurelio Ranzato, Rajat Monga, Matthieu Devin, Greg Corrado, Kai Chen, Jeffrey Dean, Andrew Y. Ng
Building high-level features using large scale unsupervised learning. ICML (2012)
Jeffrey Dean, Greg Corrado, Rajat Monga, Kai Chen, Matthieu Devin, Quoc V. Le, Mark Z. Mao, Marc'Aurelio Ranzato, Andrew W. Senior, Paul A. Tucker, Ke Yang, Andrew Y. Ng
Large Scale Distributed Deep Networks. NIPS (2012)
Marc'Aurelio Ranzato, Joshua M. Susskind, Volodymyr Mnih, Geoffrey E. Hinton
On deep generative models with applications to recognition. CVPR (2011)
Quoc V. Le, Rajat Monga, Matthieu Devin, Greg Corrado, Kai Chen, Marc'Aurelio Ranzato, Jeffrey Dean, Andrew Y. Ng
Building high-level features using large scale unsupervised learning CoRR (2011)
Kevin Swersky, Marc'Aurelio Ranzato, David Buchman, Benjamin M. Marlin, Nando de Freitas
On Autoencoders and Score Matching for Energy Based Models. ICML (2011)
George E. Dahl, Marc'Aurelio Ranzato, Abdel-rahman Mohamed, Geoffrey E. Hinton
Phone Recognition with the Mean-Covariance Restricted Boltzmann Machine. NIPS (2010)
Marc'Aurelio Ranzato, Volodymyr Mnih, Geoffrey E. Hinton
Generating more realistic images using gated MRF's. NIPS (2010)
Marc'Aurelio Ranzato, Geoffrey E. Hinton
Modeling pixel means and covariances using factorized third-order boltzmann machines. CVPR (2010)
Koray Kavukcuoglu, Marc'Aurelio Ranzato, Yann LeCun
Fast Inference in Sparse Coding Algorithms with Applications to Object Recognition CoRR (2010)
Marc'Aurelio Ranzato, Alex Krizhevsky, Geoffrey E. Hinton
Factored 3-Way Restricted Boltzmann Machines For Modeling Natural Images. AISTATS (2010)
Eva Hörster, Malcolm Slaney, Marc'Aurelio Ranzato, Kilian Q. Weinberger
Unsupervised image ranking. LS-MMRM@ACM Multimedia (2009)

Marc'Aurelio Ranzato.css-eqlu8i{font-size:small;padding-left:4px;}

Publication Activity (10 Years)

Top Topics

Top Venues

Marc'Aurelio Ranzato