Ari S. Morcos

Publication Activity (10 Years)

Years Active: 2018-2024
Publications (10 Years): 58

Top Topics

Effective Pruning

Top Venues

Publications

Amro Abbas, Evgenia Rusak, Kushal Tirumala, Wieland Brendel, Kamalika Chaudhuri, Ari S. Morcos
Effective pruning of web-scale datasets based on complexity of concept clusters. CoRR (2024)
Florian Bordes, Shashank Shekhar, Mark Ibrahim, Diane Bouchacourt, Pascal Vincent, Ari S. Morcos
PUG: Photorealistic and Semantically Controllable Synthetic Data for Representation Learning. CoRR (2023)
Mitchell Wortsman, Suchin Gururangan, Shen Li, Ali Farhadi, Ludwig Schmidt, Michael G. Rabbat, Ari S. Morcos
lo-fi: distributed fine-tuning without communication. Trans. Mach. Learn. Res. 2023 (2023)
Kushal Tirumala, Daniel Simig, Armen Aghajanyan, Ari S. Morcos
D4: Improving LLM Pretraining via Document De-Duplication and Diversification. CoRR (2023)
Erik Wijmans, Manolis Savva, Irfan Essa, Stefan Lee, Ari S. Morcos, Dhruv Batra
Emergence of Maps in the Memories of Blind Navigation Agents. CoRR (2023)
Omkar Ranadive, Nikhil Thakurdesai, Ari S. Morcos, Matthew L. Leavitt, Stéphane Deny
On the special role of class-selective neurons in early training. CoRR (2023)
Erik Wijmans, Manolis Savva, Irfan Essa, Stefan Lee, Ari S. Morcos, Dhruv Batra
Emergence of Maps in the Memories of Blind Navigation Agents. ICLR (2023)
Yu Yang, Aaditya K. Singh, Mostafa Elhoushi, Anas Mahmoud, Kushal Tirumala, Fabian Gloeckle, Baptiste Rozière, Carole-Jean Wu, Ari S. Morcos, Newsha Ardalani
Decoding Data Quality via Synthetic Corruptions: Embedding-guided Pruning of Code Data. CoRR (2023)
Erik Wijmans, Manolis Savva, Irfan Essa, Stefan Lee, Ari S. Morcos, Dhruv Batra
Emergence of Maps in the Memories of Blind Navigation Agents. AI Matters 9 (2) (2023)
Amro Abbas, Kushal Tirumala, Daniel Simig, Surya Ganguli, Ari S. Morcos
SemDeDup: Data-efficient learning at web-scale through semantic deduplication. CoRR (2023)
Mitchell Wortsman, Gabriel Ilharco, Samir Ya Gadre, Rebecca Roelofs, Raphael Gontijo Lopes, Ari S. Morcos, Hongseok Namkoong, Ali Farhadi, Yair Carmon, Simon Kornblith, Ludwig Schmidt
Model soups: averaging weights of multiple fine-tuned models improves accuracy without increasing inference time. ICML (2022)
Ben Sorscher, Robert Geirhos, Shashank Shekhar, Surya Ganguli, Ari S. Morcos
Beyond neural scaling laws: beating power law scaling via data pruning. CoRR (2022)
Sirui Xie, Ari S. Morcos, Song-Chun Zhu, Ramakrishna Vedantam
COAT: Measuring Object Compositionality in Emergent Representations. ICML (2022)
Mitchell Wortsman, Gabriel Ilharco, Samir Yitzhak Gadre, Rebecca Roelofs, Raphael Gontijo Lopes, Ari S. Morcos, Hongseok Namkoong, Ali Farhadi, Yair Carmon, Simon Kornblith, Ludwig Schmidt
Model soups: averaging weights of multiple fine-tuned models improves accuracy without increasing inference time. CoRR (2022)
Mitchell Wortsman, Suchin Gururangan, Shen Li, Ali Farhadi, Ludwig Schmidt, Michael G. Rabbat, Ari S. Morcos
lo-fi: distributed fine-tuning without communication. CoRR (2022)
Mark Ibrahim, Diane Bouchacourt, Ari S. Morcos
Robust Self-Supervised Learning with Lie Groups. CoRR (2022)
Ting-Wu Chin, Ari S. Morcos, Diana Marculescu
Joslim: Joint Widths and Weights Optimization for Slimmable Neural Networks. ECML/PKDD (3) (2021)
Jose Javier Gonzalez Ortiz, Jonathan Frankle, Mike Rabbat, Ari S. Morcos, Nicolas Ballas
Trade-offs of Local SGD at Scale: An Empirical Study. CoRR (2021)
Stéphane d'Ascoli, Hugo Touvron, Matthew L. Leavitt, Ari S. Morcos, Giulio Biroli, Levent Sagun
ConViT: Improving Vision Transformers with Soft Convolutional Inductive Biases. ICML (2021)
Ting-Wu Chin, Diana Marculescu, Ari S. Morcos
Width Transfer: On the (In)variance of Width Optimization. CoRR (2021)
Chaitanya K. Ryali, David J. Schwab, Ari S. Morcos
Leveraging background augmentations to encourage semantic focus in self-supervised contrastive learning. CoRR (2021)
Stéphane d'Ascoli, Hugo Touvron, Matthew L. Leavitt, Ari S. Morcos, Giulio Biroli, Levent Sagun
ConViT: Improving Vision Transformers with Soft Convolutional Inductive Biases. CoRR (2021)
Diane Bouchacourt, Mark Ibrahim, Ari S. Morcos
Grounding inductive biases in natural images: invariance stems from variations in data. CoRR (2021)
Jonathan Frankle, David J. Schwab, Ari S. Morcos
Training BatchNorm and Only BatchNorm: On the Expressive Power of Random Features in CNNs. ICLR (2021)
Matthew L. Leavitt, Ari S. Morcos
Selectivity considered harmful: evaluating the causal impact of class selectivity in DNNs. ICLR (2021)
Diane Bouchacourt, Mark Ibrahim, Ari S. Morcos
Grounding inductive biases in natural images: invariance stems from variations in data. NeurIPS (2021)
Ting-Wu Chin, Diana Marculescu, Ari S. Morcos
Width Transfer: On the (In)variance of Width Optimization. CVPR Workshops (2021)
Sheng Shen, Alexei Baevski, Ari S. Morcos, Kurt Keutzer, Michael Auli, Douwe Kiela
Reservoir Transformers. ACL/IJCNLP (1) (2021)
Ge Yang, Amy Zhang, Ari S. Morcos, Joelle Pineau, Pieter Abbeel, Roberto Calandra
Plan2Vec: Unsupervised Representation Learning by Latent Plans. CoRR (2020)
Haonan Yu, Sergey Edunov, Yuandong Tian, Ari S. Morcos
Playing the lottery with rewards and multiple languages: lottery tickets in RL and NLP. ICLR (2020)
Ting-Wu Chin, Ari S. Morcos, Diana Marculescu
PareCO: Pareto-aware Channel Optimization for Slimmable Neural Networks. CoRR (2020)
Matthew L. Leavitt, Ari S. Morcos
Towards falsifiable interpretability research. CoRR (2020)
Jonathan Frankle, David J. Schwab, Ari S. Morcos
Training BatchNorm and Only BatchNorm: On the Expressive Power of Random Features in CNNs. CoRR (2020)
Brian Bartoldson, Ari S. Morcos, Adrian Barbu, Gordon Erlebacher
The Generalization-Stability Tradeoff In Neural Network Pruning. NeurIPS (2020)
Matthew L. Leavitt, Ari S. Morcos
Selectivity considered harmful: evaluating the causal impact of class selectivity in DNNs. CoRR (2020)
Matthew L. Leavitt, Ari S. Morcos
Linking average- and worst-case perturbation robustness via class selectivity and dimensionality. CoRR (2020)
Sheng Shen, Alexei Baevski, Ari S. Morcos, Kurt Keutzer, Michael Auli, Douwe Kiela
Reservoir Transformer. CoRR (2020)
Matthew L. Leavitt, Ari S. Morcos
On the relationship between class selectivity, dimensionality, and robustness. CoRR (2020)
Ge Yang, Amy Zhang, Ari S. Morcos, Joelle Pineau, Pieter Abbeel, Roberto Calandra
Plan2Vec: Unsupervised Representation Learning by Latent Plans. L4DC (2020)
Jonathan Frankle, David J. Schwab, Ari S. Morcos
The Early Phase of Neural Network Training. ICLR (2020)
Jonathan Frankle, David J. Schwab, Ari S. Morcos
The Early Phase of Neural Network Training. CoRR (2020)
Tiffany Tianhui Cai, Jonathan Frankle, David J. Schwab, Ari S. Morcos
Are all negatives created equal in contrastive instance discrimination? CoRR (2020)
Ari S. Morcos, Haonan Yu, Michela Paganini, Yuandong Tian
One ticket to win them all: generalizing lottery ticket initializations across datasets and optimizers. CoRR (2019)
Felix Hill, Adam Santoro, David G. T. Barrett, Ari S. Morcos, Timothy P. Lillicrap
Learning to Make Analogies by Contrasting Abstract Relational Structure. CoRR (2019)
Yuandong Tian, Tina Jiang, Qucheng Gong, Ari S. Morcos
Luck Matters: Understanding Training Dynamics of Deep ReLU Networks. CoRR (2019)
Haonan Yu, Sergey Edunov, Yuandong Tian, Ari S. Morcos
Playing the lottery with rewards and multiple languages: lottery tickets in RL and NLP. CoRR (2019)
Felix Hill, Adam Santoro, David G. T. Barrett, Ari S. Morcos, Timothy P. Lillicrap
Learning to Make Analogies by Contrasting Abstract Relational Structure. ICLR (Poster) (2019)
Brian R. Bartoldson, Ari S. Morcos, Adrian Barbu, Gordon Erlebacher
The Generalization-Stability Tradeoff in Neural Network Pruning. CoRR (2019)
Ari S. Morcos, Haonan Yu, Michela Paganini, Yuandong Tian
One ticket to win them all: generalizing lottery ticket initializations across datasets and optimizers. NeurIPS (2019)
Ari S. Morcos, Maithra Raghu, Samy Bengio
Insights on representational similarity in neural networks with canonical correlation. NeurIPS (2018)
David G. T. Barrett, Ari S. Morcos, Jakob H. Macke
Analyzing biological and artificial neural networks: challenges with opportunities for synergy? CoRR (2018)
Adam Santoro, Felix Hill, David G. T. Barrett, Ari S. Morcos, Timothy P. Lillicrap
Measuring abstract reasoning in neural networks. ICML (2018)
Ari S. Morcos, Maithra Raghu, Samy Bengio
Insights on representational similarity in neural networks with canonical correlation. CoRR (2018)
Ari S. Morcos, David G. T. Barrett, Neil C. Rabinowitz, Matthew Botvinick
On the importance of single directions for generalization. ICLR (Poster) (2018)
Avraham Ruderman, Neil C. Rabinowitz, Ari S. Morcos, Daniel Zoran
Learned Deformation Stability in Convolutional Neural Networks. CoRR (2018)
Ari S. Morcos, David G. T. Barrett, Neil C. Rabinowitz, Matthew Botvinick
On the importance of single directions for generalization. CoRR (2018)
David G. T. Barrett, Felix Hill, Adam Santoro, Ari S. Morcos, Timothy P. Lillicrap
Measuring abstract reasoning in neural networks. CoRR (2018)
Max Jaderberg, Wojciech M. Czarnecki, Iain Dunning, Luke Marris, Guy Lever, Antonio García Castañeda, Charles Beattie, Neil C. Rabinowitz, Ari S. Morcos, Avraham Ruderman, Nicolas Sonnerat, Tim Green, Louise Deason, Joel Z. Leibo, David Silver, Demis Hassabis, Koray Kavukcuoglu, Thore Graepel
Human-level performance in first-person multiplayer games with population-based deep reinforcement learning. CoRR (2018)