Ashish Vaswani

Publication Activity (10 Years)

Years Active: 2006-2023
Publications (10 Years): 44

Top Topics

Observed Variables

Vector Space Model

Machine Translation

Top Venues

Publications

Salman H. Khan, Fahad Shahbaz Khan, Ashish Vaswani, Niki Parmar, Ming-Hsuan Yang, Mubarak Shah
Guest Editorial Introduction to the Special Section on Transformer Models in Vision. IEEE Trans. Pattern Anal. Mach. Intell. 45 (11) (2023)
Mostafa Dehghani, Yi Tay, Anurag Arnab, Lucas Beyer, Ashish Vaswani
The Efficiency Misnomer. ICLR (2022)
Yi Tay, Mostafa Dehghani, Jinfeng Rao, William Fedus, Samira Abnar, Hyung Won Chung, Sharan Narang, Dani Yogatama, Ashish Vaswani, Donald Metzler
Scale Efficiently: Insights from Pretraining and Finetuning Transformers. ICLR (2022)
Aravind Srinivas, Tsung-Yi Lin, Niki Parmar, Jonathon Shlens, Pieter Abbeel, Ashish Vaswani
Bottleneck Transformers for Visual Recognition. CVPR (2021)
Ashish Vaswani, Prajit Ramachandran, Aravind Srinivas, Niki Parmar, Blake A. Hechtman, Jonathon Shlens
Scaling Local Self-Attention for Parameter Efficient Visual Backbones. CVPR (2021)
Vidhisha Balachandran, Ashish Vaswani, Yulia Tsvetkov, Niki Parmar
Simple and Efficient ways to Improve REALM. CoRR (2021)
Aravind Srinivas, Tsung-Yi Lin, Niki Parmar, Jonathon Shlens, Pieter Abbeel, Ashish Vaswani
Bottleneck Transformers for Visual Recognition. CoRR (2021)
Mostafa Dehghani, Anurag Arnab, Lucas Beyer, Ashish Vaswani, Yi Tay
The Efficiency Misnomer. CoRR (2021)
Yi Tay, Mostafa Dehghani, Jinfeng Rao, William Fedus, Samira Abnar, Hyung Won Chung, Sharan Narang, Dani Yogatama, Ashish Vaswani, Donald Metzler
Scale Efficiently: Insights from Pre-training and Fine-tuning Transformers. CoRR (2021)
Ashish Vaswani, Prajit Ramachandran, Aravind Srinivas, Niki Parmar, Blake A. Hechtman, Jonathon Shlens
Scaling Local Self-Attention for Parameter Efficient Visual Backbones. CoRR (2021)
Aurko Roy, Mohammad Saffar, Ashish Vaswani, David Grangier
Efficient Content-Based Sparse Attention with Routing Transformers. Trans. Assoc. Comput. Linguistics 9 (2021)
Aurko Roy, Mohammad Saffar, Ashish Vaswani, David Grangier
Efficient Content-Based Sparse Attention with Routing Transformers. CoRR (2020)
Irwan Bello, Barret Zoph, Quoc Le, Ashish Vaswani, Jonathon Shlens
Attention Augmented Convolutional Networks. ICCV (2019)
Vihan Jain, Gabriel Magalhães, Alexander Ku, Ashish Vaswani, Eugene Ie, Jason Baldridge
Stay on the Path: Instruction Fidelity in Vision-and-Language Navigation. ACL (1) (2019)
Vihan Jain, Gabriel Magalhães, Alexander Ku, Ashish Vaswani, Eugene Ie, Jason Baldridge
Stay on the Path: Instruction Fidelity in Vision-and-Language Navigation. CoRR (2019)
Irwan Bello, Barret Zoph, Ashish Vaswani, Jonathon Shlens, Quoc V. Le
Attention Augmented Convolutional Networks. CoRR (2019)
Cheng-Zhi Anna Huang, Ashish Vaswani, Jakob Uszkoreit, Ian Simon, Curtis Hawthorne, Noam Shazeer, Andrew M. Dai, Matthew D. Hoffman, Monica Dinculescu, Douglas Eck
Music Transformer: Generating Music with Long-Term Structure. ICLR (Poster) (2019)
Prajit Ramachandran, Niki Parmar, Ashish Vaswani, Irwan Bello, Anselm Levskaya, Jonathon Shlens
Stand-Alone Self-Attention in Vision Models. CoRR (2019)
Niki Parmar, Prajit Ramachandran, Ashish Vaswani, Irwan Bello, Anselm Levskaya, Jon Shlens
Stand-Alone Self-Attention in Vision Models. NeurIPS (2019)
Lukasz Kaiser, Aurko Roy, Ashish Vaswani, Niki Parmar, Samy Bengio, Jakob Uszkoreit, Noam Shazeer
Fast Decoding in Sequence Models using Discrete Latent Variables. CoRR (2018)
Peter Shaw, Jakob Uszkoreit, Ashish Vaswani
Self-Attention with Relative Position Representations. NAACL-HLT (2) (2018)
Niki Parmar, Ashish Vaswani, Jakob Uszkoreit, Lukasz Kaiser, Noam Shazeer, Alexander Ku
Image Transformer. CoRR (2018)
Cheng-Zhi Anna Huang, Ashish Vaswani, Jakob Uszkoreit, Noam Shazeer, Curtis Hawthorne, Andrew M. Dai, Matthew D. Hoffman, Douglas Eck
An Improved Relative Self-Attention Mechanism for Transformer with Application to Music Generation. CoRR (2018)
Aurko Roy, Ashish Vaswani, Arvind Neelakantan, Niki Parmar
Theory and Experiments on Vector Quantized Autoencoders. CoRR (2018)
Peter W. Battaglia, Jessica B. Hamrick, Victor Bapst, Alvaro Sanchez-Gonzalez, Vinícius Flores Zambaldi, Mateusz Malinowski, Andrea Tacchetti, David Raposo, Adam Santoro, Ryan Faulkner, Çaglar Gülçehre, H. Francis Song, Andrew J. Ballard, Justin Gilmer, George E. Dahl, Ashish Vaswani, Kelsey R. Allen, Charles Nash, Victoria Langston, Chris Dyer, Nicolas Heess, Daan Wierstra, Pushmeet Kohli, Matthew Botvinick, Oriol Vinyals, Yujia Li, Razvan Pascanu
Relational inductive biases, deep learning, and graph networks. CoRR (2018)
Noam Shazeer, Youlong Cheng, Niki Parmar, Dustin Tran, Ashish Vaswani, Penporn Koanantakool, Peter Hawkins, HyoukJoong Lee, Mingsheng Hong, Cliff Young, Ryan Sepassi, Blake A. Hechtman
Mesh-TensorFlow: Deep Learning for Supercomputers. CoRR (2018)
Lukasz Kaiser, Samy Bengio, Aurko Roy, Ashish Vaswani, Niki Parmar, Jakob Uszkoreit, Noam Shazeer
Fast Decoding in Sequence Models Using Discrete Latent Variables. ICML (2018)
Ashish Vaswani, Samy Bengio, Eugene Brevdo, François Chollet, Aidan N. Gomez, Stephan Gouws, Llion Jones, Lukasz Kaiser, Nal Kalchbrenner, Niki Parmar, Ryan Sepassi, Noam Shazeer, Jakob Uszkoreit
Tensor2Tensor for Neural Machine Translation. CoRR (2018)
Peter Shaw, Jakob Uszkoreit, Ashish Vaswani
Self-Attention with Relative Position Representations. CoRR (2018)
Noam Shazeer, Youlong Cheng, Niki Parmar, Dustin Tran, Ashish Vaswani, Penporn Koanantakool, Peter Hawkins, HyoukJoong Lee, Mingsheng Hong, Cliff Young, Ryan Sepassi, Blake A. Hechtman
Mesh-TensorFlow: Deep Learning for Supercomputers. NeurIPS (2018)
Niki Parmar, Ashish Vaswani, Jakob Uszkoreit, Lukasz Kaiser, Noam Shazeer, Alexander Ku, Dustin Tran
Image Transformer. ICML (2018)
Mia Xu Chen, Orhan Firat, Ankur Bapna, Melvin Johnson, Wolfgang Macherey, George F. Foster, Llion Jones, Mike Schuster, Noam Shazeer, Niki Parmar, Ashish Vaswani, Jakob Uszkoreit, Lukasz Kaiser, Zhifeng Chen, Yonghui Wu, Macduff Hughes
The Best of Both Worlds: Combining Recent Advances in Neural Machine Translation. ACL (1) (2018)
Ashish Vaswani, Samy Bengio, Eugene Brevdo, François Chollet, Aidan N. Gomez, Stephan Gouws, Llion Jones, Lukasz Kaiser, Nal Kalchbrenner, Niki Parmar, Ryan Sepassi, Noam Shazeer, Jakob Uszkoreit
Tensor2Tensor for Neural Machine Translation. AMTA (1) (2018)
Ashish Vaswani, Noam Shazeer, Niki Parmar, Jakob Uszkoreit, Llion Jones, Aidan N. Gomez, Lukasz Kaiser, Illia Polosukhin
Attention is All you Need. NIPS (2017)
Ashish Vaswani, Noam Shazeer, Niki Parmar, Jakob Uszkoreit, Llion Jones, Aidan N. Gomez, Lukasz Kaiser, Illia Polosukhin
Attention Is All You Need. CoRR (2017)
Lukasz Kaiser, Aidan N. Gomez, Noam Shazeer, Ashish Vaswani, Niki Parmar, Llion Jones, Jakob Uszkoreit
One Model To Learn Them All. CoRR (2017)
Boliang Zhang, Xiaoman Pan, Tianlu Wang, Ashish Vaswani, Heng Ji, Kevin Knight, Daniel Marcu
Name Tagging for Low-resource Incident Languages based on Expectation-driven Learning. HLT-NAACL (2016)
Barret Zoph, Ashish Vaswani, Jonathan May, Kevin Knight
Simple, Fast Noise-Contrastive Estimation for Large RNN Vocabularies. HLT-NAACL (2016)
Ashish Vaswani, Kenji Sagae
Efficient Structured Inference for Transition-Based Parsing with Neural Networks and Error States. Trans. Assoc. Comput. Linguistics 4 (2016)
Ashish Vaswani, Yonatan Bisk, Kenji Sagae, Ryan Musa
Supertagging With LSTMs. HLT-NAACL (2016)
Ke M. Tran, Yonatan Bisk, Ashish Vaswani, Daniel Marcu, Kevin Knight
Unsupervised Neural Hidden Markov Models. SPNLP@EMNLP (2016)
Ke M. Tran, Yonatan Bisk, Ashish Vaswani, Daniel Marcu, Kevin Knight
Unsupervised Neural Hidden Markov Models. CoRR (2016)
Tomer Levinboim, Ashish Vaswani, David Chiang
Model Invertibility Regularization: Sequence Alignment With or Without Parallel Data. HLT-NAACL (2015)
Qing Dou, Ashish Vaswani, Kevin Knight, Chris Dyer
Unifying Bayesian Inference and Vector Space Models for Improved Decipherment. ACL (1) (2015)
Qing Dou, Ashish Vaswani, Kevin Knight
Beyond Parallel Data: Joint Word Alignment and Decipherment Improves Machine Translation. EMNLP (2014)
Leila Wehbe, Ashish Vaswani, Kevin Knight, Tom M. Mitchell
Aligning context-based statistical models of language with brain activity during reading. EMNLP (2014)
Dirk Hovy, Taylor Berg-Kirkpatrick, Ashish Vaswani, Eduard H. Hovy
Learning Whom to Trust with MACE. HLT-NAACL (2013)
Ashish Vaswani, Yinggong Zhao, Victoria Fossum, David Chiang
Decoding with Large-Scale Neural Language Models Improves Translation. EMNLP (2013)
Ashish Vaswani, Liang Huang, David Chiang
Smaller Alignment Models for Better Translations: Unsupervised Word Alignment with the l0-norm. ACL (1) (2012)
Dirk Hovy, Ashish Vaswani, Stephen Tratz, David Chiang, Eduard H. Hovy
Models and Training for Unsupervised Preposition Sense Disambiguation. ACL (2) (2011)
Ashish Vaswani, Haitao Mi, Liang Huang, David Chiang
Rule Markov Models for Fast Tree-to-String Translation. ACL (2011)
Ashish Vaswani, Adam Pauls, David Chiang
Efficient Optimization of an MDL-Inspired Objective Function for Unsupervised Part-Of-Speech Tagging. ACL (2) (2010)
Sujith Ravi, Ashish Vaswani, Kevin Knight, David Chiang
Fast, Greedy Model Minimization for Unsupervised Tagging. COLING (2010)
David R. Traum, Antonio Roque, Anton Leuski, Panayiotis G. Georgiou, Jillian Gerten, Bilyana Martinovski, Shrikanth Narayanan, Susan Robinson, Ashish Vaswani
Hassan: A Virtual Human for Tactical Questioning. SIGdial (2007)
Antonio Roque, Anton Leuski, Vivek Kumar Rangarajan Sridhar, Susan Robinson, Ashish Vaswani, Shrikanth S. Narayanan, David R. Traum
Radiobot-CFF: a spoken dialogue system for military training. INTERSPEECH (2006)