Dara Bahri

Publication Activity (10 Years)

Years Active: 2018-2024
Publications (10 Years): 54

Top Topics

Extreme Value Theory

Top Venues

Publications

Behrooz Tahmasebi, Ashkan Soleymani, Dara Bahri, Stefanie Jegelka, Patrick Jaillet
A Universal Class of Sharpness-Aware Minimization Algorithms. CoRR (2024)
Yi Tay, Mostafa Dehghani, Dara Bahri, Donald Metzler
Efficient Transformers: A Survey. ACM Comput. Surv. 55 (6) (2023)
Yi Tay, Mostafa Dehghani, Vinh Q. Tran, Xavier Garcia, Jason Wei, Xuezhi Wang, Hyung Won Chung, Dara Bahri, Tal Schuster, Huaixiu Steven Zheng, Denny Zhou, Neil Houlsby, Donald Metzler
UL2: Unifying Language Learning Paradigms. ICLR (2023)
Maksym Andriushchenko, Dara Bahri, Hossein Mobahi, Nicolas Flammarion
Sharpness-Aware Minimization Leads to Low-Rank Features. NeurIPS (2023)
Maksym Andriushchenko, Dara Bahri, Hossein Mobahi, Nicolas Flammarion
Sharpness-Aware Minimization Leads to Low-Rank Features. CoRR (2023)
Dara Bahri, Che Zheng, Yi Tay, Donald Metzler, Andrew Tomkins
Surprise: Result List Truncation via Extreme Value Theory. SIGIR (2023)
Dara Bahri, Heinrich Jiang, Tal Schuster, Afshin Rostamizadeh
Is margin all you need? An extensive empirical study of active learning on tabular data. CoRR (2022)
Kai Hui, Honglei Zhuang, Tao Chen, Zhen Qin, Jing Lu, Dara Bahri, Ji Ma, Jai Prakash Gupta, Cícero Nogueira dos Santos, Yi Tay, Donald Metzler
ED2LM: Encoder-Decoder to Language Model for Faster Document Re-ranking Inference. ACL (Findings) (2022)
Dara Bahri, Hossein Mobahi, Yi Tay
Sharpness-Aware Minimization Improves Language Model Generalization. ACL (1) (2022)
Yi Tay, Vinh Q. Tran, Mostafa Dehghani, Jianmo Ni, Dara Bahri, Harsh Mehta, Zhen Qin, Kai Hui, Zhe Zhao, Jai Prakash Gupta, Tal Schuster, William W. Cohen, Donald Metzler
Transformer Memory as a Differentiable Search Index. CoRR (2022)
Vamsi Aribandi, Yi Tay, Tal Schuster, Jinfeng Rao, Huaixiu Steven Zheng, Sanket Vaibhav Mehta, Honglei Zhuang, Vinh Q. Tran, Dara Bahri, Jianmo Ni, Jai Prakash Gupta, Kai Hui, Sebastian Ruder, Donald Metzler
ExT5: Towards Extreme Multi-Task Scaling for Transfer Learning. ICLR (2022)
Yi Tay, Mostafa Dehghani, Vinh Q. Tran, Xavier Garcia, Dara Bahri, Tal Schuster, Huaixiu Steven Zheng, Neil Houlsby, Donald Metzler
Unifying Language Learning Paradigms. CoRR (2022)
Dara Bahri, Heinrich Jiang, Yi Tay, Donald Metzler
Scarf: Self-Supervised Contrastive Learning using Random Feature Corruption. ICLR (2022)
Yi Tay, Vinh Tran, Mostafa Dehghani, Jianmo Ni, Dara Bahri, Harsh Mehta, Zhen Qin, Kai Hui, Zhe Zhao, Jai Prakash Gupta, Tal Schuster, William W. Cohen, Donald Metzler
Transformer Memory as a Differentiable Search Index. NeurIPS (2022)
Tal Schuster, Adam Fisch, Jai Gupta, Mostafa Dehghani, Dara Bahri, Vinh Tran, Yi Tay, Donald Metzler
Confident Adaptive Language Modeling. NeurIPS (2022)
Kai Hui, Honglei Zhuang, Tao Chen, Zhen Qin, Jing Lu, Dara Bahri, Ji Ma, Jai Prakash Gupta, Cícero Nogueira dos Santos, Yi Tay, Don Metzler
ED2LM: Encoder-Decoder to Language Model for Faster Document Re-ranking Inference. CoRR (2022)
Yi Tay, Vinh Q. Tran, Sebastian Ruder, Jai Prakash Gupta, Hyung Won Chung, Dara Bahri, Zhen Qin, Simon Baumgartner, Cong Yu, Donald Metzler
Charformer: Fast Character Transformers via Gradient-based Subword Tokenization. ICLR (2022)
Heinrich Jiang, Harikrishna Narasimhan, Dara Bahri, Andrew Cotter, Afshin Rostamizadeh
Churn Reduction via Distillation. ICLR (2022)
Tal Schuster, Adam Fisch, Jai Prakash Gupta, Mostafa Dehghani, Dara Bahri, Vinh Q. Tran, Yi Tay, Donald Metzler
Confident Adaptive Language Modeling. CoRR (2022)
Dara Bahri, Heinrich Jiang
Locally Adaptive Label Smoothing for Predictive Churn. CoRR (2021)
Yikang Shen, Yi Tay, Che Zheng, Dara Bahri, Donald Metzler, Aaron C. Courville
StructFormer: Joint Unsupervised Induction of Dependency and Constituency Structure from Masked Language Modeling. ACL/IJCNLP (1) (2021)
Donald Metzler, Yi Tay, Dara Bahri, Marc Najork
Rethinking search: making domain experts out of dilettantes. SIGIR Forum 55 (1) (2021)
Yi Tay, Mostafa Dehghani, Jai Prakash Gupta, Vamsi Aribandi, Dara Bahri, Zhen Qin, Donald Metzler
Are Pretrained Convolutions Better than Pretrained Transformers? ACL/IJCNLP (1) (2021)
Dara Bahri, Heinrich Jiang, Yi Tay, Donald Metzler
Label Smoothed Embedding Hypothesis for Out-of-Distribution Detection. CoRR (2021)
Yi Tay, Zhe Zhao, Dara Bahri, Donald Metzler, Da-Cheng Juan
HyperGrid Transformers: Towards A Single Model for Multiple Tasks. ICLR (2021)
Yi Tay, Mostafa Dehghani, Jai Prakash Gupta, Dara Bahri, Vamsi Aribandi, Zhen Qin, Donald Metzler
Are Pre-trained Convolutions Better than Pre-trained Transformers? CoRR (2021)
Dara Bahri, Heinrich Jiang, Yi Tay, Donald Metzler
SCARF: Self-Supervised Contrastive Learning using Random Feature Corruption. CoRR (2021)
Yi Tay, Vinh Q. Tran, Sebastian Ruder, Jai Prakash Gupta, Hyung Won Chung, Dara Bahri, Zhen Qin, Simon Baumgartner, Cong Yu, Donald Metzler
Charformer: Fast Character Transformers via Gradient-based Subword Tokenization. CoRR (2021)
Heinrich Jiang, Harikrishna Narasimhan, Dara Bahri, Andrew Cotter, Afshin Rostamizadeh
Churn Reduction via Distillation. CoRR (2021)
Yi Tay, Mostafa Dehghani, Vamsi Aribandi, Jai Prakash Gupta, Philip Pham, Zhen Qin, Dara Bahri, Da-Cheng Juan, Donald Metzler
OmniNet: Omnidirectional Representations from Transformers. CoRR (2021)
Yi Tay, Mostafa Dehghani, Samira Abnar, Yikang Shen, Dara Bahri, Philip Pham, Jinfeng Rao, Liu Yang, Sebastian Ruder, Donald Metzler
Long Range Arena : A Benchmark for Efficient Transformers. ICLR (2021)
Dara Bahri, Yi Tay, Che Zheng, Cliff Brunk, Donald Metzler, Andrew Tomkins
Generative Models are Unsupervised Predictors of Page Quality: A Colossal-Scale Study. WSDM (2021)
Yi Tay, Dara Bahri, Donald Metzler, Da-Cheng Juan, Zhe Zhao, Che Zheng
Synthesizer: Rethinking Self-Attention for Transformer Models. ICML (2021)
Donald Metzler, Yi Tay, Dara Bahri, Marc Najork
Rethinking Search: Making Experts out of Dilettantes. CoRR (2021)
Dara Bahri, Hossein Mobahi, Yi Tay
Sharpness-Aware Minimization Improves Language Model Generalization. CoRR (2021)
Dara Bahri, Heinrich Jiang
Locally Adaptive Label Smoothing Improves Predictive Churn. ICML (2021)
Yi Tay, Mostafa Dehghani, Vamsi Aribandi, Jai Prakash Gupta, Philip Pham, Zhen Qin, Dara Bahri, Da-Cheng Juan, Donald Metzler
OmniNet: Omnidirectional Representations from Transformers. ICML (2021)
Vamsi Aribandi, Yi Tay, Tal Schuster, Jinfeng Rao, Huaixiu Steven Zheng, Sanket Vaibhav Mehta, Honglei Zhuang, Vinh Q. Tran, Dara Bahri, Jianmo Ni, Jai Prakash Gupta, Kai Hui, Sebastian Ruder, Donald Metzler
ExT5: Towards Extreme Multi-Task Scaling for Transfer Learning. CoRR (2021)
Dara Bahri, Yi Tay, Che Zheng, Donald Metzler, Andrew Tomkins
Choppy: Cut Transformer for Ranked List Truncation. SIGIR (2020)
Yi Tay, Zhe Zhao, Dara Bahri, Donald Metzler, Da-Cheng Juan
HyperGrid: Efficient Multi-Task Transformers with Grid-wise Decomposable Hyper Projections. CoRR (2020)
Dara Bahri, Heinrich Jiang, Maya R. Gupta
Deep k-NN for Noisy Labels. ICML (2020)
Yi Tay, Dara Bahri, Donald Metzler, Da-Cheng Juan, Zhe Zhao, Che Zheng
Synthesizer: Rethinking Self-Attention in Transformer Models. CoRR (2020)
Yi Tay, Dara Bahri, Liu Yang, Donald Metzler, Da-Cheng Juan
Sparse Sinkhorn Attention. ICML (2020)
Yikang Shen, Yi Tay, Che Zheng, Dara Bahri, Donald Metzler, Aaron C. Courville
StructFormer: Joint Unsupervised Induction of Dependency and Constituency Structure from Masked Language Modeling. CoRR (2020)
Yi Tay, Mostafa Dehghani, Samira Abnar, Yikang Shen, Dara Bahri, Philip Pham, Jinfeng Rao, Liu Yang, Sebastian Ruder, Donald Metzler
Long Range Arena: A Benchmark for Efficient Transformers. CoRR (2020)
Dara Bahri, Che Zheng, Yi Tay, Donald Metzler, Andrew Tomkins
Surprise: Result List Truncation via Extreme Value Theory. CoRR (2020)
Yi Tay, Mostafa Dehghani, Dara Bahri, Donald Metzler
Efficient Transformers: A Survey. CoRR (2020)
Dara Bahri, Heinrich Jiang, Maya R. Gupta
Deep k-NN for Noisy Labels. CoRR (2020)
Yi Tay, Dara Bahri, Che Zheng, Clifford Brunk, Donald Metzler, Andrew Tomkins
Reverse Engineering Configurations of Neural Text Generation Models. CoRR (2020)
Yi Tay, Dara Bahri, Liu Yang, Donald Metzler, Da-Cheng Juan
Sparse Sinkhorn Attention. CoRR (2020)
Dara Bahri, Yi Tay, Che Zheng, Donald Metzler, Andrew Tomkins
Choppy: Cut Transformer For Ranked List Truncation. CoRR (2020)
Dara Bahri, Yi Tay, Che Zheng, Donald Metzler, Cliff Brunk, Andrew Tomkins
Generative Models are Unsupervised Predictors of Page Quality: A Colossal-Scale Study. CoRR (2020)
Yi Tay, Dara Bahri, Che Zheng, Clifford Brunk, Donald Metzler, Andrew Tomkins
Reverse Engineering Configurations of Neural Text Generation Models. ACL (2020)
Maya R. Gupta, Dara Bahri, Andrew Cotter, Kevin Robert Canini
Diminishing Returns Shape Constraints for Interpretability and Regularization. NeurIPS (2018)