Kushal Arora

Publication Activity (10 Years)

Years Active: 2016-2024
Publications (10 Years): 16

Top Topics

Natural Language Generation

Error Accumulation

Top Venues

Trans. Assoc. Comput. Linguistics

Publications

Archit Sharma, Sedrick Keh, Eric Mitchell, Chelsea Finn, Kushal Arora, Thomas Kollar
A Critical Evaluation of AI Feedback for Aligning Large Language Models. CoRR (2024)
Jeffrey Li, Alex Fang, Georgios Smyrnis, Maor Ivgi, Matt Jordan, Samir Yitzhak Gadre, Hritik Bansal, Etash Guha, Sedrick Keh, Kushal Arora, Saurabh Garg, Rui Xin, Niklas Muennighoff, Reinhard Heckel, Jean Mercat, Mayee Chen, Suchin Gururangan, Mitchell Wortsman, Alon Albalak, Yonatan Bitton, Marianna Nezhurina, Amro Abbas, Cheng-Yu Hsieh, Dhruba Ghosh, Josh Gardner, Maciej Kilian, Hanlin Zhang, Rulin Shao, Sarah M. Pratt, Sunny Sanyal, Gabriel Ilharco, Giannis Daras, Kalyani Marathe, Aaron Gokaslan, Jieyu Zhang, Khyathi Raghavi Chandu, Thao Nguyen, Igor Vasiljevic, Sham M. Kakade, Shuran Song, Sujay Sanghavi, Fartash Faghri, Sewoong Oh, Luke Zettlemoyer, Kyle Lo, Alaaeldin El-Nouby, Hadi Pouransari, Alexander Toshev, Stephanie Wang, Dirk Groeneveld, Luca Soldaini, Pang Wei Koh, Jenia Jitsev, Thomas Kollar, Alexandros G. Dimakis, Yair Carmon, Achal Dave, Ludwig Schmidt, Vaishaal Shankar
DataComp-LM: In search of the next generation of training sets for language models. CoRR (2024)
Jean Mercat, Igor Vasiljevic, Sedrick Keh, Kushal Arora, Achal Dave, Adrien Gaidon, Thomas Kollar
Linearizing Large Language Models. CoRR (2024)
Kushal Arora, Timothy J. O'Donnell, Doina Precup, Jason Weston, Jackie Chi Kit Cheung
The Stable Entropy Hypothesis and Entropy-Aware Decoding: An Analysis and Algorithm for Robust Natural Language Generation. CoRR (2023)
Pratyay Banerjee, Shweti Mahajan, Kushal Arora, Chitta Baral, Oriana Riva
Lexi: Self-Supervised Learning of the UI Language. CoRR (2023)
Jing Xu, Megan Ung, Mojtaba Komeili, Kushal Arora, Y-Lan Boureau, Jason Weston
Learning New Skills after Deployment: Improving open-domain internet-driven dialogue with human feedback. ACL (1) (2023)
Pratyay Banerjee, Shweti Mahajan, Kushal Arora, Chitta Baral, Oriana Riva
Lexi: Self-Supervised Learning of the UI Language. EMNLP (Findings) (2022)
Kushal Arora, Kurt Shuster, Sainbayar Sukhbaatar, Jason Weston
DIRECTOR: Generator-Classifiers For Supervised Language Modeling. CoRR (2022)
Kushal Arora, Layla El Asri, Hareesh Bahuleyan, Jackie Chi Kit Cheung
Why Exposure Bias Matters: An Imitation Learning Perspective of Error Accumulation in Language Generation. ACL (Findings) (2022)
Jing Xu, Megan Ung, Mojtaba Komeili, Kushal Arora, Y-Lan Boureau, Jason Weston
Learning New Skills after Deployment: Improving open-domain internet-driven dialogue with human feedback. CoRR (2022)
Kurt Shuster, Jing Xu, Mojtaba Komeili, Da Ju, Eric Michael Smith, Stephen Roller, Megan Ung, Moya Chen, Kushal Arora, Joshua Lane, Morteza Behrooz, William Ngan, Spencer Poff, Naman Goyal, Arthur Szlam, Y-Lan Boureau, Melanie Kambadur, Jason Weston
BlenderBot 3: a deployed conversational agent that continually learns to responsibly engage. CoRR (2022)
Kushal Arora, Kurt Shuster, Sainbayar Sukhbaatar, Jason Weston
Director: Generator-Classifiers For Supervised Language Modeling. AACL/IJCNLP (1) (2022)
Kushal Arora, Layla El Asri, Hareesh Bahuleyan, Jackie Chi Kit Cheung
Why Exposure Bias Matters: An Imitation Learning Perspective of Error Accumulation in Language Generation. CoRR (2022)
Kushal Arora, Aishik Chakraborty, Jackie Chi Kit Cheung
Learning Lexical Subspaces in a Distributional Vector Space. Trans. Assoc. Comput. Linguistics 8 (2020)
Kushal Arora
Contrastive Perplexity: A new evaluation metric for sentence level language models. CoRR (2016)
Kushal Arora, Anand Rangarajan
A Compositional Approach to Language Modeling. CoRR (2016)