Alon Albalak

Publication Activity (10 Years)

Years Active: 2021-2024
Publications (10 Years): 29

Top Topics

Logical Reasoning

Question Answering

Top Venues

EMNLP (Findings)

Publications

Alon Albalak, Yanai Elazar, Sang Michael Xie, Shayne Longpre, Nathan Lambert, Xinyi Wang, Niklas Muennighoff, Bairu Hou, Liangming Pan, Haewon Jeong, Colin Raffel, Shiyu Chang, Tatsunori Hashimoto, William Yang Wang
A Survey on Data Selection for Language Models. CoRR (2024)
Shayne Longpre, Stella Biderman, Alon Albalak, Hailey Schoelkopf, Daniel McDuff, Sayash Kapoor, Kevin Klyman, Kyle Lo, Gabriel Ilharco, Nay San, Maribeth Rauh, Aviya Skowron, Bertie Vidgen, Laura Weidinger, Arvind Narayanan, Victor Sanh, David Ifeoluwa Adelani, Percy Liang, Rishi Bommasani, Peter Henderson, Sasha Luccioni, Yacine Jernite, Luca Soldaini
The Responsible Foundation Model Development Cheatsheet: A Review of Tools & Resources. CoRR (2024)
Jeffrey Li, Alex Fang, Georgios Smyrnis, Maor Ivgi, Matt Jordan, Samir Yitzhak Gadre, Hritik Bansal, Etash Guha, Sedrick Keh, Kushal Arora, Saurabh Garg, Rui Xin, Niklas Muennighoff, Reinhard Heckel, Jean Mercat, Mayee Chen, Suchin Gururangan, Mitchell Wortsman, Alon Albalak, Yonatan Bitton, Marianna Nezhurina, Amro Abbas, Cheng-Yu Hsieh, Dhruba Ghosh, Josh Gardner, Maciej Kilian, Hanlin Zhang, Rulin Shao, Sarah M. Pratt, Sunny Sanyal, Gabriel Ilharco, Giannis Daras, Kalyani Marathe, Aaron Gokaslan, Jieyu Zhang, Khyathi Raghavi Chandu, Thao Nguyen, Igor Vasiljevic, Sham M. Kakade, Shuran Song, Sujay Sanghavi, Fartash Faghri, Sewoong Oh, Luke Zettlemoyer, Kyle Lo, Alaaeldin El-Nouby, Hadi Pouransari, Alexander Toshev, Stephanie Wang, Dirk Groeneveld, Luca Soldaini, Pang Wei Koh, Jenia Jitsev, Thomas Kollar, Alexandros G. Dimakis, Yair Carmon, Achal Dave, Ludwig Schmidt, Vaishaal Shankar
DataComp-LM: In search of the next generation of training sets for language models. CoRR (2024)
Bo Peng, Daniel Goldstein, Quentin Anthony, Alon Albalak, Eric Alcaide, Stella Biderman, Eugene Cheah, Xingjian Du, Teddy Ferdinan, Haowen Hou, Przemyslaw Kazienko, Kranthi Kiran GV, Jan Kocon, Bartlomiej Koptyra, Satyapriya Krishna, Ronald McClelland Jr., Niklas Muennighoff, Fares Obeid, Atsushi Saito, Guangyu Song, Haoqin Tu, Stanislaw Wozniak, Ruichong Zhang, Bingchen Zhao, Qihang Zhao, Peng Zhou, Jian Zhu, Rui-Jie Zhu
Eagle and Finch: RWKV with Matrix-Valued States and Dynamic Recurrence. CoRR (2024)
Alon Albalak, Yanai Elazar, Sang Michael Xie, Shayne Longpre, Nathan Lambert, Xinyi Wang, Niklas Muennighoff, Bairu Hou, Liangming Pan, Haewon Jeong, Colin Raffel, Shiyu Chang, Tatsunori Hashimoto, William Yang Wang
A Survey on Data Selection for Language Models. Trans. Mach. Learn. Res. 2024 (2024)
Charles Dickens, Connor Pryor, Changyu Gao, Alon Albalak, Eriq Augustine, William Yang Wang, Stephen Wright, Lise Getoor
A Mathematical Framework, a Taxonomy of Modeling Paradigms, and a Suite of Learning Techniques for Neural-Symbolic Systems. CoRR (2024)
Antonis Antoniades, Xinyi Wang, Yanai Elazar, Alfonso Amayuelas, Alon Albalak, Kexun Zhang, William Yang Wang
Generalization v.s. Memorization: Tracing Language Models' Capabilities Back to Pretraining Data. CoRR (2024)
Alon Albalak, Sharon Levy, William Yang Wang
Addressing Issues of Cross-Linguality in Open-Retrieval Question Answering Systems For Emergent Domains. EACL (System Demonstrations) (2023)
Connor Pryor, Charles Dickens, Eriq Augustine, Alon Albalak, William Yang Wang, Lise Getoor
NeuPSL: Neural Probabilistic Soft Logic. IJCAI (2023)
Liangming Pan, Alon Albalak, Xinyi Wang, William Wang
Logic-LM: Empowering Large Language Models with Symbolic Solvers for Faithful Logical Reasoning. EMNLP (Findings) (2023)
Alon Albalak, Colin A. Raffel, William Yang Wang
Improving Few-Shot Generalization by Exploring and Exploiting Auxiliary Data. NeurIPS (2023)
Liangming Pan, Alon Albalak, Xinyi Wang, William Yang Wang
Logic-LM: Empowering Large Language Models with Symbolic Solvers for Faithful Logical Reasoning. CoRR (2023)
Alon Albalak, Liangming Pan, Colin Raffel, William Yang Wang
Efficient Online Data Mixing For Language Model Pre-Training. CoRR (2023)
Alon Albalak, Colin Raffel, William Yang Wang
Improving Few-Shot Generalization by Exploring and Exploiting Auxiliary Data. CoRR (2023)
Yi-Lin Tuan, Alon Albalak, Wenda Xu, Michael Saxon, Connor Pryor, Lise Getoor, William Yang Wang
CausalDialogue: Modeling Utterance-level Causality in Conversations. ACL (Findings) (2023)
Bo Peng, Eric Alcaide, Quentin Anthony, Alon Albalak, Samuel Arcadinho, Huanqi Cao, Xin Cheng, Michael Chung, Matteo Grella, Kranthi Kiran G. V., Xuzheng He, Haowen Hou, Przemyslaw Kazienko, Jan Kocon, Jiaming Kong, Bartlomiej Koptyra, Hayden Lau, Krishna Sri Ipsit Mantri, Ferdinand Mom, Atsushi Saito, Xiangru Tang, Bolun Wang, Johan S. Wind, Stanislaw Wozniak, Ruichong Zhang, Zhenyuan Zhang, Qihang Zhao, Peng Zhou, Jian Zhu, Rui-Jie Zhu
RWKV: Reinventing RNNs for the Transformer Era. CoRR (2023)
Bo Peng, Eric Alcaide, Quentin Anthony, Alon Albalak, Samuel Arcadinho, Stella Biderman, Huanqi Cao, Xin Cheng, Michael Chung, Leon Derczynski, Xingjian Du, Matteo Grella, Kranthi Gv, Xuzheng He, Haowen Hou, Przemyslaw Kazienko, Jan Kocon, Jiaming Kong, Bartlomiej Koptyra, Hayden Lau, Jiaju Lin, Krishna Sri Ipsit Mantri, Ferdinand Mom, Atsushi Saito, Guangyu Song, Xiangru Tang, Johan S. Wind, Stanislaw Wozniak, Zhenyuan Zhang, Qinghua Zhou, Jian Zhu, Rui-Jie Zhu
RWKV: Reinventing RNNs for the Transformer Era. EMNLP (Findings) (2023)
Alon Albalak, Yi-Lin Tuan, Pegah Jandaghi, Connor Pryor, Luke Yoffe, Deepak Ramachandran, Lise Getoor, Jay Pujara, William Yang Wang
FETA: A Benchmark for Few-Sample Task Transfer in Open-Domain Dialogue. CoRR (2022)
Josiah Ross, Luke Yoffe, Alon Albalak, William Yang Wang
An Exploration of Data Efficiency in Intra-Dataset Task Transfer for Dialog Understanding. CoRR (2022)
Alon Albalak, Yi-Lin Tuan, Pegah Jandaghi, Connor Pryor, Luke Yoffe, Deepak Ramachandran, Lise Getoor, Jay Pujara, William Yang Wang
FETA: A Benchmark for Few-Sample Task Transfer in Open-Domain Dialogue. EMNLP (2022)
Eriq Augustine, Pegah Jandaghi, Alon Albalak, Connor Pryor, Charles Dickens, William Yang Wang, Lise Getoor
Emotion Recognition in Conversation using Probabilistic Soft Logic. CoRR (2022)
Alon Albalak, Sharon Levy, William Yang Wang
Addressing Issues of Cross-Linguality in Open-Retrieval Question Answering Systems For Emergent Domains. CoRR (2022)
Connor Pryor, Charles Dickens, Eriq Augustine, Alon Albalak, William Yang Wang, Lise Getoor
NeuPSL: Neural Probabilistic Soft Logic. CoRR (2022)
Yi-Lin Tuan, Alon Albalak, Wenda Xu, Michael Saxon, Connor Pryor, Lise Getoor, William Yang Wang
CausalDialogue: Modeling Utterance-level Causality in Conversations. CoRR (2022)
Alon Albalak, Varun Embar, Yi-Lin Tuan, Lise Getoor, William Yang Wang
D-REX: Dialogue Relation Extraction with Explanations. ConvAI@ACL (2022)
Alon Albalak, Akshat Shrivastava, Chinnadhurai Sankar, Adithya Sagar, Mike Ross
Data-Efficiency with a Single GPU: An Exploration of Transfer Methods for Small Language Models. CoRR (2022)
Michael Saxon, Sharon Levy, Xinyi Wang, Alon Albalak, William Yang Wang
Modeling Disclosive Transparency in NLP Application Descriptions. EMNLP (1) (2021)
Michael Saxon, Sharon Levy, Xinyi Wang, Alon Albalak, William Yang Wang
Dimensions of Transparency in NLP Applications. CoRR (2021)
Alon Albalak, Varun Embar, Yi-Lin Tuan, Lise Getoor, William Yang Wang
D-REX: Dialogue Relation Extraction with Explanations. CoRR (2021)