Roy Schwartz

Publication Activity (10 Years)

Years Active: 2011-2024
Publications (10 Years): 90

Top Topics

Natural Language

Minimally Supervised

Top Venues

EMNLP/IJCNLP (1)

Publications

Ilia Kuznetsov, Osama Mohammed Afzal, Koen Dercksen, Nils Dycke, Alexander Goldberg, Tom Hope, Dirk Hovy, Jonathan K. Kummerfeld, Anne Lauscher, Kevin Leyton-Brown, Sheng Lu, Mausam, Margot Mieskes, Aurélie Névéol, Danish Pruthi, Lizhen Qu, Roy Schwartz, Noah A. Smith, Thamar Solorio, Jingyan Wang, Xiaodan Zhu, Anna Rogers, Nihar B. Shah, Iryna Gurevych
What Can Natural Language Processing Do for Peer Review? CoRR (2024)
Yuval Reif, Roy Schwartz
Beyond Performance: Quantifying and Mitigating Label Bias in LLMs. CoRR (2024)
Michael Hassid, Tal Remez, Jonas Gehring, Roy Schwartz, Yossi Adi
The Larger the Better? Improved LLM Code-Generation via Budget Reallocation. CoRR (2024)
Matanel Oren, Michael Hassid, Yossi Adi, Roy Schwartz
Transformers are Multi-State RNNs. CoRR (2024)
Yuval Reif, Roy Schwartz
Beyond Performance: Quantifying and Mitigating Label Bias in LLMs. NAACL-HLT (2024)
Jonathan Mamou, Oren Pereg, Daniel Korat, Moshe Berchansky, Nadav Timor, Moshe Wasserblat, Roy Schwartz
Accelerating Speculative Decoding using Dynamic Speculation Length. CoRR (2024)
Yonatan Bitton, Ron Yosef, Eliyahu Strugo, Dafna Shahaf, Roy Schwartz, Gabriel Stanovsky
VASR: Visual Analogies of Situation Recognition. AAAI (2023)
Yuval Reif, Roy Schwartz
Fighting Bias With Bias: Promoting Model Robustness by Amplifying Dataset Biases. ACL (Findings) (2023)
Marcos V. Treviso, Ji-Ung Lee, Tianchu Ji, Betty van Aken, Qingqing Cao, Manuel R. Ciosici, Michael Hassid, Kenneth Heafield, Sara Hooker, Colin Raffel, Pedro Henrique Martins, André F. T. Martins, Jessica Zosa Forde, Peter A. Milder, Edwin Simpson, Noam Slonim, Jesse Dodge, Emma Strubell, Niranjan Balasubramanian, Leon Derczynski, Iryna Gurevych, Roy Schwartz
Efficient Methods for Natural Language Processing: A Survey. Trans. Assoc. Comput. Linguistics 11 (2023)
Ji-Ung Lee, Haritz Puerto, Betty van Aken, Yuki Arase, Jessica Zosa Forde, Leon Derczynski, Andreas Rücklé, Iryna Gurevych, Roy Schwartz, Emma Strubell, Jesse Dodge
Surveying (Dis)Parities and Concerns of Compute Hungry NLP Research. CoRR (2023)
Michael Hassid, Tal Remez, Tu Anh Nguyen, Itai Gat, Alexis Conneau, Felix Kreuk, Jade Copet, Alexandre Défossez, Gabriel Synnaeve, Emmanuel Dupoux, Roy Schwartz, Yossi Adi
Textually Pretrained Speech Language Models. NeurIPS (2023)
Daniel Rotem, Michael Hassid, Jonathan Mamou, Roy Schwartz
Finding the SWEET Spot: Analysis and Improvement of Adaptive Inference in Low Resource Settings. ACL (1) (2023)
Michael Hassid, Tal Remez, Tu Anh Nguyen, Itai Gat, Alexis Conneau, Felix Kreuk, Jade Copet, Alexandre Défossez, Gabriel Synnaeve, Emmanuel Dupoux, Roy Schwartz, Yossi Adi
Textually Pretrained Speech Language Models. CoRR (2023)
Netta Madvil, Yonatan Bitton, Roy Schwartz
Read, Look or Listen? What's Needed for Solving a Multimodal Dataset. CoRR (2023)
Daniel Rotem, Michael Hassid, Jonathan Mamou, Roy Schwartz
Finding the SWEET Spot: Analysis and Improvement of Adaptive Inference in Low Resource Settings. CoRR (2023)
Judit Ács, Endre Hamerlik, Roy Schwartz, Noah A. Smith, András Kornai
Morphosyntactic probing of multilingual BERT models. CoRR (2023)
Nitzan Bitton Guetta, Yonatan Bitton, Jack Hessel, Ludwig Schmidt, Yuval Elovici, Gabriel Stanovsky, Roy Schwartz
Breaking Common Sense: WHOOPS! A Vision-and-Language Benchmark of Synthetic and Compositional Images. ICCV (2023)
Aviad Sar-Shalom, Roy Schwartz
Curating Datasets for Better Performance with Example Training Dynamics. ACL (Findings) (2023)
Nitzan Bitton Guetta, Yonatan Bitton, Jack Hessel, Ludwig Schmidt, Yuval Elovici, Gabriel Stanovsky, Roy Schwartz
Breaking Common Sense: WHOOPS! A Vision-and-Language Benchmark of Synthetic and Compositional Images. CoRR (2023)
Michael Hassid, Hao Peng, Daniel Rotem, Jungo Kasai, Ivan Montero, Noah A. Smith, Roy Schwartz
How Much Does Attention Actually Attend? Questioning the Importance of Attention in Pretrained Transformers. EMNLP (Findings) (2022)
Roy Schwartz, Gabriel Stanovsky
On the Limitations of Dataset Balancing: The Lost Battle Against Spurious Correlations. CoRR (2022)
Inbal Magar, Roy Schwartz
Data Contamination: From Memorization to Exploitation. CoRR (2022)
Jesse Dodge, Taylor Prewitt, Remi Tachet des Combes, Erika Odmark, Roy Schwartz, Emma Strubell, Alexandra Sasha Luccioni, Noah A. Smith, Nicole DeCario, Will Buchanan
Measuring the Carbon Intensity of AI in Cloud Instances. FAccT (2022)
Yonatan Bitton, Nitzan Bitton Guetta, Ron Yosef, Yuval Elovici, Mohit Bansal, Gabriel Stanovsky, Roy Schwartz
WinoGAViL: Gamified Association Benchmark to Challenge Vision-and-Language Models. NeurIPS (2022)
Jesse Dodge, Taylor Prewitt, Remi Tachet des Combes, Erika Odmark, Roy Schwartz, Emma Strubell, Alexandra Sasha Luccioni, Noah A. Smith, Nicole DeCario, Will Buchanan
Measuring the Carbon Intensity of AI in Cloud Instances. CoRR (2022)
Marcos V. Treviso, Tianchu Ji, Ji-Ung Lee, Betty van Aken, Qingqing Cao, Manuel R. Ciosici, Michael Hassid, Kenneth Heafield, Sara Hooker, Pedro Henrique Martins, André F. T. Martins, Peter A. Milder, Colin Raffel, Edwin Simpson, Noam Slonim, Niranjan Balasubramanian, Leon Derczynski, Roy Schwartz
Efficient Methods for Natural Language Processing: A Survey. CoRR (2022)
Michael Hassid, Hao Peng, Daniel Rotem, Jungo Kasai, Ivan Montero, Noah A. Smith, Roy Schwartz
How Much Does Attention Actually Attend? Questioning the Importance of Attention in Pretrained Transformers. CoRR (2022)
Yonatan Bitton, Ron Yosef, Eli Strugo, Dafna Shahaf, Roy Schwartz, Gabriel Stanovsky
VASR: Visual Analogies of Situation Recognition. CoRR (2022)
Roy Schwartz, Gabriel Stanovsky
On the Limitations of Dataset Balancing: The Lost Battle Against Spurious Correlations. NAACL-HLT (Findings) (2022)
Inbal Magar, Roy Schwartz
Data Contamination: From Memorization to Exploitation. ACL (2) (2022)
Jonathan Mamou, Oren Pereg, Moshe Wasserblat, Roy Schwartz
TangoBERT: Reducing Inference Cost by using Cascaded Architecture. CoRR (2022)
Yonatan Bitton, Nitzan Bitton Guetta, Ron Yosef, Yuval Elovici, Mohit Bansal, Gabriel Stanovsky, Roy Schwartz
WinoGAViL: Gamified Association Benchmark to Challenge Vision-and-Language Models. CoRR (2022)
Yarden Tal, Inbal Magar, Roy Schwartz
Fewer Errors, but More Stereotypes? The Effect of Model Size on Gender Bias. CoRR (2022)
Jesse Dodge, Iryna Gurevych, Roy Schwartz, Emma Strubell, Betty van Aken
Efficient and Equitable Natural Language Processing in the Age of Deep Learning (Dagstuhl Seminar 22232). Dagstuhl Reports 12 (6) (2022)
Hao Peng, Jungo Kasai, Nikolaos Pappas, Dani Yogatama, Zhaofeng Wu, Lingpeng Kong, Roy Schwartz, Noah A. Smith
ABC: Attention with Bounded-memory Control. ACL (1) (2022)
William Merrill, Yoav Goldberg, Roy Schwartz, Noah A. Smith
Provable Limitations of Acquiring Meaning from Ungrounded Form: What Will Future Language Models Understand? Trans. Assoc. Comput. Linguistics 9 (2021)
William Merrill, Yoav Goldberg, Roy Schwartz, Noah A. Smith
Provable Limitations of Acquiring Meaning from Ungrounded Form: What will Future Language Models Understand? CoRR (2021)
Hao Peng, Jungo Kasai, Nikolaos Pappas, Dani Yogatama, Zhaofeng Wu, Lingpeng Kong, Roy Schwartz, Noah A. Smith
ABC: Attention with Bounded-memory Control. CoRR (2021)
Yonatan Bitton, Gabriel Stanovsky, Michael Elhadad, Roy Schwartz
Data Efficient Masked Language Modeling for Vision and Language. CoRR (2021)
Jesse Dodge, Suchin Gururangan, Dallas Card, Roy Schwartz, Noah A. Smith
Expected Validation Performance and Estimation of a Random Variable's Maximum. CoRR (2021)
Yonatan Bitton, Michael Elhadad, Gabriel Stanovsky, Roy Schwartz
Data Efficient Masked Language Modeling for Vision and Language. EMNLP (Findings) (2021)
Tom Hope, Aida Amini, David Wadden, Madeleine van Zuylen, Sravanthi Parasa, Eric Horvitz, Daniel S. Weld, Roy Schwartz, Hannaneh Hajishirzi
Extracting a Knowledge Base of Mechanisms from COVID-19 Papers. NAACL-HLT (2021)
Hao Peng, Nikolaos Pappas, Dani Yogatama, Roy Schwartz, Noah A. Smith, Lingpeng Kong
Random Feature Attention. CoRR (2021)
William Merrill, Yoav Goldberg, Roy Schwartz, Noah A. Smith
On the Power of Saturated Transformers: A View from Circuit Complexity. CoRR (2021)
Yonatan Bitton, Gabriel Stanovsky, Roy Schwartz, Michael Elhadad
Automatic Generation of Contrast Sets from Scene Graphs: Probing the Compositional Consistency of GQA. NAACL-HLT (2021)
Yonatan Bitton, Gabriel Stanovsky, Roy Schwartz, Michael Elhadad
Automatic Generation of Contrast Sets from Scene Graphs: Probing the Compositional Consistency of GQA. CoRR (2021)
William Merrill, Vivek Ramanujan, Yoav Goldberg, Roy Schwartz, Noah A. Smith
Effects of Parameter Norm Growth During Transformer Training: Inductive Bias from Gradient Descent. EMNLP (1) (2021)
Hao Peng, Nikolaos Pappas, Dani Yogatama, Roy Schwartz, Noah A. Smith, Lingpeng Kong
Random Feature Attention. ICLR (2021)
Jesse Dodge, Suchin Gururangan, Dallas Card, Roy Schwartz, Noah A. Smith
Expected Validation Performance and Estimation of a Random Variable's Maximum. EMNLP (Findings) (2021)
Swabha Swayamdipta, Roy Schwartz, Nicholas Lourie, Yizhong Wang, Hannaneh Hajishirzi, Noah A. Smith, Yejin Choi
Dataset Cartography: Mapping and Diagnosing Datasets with Training Dynamics. CoRR (2020)
Roy Schwartz, Gabi Stanovsky, Swabha Swayamdipta, Jesse Dodge, Noah A. Smith
The Right Tool for the Job: Matching Model and Instance Complexities. CoRR (2020)
William Merrill, Vivek Ramanujan, Yoav Goldberg, Roy Schwartz, Noah A. Smith
Parameter Norm Growth During Training of Transformers. CoRR (2020)
William Merrill, Gail Weiss, Yoav Goldberg, Roy Schwartz, Noah A. Smith, Eran Yahav
A Formal Hierarchy of RNN Architectures. ACL (2020)
Roy Schwartz, Jesse Dodge, Noah A. Smith, Oren Etzioni
Green AI. Commun. ACM 63 (12) (2020)
Jesse Dodge, Gabriel Ilharco, Roy Schwartz, Ali Farhadi, Hannaneh Hajishirzi, Noah A. Smith
Fine-Tuning Pretrained Language Models: Weight Initializations, Data Orders, and Early Stopping. CoRR (2020)
Aida Amini, Tom Hope, David Wadden, Madeleine van Zuylen, Eric Horvitz, Roy Schwartz, Hannaneh Hajishirzi
Extracting a Knowledge Base of Mechanisms from COVID-19 Papers. CoRR (2020)
Hao Peng, Roy Schwartz, Dianqi Li, Noah A. Smith
A Mixture of h - 1 Heads is Better than h Heads. ACL (2020)
Swabha Swayamdipta, Roy Schwartz, Nicholas Lourie, Yizhong Wang, Hannaneh Hajishirzi, Noah A. Smith, Yejin Choi
Dataset Cartography: Mapping and Diagnosing Datasets with Training Dynamics. EMNLP (1) (2020)
Roy Schwartz, Gabriel Stanovsky, Swabha Swayamdipta, Jesse Dodge, Noah A. Smith
The Right Tool for the Job: Matching Model and Instance Complexities. ACL (2020)
William Merrill, Gail Weiss, Yoav Goldberg, Roy Schwartz, Noah A. Smith, Eran Yahav
A Formal Hierarchy of RNN Architectures. CoRR (2020)
Hao Peng, Roy Schwartz, Dianqi Li, Noah A. Smith
A Mixture of h-1 Heads is Better than h Heads. CoRR (2020)
Matthew E. Peters, Mark Neumann, Robert L. Logan IV, Roy Schwartz, Vidur Joshi, Sameer Singh, Noah A. Smith
Knowledge Enhanced Contextual Word Representations. CoRR (2019)
Roy Schwartz, Jesse Dodge, Noah A. Smith, Oren Etzioni
Green AI. CoRR (2019)
Nelson F. Liu, Roy Schwartz, Noah A. Smith
Inoculation by Fine-Tuning: A Method for Analyzing Challenge Datasets. CoRR (2019)
Jesse Dodge, Suchin Gururangan, Dallas Card, Roy Schwartz, Noah A. Smith
Show Your Work: Improved Reporting of Experimental Results. CoRR (2019)
Matthew E. Peters, Mark Neumann, Robert L. Logan IV, Roy Schwartz, Vidur Joshi, Sameer Singh, Noah A. Smith
Knowledge Enhanced Contextual Word Representations. EMNLP/IJCNLP (1) (2019)
Jesse Dodge, Roy Schwartz, Hao Peng, Noah A. Smith
RNN Architecture Learning with Sparse Regularization. CoRR (2019)
Jesse Dodge, Suchin Gururangan, Dallas Card, Roy Schwartz, Noah A. Smith
Show Your Work: Improved Reporting of Experimental Results. EMNLP/IJCNLP (1) (2019)
Nelson F. Liu, Roy Schwartz, Noah A. Smith
Inoculation by Fine-Tuning: A Method for Analyzing Challenge Datasets. NAACL-HLT (1) (2019)
Hao Peng, Roy Schwartz, Noah A. Smith
PaLM: A Hybrid Parser and Language Model. CoRR (2019)
Hao Peng, Roy Schwartz, Noah A. Smith
PaLM: A Hybrid Parser and Language Model. EMNLP/IJCNLP (1) (2019)
Jesse Dodge, Roy Schwartz, Hao Peng, Noah A. Smith
RNN Architecture Learning with Sparse Regularization. EMNLP/IJCNLP (1) (2019)
Rowan Zellers, Yonatan Bisk, Roy Schwartz, Yejin Choi
SWAG: A Large-Scale Adversarial Dataset for Grounded Commonsense Inference. CoRR (2018)
Suchin Gururangan, Swabha Swayamdipta, Omer Levy, Roy Schwartz, Samuel R. Bowman, Noah A. Smith
Annotation Artifacts in Natural Language Inference Data. NAACL-HLT (2) (2018)
Rowan Zellers, Yonatan Bisk, Roy Schwartz, Yejin Choi
SWAG: A Large-Scale Adversarial Dataset for Grounded Commonsense Inference. EMNLP (2018)
Roy Schwartz, Sam Thomson, Noah A. Smith
SoPa: Bridging CNNs, RNNs, and Weighted Finite-State Machines. CoRR (2018)
Roy Schwartz, Sam Thomson, Noah A. Smith
Bridging CNNs, RNNs, and Weighted Finite-State Machines. ACL (1) (2018)
Hao Peng, Roy Schwartz, Sam Thomson, Noah A. Smith
Rational Recurrences. EMNLP (2018)
Suchin Gururangan, Swabha Swayamdipta, Omer Levy, Roy Schwartz, Samuel R. Bowman, Noah A. Smith
Annotation Artifacts in Natural Language Inference Data. CoRR (2018)
Dongyeop Kang, Waleed Ammar, Bhavana Dalvi, Madeleine van Zuylen, Sebastian Kohlmeier, Eduard H. Hovy, Roy Schwartz
A Dataset of Peer Reviews (PeerRead): Collection, Insights and NLP Applications. CoRR (2018)
Dongyeop Kang, Waleed Ammar, Bhavana Dalvi, Madeleine van Zuylen, Sebastian Kohlmeier, Eduard H. Hovy, Roy Schwartz
A Dataset of Peer Reviews (PeerRead): Collection, Insights and NLP Applications. NAACL-HLT (2018)
Nelson F. Liu, Omer Levy, Roy Schwartz, Chenhao Tan, Noah A. Smith
LSTMs Exploit Linguistic Attributes of Data. CoRR (2018)
Hao Peng, Roy Schwartz, Sam Thomson, Noah A. Smith
Rational Recurrences. CoRR (2018)
Nelson F. Liu, Omer Levy, Roy Schwartz, Chenhao Tan, Noah A. Smith
LSTMs Exploit Linguistic Attributes of Data. Rep4NLP@ACL (2018)
Ivan Vulic, Roy Schwartz, Ari Rappoport, Roi Reichart, Anna Korhonen
Automatic Selection of Context Configurations for Improved Class-Specific Word Representations. CoNLL (2017)
Roy Schwartz, Maarten Sap, Ioannis Konstas, Leila Zilles, Yejin Choi, Noah A. Smith
The Effect of Different Writing Tasks on Linguistic Style: A Case Study of the ROC Story Cloze Task. CoNLL (2017)
Roy Schwartz, Maarten Sap, Ioannis Konstas, Leila Zilles, Yejin Choi, Noah A. Smith
The Effect of Different Writing Tasks on Linguistic Style: A Case Study of the ROC Story Cloze Task. CoRR (2017)
Roy Schwartz, Maarten Sap, Ioannis Konstas, Leila Zilles, Yejin Choi, Noah A. Smith
Story Cloze Task: UW NLP System. LSDSem@EACL (2017)
Roy Schwartz, Roi Reichart, Ari Rappoport
Symmetric Patterns and Coordinations: Fast and Enhanced Representations of Verbs and Adjectives. HLT-NAACL (2016)
Ivan Vulic, Roy Schwartz, Ari Rappoport, Roi Reichart, Anna Korhonen
Automatic Selection of Context Configurations for Improved (and Fast) Class-Specific Word Representations. CoRR (2016)
Roy Schwartz, Roi Reichart, Ari Rappoport
Symmetric Pattern Based Word Embeddings for Improved Word Similarity Prediction. CoNLL (2015)
Dana Rubinstein, Effi Levi, Roy Schwartz, Ari Rappoport
How Well Do Distributional Models Capture Different Types of Semantic Knowledge? ACL (2) (2015)
Roy Schwartz, Roi Reichart, Ari Rappoport
Minimally Supervised Classification to Semantic Categories using Automatically Acquired Symmetric Patterns. COLING (2014)
Roy Schwartz, Oren Tsur, Ari Rappoport, Moshe Koppel
Authorship Attribution of Micro-Messages. EMNLP (2013)
Roy Schwartz, Omri Abend, Ari Rappoport
Learnability-Based Syntactic Annotation Design. COLING (2012)
Roy Schwartz, Omri Abend, Roi Reichart, Ari Rappoport
Neutralizing Linguistically Problematic Annotations in Unsupervised Dependency Parsing Evaluation. ACL (2011)