Jack Hessel

Publication Activity (10 Years)

Years Active: 2013-2024
Publications (10 Years): 87

Top Topics

Instructional Videos

Symbolic Knowledge

Abductive Reasoning

Top Venues

Publications

Jiwan Chung, Sungjae Lee, Minseo Kim, Seungju Han, Ashkan Yousefpour, Jack Hessel, Youngjae Yu
Selective Vision is the Challenge for Visual Reasoning: A Benchmark for Visual Argument Understanding. CoRR (2024)
Khyathi Raghavi Chandu, Linjie Li, Anas Awadalla, Ximing Lu, Jae Sung Park, Jack Hessel, Lijuan Wang, Yejin Choi
Certainly Uncertain: A Benchmark and Metric for Multimodal Epistemic and Aleatoric Awareness. CoRR (2024)
Dirk Groeneveld, Iz Beltagy, Pete Walsh, Akshita Bhagia, Rodney Kinney, Oyvind Tafjord, Ananya Harsh Jha, Hamish Ivison, Ian Magnusson, Yizhong Wang, Shane Arora, David Atkinson, Russell Authur, Khyathi Raghavi Chandu, Arman Cohan, Jennifer Dumas, Yanai Elazar, Yuling Gu, Jack Hessel, Tushar Khot, William Merrill, Jacob Morrison, Niklas Muennighoff, Aakanksha Naik, Crystal Nam, Matthew E. Peters, Valentina Pyatkin, Abhilasha Ravichander, Dustin Schwenk, Saurabh Shah, Will Smith, Emma Strubell, Nishant Subramani, Mitchell Wortsman, Pradeep Dasigi, Nathan Lambert, Kyle Richardson, Luke Zettlemoyer, Jesse Dodge, Kyle Lo, Luca Soldaini, Noah A. Smith, Hannaneh Hajishirzi
OLMo: Accelerating the Science of Language Models. CoRR (2024)
Faeze Brahman, Sachin Kumar, Vidhisha Balachandran, Pradeep Dasigi, Valentina Pyatkin, Abhilasha Ravichander, Sarah Wiegreffe, Nouha Dziri, Khyathi Raghavi Chandu, Jack Hessel, Yulia Tsvetkov, Noah A. Smith, Yejin Choi, Hannaneh Hajishirzi
The Art of Saying No: Contextual Noncompliance in Language Models. CoRR (2024)
Wenting Zhao, Justin T. Chiu, Jena D. Hwang, Faeze Brahman, Jack Hessel, Sanjiban Choudhury, Yejin Choi, Xiang Li, Alane Suhr
UNcommonsense Reasoning: Abductive Reasoning about Uncommon Situations. NAACL-HLT (2024)
Anthony Sicilia, Hyunwoo Kim, Khyathi Raghavi Chandu, Malihe Alikhani, Jack Hessel
Deal, or no deal (or who knows)? Forecasting Uncertainty in Conversations using Large Language Models. ACL (Findings) (2024)
Tejas Srinivasan, Jack Hessel, Tanmay Gupta, Bill Yuchen Lin, Yejin Choi, Jesse Thomason, Khyathi Raghavi Chandu
Selective "Selective Prediction": Reducing Unnecessary Abstention in Vision-Language Reasoning. CoRR (2024)
Yutaro Yamada, Khyathi Chandu, Bill Yuchen Lin, Jack Hessel, Ilker Yildirim, Yejin Choi
L3GO: Language Agents with Chain-of-3D-Thoughts for Generating Unconventional Objects. CoRR (2024)
Wenting Zhao, Xiang Ren, Jack Hessel, Claire Cardie, Yejin Choi, Yuntian Deng
WildChat: 1M ChatGPT Interaction Logs in the Wild. CoRR (2024)
Jaeyoung Lee, Ximing Lu, Jack Hessel, Faeze Brahman, Youngjae Yu, Yonatan Bisk, Yejin Choi, Saadia Gabriel
How to Train Your Fact Verifier: Knowledge Transfer with Multimodal Open Models. CoRR (2024)
Sahana Ramnath, Brihi Joshi, Skyler Hallinan, Ximing Lu, Liunian Harold Li, Aaron Chan, Jack Hessel, Yejin Choi, Xiang Ren
Tailoring Self-Rationalizers with Multi-Reward Distillation. ICLR (2024)
Tejas Srinivasan, Jack Hessel, Tanmay Gupta, Bill Yuchen Lin, Yejin Choi, Jesse Thomason, Khyathi Raghavi Chandu
Selective "Selective Prediction": Reducing Unnecessary Abstention in Vision-Language Reasoning. ACL (Findings) (2024)
Wenting Zhao, Xiang Ren, Jack Hessel, Claire Cardie, Yejin Choi, Yuntian Deng
WildChat: 1M ChatGPT Interaction Logs in the Wild. ICLR (2024)
Anthony Sicilia, Hyunwoo Kim, Khyathi Raghavi Chandu, Malihe Alikhani, Jack Hessel
Deal, or no deal (or who knows)? Forecasting Uncertainty in Conversations using Large Language Models. CoRR (2024)
Liunian Harold Li, Jack Hessel, Youngjae Yu, Xiang Ren, Kai-Wei Chang, Yejin Choi
Symbolic Chain-of-Thought Distillation: Small Models Can Also "Think" Step-by-Step. CoRR (2023)
Wenting Zhao, Justin T. Chiu, Jena D. Hwang, Faeze Brahman, Jack Hessel, Sanjiban Choudhury, Yejin Choi, Xiang Lorraine Li, Alane Suhr
UNcommonsense Reasoning: Abductive Reasoning about Uncommon Situations. CoRR (2023)
Jae Sung Park, Jack Hessel, Khyathi Raghavi Chandu, Paul Pu Liang, Ximing Lu, Peter West, Youngjae Yu, Qiuyuan Huang, Jianfeng Gao, Ali Farhadi, Yejin Choi
Localized Symbolic Knowledge Distillation for Visual Commonsense Models. CoRR (2023)
Seungju Han, Jack Hessel, Nouha Dziri, Yejin Choi, Youngjae Yu
Champagne: Learning Real-world Conversation from Large-Scale Web Videos. ICCV (2023)
Seungju Han, Junhyeok Kim, Jack Hessel, Liwei Jiang, Jiwan Chung, Yejin Son, Yejin Choi, Youngjae Yu
Reading Books is Great, But Not if You Are Driving! Visually Grounded Reasoning about Defeasible Commonsense Norms. CoRR (2023)
Hyunwoo Kim, Jack Hessel, Liwei Jiang, Peter West, Ximing Lu, Youngjae Yu, Pei Zhou, Ronan Le Bras, Malihe Alikhani, Gunhee Kim, Maarten Sap, Yejin Choi
SODA: Million-scale Dialogue Distillation with Social Commonsense Contextualization. EMNLP (2023)
Rajkumar Ramamurthy, Prithviraj Ammanabrolu, Kianté Brantley, Jack Hessel, Rafet Sifa, Christian Bauckhage, Hannaneh Hajishirzi, Yejin Choi
Is Reinforcement Learning (Not) for Natural Language Processing: Benchmarks, Baselines, and Building Blocks for Natural Language Policy Optimization. ICLR (2023)
Amita Kamath, Jack Hessel, Kai-Wei Chang
What's "up" with vision-language models? Investigating their struggle with spatial reasoning. EMNLP (2023)
Sahana Ramnath, Brihi Joshi, Skyler Hallinan, Ximing Lu, Liunian Harold Li, Aaron Chan, Jack Hessel, Yejin Choi, Xiang Ren
Tailoring Self-Rationalizers with Multi-Reward Distillation. CoRR (2023)
Seungju Han, Jack Hessel, Nouha Dziri, Yejin Choi, Youngjae Yu
CHAMPAGNE: Learning Real-world Conversation from Large-Scale Web Videos. CoRR (2023)
Youngjae Yu, Jiwan Chung, Heeseung Yun, Jack Hessel, Jae Sung Park, Ximing Lu, Rowan Zellers, Prithviraj Ammanabrolu, Ronan Le Bras, Gunhee Kim, Yejin Choi
Fusing Pre-Trained Language Models with Multimodal Prompts through Reinforcement Learning. CVPR (2023)
Wanrong Zhu, Jack Hessel, Anas Awadalla, Samir Yitzhak Gadre, Jesse Dodge, Alex Fang, Youngjae Yu, Ludwig Schmidt, William Yang Wang, Yejin Choi
Multimodal C4: An Open, Billion-scale Corpus of Images Interleaved with Text. NeurIPS (2023)
Amita Kamath, Jack Hessel, Kai-Wei Chang
What's "up" with vision-language models? Investigating their struggle with spatial reasoning. CoRR (2023)
Jack Hessel, Ana Marasovic, Jena D. Hwang, Lillian Lee, Jeff Da, Rowan Zellers, Robert Mankoff, Yejin Choi
Do Androids Laugh at Electric Sheep? Humor "Understanding" Benchmarks from The New Yorker Caption Contest. ACL (1) (2023)
Yizhong Wang, Hamish Ivison, Pradeep Dasigi, Jack Hessel, Tushar Khot, Khyathi Chandu, David Wadden, Kelsey MacMillan, Noah A. Smith, Iz Beltagy, Hannaneh Hajishirzi
How Far Can Camels Go? Exploring the State of Instruction Tuning on Open Resources. NeurIPS (2023)
Liunian Harold Li, Jack Hessel, Youngjae Yu, Xiang Ren, Kai-Wei Chang, Yejin Choi
Symbolic Chain-of-Thought Distillation: Small Models Can Also "Think" Step-by-Step. ACL (1) (2023)
Binzhu Xie, Sicheng Zhang, Zitang Zhou, Bo Li, Yuanhan Zhang, Jack Hessel, Jingkang Yang, Ziwei Liu
FunQA: Towards Surprising Video Comprehension. CoRR (2023)
Wanrong Zhu, Jack Hessel, Anas Awadalla, Samir Yitzhak Gadre, Jesse Dodge, Alex Fang, Youngjae Yu, Ludwig Schmidt, William Yang Wang, Yejin Choi
Multimodal C4: An Open, Billion-scale Corpus of Images Interleaved With Text. CoRR (2023)
Anas Awadalla, Irena Gao, Josh Gardner, Jack Hessel, Yusuf Hanafy, Wanrong Zhu, Kalyani Marathe, Yonatan Bitton, Samir Yitzhak Gadre, Shiori Sagawa, Jenia Jitsev, Simon Kornblith, Pang Wei Koh, Gabriel Ilharco, Mitchell Wortsman, Ludwig Schmidt
OpenFlamingo: An Open-Source Framework for Training Large Autoregressive Vision-Language Models. CoRR (2023)
Yonatan Bitton, Hritik Bansal, Jack Hessel, Rulin Shao, Wanrong Zhu, Anas Awadalla, Josh Gardner, Rohan Taori, Ludwig Schmidt
VisIT-Bench: A Dynamic Benchmark for Evaluating Instruction-Following Vision-and-Language Models. NeurIPS (2023)
Peter West, Ronan Le Bras, Taylor Sorensen, Bill Yuchen Lin, Liwei Jiang, Ximing Lu, Khyathi Chandu, Jack Hessel, Ashutosh Baheti, Chandra Bhagavatula, Yejin Choi
NovaCOMET: Open Commonsense Foundation Models with Symbolic Knowledge Distillation. CoRR (2023)
Jae Sung Park, Jack Hessel, Khyathi Chandu, Paul Pu Liang, Ximing Lu, Peter West, Youngjae Yu, Qiuyuan Huang, Jianfeng Gao, Ali Farhadi, Yejin Choi
Localized Symbolic Knowledge Distillation for Visual Commonsense Models. NeurIPS (2023)
Amita Kamath, Jack Hessel, Kai-Wei Chang
Text encoders are performance bottlenecks in contrastive vision-language models. CoRR (2023)
Nitzan Bitton Guetta, Yonatan Bitton, Jack Hessel, Ludwig Schmidt, Yuval Elovici, Gabriel Stanovsky, Roy Schwartz
Breaking Common Sense: WHOOPS! A Vision-and-Language Benchmark of Synthetic and Compositional Images. ICCV (2023)
Amita Kamath, Jack Hessel, Kai-Wei Chang
Text encoders bottleneck compositionality in contrastive vision-language models. EMNLP (2023)
Yizhong Wang, Hamish Ivison, Pradeep Dasigi, Jack Hessel, Tushar Khot, Khyathi Raghavi Chandu, David Wadden, Kelsey MacMillan, Noah A. Smith, Iz Beltagy, Hannaneh Hajishirzi
How Far Can Camels Go? Exploring the State of Instruction Tuning on Open Resources. CoRR (2023)
Joel Jang, Seungone Kim, Bill Yuchen Lin, Yizhong Wang, Jack Hessel, Luke Zettlemoyer, Hannaneh Hajishirzi, Yejin Choi, Prithviraj Ammanabrolu
Personalized Soups: Personalized Large Language Model Alignment via Post-hoc Parameter Merging. CoRR (2023)
Nitzan Bitton Guetta, Yonatan Bitton, Jack Hessel, Ludwig Schmidt, Yuval Elovici, Gabriel Stanovsky, Roy Schwartz
Breaking Common Sense: WHOOPS! A Vision-and-Language Benchmark of Synthetic and Compositional Images. CoRR (2023)
Seungju Han, Junhyeok Kim, Jack Hessel, Liwei Jiang, Jiwan Chung, Yejin Son, Yejin Choi, Youngjae Yu
Reading Books is Great, But Not if You Are Driving! Visually Grounded Reasoning about Defeasible Commonsense Norms. EMNLP (2023)
Peter West, Ronan Le Bras, Taylor Sorensen, Bill Lin, Liwei Jiang, Ximing Lu, Khyathi Chandu, Jack Hessel, Ashutosh Baheti, Chandra Bhagavatula, Yejin Choi
NovaCOMET: Open Commonsense Foundation Models with Symbolic Knowledge Distillation. EMNLP (Findings) (2023)
Yonatan Bitton, Hritik Bansal, Jack Hessel, Rulin Shao, Wanrong Zhu, Anas Awadalla, Josh Gardner, Rohan Taori, Ludwig Schmidt
VisIT-Bench: A Benchmark for Vision-Language Instruction Following Inspired by Real-World Use. CoRR (2023)
Ximing Lu, Sean Welleck, Jack Hessel, Liwei Jiang, Lianhui Qin, Peter West, Prithviraj Ammanabrolu, Yejin Choi
QUARK: Controllable Text Generation with Reinforced Unlearning. NeurIPS (2022)
Yanpeng Zhao, Jack Hessel, Youngjae Yu, Ximing Lu, Rowan Zellers, Yejin Choi
Connecting the Dots between Audio and Text without Parallel Data through Visual Knowledge Transfer. NAACL-HLT (2022)
Hyunwoo Kim, Jack Hessel, Liwei Jiang, Ximing Lu, Youngjae Yu, Pei Zhou, Ronan Le Bras, Malihe Alikhani, Gunhee Kim, Maarten Sap, Yejin Choi
SODA: Million-scale Dialogue Distillation with Social Commonsense Contextualization. CoRR (2022)
Rowan Zellers, Jiasen Lu, Ximing Lu, Youngjae Yu, Yanpeng Zhao, Mohammadreza Salehi, Aditya Kusupati, Jack Hessel, Ali Farhadi, Yejin Choi
MERLOT RESERVE: Neural Script Knowledge through Vision and Language and Sound. CVPR (2022)
Jack Hessel, Jena D. Hwang, Jae Sung Park, Rowan Zellers, Chandra Bhagavatula, Anna Rohrbach, Kate Saenko, Yejin Choi
The Abduction of Sherlock Holmes: A Dataset for Visual Abductive Reasoning. CoRR (2022)
Sarah Wiegreffe, Jack Hessel, Swabha Swayamdipta, Mark O. Riedl, Yejin Choi
Reframing Human-AI Collaboration for Generating Free-Text Explanations. NAACL-HLT (2022)
Jack Hessel, Ana Marasovic, Jena D. Hwang, Lillian Lee, Jeff Da, Rowan Zellers, Robert Mankoff, Yejin Choi
Do Androids Laugh at Electric Sheep? Humor "Understanding" Benchmarks from The New Yorker Caption Contest. CoRR (2022)
Rowan Zellers, Jiasen Lu, Ximing Lu, Youngjae Yu, Yanpeng Zhao, Mohammadreza Salehi, Aditya Kusupati, Jack Hessel, Ali Farhadi, Yejin Choi
MERLOT Reserve: Neural Script Knowledge through Vision and Language and Sound. CoRR (2022)
Youngjae Yu, Jiwan Chung, Heeseung Yun, Jack Hessel, Jae Sung Park, Ximing Lu, Prithviraj Ammanabrolu, Rowan Zellers, Ronan Le Bras, Gunhee Kim, Yejin Choi
Multimodal Knowledge Alignment with Reinforcement Learning. CoRR (2022)
Jack Hessel, Jena D. Hwang, Jae Sung Park, Rowan Zellers, Chandra Bhagavatula, Anna Rohrbach, Kate Saenko, Yejin Choi
The Abduction of Sherlock Holmes: A Dataset for Visual Abductive Reasoning. ECCV (36) (2022)
Ximing Lu, Sean Welleck, Liwei Jiang, Jack Hessel, Lianhui Qin, Peter West, Prithviraj Ammanabrolu, Yejin Choi
Quark: Controllable Text Generation with Reinforced Unlearning. CoRR (2022)
Rajkumar Ramamurthy, Prithviraj Ammanabrolu, Kianté Brantley, Jack Hessel, Rafet Sifa, Christian Bauckhage, Hannaneh Hajishirzi, Yejin Choi
Is Reinforcement Learning (Not) for Natural Language Processing?: Benchmarks, Baselines, and Building Blocks for Natural Language Policy Optimization. CoRR (2022)
Peter West, Chandra Bhagavatula, Jack Hessel, Jena D. Hwang, Liwei Jiang, Ronan Le Bras, Ximing Lu, Sean Welleck, Yejin Choi
Symbolic Knowledge Distillation: from General Language Models to Commonsense Models. NAACL-HLT (2022)
Jack Hessel, Alexandra Schofield
How effective is BERT without word ordering? Implications for language understanding and data privacy. ACL/IJCNLP (2) (2021)
Jack Hessel, Ari Holtzman, Maxwell Forbes, Ronan Le Bras, Yejin Choi
CLIPScore: A Reference-free Evaluation Metric for Image Captioning. EMNLP (1) (2021)
Yanpeng Zhao, Jack Hessel, Youngjae Yu, Ximing Lu, Rowan Zellers, Yejin Choi
Connecting the Dots between Audio and Text without Parallel Data through Visual Knowledge Transfer. CoRR (2021)
Sarah Wiegreffe, Jack Hessel, Swabha Swayamdipta, Mark Riedl, Yejin Choi
Reframing Human-AI Collaboration for Generating Free-Text Explanations. CoRR (2021)
Rowan Zellers, Ximing Lu, Jack Hessel, Youngjae Yu, Jae Sung Park, Jize Cao, Ali Farhadi, Yejin Choi
MERLOT: Multimodal Neural Script Knowledge Models. CoRR (2021)
Rowan Zellers, Ximing Lu, Jack Hessel, Youngjae Yu, Jae Sung Park, Jize Cao, Ali Farhadi, Yejin Choi
MERLOT: Multimodal Neural Script Knowledge Models. NeurIPS (2021)
Peter West, Chandra Bhagavatula, Jack Hessel, Jena D. Hwang, Liwei Jiang, Ronan Le Bras, Ximing Lu, Sean Welleck, Yejin Choi
Symbolic Knowledge Distillation: from General Language Models to Commonsense Models. CoRR (2021)
Jack Hessel, Ari Holtzman, Maxwell Forbes, Ronan Le Bras, Yejin Choi
CLIPScore: A Reference-free Evaluation Metric for Image Captioning. CoRR (2021)
Jack Hessel, Zhenhai Zhu, Bo Pang, Radu Soricut
Beyond Instructional Videos: Probing for More Diverse Visual-Textual Grounding on YouTube. EMNLP (1) (2020)
Gregory Yauney, Jack Hessel, David Mimno
Domain-Specific Lexical Grounding in Noisy Visual-Textual Documents. CoRR (2020)
Jack Hessel, Lillian Lee
Does my multimodal model learn cross-modal interactions? It's harder to tell than you might think! CoRR (2020)
Jack Hessel, Zhenhai Zhu, Bo Pang, Radu Soricut
Beyond Instructional Videos: Probing for More Diverse Visual-Textual Grounding on YouTube. CoRR (2020)
Gregory Yauney, Jack Hessel, David Mimno
Domain-Specific Lexical Grounding in Noisy Visual-Textual Documents. EMNLP (1) (2020)
Jack Hessel, Lillian Lee
Does my multimodal model learn cross-modal interactions? It's harder to tell than you might think! EMNLP (1) (2020)
Jack Hessel, Lillian Lee, David Mimno
Unsupervised Discovery of Multimodal Links in Multi-image, Multi-sentence Documents. EMNLP/IJCNLP (1) (2019)
Jack Hessel, Bo Pang, Zhenhai Zhu, Radu Soricut
A Case Study on Combining ASR and Visual Features for Generating Instructional Video Captions. CoRR (2019)
Jack Hessel, Lillian Lee, David Mimno
Unsupervised Discovery of Multimodal Links in Multi-Image, Multi-Sentence Documents. CoRR (2019)
Jack Hessel, Lillian Lee
Something's Brewing! Early Prediction of Controversy-causing Posts from Discussion Features. NAACL-HLT (1) (2019)
Jack Hessel, Bo Pang, Zhenhai Zhu, Radu Soricut
A Case Study on Combining ASR and Visual Features for Generating Instructional Video Captions. CoNLL (2019)
Jack Hessel, Lillian Lee
Something's Brewing! Early Prediction of Controversy-causing Posts from Discussion Features. CoRR (2019)
Jack Hessel, David M. Mimno, Lillian Lee
Quantifying the visual concreteness of words and topics in multimodal datasets. CoRR (2018)
Jack Hessel, David M. Mimno, Lillian Lee
Quantifying the Visual Concreteness of Words and Topics in Multimodal Datasets. NAACL-HLT (2018)
Jack Hessel, Lillian Lee, David M. Mimno
Cats and Captions vs. Creators and the Clock: Comparing Multimodal Content to Context in Predicting Relative Popularity. CoRR (2017)
Jack Hessel, Lillian Lee, David M. Mimno
Cats and Captions vs. Creators and the Clock: Comparing Multimodal Content to Context in Predicting Relative Popularity. WWW (2017)
Jack Hessel, Chenhao Tan, Lillian Lee
Science, AskScience, and BadScience: On the Coexistence of Highly Related Communities. ICWSM (2016)
Jack Hessel, Chenhao Tan, Lillian Lee
Science, AskScience, and BadScience: On the Coexistence of Highly Related Communities. CoRR (2016)
Jack Hessel, Nicolas Savva, Michael J. Wilber
Image Representations and New Domains in Neural Image Captioning. CoRR (2015)
Jack Hessel, Nicolas Savva, Michael J. Wilber
Image Representations and New Domains in Neural Image Captioning. VL@EMNLP (2015)
Jack Hessel, Alexandra Schofield, Lillian Lee, David M. Mimno
What do Vegans do in their Spare Time? Latent Interest Detection in Multi-Community Networks. CoRR (2015)
Jack Hessel, Sherri Goings
Evolving multicellularity in digital organisms through reproductive altruism. GECCO (Companion) (2013)
Jack Hessel, Sherri Goings
Using Reproductive Altruism to Evolve Multicellularity in Digital Organisms. ECAL (2013)