Jesse Thomason

Publication Activity (10 Years)

Years Active: 2014-2024
Publications (10 Years): 96

Top Topics

Natural Language

Sign Recognition

Embodied Agents

Top Venues

Publications

Ting-Yun Chang, Jesse Thomason, Robin Jia
Do Localization Methods Actually Localize Memorized Data in LLMs? A Tale of Two Benchmarks. NAACL-HLT (2024)
Ting-Yun Chang, Jesse Thomason, Robin Jia
When Parts are Greater Than Sums: Individual LLM Components Can Outperform Full Models. CoRR (2024)
Anthony Liang, Jesse Thomason, Erdem Biyik
ViSaRL: Visual Reinforcement Learning Guided by Human Saliency. CoRR (2024)
Wang Zhu, Ishika Singh, Robin Jia, Jesse Thomason
Language Models can Infer Action Semantics for Classical Planners from Environment Feedback. CoRR (2024)
Wilbert Pumacay, Ishika Singh, Jiafei Duan, Ranjay Krishna, Jesse Thomason, Dieter Fox
THE COLOSSEUM: A Benchmark for Evaluating Generalization for Robotic Manipulation. CoRR (2024)
Tejas Srinivasan, Jack Hessel, Tanmay Gupta, Bill Yuchen Lin, Yejin Choi, Jesse Thomason, Khyathi Raghavi Chandu
Selective "Selective Prediction": Reducing Unnecessary Abstention in Vision-Language Reasoning. CoRR (2024)
Ishika Singh, David Traum, Jesse Thomason
TwoStep: Multi-agent Task Planning using Classical Planners and Large Language Models. CoRR (2024)
Chancharik Mitra, Abrar Anwar, Rodolfo Corona, Dan Klein, Trevor Darrell, Jesse Thomason
Which One? Leveraging Context Between Objects and Multiple Views for Language Grounding. NAACL-HLT (2024)
Zain Merchant, Abrar Anwar, Emily Wang, Souti Chattopadhyay, Jesse Thomason
Generating Contextually-Relevant Navigation Instructions for Blind and Low Vision People. CoRR (2024)
Tejas Srinivasan, Jack Hessel, Tanmay Gupta, Bill Yuchen Lin, Yejin Choi, Jesse Thomason, Khyathi Raghavi Chandu
Selective "Selective Prediction": Reducing Unnecessary Abstention in Vision-Language Reasoning. ACL (Findings) (2024)
Woojeong Jin, Tejas Srinivasan, Jesse Thomason, Xiang Ren
WinoViz: Probing Visual Properties of Objects Under Different States. CoRR (2024)
Abrar Anwar, Rohan Gupta, Jesse Thomason
Contrast Sets for Evaluating Language-Guided Robot Policies. CoRR (2024)
Wang Zhu, Alekh Agarwal, Mandar Joshi, Robin Jia, Jesse Thomason, Kristina Toutanova
Efficient End-to-End Visual Document Understanding with Rationale Distillation. NAACL-HLT (2024)
Lee Kezar, Riley Carlin, Tejas Srinivasan, Zed Sevcikova Sehyr, Naomi Caselli, Jesse Thomason
Exploring Strategies for Modeling Sign Language Phonology. CoRR (2023)
Lee Kezar, Jesse Thomason, Zed Sevcikova Sehyr
Improving Sign Recognition with Phonology. CoRR (2023)
Lee Kezar, Jesse Thomason, Naomi Caselli, Zed Sevcikova Sehyr, Elana Pontecorvo
The Sem-Lex Benchmark: Modeling ASL Signs and their Phonemes. ASSETS (2023)
Julie Jiang, Jesse Thomason, Francesco Barbieri, Emilio Ferrara
Geolocated Social Media Posts are Happier: Understanding the Characteristics of Check-in Posts on Twitter. WebSci (2023)
Lee Kezar, Elana Pontecorvo, Adele Daniels, Connor Baer, Ruth Ferster, Lauren Berger, Jesse Thomason, Zed Sevcikova Sehyr, Naomi Caselli
The Sem-Lex Benchmark: Modeling ASL Signs and Their Phonemes. CoRR (2023)
Gunnar A. Sigurdsson, Jesse Thomason, Gaurav S. Sukhatme, Robinson Piramuthu
RREx-BoT: Remote Referring Expressions with a Bag of Tricks. IROS (2023)
Yuliang Cai, Jesse Thomason, Mohammad Rostami
Task-Attentive Transformer Architecture for Continual Learning of Vision-and-Language Tasks Using Knowledge Distillation. CoRR (2023)
Lee Kezar, Tejas Srinivasan, Riley Carlin, Jesse Thomason, Zed Sevcikova Sehyr, Naomi Caselli
Exploring Strategies for Modeling Sign Language Phonology. ESANN (2023)
Ishika Singh, Valts Blukis, Arsalan Mousavian, Ankit Goyal, Danfei Xu, Jonathan Tremblay, Dieter Fox, Jesse Thomason, Animesh Garg
ProgPrompt: Generating Situated Robot Task Plans using Large Language Models. ICRA (2023)
Wang Zhu, Ishika Singh, Yuan Huang, Robin Jia, Jesse Thomason
Does VLN Pretraining Work with Nonsensical or Irrelevant Instructions? CoRR (2023)
Tejas Srinivasan, Xiang Ren, Jesse Thomason
Curriculum Learning for Data-Efficient Vision-Language Alignment. CVPR Workshops (2023)
Wang Zhu, Jesse Thomason, Robin Jia
Chain-of-Questions Training with Latent Answers for Robust Multistep Question Answering. CoRR (2023)
Xiaohan Zhang, Saeid Amiri, Jivko Sinapov, Jesse Thomason, Peter Stone, Shiqi Zhang
Multimodal embodied attribute learning by robots for object-centric action policies. Auton. Robots 47 (5) (2023)
Wang Zhu, Alekh Agarwal, Mandar Joshi, Robin Jia, Jesse Thomason, Kristina Toutanova
Efficient End-to-End Visual Document Understanding with Rationale Distillation. CoRR (2023)
Ting-Yun Chang, Jesse Thomason, Robin Jia
Do Localization Methods Actually Localize Memorized Data in LLMs? CoRR (2023)
Lee Kezar, Jesse Thomason, Zed Sevcikova Sehyr
Improving Sign Recognition with Phonology. EACL (2023)
Wang Zhu, Jesse Thomason, Robin Jia
Chain-of-Questions Training with Latent Answers for Robust Multistep Question Answering. EMNLP (2023)
Gunnar A. Sigurdsson, Jesse Thomason, Gaurav S. Sukhatme, Robinson Piramuthu
RREx-BoT: Remote Referring Expressions with a Bag of Tricks. CoRR (2023)
Ishika Singh, Valts Blukis, Arsalan Mousavian, Ankit Goyal, Danfei Xu, Jonathan Tremblay, Dieter Fox, Jesse Thomason, Animesh Garg
ProgPrompt: program generation for situated robot task planning using large language models. Auton. Robots 47 (8) (2023)
Tejas Srinivasan, Furong Jia, Mohammad Rostami, Jesse Thomason
I2I: Initializing Adapters with Improvised Knowledge. CoRR (2023)
Jacob Krantz, Shurjo Banerjee, Wang Zhu, Jason J. Corso, Peter Anderson, Stefan Lee, Jesse Thomason
Iterative Vision-and-Language Navigation. CVPR (2023)
Allen Chang, Xiaoyuan Zhu, Aarav Monga, Seoho Ahn, Tejas Srinivasan, Jesse Thomason
Multimodal Speech Recognition for Language-Guided Embodied Agents. CoRR (2023)
Tejas Srinivasan, Furong Jia, Mohammad Rostami, Jesse Thomason
I2I: Initializing Adapters with Improvised Knowledge. CoLLAs (2023)
Chancharik Mitra, Abrar Anwar, Rodolfo Corona, Dan Klein, Trevor Darrell, Jesse Thomason
Comparative Multi-View Language Grounding. CoRR (2023)
Allen Chang, Xiaoyuan Zhu, Aarav Monga, Seoho Ahn, Tejas Srinivasan, Jesse Thomason
Multimodal Speech Recognition for Language-Guided Embodied Agents. INTERSPEECH (2023)
Yuliang Cai, Jesse Thomason, Mohammad Rostami
Task-Attentive Transformer Architecture for Continual Learning of Vision-and-Language Tasks Using Knowledge Distillation. EMNLP (Findings) (2023)
Tejas Srinivasan, Ting-Yun Chang, Leticia Leonor Pinto Alva, Georgios Chochlakis, Mohammad Rostami, Jesse Thomason
CLiMB: A Continual Learning Benchmark for Vision-and-Language Tasks. CoRR (2022)
Julie Jiang, Jesse Thomason, Francesco Barbieri, Emilio Ferrara
Geolocated Social Media Posts are Happier: Understanding the Characteristics of Check-in Posts on Twitter. CoRR (2022)
Matt Deitke, Dhruv Batra, Yonatan Bisk, Tommaso Campari, Angel X. Chang, Devendra Singh Chaplot, Changan Chen, Claudia Pérez-D'Arpino, Kiana Ehsani, Ali Farhadi, Li Fei-Fei, Anthony G. Francis, Chuang Gan, Kristen Grauman, David Hall, Winson Han, Unnat Jain, Aniruddha Kembhavi, Jacob Krantz, Stefan Lee, Chengshu Li, Sagnik Majumder, Oleksandr Maksymets, Roberto Martín-Martín, Roozbeh Mottaghi, Sonia Raychaudhuri, Mike Roberts, Silvio Savarese, Manolis Savva, Mohit Shridhar, Niko Sünderhauf, Andrew Szot, Ben Talbot, Joshua B. Tenenbaum, Jesse Thomason, Alexander Toshev, Joanne Truong, Luca Weihs, Jiajun Wu
Retrospectives on the Embodied AI Workshop. CoRR (2022)
Georgios Chochlakis, Tejas Srinivasan, Jesse Thomason, Shrikanth Narayanan
VAuLT: Augmenting the Vision-and-Language Transformer with the Propagation of Deep Language Representations. CoRR (2022)
Jing Gu, Eliana Stefani, Qi Wu, Jesse Thomason, Xin Eric Wang
Vision-and-Language Navigation: A Survey of Tasks, Methods, and Future Directions. CoRR (2022)
Tejas Srinivasan, Xiang Ren, Jesse Thomason
Curriculum Learning for Data-Efficient Vision-Language Alignment. CoRR (2022)
Sara Mohammadinejad, Jesse Thomason, Jyotirmoy V. Deshmukh
Interactive Learning from Natural Language and Demonstrations using Signal Temporal Logic. CoRR (2022)
Jing Gu, Eliana Stefani, Qi Wu, Jesse Thomason, Xin Wang
Vision-and-Language Navigation: A Survey of Tasks, Methods, and Future Directions. ACL (1) (2022)
Arjun R. Akula, Spandana Gella, Aishwarya Padmakumar, Mahdi Namazifar, Mohit Bansal, Jesse Thomason, Dilek Hakkani-Tur
ALFRED-L: Investigating the Role of Language for Action Learning in Interactive Visual Environments. EMNLP (2022)
Tejas Srinivasan, Ting-Yun Chang, Leticia Leonor Pinto Alva, Georgios Chochlakis, Mohammad Rostami, Jesse Thomason
CLiMB: A Continual Learning Benchmark for Vision-and-Language Tasks. NeurIPS (2022)
Ishika Singh, Valts Blukis, Arsalan Mousavian, Ankit Goyal, Danfei Xu, Jonathan Tremblay, Dieter Fox, Jesse Thomason, Animesh Garg
ProgPrompt: Generating Situated Robot Task Plans using Large Language Models. CoRR (2022)
Wang Zhu, Jesse Thomason, Robin Jia
Generalization Differences between End-to-End and Neuro-Symbolic Vision-Language Reasoning Systems. CoRR (2022)
Aishwarya Padmakumar, Jesse Thomason, Ayush Shrivastava, Patrick Lange, Anjali Narayan-Chen, Spandana Gella, Robinson Piramuthu, Gökhan Tür, Dilek Hakkani-Tür
TEACh: Task-Driven Embodied Agents That Chat. AAAI (2022)
Wang Zhu, Jesse Thomason, Robin Jia
Generalization Differences between End-to-End and Neuro-Symbolic Vision-Language Reasoning Systems. EMNLP (Findings) (2022)
Vishnu Sashank Dorbala, Gunnar A. Sigurdsson, Robinson Piramuthu, Jesse Thomason, Gaurav S. Sukhatme
CLIP-Nav: Using CLIP for Zero-Shot Vision-and-Language Navigation. CoRR (2022)
Arjun Majumdar, Gunnar A. Sigurdsson, Robinson Piramuthu, Jesse Thomason, Dhruv Batra, Gaurav S. Sukhatme
SSL Enables Learning from Sparse Rewards in Image-Goal Navigation. ICML (2022)
Jacob Krantz, Shurjo Banerjee, Wang Zhu, Jason J. Corso, Peter Anderson, Stefan Lee, Jesse Thomason
Iterative Vision-and-Language Navigation. CoRR (2022)
Jesse Thomason, Mohit Shridhar, Yonatan Bisk, Chris Paxton, Luke Zettlemoyer
Language Grounding with 3D Objects. CoRR (2021)
Alessandro Suglia, Qiaozi Gao, Jesse Thomason, Govind Thattai, Gaurav Sukhatme
Embodied BERT: A Transformer Model for Embodied, Language-guided Visual Task Completion. CoRR (2021)
Jesse Thomason, Mohit Shridhar, Yonatan Bisk, Chris Paxton, Luke Zettlemoyer
Language Grounding with 3D Objects. CoRL (2021)
Yizhou Zhao, Kaixiang Lin, Zhiwei Jia, Qiaozi Gao, Govind Thattai, Jesse Thomason, Gaurav S. Sukhatme
LUMINOUS: Indoor Scene Generation for Embodied AI Challenges. CoRR (2021)
Aishwarya Padmakumar, Jesse Thomason, Ayush Shrivastava, Patrick Lange, Anjali Narayan-Chen, Spandana Gella, Robinson Piramuthu, Gökhan Tür, Dilek Hakkani-Tür
TEACh: Task-driven Embodied Agents that Chat. CoRR (2021)
Shurjo Banerjee, Jesse Thomason, Jason J. Corso
The RobotSlang Benchmark: Dialog-guided Robot Localization and Navigation. CoRR (2020)
Collin Burns, Jesse Thomason, Wesley Tansey
Interpreting Black Box Models via Hypothesis Testing. FODS (2020)
Homero Roman Roman, Yonatan Bisk, Jesse Thomason, Asli Celikyilmaz, Jianfeng Gao
RMM: A Recursive Mental Model for Dialog Navigation. CoRR (2020)
Homero Roman Roman, Yonatan Bisk, Jesse Thomason, Asli Celikyilmaz, Jianfeng Gao
RMM: A Recursive Mental Model for Dialog Navigation. EMNLP (Findings) (2020)
Yonatan Bisk, Ari Holtzman, Jesse Thomason, Jacob Andreas, Yoshua Bengio, Joyce Chai, Mirella Lapata, Angeliki Lazaridou, Jonathan May, Aleksandr Nisnevich, Nicolas Pinto, Joseph P. Turian
Experience Grounds Language. EMNLP (1) (2020)
Jesse Thomason, Aishwarya Padmakumar, Jivko Sinapov, Nick Walker, Yuqian Jiang, Harel Yedidsion, Justin W. Hart, Peter Stone, Raymond J. Mooney
Jointly Improving Parsing and Perception for Natural Language Commands through Human-Robot Dialog. J. Artif. Intell. Res. 67 (2020)
Shurjo Banerjee, Jesse Thomason, Jason J. Corso
The RobotSlang Benchmark: Dialog-guided Robot Localization and Navigation. CoRL (2020)
Mohit Shridhar, Jesse Thomason, Daniel Gordon, Yonatan Bisk, Winson Han, Roozbeh Mottaghi, Luke Zettlemoyer, Dieter Fox
ALFRED: A Benchmark for Interpreting Grounded Instructions for Everyday Tasks. CVPR (2020)
Yonatan Bisk, Ari Holtzman, Jesse Thomason, Jacob Andreas, Yoshua Bengio, Joyce Chai, Mirella Lapata, Angeliki Lazaridou, Jonathan May, Aleksandr Nisnevich, Nicolas Pinto, Joseph P. Turian
Experience Grounds Language. CoRR (2020)
Jesse Thomason, Daniel Gordon, Yonatan Bisk
Shifting the Baseline: Single Modality Performance on Visual Navigation & QA. NAACL-HLT (1) (2019)
Jesse Thomason, Aishwarya Padmakumar, Jivko Sinapov, Nick Walker, Yuqian Jiang, Harel Yedidsion, Justin W. Hart, Peter Stone, Raymond J. Mooney
Improving Grounded Natural Language Understanding through Human-Robot Dialog. CoRR (2019)
Rosario Scalise, Jesse Thomason, Yonatan Bisk, Siddhartha S. Srinivasa
Improving Robot Success Detection using Static Object Data. IROS (2019)
Chris Paxton, Yonatan Bisk, Jesse Thomason, Arunkumar Byravan, Dieter Fox
Prospection: Interpretable plans from language by predicting the future. ICRA (2019)
Jesse Thomason, Michael Murray, Maya Cakmak, Luke Zettlemoyer
Vision-and-Dialog Navigation. CoRR (2019)
Saeid Amiri, Sujay Bajracharya, Cihangir Goktolga, Jesse Thomason, Shiqi Zhang
Augmenting Knowledge through Statistical, Goal-oriented Human-Robot Dialog. CoRR (2019)
Chris Paxton, Yonatan Bisk, Jesse Thomason, Arunkumar Byravan, Dieter Fox
Prospection: Interpretable Plans From Language By Predicting the Future. CoRR (2019)
Rosario Scalise, Jesse Thomason, Yonatan Bisk, Siddhartha S. Srinivasa
Improving Robot Success Detection using Static Object Data. CoRR (2019)
Mohit Shridhar, Jesse Thomason, Daniel Gordon, Yonatan Bisk, Winson Han, Roozbeh Mottaghi, Luke Zettlemoyer, Dieter Fox
ALFRED: A Benchmark for Interpreting Grounded Instructions for Everyday Tasks. CoRR (2019)
Saeid Amiri, Sujay Bajracharya, Cihangir Goktolga, Jesse Thomason, Shiqi Zhang
Augmenting Knowledge through Statistical, Goal-oriented Human-Robot Dialog. IROS (2019)
Jesse Thomason, Michael Murray, Maya Cakmak, Luke Zettlemoyer
Vision-and-Dialog Navigation. CoRL (2019)
Jesse Thomason, Aishwarya Padmakumar, Jivko Sinapov, Nick Walker, Yuqian Jiang, Harel Yedidsion, Justin W. Hart, Peter Stone, Raymond J. Mooney
Improving Grounded Natural Language Understanding through Human-Robot Dialog. ICRA (2019)
Collin Burns, Jesse Thomason, Wesley Tansey
Interpreting Black Box Models with Statistical Guarantees. CoRR (2019)
Saeid Amiri, Suhua Wei, Shiqi Zhang, Jivko Sinapov, Jesse Thomason, Peter Stone
Robot Behavioral Exploration and Multi-modal Perception using Dynamically Constructed Controllers. AAAI Spring Symposia (2018)
Jesse Thomason, Jivko Sinapov, Raymond J. Mooney, Peter Stone
Guiding Exploratory Behaviors for Multi-Modal Grounding of Linguistic Descriptions. AAAI (2018)
Justin W. Hart, Harel Yedidsion, Yuqian Jiang, Nick Walker, Rishi Shah, Jesse Thomason, Aishwarya Padmakumar, Rolando Fernandez, Jivko Sinapov, Raymond J. Mooney, Peter Stone
Interaction and Autonomy in RoboCup@Home and Building-Wide Intelligence. CoRR (2018)
Saeid Amiri, Suhua Wei, Shiqi Zhang, Jivko Sinapov, Jesse Thomason, Peter Stone
Multi-modal Predicate Identification using Dynamically Learned Robot Controllers. IJCAI (2018)
Wesley Tansey, Jesse Thomason, James G. Scott
Maximum-Variance Total Variation Denoising for Interpretable Spatial Smoothing. AAAI (2018)
Jesse Thomason, Daniel Gordon, Yonatan Bisk
Shifting the Baseline: Single Modality Performance on Visual Navigation & QA. CoRR (2018)
Jesse Thomason, Jivko Sinapov, Raymond J. Mooney
Guiding Interaction Behaviors for Multi-modal Grounded Language Learning. RoboNLP@ACL (2017)
Jesse Thomason, Raymond J. Mooney
Multi-Modal Word Synset Induction. IJCAI (2017)
Jesse Thomason, Aishwarya Padmakumar, Jivko Sinapov, Justin W. Hart, Peter Stone, Raymond J. Mooney
Opportunistic Active Learning for Grounding Natural Language Descriptions. CoRL (2017)
Piyush Khandelwal, Shiqi Zhang, Jivko Sinapov, Matteo Leonetti, Jesse Thomason, Fangkai Yang, Ilaria Gori, Maxwell Svetlik, Priyanka Khante, Vladimir Lifschitz, J. K. Aggarwal, Raymond J. Mooney, Peter Stone
BWIBots: A platform for bridging the gap between AI and human-robot interaction research. Int. J. Robotics Res. 36 (5-7) (2017)
Aishwarya Padmakumar, Jesse Thomason, Raymond J. Mooney
Integrated Learning of Dialog Strategies and Semantic Parsing. EACL (1) (2017)
Rodolfo Corona, Jesse Thomason, Raymond J. Mooney
Improving Black-box Speech Recognition using Semantic Parsing. IJCNLP(2) (2017)
Jesse Thomason, Jivko Sinapov, Maxwell Svetlik, Peter Stone, Raymond J. Mooney
Learning Multi-Modal Grounded Linguistic Semantics by Playing "I Spy". IJCAI (2016)
Jesse Thomason, Shiqi Zhang, Raymond J. Mooney, Peter Stone
Learning to Interpret Natural Language Commands through Human-Robot Dialog. IJCAI (2015)
Jesse Thomason, Subhashini Venugopalan, Sergio Guadarrama, Kate Saenko, Raymond J. Mooney
Integrating Language and Vision to Generate Natural Language Descriptions of Videos in the Wild. COLING (2014)