Jonathan Francis

Publication Activity (10 Years)

Years Active: 2010-2024
Publications (10 Years): 65

Top Topics

Pervasive Environments

Knowledge Transfer

Commonsense Knowledge

Top Venues

BuildSys@SenSys

Publications

Aaron Lohner, Francesco Compagno, Jonathan Francis, Alessandro Oltramari
Enhancing Vision-Language Models with Scene Graphs for Traffic Accident Understanding. CoRR (2024)
Benjamin Stoler, Ingrid Navarro, Meghdeep Jana, Soonmin Hwang, Jonathan Francis, Jean Oh
SafeShift: Safety-Informed Distribution Shifts for Robust Trajectory Prediction in Autonomous Driving. IV (2024)
Sriram Yenamandra, Arun Ramachandran, Mukul Khanna, Karmesh Yadav, Jay Vakil, Andrew Melnik, Michael Büttner, Leon Harz, Lyon Brown, Gora Chand Nandi, Arjun P. S, Gaurav Kumar Yadav, Rahul Kala, Robert Haschke, Yang Luo, Jinxin Zhu, Yansen Han, Bingyi Lu, Xuan Gu, Qinyuan Liu, Yaping Zhao, Qiting Ye, Chenxiao Dou, Yansong Chua, Volodymyr Kuzma, Vladyslav Humennyy, Ruslan Partsey, Jonathan Francis, Devendra Singh Chaplot, Gunjan Chhablani, Alexander Clegg, Théophile Gervet, Vidhi Jain, Ram Ramrakhya, Andrew Szot, Austin S. Wang, Tsung-Yen Yang, Aaron Edsinger, Charles C. Kemp, Binit Shah, Zsolt Kira, Dhruv Batra, Roozbeh Mottaghi, Yonatan Bisk, Chris Paxton
Towards Open-World Mobile Manipulation in Homes: Lessons from the Neurips 2023 HomeRobot Open Vocabulary Mobile Manipulation Challenge. CoRR (2024)
Sahiti Yerramilli, Jayant Sravan Tamarapalli, Jonathan Francis, Eric Nyberg
Attribution Regularization for Multimodal Paradigms. CoRR (2024)
Sahiti Yerramilli, Jayant Sravan Tamarapalli, Tanmay Girish Kulkarni, Jonathan Francis, Eric Nyberg
Semantic Augmentation in Images using Language. CoRR (2024)
Peide Huang, Wenhao Ding, Jonathan Francis, Bingqing Chen, Ding Zhao
CaDRE: Controllable and Diverse Generation of Safety-Critical Driving Scenarios using Real-World Trajectories. CoRR (2024)
Gyan Tatiya, Jonathan Francis, Ho-Hsiang Wu, Yonatan Bisk, Jivko Sinapov
MOSAIC: Learning Unified Multi-Sensory Object Property Representations for Robot Learning via Interactive Perception. ICRA (2024)
Alessandro Oltramari, Jonathan Francis, Filip Ilievski, Kaixin Ma, Roshanak Mirzaee
Generalizable Neuro-Symbolic Systems for Commonsense Question Answering. NeSy (2023)
Jonathan Francis, Nariaki Kitamura, Felix Labelle, Xiaopeng Lu, Ingrid Navarro, Jean Oh
Core Challenges in Embodied Vision-Language Planning. CoRR (2023)
Jiarui Zhang, Filip Ilievski, Kaixin Ma, Aravinda Kollaa, Jonathan Francis, Alessandro Oltramari
A Study of Situational Reasoning for Traffic Understanding. KDD (2023)
Rajshekhar Das, Jonathan Francis, Sanket Vaibhav Mehta, Jean Oh, Emma Strubell, José M. F. Moura
Regularizing Self-training for Unsupervised Domain Adaptation via Structural Constraints. CoRR (2023)
Peide Huang, Xilun Zhang, Ziang Cao, Shiqi Liu, Mengdi Xu, Wenhao Ding, Jonathan Francis, Bingqing Chen, Ding Zhao
What Went Wrong? Closing the Sim-to-Real Gap via Differentiable Causal Discovery. CoRR (2023)
Prateek Chhikara, Jiarui Zhang, Filip Ilievski, Jonathan Francis, Kaixin Ma
Knowledge-enhanced Agents for Interactive Text Games. CoRR (2023)
Gyan Tatiya, Jonathan Francis, Jivko Sinapov
Cross-Tool and Cross-Behavior Perceptual Knowledge Transfer for Grounded Object Recognition. CoRR (2023)
Benjamin Stoler, Ingrid Navarro, Meghdeep Jana, Soonmin Hwang, Jonathan Francis, Jean Oh
SafeShift: Safety-Informed Distribution Shifts for Robust Trajectory Prediction in Autonomous Driving. CoRR (2023)
Prateek Chhikara, Jiarui Zhang, Filip Ilievski, Jonathan Francis, Kaixin Ma
Knowledge-enhanced Agents for Interactive Text Games. K-CAP (2023)
Jonathan Francis, Nariaki Kitamura, Felix Labelle, Xiaopeng Lu, Ingrid Navarro, Jean Oh
Core Challenges in Embodied Vision-Language Planning (Extended Abstract). IJCAI (2023)
Gyan Tatiya, Jonathan Francis, Jivko Sinapov
Transferring Implicit Knowledge of Non-Visual Object Properties Across Heterogeneous Robot Morphologies. ICRA (2023)
Peide Huang, Xilun Zhang, Ziang Cao, Shiqi Liu, Mengdi Xu, Wenhao Ding, Jonathan Francis, Bingqing Chen, Ding Zhao
What Went Wrong? Closing the Sim-to-Real Gap via Differentiable Causal Discovery. CoRL (2023)
Gyan Tatiya, Jonathan Francis, Ho-Hsiang Wu, Yonatan Bisk, Jivko Sinapov
MOSAIC: Learning Unified Multi-Sensory Object Property Representations for Robot Perception. CoRR (2023)
Jiarui Zhang, Filip Ilievski, Kaixin Ma, Aravinda Kollaa, Jonathan Francis, Alessandro Oltramari
A Study of Situational Reasoning for Traffic Understanding. CoRR (2023)
Yafei Hu, Quanting Xie, Vidhi Jain, Jonathan Francis, Jay Patrikar, Nikhil Varma Keetha, Seungchan Kim, Yaqi Xie, Tianyi Zhang, Shibo Zhao, Yu Quan Chong, Chen Wang, Katia P. Sycara, Matthew Johnson-Roberson, Dhruv Batra, Xiaolong Wang, Sebastian Scherer, Zsolt Kira, Fei Xia, Yonatan Bisk
Toward General-Purpose Robots via Foundation Models: A Survey and Meta-Analysis. CoRR (2023)
Jonathan Francis, Bingqing Chen, Weiran Yao, Eric Nyberg, Jean Oh
Distribution-aware Goal Prediction and Conformant Model-based Planning for Safe Autonomous Driving. CoRR (2022)
Kaixin Ma, Filip Ilievski, Jonathan Francis, Eric Nyberg, Alessandro Oltramari
Coalescing Global and Local Information for Procedural Text Understanding. COLING (2022)
Yue Qi, Ruixuan Wang, Mojtaba Vaezi, Jonathan Francis, Xun Jiao
Handcrafted and Neural Network Based Features for Outlier Modulation Detection. IEEECONF (2022)
Jonathan Francis, Bingqing Chen, Siddha Ganju, Sidharth Kathpal, Jyotish Poonganam, Ayush Shivani, Vrushank Vyas, Sahika Genc, Ivan Zhukov, Max Kumskoy, Anirudh Koul, Jean Oh, Eric Nyberg
Learn-to-Race Challenge 2022: Benchmarking Safe Learning and Cross-domain Generalisation in Autonomous Racing. CoRR (2022)
Gyan Tatiya, Jonathan Francis, Jivko Sinapov
Transferring Implicit Knowledge of Non-Visual Object Properties Across Heterogeneous Robot Morphologies. CoRR (2022)
Jiarui Zhang, Filip Ilievski, Aravinda Kollaa, Jonathan Francis, Kaixin Ma, Alessandro Oltramari
Utilizing Background Knowledge for Robust Reasoning over Traffic Situations. CoRR (2022)
Kaixin Ma, Filip Ilievski, Jonathan Francis, Eric Nyberg, Alessandro Oltramari
Coalescing Global and Local Information for Procedural Text Understanding. CoRR (2022)
Jiarui Zhang, Filip Ilievski, Kaixin Ma, Jonathan Francis, Alessandro Oltramari
A Study of Zero-shot Adaptation with Commonsense Knowledge. AKBC (2022)
Gyan Tatiya, Jonathan Francis, Luca Bondi, Ingrid Navarro, Eric Nyberg, Jivko Sinapov, Jean Oh
Knowledge-driven Scene Priors for Semantic Audio-Visual Embodied Navigation. CoRR (2022)
Alessandro Oltramari, Jonathan Francis, Filip Ilievski, Kaixin Ma, Roshanak Mirzaee
Generalizable Neuro-symbolic Systems for Commonsense Question Answering. CoRR (2022)
Jonathan Francis, Nariaki Kitamura, Felix Labelle, Xiaopeng Lu, Ingrid Navarro, Jean Oh
Core Challenges in Embodied Vision-Language Planning. J. Artif. Intell. Res. 74 (2022)
Jiarui Zhang, Filip Ilievski, Kaixin Ma, Jonathan Francis, Alessandro Oltramari
An Empirical Investigation of Commonsense Self-Supervision with Knowledge Graphs. CoRR (2022)
Kaixin Ma, Filip Ilievski, Jonathan Francis, Satoru Ozaki, Eric Nyberg, Alessandro Oltramari
Exploring Strategies for Generalizable Commonsense Reasoning with Pre-trained Models. CoRR (2021)
Jonathan Francis, Nariaki Kitamura, Felix Labelle, Xiaopeng Lu, Ingrid Navarro, Jean Oh
Core Challenges in Embodied Vision-Language Planning. CoRR (2021)
Kaixin Ma, Filip Ilievski, Jonathan Francis, Yonatan Bisk, Eric Nyberg, Alessandro Oltramari
Knowledge-driven Data Construction for Zero-shot Evaluation in Commonsense Question Answering. AAAI (2021)
James Herman, Jonathan Francis, Siddha Ganju, Bingqing Chen, Anirudh Koul, Abhinav Gupta, Alexey Skabelkin, Ivan Zhukov, Max Kumskoy, Eric Nyberg
Learn-to-Race: A Multimodal Control Environment for Autonomous Racing. ICCV (2021)
James Herman, Jonathan Francis, Siddha Ganju, Bingqing Chen, Anirudh Koul, Abhinav Gupta, Alexey Skabelkin, Ivan Zhukov, Max Kumskoy, Eric Nyberg
Learn-to-Race: A Multimodal Control Environment for Autonomous Racing. CoRR (2021)
Kaixin Ma, Filip Ilievski, Jonathan Francis, Satoru Ozaki, Eric Nyberg, Alessandro Oltramari
Exploring Strategies for Generalizable Commonsense Reasoning with Pre-trained Models. EMNLP (1) (2021)
Bingqing Chen, Jonathan Francis, James Herman, Jean Oh, Eric Nyberg, Sylvia L. Herbert
Safety-aware Policy Optimisation for Autonomous Racing. CoRR (2021)
Xi Chen, Faner Lin, Yeju Zhou, Kaixin Ma, Jonathan Francis, Eric Nyberg, Alessandro Oltramari
Building Goal-oriented Document-grounded Dialogue Systems. DialDoc@ACL-IJCNLP (2021)
Bingqing Chen, Jonathan Francis, Marco Pritoni, Soummya Kar, Mario Bergés
COHORT: Coordination of Heterogeneous Thermostatically Controlled Loads for Demand Flexibility. BuildSys@SenSys (2020)
Kaixin Ma, Filip Ilievski, Jonathan Francis, Yonatan Bisk, Eric Nyberg, Alessandro Oltramari
Knowledge-driven Self-supervision for Zero-shot Commonsense Question Answering. CoRR (2020)
Zhanhong Jiang, Jonathan Francis, Anit Kumar Sahu, Sirajum Munir, Charles Shelton, Anthony Rowe, Mario Bergés
Data-driven Thermal Model Inference with ARMAX, in Smart Environments, based on Normalized Mutual Information. CoRR (2020)
Yukun Yuan, Kin Sum Liu, Sirajum Munir, Jonathan Francis, Charles Shelton, Shan Lin
Leveraging Fine-Grained Occupancy Estimation Patterns for Effective HVAC Control. IoTDI (2020)
Seong Hyeon Park, Gyubok Lee, Manoj Bhat, Jimin Seo, Minseok Kang, Jonathan Francis, Ashwin R. Jadhav, Paul Pu Liang, Louis-Philippe Morency
Diverse and Admissible Trajectory Forecasting through Multimodal Context Understanding. CoRR (2020)
Bingqing Chen, Jonathan Francis, Marco Pritoni, Soummya Kar, Mario Bergés
COHORT: Coordination of Heterogeneous Thermostatically Controlled Loads for Demand Flexibility. CoRR (2020)
Seong Hyeon Park, Gyubok Lee, Jimin Seo, Manoj Bhat, Minseok Kang, Jonathan Francis, Ashwin R. Jadhav, Paul Pu Liang, Louis-Philippe Morency
Diverse and Admissible Trajectory Forecasting Through Multimodal Context Understanding. ECCV (11) (2020)
Alessandro Oltramari, Jonathan Francis, Cory A. Henson, Kaixin Ma, Ruwan Wickramarachchi
Neuro-symbolic Architectures for Context Understanding. CoRR (2020)
Manoj Bhat, Jonathan Francis, Jean Oh
Trajformer: Trajectory Prediction with Local Self-Attentive Contexts for Autonomous Driving. CoRR (2020)
Yikang Li, Pulkit Goel, Varsha Kuppur Rajendra, Har Simrat Singh, Jonathan Francis, Kaixin Ma, Eric Nyberg, Alessandro Oltramari
Lexically-constrained Text Generation through Commonsense Knowledge Extraction and Injection. CoRR (2020)
Bingqing Chen, Weiran Yao, Jonathan Francis, Mario Bergés
Learning a Distributed Control Scheme for Demand Flexibility in Thermostatically Controlled Loads. CoRR (2020)
Bingqing Chen, Weiran Yao, Jonathan Francis, Mario Bergés
Learning a Distributed Control Scheme for Demand Flexibility in Thermostatically Controlled Loads. SmartGridComm (2020)
Sirajum Munir, Jonathan Francis, Matias Quintana, Nadine von Frankenberg, Mario Bergés
Dataset: Inferring Thermal Comfort using Body Shape Information Utilizing Depth Sensors. DATA@SenSys (2019)
Jonathan Francis, Matias Quintana, Nadine von Frankenberg, Sirajum Munir, Mario Bergés
OccuTherm: Occupant Thermal Comfort Inference using Body Shape Information. BuildSys@SenSys (2019)
Kaixin Ma, Jonathan Francis, Quanyang Lu, Eric Nyberg, Alessandro Oltramari
Towards Generalizable Neuro-Symbolic Systems for Commonsense Question Answering. CoRR (2019)
Alessandro Oltramari, Joseph Szurley, Samarjit Das, Jonathan Francis, Juncheng Li
Towards Knowledge Oriented Intelligent Audio Analytics. AAAI Workshops (2018)
Zhanhong Jiang, Jonathan Francis, Anit Kumar Sahu, Sirajum Munir, Charles Shelton, Anthony Rowe, Mario Berges
Data-driven Thermal Model Inference with ARMAX, in Smart Environments, based on Normalized Mutual Information. ACC (2018)
Abhilasha Ravichander, Thomas Manzini, Matthias Grabmair, Graham Neubig, Jonathan Francis, Eric Nyberg
How Would You Say It? Eliciting Lexically Diverse Dialogue for Supervised Semantic Parsing. SIGDIAL Conference (2017)
Kin Sum Liu, Sirajum Munir, Jonathan Francis, Charles Shelton, Shan Lin
Long term occupancy estimation in a commercial space: an empirical study: poster abstract. IPSN (2017)
Sirajum Munir, Le Tran, Jonathan Francis, Charles Shelton, Ripudaman Singh Arora, Craig Hesling, Matias Quintana, Anand Krishnan Prakash, Anthony Rowe, Mario Berges
FORK: fine grained occupancy estimatoR using kinect on ARM embedded platforms. BuildSys@SenSys (2017)
Jonathan Francis, Alessandro Oltramari, Sirajum Munir, Charles Shelton, Anthony Rowe
Context Intelligence in Pervasive Environments: Poster Abstract. IoTDI (2017)
Kin Sum Liu, Elvin Vindel Pinto, Sirajum Munir, Jonathan Francis, Charles Shelton, Mario Berges, Shan Lin
COD: a dataset of commercial building occupancy traces. BuildSys@SenSys (2017)
Sirajum Munir, Ripudaman Singh Arora, Craig Hesling, Juncheng Li, Jonathan Francis, Charles Shelton, Christopher Martin, Anthony Rowe, Mario Berges
Real-Time Fine Grained Occupancy Estimation Using Depth Sensors on ARM Embedded Platforms. RTAS (2017)
Justin P. M. Whitty, Jonathan Francis, Joe M. Howe, Brian Henderson
Computational Modelling of the Structural Integrity following Mass-Loss in Polymeric Charred Cellular Solids. J. Comput. Eng. 2014 (2014)
Jonathan Francis, Utsav Drolia, Kunal Mankodiya, Rolando Martins, Rajeev Gandhi, Priya Narasimhan
MetaBot: Automated and dynamically schedulable robotic behaviors in retail environments. ROSE (2013)
Kunal Mankodiya, Rolando Martins, Jonathan Francis, Elmer Garduño, Rajeev Gandhi, Priya Narasimhan
Interactive Shopping Experience through Immersive Store Environments. HCI (11) (2013)
Javad Yazdani, Trevor Holden, Jonathan Francis
Advanced vehicular sensor system. ICUMT (2010)