Nikhil Krishnaswamy

Publication Activity (10 Years)

Years Active: 2014-2024
Publications (10 Years): 72

Top Topics

Natural Language Dialogue

Multimodal Interaction

Coreference Resolution

Top Venues

AAAI Spring Symposia

Publications

Sadaf Ghaffari, Nikhil Krishnaswamy
Exploring Failure Cases in Multimodal Reasoning About Physical Dynamics. AAAI Spring Symposia (2024)
Iris Oved, Nikhil Krishnaswamy, James Pustejovsky, Joshua K. Hartshorne
Computational Thought Experiments for a More Rigorous Philosophy and Science of the Mind. CoRR (2024)
Shadi Manafi, Nikhil Krishnaswamy
Cross-Lingual Transfer Robustness to Lower-Resource Languages on Adversarial Datasets. CoRR (2024)
Ibrahim Khebour, Kenneth Lai, Mariah Bradford, Yifan Zhu, Richard Brutti, Christopher Tam, Jingxuan Tu, Benjamin Ibarra, Nathaniel Blanchard, Nikhil Krishnaswamy, James Pustejovsky
Common Ground Tracking in Multimodal Dialogue. CoRR (2024)
Shadi Manafi, Nikhil Krishnaswamy
Cross-Lingual Transfer Robustness to Lower-Resource Languages on Adversarial Datasets. LREC/COLING (2024)
Abhijnan Nath, Huma Jamil, Shafiuddin Rehan Ahmed, George Baker, Rahul Ghosh, James H. Martin, Nathaniel Blanchard, Nikhil Krishnaswamy
Multimodal Cross-Document Event Coreference Resolution Using Linear Semantic Transfer and Mixed-Modality Ensembles. CoRR (2024)
Hannah VanderHoeven, Mariah Bradford, Changsoo Jung, Ibrahim Khebour, Kenneth Lai, James Pustejovsky, Nikhil Krishnaswamy, Nathaniel Blanchard
Multimodal Design for Interactive Collaborative Problem-Solving Support. HCI (6) (2024)
Sadaf Ghaffari, Nikhil Krishnaswamy
Exploring Failure Cases in Multimodal Reasoning About Physical Dynamics. CoRR (2024)
Yifan Zhu, Hannah VanderHoeven, Kenneth Lai, Mariah Bradford, Christopher Tam, Ibrahim Khebour, Richard Brutti, Nikhil Krishnaswamy, James Pustejovsky
Modeling Theory of Mind in Multimodal HCI. HCI (1) (2024)
Ibrahim Khalil Khebour, Kenneth Lai, Mariah Bradford, Yifan Zhu, Richard Brutti, Christopher Tam, Jingxuan Tu, Benjamin Ibarra, Nathaniel Blanchard, Nikhil Krishnaswamy, James Pustejovsky
Common Ground Tracking in Multimodal Dialogue. LREC/COLING (2024)
Abhijnan Nath, Huma Jamil, Shafiuddin Rehan Ahmed, George Arthur Baker, Rahul Ghosh, James H. Martin, Nathaniel Blanchard, Nikhil Krishnaswamy
Multimodal Cross-Document Event Coreference Resolution Using Linear Semantic Transfer and Mixed-Modality Ensembles. LREC/COLING (2024)
Sheikh Mannan, Vivekanand Pandey Vimal, Paul DiZio, Nikhil Krishnaswamy
Embodying Human-Like Modes of Balance Control Through Human-In-the-Loop Dyadic Learning. AAAI Spring Symposia (2024)
Hua Wei, Paulo Shakarian, Christian Lebiere, Bruce A. Draper, Nikhil Krishnaswamy, Sergei Nirenburg
Metacognitive AI: Framework and the Case for a Neurosymbolic Approach. CoRR (2024)
Abhijnan Nath, Shadi Manafi Avari, Avyakta Chelle, Nikhil Krishnaswamy
Okay, Let's Do This! Modeling Event Coreference with Generated Rationales and Knowledge Distillation. NAACL-HLT (2024)
Sidney K. D'Mello, Quentin Biddy, Thomas Breideband, Jeffrey B. Bush, Michael Alan Chang, Arturo Cortez, Jeffrey Flanigan, Peter W. Foltz, Jamie C. Gorman, Leanne M. Hirshfield, Monlin Monica Ko, Nikhil Krishnaswamy, Rachel Lieber, James H. Martin, Martha Palmer, William R. Penuel, Thomas M. Philip, Sadhana Puntambekar, James Pustejovsky, Jason G. Reitman, Tamara Sumner, Michael Tissenbaum, Lyn Walker, Jacob Whitehill
From learning optimization to learner flourishing: Reimagining AI in Education at the Institute for Student-AI Teaming (iSAT). AI Mag. 45 (1) (2024)
Abhijnan Nath, Shadi Manafi, Avyakta Chelle, Nikhil Krishnaswamy
Okay, Let's Do This! Modeling Event Coreference with Generated Rationales and Knowledge Distillation. CoRR (2024)
Hannah VanderHoeven, Nathaniel Blanchard, Nikhil Krishnaswamy
Point Target Detection for Multimodal Communication. HCI (26) (2024)
Ethan Seefried, Mariah Bradford, Swagatalaxmi Aich, Caspian Siebert, Nikhil Krishnaswamy, Nathaniel Blanchard
Learning Foreign Language Vocabulary Through Task-Based Virtual Reality Immersion. HCI (59) (2024)
Sergei Nirenburg, Nikhil Krishnaswamy, Marjorie McShane
Hybrid Machine Learning/Knowledge Base Systems Learning through Natural Language Dialogue with Deep Learning Models. AAAI Spring Symposium: MAKE (2023)
Kiyong Lee, Nikhil Krishnaswamy, James Pustejovsky
An Abstract Specification of VoxML as an Annotation Language. CoRR (2023)
Shafiuddin Rehan Ahmed, Abhijnan Nath, James H. Martin, Nikhil Krishnaswamy
2*n is better than n²: Decomposing Event Coreference Resolution into Two Tractable Problems. ACL (Findings) (2023)
Alexander Henlein, Anju Gopinath, Nikhil Krishnaswamy, Alexander Mehler, James Pustejovsky
Grounding human-object interaction to affordance behavior in multimodal datasets. Frontiers Artif. Intell. 6 (2023)
Hannah VanderHoeven, Nathaniel Blanchard, Nikhil Krishnaswamy
Robust Motion Recognition Using Gesture Phase Annotation. HCI (18) (2023)
Sadaf Ghaffari, Nikhil Krishnaswamy
Grounding and Distinguishing Conceptual Vocabulary Through Similarity Learning in Embodied Simulations. CoRR (2023)
Shafiuddin Rehan Ahmed, Abhijnan Nath, James H. Martin, Nikhil Krishnaswamy
: Decomposing Event Coreference Resolution into Two Tractable Problems. CoRR (2023)
Mariah Bradford, Ibrahim Khebour, Nathaniel Blanchard, Nikhil Krishnaswamy
Automatic Detection of Collaborative States in Small Groups Using Multimodal Features. AIED (2023)
Abhijnan Nath, Sheikh Mannan, Nikhil Krishnaswamy
AxomiyaBERTa: A Phonologically-aware Transformer Model for Assamese. CoRR (2023)
Corbyn Terpstra, Ibrahim Khebour, Mariah Bradford, Brett Wisniewski, Nikhil Krishnaswamy, Nathaniel Blanchard
How Good is Automatic Segmentation as a Multimodal Discourse Annotation Aid? CoRR (2023)
Abhijnan Nath, Sheikh Mannan, Nikhil Krishnaswamy
AxomiyaBERTa: A Phonologically-aware Transformer Model for Assamese. ACL (Findings) (2023)
Chirag Kandoi, Changsoo Jung, Sheikh Mannan, Hannah VanderHoeven, Quincy Meisman, Nikhil Krishnaswamy, Nathaniel Blanchard
Intentional Microgesture Recognition for Extended Human-Computer Interaction. HCI (1) (2023)
Shafiuddin Rehan Ahmed, Abhijnan Nath, Michael Regan, Adam Pollins, Nikhil Krishnaswamy, James H. Martin
How Good is the Model in Model-in-the-loop Event Coreference Resolution Annotation? CoRR (2023)
Nada Alalyani, Nikhil Krishnaswamy
A Methodology for Evaluating Multimodal Referring Expression Generation for Embodied Virtual Agents. ICMI Companion (2023)
James Pustejovsky, Nikhil Krishnaswamy
Multimodal Semantics for Affordances and Actions. HCI (1) (2022)
Nikhil Krishnaswamy, James Pustejovsky
Affordance embeddings for situated language understanding. Frontiers Artif. Intell. 5 (2022)
Mariah Bradford, Paige Hansen, J. Ross Beveridge, Nikhil Krishnaswamy, Nathaniel Blanchard
A deep dive into microphone hardware for recording collaborative group work. EDM (2022)
Sadaf Ghaffari, Nikhil Krishnaswamy
Detecting and Accommodating Novel Types and Concepts in an Embodied Simulation Environment. CoRR (2022)
Nikhil Krishnaswamy, Sadaf Ghaffari
Exploiting Embodied Simulation to Detect Novel Object Classes Through Interaction. CogSci (2022)
Abhijnan Nath, Sina Mahdipour Saravani, Ibrahim Khebour, Sheikh Mannan, Zihui Li, Nikhil Krishnaswamy
A Generalized Method for Automated Multilingual Loanword Detection. COLING (2022)
Nikhil Krishnaswamy, Sadaf Ghaffari
Exploiting Embodied Simulation to Detect Novel Object Classes Through Interaction. CoRR (2022)
Nikhil Krishnaswamy, William Pickard, Brittany Cates, Nathaniel Blanchard, James Pustejovsky
The VoxWorld Platform for Multimodal Embodied Agents. LREC (2022)
James Pustejovsky, Nikhil Krishnaswamy
Embodied Human Computer Interaction. Künstliche Intell. 35 (3) (2021)
James Pustejovsky, Nikhil Krishnaswamy
The Role of Embodiment and Simulation in Evaluating HCI: Theory and Framework. HCI (16) (2021)
Nikhil Krishnaswamy, James Pustejovsky
The Role of Embodiment and Simulation in Evaluating HCI: Experiments and Evaluation. HCI (16) (2021)
Nikhil Krishnaswamy, James Pustejovsky
A Formal Analysis of Multimodal Referring Strategies Under Common Ground. LREC (2020)
Katherine Krajovic, Nikhil Krishnaswamy, Nathaniel J. Dimick, R. Pito Salas, James Pustejovsky
Situated Multimodal Control of a Mobile Robot: Navigation through a Virtual Environment. CoRR (2020)
Nikhil Krishnaswamy, J. Ross Beveridge, James Pustejovsky, Dhruva Patil, David G. McNeely-White, Heting Wang, Francisco Raul Ortega
Situational Awareness in Human Computer Interaction: Diana's World. ICAT-EGVE (Posters and Demos) (2020)
Mark Hutchens, Nikhil Krishnaswamy, Brent Cochran, James Pustejovsky
Jarvis: A Multimodal Visualization Tool for Bioinformatic Data. HCI (45) (2020)
Nikhil Krishnaswamy, James Pustejovsky
Neurosymbolic AI for Situated Language Understanding. CoRR (2020)
James Pustejovsky, Nikhil Krishnaswamy
Embodied Human-Computer Interactions through Situated Grounding. IVA (2020)
Nikhil Krishnaswamy, Pradyumna Narayana, Rahul Bangar, Kyeongmin Rim, Dhruva Patil, David G. McNeely-White, Jaime Ruiz, Bruce A. Draper, J. Ross Beveridge, James Pustejovsky
Diana's World: A Situated Multimodal Interactive Agent. AAAI (2020)
Nikhil Krishnaswamy, James Pustejovsky
A Formal Analysis of Multimodal Referring Strategies Under Common Ground. CoRR (2020)
Nikhil Krishnaswamy, James Pustejovsky
Generating a Novel Dataset of Multimodal Referring Expressions. IWCS (2) (2019)
Nikhil Krishnaswamy, Scott Friedman, James Pustejovsky
Combining Deep Learning and Qualitative Spatial Reasoning to Learn Complex Structures from Sparse Examples with Noise. AAAI (2019)
Nikhil Krishnaswamy, James Pustejovsky
Multimodal Continuation-style Architectures for Human-Robot Interaction. CoRR (2019)
James Pustejovsky, Nikhil Krishnaswamy
Situational Grounding within Multimodal Simulations. CoRR (2019)
Nikhil Krishnaswamy, James Pustejovsky
Situated Grounding Facilitates Multimodal Concept Learning for AI. ViGIL@NeurIPS (2019)
James Pustejovsky, Nikhil Krishnaswamy
Every Object Tells a Story. EventStory@Coling (2018)
Tuan Do, Nikhil Krishnaswamy, James Pustejovsky
Teaching Virtual Agents to Perform Complex Spatial-Temporal Activities. AAAI Spring Symposia (2018)
Nikhil Krishnaswamy, James Pustejovsky
An Evaluation Framework for Multimodal Interaction. LREC (2018)
Nikhil Krishnaswamy, Scott Friedman, James Pustejovsky
Combining Deep Learning and Qualitative Spatial Reasoning to Learn Complex Structures from Sparse Examples with Noise. CoRR (2018)
Tuan Do, Nikhil Krishnaswamy, Kyeongmin Rim, James Pustejovsky
Multimodal Interactive Learning of Primitive Actions. CoRR (2018)
Nikhil Krishnaswamy, James Pustejovsky
Deictic Adaptation in a Virtual Environment. Spatial Cognition (2018)
Pradyumna Narayana, Nikhil Krishnaswamy, Isaac Wang, Rahul Bangar, Dhruva Patil, Gururaj Mulay, Kyeongmin Rim, J. Ross Beveridge, Jaime Ruiz, James Pustejovsky, Bruce A. Draper
Cooperating with Avatars Through Gesture, Language and Action. IntelliSys (1) (2018)
Nikhil Krishnaswamy, Pradyumna Narayana, Isaac Wang, Kyeongmin Rim, Rahul Bangar, Dhruva Patil, Gururaj Mulay, J. Ross Beveridge, Jaime Ruiz, Bruce A. Draper, James Pustejovsky
Communicating and Acting: Understanding Gesture in Simulation Semantics. IWCS(2) (2017)
James Pustejovsky, Nikhil Krishnaswamy
VoxML: A Visualization Modeling Language. CoRR (2016)
Tuan Do, Nikhil Krishnaswamy, James Pustejovsky
ECAT: Event Capture Annotation Tool. CoRR (2016)
Nikhil Krishnaswamy, James Pustejovsky
Multimodal Semantic Simulations of Linguistically Underspecified Motion Events. CoRR (2016)
Nikhil Krishnaswamy, James Pustejovsky
VoxSim: A Visual Platform for Modeling Motion Language. COLING (Demos) (2016)
Nikhil Krishnaswamy, James Pustejovsky
Multimodal Semantic Simulations of Linguistically Underspecified Motion Events. Spatial Cognition (2016)
James Pustejovsky, Nikhil Krishnaswamy
Generating Simulations of Motion Events from Verbal Descriptions. CoRR (2016)
James Pustejovsky, Nikhil Krishnaswamy
Visualizing Events: Simulating Meaning in Language. CogSci (2016)
James Pustejovsky, Nikhil Krishnaswamy
VoxML: A Visualization Modeling Language. LREC (2016)
James Pustejovsky, Nikhil Krishnaswamy
Generating Simulations of Motion Events from Verbal Descriptions. *SEM@COLING (2014)