PUB: A Pragmatics Understanding Benchmark for Assessing LLMs' Pragmatics Capabilities.
Settaluri Lakshmi SravanthiMeet DoshiTankala Pavan KalyanV. Rudra MurthyPushpak BhattacharyyaRaj DabrePublished in: CoRR (2024)
Keyphrases
- natural language processing
- formal semantics
- case study
- neural network
- deeper understanding
- artificial intelligence
- machine learning
- computer vision
- decision making
- information retrieval
- objective function
- multi agent
- natural language
- lower bound
- information technology
- evolutionary algorithm
- information extraction
- real world
- real time