Reframing Spatial Reasoning Evaluation in Language Models: A Real-World Simulation Benchmark for Qualitative Reasoning.
Fangjun LiDavid C. HoggAnthony G. CohnPublished in: CoRR (2024)
Keyphrases
- language model
- qualitative reasoning
- spatial reasoning
- qualitative simulation
- real world
- qualitative differential equations
- language modeling
- dynamic systems
- n gram
- probabilistic model
- speech recognition
- qualitative information
- spatial relations
- language modelling
- document retrieval
- information retrieval
- test collection
- statistical language models
- temporal reasoning
- conceptual design
- query expansion
- topological relations
- qualitative models
- dynamical systems
- pseudo relevance feedback
- smoothing methods
- case study
- relevance model
- retrieval model
- closely related
- mixture model
- machine learning
- similarity measure
- xml retrieval
- bayesian networks
- query processing
- qualitative spatial reasoning
- language models for information retrieval
- order of magnitude reasoning