Evaluating LLMs on document-based QA: Exact answer selection and numerical extraction using CogTale dataset.
Zafaryab RasoolStefanus KurniawanSherwin BalugoScott BarnettRajesh VasaCourtney ChesserBenjamin M. HampsteadSylvie BellevilleKon MouzakisAlex Bahar-FuchsPublished in: Nat. Lang. Process. J. (2024)
Keyphrases
- question answering
- candidate answers
- question classification
- question answer
- information retrieval
- qa systems
- document images
- document classification
- passage retrieval
- information retrieval systems
- document collections
- natural language questions
- question answering systems
- benchmark datasets
- keywords
- answer extraction
- answer validation
- automatic extraction
- web documents
- information extraction
- tf idf
- knowledge extraction
- exact and approximate
- machine learning
- database
- vector space model
- correct answers
- selection algorithm
- sensitivity analysis
- document retrieval
- relevant documents
- web pages