Elements of World Knowledge (EWOK): A cognition-inspired framework for evaluating basic world knowledge in language models.
Anna A. IvanovaAalok SatheBenjamin LipkinUnnathi KumarSetayesh RadkaniThomas Hikaru ClarkCarina KaufJennifer HuR. T. PramodGabriel GrandVivian C. PaulunMaria RyskinaEkin AkyürekEthan WilcoxNafisa RashidLeshem ChoshenRoger LevyEvelina FedorenkoJoshua B. TenenbaumJacob AndreasPublished in: CoRR (2024)
Keyphrases
- world knowledge
- language model
- probabilistic model
- feature generation
- bag of words
- language modeling
- noun phrases
- knowledge sources
- natural language text
- n gram
- background knowledge
- information retrieval
- retrieval model
- human knowledge
- document retrieval
- test collection
- text classification
- query terms
- document representation
- action recognition
- wikipedia articles
- knowledge base