ROSCOE: A Suite of Metrics for Scoring Step-by-Step Reasoning.
Olga GolovnevaMoya ChenSpencer PoffMartin CorredorLuke ZettlemoyerMaryam Fazel-ZarandiAsli CelikyilmazPublished in: CoRR (2022)
Keyphrases
- scoring model
- reasoning tasks
- knowledge base
- model based reasoning
- reasoning process
- data sets
- reasoning systems
- probabilistic logic
- reasoning mechanisms
- resource bounded
- analogical reasoning
- formal models
- computational properties
- evaluation metrics
- fuzzy logic
- easy to follow
- domain knowledge
- learning algorithm
- information retrieval