Non-Expert Evaluation of Summarization Systems is Risky.

Dan Gillick Yang Liu

Published in: Mturk@HLT-NAACL (2010)

Keyphrases

neural network
gold standard
information retrieval
management system
evaluation method
evaluation criteria
expert advice
machine learning
website
building blocks
complex systems