Rethinking the Agreement in Human Evaluation Tasks.

Jacopo Amidei Paul Piwek Alistair Willis

Published in: COLING (2018)

Keyphrases

human operators
human users
evaluation method
human behavior
evaluation criteria
human interaction
real time
databases
artificial intelligence
search algorithm
learning process
transfer learning
robotic systems
gold standard
evaluation process
multiple tasks