The Perils of Using Mechanical Turk to Evaluate Open-Ended Text Generation.

Marzena Karpinska Nader Akoury Mohit Iyyer

Published in: EMNLP (1) (2021)

Keyphrases

open ended
text generation
mechanical turk
natural language generation
gold standard
natural language
learning outcomes
theorem prover
multiple choice
ground truth
knowledge base
machine translation
expert systems
learning environment
spoken dialogue
affect detection
multi agent