The Perils of Using Mechanical Turk to Evaluate Open-Ended Text Generation.

Marzena Karpinska Nader Akoury Mohit Iyyer

Published in: CoRR (2021)

Keyphrases

open ended
text generation
mechanical turk
natural language generation
gold standard
natural language
learning outcomes
theorem prover
multiple choice
artificial intelligence
learning environment
multi agent systems
ground truth
natural language processing
learning activities