Rethinking the Evaluation of Dialogue Systems: Effects of User Feedback on Crowdworkers and LLMs.
Clemencia SiroMohammad AliannejadiMaarten de RijkePublished in: SIGIR (2024)
Keyphrases
- user feedback
- dialogue system
- relevance judgments
- user interaction
- interactive retrieval
- relevance feedback
- user profiles
- mixed initiative
- information retrieval
- spoken dialogue systems
- recommender systems
- artificial intelligence
- user preferences
- implicit feedback
- feedback information
- dialogue management
- natural language
- support vector
- data sets
- tutorial dialogue