Verena Rieser

ORCID

Publication Activity (10 Years)

Years Active: 2005-2024
Publications (10 Years): 100

Top Venues

Saarland University (PHD)

Education History

Saarland University

PHD

Publications

Arianna Manzini, Geoff Keeling, Nahema Marchal, Kevin R. McKee, Verena Rieser, Iason Gabriel
Should Users Trust Advanced AI Assistants? Justified Trust As a Function of Competence and Alignment. FAccT (2024)
Iason Gabriel, Arianna Manzini, Geoff Keeling, Lisa Anne Hendricks, Verena Rieser, Hasan Iqbal, Nenad Tomasev, Ira Ktena, Zachary Kenton, Mikel Rodriguez, Seliem El-Sayed, Sasha Brown, Canfer Akbulut, Andrew Trask, Edward Hughes, A. Stevie Bergman, Renee Shelby, Nahema Marchal, Conor Griffin, Juan Mateos-Garcia, Laura Weidinger, Winnie Street, Benjamin Lange, Alex Ingerman, Alison Lentz, Reed Enger, Andrew Barakat, Victoria Krakovna, John Oliver Siy, Zeb Kurth-Nelson, Amanda McCroskery, Vijay Bolina, Harry Law, Murray Shanahan, Lize Alberts, Borja Balle, Sarah de Haas, Yetunde Ibitoye, Allan Dafoe, Beth Goldberg, Sébastien Krier, Alexander Reese, Sims Witherspoon, Will Hawkins, Maribeth Rauh, Don Wallace, Matija Franklin, Josh A. Goldstein, Joel Lehman, Michael Klenk, Shannon Vallor, Courtney Biles, Meredith Ringel Morris, Helen King, Blaise Agüera y Arcas, William Isaac, James Manyika
The Ethics of Advanced AI Assistants. CoRR (2024)
Laura Weidinger, John Mellor, Bernat Guillen Pegueroles, Nahema Marchal, Ravin Kumar, Kristian Lum, Canfer Akbulut, Mark Diaz, A. Stevie Bergman, Mikel Rodriguez, Verena Rieser, William Isaac
STAR: SocioTechnical Approach to Red Teaming Language Models. CoRR (2024)
Katherine M. Collins, Najoung Kim, Yonatan Bitton, Verena Rieser, Shayegan Omidshafiei, Yushi Hu, Sherol Chen, Senjuti Dutta, Minsuk Chang, Kimin Lee, Youwei Liang, Georgina Evans, Sahil Singla, Gang Li, Adrian Weller, Junfeng He, Deepak Ramachandran, Krishnamurthy Dj Dvijotham
Beyond Thumbs Up/Down: Untangling Challenges of Fine-Grained Feedback for Text-to-Image Generation. CoRR (2024)
Marco Casadio, Tanvi Dinkar, Ekaterina Komendantskaya, Luca Arnaboldi, Omri Isac, Matthew L. Daggitt, Guy Katz, Verena Rieser, Oliver Lemon
NLP Verification: Towards a General Methodology for Certifying Robustness. CoRR (2024)
Lu Yu, Malvina Nikandrou, Jiali Jin, Verena Rieser
Quality-agnostic Image Captioning to Safely Assist People with Vision Impairment. CoRR (2023)
Nikolas Vitsakis, Amit Parekh, Tanvi Dinkar, Gavin Abercrombie, Ioannis Konstas, Verena Rieser
iLab at SemEval-2023 Task 11 Le-Wi-Di: Modelling Disagreement or Modelling Perspectives? SemEval@ACL (2023)
Marco Casadio, Luca Arnaboldi, Matthew L. Daggitt, Omri Isac, Tanvi Dinkar, Daniel Kienitz, Verena Rieser, Ekaterina Komendantskaya
ANTONIO: Towards a Systematic Method of Generating NLP Benchmarks for Verification. FoMLAS@CAV (2023)
Sabrina Chiesurin, Dimitris Dimakopoulos, Marco Antonio Sobrevilla Cabezudo, Arash Eshghi, Ioannis Papaioannou, Verena Rieser, Ioannis Konstas
The Dangers of trusting Stochastic Parrots: Faithfulness and Trust in Open-domain Conversational Question Answering. ACL (Findings) (2023)
Lu Yu, Malvina Nikandrou, Jiali Jin, Verena Rieser
Quality-agnostic Image Captioning to Safely Assist People with Vision Impairment. IJCAI (2023)
Bruce W. Wilson, Yann Schlosser, Rayane Tarkany, Meriam Moujahid, Birthe Nesset, Tanvi Dinkar, Verena Rieser
FurNav: Development and Preliminary Study of a Robot Direction Giver. CoRR (2023)
Gavin Abercrombie, Amanda Cercas Curry, Tanvi Dinkar, Verena Rieser, Zeerak Talat
Mirages. On Anthropomorphism in Dialogue Systems. EMNLP (2023)
Georgios Pantazopoulos, Malvina Nikandrou, Amit Parekh, Bhathiya Hemanthage, Arash Eshghi, Ioannis Konstas, Verena Rieser, Oliver Lemon, Alessandro Suglia
Multitask Multimodal Prompted Training for Interactive Embodied Task Completion. CoRR (2023)
Neeraj Cherakara, Finny Varghese, Sheena Shabana, Nivan Nelson, Abhiram Karukayil, Rohith Kulothungan, Mohammed Afil Farhan, Birthe Nesset, Meriam Moujahid, Tanvi Dinkar, Verena Rieser, Oliver Lemon
FurChat: An Embodied Conversational Agent using LLMs, Combining Open and Closed-Domain Dialogue with Facial Expressions. SIGDIAL (2023)
Laura Weidinger, Maribeth Rauh, Nahema Marchal, Arianna Manzini, Lisa Anne Hendricks, Juan Mateos-Garcia, A. Stevie Bergman, Jackie Kay, Conor Griffin, Ben Bariach, Iason Gabriel, Verena Rieser, William Isaac
Sociotechnical Safety Evaluation of Generative AI Systems. CoRR (2023)
Nikolas Vitsakis, Amit Parekh, Tanvi Dinkar, Gavin Abercrombie, Ioannis Konstas, Verena Rieser
iLab at SemEval-2023 Task 11 Le-Wi-Di: Modelling Disagreement or Modelling Perspectives? CoRR (2023)
Elisa Leonardelli, Alexandra Uma, Gavin Abercrombie, Dina Almanea, Valerio Basile, Tommaso Fornaciari, Barbara Plank, Verena Rieser, Massimo Poesio
SemEval-2023 Task 11: Learning With Disagreements (LeWiDi). CoRR (2023)
Sabrina Chiesurin, Dimitris Dimakopoulos, Marco Antonio Sobrevilla Cabezudo, Arash Eshghi, Ioannis Papaioannou, Verena Rieser, Ioannis Konstas
The Dangers of trusting Stochastic Parrots: Faithfulness and Trust in Open-domain Conversational Question Answering. CoRR (2023)
Gavin Abercrombie, Verena Rieser, Dirk Hovy
Consistency is Key: Disentangling Label Variation in Natural Language Processing with Intra-Annotator Agreement. CoRR (2023)
Anya Belz, Craig Thomson, Ehud Reiter, Gavin Abercrombie, Jose Maria Alonso-Moral, Mohammad Arvan, Jackie Chi Kit Cheung, Mark Cieliebak, Elizabeth Clark, Kees van Deemter, Tanvi Dinkar, Ondrej Dusek, Steffen Eger, Qixiang Fang, Albert Gatt, Dimitra Gkatzia, Javier González-Corbelle, Dirk Hovy, Manuela Hürlimann, Takumi Ito, John D. Kelleher, Filip Klubicka, Huiyuan Lai, Chris van der Lee, Emiel van Miltenburg, Yiru Li, Saad Mahamood, Margot Mieskes, Malvina Nissim, Natalie Parde, Ondrej Plátek, Verena Rieser, Pablo Mosteiro Romero, Joel R. Tetreault, Antonio Toral, Xiaojun Wan, Leo Wanner, Lewis Watson, Diyi Yang
Missing Information, Unresponsive Authors, Experimental Flaws: The Impossibility of Assessing the Reproducibility of Previous Human Evaluations in NLP. CoRR (2023)
Neeraj Cherakara, Finny Varghese, Sheena Shabana, Nivan Nelson, Abhiram Karukayil, Rohith Kulothungan, Mohammed Afil Farhan, Birthe Nesset, Meriam Moujahid, Tanvi Dinkar, Verena Rieser, Oliver Lemon
FurChat: An Embodied Conversational Agent using LLMs, Combining Open and Closed-Domain Dialogue with Facial Expressions. CoRR (2023)
Marco Casadio, Luca Arnaboldi, Matthew L. Daggitt, Omri Isac, Tanvi Dinkar, Daniel Kienitz, Verena Rieser, Ekaterina Komendantskaya
ANTONIO: Towards a Systematic Method of Generating NLP Benchmarks for Verification. CoRR (2023)
Elisa Leonardelli, Gavin Abercrombie, Dina Almanea, Valerio Basile, Tommaso Fornaciari, Barbara Plank, Verena Rieser, Alexandra Uma, Massimo Poesio
SemEval-2023 Task 11: Learning with Disagreements (LeWiDi). SemEval@ACL (2023)
Georgios Pantazopoulos, Malvina Nikandrou, Amit Parekh, Bhathiya Hemanthage, Arash Eshghi, Ioannis Konstas, Verena Rieser, Oliver Lemon, Alessandro Suglia
Multitask Multimodal Prompted Training for Interactive Embodied Task Completion. EMNLP (2023)
Lu Yu, Verena Rieser
Adversarial Textual Robustness on Visual Dialog. ACL (Findings) (2023)
Yi-Ling Chung, Gavin Abercrombie, Florence Enock, Jonathan Bright, Verena Rieser
Understanding Counterspeech for Online Harm Mitigation. CoRR (2023)
Shikib Mehri, Jinho Choi, Luis Fernando D'Haro, Jan Deriu, Maxine Eskénazi, Milica Gasic, Kallirroi Georgila, Dilek Hakkani-Tur, Zekang Li, Verena Rieser, Samira Shaikh, David R. Traum, Yi-Ting Yeh, Zhou Yu, Yizhe Zhang, Chen Zhang
Report from the NSF Future Directions Workshop on Automatic Evaluation of Dialog: Research Directions and Challenges. CoRR (2022)
Alessandro Suglia, Bhathiya Hemanthage, Malvina Nikandrou, George Pantazopoulos, Amit Parekh, Arash Eshghi, Claudio Greco, Ioannis Konstas, Oliver Lemon, Verena Rieser
Demonstrating EMMA: Embodied MultiModal Agent for Language-guided Action Execution in 3D Simulated Environments. SIGDIAL (2022)
A. Stevie Bergman, Gavin Abercrombie, Shannon L. Spruit, Dirk Hovy, Emily Dinan, Y-Lan Boureau, Verena Rieser
Guiding the Release of Safer E2E Conversational AI through Value Sensitive Design. SIGDIAL (2022)
Mavina Nikandrou, Lu Yu, Alessandro Suglia, Ioannis Konstas, Verena Rieser
Task Formulation Matters When Learning Continually: A Case Study in Visual Question Answering. CoRR (2022)
Alessandro Suglia, José Lopes, Emanuele Bastianelli, Andrea Vanzo, Shubham Agarwal, Malvina Nikandrou, Lu Yu, Ioannis Konstas, Verena Rieser
Going for GOAL: A Resource for Grounded Football Commentaries. CoRR (2022)
Gavin Abercrombie, Verena Rieser
Risk-graded Safety for Handling Medical Queries in Conversational AI. AACL/IJCNLP (2) (2022)
Lu Yu, Verena Rieser
Adversarial Robustness of Visual Dialog. CoRR (2022)
Marco Casadio, Ekaterina Komendantskaya, Verena Rieser, Matthew L. Daggitt, Daniel Kienitz, Luca Arnaboldi, Wen Kokke
Why Robust Natural Language Understanding is a Challenge. CoRR (2022)
Gavin Abercrombie, Verena Rieser
Risk-graded Safety for Handling Medical Queries in Conversational AI. CoRR (2022)
Emily Dinan, Gavin Abercrombie, A. Stevie Bergman, Shannon L. Spruit, Dirk Hovy, Y-Lan Boureau, Verena Rieser
SafetyKit: First Aid for Measuring Safety in Open-domain Conversational Systems. ACL (1) (2022)
Karin Sevegnani, David M. Howcroft, Ioannis Konstas, Verena Rieser
OTTers: One-turn Topic Transitions for Open-Domain Dialogue. CoRR (2021)
Amanda Cercas Curry, Gavin Abercrombie, Verena Rieser
ConvAbuse: Data, Analysis, and Benchmarks for Nuanced Detection in Conversational AI. EMNLP (1) (2021)
Karin Sevegnani, David M. Howcroft, Ioannis Konstas, Verena Rieser
OTTers: One-turn Topic Transitions for Open-Domain Dialogue. ACL/IJCNLP (1) (2021)
Xinnuo Xu, Ondrej Dusek, Shashi Narayan, Verena Rieser, Ioannis Konstas
MiRANews: Dataset and Benchmarks for Multi-Resource-Assisted News Summarization. CoRR (2021)
David M. Howcroft, Verena Rieser
What happens if you treat ordinal ratings as interval data? Human evaluations in NLP are even more under-powered than you think. EMNLP (1) (2021)
Amanda Cercas Curry, Gavin Abercrombie, Verena Rieser
ConvAbuse: Data, Analysis, and Benchmarks for Nuanced Abuse Detection in Conversational AI. CoRR (2021)
Xinnuo Xu, Ondrej Dusek, Shashi Narayan, Verena Rieser, Ioannis Konstas
MiRANews: Dataset and Benchmarks for Multi-Resource-Assisted News Summarization. EMNLP (Findings) (2021)
Gavin Abercrombie, Amanda Cercas Curry, Mugdha Pandya, Verena Rieser
Alexa, Google, Siri: What are Your Pronouns? Gender and Anthropomorphism in the Design and Perception of Conversational Assistants. CoRR (2021)
Xinnuo Xu, Ondrej Dusek, Verena Rieser, Ioannis Konstas
AGGGEN: Ordering and Aggregating while Generating. CoRR (2021)
Xinnuo Xu, Ondrej Dusek, Verena Rieser, Ioannis Konstas
AggGen: Ordering and Aggregating while Generating. ACL/IJCNLP (1) (2021)
Emily Dinan, Gavin Abercrombie, A. Stevie Bergman, Shannon L. Spruit, Dirk Hovy, Y-Lan Boureau, Verena Rieser
Anticipating Safety Issues in E2E Conversational AI: Framework and Tooling. CoRR (2021)
Shubham Agarwal, Trung Bui, Joon-Young Lee, Ioannis Konstas, Verena Rieser
History for Visual Dialog: Do we really need it? CoRR (2020)
Emanuele Bastianelli, Andrea Vanzo, Pawel Swietojanski, Verena Rieser
SLURP: A Spoken Language Understanding Resource Package. CoRR (2020)
Ondrej Dusek, Jekaterina Novikova, Verena Rieser
Evaluating the state-of-the-art of End-to-End Natural Language Generation: The E2E NLG challenge. Comput. Speech Lang. 59 (2020)
Shubham Agarwal, Trung Bui, Joon-Young Lee, Ioannis Konstas, Verena Rieser
History for Visual Dialog: Do we really need it? ACL (2020)
Xinnuo Xu, Ondrej Dusek, Jingyi Li, Verena Rieser, Ioannis Konstas
Fact-based Content Weighting for Evaluating Abstractive Summarisation. ACL (2020)
David M. Howcroft, Anya Belz, Miruna-Adriana Clinciu, Dimitra Gkatzia, Sadid A Hasan, Saad Mahamood, Simon Mille, Emiel van Miltenburg, Sashank Santhanam, Verena Rieser
Twenty Years of Confusion in Human Evaluation: NLG Needs Evaluation Sheets and Standardised Definitions. INLG (2020)
Emanuele Bastianelli, Andrea Vanzo, Pawel Swietojanski, Verena Rieser
SLURP: A Spoken Language Understanding Resource Package. EMNLP (1) (2020)
Ondrej Dusek, David M. Howcroft, Verena Rieser
Semantic Noise Matters for Neural Natural Language Generation. INLG (2019)
Ondrej Dusek, David M. Howcroft, Verena Rieser
Semantic Noise Matters for Neural Natural Language Generation. CoRR (2019)
Ondrej Dusek, Karin Sevegnani, Ioannis Konstas, Verena Rieser
Automatic Quality Estimation for Natural Language Generation: Ranting (Jointly Rating and Ranking). CoRR (2019)
Simon Keizer, Ondrej Dusek, Xingkun Liu, Verena Rieser
User Evaluation of a Multi-dimensional Statistical Dialogue System. SIGdial (2019)
Ondrej Dusek, Karin Sevegnani, Ioannis Konstas, Verena Rieser
Automatic Quality Estimation for Natural Language Generation: Ranting (Jointly Rating and Ranking). INLG (2019)
Verena Rieser
Let's Chat! Can Virtual Agents learn how to have a Conversation? IVA (2019)
Simon Keizer, Ondrej Dusek, Xingkun Liu, Verena Rieser
User Evaluation of a Multi-dimensional Statistical Dialogue System. CoRR (2019)
Xingkun Liu, Arash Eshghi, Pawel Swietojanski, Verena Rieser
Benchmarking Natural Language Understanding Services for Building Conversational Agents. IWSDS (2019)
Xingkun Liu, Arash Eshghi, Pawel Swietojanski, Verena Rieser
Benchmarking Natural Language Understanding Services for building Conversational Agents. CoRR (2019)
Ondrej Dusek, Jekaterina Novikova, Verena Rieser
Evaluating the State-of-the-Art of End-to-End Natural Language Generation: The E2E NLG Challenge. CoRR (2019)
Amanda Cercas Curry, Verena Rieser
A Crowd-based Evaluation of Abuse Response Strategies in Conversational Agents. SIGdial (2019)
Amanda Cercas Curry, Verena Rieser
A Crowd-based Evaluation of Abuse Response Strategies in Conversational Agents. CoRR (2019)
Xinnuo Xu, Ondrej Dusek, Ioannis Konstas, Verena Rieser
Better Conversations by Modeling, Filtering, and Optimizing for Coherence and Diversity. EMNLP (2018)
Xinnuo Xu, Ondrej Dusek, Ioannis Konstas, Verena Rieser
Better Conversations by Modeling, Filtering, and Optimizing for Coherence and Diversity. CoRR (2018)
Ondrej Dusek, Jekaterina Novikova, Verena Rieser
Findings of the E2E NLG Challenge. INLG (2018)
Ondrej Dusek, Jekaterina Novikova, Verena Rieser
Findings of the E2E NLG Challenge. CoRR (2018)
Jekaterina Novikova, Ondrej Dusek, Verena Rieser
RankME: Reliable Human Ratings for Natural Language Generation. NAACL-HLT (2) (2018)
Shubham Agarwal, Ondrej Dusek, Ioannis Konstas, Verena Rieser
A Knowledge-Grounded Multimodal Search-Based Conversational Agent. SCAI@EMNLP (2018)
Jekaterina Novikova, Ondrej Dusek, Verena Rieser
RankME: Reliable Human Ratings for Natural Language Generation. CoRR (2018)
Shubham Agarwal, Ondrej Dusek, Ioannis Konstas, Verena Rieser
A Knowledge-Grounded Multimodal Search-Based Conversational Agent. CoRR (2018)
Shubham Agarwal, Ondrej Dusek, Ioannis Konstas, Verena Rieser
Improving Context Modelling in Multimodal Dialogue Generation. CoRR (2018)
Amanda Cercas Curry, Verena Rieser
#MeToo Alexa: How Conversational Systems Respond to Sexual Harassment. EthNLP@NAACL-HLT (2018)
Simon Keizer, Verena Rieser
Towards Learning Transferable Conversational Skills using Multi-dimensional Dialogue Modelling. CoRR (2018)
Shubham Agarwal, Ondrej Dusek, Ioannis Konstas, Verena Rieser
Improving Context Modelling in Multimodal Dialogue Generation. INLG (2018)
Dimitra Gkatzia, Oliver Lemon, Verena Rieser
Data-to-Text Generation Improves Decision-Making Under Uncertainty. IEEE Comput. Intell. Mag. 12 (3) (2017)
Amanda Cercas Curry, Helen F. Hastie, Verena Rieser
A review of evaluation techniques for social dialogue systems. ISIAA@ICMI (2017)
Amanda Cercas Curry, Helen F. Hastie, Verena Rieser
A Review of Evaluation Techniques for Social Dialogue Systems. CoRR (2017)
Jekaterina Novikova, Ondrej Dusek, Verena Rieser
The E2E Dataset: New Challenges For End-to-End Generation. SIGDIAL Conference (2017)
Jekaterina Novikova, Ondrej Dusek, Amanda Cercas Curry, Verena Rieser
Why We Need New Evaluation Metrics for NLG. EMNLP (2017)
Ioannis Papaioannou, Amanda Cercas Curry, Jose L. Part, Igor Shalyminov, Xinnuo Xu, Yanchao Yu, Ondrej Dusek, Verena Rieser, Oliver Lemon
An Ensemble Model with Ranking for Social Dialogue. CoRR (2017)
Verena Rieser, Matthew Walter, Dirk Wollherr
Special issue on spatial reasoning and interaction for real-world robotics. Adv. Robotics 31 (5) (2017)
Jekaterina Novikova, Ondrej Dusek, Verena Rieser
Data-driven Natural Language Generation: Paving the Road to Success. CoRR (2017)
Christian Landsiedel, Verena Rieser, Matthew Walter, Dirk Wollherr
A review of spatial reasoning and interaction for real-world robotics. Adv. Robotics 31 (5) (2017)
Jekaterina Novikova, Ondrej Dusek, Verena Rieser
The E2E Dataset: New Challenges For End-to-End Generation. CoRR (2017)
Jekaterina Novikova, Ondrej Dusek, Amanda Cercas Curry, Verena Rieser
Why We Need New Evaluation Metrics for NLG. CoRR (2017)
Ondrej Dusek, Jekaterina Novikova, Verena Rieser
Referenceless Quality Estimation for Natural Language Generation. CoRR (2017)
Dimitra Gkatzia, Oliver Lemon, Verena Rieser
Natural Language Generation enhances human decision-making with uncertain information. ACL (2) (2016)
Dimitra Gkatzia, Oliver Lemon, Verena Rieser
Natural Language Generation enhances human decision-making with uncertain information. CoRR (2016)
Dimitra Gkatzia, Verena Rieser, Oliver Lemon
How to talk to strangers: Generating medical reports for first-time users. FUZZ-IEEE (2016)
Eshrag Refaee, Verena Rieser
iLab-Edinburgh at SemEval-2016 Task 7: A Hybrid Approach for Determining Sentiment Intensity of Arabic Twitter Phrases. SemEval@NAACL-HLT (2016)
Jekaterina Novikova, Oliver Lemon, Verena Rieser
Crowd-sourcing NLG Data: Pictures Elicit Better Data. INLG (2016)
Nina Dethlefs, Helen F. Hastie, Heriberto Cuayáhuitl, Yanchao Yu, Verena Rieser, Oliver Lemon
Information density and overlap in spoken dialogue. Comput. Speech Lang. 37 (2016)
Jekaterina Novikova, Oliver Lemon, Verena Rieser
Crowd-sourcing NLG Data: Pictures Elicit Better Data. CoRR (2016)
Jekaterina Novikova, Verena Rieser
The aNALoGuE Challenge: Non Aligned Language GEneration. INLG (2016)
Phil J. Bartie, William A. Mackaness, Dimitra Gkatzia, Verena Rieser
The REAL Corpus: A Crowd-Sourced Corpus of Human Generated and Evaluated Spatial References to Real-World Urban Scenes. LREC (2016)
Verena Rieser, Oliver Lemon
Natural Language Generation as Planning under Uncertainty Using Reinforcement Learning. CoRR (2016)

Verena Rieser.css-eqlu8i{font-size:small;padding-left:4px;}

Publication Activity (10 Years)

Top Topics

Top Venues

Verena Rieser