Keelan Evanini

Publication Activity (10 Years)

Years Active: 2007-2021
Publications (10 Years): 54

Top Topics

Automatic Detection

Spontaneous Speech

Native Language

Top Venues

Publications

Xinhao Wang, Keelan Evanini, Yao Qian, Matthew Mulholland
Automated Scoring of Spontaneous Speech from Young Learners of English Using Transformers. SLT (2021)
Ying Qin, Yao Qian, Anastassia Loukina, Patrick L. Lange, Abhinav Misra, Keelan Evanini, Tan Lee
Automatic Detection of Word-Level Reading Errors in Non-native English Speech Based on ASR Output. ISCSLP (2021)
Anastassia Loukina, Keelan Evanini, Matthew Mulholland, Ian Blood, Klaus Zechner
Do Face Masks Introduce Bias in Speech Technologies? The Case of Automated Scoring of Speaking Proficiency. INTERSPEECH (2020)
Roberto Gretter, Marco Matassoni, Daniele Falavigna, Keelan Evanini, Chee Wee Leong
Overview of the Interspeech TLT2020 Shared Task on ASR for Non-Native Children's Speech. INTERSPEECH (2020)
Anastassia Loukina, Keelan Evanini, Matthew Mulholland, Ian Blood, Klaus Zechner
Do face masks introduce bias in speech technologies? The case of automated scoring of speaking proficiency. CoRR (2020)
Kevin Hirschi, Okim Kang, Catia Cucchiarini, John H. L. Hansen, Keelan Evanini, Helmer Strik
Mobile-Assisted Prosody Training for Limited English Proficiency: Learner Background and Speech Learning Pattern. INTERSPEECH (2020)
Yao Qian, Rutuja Ubale, Patrick L. Lange, Keelan Evanini, Vikram Ramanarayanan, Frank K. Soong
Spoken Language Understanding of Human-Machine Conversations for Language Learning Applications. J. Signal Process. Syst. 92 (8) (2020)
Su-Youn Yoon, Chong Min Lee, Klaus Zechner, Keelan Evanini
Development of Robust Automated Scoring Models Using Adversarial Input for Oral Proficiency Assessment. INTERSPEECH (2019)
Xinhao Wang, Keelan Evanini, Matthew Mulholland, Yao Qian, James V. Bruno
Application of an Automatic Plagiarism Detection System in a Large-scale Assessment of English Speaking Proficiency. BEA@ACL (2019)
Xinhao Wang, Keelan Evanini, Yao Qian, Klaus Zechner
Using Very Deep Convolutional Neural Networks to Automatically Detect Plagiarized Spoken Responses. ASRU (2019)
Rutuja Ubale, Vikram Ramanarayanan, Yao Qian, Keelan Evanini, Chee Wee Leong, Chong Min Lee
Native Language Identification from Raw Waveforms Using Deep Convolutional Neural Networks with Attentive Pooling. ASRU (2019)
Xinhao Wang, Su-Youn Yoon, Keelan Evanini, Klaus Zechner, Yao Qian
Automatic Detection of Off-Topic Spoken Responses Using Very Deep Convolutional Neural Networks. INTERSPEECH (2019)
Yao Qian, Patrick L. Lange, Keelan Evanini, Robert A. Pugh, Rutuja Ubale, Matthew Mulholland, Xinhao Wang
Neural Approaches to Automated Speech Scoring of Monologue and Dialogue Responses. ICASSP (2019)
Keelan Evanini, Matthew Mulholland, Rutuja Ubale, Yao Qian, Robert A. Pugh, Vikram Ramanarayanan, Aoife Cahill
Improvements to an Automated Content Scoring System for Spoken CALL Responses: the ETS Submission to the Second Spoken CALL Shared Task. INTERSPEECH (2018)
Xinhao Wang, Binod Gyawali, James V. Bruno, Hillary R. Molloy, Keelan Evanini, Klaus Zechner
Discourse Modeling of Non-Native Spontaneous Speech Using the Rhetorical Structure Theory Framework. SLT (2018)
Rutuja Ubale, Yao Qian, Keelan Evanini
Exploring End-To-End Attention-Based Neural Networks For Native Language Identification. SLT (2018)
Yao Qian, Rutuja Ubale, Matthew Mulholland, Keelan Evanini, Xinhao Wang
A Prompt-Aware Neural Network Approach to Content-Based Scoring of Non-Native Spontaneous Speech. SLT (2018)
Vikram Ramanarayanan, David Pautler, Patrick L. Lange, Eugene Tsuprun, Rutuja Ubale, Keelan Evanini, David Suendermann-Oeft
Toward Scalable Dialog Technology for Conversational Language Learning: Case Study of the TOEFL® MOOC. INTERSPEECH (2018)
Yao Qian, Rutuja Ubale, Patrick L. Lange, Keelan Evanini, Frank K. Soong
From Speech Signals to Semantics - Tagging Performance at Acoustic, Phonetic and Word Levels. ISCSLP (2018)
Keelan Evanini, Veronika Timpe-Laughlin, Eugene Tsuprun, Ian Blood, Jeremy Lee, James V. Bruno, Vikram Ramanarayanan, Patrick L. Lange, David Suendermann-Oeft
Game-based Spoken Dialog Language Learning Applications for Young Students. INTERSPEECH (2018)
Shervin Malmasi, Keelan Evanini, Aoife Cahill, Joel R. Tetreault, Robert A. Pugh, Christopher Hamill, Diane Napolitano, Yao Qian
A Report on the 2017 Native Language Identification Shared Task. BEA@EMNLP (2017)
Xinhao Wang, James V. Bruno, Hillary Molloy, Keelan Evanini, Klaus Zechner
Discourse Annotation of Non-native Spontaneous Spoken Responses Using the Rhetorical Structure Theory Framework. ACL (2) (2017)
Yao Qian, Rutuja Ubale, Vikram Ramanarayanan, Patrick L. Lange, David Suendermann-Oeft, Keelan Evanini, Eugene Tsuprun
Exploring ASR-free end-to-end modeling to improve spoken language understanding in a cloud-based dialog system. ASRU (2017)
Vikram Ramanarayanan, Chee Wee Leong, David Suendermann-Oeft, Keelan Evanini
Crowdsourcing ratings of caller engagement in thin-slice videos of human-machine dialog: benefits and pitfalls. ICMI (2017)
Keelan Evanini, Maryam Najafian, Saeid Safavi, Kay Berkling
WOCCI 2017: 6th international workshop on child computer interaction (workshop summary). ICMI (2017)
Xinhao Wang, Keelan Evanini
Empirical Evaluation of the Communicative Effectiveness of an Automatic Speech-to-Speech Translation System. SLaTE (2017)
Xinhao Wang, Keelan Evanini, Klaus Zechner, Matthew Mulholland
Modeling Discourse Coherence for the Automated Scoring of Spontaneous Spoken Responses. SLaTE (2017)
Yao Qian, Keelan Evanini, Patrick L. Lange, Robert A. Pugh, Rutuja Ubale, Frank K. Soong
Improving native language (L1) identifation with better VAD and TDNN trained separately on native and non-native English corpora. ASRU (2017)
Keelan Evanini, Matthew Mulholland, Eugene Tsuprun, Yao Qian
Using an Automated Content Scoring Engine for Spoken CALL Responses: The ETS submission for the Spoken CALL Challenge. SLaTE (2017)
Veronika Timpe-Laughlin, Jeremy Lee, Keelan Evanini, James V. Bruno, Ian Blood
Can you guess who I am?: An interactive task for young learners to practice yes/no question formation in English. WOCCI (2017)
Kirby Cofino, Vikram Ramanarayanan, Patrick L. Lange, David Pautler, David Suendermann-Oeft, Keelan Evanini
A modular, multimodal open-source virtual interviewer dialog agent. ICMI (2017)
Vikram Ramanarayanan, Patrick L. Lange, Keelan Evanini, Hillary R. Molloy, David Suendermann-Oeft
Human and Automated Scoring of Fluency, Pronunciation and Intonation During Human-Machine Spoken Dialog Interactions. INTERSPEECH (2017)
Chong Min Lee, Su-Youn Yoon, Xihao Wang, Matthew Mulholland, Ikkyu Choi, Keelan Evanini
Off-Topic Spoken Response Detection Using Siamese Convolutional Neural Networks. INTERSPEECH (2017)
Yao Qian, Keelan Evanini, Xinhao Wang, Chong Min Lee, Matthew Mulholland
Bidirectional LSTM-RNN for Improving Automated Assessment of Non-Native Children's Speech. INTERSPEECH (2017)
Vikram Ramanarayanan, David Suendermann-Oeft, Hillary Molloy, Eugene Tsuprun, Patrick L. Lange, Keelan Evanini
Crowdsourcing Multimodal Dialog Interactions: Lessons Learned from the HALEF Case. AAAI Workshops (2017)
Su-Youn Yoon, Chong Min Lee, Ikkyu Choi, Xinhao Wang, Matthew Mulholland, Keelan Evanini
Off-Topic Spoken Response Detection with Word Embeddings. INTERSPEECH (2017)
Yao Qian, Keelan Evanini, Xinhao Wang, David Suendermann-Oeft, Robert A. Pugh, Patrick L. Lange, Hillary R. Molloy, Frank K. Soong
Improving Sub-Phone Modeling for Better Native Language Identification with Non-Native English Speech. INTERSPEECH (2017)
Björn W. Schuller, Stefan Steidl, Anton Batliner, Julia Hirschberg, Judee K. Burgoon, Alice Baird, Aaron Elkins, Yue Zhang, Eduardo Coutinho, Keelan Evanini
The Native Language Sub-Challenge: The Data. INTERSPEECH (2016)
Yao Qian, Xinhao Wang, Keelan Evanini, David Suendermann-Oeft
Self-Adaptive DNN for Improving Spoken Language Proficiency Assessment. INTERSPEECH (2016)
Björn W. Schuller, Stefan Steidl, Anton Batliner, Julia Hirschberg, Judee K. Burgoon, Alice Baird, Aaron Elkins, Yue Zhang, Eduardo Coutinho, Keelan Evanini
The INTERSPEECH 2016 Computational Paralinguistics Challenge: A Summary of Results. INTERSPEECH (2016)
Xinhao Wang, Keelan Evanini, James V. Bruno, Matthew Mulholland
Automatic plagiarism detection for spoken responses in an assessment of English language proficiency. SLT (2016)
Yao Qian, Jidong Tao, David Suendermann-Oeft, Keelan Evanini, Alexei V. Ivanov, Vikram Ramanarayanan
Noise and Metadata Sensitive Bottleneck Features for Improving Speaker Recognition with Non-Native Speech Input. INTERSPEECH (2016)
Björn W. Schuller, Stefan Steidl, Anton Batliner, Julia Hirschberg, Judee K. Burgoon, Alice Baird, Aaron C. Elkins, Yue Zhang, Eduardo Coutinho, Keelan Evanini
The Deception Sub-Challenge: The Data. INTERSPEECH (2016)
Björn W. Schuller, Stefan Steidl, Anton Batliner, Julia Hirschberg, Judee K. Burgoon, Alice Baird, Aaron C. Elkins, Yue Zhang, Eduardo Coutinho, Keelan Evanini
The INTERSPEECH 2016 Computational Paralinguistics Challenge: Deception, Sincerity & Native Language. INTERSPEECH (2016)
Matthew Mulholland, Melissa Lopez, Keelan Evanini, Anastassia Loukina, Yao Qian
A comparison of ASR and human errors for transcription of non-native spontaneous speech. ICASSP (2016)
Björn W. Schuller, Stefan Steidl, Anton Batliner, Julia Hirschberg, Judee K. Burgoon, Alice Baird, Aaron Elkins, Yue Zhang, Eduardo Coutinho, Keelan Evanini
The Sincerity Sub-Challenge: The Data. INTERSPEECH (2016)
Björn W. Schuller, Stefan Steidl, Anton Batliner, Julia Hirschberg, Judee K. Burgoon, Alice Baird, Aaron Elkins, Yue Zhang, Eduardo Coutinho, Keelan Evanini
Discussion. INTERSPEECH (2016)
Yao Qian, Xinhao Wang, Keelan Evanini, David Suendermann-Oeft
Improving DNN-Based Automatic Recognition of Non-native Children Speech with Adult Speech. WOCCI (2016)
Min Ma, Keelan Evanini, Anastassia Loukina, Xinhao Wang, Klaus Zechner
Using F0 contours to assess nativeness in a sentence repeat task. INTERSPEECH (2015)
Alexei V. Ivanov, Vikram Ramanarayanan, David Suendermann-Oeft, Melissa Lopez, Keelan Evanini, Jidong Tao
Automated Speech Recognition Technology for Dialogue Interaction with Non-Native Interlocutors. SIGDIAL Conference (2015)
Xinhao Wang, Keelan Evanini, Su-Youn Yoon
Word-level F0 modeling in the automated assessment of non-native read speech. SLaTE (2015)
Anastassia Loukina, Melissa Lopez, Keelan Evanini, David Suendermann-Oeft, Klaus Zechner
Expert and crowdsourced annotation of pronunciation errors for automatic scoring systems. INTERSPEECH (2015)
Vikram Ramanarayanan, David Suendermann-Oeft, Alexei V. Ivanov, Keelan Evanini
A distributed cloud-based dialog system for conversational application development. SIGDIAL Conference (2015)
Anastassia Loukina, Melissa Lopez, Keelan Evanini, David Suendermann-Oeft, Alexei V. Ivanov, Klaus Zechner
Pronunciation accuracy and intelligibility of non-native speech. INTERSPEECH (2015)
Keelan Evanini, Youngsoon So, Jidong Tao, Diego Zapata-Rivera, Christine Luce, Laura Battistini, Xinhao Wang
Performance of a trialogue-based prototype system for English language assessment for young learners. WOCCI (2014)
Jidong Tao, Keelan Evanini, Xinhao Wang
The influence of automatic speech recognition accuracy on the performance of an automated speech assessment system. SLT (2014)
Keelan Evanini, Xinhao Wang
Automatic detection of plagiarized spoken responses. BEA@ACL (2014)
Klaus Zechner, Keelan Evanini, Su-Youn Yoon, Lawrence Davis, Xinhao Wang, Lei Chen, Chong Min Lee, Chee Wee Leong
Automated scoring of speaking items in an assessment for teachers of English as a Foreign Language. BEA@ACL (2014)
Xuesong Yang, Anastassia Loukina, Keelan Evanini
Machine learning approaches to improving pronunciation error detection on an imbalanced corpus. SLT (2014)
Keelan Evanini, Shasha Xie, Klaus Zechner
Prompt-based Content Scoring for Automated Spoken Language Assessment. BEA@NAACL-HLT (2013)
Catherine Lai, Keelan Evanini, Klaus Zechner
Applying rhythm metrics to non-native spontaneous speech. SLaTE (2013)
Wenting Xiong, Keelan Evanini, Klaus Zechner, Lei Chen
Automated content scoring of spoken responses containing multiple parts with factual information. SLaTE (2013)
Keelan Evanini, Xinhao Wang
Automated speech scoring for non-native middle school students with multiple task types. INTERSPEECH (2013)
Xinhao Wang, Keelan Evanini, Klaus Zechner
Coherence Modeling for the Automated Assessment of Spontaneous Spoken Responses. HLT-NAACL (2013)
Klaus Zechner, Keelan Evanini, Cara Laitusis
Using automatic speech recognition to assess the reading proficiency of a diverse sample of middle school students. WOCCI (2012)
Shasha Xie, Keelan Evanini, Klaus Zechner
Exploring Content Features for Automated Speech Scoring. HLT-NAACL (2012)
Su-Youn Yoon, Keelan Evanini, Klaus Zechner
Non-scorable Response Detection for Automated Speaking Proficiency Assessment. BEA@ACL (2011)
Xie Sun, Keelan Evanini
Gaussian Mixture Modeling of vowel durations for automated assessment of non-native speech. ICASSP (2011)
Keelan Evanini, Klaus Zechner
Using Crowdsourcing to Provide Prosodic Annotations for Non-Native Speech. INTERSPEECH (2011)
Lei Chen, Keelan Evanini, Xie Sun
Assessment of non-native speech using vowel space characteristics. SLT (2010)
Keelan Evanini, Derrick Higgins, Klaus Zechner
Using Amazon Mechanical Turk for Transcription of Non-Native Speech. Mturk@HLT-NAACL (2010)
David Suendermann, Keelan Evanini, Jackson Liscombe, Phillip Hunter, Krishna Dayanidhi, Roberto Pieraccini
From rule-based to statistical grammars: Continuous improvement of large-scale spoken dialog systems. ICASSP (2009)
Joshua Tauberer, Keelan Evanini
Intrinsic vowel duration and the post-vocalic voicing effect: some evidence from dialects of north american English. INTERSPEECH (2009)
Keelan Evanini, Stephen Isard, Mark Liberman
Automatic formant extraction for sociolinguistic analysis of large corpora. INTERSPEECH (2009)
Keelan Evanini, Phillip Hunter, Jackson Liscombe, David Suendermann, Krishna Dayanidhi, Roberto Pieraccini
Caller Experience: A method for evaluating dialog systems and its automatic prediction. SLT (2008)
David Suendermann, Jackson Liscombe, Keelan Evanini, Krishna Dayanidhi, Roberto Pieraccini
. SLT (2008)
Keelan Evanini, David Suendermann, Roberto Pieraccini
Call classification for automated troubleshooting on large corpora. ASRU (2007)