Joakim Gustafson

ORCID

Publication Activity (10 Years)

Years Active: 1993-2024
Publications (10 Years): 64

Top Venues

Royal Institute of Technology, Stockholm, Sweden (PHD)

Education History

Royal Institute of Technology, Stockholm, Sweden

PHD

Publications

Christina Tånnander, Jens Edlund, Joakim Gustafson
Revisiting Three Text-to-Speech Synthesis Experiments with a Web-Based Audience Response System. LREC/COLING (2024)
Harm Lameris, Éva Székely, Joakim Gustafson
The Role of Creaky Voice in Turn Taking and the Perception of Speaker Stance: Experiments Using Controllable TTS. LREC/COLING (2024)
Harm Lameris, Shivam Mehta, Gustav Eje Henter, Joakim Gustafson, Éva Székely
Prosody-Controllable Spontaneous TTS with Neural HMMS. ICASSP (2023)
Siyang Wang, Gustav Eje Henter, Joakim Gustafson, Éva Székely
On the Use of Self-Supervised Speech Representations in Spontaneous Speech Synthesis. SSW (2023)
Siyang Wang, Gustav Eje Henter, Joakim Gustafson, Éva Székely
A Comparative Study of Self-Supervised Speech Representations in Read and Spontaneous TTS. ICASSP Workshops (2023)
Paola Raquel Peña, Philip R. Doyle, Emily Yj Ip, Giovanni Di Liberto, Darragh Higgins, Rachel McDonnell, Holly P. Branigan, Joakim Gustafson, Donald McMillan, Robert J. Moore, Benjamin R. Cowan
A Special Interest Group on Developing Theories of Language Use in Interaction with Conversational User Interfaces. CHI Extended Abstracts (2023)
Ambika Kirkland, Shivam Mehta, Harm Lameris, Gustav Eje Henter, Éva Székely, Joakim Gustafson
Stuck in the MOS pit: A critical analysis of MOS test methodology in TTS evaluation. SSW (2023)
Jura Miniota, Siyang Wang, Jonas Beskow, Joakim Gustafson, Éva Székely, André Pereiral
Hi robot, it's not what you say, it's how you say it. RO-MAN (2023)
Erik Ekstedt, Siyang Wang, Éva Székely, Joakim Gustafson, Gabriel Skantze
Automatic Evaluation of Turn-taking Cues in Conversational Speech Synthesis. INTERSPEECH (2023)
Ambika Kirkland, Joakim Gustafson, Éva Székely
Pardon my disfluency: The impact of disfluency effects on the perception of speaker competence and confidence. INTERSPEECH (2023)
Siyang Wang, Gustav Eje Henter, Joakim Gustafson, Éva Székely
A Comparative Study of Self-Supervised Speech Representations in Read and Spontaneous TTS. CoRR (2023)
Harm Lameris, Ambika Kirkland, Joakim Gustafson, Éva Székely
Situating Speech Synthesis: Investigating Contextual Factors in the Evaluation of Conversational TTS. SSW (2023)
Harm Lameris, Joakim Gustafson, Éva Székely
Beyond Style: Synthesizing Speech with Pragmatic Functions. INTERSPEECH (2023)
Joakim Gustafson, Éva Székely, Jonas Beskow
Generation of speech and facial animation with controllable articulatory effort for amusing conversational characters. IVA (2023)
Siyang Wang, Gustav Eje Henter, Joakim Gustafson, Éva Székely
On the Use of Self-Supervised Speech Representations in Spontaneous Speech Synthesis. CoRR (2023)
Éva Székely, Siyang Wang, Joakim Gustafson
So-to-Speak: An Exploratory Platform for Investigating the Interplay between Style and Prosody in TTS. INTERSPEECH (2023)
Joakim Gustafson, Éva Székely, Simon Alexandersson, Jonas Beskow
Casual chatter or speaking up? Adjusting articulatory effort in generation of speech and animation for conversational characters. FG (2023)
Erik Ekstedt, Siyang Wang, Éva Székely, Joakim Gustafson, Gabriel Skantze
Automatic Evaluation of Turn-taking Cues in Conversational Speech Synthesis. CoRR (2023)
Éva Székely, Joakim Gustafson, Ilaria Torre
Prosody-controllable Gender-ambiguous Speech Synthesis: A Tool for Investigating Implicit Bias in Speech Perception. INTERSPEECH (2023)
Siyang Wang, Joakim Gustafson, Éva Székely
Evaluating Sampling-based Filler Insertion with Spontaneous TTS. LREC (2022)
Ambika Kirkland, Harm Lameris, Éva Székely, Joakim Gustafson
Where's the uh, hesitation? The interplay between filled pause location, speech rate and fundamental frequency in perception of confidence. INTERSPEECH (2022)
Harm Lameris, Shivam Mehta, Gustav Eje Henter, Joakim Gustafson, Éva Székely
Prosody-controllable spontaneous TTS with neural HMMs. CoRR (2022)
Catharine Oertel, Patrik Jonell, Dimosthenis Kontogiorgos, Kenneth Alberto Funes Mora, Jean-Marc Odobez, Joakim Gustafson
Towards an Engagement-Aware Attentive Artificial Listener for Multi-Party Interactions. Frontiers Robotics AI 8 (2021)
Siyang Wang, Simon Alexanderson, Joakim Gustafson, Jonas Beskow, Gustav Eje Henter, Éva Székely
Integrated Speech and Gesture Synthesis. ICMI (2021)
Dimosthenis Kontogiorgos, André Pereira, Joakim Gustafson
Grounding behaviours with conversational interfaces: effects of embodiment and failures. J. Multimodal User Interfaces 15 (2) (2021)
Siyang Wang, Simon Alexanderson, Joakim Gustafson, Jonas Beskow, Gustav Eje Henter, Éva Székely
Integrated Speech and Gesture Synthesis. CoRR (2021)
Joakim Gustafson, Jonas Beskow, Éva Székely
Personality in the mix - investigating the contribution of fillers and speaking style to the perception of spontaneous speech synthesis. SSW (2021)
Dimosthenis Kontogiorgos, Minh Tran, Joakim Gustafson, Mohammad Soleymani
A Systematic Cross-Corpus Analysis of Human Reactions to Robot Conversational Failures. ICMI (2021)
Ambika Kirkland, Marcin Wlodarczak, Joakim Gustafson, Éva Székely
Perception of smiling voice in spontaneous speech synthesis. SSW (2021)
Patrik Jonell, Birger Moëll, Krister Håkansson, Gustav Eje Henter, Taras Kucherenko, Olga Mikheeva, Göran Hagman, Jasper Holleman, Miia Kivipelto, Hedvig Kjellström, Joakim Gustafson, Jonas Beskow
Multimodal Capture of Patient Behaviour for Improved Detection of Early Dementia: Clinical Feasibility and Preliminary Results. Frontiers Comput. Sci. 3 (2021)
Dimosthenis Kontogiorgos, André Pereira, Boran Sahindal, Sanne van Waveren, Joakim Gustafson
Behavioural Responses to Robot Conversational Failures. HRI (2020)
Dimosthenis Kontogiorgos, Elena Sibirtseva, Joakim Gustafson
Chinese Whispers: A Multimodal Dataset for Embodied Language Grounding. LREC (2020)
Éva Székely, Gustav Eje Henter, Jonas Beskow, Joakim Gustafson
Breathing and Speech Planning in Spontaneous Speech Synthesis. ICASSP (2020)
Dimosthenis Kontogiorgos, Sanne van Waveren, Olle Wallberg, André Pereira, Iolanda Leite, Joakim Gustafson
Embodiment Effects in Interactions with Failing Robots. CHI (2020)
Éva Székely, Jens Edlund, Joakim Gustafson
Augmented Prompt Selection for Evaluation of Spontaneous Speech Synthesis. LREC (2020)
André Pereira, Catharine Oertel, Leonor Fermoselle, Joseph Mendelson, Joakim Gustafson
Effects of Different Interaction Contexts when Evaluating Gaze Models in HRI. HRI (2020)
Dimosthenis Kontogiorgos, Gabriel Skantze, André Pereira, Joakim Gustafson
The Effects of Embodiment and Social Eye-Gaze in Conversational Agents. CogSci (2019)
Zofia Malisz, Harald Berthelsen, Jonas Beskow, Joakim Gustafson
PROMIS: a statistical-parametric speech synthesis system with prominence control via a prominence network. SSW (2019)
Éva Székely, Gustav Eje Henter, Jonas Beskow, Joakim Gustafson
Spontaneous Conversational Speech Synthesis from Found Data. INTERSPEECH (2019)
Dimosthenis Kontogiorgos, André Pereira, Olle Andersson, Marco Koivisto, Elena Gonzalez Rabal, Ville Vartiainen, Joakim Gustafson
The Effects of Anthropomorphism and Non-verbal Social Behaviour in Virtual Assistants. IVA (2019)
Éva Székely, Gustav Eje Henter, Jonas Beskow, Joakim Gustafson
Off the Cuff: Exploring Extemporaneous Speech Delivery with TTS. INTERSPEECH (2019)
Éva Székely, Gustav Eje Henter, Joakim Gustafson
Casting to Corpus: Segmenting and Selecting Spontaneous Dialogue for Tts with a Cnn-lstm Speaker-dependent Breath Detector. ICASSP (2019)
Éva Székely, Gustav Eje Henter, Jonas Beskow, Joakim Gustafson
How to train your fillers: uh and um in spontaneous speech synthesis. SSW (2019)
André Pereira, Catharine Oertel, Leonor Fermoselle, Joe Mendelson, Joakim Gustafson
Responsive Joint Attention in Human-Robot Interaction. IROS (2019)
Petra Wagner, Jonas Beskow, Simon Betz, Jens Edlund, Joakim Gustafson, Gustav Eje Henter, Sébastien Le Maguer, Zofia Malisz, Éva Székely, Christina Tånnander, Jana Voße
Speech Synthesis Evaluation - State-of-the-Art Assessment and Suggestion for a Novel Research Program. SSW (2019)
Dimosthenis Kontogiorgos, André Pereira, Joakim Gustafson
Estimating Uncertainty in Task-Oriented Dialogue. ICMI (2019)
Elena Sibirtseva, Dimosthenis Kontogiorgos, Olov Nykvist, Hakan Karaoguz, Iolanda Leite, Joakim Gustafson, Danica Kragic
A Comparison of Visualisation Methods for Disambiguating Verbal Requests in Human-Robot Interaction. CoRR (2018)
Dimosthenis Kontogiorgos, Vanya Avramova, Simon Alexandersson, Patrik Jonell, Catharine Oertel, Jonas Beskow, Gabriel Skantze, Joakim Gustafson
A Multimodal Corpus for Mutual Gaze and Joint Attention in Multiparty Situated Interaction. LREC (2018)
Elena Sibirtseva, Dimosthenis Kontogiorgos, Olov Nykvist, Hakan Karaoguz, Iolanda Leite, Joakim Gustafson, Danica Kragic
A Comparison of Visualisation Methods for Disambiguating Verbal Requests in Human-Robot Interaction. RO-MAN (2018)
Danica Kragic, Joakim Gustafson, Hakan Karaoguz, Patric Jensfelt, Robert Krug
Interactive, Collaborative Robots: Challenges and Opportunities. IJCAI (2018)
Dimosthenis Kontogiorgos, Elena Sibirtseva, André Pereira, Gabriel Skantze, Joakim Gustafson
Multimodal Reference Resolution In Collaborative Assembly Tasks. MA3HMI@ICMI (2018)
Patrik Jonell, Catharine Oertel, Dimosthenis Kontogiorgos, Jonas Beskow, Joakim Gustafson
Crowdsourced Multimodal Corpora Collection Tool. LREC (2018)
Patrik Jonell, Catharine Oertel, Dimosthenis Kontogiorgos, Jonas Beskow, Joakim Gustafson
Crowd-Powered Design of Virtual Attentive Listeners. IVA (2017)
Zofia Malisz, Harald Berthelsen, Jonas Beskow, Joakim Gustafson
Controlling Prominence Realisation in Parametric DNN-Based Speech Synthesis. INTERSPEECH (2017)
Catharine Oertel, Patrik Jonell, Dimosthenis Kontogiorgos, Joseph Mendelson, Jonas Beskow, Joakim Gustafson
Crowd-Sourced Design of Artificial Attentive Listeners. INTERSPEECH (2017)
Patrik Jonell, Joseph Mendelson, Thomas Storskog, Goran Hagman, Per Östberg, Iolanda Leite, Taras Kucherenko, Olga Mikheeva, Ulrika Akenine, Vesna Jelic, Alina Solomon, Jonas Beskow, Joakim Gustafson, Miia Kivipelto, Hedvig Kjellström
Machine Learning and Social Robotics for Detecting Early Signs of Dementia. CoRR (2017)
Catharine Oertel, Patrik Jonell, Kevin El Haddad, Éva Székely, Joakim Gustafson
Using crowd-sourcing for the design of listening agents: challenges and opportunities. ISIAA@ICMI (2017)
Éva Székely, Joseph Mendelson, Joakim Gustafson
Synthesising Uncertainty: The Interplay of Vocal Effort and Hesitation Disfluencies. INTERSPEECH (2017)
Catharine Oertel, Joakim Gustafson, Alan W. Black
On data driven parametric backchannel synthesis for expressing attentiveness in conversational agents. MA3HMI@ICMI (2016)
Catharine Oertel, José Lopes, Yu Yu, Kenneth Alberto Funes Mora, Joakim Gustafson, Alan W. Black, Jean-Marc Odobez
Towards building an attentive artificial listener: on the perception of attentiveness in audio-visual feedback tokens. ICMI (2016)
Martin Johansson, Tatsuro Hori, Gabriel Skantze, Anja Höthker, Joakim Gustafson
Making Turn-Taking Decisions for an Active Listening Robot for Memory Training. ICSR (2016)
John Andersson, Sebastian Berlin, André Costa, Harald Berthelsen, Hanna Lindgren, Nikolaj Lindberg, Jonas Beskow, Jens Edlund, Joakim Gustafson
WikiSpeech - enabling open source text-to-speech for Wikipedia. SSW (2016)
Jens Edlund, Joakim Gustafson
Hidden Resources ― Strategies to Acquire and Exploit Potential Spoken Language Resources in National Archives. LREC (2016)
Catharine Oertel, Joakim Gustafson, Alan W. Black
Towards Building an Attentive Artificial Listener: On the Perception of Attentiveness in Feedback Utterances. INTERSPEECH (2016)
Jens Edlund, Christina Tånnander, Joakim Gustafson
Audience response system-based assessment for analysis-by-synthesis. ICPhS (2015)
Raveesh Meena, José Lopes, Gabriel Skantze, Joakim Gustafson
Automatic Detection of Miscommunication in Spoken Dialogue Systems. SIGDIAL Conference (2015)
Catharine Oertel, Kenneth Alberto Funes Mora, Joakim Gustafson, Jean-Marc Odobez
Deciphering the Silent Participant: On the Use of Audio-Visual Cues for the Classification of Listener Categories in Group Discussions. ICMI (2015)
José Lopes, Giampiero Salvi, Gabriel Skantze, Alberto Abad, Joakim Gustafson, Fernando Batista, Raveesh Meena, Isabel Trancoso
Detecting repetitions in spoken dialogue systems using phonetic distances. INTERSPEECH (2015)
Samer Al Moubayed, Jonas Beskow, Bajibabu Bollepalli, Joakim Gustafson, Ahmed Hussen Abdelaziz, Martin Johansson, Maria Koutsombogera, José David Águas Lopes, Jekaterina Novikova, Catharine Oertel, Gabriel Skantze, Kalin Stefanov, Gül Varol
Human-robot collaborative tutoring using multiparty multimodal spoken dialogue. HRI (2014)
Martin Johansson, Gabriel Skantze, Joakim Gustafson
Comparison of Human-Human and Human-Robot Turn-Taking Behaviour in Multiparty Situated Interaction. UM3I@ICMI (2014)
Jens Edlund, Fredrik Edelstam, Joakim Gustafson
Human pause and resume behaviours for unobtrusive humanlike in-car spoken dialogue systems. DM@EACL (2014)
Raveesh Meena, Johan Boye, Gabriel Skantze, Joakim Gustafson
Crowdsourcing Street-level Geographic Information Using a Spoken Dialogue System. SIGDIAL Conference (2014)
Raveesh Meena, Gabriel Skantze, Joakim Gustafson
Data-driven models for timing feedback responses in a Map Task dialogue system. Comput. Speech Lang. 28 (4) (2014)
Catharine Oertel, Kenneth Alberto Funes Mora, Samira Sheikhi, Jean-Marc Odobez, Joakim Gustafson
Who Will Get the Grant?: A Multimodal Corpus for the Analysis of Conversational Behaviours in Group Interviews. UM3I@ICMI (2014)
Bajibabu Bollepalli, Jérôme Urbain, Tuomo Raitio, Joakim Gustafson, Hüseyin Çakmak
A comparative evaluation of vocoding techniques for HMM-based laughter synthesis. ICASSP (2014)
Martin Johansson, Gabriel Skantze, Joakim Gustafson
Head Pose Patterns in Multiparty Human-Robot Team-Building Interactions. ICSR (2013)
Bajibabu Bollepalli, Jonas Beskow, Joakim Gustafson
Non-linear Pitch Modification in Voice Conversion Using Artificial Neural Networks. NOLISP (2013)
Samer Al Moubayed, Jens Edlund, Joakim Gustafson
Analysis of gaze and speech patterns in three-party quiz game interaction. INTERSPEECH (2013)
Raveesh Meena, Gabriel Skantze, Joakim Gustafson
A Data-driven Model for Timing Feedback in a Map Task Dialogue System. SIGDIAL Conference (2013)
Nicole Mirnig, Astrid Weiss, Gabriel Skantze, Samer Al Moubayed, Joakim Gustafson, Jonas Beskow, Björn Granström, Manfred Tscheligi
Face-to-Face with a Robot: What do we actually Talk about? Int. J. Humanoid Robotics 10 (1) (2013)
Raveesh Meena, Gabriel Skantze, Joakim Gustafson
The Map Task Dialogue System: A Test-bed for Modelling Human-Like Dialogue. SIGDIAL Conference (2013)
Daniel Neiberg, Giampiero Salvi, Joakim Gustafson
Semi-supervised methods for exploring the acoustics of simple productive feedback. Speech Commun. 55 (3) (2013)
Jens Edlund, Mattias Heldner, Joakim Gustafson
On the effect of the acoustic environment on the accuracy of perception of speaker orientation from auditory cues alone. INTERSPEECH (2012)
Catharine Oertel, Marcin Wlodarczak, Jens Edlund, Petra Wagner, Joakim Gustafson
Gaze Patterns in Turn-Taking. INTERSPEECH (2012)
Mats Blomberg, Gabriel Skantze, Samer Al Moubayed, Joakim Gustafson, Jonas Beskow, Björn Granström
Children and adults in dialogue with the robot head Furhat - corpus collection and initial analysis. WOCCI (2012)
Samer Al Moubayed, Gabriel Skantze, Jonas Beskow, Kalin Stefanov, Joakim Gustafson
Multimodal multiparty social interaction with the furhat head. ICMI (2012)
Raveesh Meena, Gabriel Skantze, Joakim Gustafson
A Data-driven Approach to Understanding Spoken Route Directions in Human-Robot Dialogue. INTERSPEECH (2012)
Johan Boye, Morgan Fredriksson, Jana Götze, Joakim Gustafson, Jürgen Königsmann
Walk This Way: Spatial Grounding for City Exploration. IWSDS (2012)
Matthew Johnson-Roberson, Jeannette Bohg, Gabriel Skantze, Joakim Gustafson, Rolf Carlson, Babak Rasolzadeh, Danica Kragic
Enhanced visual scene understanding through human-robot dialog. IROS (2011)
Daniel Neiberg, Joakim Gustafson
A Dual Channel Coupled Decoder for Fillers and Feedback. INTERSPEECH (2011)
Daniel Neiberg, Joakim Gustafson
Predicting Speaker Changes and Listener Responses with and without Eye-Contact. INTERSPEECH (2011)
Daniel Neiberg, Gopal Ananthakrishnan, Joakim Gustafson
Tracking Pitch Contours Using Minimum Jerk Trajectories. INTERSPEECH (2011)
Daniel Neiberg, Joakim Gustafson
The prosody of Swedish conversational grunts. INTERSPEECH (2010)
Matthew Johnson-Roberson, Jeannette Bohg, Danica Kragic, Gabriel Skantze, Joakim Gustafson, Rolf Carlson
Enhanced Visual Scene Understanding through Human-Robot Dialog. AAAI Fall Symposium: Dialog with Robots (2010)
Joakim Gustafson, Daniel Neiberg
Prosodic cues to engagement in non-lexical response tokens in Swedish. DiSS-LPSS (2010)
Daniel Neiberg, Joakim Gustafson
Modeling conversational interaction using coupled Markov chains. DiSS-LPSS (2010)
Gabriel Skantze, Joakim Gustafson
Attention and Interaction Control in a Human-Human-Computer Dialogue Setting. SIGDIAL Conference (2009)
Joakim Gustafson, Miray Merkes
Eliciting Interactional Phenomena in Human-Human Dialogues. SIGDIAL Conference (2009)
Jonas Beskow, Jens Edlund, Björn Granström, Joakim Gustafson, Gabriel Skantze, Helena Tobiasson
The MonAMI reminder: a spoken dialogue system for face-to-face interaction. INTERSPEECH (2009)
Jonas Beskow, Jens Edlund, Björn Granström, Joakim Gustafson, David House
Face-to-Face Interaction and the KTH Cooking Show. COST 2102 Training School (2009)

Joakim Gustafson.css-eqlu8i{font-size:small;padding-left:4px;}

Publication Activity (10 Years)

Top Topics

Top Venues

Joakim Gustafson