NIME or Mime: A Sound-First Approach to Developing an Audio-Visual Gestural Instrument.

Alon Ilsar Matthew Hughes Andrew Johnston

Published in: NIME (2020)

Keyphrases

audio visual
multi modal
sound source
temporal context
visual information
visual data
multimedia
multi stream
emotion recognition
person authentication
audio visual speech recognition
musical instrument
audio features
data sets
high level
gesture recognition