Efficient Large-Scale Audio Tagging Via Transformer-to-CNN Knowledge Distillation.

Florian Schmid Khaled Koutini Gerhard Widmer

Published in: ICASSP (2023)

Keyphrases

data mining techniques
knowledge discovery
knowledge acquisition
real world
metadata
real life
visual information
domain knowledge
fuzzy logic
multi modal
speech recognition
small scale
visual data
cellular neural networks