Mixture-of-Prompt-Experts for Multi-modal Semantic Understanding.

Zichen Wu Hsiu-Yuan Huang Fanyi Qu Yunfang Wu

Published in: LREC/COLING (2024)

Keyphrases

multi modal
semantic concepts
multi modality
audio visual
high dimensional
cross modal
mixture model
high level
uni modal
video search
image annotation
humanoid robot
semantic information
semantic search
feature space
semantic similarity
semantic web
higher level
low level
multiple modalities
fusing multiple
metadata