Rethinking Query, Key, and Value Embedding in Vision Transformer under Tiny Model Constraints.

Jaesin Ahn Jiuk Hong Jeongwoo Ju Heechul Jung

Published in: CoRR (2021)

Keyphrases

data structure
computer vision
high level
real time
objective function
prior knowledge
management system
response time
vector space
database
data sources
power system
experimental data
conceptual model
query evaluation