Attention Module is Not Only a Weight: Analyzing Transformers with Vector Norms.

Goro Kobayashi Tatsuki Kuribayashi Sho Yokoi Kentaro Inui

Published in: CoRR (2020)

Keyphrases

vector space
weight vector
optimal weights
electronic institutions
data sets
genetic algorithm
website
multi agent systems
feature space
weighting scheme
feature weights