Simple parameter-free self-attention approximation.

Yuwen Zhai Jing Hao Liang Gao Xinyu Li Yiping Gao Shumin Han

Published in: CoRR (2023)

Keyphrases

parameter free
outlier detection
neural network
categorical data
objective function
data mining techniques
fully automatic
approximation error
database
data mining
learning algorithm
social networks
data streams
closed form
error bounds
relative error