A2SF: Accumulative Attention Scoring with Forgetting Factor for Token Pruning in Transformer Decoder.

Hyun-rae Jo Dongkun Shin

Published in: CoRR (2024)

Keyphrases

low complexity
search space
motion detection
incremental learning
scoring model
pruning method
pruning algorithm
fault diagnosis
power system
error concealment
focus of attention
fuzzy logic
visual attention
artificial intelligence
high voltage
multiview video coding
data sets