Outlier Dimensions that Disrupt Transformers are Driven by Frequency.
Giovanni PuccettiAnna RogersAleksandr DrozdFelice Dell'OrlettaPublished in: EMNLP (Findings) (2022)
Keyphrases
- outlier detection
- low frequency
- data driven
- novelty detection
- frequency distribution
- multiple dimensions
- dimensional data
- spectrum analysis
- data sets
- frequency response
- high frequency
- multiresolution
- relational databases
- association rules
- digital libraries
- search algorithm
- video sequences
- information retrieval
- databases