What's Hidden in a One-layer Randomly Weighted Transformer?

Sheng Shen Zhewei Yao Douwe Kiela Kurt Keutzer Michael W. Mahoney

Published in: EMNLP (1) (2021)

Keyphrases

three dimensional
multi layer
fuzzy logic
weighted sum
data sets
databases
fault diagnosis
hidden information
randomly chosen
high voltage
search engine
search algorithm
computational intelligence