On the Power of Saturated Transformers: A View from Circuit Complexity.

William Merrill Yoav Goldberg Roy Schwartz Noah A. Smith

Published in: CoRR (2021)

Keyphrases

worst case
high speed
neural network
power consumption
power reduction
database
search engine
computational cost
multiple views
duty cycle