Log-Precision Transformers are Constant-Depth Uniform Threshold Circuits.

William Merrill Ashish Sabharwal

Published in: CoRR (2022)

Keyphrases

log log
depth information
depth map
high speed
precision and recall
threshold selection
positive integer
circuit design
vlsi circuits
delay insensitive
threshold values
image processing
database
digital circuits
analog circuits
logic circuits
average precision
learning algorithm
genetic algorithm
neural network