Simplicity Bias in Transformers and their Ability to Learn Sparse Boolean Functions.

Satwik Bhattamishra Arkil Patel Varun Kanade Phil Blunsom

Published in: CoRR (2022)

Keyphrases

boolean functions
uniform distribution
prime implicants
threshold functions
membership queries
dnf formulae
multi valued
functional properties
relevant variables
high dimensional
linear threshold
search algorithm
binary decision diagrams