Receptive Field Alignment Enables Transformer Length Extrapolation.

Ta-Chung Chi Ting-Han Fan Alexander I. Rudnicky

Published in: CoRR (2022)

Keyphrases

receptive fields
biologically inspired
natural images
image representation
visual cortex
space time
primary visual cortex
fuzzy logic
neural network
fault diagnosis
input space
visual information
hidden layer
machine learning
saliency map