Fovea Transformer: Efficient Long-Context Modeling with Structured Fine-to-Coarse Attention.

Ziwei He Jian Yuan Le Zhou Jingwen Leng Bo Jiang

Published in: CoRR (2023)

Keyphrases

context modeling
context awareness
multiresolution
computationally efficient
multiscale
ambient intelligence
eye movements
high order
image coder