Sign in

CoLT5: Faster Long-Range Transformers with Conditional Computation.

Joshua AinslieTao LeiMichiel de JongSantiago OntañónSiddhartha BrahmaYury ZemlyanskiyDavid C. UthusMandy GuoJames Lee-ThorpYi TayYun-Hsuan SungSumit Sanghai
Published in: CoRR (2023)
Keyphrases
  • long range
  • short range
  • conditional random fields
  • long range correlations
  • fractional brownian motion
  • pairwise
  • rigid and non rigid
  • long range interactions