MEGABYTE: Predicting Million-byte Sequences with Multiscale Transformers.
Lili YuDaniel SimigColin FlahertyArmen AghajanyanLuke ZettlemoyerMike LewisPublished in: NeurIPS (2023)
Keyphrases
- multiscale
- fixed length
- variable length
- image processing
- hidden markov models
- image segmentation
- scale space
- neural network
- real world
- natural images
- edge detection
- wavelet transform
- real time
- filter bank
- sequential patterns
- sequential data
- sequence alignment
- tens of thousands
- multiscale representation
- data structure
- wavelet coefficients
- coarse to fine
- affine invariant
- high quality
- information systems
- temporal sequences