White-Box Transformers via Sparse Rate Reduction: Compression Is All There Is?
Yaodong YuSam BuchananDruv PaiTianzhe ChuZiyang WuShengbang TongHao BaiYuexiang ZhaiBenjamin D. HaeffeleYi MaPublished in: CoRR (2023)
Keyphrases
- white box
- black box
- source code
- image compression
- compression algorithm
- data compression
- compression ratio
- test cases
- complexity reduction
- data reduction
- high dimensional
- sparse representation
- image codec
- compressed sensing
- reduction method
- sparse data
- neural network
- database
- sparse coding
- compressive sensing
- case study
- random access
- test data
- image reconstruction
- compression rate
- software systems
- open source
- data sets