Two Stones Hit One Bird: Bilevel Positional Encoding for Better Length Extrapolation.
Zhenyu HeGuhao FengShengjie LuoKai YangDi HeJingjing XuZhi ZhangHongxia YangLiwei WangPublished in: CoRR (2024)
Keyphrases
- bit string
- positional information
- bird species
- fixed length
- maximum number
- linear programming
- variable length
- bilevel programming
- computational complexity
- encoding scheme
- machine learning
- encoding schemes
- expert systems
- incomplete data
- database
- search engine
- fractal image compression
- total length
- genetic algorithm
- data mining
- real world