One Pass Streaming Algorithm for Super Long Token Attention Approximation in Sublinear Space.
Raghav AddankiChenyang LiZhao SongChiwun YangPublished in: CoRR (2023)
Keyphrases
- expectation maximization
- times faster
- np hard
- k means
- high accuracy
- optimal solution
- experimental evaluation
- preprocessing
- cost function
- learning algorithm
- optimization algorithm
- dynamic programming
- clustering method
- higher dimensional
- approximation ratio
- convergence rate
- space complexity
- detection algorithm
- linear programming
- segmentation algorithm
- search space
- computational complexity
- theoretical analysis
- data sets
- computational cost
- matching algorithm
- closed form
- lower bound
- error bounds
- solution space
- improved algorithm
- data structure
- objective function
- similarity measure
- randomized algorithm