ATP: Enabling Fast LLM Serving via Attention on Top Principal Keys.

Yue Niu Saurav Prakash Salman Avestimehr

Published in: CoRR (2024)

Keyphrases

data sets
machine learning
information retrieval
computer vision
image processing
case study
expert systems
pairwise
secret key
automated theorem proving