Login / Signup
vAttention: Dynamic Memory Management for Serving LLMs without PagedAttention.
Ramya Prabhu
Ajay Nayak
Jayashree Mohan
Ramachandran Ramjee
Ashish Panwar
Published in:
CoRR (2024)
Keyphrases
</>
memory management
operating system
garbage collection
machine learning
computer vision
pattern recognition
computing environments
hardware implementation
data analysis
web applications
parallel implementation
parallel computation