Login / Signup
VIDUR: A Large-Scale Simulation Framework for LLM Inference.
Amey Agrawal
Nitin Kedia
Jayashree Mohan
Ashish Panwar
Nipun Kwatra
Bhargav S. Gulavani
Ramachandran Ramjee
Alexey Tumanov
Published in:
MLSys (2024)
Keyphrases
</>
main contribution
inference process
lightweight
abductive reasoning
data mining
simulation environment
theoretical framework
similarity measure
statistical inference
multiscale
database
decision trees
learning algorithm
machine learning
databases
data sets
real time