Login / Signup
Vidur: A Large-Scale Simulation Framework For LLM Inference.
Amey Agrawal
Nitin Kedia
Jayashree Mohan
Ashish Panwar
Nipun Kwatra
Bhargav S. Gulavani
Ramachandran Ramjee
Alexey Tumanov
Published in:
CoRR (2024)
Keyphrases
</>
main contribution
neural network
theoretical framework
mathematical model
simulation model
inference process
simulation platform
database
social networks
multi agent
probabilistic model
knowledge representation
small scale
bayesian inference