Nitin Kedia

Publication Activity (10 Years)

Years Active: 2024-2024
Publications (10 Years): 5

Top Topics

Inference Process

Top Venues

Publications

Amey Agrawal, Nitin Kedia, Jayashree Mohan, Ashish Panwar, Nipun Kwatra, Bhargav S. Gulavani, Ramachandran Ramjee, Alexey Tumanov
Vidur: A Large-Scale Simulation Framework For LLM Inference. CoRR (2024)
Amey Agrawal, Nitin Kedia, Ashish Panwar, Jayashree Mohan, Nipun Kwatra, Bhargav S. Gulavani, Alexey Tumanov, Ramachandran Ramjee
Taming Throughput-Latency Tradeoff in LLM Inference with Sarathi-Serve. OSDI (2024)
Amey Agrawal, Nitin Kedia, Ashish Panwar, Jayashree Mohan, Nipun Kwatra, Bhargav S. Gulavani, Alexey Tumanov, Ramachandran Ramjee
Taming Throughput-Latency Tradeoff in LLM Inference with Sarathi-Serve. CoRR (2024)
Amey Agrawal, Nitin Kedia, Jayashree Mohan, Ashish Panwar, Nipun Kwatra, Bhargav S. Gulavani, Ramachandran Ramjee, Alexey Tumanov
VIDUR: A Large-Scale Simulation Framework for LLM Inference. MLSys (2024)
Amey Agrawal, Anmol Agarwal, Nitin Kedia, Jayashree Mohan, Souvik Kundu, Nipun Kwatra, Ramachandran Ramjee, Alexey Tumanov
Metron: Holistic Performance Evaluation Framework for LLM Inference Systems. CoRR (2024)