Reyna Abhyankar

Publication Activity (10 Years)

Years Active: 2023-2024
Publications (10 Years): 4

Top Topics

Bayesian Inference

Language Models For Information Retrieval

Language Modelling

Top Venues

Publications

Xupeng Miao, Gabriele Oliaro, Zhihao Zhang, Xinhao Cheng, Zeyu Wang, Zhengxin Zhang, Rae Ying Yee Wong, Alan Zhu, Lijie Yang, Xiaoxiang Shi, Chunan Shi, Zhuoming Chen, Daiyaan Arfeen, Reyna Abhyankar, Zhihao Jia
SpecInfer: Accelerating Large Language Model Serving with Tree-based Speculative Inference and Verification. ASPLOS (3) (2024)
Reyna Abhyankar, Zijian He, Vikranth Srivatsa, Hao Zhang, Yiying Zhang
APIServe: Efficient API Support for Large-Language Model Inferencing. CoRR (2024)
Vikranth Srivatsa, Zijian He, Reyna Abhyankar, Dongming Li, Yiying Zhang
Preble: Efficient Distributed Prompt Scheduling for LLM Serving. CoRR (2024)
Xupeng Miao, Gabriele Oliaro, Zhihao Zhang, Xinhao Cheng, Zeyu Wang, Rae Ying Yee Wong, Zhuoming Chen, Daiyaan Arfeen, Reyna Abhyankar, Zhihao Jia
SpecInfer: Accelerating Generative LLM Serving with Speculative Inference and Token Tree Verification. CoRR (2023)