Zhihao Jia

Publication Activity (10 Years)

Years Active: 2012-2024
Publications (10 Years): 69

Top Topics

Parallelization Strategy

Outlier Detection

Top Venues

Proc. VLDB Endow.

Publications

Xupeng Miao, Gabriele Oliaro, Zhihao Zhang, Xinhao Cheng, Zeyu Wang, Zhengxin Zhang, Rae Ying Yee Wong, Alan Zhu, Lijie Yang, Xiaoxiang Shi, Chunan Shi, Zhuoming Chen, Daiyaan Arfeen, Reyna Abhyankar, Zhihao Jia
SpecInfer: Accelerating Large Language Model Serving with Tree-based Speculative Inference and Verification. ASPLOS (3) (2024)
Yixuan Mei, Yonghao Zhuang, Xupeng Miao, Juncheng Yang, Zhihao Jia, Rashmi Vinayak
Helix: Distributed Serving of Large Language Models via Max-Flow on Heterogeneous GPUs. CoRR (2024)
Zhihao Zhang, Alan Zhu, Lijie Yang, Yihua Xu, Lanting Li, Phitchaya Mangpo Phothilimthana, Zhihao Jia
Accelerating Retrieval-Augmented Language Model Serving with Speculation. CoRR (2024)
Xupeng Miao, Chunan Shi, Jiangfei Duan, Xiaoli Xi, Dahua Lin, Bin Cui, Zhihao Jia
SpotServe: Serving Generative Large Language Models on Preemptible Instances. ASPLOS (2) (2024)
Zhuoming Chen, Avner May, Ruslan Svirschevski, Yuhsun Huang, Max Ryabinin, Zhihao Jia, Beidi Chen
Sequoia: Scalable, Robust, and Hardware-aware Speculative Decoding. CoRR (2024)
Zhengxin Zhang, Dan Zhao, Xupeng Miao, Gabriele Oliaro, Zhihao Zhang, Qing Li, Yong Jiang, Zhihao Jia
Quantized Side Tuning: Fast and Memory-Efficient Tuning of Quantized Large Language Models. ACL (1) (2024)
Xupeng Miao, Zhihao Jia, Bin Cui
Demystifying Data Management for Large Language Models. SIGMOD Conference Companion (2024)
Zikun Li, Jinjun Peng, Yixuan Mei, Sina Lin, Yi Wu, Oded Padon, Zhihao Jia
Quarl: A Learning-Based Quantum Circuit Optimizer. Proc. ACM Program. Lang. 8 (OOPSLA1) (2024)
Mengdi Wu, Xinhao Cheng, Oded Padon, Zhihao Jia
A Multi-Level Superoptimizer for Tensor Programs. CoRR (2024)
Xupeng Miao, Gabriele Oliaro, Xinhao Cheng, Mengdi Wu, Colin Unger, Zhihao Jia
FlexLLM: A System for Co-Serving Large Language Model Inference and Parameter-Efficient Finetuning. CoRR (2024)
Hongli Zhou, Zhihao Jia, Haiyang Zhu, Zhizheng Zhang
CLLP: Contrastive Learning Framework Based on Latent Preferences for Next POI Recommendation. SIGIR (2024)
Muyan Hu, Ashwin Venkatram, Shreyashri Biswas, Balamurugan Marimuthu, Bohan Hou, Gabriele Oliaro, Haojie Wang, Liyan Zheng, Xupeng Miao, Jidong Zhai, Zhihao Jia
Optimal Kernel Orchestration for Tensor Programs with Korch. ASPLOS (3) (2024)
Byungsoo Jeon, Mengdi Wu, Shiyi Cao, Sunghyun Kim, Sunghyun Park, Neeraj Aggarwal, Colin Unger, Daiyaan Arfeen, Peiyuan Liao, Xupeng Miao, Mohammad Alizadeh, Gregory R. Ganger, Tianqi Chen, Zhihao Jia
GraphPipe: Improving Performance and Scalability of DNN Training with Graph Pipeline Parallelism. CoRR (2024)
Zhihao Jia, Bing Wang, Changhao Chen
Drone-NeRF: Efficient NeRF based 3D scene reconstruction for large-scale drone survey. Image Vis. Comput. 143 (2024)
Jiangfei Duan, Ziang Song, Xupeng Miao, Xiaoli Xi, Dahua Lin, Harry Xu, Minjia Zhang, Zhihao Jia
Parcae: Proactive, Liveput-Optimized DNN Training on Preemptible Instances. NSDI (2024)
Zhengxin Zhang, Dan Zhao, Xupeng Miao, Gabriele Oliaro, Qing Li, Yong Jiang, Zhihao Jia
Quantized Side Tuning: Fast and Memory-Efficient Tuning of Quantized Large Language Models. CoRR (2024)
Ruslan Svirschevski, Avner May, Zhuoming Chen, Beidi Chen, Zhihao Jia, Max Ryabinin
SpecExec: Massively Parallel Speculative Decoding for Interactive LLM Inference on Consumer Devices. CoRR (2024)
Jiangfei Duan, Ziang Song, Xupeng Miao, Xiaoli Xi, Dahua Lin, Harry Xu, Minjia Zhang, Zhihao Jia
Parcae: Proactive, Liveput-Optimized DNN Training on Preemptible Instances. CoRR (2024)
Liyan Zheng, Haojie Wang, Jidong Zhai, Muyan Hu, Zixuan Ma, Tuowei Wang, Shuhong Huang, Xupeng Miao, Shizhi Tang, Kezhao Huang, Zhihao Jia
EINNET: Optimizing Tensor Programs with Derivation-Based Transformations. OSDI (2023)
Junhua Gu, Zhihao Jia, Taotao Cai, Xiangyu Song, Adnan Mahmood
Dynamic Correlation Adjacency-Matrix-Based Graph Neural Networks for Traffic Flow Prediction. Sensors 23 (6) (2023)
Zhihao Jia, Bing Wang, Changhao Chen
Drone-NeRF: Efficient NeRF Based 3D Scene Reconstruction for Large-Scale Drone Survey. CoRR (2023)
John Thorpe, Pengzhan Zhao, Jonathan Eyolfson, Yifan Qiao, Zhihao Jia, Minjia Zhang, Ravi Netravali, Guoqing Harry Xu
Bamboo: Making Preemptible Instances Resilient for Affordable Training of Large DNNs. NSDI (2023)
Xupeng Miao, Yining Shi, Zhi Yang, Bin Cui, Zhihao Jia
SDPipe: A Semi-Decentralized Framework for Heterogeneity-aware Pipeline-parallel Training. Proc. VLDB Endow. 16 (9) (2023)
Xupeng Miao, Gabriele Oliaro, Zhihao Zhang, Xinhao Cheng, Zeyu Wang, Rae Ying Yee Wong, Zhuoming Chen, Daiyaan Arfeen, Reyna Abhyankar, Zhihao Jia
SpecInfer: Accelerating Generative LLM Serving with Speculative Inference and Token Tree Verification. CoRR (2023)
Zikun Li, Jinjun Peng, Yixuan Mei, Sina Lin, Yi Wu, Oded Padon, Zhihao Jia
Quarl: A Learning-Based Quantum Circuit Optimizer. CoRR (2023)
Weiyang Wang, Moein Khazraee, Zhizhen Zhong, Manya Ghobadi, Zhihao Jia, Dheevatsa Mudigere, Ying Zhang, Anthony Kewitsch
TopoOpt: Co-optimizing Network Topology and Parallelization Strategy for Distributed Training Jobs. NSDI (2023)
Xupeng Miao, Chunan Shi, Jiangfei Duan, Xiaoli Xi, Dahua Lin, Bin Cui, Zhihao Jia
SpotServe: Serving Generative Large Language Models on Preemptible Instances. CoRR (2023)
Haojie Wang, Jidong Zhai, Mingyu Gao, Feng Zhang, Tuowei Wang, Zixuan Ma, Shizhi Tang, Liyan Zheng, Wen Wang, Kaiyuan Rong, Yuanyong Chen, Zhihao Jia
Optimizing DNNs With Partially Equivalent Transformations and Automated Corrections. IEEE Trans. Computers 72 (12) (2023)
Xupeng Miao, Gabriele Oliaro, Zhihao Zhang, Xinhao Cheng, Hongyi Jin, Tianqi Chen, Zhihao Jia
Towards Efficient Generative Large Language Model Serving: A Survey from Algorithms to Systems. CoRR (2023)
Suhas Jayaram Subramanya, Daiyaan Arfeen, Shouxu Lin, Aurick Qiao, Zhihao Jia, Gregory R. Ganger
Sia: Heterogeneity-aware, goodput-optimized ML-cluster scheduling. SOSP (2023)
Cheng Tan, Changliu Liu, Zhihao Jia, Tianhao Wei
Building Verified Neural Networks for Computer Systems with Ouroboros. MLSys (2023)
Byungsoo Jeon, Sunghyun Park, Peiyuan Liao, Sheng Xu, Tianqi Chen, Zhihao Jia
Collage: Seamless Integration of Deep Learning Backends with Automatic Placement. PACT (2022)
John Thorpe, Pengzhan Zhao, Jonathan Eyolfson, Yifan Qiao, Zhihao Jia, Minjia Zhang, Ravi Netravali, Guoqing Harry Xu
Bamboo: Making Preemptible Instances Resilient for Affordable Training of Large DNNs. CoRR (2022)
Ferdinand Kossmann, Zhihao Jia, Alex Aiken
Optimizing Mixture of Experts using Dynamic Recompilations. CoRR (2022)
Mingkuan Xu, Zikun Li, Oded Padon, Sina Lin, Jessica Pointing, Auguste Hirth, Henry Ma, Jens Palsberg, Alex Aiken, Umut A. Acar, Zhihao Jia
Quartz: Superoptimization of Quantum Circuits (Extended Version). CoRR (2022)
Liyan Zheng, Haojie Wang, Jidong Zhai, Muyan Hu, Zixuan Ma, Tuowei Wang, Shizhi Tang, Lei Xie, Kezhao Huang, Zhihao Jia
OLLIE: Derivation-based Tensor Program Optimizer. CoRR (2022)
Kay Liu, Yingtong Dou, Yue Zhao, Xueying Ding, Xiyang Hu, Ruitong Zhang, Kaize Ding, Canyu Chen, Hao Peng, Kai Shu, Lichao Sun, Jundong Li, George H. Chen, Zhihao Jia, Philip S. Yu
BOND: Benchmarking Unsupervised Outlier Node Detection on Static Attributed Graphs. NeurIPS (2022)
Yue Zhao, George H. Chen, Zhihao Jia
TOD: GPU-accelerated Outlier Detection via Tensor Operations. Proc. VLDB Endow. 16 (3) (2022)
Kay Liu, Yingtong Dou, Yue Zhao, Xueying Ding, Xiyang Hu, Ruitong Zhang, Kaize Ding, Canyu Chen, Hao Peng, Kai Shu, Lichao Sun, Jundong Li, George H. Chen, Zhihao Jia, Philip S. Yu
Benchmarking Node Outlier Detection on Graphs. CoRR (2022)
Mingkuan Xu, Zikun Li, Oded Padon, Sina Lin, Jessica Pointing, Auguste Hirth, Henry Ma, Jens Palsberg, Alex Aiken, Umut A. Acar, Zhihao Jia
Quartz: superoptimization of Quantum circuits. PLDI (2022)
Colin Unger, Zhihao Jia, Wei Wu, Sina Lin, Mandeep Baines, Carlos Efrain Quintero Narvaez, Vinay Ramakrishnaiah, Nirmal Prajapati, Patrick S. McCormick, Jamaludin Mohd-Yusof, Xi Luo, Dheevatsa Mudigere, Jongsoo Park, Misha Smelyanskiy, Alex Aiken
Unity: Accelerating DNN Training Through Joint Optimization of Algebraic Transformations and Parallelization. OSDI (2022)
Zhihao Zhang, Zhihao Jia
GradSign: Model Performance Inference with Theoretical Insights. ICLR (2022)
Kay Liu, Yingtong Dou, Yue Zhao, Xueying Ding, Xiyang Hu, Ruitong Zhang, Kaize Ding, Canyu Chen, Hao Peng, Kai Shu, George H. Chen, Zhihao Jia, Philip S. Yu
PyGOD: A Python Library for Graph Outlier Detection. CoRR (2022)
Dheevatsa Mudigere, Yuchen Hao, Jianyu Huang, Zhihao Jia, Andrew Tulloch, Srinivas Sridharan, Xing Liu, Mustafa Ozdal, Jade Nie, Jongsoo Park, Liang Luo, Jie Amy Yang, Leon Gao, Dmytro Ivchenko, Aarti Basant, Yuxi Hu, Jiyan Yang, Ehsan K. Ardestani, Xiaodong Wang, Rakesh Komuravelli, Ching-Hsiang Chu, Serhat Yilmaz, Huayu Li, Jiyuan Qian, Zhuobo Feng, Yinbin Ma, Junjie Yang, Ellie Wen, Hong Li, Lin Yang, Chonglin Sun, Whitney Zhao, Dimitry Melts, Krishna Dhulipala, K. R. Kishore, Tyler Graf, Assaf Eisenman, Kiran Kumar Matam, Adi Gangidi, Guoqiang Jerry Chen, Manoj Krishnan, Avinash Nayak, Krishnakumar Nair, Bharath Muthiah, Mahmoud khorashadi, Pallab Bhattacharya, Petr Lapukhov, Maxim Naumov, Ajit Mathews, Lin Qiao, Mikhail Smelyanskiy, Bill Jia, Vijay Rao
Software-hardware co-design for fast and scalable training of deep learning recommendation models. ISCA (2022)
Zhihao Zhang, Zhuoming Chen, Heyang Huang, Zhihao Jia
Quark: A Gradient-Free Quantum Learning Framework for Classification Tasks. CoRR (2022)
Yue Zhao, George H. Chen, Zhihao Jia
TOD: Tensor-based Outlier Detection. CoRR (2021)
Jessica Pointing, Oded Padon, Zhihao Jia, Henry Ma, Auguste Hirth, Jens Palsberg, Alex Aiken
Quanto: Optimizing Quantum Circuits with Automatic Generation of Circuit Identities. CoRR (2021)
Haojie Wang, Jidong Zhai, Mingyu Gao, Zixuan Ma, Shizhi Tang, Liyan Zheng, Yuanzhi Li, Kaiyuan Rong, Yuanyong Chen, Zhihao Jia
PET: Optimizing Tensor Programs with Partially Equivalent Transformations and Automated Corrections. OSDI (2021)
Yaoyao Ding, Ligeng Zhu, Zhihao Jia, Gennady Pekhimenko, Song Han
IOS: Inter-Operator Scheduler for CNN Acceleration. MLSys (2021)
Michael Bauer, Wonchan Lee, Elliott Slaughter, Zhihao Jia, Mario Di Renzo, Manolis Papadakis, Galen M. Shipman, Patrick S. McCormick, Michael Garland, Alex Aiken
Scaling implicit parallelism via dynamic control replication. PPoPP (2021)
Byungsoo Jeon, Sunghyun Park, Peiyuan Liao, Sheng Xu, Tianqi Chen, Zhihao Jia
Collage: Automated Integration of Deep Learning Backends. CoRR (2021)
Zhihao Zhang, Zhihao Jia
GradSign: Model Performance Inference with Theoretical Insights. CoRR (2021)
John Thorpe, Yifan Qiao, Jonathan Eyolfson, Shen Teng, Guanzhou Hu, Zhihao Jia, Jinliang Wei, Keval Vora, Ravi Netravali, Miryung Kim, Guoqing Harry Xu
Dorylus: Affordable, Scalable, and Accurate GNN Training with Distributed CPU Servers and Serverless Threads. CoRR (2021)
John Thorpe, Yifan Qiao, Jonathan Eyolfson, Shen Teng, Guanzhou Hu, Zhihao Jia, Jinliang Wei, Keval Vora, Ravi Netravali, Miryung Kim, Guoqing Harry Xu
Dorylus: Affordable, Scalable, and Accurate GNN Training with Distributed CPU Servers and Serverless Threads. OSDI (2021)
Yaoyao Ding, Ligeng Zhu, Zhihao Jia, Gennady Pekhimenko, Song Han
IOS: Inter-Operator Scheduler for CNN Acceleration. CoRR (2020)
Zhihao Jia, Sina Lin, Mingyu Gao, Matei Zaharia, Alex Aiken
Improving the Accuracy, Scalability, and Performance of Graph Neural Networks with Roc. MLSys (2020)
Zhihao Jia, Sina Lin, Rex Ying, Jiaxuan You, Jure Leskovec, Alex Aiken
Redundancy-Free Computation for Graph Neural Networks. KDD (2020)
Zhihao Jia, Oded Padon, James J. Thomas, Todd Warszawski, Matei Zaharia, Alex Aiken
TASO: optimizing deep learning computation with automatic generation of graph substitutions. SOSP (2019)
Zhihao Jia, James J. Thomas, Todd Warszawski, Mingyu Gao, Matei Zaharia, Alex Aiken
Optimizing DNN Computation with Relaxed Graph Substitutions. MLSys (2019)
Zhihao Jia, Matei Zaharia, Alex Aiken
Beyond Data and Model Parallelism for Deep Neural Networks. MLSys (2019)
Zhihao Jia, Sina Lin, Rex Ying, Jiaxuan You, Jure Leskovec, Alex Aiken
Redundancy-Free Computation Graphs for Graph Neural Networks. CoRR (2019)
Zhihao Jia, Sina Lin, Charles R. Qi, Alex Aiken
Exploring Hidden Dimensions in Parallelizing Convolutional Neural Networks. CoRR (2018)
Zhihao Jia, Matei Zaharia, Alex Aiken
Beyond Data and Model Parallelism for Deep Neural Networks. CoRR (2018)
Zhihao Jia, Sean Treichler, Galen M. Shipman, Patrick S. McCormick, Alex Aiken
Isometry: A Path-Based Distributed Data Transfer System. ICS (2018)
Qiubin Su, Zhihao Jia, Lu Lu
Research on user behavior clustering algorithm based on mobile application. J. Intell. Fuzzy Syst. 35 (2) (2018)
Zhihao Jia, Sina Lin, Charles R. Qi, Alex Aiken
Exploring Hidden Dimensions in Parallelizing Convolutional Neural Networks. ICML (2018)
Zhihao Jia, Yongkee Kwon, Galen M. Shipman, Patrick S. McCormick, Mattan Erez, Alex Aiken
A Distributed Multi-GPU System for Fast Graph Processing. Proc. VLDB Endow. 11 (3) (2017)
Zhihao Jia, Sean Treichler, Galen M. Shipman, Michael Bauer, Noah Watkins, Carlos Maltzahn, Patrick S. McCormick, Alex Aiken
Integrating External Resources with a Task-Based Programming Model. HiPC (2017)
Ankita Kejriwal, Arjun Gopalan, Ashish Gupta, Zhihao Jia, Stephen Yang, John K. Ousterhout
SLIK: Scalable Low-Latency Indexes for a Key-Value Store. USENIX Annual Technical Conference (2016)
Noah Watkins, Zhihao Jia, Galen M. Shipman, Carlos Maltzahn, Alex Aiken, Patrick S. McCormick
Automatic and transparent I/O optimization with storage integrated application runtime support. PDSW@SC (2015)
Xi Wang, Haogang Chen, Zhihao Jia, Nickolai Zeldovich, M. Frans Kaashoek
Improving Integer Security for Systems with KINT. OSDI (2012)
Xi Wang, Haogang Chen, Alvin Cheung, Zhihao Jia, Nickolai Zeldovich, M. Frans Kaashoek
Undefined behavior: what happened to my code? APSys (2012)