James Demmel

ORCID

Publication Activity (10 Years)

Years Active: 1987-2024
Publications (10 Years): 80

Top Venues

CoRR

IPDPS

SIAM J. Matrix Anal. Appl.

SPAA

Publications

Ziming Liu, Shaoyu Wang, Shenggan Cheng, Zhongkai Zhao, Xuanlei Zhao, James Demmel, Yang You
WallFacer: Guiding Transformer Model Training Out of the Long-Context Dark Forest with N-body Problem. CoRR (2024)
Tianyu Liang, Riley Murray, Aydin Buluç, James Demmel
Fast multiplication of random dense matrices with sparse matrices. IPDPS (2024)
Vivek Bharadwaj, Osman Asif Malik, Riley Murray, Aydin Buluç, James Demmel
Distributed-Memory Randomized Algorithms for Sparse Tensor CP Decomposition. SPAA (2024)
Xuan Jiang, Raja Sengupta, James Demmel, Samuel Williams
LPSim: Large Scale Multi-GPU Parallel Computing based Regional Scale Traffic Simulation Framework. CoRR (2024)
Michael Christ, James Demmel, Nicholas Knight, Thomas Scanlon, Katherine A. Yelick
On Multilinear Inequalities of Holder-Brascamp-Lieb Type for Torsion-Free Discrete Abelian Groups. J. Log. Anal. 16 (2024)
Maksim Melnichenko, Oleg Balabanov, Riley Murray, James Demmel, Michael W. Mahoney, Piotr Luszczek
CholeskyQR with Randomization and Pivoting for Tall Matrices (CQRRPT). CoRR (2023)
James Demmel, Laura Grigori, Alexander Rusciano
An Improved Analysis and Unified Perspective on Deterministic and Randomized Low-Rank Matrix Approximation. SIAM J. Matrix Anal. Appl. 44 (2) (2023)
Daniel Zou, Xinchen Jin, Xueyang Yu, Hao Zhang, James Demmel
Computron: Serving Distributed Deep Learning Models with Model Parallel Swapping. CoRR (2023)
Riley Murray, James Demmel, Michael W. Mahoney, N. Benjamin Erichson, Maksim Melnichenko, Osman Asif Malik, Laura Grigori, Piotr Luszczek, Michal Derezinski, Miles E. Lopes, Tianyu Liang, Hengrui Luo, Jack J. Dongarra
Randomized Numerical Linear Algebra : A Perspective on the Field With an Eye to Software. CoRR (2023)
Tianyu Liang, Riley Murray, Aydin Buluç, James Demmel
Fast multiplication of random dense matrices with fixed sparse matrices. CoRR (2023)
James Demmel
Nearly Optimal Block-Jacobi Preconditioning. SIAM J. Matrix Anal. Appl. 44 (1) (2023)
Vivek Bharadwaj, Osman Asif Malik, Riley Murray, Laura Grigori, Aydin Buluç, James Demmel
Fast Exact Leverage Score Sampling from Khatri-Rao Products with Applications to Tensor Decomposition. CoRR (2023)
Vivek Bharadwaj, Osman Asif Malik, Riley Murray, Laura Grigori, Aydin Buluç, James Demmel
Fast Exact Leverage Score Sampling from Khatri-Rao Products with Applications to Tensor Decomposition. NeurIPS (2023)
James Demmel, Ioana Dumitriu, Ryan Schneider
Generalized Pseudospectral Shattering and Inverse-Free Matrix Pencil Diagonalization. CoRR (2023)
Anthony Chen, James Demmel, Grace Dinh, Mason Haberle, Olga Holtz
Communication Bounds for Convolutional Neural Networks. CoRR (2022)
Vivek Bharadwaj, Aydin Buluç, James Demmel
Distributed-Memory Sparse Kernels for Machine Learning. CoRR (2022)
Vivek Bharadwaj, Osman Asif Malik, Riley Murray, Aydin Buluç, James Demmel
Distributed-Memory Randomized Algorithms for Sparse Tensor CP Decomposition. CoRR (2022)
Anthony Chen, James Demmel, Grace Dinh, Mason Haberle, Olga Holtz
Communication bounds for convolutional neural networks. PASC (2022)
Vivek Bharadwaj, Aydin Buluç, James Demmel
Distributed-Memory Sparse Kernels for Machine Learning. IPDPS (2022)
James Demmel, Jack J. Dongarra, Mark Gates, Greg Henry, Julien Langou, Xiaoye S. Li, Piotr Luszczek, Weslley da Silva Pereira, E. Jason Riedy, Cindy Rubio-González
Proposed Consistent Exception Handling for the BLAS and LAPACK. CoRR (2022)
James Demmel, Jack J. Dongarra, Mark Gates, Greg Henry, Julien Langou, Xiaoye S. Li, Piotr Luszczek, Weslley S. Pereira, E. Jason Riedy, Cindy Rubio-González
Proposed Consistent Exception Handling for the BLAS and LAPACK. Correctness@SC (2022)
Arissa Wongpanich, Hieu Pham, James Demmel, Mingxing Tan, Quoc V. Le, Yang You, Sameer Kumar
Training EfficientNets at Supercomputer Scale: 83% ImageNet Top-1 Accuracy in One Hour. IPDPS Workshops (2021)
Qijing Huang, Minwoo Kang, Grace Dinh, Thomas Norell, Aravind Kalaiah, James Demmel, John Wawrzynek, Yakun Sophia Shao
CoSA: Scheduling by Constrained Optimization for Spatial Accelerators. CoRR (2021)
Ruobing Han, James Demmel, Yang You
Auto-Precision Scaling for Distributed Deep Learning. ISC (2021)
Edgar Solomonik, James Demmel
Fast Bilinear Algorithms for Symmetric Tensor Contractions. Comput. Methods Appl. Math. 21 (1) (2021)
Qijing Huang, Aravind Kalaiah, Minwoo Kang, James Demmel, Grace Dinh, John Wawrzynek, Thomas Norell, Yakun Sophia Shao
CoSA: Scheduling by Constrained Optimization for Spatial Accelerators. ISCA (2021)
Yang You, Jingyue Huang, Cho-Jui Hsieh, Richard W. Vuduc, James Demmel
Communication-avoiding kernel ridge regression on parallel and distributed systems. CCF Trans. High Perform. Comput. 3 (3) (2021)
Edgar Solomonik, James Demmel, Torsten Hoefler
Communication Lower Bounds of Bilinear Algorithms for Symmetric Tensor Contractions. SIAM J. Sci. Comput. 43 (5) (2021)
Swapnil Das, James Demmel, Kimon Fountoulakis, Laura Grigori, Michael W. Mahoney, Shenghao Yang
Parallel and Communication Avoiding Least Angle Regression. SIAM J. Sci. Comput. 43 (2) (2021)
Ruobing Han, Min Si, James Demmel, Yang You
Dynamic scaling for low-precision learning. PPoPP (2021)
Younghyun Cho, James Demmel, Xiaoye S. Li, Yang Liu, Hengrui Luo
Enhancing Autotuning Capability with a History Database. MCSoC (2021)
Yang You, Yuxiong He, Samyam Rajbhandari, Wenhan Wang, Cho-Jui Hsieh, Kurt Keutzer, James Demmel
Fast LSTM by dynamic decomposition on cloud and distributed systems. Knowl. Inf. Syst. 62 (11) (2020)
Yang You, Yuhui Wang, Huan Zhang, Zhao Zhang, James Demmel, Cho-Jui Hsieh
The Limit of the Batch Size. CoRR (2020)
Grace Dinh, James Demmel
Communication-Optimal Tilings for Projective Nested Loops with Arbitrary Bounds. SPAA (2020)
Arissa Wongpanich, Yang You, James Demmel
Rethinking the Value of Asynchronous Solvers for Distributed Deep Learning. HPC Asia (2020)
Peter Ahrens, James Demmel, Hong Diep Nguyen
Algorithms for Efficient Reproducible Floating Point Summation. ACM Trans. Math. Softw. 46 (3) (2020)
Arissa Wongpanich, Hieu Pham, James Demmel, Mingxing Tan, Quoc V. Le, Yang You, Sameer Kumar
Training EfficientNets at Supercomputer Scale: 83% ImageNet Top-1 Accuracy in One Hour. CoRR (2020)
Aditya Devarakonda, James Demmel
Avoiding Communication in Logistic Regression. CoRR (2020)
Grace Dinh, James Demmel
Communication-Optimal Tilings for Projective Nested Loops with Arbitrary Bounds. CoRR (2020)
Yang You, Jing Li, Sashank J. Reddi, Jonathan Hseu, Sanjiv Kumar, Srinadh Bhojanapalli, Xiaodan Song, James Demmel, Kurt Keutzer, Cho-Jui Hsieh
Large Batch Optimization for Deep Learning: Training BERT in 76 minutes. ICLR (2020)
Aditya Devarakonda, James Demmel
Avoiding Communication in Logistic Regression. HiPC (2020)
Osni Marques, James Demmel, Paulo B. Vasconcelos
Bidiagonal SVD Computation via an Associated Tridiagonal Eigenproblem. ACM Trans. Math. Softw. 46 (2) (2020)
Yang You, Yuxiong He, Samyam Rajbhandari, Wenhan Wang, Cho-Jui Hsieh, Kurt Keutzer, James Demmel
Fast LSTM Inference by Dynamic Decomposition on Cloud Systems. ICDM (2019)
Yang You, Zhao Zhang, Cho-Jui Hsieh, James Demmel, Kurt Keutzer
Fast Deep Neural Network Training on Distributed Systems and Cloud TPUs. IEEE Trans. Parallel Distributed Syst. 30 (11) (2019)
Grey Ballard, James Demmel, Ioana Dumitriu, Alexander Rusciano
A Generalized Randomized Rank-Revealing Factorization. CoRR (2019)
Ruobing Han, Yang You, James Demmel
Auto-Precision Scaling for Distributed Deep Learning. CoRR (2019)
Yang You, Jing Li, Jonathan Hseu, Xiaodan Song, James Demmel, Cho-Jui Hsieh
Reducing BERT Pre-Training Time from 3 Days to 76 Minutes. CoRR (2019)
Yang You, Jonathan Hseu, Chris Ying, James Demmel, Kurt Keutzer, Cho-Jui Hsieh
Large-batch training for LSTM and beyond. SC (2019)
Yang You, Jonathan Hseu, Chris Ying, James Demmel, Kurt Keutzer, Cho-Jui Hsieh
Large-Batch Training for LSTM and Beyond. CoRR (2019)
James Demmel, Laura Grigori, Alexander Rusciano
An improved analysis and unified perspective on deterministic and randomized low rank matrix approximations. CoRR (2019)
Aditya Devarakonda, Kimon Fountoulakis, James Demmel, Michael W. Mahoney
Avoiding Communication in Primal and Dual Block Coordinate Descent Methods. SIAM J. Sci. Comput. 41 (1) (2019)
Aditya Devarakonda, Kimon Fountoulakis, James Demmel, Michael W. Mahoney
Avoiding Synchronization in First-Order Methods for Sparse Convex Optimization. IPDPS (2018)
James Demmel, Grace Dinh
Communication-Optimal Convolutional Neural Nets. CoRR (2018)
Yang You, Zhao Zhang, Cho-Jui Hsieh, James Demmel, Kurt Keutzer
ImageNet Training in Minutes. ICPP (2018)
Grey Ballard, James Demmel, Laura Grigori, Mathias Jacquelin, Nicholas Knight
A 3D Parallel Algorithm for QR Decomposition. CoRR (2018)
Yang You, James Demmel, Cho-Jui Hsieh, Richard W. Vuduc
Accurate, Fast and Scalable Kernel Ridge Regression on Parallel and Distributed Systems. CoRR (2018)
E. Jason Riedy, James Demmel
Augmented Arithmetic Operations Proposed for IEEE-754 2018. ARITH (2018)
Grey Ballard, James Demmel, Laura Grigori, Mathias Jacquelin, Nicholas Knight
A 3D Parallel Algorithm for QR Decomposition. SPAA (2018)
Yang You, James Demmel, Cho-Jui Hsieh, Richard W. Vuduc
Accurate, Fast and Scalable Kernel Ridge Regression on Parallel and Distributed Systems. ICS (2018)
Saeed Soori, Aditya Devarakonda, Zachary Blanco, James Demmel, Mert Gürbüzbalaban, Maryam Mehri Dehnavi
Reducing Communication in Proximal Newton Methods for Sparse Least Squares Problems. ICPP (2018)
Aditya Devarakonda, Kimon Fountoulakis, James Demmel, Michael W. Mahoney
Avoiding Synchronization in First-Order Methods for Sparse Convex Optimization. CoRR (2017)
Yang You, Zhao Zhang, Cho-Jui Hsieh, James Demmel
100-epoch ImageNet Training with AlexNet in 24 Minutes. CoRR (2017)
Yang You, Aydin Buluç, James Demmel
Scaling deep learning on GPU and knights landing clusters. SC (2017)
Yang You, James Demmel
Runtime Data Layout Scheduling for Machine Learning Dataset. ICPP (2017)
Yang You, James Demmel, Kent Czechowski, Le Song, Rich Vuduc
Design and Implementation of a Communication-Optimal Classifier for Distributed Kernel Support Vector Machines. IEEE Trans. Parallel Distributed Syst. 28 (4) (2017)
Yang You, Aydin Buluç, James Demmel
Scaling Deep Learning on GPU and Knights Landing clusters. CoRR (2017)
Edgar Solomonik, Grey Ballard, James Demmel, Torsten Hoefler
A Communication-Avoiding Parallel Algorithm for the Symmetric Eigenvalue Problem. SPAA (2017)
Edgar Solomonik, James Demmel, Torsten Hoefler
Communication Lower Bounds of Bilinear Algorithms for Symmetric Tensor Contractions. CoRR (2017)
Saeed Soori, Aditya Devarakonda, James Demmel, Mert Gürbüzbalaban, Maryam Mehri Dehnavi
Avoiding Communication in Proximal Methods for Convex Optimization Problems. CoRR (2017)
Erin C. Carson, James Demmel, Laura Grigori, Nicholas Knight, Penporn Koanantakool, Oded Schwartz, Harsha Vardhan Simhadri
Write-Avoiding Algorithms. IPDPS (2016)
Steven I. Gordon, James Demmel, Lizanne DeStefano, Lorna Rivera
Implementing a Collaborative Online Course to Extend Access to HPC Skills. Comput. Sci. Eng. 18 (1) (2016)
Ariful Azad, Grey Ballard, Aydin Buluç, James Demmel, Laura Grigori, Oded Schwartz, Sivan Toledo, Samuel Williams
Exploiting Multiple Levels of Parallelism in Sparse Matrix-Matrix Multiplication. SIAM J. Sci. Comput. 38 (6) (2016)
Aditya Devarakonda, Kimon Fountoulakis, James Demmel, Michael W. Mahoney
Avoiding communication in primal and dual block coordinate descent methods. CoRR (2016)
Cindy Rubio-González, Cuong Nguyen, Benjamin Mehne, Koushik Sen, James Demmel, William Kahan, Costin Iancu, Wim Lavrijsen, David H. Bailey, David Hough
Floating-point precision tuning using blame analysis. ICSE (2016)
Alex Gittens, Aditya Devarakonda, Evan Racah, Michael F. Ringenburg, Lisa Gerhardt, Jey Kottalam, Jialin Liu, Kristyn J. Maschhoff, Shane Canon, Jatin Chhugani, Pramod Sharma, Jiyan Yang, James Demmel, Jim Harrell, Venkat Krishnamurthy, Michael W. Mahoney, Prabhat
Matrix factorizations at scale: A comparison of scientific data analytics in spark and C+MPI using three case studies. IEEE BigData (2016)
Grey Ballard, James Demmel, Andrew Gearhart, Benjamin Lipshitz, Yishai Oltchik, Oded Schwartz, Sivan Toledo
Network Topologies and Inevitable Contention. COMHPC@SC (2016)
Edgar Solomonik, Grey Ballard, James Demmel, Torsten Hoefler
A communication-avoiding parallel algorithm for the symmetric eigenvalue problem. CoRR (2016)
Alex Gittens, Aditya Devarakonda, Evan Racah, Michael F. Ringenburg, Lisa Gerhardt, Jey Kottalam, Jialin Liu, Kristyn J. Maschhoff, Shane Canon, Jatin Chhugani, Pramod Sharma, Jiyan Yang, James Demmel, Jim Harrell, Venkat Krishnamurthy, Michael W. Mahoney, Prabhat
Matrix Factorization at Scale: a Comparison of Scientific Data Analytics in Spark and C+MPI Using Three Case Studies. CoRR (2016)
Yang You, Xiangru Lian, Ji Liu, Hsiang-Fu Yu, Inderjit S. Dhillon, James Demmel, Cho-Jui Hsieh
Asynchronous Parallel Greedy Coordinate Descent. NIPS (2016)
James Demmel, Alex Rusciano
Parallelepipeds obtaining HBL lower bounds. CoRR (2016)
Ariful Azad, Grey Ballard, Aydin Buluç, James Demmel, Laura Grigori, Oded Schwartz, Sivan Toledo, Samuel Williams
Exploiting Multiple Levels of Parallelism in Sparse Matrix-Matrix Multiplication. CoRR (2015)
Yang You, James Demmel, Kenneth Czechowski, Le Song, Richard W. Vuduc
CA-SVM: Communication-Avoiding Support Vector Machines on Distributed Systems. IPDPS (2015)
James Demmel, Hong Diep Nguyen
Parallel Reproducible Summation. IEEE Trans. Computers 64 (7) (2015)
Steven I. Gordon, James Demmel, Lizanne DeStefano, Lorna Rivera
Extending access to HPC skills through a blended online course. XSEDE (2015)
James Demmel, Laura Grigori, Ming Gu, Hua Xiang
Communication Avoiding Rank Revealing QR Factorization with Column Pivoting. SIAM J. Matrix Anal. Appl. 36 (1) (2015)
Hong Diep Nguyen, James Demmel
Reproducible Tall-Skinny QR. ARITH (2015)
Grey Ballard, James Demmel, Nicholas Knight
Avoiding Communication in Successive Band Reduction. ACM Trans. Parallel Comput. 1 (2) (2015)
Grey Ballard, James Demmel, Laura Grigori, Mathias Jacquelin, Nicholas Knight, Hong Diep Nguyen
Reconstructing Householder vectors from Tall-Skinny QR. J. Parallel Distributed Comput. 85 (2015)
Grey Ballard, James Demmel, Laura Grigori, Mathias Jacquelin, Hong Diep Nguyen, Edgar Solomonik
Reconstructing Householder Vectors from Tall-Skinny QR. IPDPS (2014)
Grey Ballard, Dulceneia Becker, James Demmel, Jack J. Dongarra, Alex Druinsky, Inon Peled, Oded Schwartz, Sivan Toledo, Ichitaro Yamazaki
Communication-Avoiding Symmetric-Indefinite Factorization. SIAM J. Matrix Anal. Appl. 35 (4) (2014)
Razvan Carbunescu, Aditya Devarakonda, James Demmel, Steven I. Gordon, Jay Alameda, Susan Mehringer
Architecting an autograder for parallel code. XSEDE (2014)
Grey Ballard, James Demmel, Olga Holtz, Oded Schwartz
Communication costs of Strassen's matrix multiplication. Commun. ACM 57 (2) (2014)
Erin C. Carson, James Demmel
A Residual Replacement Strategy for Improving the Maximum Attainable Accuracy of s-Step Krylov Subspace Methods. SIAM J. Matrix Anal. Appl. 35 (1) (2014)
Grey Ballard, Erin C. Carson, James Demmel, Mark Hoemmen, Nicholas Knight, Oded Schwartz
Communication lower bounds and optimal algorithms for numerical linear algebra. Acta Numer. 23 (2014)
Edgar Solomonik, Erin C. Carson, Nicholas Knight, James Demmel
Tradeoffs between synchronization, communication, and computation in parallel linear algebra computations. SPAA (2014)
Samuel Williams, Mike Lijewski, Ann S. Almgren, Brian van Straalen, Erin C. Carson, Nicholas Knight, James Demmel
s-Step Krylov Subspace Methods as Bottom Solvers for Geometric Multigrid. IPDPS (2014)
Edgar Solomonik, Devin Matthews, Jeff R. Hammond, John F. Stanton, James Demmel
A massively parallel tensor contraction framework for coupled-cluster computations. J. Parallel Distributed Comput. 74 (12) (2014)
Michael Christ, James Demmel, Nicholas Knight, Thomas Scanlon, Katherine A. Yelick
Communication lower bounds and optimal algorithms for programs that reference arrays - Part 1. CoRR (2013)
Grey Ballard, James Demmel, Benjamin Lipshitz, Oded Schwartz, Sivan Toledo
Communication efficient gaussian elimination with partial pivoting using a shape morphing data layout. SPAA (2013)
Austin R. Benson, David F. Gleich, James Demmel
Direct QR factorizations for tall-and-skinny matrices in MapReduce architectures. IEEE BigData (2013)

James Demmel.css-eqlu8i{font-size:small;padding-left:4px;}

Publication Activity (10 Years)

Top Topics

Top Venues

James Demmel