Shaden Smith

Publication Activity (10 Years)

Years Active: 2012-2023
Publications (10 Years): 23

Top Topics

Tensor Factorization

Relational Learning

Efficient Inference

Top Venues

Publications

Chengming Zhang, Shaden Smith, Baixi Sun, Jiannan Tian, Jonathan Soifer, Xiaodong Yu, Shuaiwen Leon Song, Yuxiong He, Dingwen Tao
HEAT: A Highly Efficient and Affordable Training System for Collaborative Filtering Based Recommendation on CPUs. ICS (2023)
Chengming Zhang, Shaden Smith, Baixi Sun, Jiannan Tian, Jonathan Soifer, Xiaodong Yu, Shuaiwen Leon Song, Yuxiong He, Dingwen Tao
HEAT: A Highly Efficient and Affordable Training System for Collaborative Filtering Based Recommendation on CPUs. CoRR (2023)
Shaden Smith, Mostofa Patwary, Brandon Norick, Patrick LeGresley, Samyam Rajbhandari, Jared Casper, Zhun Liu, Shrimai Prabhumoye, George Zerveas, Vijay Korthikanti, Elton Zheng, Rewon Child, Reza Yazdani Aminabadi, Julie Bernauer, Xia Song, Mohammad Shoeybi, Yuxiong He, Michael Houston, Saurabh Tiwary, Bryan Catanzaro
Using DeepSpeed and Megatron to Train Megatron-Turing NLG 530B, A Large-Scale Generative Language Model. CoRR (2022)
Zhuliu Li, Raphael Petegrosso, Shaden Smith, David Sterling, George Karypis, Rui Kuang
Scalable Label Propagation for Multi-Relational Learning on the Tensor Product of Graphs. IEEE Trans. Knowl. Data Eng. 34 (12) (2022)
Reza Yazdani Aminabadi, Samyam Rajbhandari, Ammar Ahmad Awan, Cheng Li, Du Li, Elton Zheng, Olatunji Ruwase, Shaden Smith, Minjia Zhang, Jeff Rasley, Yuxiong He
DeepSpeed- Inference: Enabling Efficient Inference of Transformer Models at Unprecedented Scale. SC (2022)
Reza Yazdani Aminabadi, Samyam Rajbhandari, Minjia Zhang, Ammar Ahmad Awan, Cheng Li, Du Li, Elton Zheng, Jeff Rasley, Shaden Smith, Olatunji Ruwase, Yuxiong He
DeepSpeed Inference: Enabling Efficient Inference of Transformer Models at Unprecedented Scale. CoRR (2022)
Samyam Rajbhandari, Olatunji Ruwase, Jeff Rasley, Shaden Smith, Yuxiong He
ZeRO-Infinity: Breaking the GPU Memory Wall for Extreme Scale Deep Learning. CoRR (2021)
Yongseok Soh, Patrick Flick, Xing Liu, Shaden Smith, Fabio Checconi, Fabrizio Petrini, Jee W. Choi
High Performance Streaming Tensor Decomposition. IPDPS (2021)
Samyam Rajbhandari, Olatunji Ruwase, Jeff Rasley, Shaden Smith, Yuxiong He
ZeRO-infinity: breaking the GPU memory wall for extreme scale deep learning. SC (2021)
Sriram Aananthakrishnan, Nesreen K. Ahmed, Vincent Cavé, Marcelo Cintra, Yigit Demir, Kristof Du Bois, Stijn Eyerman, Joshua B. Fryman, Ivan Ganev, Wim Heirman, Hans-Christian Hoppe, Jason Howard, Ibrahim Hur, Midhunchandra Kodiyath, Samkit Jain, Daniel S. Klowden, Marek M. Landowski, Laurent Montigny, Ankit More, Przemyslaw Ossowski, Robert Pawlowski, Nick Pepperling, Fabrizio Petrini, Mariusz Sikora, Balasubramanian Seshasayee, Shaden Smith, Sebastian Szkoda, Sanjaya Tayal, Jesmin Jahan Tithi, Yves Vandriessche, Izajasz P. Wrosz
PIUMA: Programmable Integrated Unified Memory Architecture. CoRR (2020)
Nitish Kumar Srivastava, Hanchen Jin, Shaden Smith, Hongbo Rong, David H. Albonesi, Zhiru Zhang
Tensaurus: A Versatile Accelerator for Mixed Sparse-Dense Tensor Computations. HPCA (2020)
Shaden Smith, Kejun Huang, Nicholas D. Sidiropoulos, George Karypis
Streaming Tensor Factorization for Infinite Data Sources. SDM (2018)
Shaden Smith, Jongsoo Park, George Karypis
HPC formulations of optimization algorithms for tensor completion. Parallel Comput. 74 (2018)
Zhuliu Li, Raphael Petegrosso, Shaden Smith, David Sterling, George Karypis, Rui Kuang
Scalable Label Propagation for Multi-relational Learning on Tensor Product Graph. CoRR (2018)
Jee W. Choi, Xing Liu, Shaden Smith, Tyler A. Simon
Blocking Optimization Techniques for Sparse Tensor Computation. IPDPS (2018)
Shaden Smith, Jongsoo Park, George Karypis
Sparse Tensor Factorization on Many-Core Processors with High-Bandwidth Memory. IPDPS (2017)
Shaden Smith, George Karypis
Accelerating the Tucker Decomposition with Compressed Sparse Tensors. Euro-Par (2017)
Shaden Smith, Xing Liu, Nesreen K. Ahmed, Ancy Sarah Tom, Fabrizio Petrini, George Karypis
Truss decomposition on shared-memory parallel systems. HPEC (2017)
Michael J. Anderson, Shaden Smith, Narayanan Sundaram, Mihai Capota, Zheguang Zhao, Subramanya Dulloor, Nadathur Satish, Theodore L. Willke
Bridging the Gap between HPC and Big Data frameworks. Proc. VLDB Endow. 10 (8) (2017)
Shaden Smith, Alec Beri, George Karypis
Constrained Tensor Factorization with Accelerated AO-ADMM. ICPP (2017)
Ancy Sarah Tom, Narayanan Sundaram, Nesreen K. Ahmed, Shaden Smith, Stijn Eyerman, Midhunchandra Kodiyath, Ibrahim Hur, Fabrizio Petrini, George Karypis
Exploring optimizations on shared-memory platforms for parallel triangle counting algorithms. HPEC (2017)
Shaden Smith, Jongsoo Park, George Karypis
An exploration of optimization algorithms for high performance tensor completion. SC (2016)
Shaden Smith, George Karypis
A Medium-Grained Algorithm for Sparse Tensor Factorization. IPDPS (2016)
Shaden Smith, Niranjay Ravindran, Nicholas D. Sidiropoulos, George Karypis
SPLATT: Efficient and Parallel Sparse Tensor-Matrix Multiplication. IPDPS (2015)
Shaden Smith, George Karypis
Tensor-matrix products with a compressed sparse tensor. IA3@SC (2015)
Niranjay Ravindran, Nicholas D. Sidiropoulos, Shaden Smith, George Karypis
Memory-efficient parallel computation of tensor and matrix products for big tensor decomposition. ACSSC (2014)
Yuliya Lierler, Shaden Smith, Miroslaw Truszczynski, Alex Westlund
Weighted-Sequence Problem: ASP vs CASP and Declarative vs Problem-Oriented Solving. PADL (2012)