William Won

Publication Activity (10 Years)

Years Active: 2021-2024
Publications (10 Years): 10

Top Topics

Tensor Decomposition

Network Topology

Distributed Environment

Training Process

Top Venues

Publications

William Won, Saeed Rashidi, Sudarshan Srinivasan, Tushar Krishna
LIBRA: Enabling Workload-Aware Multi-Dimensional Network Topology Optimization for Distributed Training of Large AI Models. ISPASS (2024)
Saeed Rashidi, William Won, Sudarshan Srinivasan, Puneet Gupta, Tushar Krishna
FRED: Flexible REduction-Distribution Interconnect and Communication Implementation for Wafer-Scale Distributed Training of DNN Models. CoRR (2024)
William Won, Midhilesh Elavazhagan, Sudarshan Srinivasan, Ajaya Durg, Swati Gupta, Tushar Krishna
TACOS: Topology-Aware Collective Algorithm Synthesizer for Distributed Training. CoRR (2023)
William Won, Taekyung Heo, Saeed Rashidi, Srinivas Sridharan, Sudarshan Srinivasan, Tushar Krishna
ASTRA-sim2.0: Modeling Hierarchical Networks and Disaggregated Systems for Large-model Training at Scale. CoRR (2023)
William Won, Taekyung Heo, Saeed Rashidi, Srinivas Sridharan, Sudarshan Srinivasan, Tushar Krishna
ASTRA-sim2.0: Modeling Hierarchical Networks and Disaggregated Systems for Large-model Training at Scale. ISPASS (2023)
Saeed Rashidi, William Won, Sudarshan Srinivasan, Srinivas Sridharan, Tushar Krishna
Themis: a network bandwidth-aware collective scheduling policy for distributed training of DL models. ISCA (2022)
Eric Qin, Geonhwa Jeong, William Won, Sheng-Chun Kao, Hyoukjun Kwon, Sudarshan Srinivasan, Dipankar Das, Gordon Euhyun Moon, Sivasankaran Rajamanickam, Tushar Krishna
Extending Sparse Tensor Accelerators to Support Multiple Compression Formats. CoRR (2021)
William Won, Saeed Rashidi, Sudarshan Srinivasan, Tushar Krishna
Exploring Multi-dimensional Hierarchical Network Topologies for Efficient Distributed Training of Trillion Parameter DL Models. CoRR (2021)
Eric Qin, Geonhwa Jeong, William Won, Sheng-Chun Kao, Hyoukjun Kwon, Sudarshan Srinivasan, Dipankar Das, Gordon Euhyun Moon, Sivasankaran Rajamanickam, Tushar Krishna
Extending Sparse Tensor Accelerators to Support Multiple Compression Formats. IPDPS (2021)
Saeed Rashidi, William Won, Sudarshan Srinivasan, Srinivas Sridharan, Tushar Krishna
Themis: A Network Bandwidth-Aware Collective Scheduling Policy for Distributed Training of DL Models. CoRR (2021)