Torsten Hoefler

ORCID

Publication Activity (10 Years)

Years Active: 2005-2024
Publications (10 Years): 380

Top Venues

CoRR

IPDPS

ICS

Publications

Langwen Huang, Lukas Gianinazzi, Yuejiang Yu, Peter D. Düben, Torsten Hoefler
DiffDA: a diffusion model for weather-scale data assimilation. CoRR (2024)
Samuel Riedel, Marc Gantenbein, Alessandro Ottaviano, Torsten Hoefler, Luca Benini
LRSCwait: Enabling Scalable and Efficient Synchronization in Manycore Systems through Polling-Free and Retry-Free Operation. CoRR (2024)
Thomas Benz, Michael Rogenmoser, Paul Scheffler, Samuel Riedel, Alessandro Ottaviano, Andreas Kurth, Torsten Hoefler, Luca Benini
A High-Performance, Energy-Efficient Modular DMA Engine Architecture. IEEE Trans. Computers 73 (1) (2024)
Marcin Copik, Marcin Chrapek, Larissa Schmid, Alexandru Calotoiu, Torsten Hoefler
Software Resource Disaggregation for HPC with Serverless Computing. CoRR (2024)
Maciej Besta, Florim Memedi, Zhenyu Zhang, Robert Gerstenberger, Nils Blach, Piotr Nyczyk, Marcin Copik, Grzegorz Kwasniewski, Jürgen Müller, Lukas Gianinazzi, Ales Kubicek, Hubert Niewiadomski, Onur Mutlu, Torsten Hoefler
Topologies of Reasoning: Demystifying Chains, Trees, and Graphs of Thoughts. CoRR (2024)
Lukas Gianinazzi, Alexandros Nikolaos Ziogas, Langwen Huang, Piotr Luczynski, Saleh Ashkboosh, Florian Scheidl, Armon Carigiet, Chio Ge, Nabil Abubaker, Maciej Besta, Tal Ben-Nun, Torsten Hoefler
Arrow Matrix Decomposition: A Novel Approach for Communication-Efficient Sparse Matrix Multiplication. PPoPP (2024)
Maciej Besta, Robert Gerstenberger, Emanuel Peter, Marc Fischer, Michal Podstawski, Claude Barthels, Gustavo Alonso, Torsten Hoefler
Demystifying Graph Databases: Analysis and Taxonomy of Data Organization, System Designs, and Graph Queries. ACM Comput. Surv. 56 (2) (2024)
Daniele De Sensi, Edgar Costa Molero, Salvatore Di Girolamo, Laurent Vanbever, Torsten Hoefler
Canary: Congestion-aware in-network allreduce using dynamic trees. Future Gener. Comput. Syst. 152 (2024)
Lukas Möller, Marcin Copik, Alexandru Calotoiu, Torsten Hoefler
Cppless: Productive and Performant Serverless Programming in C++. CoRR (2024)
Daniele De Sensi, Tommaso Bonato, David Saam, Torsten Hoefler
Swing: Short-cutting Rings for Higher Bandwidth Allreduce. CoRR (2024)
Saleh Ashkboos, Maximilian L. Croci, Marcelo Gennari Do Nascimento, Torsten Hoefler, James Hensman
SliceGPT: Compress Large Language Models by Deleting Rows and Columns. CoRR (2024)
Torsten Hoefler, Marcin Copik, Pete Beckman, Andrew Jones, Ian T. Foster, Manish Parashar, Daniel A. Reed, Matthias Troyer, Thomas C. Schulthess, Dan Ernst, Jack J. Dongarra
XaaS: Acceleration as a Service to Enable Productive High-Performance Cloud Computing. CoRR (2024)
Maciej Besta, Nils Blach, Ales Kubicek, Robert Gerstenberger, Lukas Gianinazzi, Joanna Gajda, Tomasz Lehmann, Michal Podstawski, Hubert Niewiadomski, Piotr Nyczyk, Torsten Hoefler
Graph of Thoughts: Solving Elaborate Problems with Large Language Models. CoRR (2023)
Tim Dettmers, Ruslan Svirschevski, Vage Egiazarian, Denis Kuznedelev, Elias Frantar, Saleh Ashkboos, Alexander Borzunov, Torsten Hoefler, Dan Alistarh
SpQR: A Sparse-Quantized Representation for Near-Lossless LLM Weight Compression. CoRR (2023)
Marcin Copik, Konstantin Taranov, Alexandru Calotoiu, Torsten Hoefler
rFaaS: Enabling High Performance Serverless with RDMA and Leases. IPDPS (2023)
Saleh Ashkboos, Ilia Markov, Elias Frantar, Tingxuan Zhong, Xincheng Wang, Jie Ren, Torsten Hoefler, Dan Alistarh
Towards End-to-end 4-Bit Inference on Generative Large Language Models. CoRR (2023)
Andrei Ivanov, Benjamin Rothenberger, Arnaud Dethise, Marco Canini, Torsten Hoefler, Adrian Perrig
SAGE: Software-based Attestation for GPU Execution. USENIX Annual Technical Conference (2023)
Torsten Hoefler, Bjorn Stevens, Andreas F. Prein, Johanna Baehr, Thomas C. Schulthess, Thomas F. Stocker, John A. Taylor, Daniel Klocke, Pekka Manninen, Piers M. Forster, Tobias Kölling, Nicolas Gruber, Hartwig Anzt, Claudia Frauen, Florian Ziemen, Milan Klöwer, Karthik Kashinath, Christoph M. Schär, Oliver Fuhrer, Bryan N. Lawrence
Earth Virtualization Engines: A Technical Perspective. Comput. Sci. Eng. 25 (3) (2023)
Philipp Schaad, Timo Schneider, Tal Ben-Nun, Alexandru Calotoiu, Alexandros Nikolaos Ziogas, Torsten Hoefler
FuzzyFlow: Leveraging Dataflow To Find and Squash Program Optimization Bugs. SC (2023)
Kazuki Osawa, Satoki Ishikawa, Rio Yokota, Shigang Li, Torsten Hoefler
ASDL: A Unified Interface for Gradient Preconditioning in PyTorch. CoRR (2023)
Yunqiang Li, Jan C. van Gemert, Torsten Hoefler, Bert Moons, Evangelos Eleftheriou, Bram-Ernst Verhoef
Differentiable Transportation Pruning. CoRR (2023)
Daniele De Sensi, Tiziano De Matteis, Konstantin Taranov, Salvatore Di Girolamo, Tobias Rahn, Torsten Hoefler
Noise in the Clouds: Influence of Network Performance Variability on Application Scalability. SIGMETRICS (Abstracts) (2023)
Tal Ben-Nun, Berke Ates, Alexandru Calotoiu, Torsten Hoefler
Bridging Control-Centric and Data-Centric Optimization. CoRR (2023)
Maciej Besta, Robert Gerstenberger, Marc Fischer, Michal Podstawski, Jürgen Müller, Nils Blach, Berke Egeli, George Mitenkov, Wojciech Chlapek, Marek Michalewicz, Torsten Hoefler
High-Performance Graph Databases That Are Portable, Programmable, and Scale to Hundreds of Thousands of Cores. CoRR (2023)
Yunqiang Li, Jan C. van Gemert, Torsten Hoefler, Bert Moons, Evangelos Eleftheriou, Bram-Ernst Verhoef
Differentiable Transportation Pruning. ICCV (2023)
Nils Blach, Maciej Besta, Daniele De Sensi, Jens Domke, Hussein Harake, Shigang Li, Patrick Iff, Marek Konieczny, Kartik Lakhotia, Ales Kubicek, Marcel Ferrari, Fabrizio Petrini, Torsten Hoefler
A High-Performance Design, Implementation, Deployment, and Evaluation of The Slim Fly Network. CoRR (2023)
Maciej Besta, Robert Gerstenberger, Marc Fischer, Michal Podstawski, Nils Blach, Berke Egeli, George Mitenkov, Wojciech Chlapek, Marek T. Michalewicz, Hubert Niewiadomski, Jürgen Müller, Torsten Hoefler
The Graph Database Interface: Scaling Online Transactional and Analytical Graph Workloads to Hundreds of Thousands of Cores. SC (2023)
Patrick Iff, Maciej Besta, Matheus A. Cavalcante, Tim Fischer, Luca Benini, Torsten Hoefler
Sparse Hamming Graph: A Customizable Network-on-Chip Topology. DAC (2023)
Marcin Chrapek, Mikhail Khalilov, Torsten Hoefler
HEAR: Homomorphically Encrypted Allreduce. SC (2023)
Tal Ben-Nun, Lukas Gianinazzi, Torsten Hoefler, Yishai Oltchik
Maximum Flows in Parametric Graph Templates. CoRR (2023)
Niels Gleinig, Tobias Rohner, Torsten Hoefler
Approximate Reversible Circuits for NISQ-Era Quantum Computers. CoRR (2023)
Marcin Copik, Roman Böhringer, Alexandru Calotoiu, Torsten Hoefler
FMI: Fast and Cheap Message Passing for Serverless Functions. CoRR (2023)
Maciej Besta, Pawel Renc, Robert Gerstenberger, Paolo Sylos Labini, Alexandros Nikolaos Ziogas, Tiancheng Chen, Lukas Gianinazzi, Florian Scheidl, Kalman Szenes, Armon Carigiet, Patrick Iff, Grzegorz Kwasniewski, Raghavendra Kanakagiri, Chio Ge, Sammy Jaeger, Jaroslaw Was, Flavio Vella, Torsten Hoefler
High-Performance and Programmable Attentional Graph Neural Networks with Global Tensor Formulations. SC (2023)
Roberto L. Castro, Andrei Ivanov, Diego Andrade, Tal Ben-Nun, Basilio B. Fraguela, Torsten Hoefler
VENOM: A Vectorized N: M Format for Unleashing the Power of Sparse Tensor Cores. SC (2023)
Paul Scheffler, Florian Zaruba, Fabian Schuiki, Torsten Hoefler, Luca Benini
Sparse Stream Semantic Registers: A Lightweight ISA Extension Accelerating General Sparse Linear Algebra. CoRR (2023)
Torsten Hoefler, Duncan Roweth, Keith D. Underwood, Bob Alverson, Mark Griswold, Vahid Tabatabaee, Mohan Kalkunte, Surendra Anubolu, Siyan Shen, Abdul Kabbani, Moray McLaren, Steve Scott
Datacenter Ethernet and RDMA: Issues at Hyperscale. CoRR (2023)
Wenqi Jiang, Marco Zeller, Roger Waleffe, Torsten Hoefler, Gustavo Alonso
Chameleon: a Heterogeneous and Disaggregated Accelerator System for Retrieval-Augmented Language Models. CoRR (2023)
Lukas Trümper, Tal Ben-Nun, Philipp Schaad, Alexandru Calotoiu, Torsten Hoefler
Performance Embeddings: A Similarity-Based Transfer Tuning Approach to Performance Optimization. ICS (2023)
Patrick Iff, Benigna Bruggmann, Maciej Besta, Luca Benini, Torsten Hoefler
RapidChiplet: A Toolchain for Rapid Design Space Exploration of Chiplet Architectures. CoRR (2023)
Tal Ben-Nun, Lukas Gianinazzi, Torsten Hoefler, Yishai Oltchik
Maximum Flows in Parametric Graph Templates. CIAC (2023)
Maciej Besta, Marc Fischer, Vasiliki Kalavri, Michael Kapralov, Torsten Hoefler
Practice of Streaming Processing of Dynamic Graphs: Concepts, Models, and Systems. IEEE Trans. Parallel Distributed Syst. 34 (6) (2023)
Tommy Nguyen, Yue Shi, Samuel Alexander Stein, Tim Stavenger, Marvin Warner, Martin Roetteler, Torsten Hoefler, Ang Li
A Reference Implementation for a Quantum Message Passing Interface. QCE (2023)
Daniele De Sensi, Edgar Costa Molero, Salvatore Di Girolamo, Laurent Vanbever, Torsten Hoefler
Canary: Congestion-Aware In-Network Allreduce Using Dynamic Trees. CoRR (2023)
Maciej Besta, Afonso Claudino Catarino, Lukas Gianinazzi, Nils Blach, Piotr Nyczyk, Hubert Niewiadomski, Torsten Hoefler
HOT: Higher-Order Dynamic Graph Representation Learning with Efficient Transformers. CoRR (2023)
Satoshi Matsuoka, Jens Domke, Mohamed Wahib, Aleksandr Drozd, Torsten Hoefler
Myths and legends in high-performance computing. Int. J. High Perform. Comput. Appl. 37 (3-4) (2023)
Kartik Lakhotia, Laura Monroe, Kelly Isham, Maciej Besta, Nils Blach, Torsten Hoefler, Fabrizio Petrini
PolarStar: Expanding the Scalability Horizon of Diameter-3 Networks. CoRR (2023)
Marcin Copik, Roman Böhringer, Alexandru Calotoiu, Torsten Hoefler
FMI: Fast and Cheap Message Passing for Serverless Functions. ICS (2023)
Eldar Kurtic, Torsten Hoefler, Dan Alistarh
How to Prune Your Language Model: Recovering Accuracy on the "Sparsity May Cry" Benchmark. CoRR (2023)
Jinfan Chen, Shigang Li, Ran Guo, Jinhui Yuan, Torsten Hoefler
AutoDDL: Automatic Distributed Deep Learning with Asymptotically Optimal Communication. CoRR (2023)
Tiziano De Matteis, Lukas Gianinazzi, Johannes de Fine Licht, Torsten Hoefler
Streaming Task Graph Scheduling for Dataflow Architectures. HPDC (2023)
Patrick Iff, Maciej Besta, Matheus A. Cavalcante, Tim Fischer, Luca Benini, Torsten Hoefler
HexaMesh: Scaling to Hundreds of Chiplets with an Optimized Chiplet Arrangement. DAC (2023)
Thomas Benz, Michael Rogenmoser, Paul Scheffler, Samuel Riedel, Alessandro Ottaviano, Andreas Kurth, Torsten Hoefler, Luca Benini
A High-performance, Energy-efficient Modular DMA Engine Architecture. CoRR (2023)
Torsten Hoefler, Thomas Häner, Matthias Troyer
Disentangling Hype from Practicality: On Realistically Achieving Quantum Advantage. CoRR (2023)
Tiziano De Matteis, Lukas Gianinazzi, Johannes de Fine Licht, Torsten Hoefler
Streaming Task Graph Scheduling for Dataflow Architectures. CoRR (2023)
Tal Ben-Nun, Berke Ates, Alexandru Calotoiu, Torsten Hoefler
Bridging Control-Centric and Data-Centric Optimization. CGO (2023)
Paul Scheffler, Florian Zaruba, Fabian Schuiki, Torsten Hoefler, Luca Benini
Sparse Stream Semantic Registers: A Lightweight ISA Extension Accelerating General Sparse Linear Algebra. IEEE Trans. Parallel Distributed Syst. 34 (12) (2023)
Torsten Hoefler, Bjorn Stevens, Andreas F. Prein, Johanna Baehr, Thomas C. Schulthess, Thomas F. Stocker, John A. Taylor, Daniel Klocke, Pekka Manninen, Piers M. Forster, Tobias Kölling, Nicolas Gruber, Hartwig Anzt, Claudia Frauen, Florian Ziemen, Milan Klöwer, Karthik Kashinath, Christoph M. Schär, Oliver Fuhrer, Bryan N. Lawrence
Earth Virtualization Engines - A Technical Perspective. CoRR (2023)
Langwen Huang, Torsten Hoefler
Compressing multidimensional weather and climate data into neural networks. ICLR (2023)
Wenqi Jiang, Shigang Li, Yu Zhu, Johannes de Fine Licht, Zhenhao He, Runbin Shi, Cédric Renggli, Shuai Zhang, Theodoros Rekatsinas, Torsten Hoefler, Gustavo Alonso
Co-design Hardware and Algorithm for Vector Search. SC (2023)
Niels Gleinig, Tal Ben-Nun, Torsten Hoefler
A Theory of I/O-Efficient Sparse Neural Network Inference. CoRR (2023)
Elias Frantar, Saleh Ashkboos, Torsten Hoefler, Dan Alistarh
OPTQ: Accurate Quantization for Generative Pre-trained Transformers. ICLR (2023)
Kartik Lakhotia, Kelly Isham, Laura Monroe, Maciej Besta, Torsten Hoefler, Fabrizio Petrini
In-network Allreduce with Multiple Spanning Trees on PolarFly. SPAA (2023)
Yue Shi, Tommy Nguyen, Samuel Alexander Stein, Tim Stavenger, Marvin Warner, Martin Roetteler, Torsten Hoefler, Ang Li
A Reference Implementation for a Quantum Message Passing Interface. SC Workshops (2023)
Andrei Ivanov, Nikoli Dryden, Tal Ben-Nun, Saleh Ashkboos, Torsten Hoefler
STen: Productive and Efficient Sparsity in PyTorch. CoRR (2023)
Wei Qiu, Marcin Copik, Yun Wang, Alexandru Calotoiu, Torsten Hoefler
User-guided Page Merging for Memory Deduplication in Serverless Systems. CoRR (2023)
Philipp Schaad, Timo Schneider, Tal Ben-Nun, Alexandru Calotoiu, Alexandros Nikolaos Ziogas, Torsten Hoefler
FuzzyFlow: Leveraging Dataflow To Find and Squash Program Optimization Bugs. CoRR (2023)
Julia Bazinska, Andrei Ivanov, Tal Ben-Nun, Nikoli Dryden, Maciej Besta, Siyuan Shen, Torsten Hoefler
Cached Operator Reordering: A Unified View for Fast GNN Training. CoRR (2023)
Lukas Trümper, Tal Ben-Nun, Philipp Schaad, Alexandru Calotoiu, Torsten Hoefler
Performance Embeddings: A Similarity-based Approach to Automatic Performance Optimization. CoRR (2023)
Mikhail Khalilov, Marcin Chrapek, Siyuan Shen, Alessandro Vezzu, Thomas Benz, Salvatore Di Girolamo, Timo Schneider, Daniele De Sensi, Luca Benini, Torsten Hoefler
OSMOSIS: Enabling Multi-Tenancy in Datacenter SmartNICs. CoRR (2023)
Satoshi Matsuoka, Jens Domke, Mohamed Wahib, Aleksandr Drozd, Torsten Hoefler
Myths and Legends in High-Performance Computing. CoRR (2023)
Torsten Hoefler, Thomas Häner, Matthias Troyer
Disentangling Hype from Practicality: On Realistically Achieving Quantum Advantage. Commun. ACM 66 (5) (2023)
Wenqi Jiang, Shigang Li, Yu Zhu, Johannes de Fine Licht, Zhenhao He, Runbin Shi, Cédric Renggli, Shuai Zhang, Theodoros Rekatsinas, Torsten Hoefler, Gustavo Alonso
Co-design Hardware and Algorithm for Vector Search. CoRR (2023)
Wei Qiu, Marcin Copik, Yun Wang, Alexandru Calotoiu, Torsten Hoefler
User-guided Page Merging for Memory Deduplication in Serverless Systems. BigData (2023)
Torsten Hoefler, Duncan Roweth, Keith D. Underwood, Robert Alverson, Mark Griswold, Vahid Tabatabaee, Mohan Kalkunte, Surendra Anubolu, Siyuan Shen, Moray McLaren, Abdul Kabbani, Steve Scott
Data Center Ethernet and Remote Direct Memory Access: Issues at Hyperscale. Computer 56 (7) (2023)
Roberto L. Castro, Andrei Ivanov, Diego Andrade, Tal Ben-Nun, Basilio B. Fraguela, Torsten Hoefler
VENOM: A Vectorized N: M Format for Unleashing the Power of Sparse Tensor Cores. CoRR (2023)
Kazuki Osawa, Shigang Li, Torsten Hoefler
PipeFisher: Efficient Training of Large Language Models Using Pipelining and Fisher Information Matrices. CoRR (2022)
Alexandros Nikolaos Ziogas, Grzegorz Kwasniewski, Tal Ben-Nun, Timo Schneider, Torsten Hoefler
Deinsum: Practically I/O Optimal Multi-Linear Algebra. SC (2022)
Nikoli Dryden, Torsten Hoefler
Spatial Mixture-of-Experts. CoRR (2022)
Torsten Hoefler
Benchmarking Data Science: 12 Ways to Lie With Statistics and Performance on Parallel Computers. Computer 55 (8) (2022)
Salvatore Di Girolamo, Daniele De Sensi, Konstantin Taranov, Milos Malesevic, Maciej Besta, Timo Schneider, Severin Kistler, Torsten Hoefler
Building Blocks for Network-Accelerated Distributed File Systems. SC (2022)
Carl-Johannes Johnsen, Tiziano De Matteis, Tal Ben-Nun, Johannes de Fine Licht, Torsten Hoefler
Temporal Vectorization: A Compiler Approach to Automatic Multi-Pumping. CoRR (2022)
Johannes de Fine Licht, Christopher A. Pattison, Alexandros Nikolaos Ziogas, David Simmons-Duffin, Torsten Hoefler
Fast Arbitrary Precision Floating Point on FPGA. FCCM (2022)
Lukas Gianinazzi, Tal Ben-Nun, Saleh Ashkboos, Yves Baumann, Piotr Luczynski, Torsten Hoefler
The spatial computer: A model for energy-efficient parallel computation. CoRR (2022)
Langwen Huang, Torsten Hoefler
Compressing multidimensional weather and climate data into neural networks. CoRR (2022)
Patrick Iff, Maciej Besta, Matheus A. Cavalcante, Tim Fischer, Luca Benini, Torsten Hoefler
HexaMesh: Scaling to Hundreds of Chiplets with an Optimized Chiplet Arrangement. CoRR (2022)
Kartik Lakhotia, Maciej Besta, Laura Monroe, Kelly Isham, Patrick Iff, Torsten Hoefler, Fabrizio Petrini
PolarFly: A Cost-Effective and Flexible Low-Diameter Topology. SC (2022)
Johannes de Fine Licht, Christopher A. Pattison, Alexandros Nikolaos Ziogas, David Simmons-Duffin, Torsten Hoefler
Fast Arbitrary Precision Floating Point on FPGA. CoRR (2022)
Shigang Li, Torsten Hoefler
Near-Optimal Sparse Allreduce for Distributed Deep Learning. CoRR (2022)
Niels Gleinig, Torsten Hoefler
Circuits for Measurement Based Quantum State Preparation. DATE (2022)
Philipp Schaad, Tal Ben-Nun, Torsten Hoefler
Boosting Performance Optimization with Interactive Data Movement Visualization. SC (2022)
Maciej Besta, Raphael Grob, Cesare Miglioli, Nicola Bernold, Grzegorz Kwasniewski, Gabriel Gjini, Raghavendra Kanakagiri, Saleh Ashkboos, Lukas Gianinazzi, Nikoli Dryden, Torsten Hoefler
Motif Prediction with Graph Neural Networks. KDD (2022)
András Strausz, Flavio Vella, Salvatore Di Girolamo, Maciej Besta, Torsten Hoefler
Asynchronous Distributed-Memory Triangle Counting and LCC with RMA Caching. IPDPS (2022)
Konstantin Taranov, Fabian Fischer, Torsten Hoefler
Efficient RDMA Communication Protocols. CoRR (2022)
Shigang Li, Kazuki Osawa, Torsten Hoefler
Efficient Quantized Sparse Matrix Operations on Tensor Cores. CoRR (2022)
Shiyi Cao, Salvatore Di Girolamo, Torsten Hoefler
Accelerating Data Serialization/Deserialization Protocols with In-Network Compute. ExaMPI@SC (2022)
Konstantin Taranov, Steve Byan, Virendra J. Marathe, Torsten Hoefler
KafkaDirect: Zero-copy Data Access for Apache Kafka over RDMA Networks. SIGMOD Conference (2022)
Konstantin Taranov, Benjamin Rothenberger, Daniele De Sensi, Adrian Perrig, Torsten Hoefler
NeVerMore: Exploiting RDMA Mistakes in NVMe-oF Storage Applications. CoRR (2022)
Maciej Besta, Patrick Iff, Florian Scheidl, Kazuki Osawa, Nikoli Dryden, Michal Podstawski, Tiancheng Chen, Torsten Hoefler
Neural Graph Databases. CoRR (2022)
Alexandros Nikolaos Ziogas, Grzegorz Kwasniewski, Tal Ben-Nun, Timo Schneider, Torsten Hoefler
Deinsum: Practically I/O Optimal Multilinear Algebra. CoRR (2022)
Elias Frantar, Saleh Ashkboos, Torsten Hoefler, Dan Alistarh
GPTQ: Accurate Post-Training Quantization for Generative Pre-trained Transformers. CoRR (2022)

Torsten Hoefler.css-eqlu8i{font-size:small;padding-left:4px;}

Publication Activity (10 Years)

Top Topics

Top Venues

Torsten Hoefler