OmNICCL: Zero-cost Sparse AllReduce with Direct Cache Access and SmartNICs.

Tongzhou Gu Jiawei Fei Marco Canini

Published in: NAIC (2024)

Keyphrases

cache management
high cost
sparse data
miss rate
high dimensional
query processing
access control
sparse representation
total cost
prefetching
replacement policy
read write
hit ratio
databases
communication cost
multiple users
resource consumption
response time
digital libraries