On Difficulties of Attention Factorization through Shared Memory.
Uladzislau YorshMartin HoleñaOndrej BojarDavid HerelPublished in: CoRR (2024)
Keyphrases
- shared memory
- message passing
- parallel algorithm
- multi processor
- distributed memory
- parallel computing
- parallel programming
- parallel architecture
- parallel architectures
- pairwise
- parallel computation
- shared memory multiprocessors
- singular value decomposition
- parallel machines
- data parallelism
- address space
- multi core systems
- high quality
- parallel execution
- low overhead
- interprocess communication
- parallel computers
- search algorithm
- multithreading
- three dimensional
- commodity hardware
- real time