Model Parallelism on Distributed Infrastructure: A Literature Review from Theory to LLM Case-Studies.

Felix Brakel Uraz Odyurt Ana Lucia Varbanescu

Published in: CoRR (2024)

Keyphrases

literature review
case study
computational model
theoretical framework
formal model
lessons learned
high level
multi agent
open source
conceptual framework
data sets
evaluation model
theoretical foundation
parallel processing
conceptual model
software development
distributed systems
fuzzy logic
objective function