SambaNova SN40L: Scaling the AI Memory Wall with Dataflow and Composition of Experts.
Raghu PrabhakarRam SivaramakrishnanDarshan GandhiYun DuMingran WangXiangyu SongKejie ZhangTianren GaoAngela WangKaren LiYongning ShengJoshua BrotDenis SokolovApurv VivekCalvin LeungArjun SabnisJiayu BaiTuowen ZhaoMark GottschoDavid JacksonMark LuttrellManish K. ShahEdison ChenKaizhao LiangSwayambhoo JainUrmish ThakkerDawei HuangSumti JairathKevin J. BrownKunle OlukotunPublished in: CoRR (2024)
Keyphrases
- artificial intelligence
- memory usage
- ai systems
- expert systems
- memory requirements
- case based reasoning
- intelligent systems
- machine learning
- data flow
- ai community
- ai technologies
- knowledge representation and reasoning
- control flow
- parallel computing
- data sets
- computing power
- memory space
- limited memory
- domain experts
- knowledge representation
- memory size
- data mining
- petri net
- ai methods
- data streams