DeepSpeed-FastGen: High-throughput Text Generation for LLMs via MII and DeepSpeed-Inference.
Connor HolmesMasahiro TanakaMichael WyattAmmar Ahmad AwanJeff RasleySamyam RajbhandariReza Yazdani AminabadiHeyang QinArash BakhtiariLev KurilenkoYuxiong HePublished in: CoRR (2024)
Keyphrases
- high throughput
- text generation
- microarray
- genome wide
- natural language generation
- biological data
- systems biology
- natural language
- genomic data
- data acquisition
- low latency
- protein protein interactions
- gene expression
- microarray data
- proteomic data
- theorem prover
- bayesian inference
- mass spectrometry
- bayesian networks
- gene ontology
- natural language processing
- living cells
- dna sequencing
- real time