USP: A Unified Sequence Parallelism Approach for Long Context Generative AI.
Jiarui FangShangchun ZhaoPublished in: CoRR (2024)
Keyphrases
- artificial intelligence
- context aware
- long sequences
- data mining
- neural network
- machine learning
- expert systems
- database
- parallel processing
- contextual information
- generative model
- input data
- ai community
- ai systems
- context sensitive
- em algorithm
- data driven
- knowledge representation
- prior knowledge
- information retrieval
- data sets