Modern Distributed Data-Parallel Large-Scale Pre-training Strategies For NLP models.

Published in: HP3C (2021)

Keyphrases

distributed data
natural language processing
neural network
database
databases
data mining algorithms
nearest neighbor
business intelligence
machine translation
communication cost
data sharing