PyTorch FSDP: Experiences on Scaling Fully Sharded Data Parallel.
Yanli ZhaoAndrew GuRohan VarmaLiang LuoChien-Chin HuangMin XuLess WrightHamid ShojanazeriMyle OttSam ShleiferAlban DesmaisonCan BaliogluPritam DamaniaBernard NguyenGeeta ChauhanYuchen HaoAjit MathewsShen LiPublished in: Proc. VLDB Endow. (2023)
Keyphrases
- data collection
- database
- data sets
- experimental data
- data sources
- synthetic data
- original data
- raw data
- data processing
- data mining
- training data
- high quality
- data structure
- data analysis
- data quality
- data objects
- data acquisition
- complex data
- spatial data
- statistical analysis
- data mining techniques
- multi dimensional
- wireless sensor networks
- xml documents
- case study