PyTorch FSDP: Experiences on Scaling Fully Sharded Data Parallel.
Yanli ZhaoAndrew GuRohan VarmaLiang LuoChien-Chin HuangMin XuLess WrightHamid ShojanazeriMyle OttSam ShleiferAlban DesmaisonCan BaliogluBernard NguyenGeeta ChauhanYuchen HaoShen LiPublished in: CoRR (2023)
Keyphrases
- data sets
- database
- data structure
- raw data
- data sources
- statistical methods
- synthetic data
- statistical analysis
- data collection
- complex data
- data quality
- data distribution
- experimental data
- data processing
- image data
- data analysis
- small number
- missing data
- spatial data
- knowledge discovery
- data points
- prior knowledge
- knowledge base