No "Zero-Shot" Without Exponential Data: Pretraining Concept Frequency Determines Multimodal Model Performance.
Vishaal UdandaraoAmeya PrabhuAdhiraj GhoshYash SharmaPhilip H. S. TorrAdel BibiSamuel AlbanieMatthias BethgePublished in: CoRR (2024)
Keyphrases
- experimental data
- prior knowledge
- data sets
- input data
- multi modal
- probability distribution
- simulation data
- data analysis
- data processing
- network structure
- raw data
- image data
- predictive model
- prior information
- database
- test data
- neural network
- statistical model
- statistical methods
- mathematical model
- artificial neural networks
- statistical analysis
- probabilistic model
- multimedia
- data collection
- data quality
- data sources
- synthetic data
- empirical data
- measured data
- data samples
- spatial data
- high quality
- computer systems
- decision trees
- small number
- data points
- high level
- database systems
- training data