Unmasking Transformers: A Theoretical Approach to Data Recovery via Attention Weights.
Yichuan DengZhao SongShenghao XieChiwun YangPublished in: CoRR (2023)
Keyphrases
- data sets
- raw data
- data analysis
- original data
- data collection
- training data
- high quality
- image data
- small number
- data mining techniques
- statistical analysis
- complex data
- real time
- log data
- data acquisition
- data distribution
- experimental data
- information systems
- data processing
- data sources
- prior knowledge
- learning algorithm
- computer systems
- historical data
- data quality
- noisy data
- data structure
- high dimensional
- missing values
- application domains
- data mining algorithms
- spatial data
- missing data
- synthetic data
- high dimensional data
- labeled data