Rethinking the Role of Scale for In-Context Learning: An Interpretability-based Case Study at 66 Billion Scale.
Hritik BansalKarthik GopalakrishnanSaket DingliwalSravan BodapatiKatrin KirchhoffDan RothPublished in: ACL (1) (2023)
Keyphrases
- case study
- learning algorithm
- learning process
- prior knowledge
- learning scheme
- context aware
- artificial intelligence
- knowledge base
- scale space
- online learning
- small scale
- contextual information
- learning systems
- learning tasks
- technology enhanced learning
- context dependent
- incremental learning
- unsupervised learning
- empirical studies
- software development
- object recognition