Transformers Implement Functional Gradient Descent to Learn Non-Linear Functions In Context.

Xiang Cheng Yuxin Chen Suvrit Sra

Published in: CoRR (2023)

Keyphrases

context aware
contextual information
context awareness
efficient learning
functional language
high level
cost function
learning rules
functional properties
database
real time
information systems
image processing
objective function