Superiority of Multi-Head Attention in In-Context Linear Regression.

Yingqian Cui Jie Ren Pengfei He Jiliang Tang Yue Xing

Published in: CoRR (2024)

Keyphrases

linear regression
least squares
regression problems
regression methods
ridge regression
nonlinear regression
linear models
linear regression model
locally weighted
regression trees
computer vision
feature extraction
optical flow
kernel density estimators