Scaling Pre-trained Language Models to Deeper via Parameter-efficient Architecture.

Peiyu Liu Ze-Feng Gao Yushuo Chen Wayne Xin Zhao Ji-Rong Wen

Published in: CoRR (2023)

Keyphrases

language model
language modeling
pre trained
probabilistic model
speech recognition
document retrieval
retrieval model
statistical language models
information retrieval
n gram
query expansion
language modelling
test collection
relevance model
document ranking
smoothing methods
image classification
active learning