MicroBERT: Effective Training of Low-resource Monolingual BERTs through Parameter Reduction and Multitask Learning.

Luke Gessler Amir Zeldes

Published in: CoRR (2022)

Keyphrases

multitask learning
gaussian processes
learning tasks
multi task
feature selection
multi task learning
information retrieval
computer vision
reinforcement learning
supervised learning