LEALLA: Learning Lightweight Language-agnostic Sentence Embeddings with Knowledge Distillation.

Zhuoyuan Mao Tetsuji Nakagawa

Published in: CoRR (2023)

Keyphrases

lightweight
learning systems
knowledge acquisition
prior knowledge
learning algorithm
knowledge transfer
domain knowledge
background knowledge
developmental psychology
reinforcement learning
language learning
concept maps
natural language
learning process
knowledge representation
learning scenarios