Login / Signup

Retro: Reusing teacher projection head for efficient embedding distillation on Lightweight Models via Self-supervised Learning.

Khanh-Binh NguyenChae Jung Park
Published in: CoRR (2024)
Keyphrases
  • lightweight
  • learning process
  • learning algorithm
  • prior knowledge
  • accurate models
  • learning models
  • development environments
  • computer networks
  • teacher education