Login / Signup

MUX-PLMs: Pre-training Language Models with Data Multiplexing.

Vishvak MurahariAmeet DeshpandeCarlos E. JimenezIzhak ShafranMingqiu WangYuan CaoKarthik Narasimhan
Published in: RepL4NLP@ACL (2023)
Keyphrases
  • language model
  • training data
  • knowledge discovery
  • n gram
  • machine learning
  • training set
  • speech recognition
  • test collection
  • document retrieval
  • retrieval model
  • language modelling