LongCoder: A Long-Range Pre-trained Language Model for Code Completion.
Daya GuoCanwen XuNan DuanJian YinJulian J. McAuleyPublished in: ICML (2023)
Keyphrases
- language model
- long range
- pre trained
- short range
- language modeling
- probabilistic model
- training data
- n gram
- information retrieval
- query expansion
- conditional random fields
- speech recognition
- training examples
- control signals
- smoothing methods
- prior knowledge
- data sets
- graphical models
- wireless communication
- active learning
- data mining