What Do They Capture? - A Structural Analysis of Pre-Trained Language Models for Source Code.
Yao WanWei ZhaoHongyu ZhangYulei SuiGuandong XuHai JinPublished in: ICSE (2022)
Keyphrases
- source code
- language model
- structural analysis
- pre trained
- language modeling
- open source
- software systems
- document retrieval
- n gram
- speech recognition
- retrieval model
- training data
- probabilistic model
- information retrieval
- three dimensional
- test collection
- image processing
- software maintenance
- vector space model
- training examples
- query expansion
- high level
- document representation
- control signals
- relevance model
- data sets
- text classification
- decision trees
- source files