What Do They Capture? - A Structural Analysis of Pre-Trained Language Models for Source Code.
Yao WanWei ZhaoHongyu ZhangYulei SuiGuandong XuHai JinPublished in: CoRR (2022)
Keyphrases
- source code
- language model
- structural analysis
- pre trained
- language modeling
- open source
- software systems
- speech recognition
- probabilistic model
- n gram
- document retrieval
- information retrieval
- training data
- query expansion
- training examples
- retrieval model
- three dimensional
- software maintenance
- test collection
- software repositories
- smoothing methods
- high level
- vector space model
- image processing
- relevance model
- control signals
- case study