Is Your Code Generated by ChatGPT Really Correct? Rigorous Evaluation of Large Language Models for Code Generation.
Jiawei LiuChunqiu Steven XiaYuyao WangLingming ZhangPublished in: CoRR (2023)
Keyphrases
- code generation
- language model
- language modeling
- application development
- code generator
- software development
- n gram
- information retrieval
- retrieval model
- test collection
- document retrieval
- language modelling
- query expansion
- probabilistic model
- model driven
- statistical language models
- modeling language
- rapid prototyping
- formal specification
- document ranking
- speech recognition
- software reuse
- smoothing methods
- automatically generated
- context sensitive
- data processing
- pseudo relevance feedback
- relevance model
- high level
- case study
- artificial intelligence
- language models for information retrieval
- design patterns
- machine learning
- retrieval systems
- data driven
- source code