Quantifying Contamination in Evaluating Code Generation Capabilities of Language Models.
Martin RiddellAnsong NiArman CohanPublished in: ACL (1) (2024)
Keyphrases
- language model
- code generation
- language modeling
- application development
- probabilistic model
- n gram
- document retrieval
- retrieval model
- software development
- query expansion
- language modelling
- code generator
- speech recognition
- formal specification
- context sensitive
- statistical language models
- modeling language
- information retrieval
- software reuse
- rapid prototyping
- language models for information retrieval
- test collection
- design tools
- smoothing methods
- model driven
- bayesian networks
- design patterns
- relevance model
- development process
- life cycle
- software engineering
- user interface
- artificial intelligence
- statistical language modeling
- databases