Copilot Evaluation Harness: Evaluating LLM-Guided Software Programming.
Anisha AgarwalAaron ChanShubham ChandelJinu JangShaun MillerRoshanak Zilouchian MoghaddamYevhen MohylevskyyNeel SundaresanMichele TufanoPublished in: CoRR (2024)
Keyphrases
- automatic evaluation
- software development
- software systems
- user interface
- programming language
- software components
- computer software
- evaluation criteria
- object oriented design
- data mining
- program understanding
- hardware design
- software packages
- software design
- software tools
- design patterns
- software architecture
- general purpose
- information retrieval