Evaluation of LLMs on Syntax-Aware Code Fill-in-the-Middle Tasks.

Linyuan Gong Sida Wang Mostafa Elhoushi Alvin Cheung

Published in: CoRR (2024)

Keyphrases

source code
evaluation method
evaluation criteria
machine learning
gold standard
multiple tasks
program code
database
real time
web services
high level