Contamination Means Overestimation? A Fine-Grained Empirical Study in Code Intelligence
In recent years, code intelligence has gained increasing importance in the field of automated software engineering. Meanwhile, the widespread adoption of Pretrained Language Models (PLMs) and Large Language Models (LLMs) has raised concerns regarding data contamination and its potential impact on model performance eval...
Zhen Chuan Yang, Hongyi Lin, Yifan He et al.
· Proceedings of the ACM on so... · 0 citations