Revisiting LLMs on New Feature Implementation in Real-World Software Development Practices
A systematic evaluation of the capability of large language models (LLMs) in new feature implementation, with a task setup strictly aligned with real-world software development practices, shows that new feature implementation of LLMs adhering to real-world world software development practices remains challenges.