Across the seven tasks and hyperparameter configurations the authors consider, CTCD is competitive with vanilla distillation and outperforms supervised fine-tuning alone on average; it transfers to task-specific fine-tuning as a viable distillation objective, but not as an improvement over the standard formulation.
Nikhil Trivedi, Karthik Ravi, Mohammad Ali Shehral et al.· Optical Engineering + Applic...· 0 citations
Developer-AI conversations, through coding assistants and chat-based programming aids, produce rich architectural decision traces (trigger, context, alternatives considered, decision, rationale) that are lost when the chat session ends. Conversation logs are unstructured, not indexed for retrieval, and disconnected fro...
Mohammad Ali Shehral, Karthik Ravi, Nikhil Trivedi et al.· Proceedings of the 41st IEEE...· 0 citations
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.