Strategy Accumulation and Guided Execution for Automated LLM Fine-Tuning
Results show that persistent strategy experience provides effective guidance for automated fine-tuning on unseen tasks, and propose Strategy Accumulation and Guided Execution (SAGE), a two-stage framework that makes automated fine-tuning search cumulative.