Zhi-Xuan Fang

Layer-Informed Fine-Tuning via Three-Stage Functional Segmentation of LLMs

In recent years, the performance of large language models (LLMs) on reasoning tasks has been remarkable, even surpassing human capabilities on various benchmarks. However, there remains a lack of clear understanding in the academic community regarding how the structure and internal parameters of LLMs progressively solv...