J.-X. Bai

Research on Efficient Fine-Tuning of Large Model Parameters Using a Hybrid LoRA and IA3 Adaptation Approach

The proposed approach provides an efficient fine-tuning framework for applying LLMs to domain-specific engineering tasks with reduced computational overhead and a hybrid adaptation training strategy is designed using hierarchical learning rates and gradient clipping mechanisms across different modules.