Low-Rank Adaptation (LoRA) achieves parameter-efficient fine-tuning by constraining model updates to a low-rank subspace and has been widely used in practice. However, LoRA typically employs a shared low-rank update across tokens, which limits its ability to fully exploit the adaptation subspace for tokens from differe...
Guang Yang, Chang-Hao Guan, Chao Huang et al.· 0 citations
Large reasoning models (LRMs) have shown exceptional performance in complex tasks such as mathematics and coding. In the field of machine translation (MT), reinforcement learning (RL) has been utilized to enhance the quality of translations. However, traditional RL approaches rely heavily on the base model’s inherent...
Zengkui Sun, Jia-Li Zeng, Jiaan Wang et al.· Transactions of the Associat...· 0 citations
A disentangled contrastive learning~(DCL) method for multilingual dense retrieval by separating multilingual representations into semantic and linguistic subspaces based on hierarchical semantic alignment and language debiasing contrastive learning to reduce language-induced interference in semantic matching.
Chao Huang, Yufeng Chen, Changhao Guan et al.· 0 citations
Experiments on multilingual mathematical benchmarks show that MCD consistently reduces reasoning length while maintaining competitive accuracy, and significantly improves robustness in low-resource languages.
Jiarui Wan, Songming Zhang, Yufeng Chen· Proceedings of the 1st Works...· 0 citations
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.