This work introduces TLXML (Task-Level eXplanation of Meta-Learning), a novel framework that extends influence functions to meta-learning settings, enabling task-level explanations of adaptation and inference, and proposes a Gauss-Newton-based approximation.
Pretrained large language models offer a practical foundation for learning useful behavior from few task-specific examples. We argue that current prompt and context optimization methods underuse the extensive knowledge and reasoning capabilities of trillion-parameter models. These capabilities can make adaptation more...
A lightweight LLM-based framework designed for joint performance prediction and feedback generation and a Low-Rank Adaptation-based parameter-efficient fine-tuning mechanism is proposed, indicating that parameter fusion and parameter-efficient fine-tuning provide effective solutions for integrating prediction and feedb...
TAILS resolves cross-task ambiguity at the representation level, while leaving the original PTM, method-specific modules, and classifier unchanged, and can improve classification and task-inference performance with modest parameter overhead and negligible inference cost.
Zhiming Xu, Huiyu Yi, Zheng-He Xie et al.· 0 citations
A dependency-graph framework is proposed to formalize compositional reasoning, yielding three levels of compositionality with increasing complexity, and preliminary evidence that the decomposed-to-composed asymmetry can extend to practical settings is presented.
Yu He, Ying-Xi Li, Yi-Fei Wang et al.· 0 citations
As large language models are increasingly deployed across diverse downstream tasks, efficient task adaptation has emerged as a central challenge. In response, a wide range of task adaptation methods have been proposed, spanning parameter-efficient fine-tuning, in-context learning, and embedding-injection approaches. Ho...
Jungwon Park, Changin Choi, Jimyeong Kim et al.· 0 citations
Experiments across synthetic benchmarks and a real-world robot arm control problem, together with evaluations under different acquisition functions and evolutionary multitasking, demonstrate the effectiveness and generality of ICG-MTO for few-shot multitask optimization.
Tingyang Wei, Hao-Feng Wu, Jiao Liu et al.· 0 citations
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.