What happens to information a pretrained model already encodes when post-training no longer rewards using it? The common language of representation compression conflates three fates: information may be erased, rerouted away from the decision while still represented, or rescaled to occupy less variance while still repre...
Wei-Han Li, Tianshi ZHENG, Jun-Hao Wu et al.· 1 citation
Scientific discovery often begins when scattered clues call for a new way of describing the world. Such abductive exploration can require constructing the representation in which an explanation is stated, when the world is epistemically open, and composing evidence scattered across contexts, when it is structurally int...
Wei-Han Li, Tianshi ZHENG, Yang-Qiu Song et al.· 0 citations
Noise-Aware Verbal Confidence CAlibration Rules are proposed to provide a principled foundation for resolving overconfidence under noise and NOVA, a noise-aware calibration framework that synthesizes supervision from ~2K HotpotQA examples guided by these rules.
Real-world decision-making often involves uncertainty expressed in linguistic rather than numerical terms, and Prospect Theory (PT) provides a classic framework for modeling human behavior under such uncertainty. Although recent studies have developed frameworks to estimate PT parameters for Large Language Models (LLMs...
Rui Wang, Qi-Han Lin, Jiayu Liu et al.· 2 citations
Claims about what an internal direction in an LLM represents need evidential constraints beyond an observer's prior beliefs about the system. Decodability and successful activation steering do not, by themselves, establish which construct the direction tracks. This gap is especially consequential for welfare-relevant i...
Wei-Han Li, Xin-Lei Chen, Yu-Han Song et al.· 0 citations
AgentIdeaBench is introduced, a multidisciplinary benchmark that evaluates scientific ideation under two matched settings, static observation and active exploration, and Scientific World Modeling is explored, a generation-time loop that refines a draft hypothesis through structured thought experiments.
Yunxiang Mo, Tianshi ZHENG, Yi-Sen Gao et al.· 0 citations
Consistent gains over DVD on LVBench, Video-MME, EgoSchema, and LongVideoBench suggest that option-aware evidence acquisition transfers beyond MMR-V, and proposes PACE (Progressive Acquisition of Critical Evidence), a factor-guided framework for long-video evidence acquisition.
Bai-Xuan Xu, Yinyui Xu, Tianshi ZHENG et al.· 1 citation
Results indicate that MultivationBench presents a significant challenge: all tested models struggle to maintain consistent motivation reasoning across sequential contexts, revealing a critical disconnect between static recognition capabilities and the dynamic reasoning essential for human-like social understanding.
This work proposes InferenceDynamics, a flexible and scalable multi-dimensional routing framework by modeling the capability and knowledge of models, and demonstrates its effectiveness and generalizability in group-level routing using modern benchmarks including MMLU-Pro, GPQA, BigGen-Bench, and LiveBench.
Haochen Shi, Tianshi ZHENG, Weiqi Wang et al.· Annual Meeting of the Associ...· 0 citations
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.