In-context learning (ICL) enables language models to perform new tasks from demonstrations without weight updates. However, every ICL inference requires processing the full set of examples, resulting in inefficient deployments, and how ICL works mechanistically is not fully understood. Prior work compresses ICL into fi...
Guang-Zhi Xiong, Zheng-Hao He, Bo-Han Liu et al.· 0 citations
Long-term egocentric video enables personalized AI assistants to reason about daily life. However, as video histories grow to hundreds of hours spanning months or years, reprocessing raw clips for every query becomes computationally prohibitive. Memory systems offer a scalable alternative by compacting videos into text...
Guang-Zhi Xiong, Xin-Yuan Zhang, Xiao Yang et al.· 0 citations
It is shown that current large language models generally perform poorly on most of the safety tests, regardless of their safety alignment mechanisms, which underscores the crucial need for ongoing human oversight and the implementation of strict safety guardrails before deploying these tools in clinical practice.
Yi-Fan Yang, Qiao Jin, Robert Leaman et al.· Communications Medicine· 0 citations
Masked diffusion language models (MDLMs) can generate text efficiently by predicting multiple masked tokens in parallel, but predictions from the same forward pass are not necessarily reliable when committed together. We study when parallel commitment is reliable. Our diagnostics show that confidence alone does not det...
Zheng-Hao He, Bo-Han Liu, Guang-Zhi Xiong et al.· 0 citations
This work proposes to view reasoning paths as phase-structured trajectories within fixed questions as PAIR, short for Phase-Aligned Intra-question Reasoning, and improves within-question trajectory ranking and Best-of-N trajectory selection across models and benchmarks.
Zheng-Hao He, Guang-Zhi Xiong, Sanchit Sinha et al.· 0 citations
Concept-Residual eXpansion (CRX), a concept-augmented framework that improves robustness by expanding the set of candidate predictive features by improving robustness to spurious correlations, is proposed.
Eric Xie, Guang-Zhi Xiong, Wenqian Ye et al.· Proceedings of the 32nd ACM...· 0 citations
It is suggested that CoT prompting activates specific latent features to trigger reasoning, and that targeted intervention on these features offers an alternative pathway to elicit efficient reasoning behavior without explicit CoT prompting.
Zhenghao He, Guangzhi Xiong, Bohan Liu et al.· 6 citations· ⚡1
Concept-Residual eXpansion (CRX), a concept-augmented framework that improves robustness by expanding the set of candidate predictive features by improving robustness to spurious correlations, is proposed.
Eric Xie, Guangzhi Xiong, Wenqian Ye et al.· Proceedings of the 32nd ACM...· 0 citations
This entry-level tutorial aims to equip healthcare professionals with the tools necessary to effectively integrate LLMs into clinical practice, ensuring that these powerful technologies are applied in a safe, reliable, and impactful manner.
Qiao Jin, Nicholas Wan, Robert Leaman et al.· Nature Protocols· 1 citation
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.