JUPE, a visual-question-answering (VQA)-style benchmark that fixes answers while varying explanations is introduced, finding a significant mean shift in decision criterion toward acceptance, without a clear change in mean discriminability.
Ang-Lin Cai, Zhi-Qi Wang, Xiao-Zhi Yang et al.· 0 citations
Speculative decoding accelerates inference for a large language model (LLM), referred to as the \emph{target model}, by first using a smaller model, referred to as the \emph{draft model}, to generate candidate tokens and then verifying them with the target model for acceptance or rejection. Prior studies primarily focu...
Yi-Chi Zhang, Zhi-Qi Wang, N. Gong et al.· 0 citations
This work identifies a class of user-issued instructions, Session Constraints, that are meant to constrain LLM's behavior for the remainder of a session but are silently dropped during compaction, and introduces COMPINT, an evaluation suite that evaluates compactors across three long-context scenarios: multi-turn chat,...
Zhiqi Wang, Yichi Zhang, Dongwon Lee et al.· 2 citations
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.