This work investigates two representative model families, LLaVA-1.5 and Qwen2.5, and provides a token-, layer-, and head-level account of how VLMs transform object grounding into spatial relations, showing that knowing where objects are is not equivalent to knowing how they relate.
Xi-Wei Liu, Yu-Long Li, Xin-Lin Zhuang et al.· 1 citation
It is shown that policies within a bounded $\chi^2$ divergence from the proxy-feasible reference distribution admit an $N$-independent safety-hacking bound, and instantiate this general coverage-control principle with constrained pessimistic sampling.
Experimental results on instruction-following tasks show that the proposed self-distillation framework, SelFusion, substantially outperforms other KD methods with external LLM and DLM teachers, providing a practical path toward improving DLM generation quality.
Hyeongsoo Lim, Jinyoung Kim, Eunjoo Seo et al.· Annual Meeting of the Associ...· 0 citations
General-purpose language models can reason and synthesize knowledge, but complex work also requires sustained interaction with files, information sources, and executable code, together with state maintenance, failure recovery, and verifiable delivery. We call this \emph{working capability}: sustained, verifiable progre...
Apodex Team B. An, B. Li, B. Wang et al.· 0 citations
Reach audiences
Advertise in front of researchers, engineers, and readers.
It is argued that WG is more plausible as an adversarial threat-requiring careful data engineering-rather than as a significant hazard inherent to routine fine-tuning.
This work proposes a unified multi-domain and multi-task training framework that models heterogeneous event schemas within a single model, enabling dynamic adaptation to dataset-specific schemas without requiring complete event label sets at inference time.
Si-Ting Liang, Omar Adjali, Daniel Sonntag· 0 citations
Experiments on long-term conversational memory show that mixed observed-and-estimated reranking improves answer accuracy over semantic retrieval by up to 6.62% and remains effective when only 17.5% of candidates receive direct LLM relevance scores, thereby substantially reducing the inference overhead of LLM reranking.
An LLM router picks which model should answer each query. The appeal is that models fail on different questions. Whatever single model is best overall still gets some wrong, and another model in the pool gets many of those right. Getting that choice right every time is the ceiling, and a router is an attempt to approac...
MIND was able to answer many questions about escitalopram in a manner deemed accurate, complete, and safe by psychiatrists the majority of the time, and represents a step towards building safe LLM systems to enhance patient education in psychiatry.
Alexander J. Hish, A. Nagendran, S. Compton· 0 citations
This work introduces future querying, a paradigm that probes whether large language models can function as implicit medical world models by evaluating their ability to answer time-indexed clinical queries about a patient's future, and shows that small, locally fine-tuned open-weight models can match or approach larger...
Siri Willems, James Butterworth, L. Goetschalckx et al.· 0 citations
This work compares data-driven knowledge distillation (DDKD) against zero-shot inference and fine-tuning on out-of-domain D2T data, and introduces structure-preserving augmentation via structural subsampling and perturbation in cross-domain D2T generation.
Yifei Song, Kun Efimov-Zhang, Claire Gardent· 0 citations
This work proposes ProxyFormer, a general dual-stream architecture built upon proxy tokens, and introduces factorized multi-level compression/decompression, layer-wise dynamic compression ratios, asymmetric dual embeddings, and a proxy-only KV-cache inference scheme.
Assistant Professor Benjamin Lindquist studies how engineers deliberately injected randomness into early AI, giving rise to deep-learning models that sometimes hallucinate.
Flint-interactive gives AI agents a language for creating interactive visualizations. Click a chart, filter data, highlight related content, and explore beyond the view the author originally chose. The post Flint-interactive: A language for creating interactive data visualizations appeared first on Microsoft Research.
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.