An SSD-native local MoE inference system that addresses challenges with an SSD I/O pipeline optimized for expert delivery, a native three-tier storage hierarchy that delivers and retains experts dynamically, and balanced CPU--GPU hybrid execution.
Fang-Zhou Liang, Yibin Shen, Jian-Min Hu et al.· 0 citations
A fine-tuned Small Language Model is fine-tuned with a hybrid ordinal regression loss combining a Mean Squared Error term, which preserves ordinal distance, with a categorical Cross-Entropy term, which sharpens class boundaries, which sharpens class boundaries.
Qi-Hang Wang, Jin-Wei Tan, Meng-Yuan Shi et al.· 0 citations
roseNNa is now a code generator. A model is lowered to Fortran 2008 or C11 with literal loop bounds, no runtime shape logic, no allocation and no mutable global state, so infer inlines into a solver's own compute kernel -- including a device kernel. The previous runtime library (fLibrary/) is retired. It parsed a model...
Ajay Bati, Spencer H. Bryngelson· Zenodo (CERN European Organi...· 0 citations
RankGround is a two-stage framework that achieves accurate GUI grounding with a single VLM call per query and achieves 1.4 times faster inference and improves localization accuracy by 5.5% on average over the second-best method across all backbones and screen scales, establishing a new state of the art in both efficien...
Li-Yang Fan, Xin-Ping Bi, Yi-Tai Li et al.· 0 citations
Reach audiences
Advertise in front of researchers, engineers, and readers.
Teochew has a substantial speaker community and exhibits distinctive lexical, syntactic, and pragmatic features, yet textual resources for evaluating large language models remain limited. We present TeochewBench, a human-reviewed benchmark comprising 300 Teochew Hanzi expressions for evaluating translation from Teochew...
We propose a compact NISQ-compatible quantum transformer architecture for synthetic QNLP sequence modelling. The model preserves the autoregressive next-token interface of a classical transformer, but replaces attention and feed-forward sublayers with variational quantum encoder blocks, connector circuits, decoder bloc...
Julian Hager, Michael Kölle, Gerhard Stenzel et al.· 0 citations
A metric interaction framework that models object-level and scene-level interactions in physical Cartesian space at a shared metric scale and improves diverse VLA and WAM baselines with a small number of additional parameters and training steps is introduced.
Li-Jie Wang, Zheng Lu, Yi-Ming Wang et al.· 0 citations
Large language models (LLMs) are increasingly deployed in applications involving interaction between agents, where their output plays a role in collective reasoning and decision-making processes. Despite significant research into the functioning of LLMs in such multi-agent systems, the processes of bias propagation in...
Omran Berjawi, G. Fenza, Rida Khatoun· 0 citations
We study the problem of demonstration selection, which involves selecting a subset of examples for prepending to a query to a language model. This problem is closely related to in-context learning and language model inference. Since the inference cost of a transformer model scales quadratically with sequence length, th...
Zi-Niu Zhang, Zhen-Shuo Zhang, Ruoxuan Xiong et al.· 0 citations
This paper proposes and analyzes Comparison-based Preference Optimization (ComPO), a zeroth-order alignment method based on comparison oracles, and establishes a convergence guarantee for its basic offline scheme under smoothness, gradient sparsity, and compatibility between the oracle and a latent objective.
Peter Chen, Xi Chen, Wo-Tao Yin et al.· 0 citations
This work introduces physical rank consistency (PRC) to measure how well tokenization preserves local physical distance rankings after reconstruction, and presents ActionPiece, which preserves physical action relationships through joint supervision of representation learning and quantization.
Shijie Lian, Bin Yu, Zhao-Long Shen et al.· 1 citation
These findings establish articulated rationales as a useful complement to behavioral and content signals, and demonstrate a practical role for MLLMs in scaling sparse human explanations into preference information that improves industrial recommendation.
Hao-Ke Xiao, Yue-Yang Liu, Yu-Hui Zhang et al.· 0 citations
StudentSim is a research system for evaluating and improving AI tutoring tools before they are tested with learners. It models how individuals may engage with tutors, giving feedback to improve tutor performance across subjects like chess, writing, and mathematics. The post Simulating student learning for better AI tutoring appeared first on Microsoft Research.