Skip to content

Author

Qi Zhang

We have 6 of 92 papers

We haven’t gathered this author’s papers yet. Follow them and we’ll fetch their work.

Not the right person? Other researchers publish under this name.

#natural language process... Preprint Oct 2026

Byte Language Models: Scaling, Emergent Abstractions, and Information Allocation

Tokenizer-free language models remove the inductive bias of fixed tokenizers by modeling text directly as bytes, but the resulting longer sequences substantially increase computation and eliminate explicit text abstractions. We ask whether this additional computation can be useful, and whether standard Transformers can...

Jie Wang, Shi-Wei Luo, Qi Zhang et al. · 0 citations
Preprint Aug 2026

A Token-Level Analysis of Sampled-Token Reverse-KL On-Policy Distillation

On-policy distillation (OPD) supervises a student on its own trajectories with token-level signals from a frozen teacher, yet how a sampled loss allocates updates across tokens remains poorly understood. We analyze the gradient of the per-token K2 estimator of reverse KL with respect to the student logits. The $\ell_1$...

Bing Shao, Jia-Zheng Zhang, Long Ma et al. · 5 citations
Preprint Aug 2026

State-Conditioned Visual Evidence Retrieval for Fine-Grained Perception in Document Vision-Language Models

Experiments on document parsing benchmarks show that SCVER improves robustness under reduced input resolution and achieves a better accuracy-efficiency trade-off, demonstrating the effectiveness of on-demand visual evidence retrieval for fine-grained perception.

Ming-Xu Chai, Chen-Yu Liu, Zi-Yu Shen et al. · 0 citations

Prefix-Adaptive Block Diffusion for Efficient Document Recognition

The Prefix-Adaptive Block Diffusion Model (PA-BDM) is proposed, which replaces intra-block bidirectional denoising with causal denoising from prefix to suffix and treats the block size as a maximum candidate range rather than a fixed commitment unit.

Ming-Xu Chai, Zi-Yu Shen, Chen-Yu Liu et al. · 0 citations
Conference Open access 2026

Counteracting the Matthew Effect in Self-Improvement of LVLMs through Head-Tail Re-balancing

To mitigate a critical imbalance during the exploration-and-learning process, this work approaches head-tail re-balance during the exploration-and-learning process from two perspectives: distribution-reshaping and trajectory-resampling.

Xin Guo, Zhiheng Xi, Yiwen Ding et al. · 1 citation
Conference Open access Jul 2026

AgentGym2: Benchmarking Large Language Model Agents in De-Idealized Real-World Environments

AgentGym2 is presented, a new evaluation framework with task instances grounded in real-world end-to-end working demands that measures agents'ability to execute end-to-end procedures, discover tools via exploration, compose tools for unseen tasks, and remain robust to noisy and underspecified information.

Zhiheng Xi, Dingwen Yang, Jiaqi Liu et al. · 1 citation

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.