Author

Qi Han

h-index 6 View on Semantic Scholar

We have 6 of 14 papers

We haven’t gathered this author’s papers yet. Follow them and we’ll fetch their work.

Not the right person? Other researchers publish under this name.

Preprint Sep 2026

$\Phi$-Bench: Can Large Language Models Engineer the Infrastructure That Powers Them?

Large language models (LLMs) now show strong reasoning and coding abilities, raising the prospect that they could assist in developing and optimizing the very infrastructure that powers them. Existing benchmarks, however, mainly focus on isolated kernels, predefined operators, or pre-specified optimization targets, and...

Lei-Lei Ding, Shu-Min Wang, Yu-Ting Huang et al. · 2 citations · ⚡1

#natural language process... Preprint Oct 2026

Prefilling-dLLM v2: Learned Chunk Routing for Long-Context Diffusion Language Models

Diffusion language models apply bidirectional attention over the whole context at every denoising step, so a longer context makes each step substantially more expensive. Sparsifying only at inference leaves the pretrained weights unchanged, so the model is never trained under the sparse pattern it runs with. We propose...

Qi Han, Jing Xiong, Zi-Yuan Zhang et al. · 0 citations

#machine learning Preprint Sep 2026

onPanda: Efficient Annotation of On-Policy Alignment Data for LLMs and Agents via Token-Level Correction

We present onPanda, an interactive tool for efficiently annotating LLM alignment data and agent trajectories. onPanda adopts token-level correction as its core interaction: while reading a model response, the annotator locates the first inappropriate token and either picks a substitute from the model's candidate tokens...

Lei Yang, Meng-Yin Liu, Jia Wang et al. · 0 citations

#artificial intelligence Preprint Sep 2026

RideWay: Benchmarking Efficient Task Completion for Tool-Using Language Agents

RideWay makes interaction efficiency measurable alongside task success, while exposing the boundary of count-based tool-use evaluation, together with Efficiency Utility, a success-gated metric that discounts successful trajectories for excess tool calls and user-facing turns relative to task-specific reference effort.

Qi Han, Bohan Fang, Ming-Zhi Hou et al. · 2 citations

#natural language process... Preprint Sep 2026

$\Phi$-Bench: Can Large Language Models Engineer the Infrastructure That Powers Them?

This work presents $\Phi$-Bench, a benchmark for systematically evaluating LLMs on engineering the LLM infrastructure stack and spans tasks of varying complexity, ranging from localized kernel-level function completion to long-horizon implementation and end-to-end system optimization.

Lei-Lei Ding, Shu-Min Wang, Yu-Ting Huang et al. · 1 citation

#artificial intelligence Preprint Sep 2026

SWE-Test: Benchmarking LLM Vulnerability Discovery via Input Prediction

This work recasts vulnerability discovery as an input-prediction task with a closed, deterministic ground truth, and decomposes discovery into three task modes over 22 real-world C/C++ programs spanning 15 domains, finding constraint inference, not navigation, is the dominant bottleneck.

Yuan-Xiang Shi, Jia-Yi Lin, Xuan-Yong Lin et al. · 0 citations