Skip to content

Author

Xiao-Jie Wang

2 papers indexed here

We haven’t gathered this author’s papers yet. Follow them and we’ll fetch their work.

Not the right person? Other researchers publish under this name.

GSM: Efficient Language Modeling with Shared Global State

The Global State Model (GSM), a causal encoder--decoder architecture that concentrates the selection and aggregation of long-range information in the encoding stage, is introduced, offering a shared-state architecture for efficient language modeling.

Yun Zheng, Bin Wen, Xiao-Jie Wang et al. · 0 citations
#natural language process... Preprint Sep 2026

Lngram v2: Latent N-Gram Memory with Interpretable Discrete Representations

Analysis shows that Lngram v2 substantially reduces both total and activated memory parameters while maintaining or improving language modeling performance, and shows that its discrete IDs preserve substantial semantic structure of continuous hidden states, enabling semantic recovery from IDs alone and stable ID--seman...

Yun Zheng, Bin Wen, Xiao-Jie Wang et al. · 0 citations

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.