Skip to content
Log in
Sponsored AI Networking Cookbook: Practical recipes for AI-assisted network automation and development AI Networking Cookbook: Practical recipes for AI-assisted network automation and development

Author

Donghui Yang

View on Semantic Scholar

2 papers indexed here

We haven’t gathered this author’s papers yet. Follow them and we’ll fetch their work.

Not the right person? Other researchers publish under this name.

#large language models Open access Sep 2026

Full-Layer Memory Injection via Compile-Time Key-Value Caches: An External-Knowledge Mechanism for Small-Parameter Language Models

Knowledge of large language models (LLMs) is frozen in parameters after pretraining and hard to update at low cost. This paper proposes a full-layer memory injection method based on compile-time key-value (KV) caches. Experiments on Qwen3-0.6B show full-layer token-level KV injection raises private-specification QA score from 0.079 to 0.621, exceeding the text prefix (0.571); sparse or pooled injection degenerates to baseline. Cross-scale validation on Qwen3.8-27B (hybrid, 16/64 full-attention layers) raises 0.133 to 0.642. Full data and code are provided.

Donghui Yang · 0 citations
#large language models Open access Sep 2026

Full-Layer Memory Injection via Compile-Time Key-Value Caches: An External-Knowledge Mechanism for Small-Parameter Language Models

Knowledge of large language models (LLMs) is frozen in parameters after pretraining and hard to update at low cost. This paper proposes a full-layer memory injection method based on compile-time key-value (KV) caches. Experiments on Qwen3-0.6B show full-layer token-level KV injection raises private-specification QA score from 0.079 to 0.621, exceeding the text prefix (0.571); sparse or pooled injection degenerates to baseline. Cross-scale validation on Qwen3.8-27B (hybrid, 16/64 full-attention layers) raises 0.133 to 0.642. Full data and code are provided.

Donghui Yang · 0 citations

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.