Results show that effective memory can be realized through a compact online state directly coupled with attention computation, without full fine-tuning, backbone replacement, or explicit context extension.
Jing-Di Lei, Di Zhang, Junxian Li et al.· arXiv.org· 10 citations
This work proposes $\delta$-Vision, which replaces repeated Transformer evolution of visual tokens with lightweight low-rank adapters that construct layer-wise visual memories while preserving all visual tokens for text retrieval, and achieves higher accuracy than visual token pruning baselines at comparable or lower c...
Jing-Di Lei, Junxian Li, Di Zhang et al.· 0 citations
MolReFlect is proposed, a novel teacher-student framework, where a teacher LLM first generates and refines mappings between caption phrases and SMILES substructures and then explicitly teaches these detailed alignments to a student LLM, enabling LLMs to significantly outperform previous baselines.
Jiatong Li, Yunqing Liu, Wei Liu et al.· IEEE Transactions on Knowled...· 13 citations
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.