Preprint
Aug 2026
DEPT: Document Embedding Preservation Tuning for Unified Query Expansion and Retrieval
Document Embedding Preservation Tuning (DEPT) is introduced, which keeps tuned document embeddings close to cached initial embeddings while allowing retrieval gradients to pass through straight-through decoding into the generator.
Jingyuan Wang, Richong Zhang, Zhijie Nie et al.
· 0 citations