REIGN: Refurbished Embeddings with Integrated Guidance Networks for Efficient Context-Length Scaling
This work proposes REIGN (Refurbished Embeddings with Integrated Guidance Networks), a contrastively trained bi-encoder that operates on sequences of contextualised chunk embeddings from a frozen Guidance Network rather than on raw tokens for document-to-document retrieval.
Devrim Cavusoglu, Emre Akbas
· 0 citations