Randomized features provide a scalable approximation to kernel machines, but their performance depends strongly on the choice of feature distribution. We propose a particle-based method that learns this distribution by optimizing kernel-target alignment while regularizing particles with a Riesz/Coulomb repulsive potential. The resulting Hamiltonian yields diverse, task-adaptive random features and admits a mean-field description through a McKean--Vlasov equation. We instantiate the method in linearized Transformer attention by learning positive random-feature maps in a first alignment phase, then freezing the kernel and training the remaining network parameters with cross-entropy. Experiments on synthetic classification and sentence-level benchmarks show that learned kernelized attention can improve accuracy, calibration, and robustness for several feature maps while preserving linear-attention inference complexity.
M. B. Khuzani, Sharath Honnaiah, Atiq Islam et al.· 0 citations
Buyer intent in e-commerce is multi-faceted and is expressed through explicit attributes—such as brand, size, color, and material, rather than through general topical relevance. However, many state-of-the-art scalable query-product matching systems rely on aggregate representations, scoring a single query embedding against a single item embedding. While efficient, this aggregation frequently fails to satisfy individual attribute intent: items can be semantically related, yet violate key aspects specified in the query. In contrast, fine-grained interaction methods can better capture aspect-level constraints, but are typically too expensive due to increased run-time computation and storage costs. We propose an aspect-aware ranking framework that retrieves and resolves aspects in queries and performs fine-grained semantic affinity match against aspects in products to compute an aggregate query-product level aspect affinity score. The proposed approach integrates (i) query aspect resolution (canonicalization) using structured aspect data, (ii) a model to learn granular aspect affinity signal capturing individual aspect-level understanding; and iii) an efficient design for online serving, significantly cutting cost associated with inference speed and storage. This design preserves the scalability of two-tower retrieval while substantially improving explicit intent satisfaction. Experiments on large-scale e-commerce search data show that systematic modeling of aspect affinity on a high aspect-density query segment improves MRR by up to +0.70% over a strong production baseline. To our knowledge, this is among the first deployments of query–product aspect matching at broad aspect and category coverage in an industrial e-commerce search platform.
Amanuel Alambo, Sathappan Muthiah, Diego Sierra et al.· Annual International ACM SIG...· 0 citations
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.
