TPR-Attention for Combinatorial Generalization
This work introduces a new architectural component that embeds structured inductive bias into deep learning: an attention mechanism operating over tensor-product representations (TPRs) that outperforms existing architectural components in combinatorial generalization.
Melisa Civelekoğlu, Isabeau Prémont-Schwarz
· 0 citations