This paper introduces SAGE, Semantic Audio Generative Encoder: a compact variational autoencoder that shapes its latent by distilling embeddings from a pretrained audio-text model, combining high reconstruction fidelity, state-of-the-art semantic structure, and fast inference.
Francesco Brigante, Luca Cerovaz, Davide Marincione et al.· 0 citations
It is shown that neural network weights can be explicilty fintuned to admit a smaller grammar, and the first time grammar size has been used as an explicit training objective for network weights.
Irene Tallini, Daniele Solombrino, Alberto Cazzaniga et al.· 0 citations
Studying two independent testbeds (activation oracles and emergent-misaligned models) across three model families, it is found that the answer is threefold: merging preserves an emergent capability that both parents carry, but cannot create an emergent capability that is superadditive in its parents.
We show that a quantized model that keeps its classification accuracy still changes $14$ to $46\%$ of its top-1 retrieval results, and that aggregate ranking metrics reveal only part of this damage. We tie this failure to the gap between the two highest model scores and use that gap to decide when to trust a quantized...
Luca Zhou, Alessandro Zirilli, Daniele Solombrino et al.· 0 citations
This work introduces Homomorphic Encryption-Aware Training (HEAT), a fine-tuning method that makes the per-nonlinearity iteration counts learnable, enabling them and the model weights to co-adapt during training.
Alessandro Zirilli, Davide Marincione, E. Kornaropoulos et al.· 0 citations
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.