QK-MAP, a Magnitude-Aware Projection for constructing queries and keys, transforms the input representation using multiple learnable frequencies, so that changes in magnitude are encoded as bounded phase patterns rather than vector length alone.
Yong-Ding Tao, Yi-Tong Qiao, Tian-Qi Shao et al.· 0 citations
Two expert pruning methods are proposed under the unified structure-preserving framework: Projection Energy Expert Pruning (PEEP), which preserves the functional subspace by maximizing weighted projection energy, and Distributional Coverage Expert Pruning (DCEP), which preserves the distributional geometry by minimizin...
Tian Wang, Yong-Ding Tao, Yihong Dong et al.· 0 citations
Vision-language models can get individual judgments right while struggling to recover and consistently use the exact properties of a 3D object. To characterize this gap, we introduce BedBench, a controlled benchmark of thirteen procedurally generated tasks spanning individual judgments and composite answers. Across twe...
Khai Le-Duc, Nguyen Kim Hai Bui, An Ngo et al.· 1 citation
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.