Aug 2026· Proceedings of the 32nd ACM SIGKDD Conference on Knowledge Discovery and Data Mining V.2· pp. 13447-13448· 1 citation· 55 references
TL;DR
The Geometric Space, Architecture and Learning Objective for Large Pre-Trained Models (GALOP) workshop is an accepted half-day KDD 2026 workshop that examines how geometric principles can make large pretrained models more expressive, robust, interpretable, and efficient.
Abstract
Large pretrained models have reshaped artificial intelligence, yet their Euclidean design assumptions often limit their ability to model hierarchy, curvature, symmetry, and heterogeneous relations in real-world data. The Geometric Space, Architecture and Learning Objective for Large Pre-Trained Models (GALOP) workshop is an accepted half-day KDD 2026 workshop that examines how geometric principles can make large pretrained models more expressive, robust, interpretable, and efficient. The workshop is organized around three complementary themes: (1) Geometric Space, which studies non-Euclidean representation spaces such as hyperbolic, spherical, and mixed-curvature manifolds; (2) Geometric Architecture, which designs model architectures that respect data symmetries, manifold structure, and relational geometry; and (3) Geometric Learning Objective, which develops objectives and optimization methods that preserve distances, angles, curvature, and topology during training. Through two invited talks and four contributed talks, the workshop brings together researchers from machine learning, data mining, and related fields to advance geometrically-informed foundation models for language, vision, graphs, knowledge discovery, and scientific discovery.
This tutorial provides a comprehensive introduction to rotational equivariance, starting from the physical and geometric intuition behind coordinate independence and building up the necessary machinery from geometric deep learning, group theory, and representation theory.
MoLiegroup is introduced, a framework that embeds multiple Lie-group priors as specialized kernel experts and adaptively fuses them via a geometry-aware gating mechanism to learn equivariance-inspired geometric features and supplies a practical, architecture-agnostic geometric inductive bias that improves expressivity...
Yao-Xian Yang, Guipeng Lan, Shuai Xiao et al.· IEEE Transactions on Neural...· 0 citations
The hyperbolic Res-MLP (HR-MLP), an architecture extending the attention-free MLP to a non-Euclidean space and enabling direct hyperbolic operations with fewer parameters, facilitating faster training and superior performance compared to Euclidean counterparts is introduced.
The results give an empirical separation, on a real hierarchical-classification problem, between two natural latent geometries for a class-structured regularizer.
Training Transformer-based architectures with finite data augmentation has become an increasingly popular approach in geometric machine learning. Despite its empirical success, the interplay between the Transformer architecture, invariance to different symmetries, and augmentation budgets remains underexplored. In this...
Eduardo Santos-Escriche, Valerie Engelmayer, Y. Lin et al.· 0 citations
3D instance segmentation requires fine-grained geometric discrimination together with an effective representation of the hierarchical organization of real-world objects and scenes. Conventional transformer architectures, however, operate predominantly in Euclidean space, whose polynomial volume growth can be poorly mat...
Xiao-Yu Wei, A. Konushin· Neural Networks· 0 citations
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.