Skip to content
Book Open access

Geometric Space, Architecture and Learning Objective for Large Pre-Trained Models

Aug 2026 · Proceedings of the 32nd ACM SIGKDD Conference on Knowledge Discovery and Data Mining V.2 · pp. 13447-13448 · 1 citation · 55 references

TL;DR

The Geometric Space, Architecture and Learning Objective for Large Pre-Trained Models (GALOP) workshop is an accepted half-day KDD 2026 workshop that examines how geometric principles can make large pretrained models more expressive, robust, interpretable, and efficient.

Abstract

Large pretrained models have reshaped artificial intelligence, yet their Euclidean design assumptions often limit their ability to model hierarchy, curvature, symmetry, and heterogeneous relations in real-world data. The Geometric Space, Architecture and Learning Objective for Large Pre-Trained Models (GALOP) workshop is an accepted half-day KDD 2026 workshop that examines how geometric principles can make large pretrained models more expressive, robust, interpretable, and efficient. The workshop is organized around three complementary themes: (1) Geometric Space, which studies non-Euclidean representation spaces such as hyperbolic, spherical, and mixed-curvature manifolds; (2) Geometric Architecture, which designs model architectures that respect data symmetries, manifold structure, and relational geometry; and (3) Geometric Learning Objective, which develops objectives and optimization methods that preserve distances, angles, curvature, and topology during training. Through two invited talks and four contributed talks, the workshop brings together researchers from machine learning, data mining, and related fields to advance geometrically-informed foundation models for language, vision, graphs, knowledge discovery, and scientific discovery.

Read PDF

Similar papers

#machine learning Review Aug 2026

Rotational Equivariance in Machine Learning: A Comprehensive Tutorial

This tutorial provides a comprehensive introduction to rotational equivariance, starting from the physical and geometric intuition behind coordinate independence and building up the necessary machinery from geometric deep learning, group theory, and representation theory.

Peter Lippmann, Fred A. Hamprecht · 0 citations
Open access Sep 2026

Mixture of Lie-Group Kernels for Equivariance-Inspired Feature Learning.

MoLiegroup is introduced, a framework that embeds multiple Lie-group priors as specialized kernel experts and adaptively fuses them via a geometry-aware gating mechanism to learn equivariance-inspired geometric features and supplies a practical, architecture-agnostic geometric inductive bias that improves expressivity...

Yao-Xian Yang, Guipeng Lan, Shuai Xiao et al. · 0 citations

Efficient Hyperbolic Perceptron for Image Classification

The hyperbolic Res-MLP (HR-MLP), an architecture extending the attention-free MLP to a non-Euclidean space and enabling direct hyperbolic operations with fewer parameters, facilitating faster training and superior performance compared to Euclidean counterparts is introduced.

A. O. Ahsan, Susanna Tang, Wei Peng · 0 citations
#machine learning Preprint Oct 2026

How Do Transformers Learn to Represent Symmetries?

Training Transformer-based architectures with finite data augmentation has become an increasingly popular approach in geometric machine learning. Despite its empirical success, the interplay between the Transformer architecture, invariance to different symmetries, and augmentation budgets remains underexplored. In this...

Eduardo Santos-Escriche, Valerie Engelmayer, Y. Lin et al. · 0 citations
Sep 2026

HieFormer: Leveraging hyperbolic geometry to overcome the hierarchical expressiveness limitation of transformers.

3D instance segmentation requires fine-grained geometric discrimination together with an effective representation of the hierarchical organization of real-world objects and scenes. Conventional transformer architectures, however, operate predominantly in Euclidean space, whose polynomial volume growth can be poorly mat...

Xiao-Yu Wei, A. Konushin · 0 citations

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.