Skip to content
Conference Open access

Mixture-of-Experts-based Entropy Model for Learned Image Compression

Aug 2026 · International Conference on Information Photonics · Vol abs/2608.10947, pp. 1-6 · 1 citation · 40 references
Computer Science

TL;DR

This paper proposes a MoE-based Entropy model (MoEE) for learned image compression, allowing the model to selectively activate only the subset of parameters required for the input image.

Abstract

Learned image compression has seen significant progress in recent years with the development of end-to-end learned models that achieve better compression efficiency than state-of-the-art conventional methods. Recently, Mixture of Experts (MoE) approaches have seen promising results in NLP and computer vision tasks. In this paper, we introduce the MoE approach to learned image compression. We propose a MoE-based Entropy model (MoEE) for learned image compression, allowing the model to selectively activate only the subset of parameters required for the input image. Our model achieves a BD-Rate improvement over VVC of -16.85% on the Kodak dataset.

Read PDF

Similar papers

Preprint Nov 2026

Joint Activation and Weight Quantization for Learned Image Compression

Learned image compression (LIC) models achieve competitive rate-distortion performance with increasingly large networks, making network quantization important for efficient deployment. Directly quantizing LIC models remains difficult in post-training quantization (PTQ) because compression performance is highly sensitiv...

Yi-Le Tu, He-Ming Sun · 0 citations
Preprint Oct 2026

SCOPE: Semantic COdec Pre-Editing for Object-Preserving Compression

SCOPE (Semantic COdec Pre-Editing), a conditional image pre-editor that modifies images before compression to improve the bitrate and detection accuracy trade-off, and shows consistent gains across different codec families and detector architectures.

Silvia Dani, Leonardo Galteri, Marco Bertini · 0 citations
Preprint Nov 2026

Noise-Regularized Training for Learned Image Compression

Learned image compression (LIC) is trained almost exclusively on clean images: the only stochastic perturbation in the loop is an additive uniform proxy injected in the latent domain to keep the entropy model differentiable. Outside compression, by contrast, a long line of work---from Tikhonov regularization and contra...

Ren-Jie Zou, Zhi-Wei Huang, Dong-Jin Jiang · 0 citations
#machine learning Review Sep 2026

An Introduction to Compression-Based Machine Learning

This work introduces and empirically validate a design framework for compression-based ML, finding compression-based methods competitive with conventional baselines and decisively stronger on malware.

John Hurwitz, Edward Raff, Charles Nicholas · 0 citations
Conference Open access Sep 2026

HaRP-ViT: Hadamard Rotation for Low-Bit Vision Transformer Post-Training Quantization

HaRP-ViT (Hadamard Rotation for Post-Training Quantization of Vision Transformers), a training-free randomized Hadamard transform applied exclusively after the GELU activation is proposed, making the post-GELU tensor better suited to standard per-tensor uniform quantization.

Mustafa Ibrahim Aksu, F. Ş. Torun · 0 citations
Oct 2026

Learned Image Coding With Generative Reference of Conditional Latents.

This paper presents a learned image compression framework that exploits semantically correlated external images as conditional coding references in the latent domain. Three reference generation methods are investigated: local dictionary retrieval, web-based image search, and diffusion-based image-text-image generation....

Si-Qi Wu, Yin-Da Chen, Wei-Ming Chen et al. · 0 citations

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.