Skip to content
Preprint

MPFlow: Learning Budgeted Max-Flow Optimization on the Lightning Network with Deep Graph Reinforcement Learning

Jul 2026 · 0 citations · 27 references
Computer Science

TL;DR

This lightweight agent combines a message-passing policy network with proximal policy optimization (PPO) and action masking, and is trained under a hub-exclusion curriculum, forcing the policy to learn capacity-aware placement rather than hub attachment.

Abstract

We address liquidity placement in the Bitcoin Lightning Network (LN): given a fixed budget, which channels should a node open to maximize its routing capacity? We cast this as a budget-constrained combinatorial optimization problem on graphs, selecting $k$ edge additions that maximize $s$--$t$ max-flow, a theory-grounded measure of routing capacity, and solve it with graph reinforcement learning. Our lightweight agent combines a message-passing policy network with proximal policy optimization (PPO) and action masking, and is trained under a hub-exclusion curriculum: the network's top hubs are removed from training subgraphs, forcing the policy to learn capacity-aware placement rather than hub attachment. In extensive experiments on real Lightning Network snapshots, our method consistently outperforms strong heuristic baselines on the max-flow objective across multiple seeds and unseen graphs. The agent has been deployed in production for peer recommendations, executing 4640 channel-open decisions that cumulatively allocate 267.3 BTC over $16 million across 30 managed nodes.

View source

Similar papers

Preprint Aug 2026

TANGCO: Learning Topology-Aware Capacity Allocation for Overload-driven Cascading Failures

This work introduces TANGCO (Topology-Aware Neural Graph-Guided Capacity Optimization), which uses a graph neural network policy trained through the cascade simulator with policy-gradient learning and a heuristic anchor to allocate a fixed capacity budget across nodes to resist cascades under local load redistribution.

Orkun İrsoy, L. Akoglu, Osman Yağan · 0 citations
Jul 2026

Learning to Optimize: Joint Routing and Flow Allocation on Sparse Non-Euclidean Networks

This work proposes Double-Channel Graph Attention (DCGA), an end-to-end reinforcement learning framework that isolates network reachability and demand-service logic into separate graph channels and constructs valid routes using a simulator-coupled, constraint-informed decoder.

Hao Sun, Fang He, Congyuan Ji et al. · 0 citations
Open access Aug 2026

Application of Reinforcement Learning for Optimizing the Capacitated Vehicle Routing Problem

This study proposes a reinforcement learning (RL) framework for solving the deterministic single-depot Capacitated Vehicle Routing Problem (CVRP). The Capacitated Vehicle Routing Problem is formulated as a Markov Decision Process and a REINFORCE agent with a linear-softmax policy, incorporating Clarke-Wright savings features, is trained as a proof-of-concept prior to future deep architectures such as Deep Q-Network and Proximal Policy Optimization. The proposed agent is trained and evaluated on three reproducible synthetic benchmark datasets comprising 20, 50, and 100 customers, and its performance is compared with two conventional construction methods, namely Nearest Neighbor and Clarke-Wright Savings. The results show that the learned policy consistently converges to a stable routing strategy and outperforms the Nearest Neighbor heuristic on the medium- and large-scale instances, reducing total travel distance by 8.3% and 10.0% respectively, while remaining within 13.8-20.8% of the Clarke-Wright benchmark across all scenarios. Inference is completed within milliseconds once training is finished, indicating that the learned policy can be reused across new routing instances without restarting the optimization process. These findings demonstrate that reinforcement learning is a promising and scalable alternative to conventional heuristic and metaheuristic approaches for capacitated routing problems, particularly in dynamic logistics environments that require rapid and adaptive decision making.

Audrey Ariij Sya'imaa HS, Muhamad Rizky Aulia, Siti Hadiaty Yuningsih · 0 citations
Aug 2026

Bidirectional job-shop scheduling with graph-theoretic features: a graph attention network and proximal policy optimization approach

A novel DRL-based approach that integrates bidirectional scheduling with graph-theoretic features to effectively solve JSSP is introduced, which achieves superior performance compared to traditional heuristics and classic DRL methods, while maintaining competitive results against recent state-of-the-art approaches.

Nanfeng Ma, Xi-Fan Yao, Kun Hu · 0 citations
Open access Jul 2026

GraphRoute-Transfer: Topology-Generalizable Routing Convergence Optimization via Graph Reinforcement Learning

GraphRoute-Transfer, a graph-neural-network policy that assigns per-node timers from local structural features and is by construction permutation- and size-invariant, is proposed, a graph-neural-network policy that assigns per-node timers from local structural features and is by construction permutation- and size-invariant.

Yuto Nakamura · 0 citations

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.