This lightweight agent combines a message-passing policy network with proximal policy optimization (PPO) and action masking, and is trained under a hub-exclusion curriculum, forcing the policy to learn capacity-aware placement rather than hub attachment.
Abstract
We address liquidity placement in the Bitcoin Lightning Network (LN): given a fixed budget, which channels should a node open to maximize its routing capacity? We cast this as a budget-constrained combinatorial optimization problem on graphs, selecting $k$ edge additions that maximize $s$--$t$ max-flow, a theory-grounded measure of routing capacity, and solve it with graph reinforcement learning. Our lightweight agent combines a message-passing policy network with proximal policy optimization (PPO) and action masking, and is trained under a hub-exclusion curriculum: the network's top hubs are removed from training subgraphs, forcing the policy to learn capacity-aware placement rather than hub attachment. In extensive experiments on real Lightning Network snapshots, our method consistently outperforms strong heuristic baselines on the max-flow objective across multiple seeds and unseen graphs. The agent has been deployed in production for peer recommendations, executing 4640 channel-open decisions that cumulatively allocate 267.3 BTC over $16 million across 30 managed nodes.
This work introduces TANGCO (Topology-Aware Neural Graph-Guided Capacity Optimization), which uses a graph neural network policy trained through the cascade simulator with policy-gradient learning and a heuristic anchor to allocate a fixed capacity budget across nodes to resist cascades under local load redistribution.
This work proposes Double-Channel Graph Attention (DCGA), an end-to-end reinforcement learning framework that isolates network reachability and demand-service logic into separate graph channels and constructs valid routes using a simulator-coupled, constraint-informed decoder.
Hao Sun, Fang He, Congyuan Ji et al.· arXiv.org· 0 citations
This study proposes a reinforcement learning (RL) framework for solving the deterministic single-depot Capacitated Vehicle Routing Problem (CVRP). The Capacitated Vehicle Routing Problem is formulated as a Markov Decision Process and a REINFORCE agent with a linear-softmax policy, incorporating Clarke-Wright savings features, is trained as a proof-of-concept prior to future deep architectures such as Deep Q-Network and Proximal Policy Optimization. The proposed agent is trained and evaluated on three reproducible synthetic benchmark datasets comprising 20, 50, and 100 customers, and its performance is compared with two conventional construction methods, namely Nearest Neighbor and Clarke-Wright Savings. The results show that the learned policy consistently converges to a stable routing strategy and outperforms the Nearest Neighbor heuristic on the medium- and large-scale instances, reducing total travel distance by 8.3% and 10.0% respectively, while remaining within 13.8-20.8% of the Clarke-Wright benchmark across all scenarios. Inference is completed within milliseconds once training is finished, indicating that the learned policy can be reused across new routing instances without restarting the optimization process. These findings demonstrate that reinforcement learning is a promising and scalable alternative to conventional heuristic and metaheuristic approaches for capacitated routing problems, particularly in dynamic logistics environments that require rapid and adaptive decision making.
Audrey Ariij Sya'imaa HS, Muhamad Rizky Aulia, Siti Hadiaty Yuningsih· International Journal of Mat...· 0 citations
A novel DRL-based approach that integrates bidirectional scheduling with graph-theoretic features to effectively solve JSSP is introduced, which achieves superior performance compared to traditional heuristics and classic DRL methods, while maintaining competitive results against recent state-of-the-art approaches.
GraphRoute-Transfer, a graph-neural-network policy that assigns per-node timers from local structural features and is by construction permutation- and size-invariant, is proposed, a graph-neural-network policy that assigns per-node timers from local structural features and is by construction permutation- and size-invariant.
Yuto Nakamura· Journal of Computing and Ele...· 0 citations
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.