Reinforcement-Learning-Based Energy Management for a Range-Extended Distributed-Drive Tracked Combine Harvester in Hilly Terrain

Abstract

Farmland in the hilly and mountainous regions of southern China is characterized by complex terrain and highly variable operating loads. Conventional diesel-powered tracked harvesters are constrained by high crop losses, excessive impurity rates, frequent blockages, and low overall energy-use efficiency. Distributed electric drive provides a promising solution; however, threshing cylinder blockage, high-frequency load transients, and slope operation make it difficult for conventional energy-management strategies to simultaneously ensure dynamic responses, fuel economy, and battery state of charge (SOC) stability. This study therefore proposes a deep deterministic policy gradient (DDPG)-based reinforcement learning energy-management strategy (RL-EMS) for a range-extended, distributed-drive hybrid tracked combine harvester. First, a full-vehicle dynamic model incorporating eight electric-drive units and strong electromechanical coupling is established. Second, power allocation is formulated as a Markov decision process (MDP), with a multi-objective reward function that accounts for fuel consumption, SOC tracking, and boundary violations; the load-rate-of-change is introduced as a feedforward state. Finally, a supervisory physical layer comprising feasible power projection, safety filtering, and rate limiting is inserted between the policy network output and the physical plant so that the executed command satisfies range extender power, battery SOC, current, and power-slew constraints. Under the standard 1000 s cycle, SOC-corrected energy-equivalent comparison shows that the RL-EMS reduces fuel consumption by 1.5% relative to the adaptive equivalent consumption minimization strategy (A-ECMS) and by 26.6% relative to the constant-torque energy-management strategy (CT-EMS). Under an unseen complex random cycle, the RL-EMS reduces fuel consumption by 5.1% relative to A-ECMS. It also suppresses DC-bus voltage sag during a threshing cylinder blockage transient, demonstrating favorable electromechanical transient response. The proposed method provides a modeling and control reference for the intelligent energy management of range-extended, distributed-drive agricultural machinery.