Fast and Scalable Caputo Fractional Gradient Descent via Perturbation-Preserving Memory Compression
Fractional gradient descent (FGD) incorporates long-range memory through Caputo-type operators and has been shown to improve stability in ill-conditioned and nonconvex optimization problems. Despite these advantages, its practical use remains limited, mainly due to the high computational cost of evaluating history-depe...