This work introduces a modular and scalable architecture called ODEONN that is generic to multiple applications of ONNs, and to the best of the knowledge, is the first fully digital ONN to also support complex-valued coupling.
Abstract
Oscillatory Neural Networks (ONNs) are an alternative computing paradigm for AI and combinatorial optimization problems. However, digital architectures are often designed for specific applications of ONNs. This work introduces a modular and scalable architecture called ODEONN that is generic to multiple applications of ONNs, and to the best of our knowledge, is the first fully digital ONN to also support complex-valued coupling. Additionally, an approximation of the sine function is introduced that uses half of the hardware resources compared to standard methods. The performance of ODEONN is compared with a full-precision software simulation, where a performance degradation of less than $2\%$ is shown. Therefore, we conclude that the fixed-point quantization and the approximated waveform affect the accuracy of computation by only a small amount. Furthermore, ODEONN shows a 45$\times$ reduction in energy-delay product over the software simulation running on conventional hardware.
It is shown that multi-bit packets, rather than spikes, are the most efficient communication strategy in packet-switched networks and that compared to basic numerical integration methods, higher-order differential equation solvers decrease both computation and communication costs while achieving lower numerical error,...
Jakob Jordan, Ole Richter, Cong Li et al.· 0 citations
In recent years, both academia and industry have focused on the development of computational architectures inspired by the distributed, adaptive, and event-driven characteristics of biological neural systems, with the aim of reducing the computational cost associated with conventional training approaches [1]. However,...
Simulation is central to modern engineering and science, but the cost of numerical solvers for partial differential equations (PDEs) remains a bottleneck whenever fast or many-query evaluations are required. Neural emulators trained on solver-generated data promise significant speedups, yet they are usually framed as o...
Though an eminent performance of Artificial Intelligence (AI) is expected to be applied in various technological fields, its high energy consumption is still an issue to be solved for the sustainable implementation of AI into our society. The analog implemented neural networks are promising alternative computation devi...
Ryosei Okubo, Y. Mitsuya, Hiroyuki Takahashi· Frontiers in Neuroscience· 0 citations
An approach is presented which proposes the embedding of a neural network based architecture as a substitute for the state function of an ODE into established Runge–Kutta based integration method.
Timo Bielitz, Dieter Bestle· Proceedings in Applied Mathe...· 0 citations
SpiKFAX is proposed, a second-order optimization method that formulates a computationally tractable, Kronecker-factored approximation of the Fisher information matrix specifically adapted to the structure of SNNs.
Ngoc Phu Doan, Ihsen Alouani· 0 citations
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.