| Project Detail |
Synaptic plasticity and ‘cognition’ in nanonetworks of memristive and spintronic components
Artificial intelligence (??) is transforming the way machines ‘think’ thanks to software and algorithms that respond intelligently and adaptively to problems as they arise, often making decisions in real time and learning from the past. One step closer to human brain function are physical systems – hardware rather than software – that mimic neurons and synapses and their behaviours, either individually or collectively. The EU-funded Grenadyn project is developing just such systems from memristive and spintronic nanocomponents capable of reorganising themselves dynamically and learning without supervision. The end goal is to demonstrate a chip integrating nanosynaptic devices on CMOS that achieves pattern recognition rates on par with AI.
The Grenadyn project will demonstrate that assemblies of imperfect, dynamical nanodevices can self-learn through physical principles, like biological neurons and synapses do, with performance comparable to the best artificial intelligence (AI) algorithms. For this, Grenadyn’s networks will minimize their effective energy together with the recognition error when learning.
The starting point of Grenadyn is an algorithm called Equilibrium Propagation, developed by AI pioneer Yoshua Bengio, that takes its roots in physics. We will assemble memristive as well as spintronic nanocomponents in neural networks that perform pattern recognition through Equilibrium Propagation. We will show that these dynamical networks learn by nudging their outputs towards the desired solution through a spring-like force, and letting nano-synapses and neurons reorganize themselves towards equilibrium. We will show that they can also learn directly from the data, without supervision.
We will induce a high resilience to imperfections in these networks through self-adaptation and digitization. We will demonstrate by experiments and simulations that our physical neural networks made of variable elements compute with an accuracy similar to software neural networks trained with backpropagation. We will produce a chip integrating nanosynaptic devices on CMOS and achieve state-of-the-art recognition rates on AI image benchmarks.
We will enhance the network functionalities by leveraging their dynamical properties through synchronization and time-delayed feedback. Finally, we extend Grenadyn’s in-materio self-learning to any assembly of coupled dynamical nanodevices, providing novel horizons for multifunctional materials and devices.
Grenadyn’s scientific advances in condensed-matter physics, non-linear dynamics, electronics, and AI will give the foundations for deep network chips that contain billions of nano-synapses and nano-neurons and self-learn with state-of-the-art accuracy. |
