Sensor fusion that consumes less energy, experiences less delay and achieves more precision needs hardware that’s tailored to its needs.
Many applications that could profit from automated vision and sensing are lightweight and operate on a tiny energy budget. Still, they should be highly reliable and safe to operate. Think of drones that need to function under all circumstances.
A low energy budget and complex sensor fusion are hard to combine with today’s technology. To overcome this, imec develops spiking neural networks (SNN).
Spiking neural networks mimic the way groups of biological neurons operate. They integrate sparse and asynchronous binary signals that for instance only fire when the sensory input surpasses a threshold.
It’s an approach that has considerable benefits:
Today and in order to connect sensors to the underlying AI, the continuous feed still needs to be translated into frames. This limits the efficiency. That’s why imec is also investigating how the spiking concept can be implemented end-to-end, from the cameras and sensors to the AI engine.
We are pioneering this approach, with promising results. Addressing that many requirements in an SNN chip has never been done before.
Want to explore the possibilities of this new generation of neuromorphic hardware?
We invite all interested technology companies – including OEMs in automotive and robotics – to enter our exploration of spiking neural networks. As partner in our R&D program, you’ll position yourself ahead of the curve.