Tiny Transformers for Online Processing of Sensor Data Streams on Low Power MCUs

The presentation discusses the design, training  and deployment of lightweight energy efficient algorithms derived from vision transformers exploited for the real-time analysis of sensor data streams. The capabilities of the presented approach are assessed on decoding and classification tasks involving biosignals. The algorithms are executed on several parallel MCU for IoT-node development.