embedded systems designers

Abstract: Biological visual systems achieve continuous, low-latency motion perception by processing sparse, asynchronous spiking signals, enabling real-time tracking under strict energy constraints. Event-based cameras, inspired by the mammalian retina, replicate this efficiency by capturing only local brightness changes as asynchronous events, offering a natural substrate for spiking neural networks (SNNs) to parallelise computation and adapt to fast-changing scenes. Pinball provides a controlled yet dynamic testbed, requiring precise motion estimation and fast reaction to a small, rapidly moving target. This work presents a fully spiking, real-time perception-to-action pipeline for closed-loop pinball gameplay. A dynamic vision sensor observes a small, fast-moving ball, and a network of spiking Time-Difference Encoders on the SpiNNaker neuromorphic platform jointly estimates its position, speed, and direction. The system is characterised across receptive field size, accumulation window, and angular tuning width for real-time operation, and benchmarked in closed loop against human players across two flipper regimes of increasing physical realism. It achieves a hit rate of 56.1%, nearly double the human average, reacting within 21.7 ms (5 ms network latency) and consuming an estimated 148 μW using fewer than 25k neurons, among the fastest and most energy-efficient event-based closed-loop demonstrators benchmarked. Under more realistic flipper dynamics, tuning a single interpretable policy parameter reproduces the full spectrum of human play styles, from cautious to aggressive, with no change to the perception pipeline. A physical demonstrator, tracking a real ball and actuating real flippers in closed loop, confirms the principle operates beyond simulation. Its fully spiking, learning-free design offers a compact, energy-efficient example of real-time neuromorphic perception-to-action.

Abstract: Hyperdimensional computing (HDC) is a computing framework that represents information as high-dimensional pseudorandom vectors called hypervectors (HVs), enabling learning and inference through simple algebraic operations. The HV dimensionality provides computational capacity and error robustness, but the required high-dimensional randomness must be stored or regenerated, imposing a memory--computation tradeoff. Here, we address this tradeoff by physically embodying the randomness required for HV generation in the static disorder of a scattering medium. Specifically, a silicon photonic circuit combined with the scattering medium generates high-dimensional HVs from a small number of input values in a single optical shot. Detector-side encoding programs HV correlations for continuous and categorical representations. The resulting HVs reproduce key statistical and compositional properties of ideal i.i.d.\ random HVs, including pairwise similarity statistics, associative-memory capacity, and factorization capacity. We further demonstrate an optically assisted inference path using the generated HVs and optical similarity evaluation.