Mixed signal design uses capacitor memory for event camera segmentation
EventSpikeSeg: Memory-Aware Mixed-Signal Architecture for Event-Camera Spiking Segmentation
Hardware ArchitectureComputer Vision and Pattern RecognitionNeural and Evolutionary Computing
Summary
Event cameras capture changes in a scene as events, which are sparse and require memory to interpret over time. The authors introduce EventSpikeSeg, a new hardware design that uses a mix of analog and digital circuits with capacitor memory to process these event streams more efficiently. Their design is tested through simulations that estimate power use and accuracy, showing promise but not yet demonstrating a fully working physical system. This work focuses on how to organize memory and computation for event camera segmentation in embedded hardware.
What this means in practice
- •For embedded system engineers: Design low-power hardware for real-time image segmentation from event cameras using mixed analog-digital memory architectures.
- •For robotic perception teams: Develop efficient event-based vision modules that balance memory and computation for segmentation tasks in embedded robotic systems.
Authors
Amir Mohammad Khadem Hosseini, Sattar Mirzakuchaki
Abstract
Event-camera segmentation requires persistent neural state despite sparse input events, making memory organization a central constraint on embedded implementation. We present EventSpikeSeg, a mixed-signal architecture combining resident capacitor memory with shared analog processing in GF180MCU 180-nm CMOS. Its 25-population spiking encoder-decoder has 143,824 synaptic weights but requires 30,976,000 membrane states at 440 x 640 resolution. The mapping specifies chronological 5-ms model updates, digital event/address services and 64-state capacitor banks. Characterization covers 22 module families and 74 operating points, distinguishing transistor simulations from digital-library estimates. Nominal results include 41.711 microwatts biased neuron-core power, 3.338-pJ positive terminal energy for a 1.4-microsecond cell read, and 0.531-mV selected-state drift over a 5-ms extracted-tile hold. Commit and coupling errors are reported separately. The software checkpoint records 27.976% mean intersection-over-union on a held-out six-class DSEC split; this is not hardware accuracy. Component layouts and simulation evidence quantify local implementation costs and expose storage replication and service scheduling as scaling constraints. A detailed SPICE-calibrated behavioral forward simulation of one full-resolution DSEC frame achieves 24.26% mean intersection-over-union, versus 26.22% for the matched PyTorch reference, using a compact 5-fF bank variant and external count/voltage calibration. Physical full-network operation, system energy and mismatch robustness remain unverified.