Papers for

hardware designers

Papers whose findings have a practical use for this group, as judged from the abstract. Open a paper to read what it means in practice.

Maximally redundant unsigned digit systems speed up arithmetic units

MRUD: Maximally Redundant Unsigned Digit Number Systems for High-Performance Arithmetic Units

Abstract: Signed digit redundant number systems such as Maximally Redundant Signed Digit (MRSD) enable carry-free addition but introduce significant overhead in multiplication due to the presence of both positive and negative bits. While Unsigned Digit Redundant (UDR) systems have shown promise in radix-2, their extension to higher radices remains unexplored. This work presents the first generalized Maximally Redundant Unsigned Digit (MRUD) number systems for high-radix arithmetic, extending UDR representations from radix-2 to radix-$2^h$ while preserving carry-free addition. The proposed framework includes digit encoding, digit extension, arithmetic operations (addition, subtraction, and multiplication), sign inversion, forward/reverse conversion algorithms, overflow/underflow detection, and hardware architectures for both signed and unsigned MRUD representations. Unlike MRSD, which is inherently limited to signed arithmetic, MRUD supports both signed and unsigned representations, similar to conventional binary systems. Evaluations across three multiplier modes---RRR (Redundant inputs, Redundant output), BBR (Binary inputs, Redundant output), and BBB (Binary inputs, Binary output)---as well as Multiply-Accumulate (MAC) units, using the FreePDK 45nm library, demonstrate that MRUD achieves up to 30\% lower delay, 26\% smaller area, and 87\% lower power than MRSD. In BBR mode, MRUD achieves up to 43\% delay reduction over the best conventional architecture for 32$\times$32 operands, while in Multiply-Accumulate (MAC) units, performing reverse conversion only once at the end yields up to 64\% higher throughput than DesignWare and over 150\% higher than Wallace. These results demonstrate that MRUD enables high-radix redundant arithmetic with significantly improved multiplier and MAC performance, making it an efficient alternative to conventional signed digit redundant number systems.

Thu 29 OctHardware Architecture
The gist
Performing addition without waiting for carries can make computers faster, but this usually makes multiplication harder. The authors show a new number system called MRUD that extends unsigned digit redundancy to bigger digit sizes, keeping addition fast and multiplication easier. MRUD supports both signed and unsigned numbers, unlike older methods, and can make hardware for multiplication and multiply-accumulate operations run faster, smaller, and with less power. This approach offers a new way to build faster arithmetic units inside computers.
Open → 2610.39638v1

Quantization error triggers loss spikes in language model training

The Role of Quantization in Loss Spikes

Abstract: Loss spikes in language model pretraining can waste substantial compute and derail otherwise healthy training runs. A primary driver of these instabilities is the growth and divergence of output logits in the final language modeling (LM) head. In this work, we study a particularly costly form of this instability associated with output logit growth: delayed, terminal divergences that emerge only after prolonged training, which we call time-bomb spikes. We find that these instabilities are preceded by rapidly growing quantization error in the LM head, which eventually culminates in a loss spike. Crucially, reducing numerical precision accelerates time-bomb spikes, while increasing precision improves stability. We then propose a simple yet effective mitigation that replaces AdamW on the LM head with SGD with momentum, suppressing logit growth and improving stability over long training horizons. Finally, we find that existing mitigation techniques from the literature (along with our own) all reduce quantization error, suggesting a shared numerical mechanism behind their effectiveness. Together, our results identify finite precision error as a hidden driver of time-bomb spikes and show that suppressing this error is key to stable long-horizon pretraining.

Wed 28 OctMachine LearningArtificial Intelligence
The gist
Training large language models can sometimes hit sudden problems called loss spikes that waste time and computing power. These spikes happen because parts of the model's output become unstable and grow too large during training. The authors found that errors caused by limited numerical precision in the model's calculations, called quantization errors, cause these late-stage loss spikes. Using lower precision makes the problem worse, while higher precision helps prevent it. They also show that switching the training method for the model’s final layer helps keep output sizes in check and makes training more stable for longer.
Open → 2610.38277v1

Fpga runs full fruit fly brain simulation efficiently on one chip

FPGAFly: A 166.7k-Neuron Fruit-Fly Connectome on One FPGA via Deferred Spike Expansion and Shared-Codeword States

Abstract: Synapse-resolution fruit-fly (Drosophila) connectomes enable neuron-by-neuron simulation of entire insect nervous systems, yet whole-brain models still require computationally demanding software or multiple neuromorphic chips, and single FPGAs support only small or statistical networks. Scaling to the full connectome, per-synapse spike expansion scales queue traffic with fan-out up to 11.2k, while 41-bit neuron states require 6.83 Mbit, exceeding the 6.27 Mbit on-chip block static RAM (BSRAM) of the target device. FPGAFly runs the 166.7k-neuron, 25.6M-connection leaky integrate-and-fire male central nervous system (CNS) connectome on one FPGA. Order-preserving deferred expansion queues one 64-bit descriptor per spike in source-ID order, cutting external memory traffic by 54.5%-57.9% and peak queue data by 95.6%-96.5% with bit-identical results. A 24-bit encoding shares codewords across normal, refractory, and quantized out-of-range states, reducing BSRAM usage from 438 to 270 with 1245 extra LUTs and zero changes across 10,000 MNIST predictions. At 80 MHz on a Gowin GW5AST-LV138, each 100 ms window finishes in 86.83 ms on average and within 93.05 ms across 2000 tests, realizing the first complete Drosophila CNS connectome simulation on one FPGA.

Wed 28 OctNeural and Evolutionary ComputingHardware Architecture
The gist
Simulating the entire brain of a fruit fly needs huge computing power because it involves millions of connections between neurons. The authors created a way to run this big simulation on a single FPGA chip, which usually can handle only small networks. They cut down memory use and data traffic by using smarter data encoding and ordering tricks. This lets the FPGA run the full insect brain model fast and with exact results.
Open → 2610.38118v1

State augmented method improves processor design concurrency and efficiency

A State Augmented Approach to Paralle Modeling in High-Level Synthesis

Abstract: High-level synthesis (HLS) can schedule only the concurrency made legal by its input description. For feedback-coupled designs, a sequential behavioral model can obscure the architectural state boundaries and hazard resolution needed for efficient overlap. We develop an explicit architectural modeling methodology based on synchronous sequential processes that start in lockstep and synchronize completion before repeating. Persistent state, communication, and feedback control are represented in C++, while HLS schedules and binds operations within that structure. A five-stage RV32I processor illustrates three consequential modeling decisions: which version of a value a consumer reads, when it consumes that value, and how architectural memory actions map to port operations. On a Kintex UltraScale+ FPGA, the CPI-optimized configuration achieves 1.221 cycles per instruction at 220 MHz, compared with 4.000 for an algorithmic HLS baseline and 1.575 at 242 MHz for an Ibex reference. An area-optimized configuration reduces LUTs by 65\% and registers by 47\%, with 9.7\% more benchmark cycles and a 250 MHz achieved clock. These results demonstrate a separation between designer-controlled architecture and tool-controlled scheduling.

Tue 27 OctHardware Architecture
The gist
High-level synthesis (HLS) tools often miss opportunities for parallel operation because they depend entirely on how the design is described. The authors show that using a special way to model processor architecture makes it easier for HLS to schedule tasks more efficiently. Their modeling method lets designers control architectural states and feedback more clearly, enabling better overlap of operations. They tested this on a processor design for an FPGA and achieved faster instruction processing and smaller hardware footprints than standard methods.
Open → 2610.36481v1

Deep neural networks improve energy efficiency through voltage scaling adaptation

Adapting DNNs to Embrace Voltage Scaling Induced Errors via Accumulation-Aware Quantization

Abstract: The pervasive deployment of Deep Neural Networks (DNNs) across the computing spectrum has brought growing attention to energy efficiency, alongside raw performance. While voltage scaling is a potent knob for power reduction, its application in next-generation nodes is hampered by severe throughput degradation and susceptibility to process variation. This work aims to address these energy-reliability trade-offs by introducing a hardware-software co-design methodology, based on the observation that timing-robust bit ranges within the accumulator of a systolic array vary significantly across different voltage-frequency operating points. At the software level, we propose an Accumulation-Aware Training approach that incorporates this information as a first-order optimization constraint during training. By integrating mixed-precision quantization with unstructured pruning, we effectively constrain the model's weight distribution to avoid activating the hardware's sensitized high-rank carry chains. At the architectural level, we complement this with selective MSB-masking and fine-grained clock-gating to minimize unnecessary dynamic switching activity. Furthermore, we employ a layer-wise Dynamic Frequency Scaling strategy to further adapt to the accumulator's reduced dynamic range, based on the numerical sensitivity of each layer. We experimentally evaluate the proposed solution on a deep scaled 2nm technology node and demonstrate that, when operating at a low-voltage frontier, our co-optimized post-layout architecture delivers substantial energy and energy-delay product gains of 39% and 23% respectively, relative to the nominal voltage implementation, while maintaining accuracy degradation within 1%.

Sat 24 OctHardware ArchitectureArtificial Intelligence
The gist
Lowering the voltage in computer chips saves energy but can cause errors that slow down processing. The authors found a way to train deep neural networks to avoid these errors by understanding how numbers add up inside the chip. Their technique tweaks the model so it avoids risky operations that cause mistakes at low voltages. This method helps save energy while keeping the accuracy of the neural network high.
Open → 2610.33824v1

Multi trigger backdoor defense reduces attacks with hardware friendly design

Combinatorial Lock for Trojan-Resilient AI Engines via Hash-Assisted Spectral Filtering

Abstract: Multi-trigger backdoor attacks, in which heterogeneous trigger mechanisms (e.g., patch, blend, warping, and the latent-domain Spy-Watermark) coexist within a single poisoned model, cannot be addressed by existing shortcut-based defenses that assume a single, static attack mechanism. Current multi-trigger remedies (BU+FT, BU+ANP, and BU+ABL) rely on backdoor unlearning, which incurs high training costs and loses effectiveness at low poisoning ratios. This paper proposes Combinatorial Lock, a training-free, reference-calibrated defense that reduces multi-trigger identification to a combinatorial problem over binary activation signatures. This formulation is the key novelty: it yields a multi-trigger defense that is training-free, trigger-oblivious, and directly implementable in hardware, since its decision rules can be evaluated with integer and logic operations. The framework combines anomaly-gated spectral scrubbing, which removes the malicious subspace only from inputs identified as anomalous, with a hash-compressed combinatorial signature verified by an ensemble of detection experts, including a compound-attack-aware expert for multi-trigger inputs. A joint threshold-shrinkage search identifies an operating point ($τ$ at the 97.1st percentile, $γ= 0.78$) that reduces the attack success rate (ASR) to as low as 0.1% while preserving 97.8% clean accuracy. Evaluation on six models (ResNet18, VGG16, MobileNet, AlexNet, ViT-Small, ViT-Base) shows strong generalization: near-100% ASR drops to single digits across poisoning rates of 1-10% and 1-9 simultaneous triggers, with only gradual degradation in clean accuracy. ASIC and FPGA implementations confirm practicality, adding a consistent 19-20% latency overhead across all evaluated architectures and establishing Combinatorial Lock as a hardware-native approach to multi-trigger backdoor mitigation.

Sat 24 OctCryptography and SecurityHardware ArchitectureMachine Learning
The gist
Backdoor attacks in AI models use various secret triggers to make the AI behave badly, and current defenses usually only handle one type of trigger. The authors propose Combinatorial Lock, which can spot multiple hidden triggers at once without extra training, using simple digital logic that hardware can handle easily. Their method filters out malicious behavior only for suspicious inputs and keeps the AI working well on normal data. Tests on various AI models show it greatly reduces these attacks while keeping accurate results and hardware tests confirm it adds only a small delay.
Open → 2610.33437v1

Thermodynamic costs reveal energy limits of logic circuits

The Thermodynamic Complexity of Circuits

Abstract: When any physical system executes a logically irreversible (non-injective) step of a computation, the excess heat released over the Landauer limit is an energetic cost that cannot be recovered. In modern computers this cost vastly dwarfs the Landauer cost. Modern stochastic thermodynamics refers to this cost as the ``entropy production'' and has derived fundamental lower bounds on its value. Here we introduce a thermodynamic model of circuits using heat functions and investigate its entropy production, deriving new results on the thermodynamic complexity of circuits. We first show that computing the optimal heat functions for gates in a given circuit (minimizing the entropy production) is PP-complete and multiplicative approximation of those heat functions is NP-hard, but additive approximation admits a polynomial-time randomized algorithm. We give tight bounds for entropy production for certain specific families of circuits (on uniformly distributed inputs): an $n$-ary AND tree of depth $O(\log n)$ requires $Ω(n)$ entropy production, while a serial chain achieves $O(1)$ in an idealized model, showing an energy-depth tradeoff. The Batcher odd-even mergesort network on $n$ bits has $Θ(n)$ entropy production, asymptotically less than its $Θ(n \log^2 n)$ gate count. On random permutations of distinct integers its entropy production is $Θ(n \log^2 n)$, asymptotically exceeding the Landauer cost of sorting; but preceding it with Leighton and Plaxton's almost-sorting network reduces the total heat released to $O(n \log n)$. Finally, we show how to sort $n$ values with zero circuit entropy production over any exchangeable input distribution. Our framework also yields streamlined proofs of known results in stochastic thermodynamics on mismatch cost and modularity cost.

Fri 23 OctComputational Complexity
The gist
This paper studies the extra heat produced when computers do irreversible calculations, which wastes energy beyond the fundamental minimum. The authors model logic circuits to measure this heat and find it very hard to minimize or approximate. They also discover that certain circuit designs use more or less energy, revealing a tradeoff between circuit depth and energy waste. They propose ways to sort data with minimal or even zero extra heat under specific conditions, improving understanding of the energy efficiency limits of computation.
Open → 2610.33193v1

3D scaling reduces GPU carbon footprint compared to 2.5D scaling

Embodied Emissions of 2.5D and 3D Scaling in Chipletized GPUs for Low-Carbon AI

Abstract: GPU compute resources are scaling to support growing AI workloads, leading to further rises in the climate change impact of hyperscale data centers that rely on high-performance GPUs. To model how packaging decisions impact the carbon footprint we have estimated the embodied emissions (EE) of a chiplet-based GPU that has been scaled in 2.5D and 3D using the imec.netzero modelling platform. We doubled the number of compute units and high bandwidth memory (HBM) capacity in the 2.5D and 3D scaled systems and found that 3D scaling results in an 89% increase in EE, as compared to an increase of 141% for 2.5D scaling, positioning 3D scaling as an attractive solution to limit the embodied emissions due to GPU scaling.

Fri 23 OctHardware Architecture
The gist
As GPUs grow more powerful to support AI, they use more materials that impact the environment. The authors looked at two ways to stack components inside GPUs, called 2.5D and 3D, to see which has a smaller carbon footprint. They found that 3D stacking increases environmental impact less than 2.5D when doubling key parts of the GPU. This means 3D scaling could help make future GPUs greener while still growing in power.
Open → 2610.32830v1

Adaptive framework combines prime testing with optimization techniques

Bridging Number-Theoretic Primality Testing And Algorithmic Optimization: An Adaptive Cryptographic Framework

Abstract: The security of modern public-key cryptographic systems, such as RSA, Diffie-Hellman, and ECC, depends entirely on the computational intractability of the integer factorization and discrete logarithm problems. For these asymmetric algorithms to operate, a core requirement is that the system must be capable of generating, testing, and simultaneously proving the primality of extraordinarily large numbers. To meet those requirements, this study proposes a comprehensive framework, bridging clas- sical number theory with modern machine learning models and optimization algorithms. Specifically, the paper delineates an adaptive, arbitrary-precision architecture dedicated exclusively to primality testing. Concurrently, the research deeply analyzes the theoretical foundations of testing methods (both deterministic and probabilistic), hardware-level optimization techniques, and the application of quantum-secured entropy sources, while providing rigorous mathematical proofs to guarantee security even when the prime distribution is biased.

Thu 22 OctCryptography and SecurityMachine Learning
The gist
Modern encryption systems rely on very large prime numbers that are hard to find and prove prime. The authors propose a new system that uses traditional math alongside modern machine learning and hardware tricks to test and prove if large numbers are prime. They also consider new secure sources of randomness to keep the system safe even if the prime numbers are unevenly distributed. This approach helps improve the reliability and security of cryptographic keys.
Open → 2610.30935v1

Modulating neural network weights improves error tolerance and reduces storage

LEAN: Loss-Engineered Modulation of the Model Weight-Sensitivity Distribution for Efficient, Error-Tolerant Neural Networks

Abstract: The weights of a trained network do not have uniform sensitivity to model accuracy: the 1% most sensitive weights carry about a fifth of the damage a bit flip can do. This distribution decides the bit-flip tolerance of a model, the fraction of weights a code must cover and the bits each weight needs; existing schemes work with the distribution training leaves. We show that we can systematically modulate or alter the weight sensitivity distribution of a trained model, thereby shifting weights from one sensitivity bin to another. The sensitivity of a stored weight is the product of its gradient and the step a flip takes in the storage format, and LEAN adds a composite regularizer on both factors, a range term that bounds the flip step and a tail term that lowers the gradient of the most sensitive weights, with one coefficient λ setting how far the distribution moves. Ten epochs with the term, as a fine-tune or as the last epochs of training, shrink the sensitive tail 5 to 13 times on nine vision models (ResNet-18, ResNet-50, VGG-16 on CIFAR-10, CIFAR-100, ImageNet) within 0.5 points of accuracy; real flips confirm that the reshaped weights do less damage, a plain gradient-norm penalty does not reproduce the effect, and a preliminary extension to three small language models shows the same tail shaping. With a BCH code over 1% of the weights the model then survives 300 progressive bit-search flips in every training seed and 500 in two of three, where three of four published defenses with the same code fail by 300 and WCAT falls to 75% at 500. The reshaped distribution also cuts the parity for a fixed guarantee 3.7 times and makes a sensitivity-ordered 8/6/4/3-bit format affordable, which stores ImageNet ResNet-50 at a 3.29-bit weight payload, 2.4 times smaller than INT8, above the accuracy of LSQ at 3 bits.

Tue 20 OctMachine LearningCryptography and Security
The gist
Not all parts of a neural network's memory are equally important for keeping its accuracy. The authors discovered a way to adjust how sensitive these memory parts are to errors, making the network less likely to break from small bit flips. They do this by fine-tuning the network to spread out sensitivity more evenly across weights, resulting in much better resistance to errors with little loss in performance. This could allow smaller storage formats without hurting how well the network works.
Open → 2610.28872v1

Memory stacked chip boosts generative image model speed and efficiency

M3D-FLOW: A Monolithic 3-D-Stackable Processing-Near-DRAM Architecture for Generative Normalizing Flow Applications

Abstract: Normalizing Flows (NFs) have shown strong results in generative modeling, recently reaching state-of-the-art image generation performance. However, their repetitive, sequential operations limit the computational and memory efficiency achievable with GPUs and TPUs. We propose M3D-FLOW, a novel monolithic 3D-stackable (M3D) DRAM-based processing-near-memory (PNM) architecture that eliminates memory bottlenecks using a Cu-Cu hybrid-bonded logic die integrated with an M3D DRAM die. The M3D DRAM provides dense bank integration and a tiered organization with variable access latencies that M3D-FLOW exploits for the efficient processing of different NF workloads. To maximize compute density while minimizing area, energy, and thermal overhead, M3D-FLOW employs hybrid binary--stochastic floating-point multipliers, performing mantissa multiplication in the stochastic domain and exponent operations in the binary domain. A pipelined execution strategy maps sequential NF stages across dynamically partitioned PE groups, and together with the stochastic hardware, enables M3D-FLOW to achieve at least $6.6\times$ higher performance and $3\times$ better energy efficiency than prior PNM accelerators, with only a 2.2% bits-per-dimension (BPD) increase over bfloat16 and 4.1% over FP32. An analysis of stochastic hardware variants further shows that shorter stochastic bitstreams reduce execution time by up to $3.3\times$ at the cost of higher approximation error, providing a concrete design guide for latency--accuracy trade-offs.

Mon 19 OctHardware ArchitectureEmerging Technologies
The gist
Generating images using Normalizing Flows is slow and uses a lot of power because the process is repetitive and sequential. The authors present M3D-FLOW, a new computer architecture that stacks processing units directly on memory chips to reduce data bottlenecks. By using a mix of binary and stochastic calculations, and organizing tasks smartly across processing groups, this design speeds up image generation by over six times and uses one-third the energy of previous designs. They also show how shorter stochastic calculations can speed things up more at a slight cost in accuracy.
Open → 2610.27371v1

Hybrid GPU and memory design boosts language model efficiency

A Hybrid GPU and Processing-Near-Memory Architecture with Shared DRAM for Efficient Prefill-Decode Disaggregation

Abstract: The growing adoption of large language models (LLMs) has significantly increased the compute and memory demands of inference serving. A key challenge arises from the mismatch between compute-bound prefill and memory-bound decoding: when executed together, the two phases interfere, while separating them via prefill-decode (PD) disaggregation leads to substantial resource underutilization. Specifically, prefill leaves memory bandwidth underutilized, whereas decoding underutilizes compute resources. Prior approaches, such as GPU Streaming Multiprocessor (SM) partitioning, attempt to improve utilization by spatially dividing GPU resources. However, these approaches remain fundamentally limited, as memory-bound decoding still requires a large number of SMs to saturate bandwidth, reducing the compute resources available for prefill and resulting in an inherent trade-off. To address this limitation, we propose DuoPD, a hybrid PD-disaggregation architecture that integrates lightweight Processing-Near-Memory (PNM) units into the HBM logic die. Unlike prior PIM/PNM designs that rely on costly internal bandwidth scaling and offload only partial decoding operations, DuoPD enables full decoding execution on PNM by leveraging bandwidth sharing with the GPU over a shared HBM interface. This allows compute-bound prefill and memory-bound decoding to execute concurrently with minimal interference, improving both compute and memory utilization. To realize this design, we develop a compact PNM microarchitecture, a TSV-level bandwidth sharing mechanism, and a hierarchical data mapping scheme tailored for hybrid GPU-PNM execution. Evaluations on server-scale LLMs demonstrate that DuoPD achieves up to 2.23x higher end-to-end throughput than conventional PD-disaggregation.

Mon 19 OctHardware Architecture
The gist
Running big language AI models needs lots of computing power and memory. The authors found that when two parts of model processing happen together, they slow each other down, and doing them separately wastes resources. They created a new system called DuoPD that combines special processing units near memory with a GPU to run these parts at the same time more smoothly. This approach uses both computing and memory better, making language model tasks run over twice as fast as before.
Open → 2610.26131v1

Random clocks on computation paths reveal new time reach limits

Random Clocks on Computation Paths]{Random Clocks on Computation Paths: How Far Can They Reach, and When Does Stepping Back Help?

Abstract: We watch a computation only at moments chosen by a random clock that can leap ahead, pause, or step back, and we count looks rather than steps. How far can such a clock reliably see with polynomially many looks, and does stepping back help? Rare long leaps reach exponential and doubly exponential time, with infinitely many levels between polynomial and exponential time. A clock that tends to fall back sees only the start of the input, and below polynomial time we find infinitely many incomparable levels. Stepping back can help decisively. For clocks whose long leaps occur only at rare positions, no forward-only clock goes beyond polynomial time, while even single steps back raise the reach to exponential time. Stepping back cannot help, however, when the clock's leaps ignore its position.

Mon 19 OctComputational Complexity
The gist
This work studies a special kind of 'random clock' that watches computer programs at unpredictable moments, including jumping forward, pausing, or stepping backward. The authors explore how far these clocks can see into the computation with limited looks and whether stepping back can help. They find that rare long jumps let the clock glimpse very far, even exponentially far in time, while clocks that frequently step back see less. Interestingly, stepping back can significantly extend how far the clock sees when jumps happen rarely, but not when jumps ignore position.
Open → 2610.25830v1

Bit-sharing boosts large language model decoding speed with new hardware

BS-Spec: BFP-Based Bit-Sharing for Self-Speculative LLM Decoding with LUT-Driven Mixed-Precision Acceleration

Abstract: As large language models (LLMs) are increasingly deployed across diverse inference services, serving workloads span a wide range of batch sizes, context lengths, and performance requirements. Speculative decoding improves inference throughput, but conventional approaches require a separate draft model and KV cache, while existing self-speculative methods suffer from workload-insensitive draft configurations and inefficient mixed-precision execution. In this paper, we present BS-Spec, a block floating point (BFP)-based bit-sharing framework that jointly optimizes draft construction, workload-aware precision selection, and hardware execution. BS-Spec derives multiple draft representations directly from a single BFP target model by partially loading the most significant bits of weights and the KV cache while preserving shared exponents, eliminating separate draft-model storage. Offline calibration selects the weight and KV-cache precision pair that maximizes estimated speedup for each serving regime, and a precision lookup table applies the selected configuration at runtime. To support this adaptive execution, we design a mixed-precision BFP accelerator with a lookup table (LUT)-based variable-precision datapath for both draft and target computation. Experimental results show that BS-Spec achieves up to $1.9\times$ speedup over conventional autoregressive decoding and improves speedup over the evaluated bit-sharing self-speculative decoding baselines by $67.2\%$ on average, demonstrating the benefits of jointly co-designing bit sharing, precision adaptation, and specialized hardware for diverse LLM serving workloads.

Fri 16 OctHardware Architecture
The gist
Running large language models (LLMs) can be slow because they handle complex decoding steps, especially for varied request sizes and demands. The authors propose BS-Spec, a method that shares parts of model data in fewer bits and smartly picks precision levels depending on the workload, all while using a special hardware design. This lets the system do most of the work faster without needing extra copies of the model. Their tests show this approach speeds up common decoding methods by nearly twice and improves on similar newer methods by over 60%.
Open → 2610.22877v1

Efficient multiplier-free large language model inference with fractional power-of-two quantization

Fractional Power-of-Two Quantization for Efficient and Effective Multiplier-Free LLM Inference

Abstract: Large Language Models (LLMs) demand efficient inference, where the multiply-accumulate (MAC) operations in linear projections dominate compute and energy cost. Post-training quantization (PTQ) reduces this cost by mapping weights and activations to low-bit integers. Power-of-Two (PoT) weight quantization promises efficient multiplier-free LLM inference via shift-add logic, but suffers significant accuracy degradation at low bitwidths due to its coarse base-2 quantization grid. We introduce Fractional PoT (FPoT), a base-$\sqrt{2}$ (half-octave) fractional PoT grid that achieves practical 4-bit weight quantization while preserving a fully integer shift-add datapath. The method combines (i) the base-$\sqrt{2}$ weight grid with uniform integer activations, (ii) a calibration-time grid-alignment refinement absorbed into the static per-channel scale, and (iii) a lightweight 1-adder $\sqrt{2}$ approximation whose error is absorbed during weight calibration via approximate-grid quantization, yielding a processing element (PE) with significantly fewer gates than a 4-bit integer multiplier. On Llama-3-8B with 4-bit weight and activation quantization, FPoT improves zero-shot commonsense reasoning performance by 8.72% relative to the PoT baseline, while maintaining performance close to the uniform integer baseline, with only a negligible 0.4%p degradation. These results hold across various configurations spanning seven models and three bit-widths. Furthermore, FPoT can be integrated with state-of-the-art LLM PTQ methods, demonstrating framework-agnostic applicability.

Thu 15 OctMachine LearningArtificial Intelligence
The gist
Large language models require lots of computing power, especially for multiply operations. The authors introduce a new way to simplify these operations by using a special type of number rounding called fractional power-of-two quantization, which lets computers replace multiplications with faster shift-and-add steps. This method keeps the model’s accuracy mostly intact while using less hardware and energy. Their approach works well across various models and bit sizes and can be combined with other optimization methods.
Open → 2610.21257v1

Hardware software contracts help prevent side channel attacks

Foundations of Hardware-Software Leakage Contracts

Abstract: Microarchitectural attacks such as Spectre and Meltdown undermine security by exploiting software-visible side effects of microarchitectural optimizations like caches and speculative execution. To use modern hardware securely, programmers must take into account the security implications of these optimizations. Yet instruction set architectures (ISAs)---the conventional abstraction layer between hardware and software---are ill-suited for secure programming: by design, they abstract from microarchitectural details and therefore fail to reflect their security consequences. A new security abstraction is emerging to fill this void: hardware-software leakage contracts. To support the principled development of secure software on modern hardware such contracts characterize side-channel leakage at the ISA level. Thereby they enable programmers and compilers to generate code that is provably resistant to side-channel attacks---without having to explicitly reason about the microarchitecture. On the other hand, they provide a specification for hardware designers to ensure that microarchitectures do not introduce unintended and undocumented side channels. This paper introduces the foundations of this emerging topic, discussing recent contributions and unresolved challenges along the way.

Wed 14 OctCryptography and SecurityHardware Architecture
The gist
Modern processors have optimizations like caches and speculative execution that can accidentally leak secret information through side channels, causing security problems. The usual hardware-software interface, called an ISA, hides these micro-level details, making it hard for programmers to write secure code. The authors discuss a new idea called hardware-software leakage contracts, which describe how much information might leak at the ISA level. This helps software developers write code that avoids these leaks without needing expert knowledge of hardware internals and guides hardware designers to avoid unexpected leaks.
Open → 2610.20754v1

Double circulant codes improve binary LCD error correction rates

Double circulant LCD codes over $\mathbb{F}_2+u\mathbb{F}_2$ and constructions for binary LCD codes

Abstract: Linear complementary dual (LCD) codes are linear codes that intersect their dual trivially. We study double circulant (Euclidean) LCD codes over the finite chain ring $R=\mathbb F_2+u\mathbb F_2$, where $u^2=0$. Using the Chinese Remainder Theorem and the factorization of $x^n-1$, we derive an explicit enumeration formula, with a separate treatment of the constituent corresponding to $x-1$, which is not obtained by a formal specialization of the previously known counting formula over $\mathbb F_q[u]/(u^k)$. Assuming Artin's primitive root conjecture for $2$, we show that the binary Gray images contain an asymptotically good family of rate $1/2$ whose relative distance can approach $H_2^{-1}(1/4)$ from below. More importantly from the constructive viewpoint, by combining Gray images with a known extension construction, we obtain a binary LCD code with parameters $[29,15,7]$ and construct two explicit permutation-inequivalent binary LCD codes with parameters $[45,23,9]$.

Mon 12 OctInformation Theory
The gist
Some codes used in computers and communications need to be easy to check and fix errors. The authors look at a special kind of code built from repeating patterns called double circulant codes over a simple mathematical ring. They figured out exactly how many such codes exist and showed how to make good binary codes that can correct errors well. They also made specific examples of these codes that have strong error correction with neat properties useful for practical use.
Open → 2610.16121v1

Linear attention models need new methods to quantize recurrent state

When Dynamic Scaling Fails: A Scale-State Feedback Governs Recurrent-State Quantization in Linear-Attention and SSM LLMs

Abstract: Linear-attention and state-space LLMs carry long context in a fixed-size recurrent state, and quantizing that state is the natural way to cut its cost during long decode. Unlike a weight tensor, the state is rewritten at every step, so a quantizer applied at each step sits inside the recurrence and its errors compound. INT4 that leaves synthetic recall perfectly intact at the start destroys it a thousand steps later. The mechanism is a feedback between the quantizer scale and the state it is derived from. Yoking that scale to a full-precision reference removes the resulting norm explosion entirely, yet recovers only 1.8 of the 5.4 nats lost, so numerical instability and functional degradation are separable failures. The remainder is a resolution problem that locating outliers does not solve, since every outlier-aware scheme here loses to plain persistent scaling. Allocating bits across layers does help, but under article-disjoint splits a learned allocation collapses onto the trivial rule of protecting the first few layers. Run out to 32K, group-wise INT4 is worth no more than discarding the state. Contain the scale rather than locate outliers, and report the decode horizon at which a bit-width was certified.

Sat 10 OctMachine Learning
The gist
Some large language models hold long conversations by remembering information in a fixed-size memory, which can be made smaller by compressing that memory. The authors find that simply using low-bit number storage causes errors to build up as the conversation continues. They discover this is because the scaling used for compression feeds back on the memory and causes instability. Attempting to fix this by using a reference for scaling helps with numeric issues but does not fully restore the model's performance. The paper shows that carefully managing the scale is more important than targeting rare outlying values for better compression.
Open → 2610.15139v1

Physical electromagnetic leaks reveal tokens and prompts on edge LLMs

Physical Side-Channel Attacks on Edge LLMs: Extracting Output Tokens and User Prompts

Abstract: The deployment of large language models (LLMs) on edge devices is largely motivated by privacy concerns over sharing sensitive user data with cloud servers. In this paper, we demonstrate that keeping inference local does not eliminate privacy risks: an adversary with physical access to the device may exploit hardware leakage to recover sensitive information without compromising or modifying the software system. In particular, we present an electromagnetic (EM) side-channel attack targeting LLM inference on edge devices. Targeting LLaMA-3.2-1B-Instruct running on a Raspberry Pi 5, we demonstrate that EM traces collected during inference can leak both generated tokens and user prompts. We propose three attacks under different threat assumptions. First, a profiling attack that identifies generated tokens among 50 medical and privacy-related keywords with 97.2% accuracy on profiled words. Second, a reconstruction attack recovers the model's hidden representations and uses them to predict tokens from the full 128k-token vocabulary, achieving 94.3% accuracy on profiled classes. For unseen words, the correct token is ranked within the first 100 positions of the 128k-token vocabulary in 67% of cases, with a median rank of 54. Finally, we present a hidden-state inversion attack that uses the recovered hidden state to reconstruct user prompts semantically. Our proposed attacks require only passive EM side-channel measurements and a limited number of traces during model training. These results demonstrate that local execution alone may not guarantee the confidentiality of generated tokens and user inputs.

Fri 9 OctCryptography and Security
The gist
Running large language models on local devices is thought to protect privacy by keeping data off the internet. However, this paper shows that someone who can physically access the device can read secret information like what you asked the model and what it outputs by measuring electromagnetic signals emitted during computation. The authors demonstrate this on a Raspberry Pi running a popular language model, recovering words with high accuracy just from those signals. This means running AI locally is not always enough to keep data private if attackers can measure the device’s hardware signals.
Open → 2610.14215v1

Hardware malware detectors balance power performance and chip area costs

Power, Performance, and Area of HPC-Based Malware Detectors: An FPGA and Open-PDK ASIC Study

Abstract: Hardware malware detectors (HMDs) classify programs as benign or malicious based on hardware performance counter (HPC) data. Previous studies have shown that ensemble classifiers outperform other classifiers on detection metrics. However, the area, power, and timing costs of HMDs remain open questions. We address these questions across a comprehensive design space comprising multiple classifier families, variable HPC sets, and ensemble learning methods. We designed a pipeline to reconstruct selected trained models, generate synthesizable register-transfer-level (RTL) implementations, validate each design against a bit-accurate golden model, and evaluate the implementations. The results show that tree- and rule-based detectors achieve the highest detection performance with nearly an order of magnitude less area and several times lower energy than function-based classifiers. Reducing the number of HPC inputs to fit a processor's concurrent-counter limit preserves detection performance while substantially reducing area, power, and delay.

Thu 8 OctCryptography and SecurityHardware Architecture
The gist
Malware detectors that use hardware performance counters (HPCs) help recognize harmful software based on computer hardware signals. The authors explored how different types of detectors perform and their costs in power, chip size, and speed. They found that tree- and rule-based detectors work well while using much less energy and chip space compared to function-based ones. Also, using fewer HPCs (hardware counters) keeps the detection quality high but reduces cost and delay. This study helps design more efficient hardware for catching malware.
Open → 2610.12795v1

Unprivileged sensors reveal memory data without timing side channels

HOMARD: Hammering Off-chip Memory via Aggregate power Rail Disclosure

Abstract: Software-based microarchitectural attacks have mainly exploited timing differences to infer information from DRAM. However, defenses and optimizations can prevent timing-based approaches from resolving precise microarchitectural behaviors. We show that unprivileged millisecond- and milliampere-resolution power sensors on modern Arm SoCs can recover DRAM mapping functions and reveal the data dependence of memory accesses without timers. We present HOMARD, a methodology that reads DRAM activity from this telemetry, and two attack primitives. HOMARD-RE is a hierarchy-aware linear-algebraic method that reverse-engineers DRAM addressing functions from power alone. HOMARD-DATA recovers the Hamming weight of a fetched cache line through joint-power rail templating and secret byte values through correlation power analysis on the same rails. Across an AMD ZCU102, a Raspberry Pi 5, and a multi-chip-based LPDDR4 NVIDIA Jetson TX2, HOMARD-RE succeeds where row-buffer timing methods fail. On the Pi 5, HOMARD-DATA classifies 9 Hamming-weight levels at 81.5% accuracy and recovers secret bytes in minutes by correlating rail current with data-dependent bit toggling between neighbors in a row. Both primitives work with an architectural load or a mispredicted Spectre-RSB path on which no value is architecturally read. These results establish unprivileged power telemetry as an independent side channel for profiled microarchitectural attacks, particularly when timing falls silent.

Thu 8 OctCryptography and Security
The gist
Many security attacks on computer memory rely on measuring how long things take to happen, but some protections can make those timing clues harder to spot. This paper shows that regular software running without special permissions can use electric power measurements inside processors to figure out how memory is organized and what data is being accessed, even without timing information. The researchers created a method called HOMARD that uses power data to reverse-engineer memory addresses and recover secret information from memory. Their approach works on popular devices where traditional timing attacks fail, proving power measurements alone can provide a new way to spy on data.
Open → 2610.12621v1

Fixed networks build and self-replicate stored threshold networks exactly

Universal Construction and Exact Self-Reproduction in Ternary McCulloch-Pitts Networks

Abstract: A fixed network of McCulloch-Pitts threshold units with weights in {-1,0,1} can hold other threshold networks in its state and run them: the state is a ring of banks of records, each record a unit of a stored network, and each step evaluates one record. We use such a network to carry out von Neumann's universal construction and self-reproduction exactly. As a cellular automaton keeps its rule, the fixed network keeps its weights, and what reproduces is a stored network. A constructor of 143 records reads the description of a network from its tape, builds that network in the next bank, copies the description onto the next tape and hands control to what it built; started on its own description, it rebuilds itself, weights included, in every generation. The scheme scales to a universal computer. A SUBLEQ computer of 17,598 ternary units, stored as 36,080 records and running a program of 27 instructions, builds any network that fits a bank and reproduces itself in the same way, at every word width from eight bits on; run directly, it emits the serialization of its own weights, memory and tape. Integer pre-activations give every orbit a margin of 1/2, and replicating each unit r times multiplies it by r. That suffices against noise of any size on the pre-activations, but against von Neumann's output flips only below a threshold inversely proportional to the fan-in. These results are proved in Rocq.

Thu 8 OctLogic in Computer ScienceNeural and Evolutionary Computing
The gist
This paper shows how a fixed network made of simple units with limited connections and weights can store and run other network designs inside its own state. The authors demonstrate that such a network can carry out self-reproduction exactly, meaning it can build a copy of itself within its structure and then run the copy, including all its details. They also prove that this scheme scales up to universal computing machines and can protect itself against certain types of noise. This work builds on ideas originally proposed by von Neumann but applies them to a specific model of neural networks called ternary McCulloch-Pitts networks.
Open → 2610.12251v1

Fly olfactory circuit wiring offers no clear retrieval edge over random connections

A Connectome Test of the Fly Hashing Algorithm

Abstract: Dasgupta, Stevens and Navlakha (2017) showed that the Drosophila olfactory circuit, modelled as a random sparse projection followed by winner-take-all, is a locality-sensitive hash that beats classical LSH. The projection was random because the wiring was unknown. We test it against four electron-microscopy connectomes (MaleCNS, hemibrain, FlyWire, BANC; four animals, seven hemispheres). First, the 2017 pattern holds in a reimplementation of its protocol on SIFT, MNIST and odour mixtures (GloVe is near chance at short codes for every method): the fly hash beats k Gaussian projections at short hash lengths (3.1x in AP@200 on MNIST at k = 4). Second, against the tested real-valued Gaussian baseline that advantage is per active cell, not per operation: Gaussian projections given the same projection arithmetic retrieve better on every dataset and input dimension tested. Third, across four connectomes the measured pairing of glomeruli gives no consistent retrieval advantage over degree-preserving rewiring: retrieval is slightly lower (median -1.6%), and the small odour deficits depend on how missing odour responses are treated. Separately, equalising glomerular fan-out at fixed connection count improves retrieval in the model in every hemisphere, while equalising inputs per cell lowers it on average. Yet the fan-out profile is similar across the four sampled animals (median between-animal Spearman rho = 0.86), structural synapse counts do not offset it, and its relation to odour tuning is weak. In the model that uneven allocation costs retrieval. For practice: measured wiring gives no consistent retrieval advantage over degree-preserving random wiring, so a fly hash needs no connectome data, and its advantage is per active unit, which may suit hardware where active units rather than arithmetic are the binding cost, a hypothesis we do not test.

Tue 6 OctNeural and Evolutionary Computing
The gist
The authors checked if the specific wiring of a fruit fly’s smell-processing brain area helps computers quickly find similar smells, using detailed brain maps. They found that a simple random wiring, which keeps how busy each part is but changes exact connections, works just as well or better. This suggests that the special wiring of fly brains might not be needed to build these fast searching tools. The work also shows that the fly’s method is more efficient when measured by active parts rather than computational steps.
Open → 2610.09114v1

Architecture speeds large language model serving with smart quantization

A Shape-Adaptive Architecture with Disaggregated Quantization for Efficient LLM Serving

Abstract: Large language models (LLMs) have become the backbone of modern AI applications, but pose significant challenges for efficient inference. Their autoregressive generation divides execution into two phases: prefill, dominated by large GEMMs, and decoding, dominated by small GEMVs. Modern serving systems further introduce complexity through continuous batching and prefill-decoding disaggregation, leading to dynamic workloads and phase separation. However, existing accelerators remain poorly aligned with these system-level behaviors, resulting in inefficiencies in LLM serving. In this work, we present DynaCore, a unified architecture for efficient LLM serving via system-architecture co-design. We observe that the compute tile a systolic array executes, its Minimum Efficient Unit (MEU), spans all three GEMM dimensions. DynaCore reshapes the MEU along all three: spatially it trades array width against height asymmetrically, raising weight delivery while leaving the input path untouched, and temporally Split-K maps the reduction onto the array, folding partial sums through the interconnect the array already has. To exploit phase separation, we further propose disaggregated quantization, applying dual-side quantization to prefill and weight-only quantization to decoding, with an inner-product mixed-precision datapath that keeps output width invariant to precision. A runtime scheduling framework then selects an MEU per batch. Evaluation with real-world serving traces shows that DynaCore substantially reduces service-level latency over quantization and reconfigurable accelerators, improving TTFT by 3.50x and 2.97x and TPOT by 36.55x and 8.02x, respectively.

Mon 5 OctHardware Architecture
The gist
Large language models are powerful but slow and complex to run efficiently because they work in two phases that use computing differently. The authors designed a new computer architecture called DynaCore that adapts its shape and precision based on these phases to use resources better. DynaCore also picks the best setup for each batch of work to keep things fast. Testing it on real workloads showed much faster responses than existing approaches.
Open → 2610.07443v1

Large language models tested on real vhdl hardware design tasks

VHDL-REPOBENCH: A Repository-Level Benchmark for Evaluating Large Language Models on VHDL Design Generation

Abstract: Large Language Models (LLMs) are increasingly applied in hardware design automation, demonstrating strong potential in generating and understanding hardware description languages. However, most existing benchmarks focus on Verilog, with limited evaluation of VHDL, which remains widely used in industry and academia for FPGA and safety-critical systems. To address this gap, we introduce VHDL-REPOBENCH, a large-scale, cross-file, repository-level benchmark for assessing LLM capabilities on realistic VHDL design generation and analysis tasks. VHDL-REPOBENCH curates ~100 open-source VHDL repositories, encompassing ~2.5k VHDL files and ~500 testbenches, and provides structured problem statements, module stubs, and self-verifying testbenches. The benchmark enables comprehensive evaluation across syntax, semantic correctness, hierarchical reasoning, cross-file dependency resolution, and functional verification. We evaluate several state-of-the-art models, including GPT-4o, Llama-3-70B, Qwen2.5-72B, CodeLlama-70B, and multi-step reasoning approaches such as Reflexion and CoDes. Results reveal that while current LLMs achieve moderate line- and block-level accuracy, substantial challenges remain in multi-file reasoning, hierarchical design understanding, and specification-to-module generation. VHDL-REPOBENCH represents the first large-scale VHDL-focused benchmark and provides a valuable resource for the hardware design community to evaluate, compare, and advance LLM capabilities for practical VHDL development.

Sun 4 OctProgramming LanguagesHardware ArchitectureComputation and Language
The gist
Hardware designers often use a language called VHDL to describe circuits, but tools to help write and check VHDL using AI had mostly focused on another language called Verilog. The authors created a big set of real VHDL projects and tests called VHDL-REPOBENCH to see how well AI models can handle VHDL tasks like understanding code spread across files and checking if hardware behaves correctly. They used this benchmark to test popular AI models and found that while the AI can get some simple parts right, it struggles with complex designs and multi-file logic. This work helps show where AI tools for hardware design need to improve and provides a resource for making those tools better.
Open → 2610.05380v1

RapID boosts memory computing by processing whole rows fast

RAPID: Row-Parallel Arithmetic Processing in DRAM

Abstract: Processing-using-memory (PUM) architectures perform computation directly within DRAM to reduce costly data movement between memory and processors. Because charge-sharing operations are confined to individual bitlines, existing DRAM-PUM architectures reorganize data into column-oriented, bit-serial representations. This organization is fundamentally incompatible with the row-oriented, word-parallel layouts used by conventional processors and accelerators, requiring expensive data-layout transformations whenever computation transitions between PUM and conventional execution. In this paper, we present RAPID, a Row-parallel Arithmetic Processing-In-DRAM architecture. RAPID augments the DRAM subarray with two lightweight extensions: migration cells that enable localized horizontal data movement between neighboring bitlines and inversion cells that provide efficient in-array logical inversion. These primitives enable RAPID to operate directly on row-parallel, bit-parallel data, preserving CPU-compatible layouts while exploiting the massive parallelism of the DRAM subarray. In particular, RAPID demonstrates that localized horizontal communication is sufficient to realize shallow arithmetic networks and efficient parallel reduction for multiplication, reducing arithmetic latency while preserving throughput and eliminating costly data-layout transformations, all while maintaining the conventional DRAM array organization. We demonstrate the feasibility and overhead of augmenting DRAM subarrays with migration and inversion cells through detailed transistor-level layout and SPICE-validated circuit simulations. Using the RAPID compiler it is possible to evaluate the performance and data reorganization tradeoffs to ensure the best execution across combined CPU and PUM. Evaluating RAPID on 19 MLPerf benchmarks, there is a 5.9x higher end-to-end performance compared to SIMDRAM for DDR4 PUM execution.

Thu 1 OctHardware Architecture
The gist
Moving data between a computer's processor and memory can slow down tasks a lot. The paper presents RAPID, a way to do math calculations right inside the computer memory but working with data arranged just like the processor expects it. This avoids slow changes in how the data is arranged and lets the memory work on many tasks at once, speeding things up. The authors tested RAPID on typical machine learning tasks and found it to be nearly six times faster than a previous method.
Open → 2610.02502v1

Stochastic rounding boosts low-precision transformer accuracy in key parts

Stochastic Rounding in Low-Precision Transformer Inference: A Variable-Precision Emulation Study of a Small GPT-2

Abstract: Should low-precision transformer inference use stochastic rounding (SR) or round-to-nearest (RN)? The answer depends on where in the network you look. We isolate this effect by holding the numerical format fixed and varying only the rounding rule at individual operation sites. To enable experiments at freely chosen precisions, we extend the PRISM vectorized rounding library to arbitrary virtual precision via a variable-precision stochastic rounding (VPSR) algorithm, proving that the rounding decision is evaluated exactly in hardware floating point. We develop two analyses providing complementary insight into this site-level trade-off. First, a probabilistic forward-error bound for linear projections shows that SR's error envelope grows as $O(\sqrt{n} u)$ in reduction length $n$, versus $O(n u)$ for RN, a gap that widens rapidly at low precision and is most pronounced in the long multilayer perceptron (MLP) down-projection. Second, a second-order decomposition of expected cross-entropy loss change at the output softmax into signed drift, drift curvature, and a Fisher-weighted variance penalty reveals why the two sites behave oppositely: MLP noise is predominantly a uniform logit shift to which softmax is invariant, so SR's variance is largely discounted; head noise is non-uniform across the vocabulary and is not. On DistilGPT-2 at $t=6$ significand bits, observations match theory: SR in the MLP raises perplexity to 1.15x the full-precision reference, versus 2.21x for RN. At the language-model head, the ordering reverses because SR introduces non-uniform variance, whereas deterministic RN carries none. In a mixed-precision configuration (MLP output at $t=6$), assigning SR to the MLP and RN to the head brings perplexity within 1.10x of the full-precision reference, a 28% reduction over matched-bit RN.

Thu 1 OctMachine LearningComputation and Language
The gist
When computers run transformer language models like GPT-2 using fewer bits to save memory and speed, rounding numbers can cause errors. The authors studied two rounding methods: stochastic rounding, which adds randomness, and round-to-nearest, which chooses the closest number deterministically. They found that stochastic rounding works better in some parts of the model, especially in the multilayer perceptron layers, while round-to-nearest is better in the language-model head. Combining these methods in different parts reduces errors significantly compared to using just one rounding method.
Open → 2610.01889v1

Open-source chip design for synchronized 8-channel ultrasound transmitters

U-Sonic: An Open-Source 8-Channel Ultrasound Transmit IP in a 130 nm RISC-V SoC

Abstract: Miniaturized ultrasound (US) probes require programmable and synchronized transmit (TX) excitation across multiple elements, while existing compact platforms often rely on limited microcontroller (MCU) pulse generators or closed-source fixed-function pulser devices. We present U-Sonic, an open-source digital US TX peripheral integrated into a 32-bit RISC-V system-on-chip (SoC). The implemented SoC integrates 8 pulser cores, while the parameterized architecture supports up to 16 channels. Each core generates single- or dual-tone bursts with programmable period, duty cycle, pulse count, polarity, and idle level, together with optional inverted stop pulses for active damping. A shared memory-mapped Open Bus Interface (OBI) enables synchronous start and stop of arbitrary channel subsets and supports composite bipolar, gated, and three-level excitation schemes. Functional correctness was verified in Verilator against a Python golden model over 4379 checked cycles across directed and randomized configurations, and confirmed on a Terasic DE10-Lite field-programmable gate array (FPGA). The design was synthesized and placed-and-routed in IHP 130 nm. The post-layout area in kilo gate equivalents (kGE), scales as 1.65 kGE plus 1.66 kGE per channel. The 8-channel instance occupies 14.9 kGE, corresponding to approximately 14.3% of the 104 kGE SoC. The register-transfer level (RTL), register descriptions, verification collateral, and software support are released as open source.

Thu 1 OctHardware Architecture
The gist
Ultrasound machines use tiny probes that send sound pulses from multiple points at once, but many small devices use limited or unchangeable parts for this. The authors created U-Sonic, a chip design that can send controlled ultrasound signals from up to 16 channels, and they tested it to make sure it works well. This design is open for anyone to use and modify, providing more flexibility and easier development of ultrasound devices. Their work shows a way to build better miniature ultrasound transmitters in hardware that fits in small chips.
Open → 2610.01603v1

Parity function needs very large circuits at all constant depths

Top-Down Lower Bounds for All Depths

Abstract: We prove that Parity requires $2^{n^{Ω(1)}}$ size De Morgan circuits of constant depth using a new method which is completely "top-down" in the sense of [HJP95]. The proof relies crucially on the core ideas developed in a line of work [HJP95, PPZ99, MW19, GRSS24] which previously established top-down lower bounds for circuits of depth 3 and 4. We first present a proof of a lower bound $\exp(n^{3^{-d}})$. In this case, nearly all of the relevant combinatorial ideas necessary for the proof are already present in some form in [GRSS24]. We then present two extensions of this argument, the first achieving a lower bound $\exp(ε_d n^{1/(2d-2)})$ for some $ε_d>0$ depending only on $d$, and the second achieving the essentially tight lower bound $\exp(ε_d n^{1/(d-1)})$. These improved results each hinge on establishing a key lemma which quantifies the extent to which a high entropy random variable in $\{0,1\}^n$ will look close to uniform after projecting it onto a random small set of coordinates $R \subseteq [n]$.

Wed 30 SeptComputational Complexity
The gist
The paper shows that solving the parity problem (determining if a list of bits has an even or odd number of ones) requires very large logical circuits if those circuits have a fixed small number of layers. The authors build on previous work and extend methods to prove stronger size limitations for circuits of any constant depth. Their key insight involves understanding how certain random projections of data behave like uniform randomness, which helps them show why small circuits can’t work well. This advances our understanding of limits on efficient circuit designs.
Open → 2609.38677v1

HARS improves error correction with faster and more reliable decoding

HARS: LDPC Bit-Flipping Decoding With Initial-Syndrome-Conditioned Parameter Mapping and Local-Reliability Weighting

Abstract: HARS (Hybrid Adaptive Reliability-Aware and Syndrome-Aware) is a bit-flipping decoder that combines local channel reliability with parameter selection from the initial syndrome. A bounded check reliability modifies the parity-check weight, while the initial syndrome weight selects the base weight, reliability coefficient, threshold decay factor, and perturbation amplitude for each frame. Computing these quantities at initialization supports synchronous multi-bit updates with a simple iterative datapath. For rate-one-half PEGReg and WiMAX codes over the binary-input additive white Gaussian noise channel, HARS reduces both bit-error rate (BER) and mean iteration count relative to a calibrated SM-NGDBF baseline. The PEGReg BER at 3.25 dB is approximately one-sixth of the comparison value; the WiMAX BER at 2.75 dB is reduced by 59%. A seven-fractional-bit FPGA implementation shares 132 variable-node lanes among four frame contexts. Precomputed check weights, encoded threshold states, and parallel perturbation generation support one group per clock during sustained decoding. On an XC7A200T at 60 MHz, for preloaded 128-frame batches with a ready receiver, measured coded throughputs are 49.7 Mb/s at 2.50 dB and 361.9 Mb/s at 4.00 dB, including initialization and output transfers.

Tue 29 SeptInformation Theory
The gist
When digital messages get sent, errors can happen due to noise. The authors developed HARS, a method that better detects and fixes these errors by using information from the first check of the message and local data about reliability. This approach lets the decoding process update many bits at once more efficiently. Tests show it significantly lowers error rates and speeds up decoding compared to older methods. They also demonstrated it working well on a hardware chip, making it practical for real devices.
Open → 2609.36727v1

Fractus codes enable efficient encoding for scalable sparse error correction

LDPC Fractus Codes: Sparse Codes with Recursive Structure

Abstract: We introduce a new family of recursively constructed sparse matrices, termed Fractus matrices, and investigate their use in constructing low-density parity-check (LDPC) codes. Generated through a self-similar recursive process, these matrices yield regular sparse parity-check matrices while preserving key structural properties across successive iterations. This recursive structure enables an efficient encoding algorithm with computational complexity that is nearly linear in the block length. Decoding is performed using standard iterative message-passing algorithms, thereby retaining the low-complexity decoding characteristic of LDPC codes. The proposed construction produces Tanner graphs with girth six and guarantees a minimum Hamming distance of at least $\ell+1$. We establish several algebraic properties of Fractus matrices, including sparsity, regularity, recursive decomposition, and symmetry under the flip-transpose operation. In addition, we show that the family of Fractus matrices admits a natural lattice structure and that the associated LDPC codes inherit corresponding lattice-theoretic properties. These results establish a connection between order theory and coding theory. Overall, the proposed framework integrates recursive matrix constructions, efficient encoding, graph-theoretic analysis, and lattice theory into a unified algebraic approach to the design and analysis of scalable LDPC codes.

Mon 28 SeptInformation Theory
The gist
Communicating data reliably over noisy channels requires error-correcting codes. The authors introduce Fractus matrices, special patterns that build sparse codes recursively. This structure lets them encode messages quickly while keeping the standard fast decoding of LDPC codes. Their method also ensures certain quality features in the code’s design and links coding theory to another math area called lattice theory. Overall, this provides a new way to build useful error-correcting codes that scale well.
Open → 2609.36249v1

ReLU networks reveal more by analyzing outputs as vectors not scalars

Beyond Scalar Probes: Exploiting Vector-Valued Outputs in ReLU Networks For Signature Extraction

Abstract: We revisit cryptanalytic extraction of ReLU networks from a geometric and algebraic perspective. Rather than restricting attention to a single output component, we study the full vector-valued behavior across adjacent linear regions. This leads to a rank-one characterization of Jacobian differences that recovers the usual row-signature information while also revealing complementary column-side information. Our experiments show how this additional structure can be used in ex- traction and improves numerical estimation under different numerical- precision regimes (float64, float32 and float16). We extend the analysis beyond the high-precision and output-rounding settings commonly con- sidered in the literature towards the low-precision settings encountered in many practical settings.

Mon 28 SeptCryptography and Security
The gist
This paper looks at ways to understand neural networks that use ReLU functions by not just looking at one output at a time but the entire output vector. The authors found a neat mathematical way to describe how the network changes between different small regions, which lets them see more information than before. Their approach works better than older methods when computers store numbers with different levels of precision. They also tested it in situations where numbers are stored less precisely, similar to what many real-world systems use.
Open → 2609.35487v1

Agent performance benchmark reveals gaps in language model testing

AgentPerfBench: A Benchmarking and Evaluation Suite for Inference Performance of Agentic LLMs

Abstract: The optimization of LLM serving engines, such as vLLM and SGLang, is largely benchmark-driven: optimizations, scheduling policies, hardware and system designs are all selected based on representative workloads. However, a significant mismatch has emerged in the agentic era. Existing benchmarks primarily focus on simple single-turn chatbot workloads. LLM applications are increasingly agentic: coding agents, terminal execution systems, and tool-use agents issue multi-turn requests with growing context lengths. We introduce AgentPerfBench, a benchmark suite for agentic inference. It uses real traces from agentic benchmarks, such as SWE-Bench and TerminalBench, alongside standard chat baselines. This enables benchmarking of models on multi-turn tasks involving tool calling, skill utilization, and increasing context lengths. AgentPerfBench also samples from empirical distributions of input length, output length, and turn count derived from the real traces, generating representative synthetic profiles for cheap and accurate measurements on new hardware. In addition, we further find that several existing benchmarks fail to accurately reflect real hardware performance for two key reasons: 1) they do not account for realistic context-length growth, and 2) they measure inference performance without operating at hardware saturation. We discuss these issues in detail and provide rich kernel-level Nsight Compute (NCU) traces to construct a new multi-dimensional roofline model that captures hardware-system limitations in both memory bandwidth and memory capacity footprint. The benchmarking suite then includes automated scripts to identify potential bottleneck conditions on emerging hardware when evaluated with diverse agentic traces. Together, these contributions quantify the chat-to-agentic gap in current inference benchmarks and characterise per-kernel GPU resource utilisation via roofline analysis.

Mon 28 SeptMachine Learning
The gist
Language models are now often used as agents that perform multi-step tasks, but current tests only look at simple one-step chats. The authors created AgentPerfBench, a new benchmark that uses real examples of these complex agent tasks to better measure how well systems perform. They found that old tests miss important performance issues because they don’t simulate longer conversations or fully use the computer’s hardware. Their benchmark also helps identify which parts of the hardware limit performance during these tasks.
Open → 2609.34683v1

PolyCIM boosts memory chip use for faster neural network work

PolyCIM: Improving Data Reuse in Digital CIM Accelerators with Polyhedral-Based Compilation

Abstract: Digital Compute-in-Memory (CIM) presents a promising solution for accelerating deep neural networks (DNNs) through the integration of computational logic directly within memory arrays. However, mapping modern DNN operators to CIM accelerators often results in severe array underutilization, due to the strict data reuse constraints imposed by the rigid CIM array structure. We observe that data reuse in modern DNNs forms hyperplane structures often oriented along non-axial directions, rendering them invisible to conventional mapping methods that only exploit axis-aligned reuse. In this work, we propose PolyCIM, a polyhedral-based compilation framework for CIM architectures that systematically exposes and realigns these hyperplanes through affine transformations. PolyCIM provides a unified abstraction capable of efficiently representing both diverse DNN workloads and digital CIM architectures. Through data reuse exposure, computation mapping, and data movement optimization, PolyCIM generates mappings for CIM architectures that achieve superior array utilization and performance. Experimental results show that PolyCIM delivers up to $4\times$ improvement in macro utilization and $3.2\times$ speedup, effectively bridging the gap between modern DNN operators and CIM architectures.

Mon 28 SeptHardware Architecture
The gist
Computers that run tasks like recognizing images often use special chips with memory and calculators combined, called compute-in-memory (CIM) accelerators. The problem is these chips don’t work well with modern AI programs because they expect data arranged in simple, straight lines, but the real data is more complex. The authors propose PolyCIM, a smart way to reorganize data so these chips see the patterns they expect, letting them work more efficiently. This method uses math tools to transform data arrangements and speeds up processing by making better use of the chip’s resources.
Open → 2609.34351v1

Shift-invariant permutations with clear algebraic structure for cryptography

A Class of Shift-Invariant Permutations and Their Algebraic Structure

Abstract: Shift-invariant permutations of $\mathbb F_2^n$ are attractive in symmetric cryptography because of their regularity and implementation efficiency. Constructing such permutations with an explicit algebraic structure remains a challenging problem. In this paper, we study a family of shift-invariant transformations of $\mathbb F_2^n$ generated by a recursively defined sequence of mappings $\{γ_j\}_{j\ge0}$ associated with landscapes. First, we prove that, under an explicit dimension condition on $n$ and the support of the landscape, the sequence $\{γ_j\}_{j\ge0}$ has the polynomial composition property if and only if the corresponding landscape with nonzero special index is quasi-conserved on $\mathbb F_2^n$. Then, we determine the eventual zero or periodic behavior of $\{γ_j\}_{j\ge0}$, including the first zero or periodic index and the least eventual period, and establish linear independence up to the first relation. When the polynomial composition property holds, we establish an explicit isomorphism between the group of permutation elements in the monoid generated by these mappings and the unit group of a quotient ring $\mathbb F_2[z]/\langle p(z)\rangle$, where $p(z)$ is a monomial or a binomial determined by the landscape. This framework reduces the permutation property, compositional inverse, order, and iterates of these mappings to polynomial computations. Finally, we apply the results to mappings represented by binomials and trinomials in the quotient ring, obtaining explicit criteria and formulas. We tabulate more than one hundred representative constructions of shift-invariant permutations, recovering and unifying several previously studied families.

Fri 25 SeptInformation Theory
The gist
Shift-invariant permutations are special ways of rearranging data bits that repeat in a regular pattern, making them efficient to use in encryption. The authors study a particular family of these permutations based on mathematical objects called landscapes and find when their building blocks combine nicely like polynomials. They show how these permutations can be understood using polynomial math, making it easier to find when they have good cryptographic properties and to compute their reverses and repeated applications. Their work includes explicit formulas, criteria, and many examples that unify previous known constructions.
Open → 2609.31174v1

Transformer compression improves by matching layer geometries

GeoPair: Geometry-Preserving Cross-Layer Factorization for Training-Free Transformer Compression

Abstract: Transformer architectures exhibit cross-layer redundancies, yet post-training compression pipelines typically optimize layers in isolation or rely on heuristic grouping strategies that disregard layer-specific activation geometries. We introduce a principled, training-free framework that sequentially optimizes cross-layer weight pairings and shared-dictionary factorizations. Rather than forcing weights of adjacent layers to share a basis or heuristically merging activation statistics, our approach identifies structurally compatible projections and learns a shared representation that better preserves each layer's distinct calibration geometry. Coupled with structured sparsity, this yields highly efficient weight decompositions without sacrificing functional fidelity. Across diverse architectures, scales, and modalities, our method achieves state-of-the-art results, consistently outperforming independent structured weight decompositions and alternative pairwise weight factorizations, which operate under heuristic grouping strategies. By replacing heuristic engineering strategies with a convergent, optimization-driven pipeline, we establish a theoretically grounded foundation for scalable, transformer compression across different modalities.

Tue 22 SeptMachine Learning
The gist
Transformers are powerful AI models but often have repeated or redundant information across layers, which makes them large and slow. The authors developed a method called GeoPair that finds smarter ways to compress these layers together without needing extra training. Their approach preserves the unique characteristics of each layer while reducing the overall model size more effectively than older methods. This helps make transformer models smaller and faster without losing accuracy.
Open → 2609.25963v1

Circuit design cuts memory compute comparisons to save energy

Circuit-Architecture-Training Co-Design with Regenerative-SA Similarity Sensing for Aggressive SAR Skipping in Analog Compute-in-Memory

Abstract: This work presents a circuit-architecture-training co-design framework that exploits sense-amplifier (SA) regeneration to detect analog-output similarity and reduce SAR comparisons in compute-in-memory (CIM) systems. Hardware-aware training incorporates circuit-characterized SA disturbance and encoding errors caused by prefix reuse, enabling aggressive comparison skipping. The detector is characterized through 55-nm CMOS schematic simulations, with system-level evaluation on WRN-28-10, ResNet20, and DeiT using an ISAAC-based W4A4 CIM model. On WRN-28-10, the proposed approach achieves 77.3% Top-1 accuracy (W4A4 baseline: 78.4%) while reducing SAR comparisons by 48.19% across the evaluated layers. Energy-budget analysis estimates a 27.18% reduction in reference ADC energy after detector overhead, leaving 0.52 pJ per conversion to accommodate additional control and peripheral costs.

Mon 21 SeptHardware Architecture
The gist
Computers that perform many calculations inside their memory often spend time comparing similar values, which wastes energy. The authors found a way to detect when values are similar using special circuits, so the computer can skip unnecessary steps. They trained the system to handle minor errors that happen in these circuits. This approach saves nearly half of the comparison operations, reducing energy use while keeping accuracy almost the same. The work was tested on known computer vision models to show practical benefits.
Open → 2609.24288v1

Unified 16-bit format boosts neural network error protection efficiency

UniCASE: A Unified 16-bit Floating-Point Format with Criticality-Aware Selective ECC for Efficient DNN Protection

Abstract: Soft errors are an increasing reliability concern for Deep Neural Network execution because they can corrupt parameters, leading to accuracy degradation. While conventional ECC offers strong fault protection, it incurs additional parity storage and computational overhead. Embedded-parity formats reduce storage cost by reusing the least-significant bits, but they do not optimize protection while reducing computational overhead. We propose UniCASE, a unified 16-bit floating-point (FP) format that jointly optimizes data representation and error protection for reliable DNN execution. It identifies stable blocks across FP64, FP32, FP16, and BFloat16 that can be mapped into a unified representation. Based on bit-level criticality analysis, UniCASE uses selective ECC that assigns distinct levels of protection to different data bits according to their resilience against soft errors. Experimental results show that UniCASE reduces encoder/decoder cost by up to 30%, preserves model accuracy within 1% of the FP32 baseline, and provides significantly stronger soft error resilience than existing embedded-parity methods.

Fri 18 SeptHardware ArchitectureCryptography and Security
The gist
Soft errors can cause mistakes in how deep learning models work, which harms their accuracy. The authors propose UniCASE, a new way to store numbers that both saves space and protects against these errors more efficiently. Their method looks at which parts of the number are most important and protects them better, reducing the overhead of error correction. Tests show UniCASE keeps accuracy close to standard formats while cutting error correction costs and improving reliability.
Open → 2609.22590v1

FloatLib enables verified and efficient floating-point math in Lean

FloatLib: Verified Floating-Point Arithmetic in Lean

Abstract: We present FloatLib, a verified arbitrary-precision floating-point arithmetic library in Lean 4 that combines broad format coverage, machine-checked correctness, and efficient certified execution. To our knowledge, FloatLib is the first Lean library to unify IEEE binary and decimal arithmetic, arbitrary-width posits, P3109, and user-defined formats and rounding rules behind interchangeable certified software backends. Every certified backend is proved equal to a complete encoded specification, preserving signed zeros and exceptional values, while numerical theorems connect execution to real rounding, error bounds, and exactness. FloatLib combines exhaustive certified tables for small formats with verified word and limb kernels based on guard-and-sticky invariants and independently checked quotient candidates. Its posit development additionally proves standard rounding thresholds and exact quire accumulation within capacity for arbitrary widths. Across matched workloads, FloatLib achieves speedups of up to 1.46x over FLoPS and 116x over Universal, while remaining slower in some regimes such as binary arithmetic against MPFR. Independent conformance testing includes more than 102 million TestFloat evaluations with zero differences under the tested relation. We release the library, proofs, benchmarks, evaluation data, and guide as open source.

Wed 16 SeptLogic in Computer ScienceProgramming Languages
The gist
Floating-point arithmetic is used by computers to handle numbers with decimals, but it can be tricky to get exactly right due to rounding and special values. The authors developed FloatLib, a software library in the Lean programming language, that supports many types of floating-point formats and checks correctness with mathematical proofs. This library also runs efficiently and has been tested extensively to ensure results match expected standards. FloatLib helps programmers trust the accuracy of complex number calculations in their software.
Open → 2609.19352v1

Limits on state increase when changing nondeterministic to deterministic automata

On 2DFA simulation of 1NFA: A Quadratic Limitation to a New Lower-Bound Method

Abstract: A recent result by the present authors established a quadratic lower bound, in the worst case, for the increase in the number of states when a one-way nondeterministic finite automaton is converted to a two-way deterministic finite automaton. Although this simply matched a well-known pre-existing quadratic lower bound by Chrobak, it used a distinct proof method. We show that, much like Chrobak's, this new method is also unable to deliver any lower bound strictly greater than quadratic.

Sat 12 SeptFormal Languages and Automata Theory
The gist
The paper looks at how complicated a machine must get when turning a type of computing machine that can guess (nondeterministic) into one that works in a fixed way (deterministic). The authors confirmed an earlier finding that in the worst case, the new machine must have about the square of the original machine’s number of parts. They also showed that their new method can’t prove any bigger jump than this. This means if you want to prove bigger jumps, a different approach will be needed.
Open → 2609.13793v1

Topology restricts power of small efficient computer circuits

Topology inside NC$^1$

Abstract: We show that ACC$^0$ is precisely what can be computed with constant-width circuits of polynomial size and polylogarithmic genus. This extends a characterization given by Hansen, showing that planar constant-width circuits also characterize ACC$^0$. Thus polylogarithmic genus provides no additional computational power in this model. We consider other generalizations of planarity, including crossing number and thickness. We show that constant-width circuits of polynomial size and thickness two already suffice to capture all of NC$^1$.

Thu 10 SeptComputational Complexity
The gist
This work explores how the shape or 'layout' of computer circuits affects what they can compute efficiently. The authors show that certain complex circuits constrained to a limited 'width' and organized with a shape close to flat (planar or with low 'genus') can only solve problems within a specific class called ACC0. Extending this, they find that allowing slightly more complex shapes (like thickness two) enables solving a larger class called NC1. This helps us understand the limits and possibilities for designing circuits with certain physical or logical layout restrictions.
Open → 2609.11822v1

Efficient memory safety for multicore processors reducing wasted space

CHERI-D Reincarnate: efficient multicore CHERI temporal memory safety through allocation reincarnation (draft version)

Abstract: We propose CHERI-D Reincarnate (Reinc), an architectural extension to CHERI for scalable and efficient temporal memory safety. Prior work CHERI-D has a finite-width generation ID stored at a fixed location, requiring an object to be quarantined when its ID is exhausted. Reinc further provides use-after-free mitigation while permitting immediate freed memory reuse for objects through allocation reincarnation: rather than quarantining an allocation slot upon ID exhaustion, Reinc dynamically assigns a new ID to that slot when its current ID is exhausted. Exhausted IDs are quarantined and later reclaimed, while the underlying memory remains available for immediate reuse. By quarantining IDs rather than memory, Reinc enables continuous reuse of memory in the common case, substantially reducing both memory-sweep frequency and quarantine memory overhead. Reinc further introduces coherent ID caching while retaining a fully decentralized ID organization. Temporal metadata remains colocated with the memory it protects, preserving locality while avoiding centralized metadata structures. To support multicore execution, Reinc connects physical coherence events to the virtually addressed ObjID buffer using lightweight reverse-map and filter-based mechanisms. We implement Reinc as a hardware-software co-design spanning CHERI-Toooba (superscalar FPGA softcore), QEMU, LLVM/Clang and CheriBSD. Across our evaluated workloads, Reinc substantially reduces memory-sweep frequency and memory quarantine while incurring low performance and hardware overhead.

Thu 10 SeptHardware ArchitectureCryptography and Security
The gist
Programs sometimes make mistakes by using memory after they have freed it, which can cause crashes or security problems. The authors propose a system called Reinc that fixes this by reusing memory safely without waiting, keeping track of memory use in a smart way. Unlike older methods that had to hold onto freed memory for a long time, Reinc recycles it right away, which saves space and work. It works well even when many processor cores are running at once and they tested it with low overhead.
Open → 2609.11590v1

How signal shape changes with amplitude limits in noisy channels

On the Evolution of the Capacity-Achieving Input Support for the Amplitude-Constrained AWGN Channel

Abstract: We consider an additive white Gaussian noise channel subject to a peak-amplitude constraint and study how the support of the capacity-achieving input distribution (CAID) evolves as the amplitude constraint $A$ varies. Although the CAID is known to be unique, symmetric, discrete, and finitely supported, the structure of its support transitions has remained largely unresolved. We show that the origin is the only possible degenerate support point and the only possible inactive contact point of the KKT function. We then establish continuity properties of the optimal distribution and the KKT function and prove that every nonzero support point is locally stable: under small changes in $A$, it persists as a unique nearby atom whose location and probability mass vary continuously. Combining these results, we prove that, locally, the support cardinality at a nearby amplitude is either unchanged or larger by one and that any such increase can occur only at the origin. Consequently, all local changes in support cardinality are confined to the origin: locally, the only possible transition mechanisms are the appearance or disappearance of the point at the origin and the splitting or merging of the origin into a symmetric pair.

Wed 9 SeptInformation Theory
The gist
This paper looks at how the best way to send a signal changes when you have a strict limit on its peak strength, in a noisy communication channel. The authors found that the possible signal points mostly stay stable as the allowed peak changes, except for one special point at zero amplitude that can appear, disappear, or split. This helps explain exactly how the signal design changes as the amplitude limit varies, improving understanding of optimal communication under strict limits.
Open → 2609.10039v1

Near-memory scheduler improves session memory use for language model agents

UNISON: A Co-Designed Near-Memory Scheduler of Session KV Residency for LLM Agents

Abstract: Large language models are increasingly composed into agent loops that plan, call tools, and resume the same task after each action. These loops press a shared memory hierarchy harder than conventional multi-turn chat, because they hold a growing key-value (KV) prefix across tool waits and place many sessions on one SRAM/HBM pool, so that eviction and hierarchical placement become a session-level efficiency problem orthogonal to compute-mode optimization. Existing proxies based on recency, timeout, or identity miss the mechanism information of the loop and therefore treat a live wait as a cold, discardable unit. We present Unified Native Inter-turn Session Orchestration Nexus (UNISON), an event-driven near-memory scheduler in which Survival-Penalty Eviction for Agent Return-gap (SPEAR) and Tiering in Idle-window DMA Events (TIDE) share one live ranking. SPEAR selects who leaves from a gap average and a turn-indexed hazard, while TIDE spends the observed wait as a DMA budget for who sits in the fast tier. On coding and general-mission benchmarks with three model families, totaling 1,415 sessions and 33,596 turns, the joint policy is the best non-oracle entry on every trace, raising hit rate by 0.3% to 23.1%, reducing AMAT by 22% to 51%, and lowering TTFT by 58% to 89% on long-horizon traces. A structural necessity analysis shows that the unified near-memory design cannot be decomposed into independent IPs or realized in software without re-introducing documented failure modes. The 28-nm CMOS scheduling core occupies 0.169 mm^2 at 13.6 mW and 150 MHz, a negligible overhead relative to the KV hierarchy it manages, reproducing the floating-point ranking at Kendall tau exceeding 0.998.

Wed 9 SeptHardware Architecture
The gist
When computer programs use large language models to complete tasks, they often have to remember lots of information between steps. This can slow things down because the memory used to store this information runs out or gets mixed up. The authors created a new memory manager called UNISON that smartly decides what information to keep or move near the processor, speeding up task completion. Their system works better than previous methods, reducing delays and improving how often needed information is readily available.
Open → 2609.09643v1