Papers for

hardware developers

Papers whose findings have a practical use for this group, as judged from the abstract. Open a paper to read what it means in practice.

Physical muon enables energy efficient transformer training with orthogonalization flow

Physical Muon: Orthogonalization as an Equilibrium Computation

Abstract: Physical neural networks and analog in-memory computing could reduce the energy cost of neural network training. Realizing this potential, however, requires optimizers that combine effective learning with physical implementability. SGD fits local analog updates but struggles on transformers, while Adam family is unstable against analog bias. Muon offers strong training performance, but its Newton--Schulz orthogonalization relies on dense matrix-matrix products. To address this obstacle, we introduce Physical Muon, which computes the orthogonalization as the equilibrium of a continuous-time flow. Random probes approximate the flow using matrix-vector products, reciprocal reads, and local rank-1 writes. To test whether this replacement preserves training performance, we evaluate it on a 10.95M-parameter transformer. The dense flow's mean validation cross-entropy is 0.0085 above Newton--Schulz across nine seeds per method; the probe implementation is 0.0188 above the control across two seeds. Circuit simulations further reproduce the flow dynamics and yield comparable training behavior.

Tue 29 SeptMachine LearningEmerging Technologies
The gist
Training large AI models like transformers can use a lot of energy, especially for certain math steps called orthogonalization. The authors looked at a new method called Physical Muon that makes these steps work using simpler, energy-saving operations. They tested it on a real transformer model and found it performs almost as well as the standard method. This approach could help future AI training run more efficiently on specialized hardware.
Open → 2609.37525v1

Bluetooth low energy multi-hop networks face timing and collision challenges

Deconstructing BLE Multi-hop: a Model-based Approach to Quantifying the Challenges

Abstract: Bluetooth Low Energy (BLE) was originally designed for point-to-point communication, but BLE multi-hop networks have attracted academic and industrial interest. Multi-hop communication, however, introduces desynchronized nodes to the network due to the difference in individual clocks. In this paper, we study the impact of clock drift on a BLE multi-hop network. The aim is to find out if a BLE multi-hop network can be properly set up, why, and how. For this goal, we develop a mathematical model to quantify the collision probability among BLE connections managed by a single device. We provide a simplified version of the model for constrained deployment. The impact of clock drift and our mathematical model are validated through practical experiments. Afterward, we find that a BLE multi-hop network cannot eliminate the impact of clock drift in most cases. Moreover, from a long-term point of view, the collision between BLE connections occurs with a fixed frequency. We further analyze the limitation of using BLE to form multi-hop networks, and propose possible solutions, such as topology limitation, changes to BLE stack or hardware. This paper is a clear and quantitative problem statement on the limitations of using BLE in multi-hop networks.

Mon 28 SeptNetworking and Internet Architecture
The gist
Bluetooth Low Energy (BLE) was made for simple one-on-one connections, but people want to use it for networks where messages hop through several devices. The authors studied how tiny differences in device clocks cause trouble in these multi-hop networks, making connections collide and desynchronize. They built a math model to measure how often these collisions happen and tested it with real hardware. Their findings show that clock differences cause repeated collisions, limiting how well BLE can form multi-hop networks unless changes are made to the system or hardware.
Open → 2609.34483v1

Cluster mean-field theory speeds up extreme-scale Ising machines

Extreme-Scale Ising Machines with Cluster Mean-Field Theory

Abstract: Scaling analog and digital Ising machines to larger problems requires overcoming finite device capacity and the cost of communication between devices. We present cluster mean-field theory (CMFT), a framework that partitions a large interaction graph into clusters sized to fit available hardware. Each cluster performs local updates independently, while interactions across cluster boundaries enter through periodically updated effective biases computed from boundary-spin averages. To reduce the error introduced by fixed cluster boundaries, we introduce dynamic partitioning, which cycles through multiple partitions so that interactions approximated by mean fields at one stage can act through instantaneous spins at another. On three-dimensional spin glasses and planted Pegasus instances, dynamic CMFT exhibits power-law decay of residual energy over sweep budgets. This shows that solution quality continues to improve with computational effort despite the mean-field approximation. An automated graph partitioner combined with a weighted recovery ratio provides a practical heuristic for selecting partition combinations on graphs without natural cut directions. We demonstrate CMFT on four GPUs with approximately four million p-bits, reaching comparable energy densities up to 15 times faster than a single-GPU implementation of the full graph. By coupling locally evolving clusters through programmable effective biases, CMFT provides a route to extreme-scale Ising machines on both analog and digital hardware.

Fri 18 SeptDistributed, Parallel, and Cluster ComputingEmerging Technologies
The gist
Solving really big optimization problems using Ising machines can be limited by hardware size and communication costs. The authors introduce a way to split the problem into smaller clusters that run independently but still talk to each other through approximate signals. By changing how the problem is divided over time, their method improves the quality of solutions steadily. They tested this on large simulated problems and showed a faster solution compared to running everything on one device. This offers a practical way to build much larger Ising machines using current hardware.
Open → 2609.22645v1

SpMV speed improves with hierarchical sparse storage on RISC-V

Rethinking Sparse Formats for RISC-V: A Hierarchical Approach to High-Performance SpMV

Abstract: The sparse matrix-vector multiplication (SpMV) algorithm is a fundamental computational kernel of linear algebra and serves as a building block for numerous applications, primarily iterative solvers for systems of linear equations used in scientific and engineering simulations. This paper compares vectorized implementations of the SpMV algorithm across eight established sparse matrix storage formats and proposes a novel modification of the CSR format, Hierarchical CSR (HCSR), which enhances SpMV performance on RISC-V processors. Our SpMV implementations utilize RVV 1.0 intrinsics and are publicly available as an open-source C++ library named RVVLASparse. Computational experiments conducted on SpacemiT K1 and K3 RISC-V boards demonstrate that selecting an appropriate matrix storage format accelerates SpMV computations by an average of 1.6x, while the proposed HCSR format achieves the shortest execution time among all considered formats across a broad class of sparse matrices.

Thu 10 SeptDistributed, Parallel, and Cluster ComputingPerformance
The gist
Multiplying big sparse matrices by vectors quickly is important for many science and engineering problems. The authors tested different ways to store these sparse matrices on RISC-V processors and created a new method called Hierarchical CSR (HCSR). Their new approach makes the multiplication faster than older methods on RISC-V boards. They also shared their code openly for others to use.
Open → 2609.11352v1