Papers for

hpc system designers

Papers whose findings have a practical use for this group, as judged from the abstract. Open a paper to read what it means in practice.

Caliper improves accuracy in high performance computing network simulators

CALIPER: Calibrating HPC/AI Network Simulators

Abstract: Network simulation plays an important role in HPC/AI system research by enabling exploration of network architectures, communication strategies, and system configurations at scales that may be impractical to study experimentally. Existing approaches to network simulator calibration and validation lack a principled methodology that combines parameter alignment, constrained inference, and independent validation for collective-centric HPC/AI networks. We present CALIPER, a methodology for systematic calibration and validation of HPC/AI network simulators. CALIPER distinguishes directly observable system parameters from auxiliary parameters which are configured via calibration and constrains the latter to feasible domains consistent with the target system. We evaluate CALIPER's hierarchical, scale-aware calibration and its effects on parameter identifiability and generalization using collective communication benchmarks on a reference system with up to 64-nodes at the Jülich Supercomputing Centre. Validation results show that the calibrated parameter configurations identified by CALIPER predict system performance with less than 5% mean errors across scale-up and scale-out network domains. CALIPER demonstrates that hierarchical, constrained calibration can produce simulator configurations whose predictive accuracy persists beyond the observations used for fitting.

Mon 12 OctNetworking and Internet ArchitectureDistributed, Parallel, and Cluster Computing
The gist
Simulating networks in high-performance computing and artificial intelligence systems helps researchers test ideas without building costly hardware. But these simulators need to be carefully tuned to match real-world systems accurately. The authors introduce CALIPER, a way to systematically adjust simulator settings using real measurements and logical constraints. This technique improves predictions across different network sizes, making simulations more reliable for designing future systems.
Open → 2610.16477v1

Gpu architecture causes different software fault results

BitIR: Cross-Architecture Fault Injection for Resilience Analysis of Heterogeneous GPU Applications

Abstract: Modern GPU-based HPC systems rely on heterogeneous vendor stacks, yet resilience studies are largely limited to single architectures, leaving it unclear how faults behave across different GPU backends. We present \emph{BitIR}, a cross-architecture fault injection framework that injects deterministic single-bit faults at the LLVM IR level, ensuring semantically equivalent perturbations prior to backend lowering and enabling direct cross-vendor comparison across NVIDIA, Intel, and AMD GPUs. We evaluate BitIR on three production supercomputers -- Polaris (ALCF, NVIDIA A100), Aurora (ALCF, Intel GPU Max 1550), and Frontier (OLCF, AMD Instinct MI250X) -- representing the full spectrum of current leadership-class GPU architectures. Using representative heterogeneous benchmarks, we conduct large-scale injection campaigns across all three systems and classify outcomes into masked results, silent data corruptions (SDCs), and failures. Our results show that identical faults produce markedly different behaviors across vendors: Intel most often masks faults but exhibits more hangs when faults escape masking, NVIDIA exposes more detectable hard failures, and AMD alternates between SDC-dominant and failure-dominant behavior depending on the benchmark and fault site. These findings demonstrate that resilience is not backend-invariant, underscoring the need for backend-aware and workload-aware fault mitigation.

Fri 2 OctDistributed, Parallel, and Cluster Computing
The gist
Computer systems that use GPUs from different makers may behave differently when tiny errors occur during calculations. The authors created BitIR, a tool that introduces the exact same small error into programs before they get customized for different GPUs. They tested this on three top supercomputers with GPUs from NVIDIA, Intel, and AMD, finding that errors caused very different outcomes on each one. This means fixing errors and making software reliable needs to consider the specific GPU being used.
Open → 2610.04037v1