Managing hybrid quantum classical work improves optimization workflow control

Managing Iterative Hybrid Quantum-Classical Optimization as a First-Class Scientific Workflow

Distributed, Parallel, and Cluster Computing

Summary

Current quantum computers are too small and noisy to directly solve big optimization problems, so they work alongside classical computers in a cycle that breaks down problems, solves pieces, and combines results. The authors looked at this cycle not just as a simple script but as a scientific workflow, adding features like how to decide when to stop, recover from errors, and switch between quantum and classical computing if needed. They tested their approach on different problem types and showed how much time the workflow management takes and how it helps handle failures. They also tracked detailed performance data from different computing devices in the same format.

What this means in practice

Authors

Giuliana Siddi Moreau, Maria Laura Clemente, Lorenzo Pisani, Manuela Profir, Marco Pinna, Marco Moro, Lidia Leoni

Abstract

Today's Quantum Processing Units (QPUs) are too small and too noisy to solve large combinatorial optimization problems directly, so practical hybrid solvers split a problem into pieces and iterate a decompose-solve-aggregate loop over whatever backends are available: classical heuristics, simulators, emulators, or a QPU. In practice, the loop is a driver script. It sits on top of the quantum-HPC middleware, handling task generation, provenance, recovery, and portability. Instead, we treat the loop as a scientific workflow and ask what a workflow layer adds to a generic workflow management system and QPU-sharing middleware. Two decomposition patterns from real applications, iterative consensus (ADMM) and hierarchical partitioning, turn out to stress the orchestration layer very differently: over 120 managed runs, orchestration took 78.4% of end-to-end time for the iterative pattern, almost all of it in a per-round barrier, but only 6.2% for the hierarchical one. Our workflow model adds four things a generic engine does not have: a termination predicate residing in the task graph that reads the previous round's residuals, subproblem-level recovery with warm-start and quorum-deferred aggregation, failover from a QPU to a classical replica within a round, and a provenance schema that describes CPUs, simulators and QPUs with the same fields, including the shot budget included. We report the cost of each layer on our engine, show that speculative re-execution enable runs to complete under injected failures that stall an unmanaged driver. We also use the same provenance to give per-device latency tails across simulators, emulators and IQM QPUs.