Quantum algorithm improves software test case selection under noise
An Empirical Study on Clustering-based Quantum Approximate Optimization Algorithm for Regression Test Case Selection
Software Engineering
Summary
Software needs testing after changes to make sure it still works well, but testing everything every time takes too long. The authors studied a quantum-based method called QAOA-TCS that picks the best tests to run more efficiently. They found it often works better than other methods, even when the quantum system is noisy or imperfect. This makes it a promising way to save time while keeping tests reliable.
What this means in practice
- •For software testing teams: Use QAOA-TCS to select test cases efficiently, reducing time while maintaining effectiveness even with noisy quantum simulations.
- •For quantum computing engineers: Implement QAOA-based algorithms for multi-objective optimization problems to evaluate performance and noise resilience in real quantum environments.
Authors
Antonio Trovato, Martin Beseda, Dario Di Nucci
Abstract
Regression testing assesses whether software components that have already been developed and tested continue to work correctly after modifications. Ideally, regression testing re-executes the entire test suite after each modification, but this is infeasible in real-world scenarios because of the computational burden; therefore, optimized approaches, such as Test Case Selection, have been developed. The state of the art in regression testing optimization includes both classical approaches, such as Additional Greedy and DIV-GA, and quantum approaches, such as SelectQA, BootQA, and IGDec-QAOA. However, while the former incur high computational costs, the latter are constrained by the physical limitations of currently available quantum machines. This paper extends the evaluation of QAOA-TCS, our quantum approach for the test case selection problem. We thoroughly evaluate its performance, compare it with state-of-the-art classical and quantum approaches, and assess its robustness to quantum noise. The results show that QAOA-TCS outperforms state-of-the-art multi-objective approaches in most cases and maintains stable performance even under high noise levels. In the single-objective formulation, QAOA-based methods perform comparably. In terms of efficiency, our previous method based on quantum annealing, namely SelectQA, is the most efficient for large problems in the multi-objective formulation, whereas QAOA-TCS offers the best trade-off between effectiveness and efficiency in the single-objective formulation when run on realistic noisy simulators. However, such analysis is constrained by the different computational environments used to run the algorithms.