The Impact of Magma: A Ground-Truth Fuzzing Benchmark

Cryptography and Security

Summary

The authors created Magma, a free tool to fairly test and compare fuzzers, which are programs that find bugs by trying lots of inputs randomly. This paper explains why they made Magma, how it works, and the positive effects it has had. They also describe new features added since the first version. Essentially, Magma helps researchers see which fuzzers work best in a consistent way.

Authors

Ahmad Hazimeh, Adrian Herrera, Srividya Subramanian, Thaqiya Aman, Sara Vaccino, Qiang Liu, Mathias Payer

Abstract

Magma is an open-source and ground-truth fuzzing benchmark that enables uniform fuzzer evaluation and comparison. Magma was originally released with a research paper published at ACM SIGMETRICS 2021. This short paper explains the motivation, the design, and the impact of Magma, with a description of extensions to the original benchmark.