Reproducible Research in Network Modeling
Networking and Internet Architecture
Summary
The authors explain that testing network models is hard because real experimental data can be unreliable or hard to get. They suggest using full software versions of network devices, called nature experiments, which act like real devices and can be repeated to check reliability. They compared popular software tools for network modeling and found most can reliably reproduce results. The authors say the best tool to use depends more on how well known and popular it is rather than technical reasons.
Authors
Anna M. Ermolayeva, Tatyana R. Velieva, Anna A. Zhivtsova, Anna V. Korolkova, and Dmitry S. Kulyabov
Abstract
Background: When we model networks, there is a problem of obtaining experimental data to verify other model approaches. And even if there are some experimental data, it is necessary to be sure of their reliability. Purpose: It is necessary to propose methods for obtaining reliable experimental data. Method: By its nature, network equipment is a software and hardware complex. Therefore, a full-scale software model can be considered completely equivalent to real equipment. And a real experiment can be replaced by a nature experiment. The reliability of a nature experiment will be based on its reproducibility. Results A comparison of popular nature network modeling packages was carried out. These packages were divided by functionality and feasibility of reproducible studies. Conclusions: Most software packages meet the reproducibility criteria. The choice of a specific solution depends on non-technical factors: popularity and knowledge of the package.