Machine learning improves operating system detection from network data

Machine Learning Optimization for Enhanced OS Fingerprinting

Machine Learning

Summary

Identifying the operating systems running on devices in a network helps protect and manage those devices. This paper shows how machine learning can analyze network packets to recognize operating systems with good accuracy. The researchers built a tool called OsirisML that processes data and applies a popular machine learning method called XGBoost to identify systems. Their tests show it works well in different network traffic scenarios but with varying accuracy depending on the data.

What this means in practice

  • For network security teams: Automatically identify devices’ operating systems in large networks from passive traffic to support security monitoring and incident response.
  • For network operations teams: Improve inventory and management of networked devices by accurately detecting operating systems from traffic without active scanning.

Authors

Jae Sung Kim, Spencer Ekeroth, Jeremy Neale

Abstract

Operating System (OS) Fingerprinting is a technique that can be used to identify a network's operating systems by evaluating network traffic in the form of TCP/IP packets. This research will explore the effectiveness of passively identifying operating systems on the CIC-IDS2017 dataset, a collection of over 47 gigabytes of pcap files with their corresponding operating systems. This research also proposes a new command line interface, OsirisML, which uses nPrint to preprocess the data into tabular data and XGBoost to apply ML to the data to generate, retrain, and test ML models. When packets are split randomly between training and testing, OsirisML models reach an accuracy of 97.66% on a down-sampled subset of the Friday capture and 84.69% on the entire capture. On the entire Monday capture, which contains no attacks, OsirisML reaches an accuracy of 73.83% and an F-1 score of 79.38%.