Autonomous vehicle safety tested through behavior and traffic interactions

Behavioral Safety Assessment towards Large-scale Deployment of Autonomous Vehicles, Part I: Methodology

Robotics

Summary

Self-driving cars have improved a lot, but making sure they are really safe for everyone is still tricky. Current safety tests mainly check if the car's parts work well, but they don’t always look at how the car behaves around other drivers and traffic. The authors suggest a new way to check safety by testing how the car reacts in specific situations and how it interacts with other road users in normal traffic. This two-part method aims to give a clearer, more realistic idea of how safe autonomous vehicles really are before lots of them are used on roads.

What this means in practice

  • For automotive safety engineers: Evaluate how self-driving cars behave in controlled and real traffic scenarios to better predict safety risks before public rollout.
  • For traffic system designers: Use behavioral safety metrics to understand and improve interactions between autonomous vehicles and human-driven traffic.

Authors

Henry X. Liu, Tinghan Wang, Xintao Yan, Haowei Sun, Zhijie Qiao, Kenneth Boyd, Shuo Feng, Greg Stevens, Greg McGuire

Abstract

Autonomous vehicles (AVs) have significantly advanced in real-world deployment in recent years, yet safety continues to be a critical barrier to widespread adoption. Traditional functional safety approaches, which primarily verify the reliability, robustness, and adequacy of AV hardware and software systems from a vehicle-centric perspective, do not sufficiently address the AV's broader interactions and behavioral impact on the surrounding traffic environment. To overcome this limitation, we propose a paradigm shift toward behavioral safety, a comprehensive approach focused on evaluating AV responses and interactions within the traffic environment. To systematically assess behavioral safety, we introduce a third-party AV safety assessment framework comprising two complementary evaluation components: the Behavioral Competency Test and the Driving Intelligence Test. The Behavioral Competency Test evaluates the AV's reactive behaviors under controlled scenarios, ensuring basic behavioral competency. In contrast, the Driving Intelligence Test assesses the AV's interactive behaviors within naturalistic traffic conditions, quantifying the frequency of safety-critical events to deliver statistically meaningful safety metrics before large-scale deployment. In Part II of this study, an open-source Level 4 Automated Driving System (ADS) is tested to demonstrate the effectiveness of the proposed method.