Papers for

autonomous vehicle software developers

Papers whose findings have a practical use for this group, as judged from the abstract. Open a paper to read what it means in practice.

Reflection removal improves 3d driving video reconstruction quality

RIDE-Splat: Reflection Removal for In-the-Wild Driving Environments

Abstract: Driving video captured through a windshield violates the world-space consistency assumed by 3D Gaussian Splatting (3DGS): the road scene exhibits parallax while cabin reflections remain attached to the camera, causing standard 3DGS to embed reflected content into the reconstructed scene. We introduce RIDE-Splat, a pipeline for reflection-free 3D reconstruction from posed driving video without clean images, reflection masks, or pretrained networks. RIDE-Splat assigns world-consistent transmission through the windshield to a 3DGS scene and the dominant camera-attached reflection to one shared, signed RGB image. It builds the clean reconstruction in two passes. First, it learns the 3D geometry and the signed reflection image, representing both added radiance and transmission attenuation. Then, it uses the reflection-removed training images to fit a clean 3DGS model. At inference, the reflection image is discarded, preserving the standard 3DGS rendering path. We also introduce the RIDE-Splat Dataset, the first 3D reconstruction benchmark for reflection removal from driving video -- with real driving scenes, physical windshield reflections in training views, and separately captured non-reflective evaluation images. Across the RIDE-Splat Dataset, XLD, and Wayve, RIDE-Splat outperforms 3DGS, DC-Gaussian, and RobustSplat on all nine aggregate metrics, improving PSNR by up to 3.59 dB and reducing LPIPS by up to 0.0876. We achieve the highest metrics in 38 out of 42 per-scene comparisons and removes windshield reflections that remain visible in the baselines while preserving the transmitted scene.

Sun 25 OctComputer Vision and Pattern RecognitionArtificial Intelligence
The gist
Driving videos taken through windshields often show unwanted reflections inside the car, which makes it hard to get a clear 3D view of the road. The authors created a method called RIDE-Splat that separates the reflection from the actual scene without needing clean images or special training data. This approach builds a clean 3D model of the outside world by first estimating the reflection and then removing it for a better reconstruction. They also made a dataset to test this method and showed it works better than previous techniques in many driving scenes.
Open → 2610.34632v1

Asv control policies trained in simulation transfer directly to real boats

Sim-to-Real RL for ASVs using SysID

Abstract: Autonomous Surface Vehicles (ASVs) operating in dynamic marine environments require robust control policies for tasks such as path following and station keeping, making reinforcement learning (RL) a promising alternative to classical controllers. However, existing ASV simulators rarely support parallel environments for RL training. Such existing simulators require accurate hydrodynamic modeling from computational fluid dynamics solvers or towing tank tests for setting hydrodynamic parameters to address the sim-to-real gap. To address these challenges, we present an ASV simulator and accompanying pipeline that enables training policies starting from unknown vehicle dynamics. Our framework uses only a CAD model and brief set of open-water field trajectories for approximating and refining both hydrodynamic and thruster parameters. Real-world deployments on a BlueBoat ASV demonstrate successful zero-shot sim-to-real transfer in path following and station-keeping tasks without prior hydrodynamic and propeller information.

Thu 8 OctRobotics
The gist
Controlling autonomous boats in changing water conditions is hard, and teaching them using computer simulations usually takes a lot of detailed water and vehicle data. The authors created a system that only needs a simple 3D model of the boat and some short real-world trial runs to estimate how the boat moves and its engine power. They then train control strategies entirely in simulation, which work on the real boat right away without extra tuning. This makes it easier and faster to develop smart controllers for autonomous surface vehicles.
Open → 2610.12202v1

Agent-based model shows how self-driving cars improve ramp traffic flow

Agent-Based Evolutionary Dynamics for Mixed Autonomy Weaving Ramps

Abstract: Existing models of mixed-autonomy weaving ramps characterize how altruistic connected and automated vehicles (CAVs) can improve traffic efficiency at the population level, but provide limited insight into how such behavior emerges from decentralized vehicle interactions or how it is affected by finite populations, heterogeneous preferences, and imperfect information. We develop an agent-based model of a macroscopic weaving-ramp framework in which individual vehicles adapt their lane choices using an evolutionary game-theoretic update rule and altruism-based objectives providing a microscopic interpretation of the original Wardrop model. We prove convergence of the decentralized dynamics to the unique equilibrium predicted by the macroscopic theory. Beyond reproducing aggregate equilibrium behavior, the framework enables the study of deployment-level questions that cannot be addressed by static analysis. Simulation results demonstrate close agreement with the macroscopic predictions while revealing how convergence rates, adaptation to changing traffic conditions, heterogeneous altruism levels among CAVs, and imperfect state information influence system performance and the distribution of altruistic burden across vehicles. These results provide a bridge between equilibrium traffic theory and decentralized mixed-autonomy deployment.

Tue 29 SeptMultiagent Systems
The gist
Traffic involving both human-driven and self-driving cars can be hard to understand, especially when these cars try to help each other. The authors created a detailed computer model where each car decides its lane based on simple rules inspired by kindness toward others. They proved that these decisions lead the whole traffic system to a steady balance, matching what bigger traffic theories predict. Their model also shows how differences between cars and imperfect knowledge affect traffic and cooperation over time.
Open → 2609.36424v1

Destination support restoration improves robot human path predictions

Destination Support Restoration for Finite-Set Multimodal Trajectory Prediction

Abstract: Robots operating around pedestrians often reason over a finite set of predicted human futures. Repeated online updates can concentrate this limited prediction budget on dominant destinations and leave plausible alternatives underrepresented or absent, removing those alternatives from the finite representation available to downstream decision making. We introduce Destination Support Restoration (DSR), a causal post-selection operator that repairs destination support without retraining the host predictor or increasing the maintained set size. At a repair step, DSR evaluates a temporary destination-stratified candidate bank from the observed prefix, converts candidate evidence into integer target counts, protects representatives of active modes, and reallocates redundant surplus hypotheses to deficient modes. The maintained and returned sets retain exactly $N$ hypotheses, and DSR replaces at most $\lceilρN\rceil$ entries. Protected representatives preserve current categorical support; lineage-aware particle filters also preserve surviving resampling ancestors. Each replacement reduces the allocation mismatch to the evidence-driven target by one. On the complete 3,719-trajectory Edinburgh protocol over three seeds, DSR reduces MIF weighted ADE and FDE by 13.36% and 13.30% at $N=64$. Paired integrations with CLiFF, PPT, causal GDTS, Social Informer, and PECNet improve both metrics in every evaluated pair. These results show that finite-set support allocation is a useful prediction-side control point when a fixed hypothesis set serves as the interface to downstream systems.

Tue 22 SeptRoboticsArtificial Intelligence
The gist
Robots predicting where people will go often choose only a few main paths, missing other possible routes. The authors came up with a way called Destination Support Restoration (DSR) that fixes this by making sure less obvious paths still show up in the predictions. This method adjusts predictions without needing to rebuild the robot’s model or add more guesses, helping robots make better decisions around people. Tests show that DSR improves accuracy in predicting human movement across multiple existing methods.
Open → 2609.25942v1

Neural method improves safety control for high dimensional robots

Gradient-Free Neural Hamilton-Jacobi Reachability for Scalable Safety-Critical Control

Abstract: Hamilton-Jacobi (HJ) reachability provides a principled framework for synthesizing safety certificates and robust controllers for safety-critical robotic systems. However, applying reachability analysis to high-dimensional nonlinear systems remains challenging: classical grid-based solvers suffer from the curse of dimensionality, continuous-time neural solvers require accurate spatial value gradients, and reinforcement-learning-based approaches often suffer from weak boundary anchoring and non-stationary adversarial policy optimization. We propose a discrete-time neural reachability framework for control-disturbance-affine systems that learns backward reachable tubes (BRTs) and backward reach-avoid tubes (BRATs) through Bellman-Isaacs value propagation. Our key idea is to combine equation-driven self-supervision with structured policy learning: rather than computing explicit PDE-gradients, we exploit the bang-bang structure of optimal safety interventions to construct approximate teacher actions from gradient-free value probes, converting adversarial actor learning into supervised policy learning. To stabilize long-horizon value propagation, we leverage the learned actor to train the value function backward from the terminal boundary using a windowed temporal curriculum, where each window is used as the boundary condition for the next window. Across benchmark problems up to 80 dimensions, our method learns accurate reachability value functions while improving stability over existing learning-based solvers. We further demonstrate observation-space scalability on F1-tenth racing with over 16,000-dimensional egocentric inputs. The learned safety filter generalizes zero-shot to unseen tracks and transfers to a physical RC car, achieving real-time robust collision avoidance.

Sat 12 SeptRobotics
The gist
Controlling robots safely, especially those with many parts or sensors, is very hard with traditional math tools because they get too complex. The authors created a new way that uses neural networks to predict safe actions for robots without needing complicated calculations of spatial information. They teach the system by simulating how safety decisions should work, making learning more stable, even for very complex robots with thousands of inputs. Their method worked well in computer tests and controlled a real small racing car to avoid collisions.
Open → 2609.14087v1

PlannerForge uses AI agents to improve self-driving car testing

PlannerForge: LLM Agents for Scenario-Based Testing of Motion Planners in Autonomous Driving

Abstract: Ensuring the safety of autonomous driving is a critical challenge. Scenario-based testing is a systematic process used to validate Autonomous Driving Systems (ADSs), but it remains a fragmented modular pipeline in which scenario generation, retrieval, modification, ADS execution, and results analysis are performed by separate tools with little interaction. Large Language Model (LLM) agents have shown promise across ADS sub-systems such as perception, planning, and control. However, no prior work covers the whole scenario-based testing pipeline for ADSs with a unified LLM-agent framework. We present PlannerForge, an LLM-agent framework that extends all scenario-based testing stages (from Scenario Generation to ADS Assessment) and adds two further LLM-enhanced stages: ADS Enhancement and ADS Benchmarking. We evaluate PlannerForge with 10 off-the-shelf LLMs across all tasks (Generation, Selection, Modification, Module Routing, Planner Testing, and Enhancement) under 5 prompt conditions. Best-per-task scores range from 0.88 to 1.00, and open-source 20-35B backends match commercial APIs on most tasks. Open-source models such as Qwen3.6:35B match commercial APIs on three of the five tasks. Chaining the modules end-to-end retains 83% / 78% of seed queries (commercial / open). It outperforms Scenario Factory 2.0 (Finkeldei et al., 2025) on natural-language generation (193 vs. 144 executable of 200) and realises 92-96% of requested city, road and vehicle attributes. It outperforms BM25 (Robertson and Zaragoza, 2009) at rank 1 selection (92.0% vs. 67.5%) and From-Words-to-Collisions (Gao et al., 2025) on physically valid edits (>=94% vs. 31%). At N=400, cost-tuning lifts planner success from 50.4% to 70.2% and cuts collisions from 19.0% to 8.4%, without domain-specific fine-tuning.

Tue 8 SeptArtificial IntelligenceComputation and LanguageRobotics
The gist
Testing self-driving cars safely is hard because many separate tools handle different parts of the job. The authors created PlannerForge, a system that uses AI language models to manage the whole process from making test scenarios to analyzing results. It can also improve the autonomous driving system itself and compare different systems. Their tests showed that PlannerForge works well using various AI models, sometimes better than existing tools, and helps make testing more efficient without extra training.
Open → 2609.08965v1