Papers for

robotics operations teams

Papers whose findings have a practical use for this group, as judged from the abstract. Open a paper to read what it means in practice.

Decision tree learns from a language model to help robots avoid freezing

Teaching a Tree to Recover: Online Distillation of an LLM Supervisor with Counterfactual Replay

Abstract: Autonomous mobile robots commonly pair a global planner with a local model predictive controller (MPC), but nonconvex obstacle avoidance and a limited horizon can make the robot freeze in complex layouts. Deciding whether to replan, wait, or call for help is a supervisory decision. Recent work queries a large language model (LLM) supervisor on every anomaly, which is slow and costly. We instead distill the LLM online into a decision tree. After each training episode, counterfactual replay labels recoveries as needed, unnecessary, or harmful. These labels retire unhelpful rules. In simulation, on 20 unseen layouts where the MPC alone freezes, the tree handles at least 18 correctly across all seeds, either by reaching the goal or by calling for help when no feasible path exists. The tree matches both an always-query LLM supervisor and expert-designed rules, while issuing no LLM queries at test time. Handwritten rules cannot anticipate the long tail of situations a physical robot will encounter. Online distillation is a promising remedy: the tree handles familiar cases, and the LLM is consulted only for new ones, whose validated recoveries become new rules. Language models can thus also serve as designers of supervisors rather than only as runtime supervisors.

Thu 29 OctRobotics
The gist
Autonomous robots sometimes get stuck because their quick obstacle-avoiding plans don't always work perfectly. The authors developed a way to teach a simple decision tree using advice from a large language model (LLM) so the robot can decide when to replan, wait, or ask for help without slowing down. The decision tree improves over time by learning from past experiences and only asks the LLM when facing new problems. This approach helps robots handle tricky situations more reliably without always needing the slower language model.
Open → 2610.39775v1

Collaborative planning improves UAV UGV teamwork under constraints

Collaborative Planning for UAV-UGV Teams under Operational Constraints via Masked Error-bounded Neuro-Symbolic Diffusion

Abstract: Collaborative planning under operational constraints is essential for heterogeneous robot teams in large-scale missions. Unmanned Aerial Vehicles (UAVs) provide rapid area coverage but are limited by onboard energy, while Unmanned Ground Vehicles (UGVs) can serve as mobile recharging stations yet are constrained by road-network traversability. Effective collaboration must enforce operational constraints during execution while enabling parallel, coordinated actions. Masked Diffusion Models (MDMs) have shown promise through token unmasking but have two key limitations: entropy-guided scheduling assumes distributional alignment and reliance on differentiable constraints for diffusion-time optimization. We propose Masked Error-bounded Neuro-Symbolic Diffusion (MEND), which formulates collaborative planning as a conditional masked generative process to generate context-aware action sequences for UAV-UGV teams. MEND introduces a neuro-symbolic diffusion paradigm that constrains conditional masked diffusion policies at execution by reweighting the learned action distribution with a logic-induced admissibility indicator, thereby enforcing compliance with operational constraints. MEND introduces an error-bounded inference scheduling at execution that constructs the unmasking schedule by selecting positions with minimal predictive entropy over the constraint-aware action distribution, enhancing collaborative planning optimality under operational constraints. Extensive experimental results in simulation, on real-world maps, and with physical robot teams demonstrate that MEND advances UAV-UGV collaborative planning under operational constraints.

Tue 13 OctRobotics
The gist
Planning joint missions for drones (UAVs) and ground vehicles (UGVs) is tricky because each has limits like battery life or road access. The authors created a new method called MEND that helps these vehicles plan their actions together while following strict rules. MEND uses a smart AI technique that checks plans against logic rules at execution time, ensuring they work in real conditions. Their tests with simulations, maps, and real robots show MEND makes their teamwork better.
Open → 2610.18850v1

Mixed reality system improves control of multi-robot teams

MRPilot: Supervising and Intervening LLM-Based Multi-Robot Teams through Mixed Reality

Abstract: Large language models (LLMs) let users direct heterogeneous multi-robot systems (MRS) through natural language, but make task interpretation, robot assignment, and coordination difficult to inspect and change. Based on a formative study with 12 non-expert users, we developed MRPilot, a mixed reality system organized around four stages of supervision and intervention. MRPilot represents robot-team plans and execution states as structured commitments shared across synchronized situated and overview views. Across four stages, it helps users resolve ambiguous references (Forming), review plans before execution (Reviewing), monitor distributed execution (Following), and make robot-level or team-level changes when problems arise (Repairing). In a within-subjects study with 20 participants in a virtual reality-simulated home, MRPilot reduced workload, increased situational awareness, transparency, trust, and perceived control compared with a conventional LLM-based conversational interface using the same LLM planner and robot capabilities. We provide design implications for multi-scale intervention, adaptive supervision, and calibrated reliance in LLM-based MRS.

Mon 5 OctHuman-Computer InteractionRobotics
The gist
Coordinating teams of different kinds of robots using natural language can lead to confusion and mistakes. The authors created MRPilot, a mixed reality tool that lets people see and manage robot plans and actions more clearly. It helps users fix unclear instructions, check plans, watch robots working, and intervene if problems happen. In tests, MRPilot made users feel more confident, aware, and in control compared to just talking to the robots through chat. This system shows new ways to better supervise and adjust robot teams using language.
Open → 2610.07477v1