Papers for

industrial automation managers

Papers whose findings have a practical use for this group, as judged from the abstract. Open a paper to read what it means in practice.

AI agents not instantly useful for industrial robot programming

Can AI Agents Help Robotic Engineers? Lessons from Two Focus Days in Industry

Abstract: Software developers increasingly use AI agents that execute multi-step programming tasks on their own. However, it is unclear if and how this transfers to robotic engineering, where engineers program industrial robots in niche, vendor-specific languages and rely on visual feedback from simulation tools. Within this paper, we report a case study on the use of AI agents by an SME that programs industrial robots. Our results show that the agent did not make the engineers more productive, with the exception of a task that required the generation of highly repetitive code. However, the results with the agent improved over time, as the engineers learned how to use it and the agent was adapted to the domain. Moreover, the experience with AI mattered more for the success with the agent than the experience with robotic engineering. This shows that AI agents are not a plug-and-play solution. Instead, companies must train their engineers on the usage of agents, plan time for a learning curve, and ensure that agent configurations match the domain and developer requirements. The strong learning curve we observed further implies that studies on productivity gains with AI should be longitudinal, as they otherwise miss how engineers adopt agents in practice.

Fri 23 OctSoftware EngineeringArtificial Intelligence
The gist
Using AI agents that can write code on their own works well for some software developers, but robotic engineers program robots using special languages and tools, which makes it different. The authors studied a small company that codes industrial robots using AI agents, and found that the AI helped mainly with repetitive coding tasks, but didn’t make the engineers faster overall. However, the engineers got better at using the AI over time, and the AI improved when adapted to the robot programming domain. The study shows that companies need to invest effort and time to train engineers and customize AI before it becomes truly productive.
Open → 2610.32636v1

Mixed reality system improves control of multi-robot teams

MRPilot: Supervising and Intervening LLM-Based Multi-Robot Teams through Mixed Reality

Abstract: Large language models (LLMs) let users direct heterogeneous multi-robot systems (MRS) through natural language, but make task interpretation, robot assignment, and coordination difficult to inspect and change. Based on a formative study with 12 non-expert users, we developed MRPilot, a mixed reality system organized around four stages of supervision and intervention. MRPilot represents robot-team plans and execution states as structured commitments shared across synchronized situated and overview views. Across four stages, it helps users resolve ambiguous references (Forming), review plans before execution (Reviewing), monitor distributed execution (Following), and make robot-level or team-level changes when problems arise (Repairing). In a within-subjects study with 20 participants in a virtual reality-simulated home, MRPilot reduced workload, increased situational awareness, transparency, trust, and perceived control compared with a conventional LLM-based conversational interface using the same LLM planner and robot capabilities. We provide design implications for multi-scale intervention, adaptive supervision, and calibrated reliance in LLM-based MRS.

Mon 5 OctHuman-Computer InteractionRobotics
The gist
Coordinating teams of different kinds of robots using natural language can lead to confusion and mistakes. The authors created MRPilot, a mixed reality tool that lets people see and manage robot plans and actions more clearly. It helps users fix unclear instructions, check plans, watch robots working, and intervene if problems happen. In tests, MRPilot made users feel more confident, aware, and in control compared to just talking to the robots through chat. This system shows new ways to better supervise and adjust robot teams using language.
Open → 2610.07477v1