Papers for

medical form processors

Papers whose findings have a practical use for this group, as judged from the abstract. Open a paper to read what it means in practice.

Autonomous system improves language agent task performance and cuts cost

AutoOnboarder: Autonomously Onboarding LLM Agents

Abstract: Agentic large language models have been documented to lose reasoning capability when placed inside a harness, the software that mediates their observations and actions. To reconcile these losses, we introduce AutoOnboarder, an autonomous system that adapts an agent to a task the way a trainer onboards a new employee. It places the agent under the supervision of an intelligent ``Onboarder'' coding agent, which iteratively tailors its foundation model, prompt, and harness source code to simultaneously improve performance and decrease cost. Like a real onboarding process, the Onboarder is only given tens of examples, and all evaluation data is isolated on a separate virtual machine to prevent leakage. We report the lessons learned from building and testing AutoOnboarder on genomic-sequencing prior authorization form submission. Autonomously onboarded agents are able to match or exceed the performance of a Gemini 3.5 Flash baseline at up to 29$\times$ lower costs. However, these agents remain imperfect, and the Onboarding process varies greatly in terms of final performance. We conclude that future Onboarding systems require a robust environment for the Onboarder, including a structured thought interface, (controlled) internet access, and a wide model search space.

Thu 15 OctArtificial Intelligence
The gist
When large language model agents are put to work on tasks via software called a harness, their reasoning skills often get worse. The authors created AutoOnboarder, a system that acts like a trainer, teaching the agent how to do the task better by adjusting how it works and what it sees. This improvement happens with only a small number of examples and without the agent seeing test data ahead of time. Their experiments with filling out complex medical forms show their approach can match or beat a strong baseline model while using much less computing power. Still, the system's success varies and more advanced features like internet access might help future versions.
Open → 2610.21218v1