Papers for

software developers integrating ai tools

Papers whose findings have a practical use for this group, as judged from the abstract. Open a paper to read what it means in practice.

Object-oriented harnesses improve language model task handling

Object-Oriented Harness: Evolving Agent Harnesses through Object-Oriented Design

Abstract: Agent harnesses are executable code that specifies the prompts, tools, and control flow around a language model. A single global harness can struggle with heterogeneous tasks that require different execution strategies. In this work, we introduce Object-Oriented Harness (OO-Harness), a harness optimization framework that evolves a hierarchy of executable harness classes using object-oriented design. During training, an evolution agent uses execution records to create a family of specialized harnesses, each implemented as a subclass of the base or an existing specialized harness via inheritance. At test time, a harness router uses routing lessons accumulated during training to select a specific harness for each task. Across three long-horizon benchmarks spanning business workflows, workspace tasks, and tool use, OO-Harness achieves the best performance among the compared methods, with an absolute improvement of up to 15% over the base. Extensive ablation studies examine the contributions of its core components.

Tue 20 OctComputation and LanguageSoftware Engineering
The gist
Language models often need extra code, called harnesses, to guide how they use prompts and tools for different tasks. A single harness might not work well for all kinds of tasks that need different handling. The authors created a way to evolve many specialized harnesses arranged in a hierarchy using object-oriented programming ideas, so each task can use the best one. Their system learned how to pick the right harness for each task and was tested on different complex benchmarks, showing better results than simpler methods.
Open → 2610.28380v1