Unitboost improves compound AI systems with transparent output merging
UnitBoost: Managing Compound LLM Systems with a Merge Operator, Not a Model
Artificial IntelligenceComputation and LanguageMultiagent Systems
Summary
Large language models (LLMs) that work together usually need a special manager model to combine their answers. The authors show that this manager doesn’t need to generate text to do its job. Instead, their approach called UnitBoost uses a clear method to pick the best parts from each model's answer, making the system easier to understand, less sensitive to order, and more reliable. Tests on several tasks showed UnitBoost gave better final answers than other ways of managing multiple LLMs.
What this means in practice
- •For ai system engineers: Improve multi-LLM coordination by replacing generative managers with transparent merge operations, enhancing reliability and interpretability.
- •For software developers building ai tools: Use residual-directed multi-round integration to boost performance in compound question answering systems.
Authors
Xing Zhang, Guanghui Wang, Yanwei Cui, Mengdie Flora Wang, Peiyang He
Abstract
Compound LLM systems often solve a coordination problem by adding a higher-level LLM. The resulting meta-agent reads workers' outputs, writes the final answer, allocates later calls, and decides when to stop. It is expressive, but it also concentrates three control decisions in an opaque, order-sensitive model call. We ask whether the manager needs to be generative at all. UnitBoost replaces that model with a defined meta-level operator: a task-given unit map turns worker outputs into slot-value proposals, a constrained argmax assembles the output, and the slots left unfilled or unsupported become an explicit residual for the next round. The operator is order-free, records unit provenance, and gives a simple guarantee: without coupling constraints, unit-wise maximization under the same admission score dominates selection of any complete candidate. On three held-out benchmarks, it exceeds the best single candidate chosen with gold labels by 0.060-0.195 absolute task-score points and input-matched generative managers by 0.048-0.076. Replacing only the management step improves six compound-system configurations by 0.013-0.182. Residual-directed rounds raise FanOutQA cell F1 from 0.4778 to 0.5524; matched controls show that the true residual outperforms random targets and ordinary rereading, while a label-free supply signal flags exhaustion after one unproductive round. The same analysis measures three conditions in which no such gain is available (one indivisible unit, unavailable unit identity, and an endpoint that charges for every emitted unit) and quantifies cross-unit coupling as a repair cost. The manager gives up semantic freedom and gains order invariance, unit provenance, and testable failure conditions.