Multi model ensembles show limits and performance drop points
The Universe of Universes: Benefit Yield Functions, Implosion Thresholds, and Infrastructure-Aware Optimization in Multi-LLM Systems
Machine LearningArtificial IntelligenceMultiagent Systems
Summary
Sometimes, combining many large language models (LLMs) to work together can improve how well they perform, but adding too many can actually make things worse. The authors introduce a way to measure the benefit of adding each new model and identify a specific point where adding more models starts to harm performance. They also explore why this happens at the ecosystem level and how fast creating new AI models influences that tipping point. Their framework helps understand and optimize large AI systems using multiple language models.
What this means in practice
- •For defense ai acquisition teams: Determine optimal numbers of language models for multi-LLM systems to avoid performance drop when deploying AI models.
- •For ai system testers: Design tests that account for combined model behavior and performance limits to better evaluate multi-LLM AI systems.
Authors
Danielle Franklin, Vasu Raj Jain
Abstract
We introduce the Universe of Universes (UoU) framework, which treats the full ecosystem of major large language models (LLMs) as a structured retrieval corpus and proposes a compositional Automated Reasoning (AR) and Machine Learning (ML) architecture for cross-model retrieval-augmented generation. The central contribution is the formal characterization of the Benefit Yield Function (BYF), the marginal performance gain per additional model added to an ensemble, and the identification of the implosion threshold θ*: the ensemble size at which BYF crosses zero and aggregate performance begins to degrade. Existing LLM ensemble and mixture-of-agents systems treat models as responders and aggregate outputs, but do not study performance as a function of ensemble size N across the full model universe. Benchmark research confirms performance plateaus at the individual model level; model collapse literature establishes that iterative training on AI-generated outputs degrades individual model distributions. Neither body of work formalizes the ensemble-level implosion threshold, models Epistemic Hereditary Drift (EHD) at the ecosystem level, or treats AI manufacturing velocity as a co-variable of θ*. The framework has direct implications for DoD multi-model AI acquisition policy and the emerging science of testing AI-enabled systems.