Efficiently finding profitable AI model inference mixes despite complexity
Circumventing the Computational Hardness of Computational Arbitrage
Artificial Intelligence
Summary
Buying AI model predictions from multiple providers at different costs can create a chance to resell combined services for profit, but figuring out the best way to do this is usually very hard. The authors showed that while the problem is generally tough to solve, under realistic conditions it can be handled efficiently. They also developed a way to estimate models’ performance with less data. Their findings explain how arbitrage benefits users and providers by favoring models that provide more value per dollar spent.
What this means in practice
- •For ai marketplace operators: Determine efficient pricing and allocation strategies for large pools of AI models to optimize profit and consumer value.
- •For cloud infrastructure managers: Identify subsets of AI models to fund and deploy that maximize utility per dollar under realistic cost-performance trade-offs.
A theory result. No direct application yet.
Authors
Nastaran Okati, Ricardo Olmedo, Moritz Hardt
Abstract
AI model marketplaces host providers with heterogeneous costs and capabilities. These differences create an opportunity for computational arbitrage (Olmedo et al., 2026), in which an intermediary purchases inference from a portfolio of models and resells it to users at a profit. Beyond creating profit opportunities for the arbitrageur, computational arbitrage offers financial value to both consumers and providers and could therefore significantly influence AI model markets. While prior work empirically demonstrates the feasibility of computational arbitrage for small model pools, scaling it to large marketplaces requires arbitrage strategies that are both computationally tractable and inexpensive to identify and deploy. In this work, we formalize computational arbitrage as an allocation problem and prove that it is generally NP-hard. However, we show that the optimal allocation can be computed efficiently under a natural diminishing-returns condition on how model performance scales with inference spending. We further develop a sample-efficient method for estimating model performance from limited data, reducing the upfront cost of identifying arbitrage strategies. Our analysis also yields several economic insights: at the optimum, every funded model delivers the same marginal utility per dollar; arbitrage directs revenue away from providers offering little utility relative to their prices; and it rewards complementary specialization.