Nonuniformity Principle in Human-AI Coworking
Artificial Intelligence
Summary
The authors looked at how people and AI can work together on long tasks, like writing or building websites. They noticed that having humans check the AI's work at certain points makes people happier and reduces wasted effort. They studied the best way to pick these check points and found that checks should be spaced out with increasing gaps as the task goes on. This helps balance the need for human oversight with the efficiency of AI.
Authors
An Luo, Jie Ding
Abstract
As generative AI is increasingly applied to automate multi-step and high-stake workflows, human judgment and involvement remain essential for ensuring the quality of AI-generated outputs. In practice, while it is desirable for human experts to provide oversight on AI regularly, often by reviewing intermediate outputs, giving feedback, making corrections, and steering subsequent steps, such oversight is constrained by the time and resources that humans can afford. This creates a tension between the need for human oversight and AI's efficiency in delivering more output with less intervention. An important but underexplored question, then, is how to optimally engage humans in human-AI coworking. This work was originally motivated by our empirical observation that in long AI workflows, human oversight often improves user satisfaction while reducing unnecessary rework and token consumption. From there, we formulate the problem of where to place oversight stages in human-AI coworking. Under reasonable assumptions, we then develop the nonuniformity principle, which states that the optimal schedule places oversight stages with non-decreasing gaps along the workflow. We empirically validate this principle in two common AI agent workflows: writing literature reviews and constructing websites.