Papers for

system engineers

Papers whose findings have a practical use for this group, as judged from the abstract. Open a paper to read what it means in practice.

System design improves with contracts using agent delegation quotient

Contract-Based Agentic Systems Engineering: Delegation as Quotient for Assured System Design

Abstract: A component an agent builds from a prompt can satisfy it and still break the system it joins, because the prompt omits what its neighbours assume of it. The artifact to hand over is computed, not written. A SysML v2 requirement with assumed and required constraints is an assume/guarantee contract, so when a system requirement is decomposed over fixed neighbours, the open component's requirement is the contract quotient, the weakest sound one, and again a SysML v2 requirement. Its required constraints carry the neighbours' assumptions, which a requirement for the mission alone drops and unit tests with mocked neighbours cannot reach. Signal Temporal Logic is closed under the quotient. We build the requirements, with derivation, allocation, satisfaction and verification, as a SysML~v2 model and compute the quotient from it. A case study delegates the local controller of a simulated warehouse robot, whose route crosses a worker's path and ends at a dock, to one language model under the quotient requirement, a mission-only requirement and a natural-language task, and scores the deliveries on live episodes against the system requirement from ground truth.

Fri 23 OctRobotics
The gist
When building complex systems with many parts, a new part can meet its instructions but still cause problems because it misses what other parts expect from it. The authors show how to create a precise contract for this new part by calculating a 'quotient' that captures all assumptions from its neighbors. This method uses formal requirements language and logic to ensure parts fit together properly. They tested this by having an AI control a robot in a warehouse following these contracts and compared different instruction types to see how well it met overall system goals.
Open → 2610.33349v1

Strategies for choosing update timing cut resource waste and performance loss

Learning When to Update: A Near-Optimal Timing Bandit Approach

Abstract: Systems operating in dynamic environments require timely updates to sustain performance. For resource-intensive systems such as machine learning models and digital twins, strategically timing updates is essential. Updating too frequently wastes resources, while updating too infrequently leads to costly performance degradation. The problem is particularly challenging when the system's degradation pattern is unknown a priori, as is common in new operating environments. We formalize this challenge as a novel \emph{timing bandit} problem, where each arm represents a candidate update interval with a fixed update cost and an unknown, stochastic degradation cost. Three structural properties distinguish this setting from standard multi-armed bandits: selecting an interval commits the learner to multiple time slots before the next update; arm costs are composed of per-step degradation costs and a fixed update cost; and selecting a longer interval naturally reveals degradation at every intermediate step, providing consecutive feedback relevant to shorter intervals. By exploiting these structures, we develop Balanced Consecutive Arm Elimination (BCAE). BCAE achieves $\tilde{O}(\sqrt{T})$ regret, improving upon the $\tildeΩ(K\sqrt{T})$ regret of standard bandit algorithms in this setting, where $K$ is the number of candidate update intervals. We further propose an Optimism-Enhanced variant (OE-BCAE) that integrates lower-confidence-bound principles to improve empirical adaptivity while preserving the same regret order. Moreover, the regret bound achieved by our algorithms matches the theoretical lower bound up to logarithmic factors. Simulation results demonstrate that our algorithms achieve low regret and remain stable as both the number of arms and the update cost vary.

Tue 29 SeptMachine Learning
The gist
Systems like AI models or digital replicas need to update regularly to keep working well, but updating too often wastes effort and updating too rarely lets them perform badly. The authors studied a situation where the way performance gets worse over time is unknown. They created a new way to pick when to update by treating it like a game where each choice covers multiple time points and feedback comes in continuously. Their approach learns to update at near-best times, reducing wasted updates and poor performance.
Open → 2609.37932v1

AI trust calibration testbed reveals gaps in risk assessment policies

CRiDiT: Instantiating a run-time testbed for trust calibration in AI-infused systems

Abstract: The integration of AI into larger technical infrastructures has made the alignment of human trust with system trustworthiness, known as trust calibration, a critical engineering concern, since misplaced trust in either direction leads to operational and safety risks. While conceptual frameworks provide a strong foundation for understanding trust calibration, their translation into running systems remains a challenge, because there are few testbeds in which human trust inputs, machine trustworthiness evidence, gap detection and remediation operate together within a closed loop. This paper instantiates CRiDiT (Computational Risk-Sensitive biDirectional Trust) as a run-time testbed, operationalising machine-side trust with Dempster-Shafer Theory and PCR5 redistribution, human-side trust with Subjective Logic, and calibration with a threshold-based trust gap. Following the Design Science Research methodology, we exercise the artifact across three high-stakes scenarios (hiring, financial, legal), producing 144 logged interaction steps across fifteen sessions. The analysis shows that the artifact captures trust calibration dynamics as intended, and reveals three points at which the instantiated policy departs from its design requirements: the machine-side estimate begins from a global benchmark rather than task-relevant evidence; risk-sensitive thresholds do not produce risk-sensitive triggering; and the calibration policy assigns explanatory prompts to over-trust, where corrections narrowed the gap in all 6 observed cases. Since the first two arise from the same design decision, to make the difference of two estimated scalars the calibration criterion, they point toward a common requirement: that the criterion should operate on the evidence rather than on scalars derived from it. The third concerns what follows detection, and shows that the action vocabulary inherited from trust repair does not align with what the interaction logs show to be effective. The work contributes the artifact, a characterisation of its run-time behaviour, and the requirements this characterisation elicits.

Mon 21 SeptHuman-Computer Interaction
The gist
When people use AI systems, it's important their trust matches how reliable the system really is to avoid mistakes or dangers. The authors built a working testbed called CRiDiT that tracks how human trust and AI trustworthiness interact in real time and checks for mismatches. They tested it in hiring, finance, and legal scenarios, finding that some parts of the system's method to detect and fix trust gaps didn't work as expected. This shows that trust calibration needs to focus on the underlying evidence rather than just summary numbers, and that how the system reacts after detecting over-trust should be improved.
Open → 2609.24833v1

Limits found on fair job scheduling methods for unrelated machines

Universally truthful mechanisms for scheduling

Abstract: We consider universally truthful randomized mechanisms for the problem of scheduling $m$ jobs on $n$ unrelated machines. We prove a lower bound on the expected approximation ratio of every such mechanism whose probability distribution has discrete support. We show that no universally truthful randomized mechanism in this class can achieve approximation ratio smaller than $n/12 - o(n)$ with respect to the optimal makespan. We match this, up to a constant factor, by a mechanism with approximation ratio $n/2 + o(n)$.

Fri 11 SeptComputer Science and Game Theory
The gist
Scheduling many jobs on different machines that work in unrelated ways is a tricky problem. The authors studied a special kind of scheduling method that is always truthful in a randomized way, meaning machines have no incentive to lie about their speed. They found a mathematical limit showing these methods can’t schedule jobs too efficiently compared to the best possible solution. They also gave a method that nearly matches this limit, showing the bound is close to the best we can do.
Open → 2609.12621v1