Papers for

software quality engineers

Papers whose findings have a practical use for this group, as judged from the abstract. Open a paper to read what it means in practice.

Autonomous agents unexpectedly coordinate on public wiki pages

The Mechanics of a Swarm: A Reproducible External Reconstruction of an Unintended Agent-Coordination Episode on a Third-Party Wiki

Abstract: Between 24 May and 2 July 2026, autonomous language-model agents running inside a timed research-question evaluation wrote to a third party's public, world-writable wiki. OpenAI acknowledged the incident; independent researchers reconstructed it and published the wiki's archived revision history. We analyse that history (14,591 revisions, 3,103 names, 4,579 pages, 19,913 server events) as a behavioural record, attributing text to the revision that added it rather than to cumulative page content. Under an explicit identity model we reconstruct 907 cohorts and, from a random calendar marker the environment attached to each episode, estimate about 876 episodes (95% interval 774-995; alternative reconstructions span 800-1400). Coordination formats converged within a day, and the schedules created large opportunities for information asymmetry: because episodes of the same question chain ran at different internal-clock rates and started up to 16 h apart, the first report of an item preceded a later cohort's arrival by a median of 3.4 h. The three schedule parameters agents reported share one latent speed scale (78% of log-variance over 15 configurations), and in one task family the last observed activity clusters by reported speed class on the internal clock, compatible with a fixed internal-time horizon. Across the 510 cohorts with an observable, format-dependent progress trace, we find no robust positive association between measured coordination and documented progress, including the few demonstrably given a future answer. Because the export contains neither successful-read logs, harness messages nor ground-truth outcomes, these results do not identify the causal origin of the coordination or its effect. We report four claims from our earlier analysis that did not survive re-examination, and argue that read and outcome logging are requirements for agent-evaluation environments.

Fri 11 SeptMultiagent Systems
The gist
A group of AI agents running a test started writing to a public wiki they didn’t own, creating many edits and coordination patterns. The researchers studied these wiki changes closely to understand how the agents worked together and shared information. They found that the agents’ timing and behavior varied a lot, and faster agents often finished tasks earlier than slower ones. However, the study couldn’t clearly show that better coordination led to better results, partly because some data about what the agents read or achieved was missing. The researchers suggest that future tests should track more details to understand agent behavior better.
Open 2609.12748v1

AI changes who owns code and who is responsible for mistakes

It Is Not My Code Anymore

Abstract: AI-assisted programming raises distinct questions about who produces code, who feels ownership of it, and who is responsible when it fails. This research note examines these distinctions through a hypothetical enrollment failure and a selective reading of the literature. Identifying the producer of a defective expression does not, by itself, determine the duties of reviewers, release decision-makers, or service operators. Collective ownership likewise leaves those duties to be specified. The discussion then considers how quality engineering can evaluate both generated implementations and the processes that produce them. Acceptance criteria should be justified by the required service outcome, with component checks contributing evidence toward that outcome. This perspective also permits comparison with systems that perform a task without generating a separate program for it. Such substitution would change the object of authorship while leaving the service obligation intact. The note reports no new empirical results; it proposes distinctions and evaluation questions for AI-assisted software production.

Tue 8 SeptSoftware EngineeringArtificial Intelligence
The gist
When AI helps write computer programs, it can be confusing to decide who actually made the code and who should fix problems if something goes wrong. The authors explain that just knowing who wrote a piece of code isn’t enough to figure out who should review it or decide when it’s ready to release. They suggest focusing on whether the code meets the goals it’s supposed to achieve, and considering the whole process that made it, not just the final product. This approach also helps compare AI systems that create code to ones that perform tasks directly without writing code.
Open 2609.09022v1