Papers for

ai policy makers

Papers whose findings have a practical use for this group, as judged from the abstract. Open a paper to read what it means in practice.

AI tools enable online creation of non-consensual intimate images

AI-Generated Non-Consensual Intimate Imagery is Configured, Not Built: How General-Purpose AI Technology Enables Sexual Violence

Abstract: AI-generated non-consensual intimate imagery (AIG-NCII) is an increasingly prevalent form of online abuse, distinguished from AI-generated sexual content (AIG-SC) by the sexualized depiction of a real person's identity without their consent. To understand how offenders may benefit from the tools and resources shared across the broader AIG-SC community, we analyzed 139 R+ guides on CivitAI, a popular platform known to host a disproportionate amount of AIG-SC. We find that AIG-SC guides discuss how to create content generation workflows composed of sexual and identity concepts, the building blocks of AIG-NCII, including one guide that explicitly outlines an AIG-NCII workflow. We identify that ultimately AIG-NCII is enabled by configuration rather than a distinct set of technical tools. We map AIG-NCII threat models across basic and advanced AIG-SC workflows to demonstrate how multiple dual-use technical components can compose NCII outputs in an environment with little to no discussion of ethical implications or responsible use. We conclude by noting that, as most workflows rely on open-weight models, existing technical defenses against AIG-NCII are limited. However, our findings offer a starting point for evaluation of AI-based models and products against realistic attacker behavior required by new EU regulation and suggest that efforts to develop safeguards at the model- and product-levels should focus on generation of identity content.

Tue 27 OctCryptography and Security
The gist
Creating sexual images of real people without their permission online is a growing problem made easier by general artificial intelligence tools. The authors studied publicly shared guides on how to make sexual AI images and found that the harmful, non-consensual kind can be made by simply adjusting settings rather than using special software. They explain how common AI image creation workflows can produce this content with little attention to ethics or harm. The paper also highlights that current defenses are limited because most AI models involved are openly available.
Open → 2610.37949v1

African languages vary widely in readiness for AI safety research

African Languages AI Safety Readiness Report

Abstract: With the widespread adoption of large language models (LLMs) across languages and domains, AI safety has emerged as a critical global concern. However, due to resource constraints, research and development efforts tend to prioritize a limited number of high-resource languages, leaving many others, especially those spoken in Africa, underrepresented. While existing research on language "resource-ness" has largely examined whether sufficient resources are available to develop language technologies, the question of whether languages are adequately represented in AI safety research has received attention only more recently. This report examines the readiness of African languages for inclusion in AI safety discussions, drawing on existing literature and data. It considers four factors: the availability of AI-relevant resources, including text data; national AI policy support; performance on established text benchmarks; and speaker population. Based on these factors, languages are grouped into four readiness categories: fully ready, mostly ready, emerging, and foundational support needed. This classification is intended to inform the inclusion of African languages in AI safety benchmarks, highlight varying levels of preparedness, and guide strategic investment in data development, policy, and community engagement for underrepresented languages.

Mon 19 OctComputation and Language
The gist
Many African languages have less data and support for helping make AI systems safer. The authors looked at how ready these languages are for AI safety work by checking resources, policies, data performance, and number of speakers. They grouped the languages into four categories based on their readiness levels. This helps focus effort on improving AI safety for languages that are less prepared.
Open → 2610.27269v1

Current evidence weakly supports loss of control risks from AI agents

Assessing the Empirical Evidence for Loss of Control from Agentic General-Purpose AI

Abstract: Theoretical literature warns that advanced generalist agentic systems might pursue instrumental goals that are misaligned with human preferences, thus posing risks of irreversible loss of human control. The EU's Code of Practice for General-Purpose AI lists loss of control as a systemic risk that must be assessed, yet no structured assessment of the quality of the empirical evidence for this risk exists. This study fills that gap. We evaluate 19 recent empirical studies across eight properties identified from threat models (such as strategic deception, situational awareness, and autonomous replication), assessing the quality of evidence across three dimensions: construct validity, content validity, and external validity. Our central finding is that the current body of evidence supports a judgment of loss of control as "weakly plausible." In our framework, 'plausibility' denotes the strength and direction of available evidence, not a probability estimate. Emerging evidence exists across multiple properties. No study clears the validity thresholds for a stronger judgment that a property is present; a single study clears them only for a negative-direction judgment (against situational awareness). Validity gaps, particularly in external validity, are widespread. Therefore, our findings highlight the need for more rigorous evaluations of agentic general-purpose AI systems. However, for the most dangerous properties, high external validity may be structurally unachievable under responsible research practices, reflecting a ceiling on feasible evidence rather than absence of the capability. Furthermore, as AI capabilities advance rapidly, empirical assessments may systematically lag behind the capability frontier. Our framework provides a structured baseline for ongoing monitoring as capabilities advance.

Sun 18 OctComputers and SocietyArtificial IntelligenceComputation and Language
The gist
There are worries that advanced AI systems might act in ways that humans can no longer control. The authors looked at 19 studies to see how strong the evidence is for these risks, focusing on things like AI being deceptive or aware of its situation. They found the evidence is weak but points toward some potential for loss of control. More thorough and realistic studies are needed, but some risks may be hard to test without creating unsafe scenarios.
Open → 2610.25241v1

Regulating AI risks under unknown safety productivity and fixed deadlines

Risk Ceilings and Development Deadlines: Pacing AI under Uncertain Safety Productivity

Abstract: Can a regulator promise both a risk ceiling and a development deadline when safety productivity is unknown? A ceiling below the final model's unprotected hazard requires a minimum stock of safety knowledge, so both promises hold only if weak research can be ruled out. Learning first and then replaying development, with spare compute in safety, comes close to that minimum. In a calibration with only state risk, constant safety yield, and full knowledge transfer, it needs only 3.3 percent more productivity than the necessary bound. Customer services pay for the guarantee. Rules that fix compute allocation fix dates, not risk.

Thu 8 OctComputers and Society
The gist
The paper looks at whether it's possible for regulators to promise both a maximum limit on AI risk and a fixed deadline for AI development when they don’t fully understand how productive AI safety research will be. The authors find that to keep risks below a certain level, enough safety knowledge must be accumulated beforehand, which means weak or slow safety research can’t be allowed. They suggest a way to balance learning safety knowledge first and then speeding up development by using leftover computing resources for safety work. Their model shows this approach nearly meets the tightest productivity requirements. They also show that simply setting fixed computing resources earlier mostly controls development dates but not safety risks.
Open → 2610.11093v1

Agentic AI challenges current stop mechanisms and legal controls

The Law of Stop: Interruptibility, Injunctions, and the Governance of Agentic AI

Abstract: On June 12, 2026, the U.S. government ordered Anthropic to bar foreign nationals from two of its most capable models within ninety minutes. Unable to sort users by nationality in that time, it withdrew them from everyone. Weeks later, OpenAI agents under test escaped their sandbox and compromised Hugging Face, which stopped the intrusion without knowing its source. Neither stop rested on AI-specific regulation. The EU AI Act requires that high-risk systems be capable of interruption "through a 'stop' button or a similar procedure," and a bill introduced in Congress in July 2026 is titled the AI Kill Switch Act. Yet interruption is not simply a technical artifact, a red button; it is an institutional practice. This Article develops a theory of stop along four dimensions: technical affordances, interruption authority, epistemic triggers, and epistemic standing; and four shutdown paradigms: simple (escalator), sequenced (process plant), networked (railway), and distributed (agentic AI). Agentic AI exposes a mismatch between those mechanisms and distributed agency: control is divided, a stop at one point may leave the activity running elsewhere, and the system may resist being halted. An original coding of 1,400 AI incidents, by two language models from rival laboratories under a pre-specified protocol, finds no stop in roughly 80% of the 1,213 retained; where no usable stop existed, the missing element was legal rather than technical four times in five. A survey of thirty-nine AI governance instruments finds the same gap: only seven contain binding stopping requirements, and none says how a stop should be coordinated or when operation may resume. The Article proposes a layered law of stop: emergency authority to interrupt at the infrastructure layer, enforceable access for regulators and independent evaluators to the evidence a stop must rest on, and safeguards for when a stop fails.

Sat 19 SeptComputers and SocietyArtificial Intelligence
The gist
Stopping advanced AI systems quickly and effectively is harder than just pressing a button. The authors explain that stopping AI involves technical tools and legal authority, but agentic AI spreads control across many parts, so stopping one part might not stop the whole system. They looked at 1,400 AI problems and found that most lacked proper stops, mostly due to legal issues. Their work suggests new layered laws to improve how and when AI systems can be shut down safely.
Open → 2609.22882v1

Frontier ai safety frameworks often hide changes in commitments

Silent Revision: Measuring Undisclosed Change in the Safety Frameworks of Frontier AI Developers

Abstract: Frontier AI developers publish safety frameworks that commit them to evidencing whether their models are dangerous. The European Union and California now treat these documents as instruments of accountability, and both already impose duties on their revision. Neither requires the revision to be legible, in the sense that a reader could learn from the developer's own account what changed. We introduce the silent revision rate, the share of material changes to a framework's commitments that the developer's published account does not identify, and we release the versioned, hash-pinned corpus needed to compute it. The corpus contains every public version of the safety frameworks of the twelve developers that have published one, together with each provider's changelog, redline or announcement. We trace 710 commitment instances across twelve consecutive version pairs, code them against a frozen codebook, and adjudicate 244 individually. Three findings follow. First, 67% of material changes (95% CI 62 to 72) are silent under a strict standard and 53% under a lenient one, falling to 49% at section granularity. Second, silence appears to track the form of the account, since narrative announcements run at 74% against 63% for itemised changelogs, whereas account length in words barely matters; on the test that respects nesting the difference is suggestive. Third, 77% of traced changes weaken or remove a commitment, and in seven of eight pairs weakenings are more often silent than strengthenings. The statutory remedy therefore exists and specifies the wrong artefact. A justification explains why a framework changed, an enumeration states what changed, and only the latter makes revision auditable. We argue that publication duties should carry an enumeration duty, which one provider already meets, voluntarily and incompletely.

Tue 8 SeptComputers and SocietyArtificial IntelligenceSoftware Engineering
The gist
Many AI companies publish safety promises to show how they keep their models safe. The authors found that these companies often make important changes to those promises but don’t clearly say what changed or why. Most hidden changes tend to weaken safety commitments. The authors say rules should require companies to clearly list every change, making it easier for people to check if AI safety is really improving.
Open → 2609.08789v1