Papers for

ai platform providers

Papers whose findings have a practical use for this group, as judged from the abstract. Open a paper to read what it means in practice.

Collaborative agent systems outperform solo developers in accuracy

The Wealth of Agents: Scaling Agentic AI Across Developers

Abstract: Today's agentic systems are typically designed, built, and deployed by single developers with full control over all participating agents. While this simplifies development, it limits the potential scale of agentic systems. We study multi-developer agentic systems (MDAs) which enable developers to collaboratively build agentic systems to push frontier capability beyond what any individual developer could achieve alone. We construct empirical and theoretical models of developers to compare MDAs with single-developer agentic systems (SDAs). On GAIA, a general assistant benchmark, a population of specialized developers whose individual agents do not exceed 35% accuracy reaches 70% when their agents are combined in an MDA. This MDA performs 12 percentage points above the median general-purpose SDA built with several times each specialist's development budget. Our theoretical models show how MDAs can incentivize specialization and encourage more efficient use of aggregated developer resources. Put together, our results make a preliminary case for MDAs as a new scaling axis by enabling developers with diverse capabilities and resources to advance agentic AI collaboratively.

Wed 14 OctArtificial IntelligenceMultiagent Systems
The gist
Building AI systems with multiple developers working together can create better performing agents than those made by individuals working alone. The authors found that when specialized developers combine their efforts, their overall system can be much more accurate. Their models show that collaboration encourages developers to focus on their strengths and use resources more efficiently. This suggests that teamwork in AI development can push capabilities beyond what single developers can achieve.
Open → 2610.20518v1

Vulnerable ai models widely used across many open source projects

Vulnerable Models in the AI Supply Chain: An Empirical Study of Adoption, Propagation, and Usage Patterns

Abstract: The rapid integration of Artificial Intelligence (AI) models has established a complex supply chain, but many of these shared artifacts harbor severe vulnerabilities such as insecure serialization and architectural backdoors. While prior efforts have extensively scanned model registries to flag malicious artifacts, a critical gap remains in understanding how developers actually adopt and integrate these unsafe models into downstream software systems. We bridge this gap by conducting a large-scale empirical study on the usage and propagation of 16,977 known vulnerable models on HuggingFace flagged by InsightDB. We track their prevalence across GitHub repositories, software packages, fine-tuning chains, and deployed applications. Our analysis reveals that, despite being publicly flagged, these vulnerable models appear in over 21,000 code locations across more than 5,000 open-source repositories, with 3,757 distinct flagged models (22.1\%) actively referenced in at least one project. To understand how these models are integrated in code and identify recurring usage patterns, we categorize and analyze the recurring patterns surrounding them via a customized pipeline that combines Code Property Graphs extraction with a tailored Frequent Subgraph Mining approach. Across all patterns, we find no evidence of provenance verification or model sanitization logic, with developers frequently bypassing security parameters or delegating trust to permissive framework defaults. These findings underscore that scanning model files alone is insufficient, highlighting the urgent need for context-aware security analysis and stricter integration guardrails at the application layer of the AI supply chain.

Fri 9 OctCryptography and SecuritySoftware Engineering
The gist
There are many AI models available for developers to use, but some have serious security problems like hidden backdoors. The authors studied almost 17,000 of these unsafe models on a popular AI hub called HuggingFace and found that thousands are still used in over 5,000 open-source projects. They discovered that developers often do not check where the models come from or attempt to fix the security issues when adding them to their software. This shows that just identifying unsafe models is not enough; better tools and rules are needed when developers integrate AI models into applications.
Open → 2610.12893v1

AgentXploit improves security testing for AI agent software

AgentXploit: Autonomous Repository-to-Runtime Red-Teaming for AI Agents

Abstract: AI agents combine language models with external data and tools that can modify files, call APIs, or execute code. Security failures can arise when adversarial content changes an agent's tool use or when the surrounding software contains vulnerabilities such as path traversal or command injection. We study authorized white-box pre-deployment auditing, where the auditor has access to the target repository and a controlled runtime, but successful attacks must still act through the task-defined attacker interface and be confirmed by an external verifier. We present AgentXploit, a two-role auditing system that separates repository-level attack-path discovery from runtime exploitation. The Analyzer Agent traces attacker-controlled inputs to sensitive operations and records code-supported candidate attack paths; the Exploiter Agent turns these paths into concrete attacks and revises them using runtime feedback. We also introduce AgentXploit-Bench, containing 72 reproducible vulnerabilities across 12 open-source AI-agent systems and frameworks. Across three runs, AgentXploit reaches 59.3% end-to-end success, compared with 38.4% for Codex. Under a token-budget-matched comparison, Codex reaches 46.3%. On AgentDojo, where injection points are provided, the Exploiter Agent reaches 79.2% attack success versus 52.7% for AgentVigil. These results highlight repository discovery and runtime exploitation as distinct challenges in end-to-end agent security auditing.

Fri 25 SeptCryptography and SecurityArtificial Intelligence
The gist
AI agents use language models that interact with software tools and data, but this can lead to security risks if harmful inputs manipulate the agent's behavior or exploit software flaws. The paper presents AgentXploit, a two-part system that finds how attacks could happen in the code and then tries to carry out those attacks in a safe testing environment before deployment. The authors also provide a benchmark with multiple real-world vulnerabilities in AI agent frameworks to evaluate such attack methods. Their system outperforms previous automated approaches in finding and verifying these security issues. This work helps make AI agents safer by detecting risks early in development.
Open → 2609.31318v1