Papers for

workflow automation developers

Papers whose findings have a practical use for this group, as judged from the abstract. Open a paper to read what it means in practice.

AgentOrch narrows workflow accuracy gap with fewer AI calls

AgentOrch: How Close Can Global Orchestration Come to Step-by-Step Interaction?

Abstract: Enterprise workflow agents typically rely on step-by-step interaction (Step-by-Step): the agent executes an action, observes its result, and invokes a large language model (LLM) again to decide the next step. Global orchestration (Global) instead generates a complete executable workflow in advance and executes it without further LLM calls, substantially reducing inference overhead, but it remains less accurate than Step-by-Step. We study how close Global can come to Step-by-Step and what narrows the remaining gap. We introduce AgentOrch, a benchmark that directly compares global orchestration with step-by-step interaction on 650 enterprise SOPs and 3,220 runtime variants under matched tools, environments, and evaluation. Step-by-Step remains more accurate for every evaluated model, but the gap has shrunk by about 79% from early models to the strongest recent model. We identify three routes to further narrowing this gap. Incremental workflow construction improves Global accuracy by an average of 9.98 percentage points (pp) without runtime execution feedback. Revising complete workflows with execution feedback improves all evaluated models, including 6.13 pp on held-out runtime variants. Targeted training on complete workflows improves accuracy by an average of 12.18 pp across all five trained models. Although a gap remains, global orchestration offers a promising path toward enterprise agents that deliver higher accuracy with fewer LLM calls.

Sat 24 OctArtificial Intelligence
The gist
When software agents follow instructions step-by-step, they make decisions after each action, which is accurate but slow and costly. Another way is planning the entire workflow in advance, which saves time and computational effort but is usually less accurate. The authors compare these two approaches on many business workflows and find that the gap in accuracy is decreasing with recent improvements. They suggest methods like building workflows incrementally, revising workflows during execution, and training on complete workflows to make planning nearly as accurate as step-by-step interaction.
Open → 2610.33375v1

Memory selection method improves efficiency for large language model agents

Beyond Marginal Influence: Interaction-Aware Memory Selection for LLM Agents

Abstract: LLM-agent memory selection often uses retrieval rankings based on record relevance or individual influence. Such rankings cannot identify sufficient subsets under redundant or jointly necessary evidence. We study per-decision memory sufficiency: selecting a small subset that preserves full-memory behavior. To separate search error from model error, we introduce JointCoreBench, a benchmark with nine interaction families, six workflow domains, natural-language decisions, and exact sufficient-set oracles, and JointCore, a relevance cost-ordered group-deletion baseline that tests blocks before individual records. On 6,912 exact conditions, cost-ordered JointCore recovers a minimum-cost sufficient set in 100.0% of cases, reduces subset evaluations from 30.00 to 11.13 (62.9%), and achieves 87.8% active-memory savings. Across four 12B-70B model families and 432 tasks per model, its unweighted mean is 10.28 versus 16.00 model queries and 50.6% versus 43.1% minimum-cost recovery relative to cost aware singleton deletion. Both methods preserve full-memory behavior under the deterministic primary interface. Tests with physical deletion, UNKNOWN masks, PENDING sentinels, counterfactual values, and alternative labels identify interface dependent behavior. JointCore is an efficient benchmark baseline; the study does not establish deployment-ready memory compression.

Fri 16 OctMachine LearningArtificial Intelligence
The gist
Remembering all information for decisions can be inefficient for AI language models. The authors studied how to pick just enough memory so the model acts the same as with full memory. They made a test suite and a method called JointCore that finds such memory subsets efficiently. Their approach saves a lot of effort and memory without losing performance according to their tests.
Open → 2610.23266v1

Authorization workflow attack tricks agents into improper document access

When Approval Becomes Execution: Authorization-Grounded Workflow Attacks on Tool-Using Agents

Abstract: Tool-using language-model agents increasingly rely on local services for document access, approval management, and enterprise workflow execution. This paper studies an authorization-grounded workflow attack in the OpenClaw Agent Security Attack Competition, a controlled benchmark derived from SeClaw-style security task synthesis. Rather than using explicit policy-override instructions, the attack guides the agent through a locally coherent approval workflow: a protected document request is denied, the agent requests a normal approval token from the local approval service, and the returned token is supplied to the document service through authorized_by. Official submission traces show this pattern succeeding on three Enterprise OA document targets. We also conducted 23 controlled local validation experiments in the official OpenClaw execution environment: the original configuration reached the approval-token transition in 9/9 reruns and completed the exact target operation in 8/9 reruns, while single-component variants remained successful on the three document targets. The results provide concrete case evidence of an authorization-context gap: token possession can be treated as sufficient authorization even when requester identity, approver authority, resource scope, action type, destination or recipient, and business purpose are not jointly enforced. We present the attack pattern, controlled trace analysis, and defensive implications for context-bound tokens, service-side policy binding, agent-side authorization checks, and trace-aware benchmark design.

Fri 16 OctCryptography and Security
The gist
This paper shows how computer agents that use approval systems to access documents can be tricked into doing things they shouldn’t. Instead of breaking the rules directly, the attack fools the agent into following a regular approval process with tokens that don’t fully prove proper permission. The researchers ran experiments that showed these attacks work repeatedly on enterprise documents, revealing that just having an approval token can wrongly count as full permission. They discuss ways to fix this by better linking approvals to specific user identities and contexts.
Open → 2610.23077v1

Croissant adds clear rules to check dataset use restrictions automatically

A Policy Profile for Croissant: Refusal as a Property of the Dataset

Abstract: Croissant is the de facto machine-readable descriptor for ML datasets: JSON-LD over schema.org. Since version 1.1 it also carries data use conditions, recommending DUO and ODRL for them. What no version specifies is how any of them is evaluated: no decision procedure, no bound on evaluation cost, no outcome for a condition an implementation cannot evaluate, no record of what was checked, and nothing on composition with caller-side authority. We supply that half. An additive profile lets a dataset declare the operations it admits and the conditions under which it admits them, over a closed set of five operators whose decision procedure is given in full, so a gate decides from the descriptor alone and records what it checked. Two corpora evaluate it and their evidence is kept apart. Three descriptors that gated a real nf-core pipeline give the deployment result: decisions from a profile document match the gate's native descriptor record for record, stripping the layer leaves a valid Croissant document, and the added cost is 11.7 $μ$s against a 119 $μ$s decision. A corpus generated from the profile's grammar gives the breadth, covering every operator, refusal class and conformance clause. Across its valid cases, 552 complete decision records agree three ways -- native descriptor, profile terms, and the same policy as ODRL in usageInfo. The carrier is therefore not the contribution; the evaluation semantics is. Finally, caller-bound and data-bound policies range over non-overlapping state spaces, so neither permit set contains the other.

Thu 17 SeptMachine LearningCryptography and SecurityDatabases
The gist
Datasets often have rules about how they can be used, but previously these rules weren’t always easy for software to check or understand clearly. The authors worked on Croissant, a way to write these dataset rules so that computers can automatically decide if an operation is allowed or refused. They created a clear system with exact steps and recorded decisions to make sure checks are reliable and fast. This helps systems that manage datasets follow restrictions correctly and transparently.
Open → 2609.19640v1

Graph-based retrieval improves suffix prediction for process recommendations

Complete Suffix Prediction for Recommendation via Latent Retrieval over Process Graphs

Abstract: Complete suffix prediction is challenging in sequential decision settings, where the same prefix can remain compatible with several plausible suffixes. We propose a graphbased metric-learning framework that reformulates complete suffix prediction as latent retrieval over process graphs. Prefixes and suffixes are represented as directed attributed graphs and encoded by edge-conditioned graph neural networks, allowing event-level activities and transition-level durations to be modelled jointly. Prefix representations are projected into the latent suffix space through a predictor trained with a joint reconstruction and contrastive objective strengthened using process-aware hard negatives. To stabilise the learned retrieval geometry, spectral normalisation, and retrieval robustness, spectral normalisation is applied to enforce a Lipschitz constraint on both encoders and predictor. Experiments on two real-life process datasets demonstrate that the proposed framework achieves the best overall results across nearly all evaluated criteria. It improves semantic suffix accuracy measured by normalized Damerau-Levenshtein distance, yields strong retrieval quality through Recall@1, Recall@5, and MRR@5, and maintains temporal plausibility according to Mean Absolute Error. These results show that graph-based latent retrieval is an effective alternative to sequential suffix prediction for recommendation-oriented process monitoring under structural and KPI-related constraints.

Mon 14 SeptNeural and Evolutionary Computing
The gist
Predicting what comes next after a series of steps is hard because the same beginning can lead to many different endings. The authors represent these sequences as graphs and use a special type of neural network to understand both the activities and the time between them. They train a model that matches beginnings to likely endings by learning to pull similar examples close in a shared space. Their method outperforms others in accuracy and timing on real-world datasets, showing graph-based methods can better recommend next steps in complex processes.
Open → 2609.15692v1

Post-task workflows improve understanding and reuse of AI agent tasks

From Review to Reuse: How Post-Task Workflow Can Support Human-AI Agent Interaction

Abstract: AI agents can automate tasks by turning a single natural-language request into a multi-step process spanning tools, files, and applications. Users are often left to judge that process from fragmented execution information and the final output. To make the completed process easier to understand, validate, and reuse, we investigate post-task workflows: editable, graph-based representations of an agent's completed execution. We first analyzed 10,803 public workflow templates from n8n to characterize real-world automation practice, then developed Trace2Flow, a research probe that translates agent execution traces into interactive post-task workflows. In a study, participants (N = 20) reviewed agent executions with prompt or agent errors. We found that post-task workflows improved their understanding and error detection over a prompt-only condition, and that validation succeeded mainly when users cross-checked across multiple evidence sources. For follow-up tasks, adapting the workflow matched adapting the prior prompt in success, time, and difficulty, and was often preferred.

Fri 11 SeptHuman-Computer Interaction
The gist
When AI agents complete tasks, people often only see the final result and some scattered details, making it hard to understand how the AI did the job or to fix mistakes. The authors studied a way to show the full process after the task finishes, using clear, editable diagrams called post-task workflows. They found that seeing these workflows helped people better spot errors and understand the AI's work, and that editing these workflows was as effective and sometimes preferred over just changing the original request. This approach makes it easier to check and reuse AI work.
Open → 2609.13136v1

Comparison queries enable fair chore division without exact costs

Comparison-Based Fair Division of Indivisible Chores

Abstract: We investigate the query complexity of fairly allocating $m$ indivisible chores among $n$ agents with additive cost functions. We depart from the standard cardinal model and assume only comparison access: an algorithm may ask an agent which of two bundles is less costly, but never observes numerical costs. Our first results concern proportionality up to one item (PROP1). We design comparison-based algorithms that compute PROP1 allocations using $O(n^3\log m)$ comparison queries. When the chores are arranged in a fixed order and allocations are required to be contiguous, we compute a contiguous PROP1 allocation using $O(n^3 \log^2 m)$ comparison queries. Our main result concerns the maximin share (MMS) guarantee. We show that for any fixed number of agents $n$ and constant $\varepsilon>0$, a $\left(13/11 +\varepsilon\right)$-MMS allocation can be computed with a comparison complexity logarithmic in $m$. Remarkably, comparison access suffices to match the state-of-the-art $13/11$ cardinal-access guarantee of Huang and Segal-Halevi up to an arbitrarily small loss. Furthermore, our result implies that the MMS distortion of comparison access (i.e., the worst-case multiplicative loss in MMS fairness incurred by observing only comparisons rather than numerical costs) is at most $13/11$. Finally, we show that, for three agents, an allocation satisfying envy-freeness up to one item (EF1) can be computed using $O(\log m)$ comparison queries.

Tue 8 SeptComputer Science and Game Theory
The gist
This work looks at how to fairly split up chores among people without knowing exact values for how bad each chore is. Instead, the authors use only comparisons, asking who prefers which chore bundle instead of requiring exact numbers. They develop methods that find nearly fair divisions efficiently using these comparison queries. For example, they can ensure everyone feels they have a mostly fair share or is not too envious of others, even with only these comparisons. Their approach matches some of the best-known fairness results that use exact costs.
Open → 2609.08687v1