Papers for

compliance teams

Papers whose findings have a practical use for this group, as judged from the abstract. Open a paper to read what it means in practice.

Korean language model training changes how often and how much it answers

Off-Target Effects of Response-Style Alignment in a Korean 27B Language Model

Abstract: We post-train Qwen3.8-27B for Korean response style -- verbosity, list and markdown usage, discourse structure and register -- and measure two behaviours the objective never targets: abstention on ambiguous social questions in KoBBQ, where the benchmark-correct answer is UNKNOWN, and unprompted disclosure in securities guidance. Both move, and the changes are expressed primarily through the model's emission policy: how often it answers and how much it says. Matched target-form controls show that answer propensity depends on the training target, not the prompt set or recipe alone. Holding prompts, recipe, data volume and serving fixed and changing only the target text, three style seeds give positive answer-rate point estimates (mean +0.82 pp) and three neutral seeds negative ones (mean -1.53 pp); the observed seed ranges do not overlap and the means differ by 2.34 pp. A length-matched arm lies between them, and a fourth arm that stays short while preserving hedging is unstable across seeds, so which feature of the form is responsible is unresolved. For absolute stereotyped exposure the decomposition into an answer-propensity term and a conditional-composition term is an algebraic identity, not a finding; its empirical content is where the movement went. Across the trained checkpoints the changes are dominated by answer propensity while the composition term stays small, and because that term is evaluated on treatment-dependent answered subsets we do not read it as evidence about latent preference. Two measurement results follow. A between-arm contrast in conditional stereotyped share does not identify a change in conditional content preference when answer status is treatment-dependent. And agreement between two rule detectors for the same construct runs from 0.44 to 0.99 depending on which checkpoint produced the text -- observable without any reference labels.

Thu 10 SeptArtificial Intelligence
The gist
The researchers studied how training a Korean language AI model to write in a certain style can also accidentally change other behaviors. They found the model changes how often it chooses to answer questions and how much detail it gives, even when the training did not aim for these outcomes. For example, the model either answers ambiguous social questions more or less often, depending on the style used in training. These changes come more from whether the model decides to answer rather than the content of its answers.
Open 2609.11291v1

Model clarifies evidence claims and trust in agentic AI systems

An Evidence Model for Agentic Processes: Evidence Claims, Trust Assumptions, and Policy Assessment

Abstract: Agentic AI systems increasingly exchange messages, invoke tools, request approvals, hold structured decision sessions, and modify shared artifacts. Logs and anchors can make selected records tamper-evident, but they can also mislead if their evidentiary meaning is implicit: a hash does not establish semantic truth, a signature does not establish authorization, and an external anchor does not establish capture completeness. This paper proposes an evidence claim model for agentic processes. It distinguishes artifact integrity, temporal existence, provenance, approval evidence, declared ordering, capture claim, relevance claim, deliberation traceability, monitoring claim, anchoring authorization claim, policy assessment claim, risk treatment claim, mitigation implementation claim, and management response claim. Semantic validity is treated as a recurring limitation. The model maps these claims to mechanisms, assumptions, limitations, and threats, and situates them in an agent organization with functional CEO agent, executive, operational, evidence, and audit roles, plus a plan-do-check-act-inspired management response loop. The contribution is conceptual: it does not validate a particular implementation, prevent all failures, or automate legal compliance. It provides a vocabulary for stating which claims an agentic black box can support, which claims it cannot establish, and which controls are required around it.

Tue 8 SeptCryptography and Security
The gist
Agentic AI systems often make decisions, exchange messages, and update shared work in complex ways. The authors point out that logs and cryptographic anchors, while helpful, can sometimes mislead if their meaning is not clear. They propose a detailed model that breaks down different kinds of evidence and trust claims about these systems. The model helps clarify what kinds of trust or proof such AI systems can really provide, and what assumptions or limits exist. This creates a common language to discuss the reliability and governance of agentic AI processes.
Open 2609.08481v1

Hierarchical framework detects conflicting evidence in ai-generated answers

A Hierarchical Consistency Framework for Auditing Retrieval-Augmented Generation Systems

Abstract: Retrieval-augmented generation (RAG) is commonly evaluated by whether the final answer is correct. That test is insufficient: an answer can match its reference while the context that produced it contains a direct contradiction, leaving the contested evidence invisible to answer-only review and retrieval relevance scores. This paper presents the Hierarchical Consistency Framework (HCF), a post-hoc, model-agnostic audit of three distinct levels of a RAG process: the knowledge corpus, the final retrieved context, and the generated answer. HCF represents corpus conflicts as source-linked atomic facts, thereby identifying the documents responsible, and returns each Answer Consistency Score (ACS) with an explanation of supporting and contradictory contextual statements. We evaluate HCF on several controlled corpora spanning five domains and 100 query-corpus instances. A human evaluator compares every generated response with its supplied ground-truth response. The results show that the three diagnostic levels can dissociate: the corpus with the highest mean retrieval similarity has the lowest mean ACS, while a structurally degraded corpus performs worse at corpus level but better at answer level. Most importantly, HCF identifies contradictory retrieved evidence in several cases where the answer still matches the ground truth. HCF does not certify factual truth; it makes the evidence supporting and challenging an answer inspectable and attributable.

Mon 7 SeptArtificial Intelligence
The gist
Many systems that answer questions by looking up information and then generating responses can produce answers that seem right but are actually supported by conflicting facts. The authors introduce a new way to check answers by examining the original information, the retrieved evidence, and the final answer separately. This method helps find where contradictions happen, even when the answer matches what’s expected. Their approach does not prove if an answer is true but makes it easier to see and understand the evidence behind it.
Open 2609.07075v1