Papers for

knowledge engineers

Papers whose findings have a practical use for this group, as judged from the abstract. Open a paper to read what it means in practice.

Minimum-cost certificates ensure rule conclusions withstand multiple source failures

Minimum-Cost Robust Evidence Certificates for Horn Reasoning under Correlated Source Failures

Abstract: A small justification for a rule-based conclusion may disappear when a source is withdrawn, and multiple derivations need not provide independent evidence. We study minimum-cost certificates that preserve a Horn conclusion under every withdrawal of at most k source domains. Evidence records remain distinct from asserted facts, supporting replicated attestations and overlapping failure dependencies. Transversals of minimal-support footprints characterize robustness and explain why disjoint-proof requirements can reject valid certificates. An exact procedure alternates weighted evidence selection with a source-failure oracle. A rule-closed counterinterpretation yields a globally valid selection cut without enumerating supports or failure scenarios. We prove correctness, finite termination, and cost optimality, establish coNP-completeness of unrestricted verification and NP-completeness of synthesis for every fixed budget, and identify a tractable reachability restriction. Experiments on controlled benchmarks, reachability graphs, and ontology-derived instances demonstrate that our counterinterpretation-guided synthesis achieves up to 92% optimum coverage within practical resource bounds, outperforming scenario expansion and general abduction while confirming the necessity of transversal-based reasoning over proof-packing heuristics.

Mon 19 OctArtificial Intelligence
The gist
Sometimes, a conclusion drawn from multiple evidence sources can become invalid if some sources stop providing information. The paper studies how to find the cheapest set of evidence that guarantees a conclusion remains valid even if up to k sources fail. The authors introduce a method using special mathematical structures called transversals to make sure the evidence set is robust and explain why requiring completely separate proofs can wrongly reject valid solutions. Their approach efficiently finds optimal evidence without checking all possible failure scenarios and works well in tests compared to other methods.
Open → 2610.25865v1

Graph text formats affect reasoning accuracy in large language models

Graph Serializations for Reasoning LLMs: A Study Across Knowledge Extraction and Structural Reasoning

Abstract: The way a knowledge graph is serialized as text for inclusion into LLM context can substantially affect downstream LLM performance, with prior work reporting tens of percentage points variations across formats. However, existing studies consider only a limited set of representations and predate frontier reasoning models, which now offer stronger reasoning, instruction-following, and long-context capabilities. We evaluate 15 graph representation formats across nine frontier LLM configurations on ontology-based knowledge extraction and structural graph reasoning tasks. While knowledge extraction is relatively insensitive to different serialization formats, the choice of the optimal format for structural reasoning tasks significantly affects accuracy. We demonstrate that the optimal representation choice depends on model, query, and task and propose to approach graph serialization as a dynamic orchestration decision.

Thu 15 OctArtificial Intelligence
The gist
How knowledge graphs are turned into text for large language models (LLMs) can make a big difference in how well the models understand and reason about the information. The authors studied 15 different text formats and tested them with nine advanced LLMs on tasks involving extracting knowledge and reasoning about graph structure. They found that while extracting facts is mostly unaffected by the format, the ability to solve reasoning problems depends heavily on how the graph is written out. They suggest choosing graph text formats dynamically based on the specific model and task to get the best results.
Open → 2610.22734v1

Language models improve translating natural language into logic formulas

Natural Language to First-Order Logic LLM-based Autoformalization

Abstract: Large Language Models (LLMs) have renewed interest in autoformalization. Yet, when First-Order Logic (FOL) is considered as the target formalism, the field still lacks a unified task formulation and a systematic survey. This paper addresses this gap: we first provide a principled definition for the FOL-autoformalization task by distinguishing Ontology Extraction from Logical Translation, showing how their conflation obscures (cross-study) evaluation; we review existing datasets, evaluation metrics, and LLM-based methods, including fine-tuning, prompting, and verification-based refinement; we identify open challenges in benchmarking, semantic evaluation, ontology-aware methods, and end-to-end applications.

Thu 8 OctComputation and Language
The gist
Turning everyday language into precise logical statements is hard but useful. The authors explain how breaking this task into two parts—understanding the concepts (ontology extraction) and converting to logical form (logical translation)—makes it easier to evaluate and improve methods. They review existing data and techniques that use large language models to do this automatic translation. Finally, they point out challenges like better evaluation and making systems aware of broader context.
Open → 2610.12030v1

Organizing cognitive schemas by information to improve problem solving reuse

Cognitive Schemas, Laws and Tasks

Abstract: This paper asks how explicit representations can support reusable cognitive schemas in knowledge-based problem solving. We develop a structural framework in which schemas are organized by the information and relations required for their use, rather than introduced as unrelated primitives. The framework also distinguishes context-dependent relations from more stable structures that can be reused across different representations. Tasks are described through the information available, the unknowns to be determined, and the constraints that admissible solutions must satisfy. This makes it possible to separate limitations of the representation from limitations of the solving procedure. In particular, we distinguish inconsistency, underdetermination, and contextual insufficiency, where the current representation lacks distinctions or relations required by the external task meaning. We also show formally when a reduction of representation preserves the task-relevant solution structure. The resulting task--schema interface offers a structured way to describe representational conditions relevant to problem solving. It supports the reuse and stabilization of derived knowledge while remaining independent of the particular mechanism used to generate candidate solutions. This may provide a useful component for future solver architectures that combine structured knowledge, verification, and learned proposal mechanisms.

Wed 7 OctArtificial Intelligence
The gist
Figuring out how our mental shortcuts or 'schemas' can be clearly represented to help solve problems better is a tricky challenge. The authors created a framework that organizes these schemas based on the information and relationships they need instead of just treating them as isolated concepts. This approach helps separate what limits our understanding from what limits how we solve problems and shows when simplifying representations won't lose important details. Their work provides a way to reuse knowledge across different tasks, which could help build smarter systems that combine known facts and learned strategies.
Open → 2610.09495v1

MemoryAgentBench conflict scores largely match simple last-write rule

Bookkeeping, Composition, or Unreachable Gold? Reading MemoryAgentBench's Conflict-Resolution Scores Against a Frozen Last-Write Resolver

Abstract: MemoryAgentBench's Conflict Resolution split is read as measuring "selective forgetting". We execute the benchmark's own rule - the newest statement about a fact wins - as a zero-learning resolver frozen on one of the four fact lists. Under the official metric the rule answers 80.25% of the questions (74.5% on the three held-out lists). Of the rest, 67 items have a released gold that the last-write graph cannot reach but overwritten statements would ("The capital of India is New Delhi." superseded by "The capital of India is Grosseto."; gold New Delhi); such items are a third of the multi-hop questions at 262K. Two long-context models and our pre-registered approximate re-implementation of the benchmark's BM25 agent, one retained run per item and outcomes only, score 84.7%, 82.6% and 41.6% on the items the rule solves against 10.4%, 11.9% and 6.0% on those 67. The failures are a reachability split plus a small parser-scope residual; the per-item split, not the aggregate, is the unit at which a score here can be read.

Tue 6 OctArtificial IntelligenceComputation and Language
The gist
This paper looks at how well a simple rule — always trusting the newest fact — does on a benchmark designed to test memory in AI models. The authors show that this rule alone solves over 80% of the questions, even without learning. They also find a specific set of challenging questions where the benchmark's answer can’t be reached by this rule, highlighting limitations in how facts are updated. Some advanced models do better on these tough cases, which are rare but important. The work helps clarify what the benchmark really measures and how memory conflicts are resolved in AI.
Open → 2610.09193v1

OntoInk combines ontology diagrams and validation in documentation pages

OntoInk: Interactive Ontology Visualization, Validation, and Reasoning

Abstract: Ontology documentation, visualization, and validation are usually carried out with separate tools. This split workflow slows down development and makes knowledge transfer harder. We present OntoInk, an open-source MkDocs plugin that brings these activities together. Within a single documentation-as-code pipeline, OntoInk renders interactive ontology diagrams, validates instance data against SHACL shapes, runs OWL\,DL reasoning, and supports inline Turtle editing. General-purpose diagram plugins for MkDocs cannot parse RDF, dereference IRIs, overlay SHACL constraints, or run OWL reasoning. Compared with standalone ontology visualization tools, OntoInk embeds interactive and editable diagrams directly into documentation pages. A live demo and source code are available at \url{https://ise-fizkarlsruhe.github.io/ontoink/}.

Mon 5 OctArtificial IntelligenceInformation Retrieval
The gist
Working with ontologies often requires using separate tools to draw pictures, check for errors, and run tests, which slows things down. The authors introduce OntoInk, a tool that puts all these tasks into one place inside regular project documents. OntoInk makes interactive, editable diagrams, checks that data fits their rules, and runs logical reasoning all within the same documentation. This helps people build and understand ontologies faster and share knowledge more easily.
Open → 2610.05945v1

Deep search agents improved for longer complex queries and reasoning

LexiHorizon: Stabilizing Reinforcement Learning for Long-Horizon Deep Search

Abstract: Deep search agents tackle complex knowledge tasks through iterative retrieval, multi-hop reasoning, and evidence synthesis across multiple sources. Existing approaches typically assume relatively stable retrieval systems and operate over short-horizon tool interaction. However, when retrieval is sensitive to query formulation, even a semantically appropriate query may fail to surface critical evidence because of mismatched entity names, aliases, or keyword combinations. Recovering from such failures requires repeated query reformulation and longer interaction trajectories. This setting poses a distinct training challenge, as the policy must sustain long-horizon query exploration while managing an expanding volume of retrieved content. We propose LexiHorizon, a framework for training search agents over long horizons that expands the trajectory context budget, manages accumulated retrieval content using a window over recent tool observations while preserving the reasoning history, and introduces an outcome-gated search-effort reward that provides a bounded bonus for tool invocations to trajectories with nonzero answer reward. Experiments on XBench, WebWalkerQA, and BrowseComp-ZH show that the resulting 9B model consistently outperforms both its base model and MiroThinker-1.7-mini, with maximum absolute gains of 8.7 and 23.8 percentage points, respectively. These results suggest that combining an extended context budget with reasoning-preserving context management benefits long-horizon deep search agents.

Sun 4 OctArtificial Intelligence
The gist
Finding information by asking many questions can get tricky when the search tool sometimes misses important details due to slight changes in wording. The authors created a method called LexiHorizon that helps the search process work better over long sequences of questions by keeping track of what was found recently and rewarding careful searching. Their approach was tested on several benchmarks, showing clear improvements in finding correct answers compared to earlier methods. This means search agents can better handle complicated tasks requiring many steps of thinking and looking up information.
Open → 2610.05119v1

Large language model aids discovery of links between different ontologies

LLM-Assisted Discovery of Typed Semantic Links for Ontology Network Construction

Abstract: Constructing typed, justified semantic links between ontologies is essential for enabling interoperability across heterogeneous and interdisciplinary knowledge domains. However, manually curating such links is difficult to scale. To address this challenge, we propose an end-to-end framework for ontology network construction that automates the discovery and generation of both intra-domain and inter-domain relationships. Our approach combines domain-adapted DistilBERT embeddings for dense contextual representation, clustering-based pre-filtering to reduce the candidate search space, and GPT-4o-driven relationship generation via iterative prompt engineering to produce semantically rich, interpretable links. Applied to ReproduceMeON - a network of 33 ontologies spanning machine learning, microscopy, computational science, and experimental workflow - the pipeline reduces approximately 800k raw concept pairs to 95k high-quality candidates. Human expert validation of 429 generated relationships by two independent annotators yields an overall precision of 80.19% (91.49% on high-certainty annotations) and an F1 of 0.890, with substantial inter-annotator agreement. Comparative experiments against five similarity-based baselines, including Sentence-BERT, show a substantial performance gap (best baseline F1 = 0.581), while an ablation study demonstrates that similarity-based methods alone fail to discriminate valid from invalid relationships (AUC approx 0.5) on the filtered candidate set. These findings highlight the necessity of LLM-based reasoning over concept roles and domain semantics for accurate relationship construction.

Thu 1 OctComputation and LanguageArtificial Intelligence
The gist
Linking different collections of knowledge, called ontologies, is hard because doing it by hand takes too long and is complicated. This paper describes a way to use large language models like GPT-4 combined with special data representations to automatically find meaningful links within and between different knowledge areas. Their approach reduces huge numbers of possible connections to a manageable set and creates links that experts find accurate and useful. This shows that reasoning with language models is better than just comparing how similar words or concepts are when building these knowledge networks.
Open → 2610.01393v1