Papers for

industrial ai teams

Papers whose findings have a practical use for this group, as judged from the abstract. Open a paper to read what it means in practice.

Llm improves reasoning on knowledge graphs without question labels

Evolve on Graph: Self-Evolving Knowledge Graph Reasoning without Question Annotations

Abstract: Knowledge graphs (KGs) provide reliable external knowledge for multi-hop factual reasoning with large language models (LLMs), yet most KGs in real-world domains such as finance and industry lack question--answer (QA) annotations. Without such annotations, existing methods struggle to improve LLM graph reasoning: training-free agents cannot improve their exploration through interaction; reinforcement learning (RL) agents depend on QA data annotated by humans or synthesized by closed-source models; and training data is typically built offline, so its topology mix is fixed and cannot follow the agent's ability. We propose Evolve on Graph (EoG), a framework that lets an LLM self-evolve its graph reasoning without any QA annotations. Through Graph Self-Play, a single LLM alternates between a Proposer that poses questions and a Solver that answers them. To make questions verifiable, Symbolically Verifiable Topology Synthesis (SVTS) samples reasoning topologies on the KG and executes the corresponding first-order logic queries, yielding topology skeletons with correct and complete answer sets; guided by a skeleton, the Proposer explores the graph to pose a multi-hop question. To let task topologies follow the Solver, a Boundary-Aware Graph Curriculum rewards the Proposer by the Solver's score variance, keeping questions at the Solver's capability boundary so that complex topologies enter training as the Solver improves. On six benchmarks over Freebase, Wikidata, and an industrial KG, EoG consistently outperforms prompting-, retrieval-, and agent-based methods, showing that LLM graph reasoning can improve through self-play without QA annotations. Our code is available at https://github.com/Szy5/EoG

Mon 26 OctArtificial Intelligence
The gist
Large language models (LLMs) often use knowledge graphs to find answers that require several reasoning steps. However, many real-world knowledge graphs lack labeled questions and answers to help train such models. The authors propose a way for an LLM to teach itself by playing both the role of asking and answering questions using the knowledge graph. Their method generates verifiable multi-step questions and gradually increases difficulty as the model improves. This approach works well on different knowledge graphs without needing any pre-existing question annotations.
Open → 2610.35598v1

Faithfulness and stability vary for sensor heatmap explanations

Do RUL explanations hold up? Faithfulness and stability of attributions on C-MAPSS

Abstract: Deep remaining-useful-life (RUL) models on NASA C-MAPSS are now routine, and so are heatmaps that colour sensors and timesteps. A heatmap that looks mechanical is not the same as an explanation an engineer can act on. We train three standard architectures - a 1D CNN, an LSTM, and a small Transformer encoder - on the official FD001 and FD003 splits with the piecewise RUL cap of 125 cycles and the official PHM08 asymmetric score. We then attach three attribution maps (Integrated Gradients, occlusion, last-layer attention) and evaluate them with the checks the XAI-for-PdM literature still under-reports: deletion/insertion faithfulness, Spearman stability under sensor-scale noise, agreement across training seeds, and cosine consistency inside RUL bins. Prediction error is a prerequisite, not the claim. The headline is which explanation method moves the RUL output when its top cells are removed, and which map survives a 5% input perturbation. Integrated Gradients and occlusion are similarly faithful on the LSTM; Transformer attention is cheap and temporally smooth but weakly faithful. All three maps are almost unchanged under 5% input noise, yet IG/occlusion agree only moderately across two LSTM seeds - stability to sensor jitter is not the same as stability to retraining. A secondary tabular check on the AI4I 2020 failure dataset shows the same deletion pattern for tree importances. We recommend occlusion or IG for any C-MAPSS-style report that will be read by a maintenance engineer, and we treat raw attention weights as a visualisation only.

Sat 3 OctMachine Learning
The gist
Making sense of deep learning models that predict how long a machine part will last is tricky because the usual heatmaps highlighting important sensors don't always behave reliably. The authors trained three popular types of models and tested three popular explanation methods to see how well these methods reveal real influences on predictions when sensors are changed or even slightly noisy. They found that two methods, Integrated Gradients and occlusion, were better at showing true cause-and-effect on some models, while attention maps were easier to produce but less accurate. Their work helps engineers know which explanation tools to trust when assessing sensor data for maintenance decisions.
Open → 2610.04278v1

Surgical video models improve by respecting procedure hierarchies

A Hierarchy-Aware Video-Language Model Evaluation and Hyperbolic Baseline for Surgery

Abstract: Surgical procedures follow a phase-to-step hierarchy, yet the video-language models used to recognize them are evaluated with flat per-level metrics that ignore cross-level coherence and error structure. In this paper we make two contributions to address this problem, (i) we introduce SurgHiBench, the first hierarchy-aware evaluation suite for surgical video understanding, with three tasks measuring recognition, consistency, and severity across granularity levels. We evaluate a general-purpose CLIP model, a Euclidean surgical model, and, as second contribution: (ii) HyperSurg, a new hyperbolic model that enforces phase-step containment via entailment cones, across four (existing) datasets spanning three procedure types. The suite reveals that two models with the same accuracy can produce predictions of very different error severity, ranging from sibling confusions within the correct phase to unrelated cross-phase predictions. Hyperbolic geometry shifts predictions toward the correct procedural neighborhood, and these gains scale with the tree-likeness of each dataset's annotation hierarchy, providing a principled indicator when hierarchy-aware geometry helps.

Tue 22 SeptComputer Vision and Pattern RecognitionArtificial Intelligence
The gist
Surgical videos show operations that happen in steps grouped into larger phases, but current video-language tools treat these steps equally without considering their hierarchy. The authors created a new way to check how well models honor this structure by measuring not just overall accuracy but also consistency and error severity across these levels. They also developed a new type of model that uses hyperbolic geometry, which better captures the tree-like hierarchy of surgeries. Their tests show this approach reduces serious mistakes and works better on datasets where the hierarchy is clearer.
Open → 2609.27139v1