Papers for

cybersecurity analysts

Papers whose findings have a practical use for this group, as judged from the abstract. Open a paper to read what it means in practice.

Exploit code helps create faster rules to catch cyberattacks

Set an Exploit to Catch an Exploit: Compiling Public Proofs of Concept into Threat Hunting Rules

Abstract: Public exploit code for a newly disclosed vulnerability usually appears before any published rule that detects its exploitation. Of the 45 CVEs we evaluate, 37 ever received a Sigma, Elastic or Splunk rule; in 33 the exploit came first, by a median of 22 days. Analysts still write every rule by hand. We present Encore, which compiles a public Python proof-of-concept exploit (PoC) into CVE-specific hunting rules over a web service's existing logs, without running it. Encore rests on the PoC Behavior Alignment Principle: a PoC performs the exploit, so its code already provides a rule's HTTP requests, payloads and host operations. That is hard to act on: a PoC is written against libraries and runs on the attacker's machine, while the target's web-server, proxy and host logs record only what arrived and what it did. Encore closes the gap with a map from library calls to the operations they cause, built once per library, keeping only the operations visible on the target. For 12 of the 45, Encore's rule states the exploit's own payload fragment or host operation, which is evidence of the exploit itself, and not of traffic to its endpoint. On matched controls it separates that exploit from the same request with a harmless value, and it raises no alerts across 27,081 legitimate and crawl requests. We never compile the exploit that produced the logs. Most are Splunk's public attack data, recorded by a third party. Without reading a single log, Encore's rules find 43 of the 45. Splunk's log-tested rules cover 30 of the 45, and Encore finds 28 of those, plus all 10 CVEs without an ESCU rule. Where Splunk's rules alert on 20 wrong CVE pairs, Encore's alert on only 2. Hunting can start as soon as a PoC is public, and rules can raise an alert when it provides a payload or host operation.

Tue 27 OctCryptography and Security
The gist
When new software vulnerabilities are found, hackers often share code to exploit them before security teams develop ways to detect the attacks. The authors created Encore, a tool that turns publicly available exploit code into rules that detect attacks in web server logs, without running the exploit itself. Encore uses a special method to match the exploit code's behavior to what shows up in the logs, making detection faster and more accurate. This helps security teams start hunting for attacks as soon as exploit code is published, improving defense timing.
Open → 2610.37872v1

Graph neural networks improve learning with adaptive aggregation types

Graph Representation Learning via Adaptive Expectile Aggregation

Abstract: Graph neural networks (GNNs) rely critically on neighborhood aggregation, yet conventional mean aggregation may fail to capture class-relevant distributional information, particularly in heterophilic graphs. We propose ExpectileGCN, an adaptive graph aggregation framework that introduces a learnable expectile level to capture neighborhood information beyond the mean. The proposed operator continuously adjusts aggregation between minimum- and maximum-type behaviors, with mean aggregation as a special case. A differentiable approximation based on sigmoid smoothing and fixed-point iterations enables end-to-end optimization. Theoretically, we establish stability properties and transductive generalization guarantees for ExpectileGCN. We further investigate its classification risk under heterophilic neighborhood models. For informative neighborhoods, we show that expectile aggregation can exploit class-dependent scale differences to achieve a classification advantage over mean aggregation. Under a local asymptotic regime with diminishing per-neighbor label informativeness, we establish that this advantage can persist in terms of limiting classification risk. Experiments on homophilic and heterophilic benchmark graphs demonstrate strong predictive performance and improved robustness under feature corruption and structural perturbations.

Tue 27 OctMachine Learning
The gist
Graph neural networks (GNNs) often combine information from connected nodes by averaging, but averaging can miss important signals, especially when connected nodes differ a lot. The authors propose a new method called ExpectileGCN that learns how to mix information by focusing more on either smaller or larger values instead of just averaging. This new approach adapts automatically and helps GNNs make better predictions on various graph types, including those where neighbors are quite different. The authors also provide mathematical guarantees and show that this method is more robust when data is noisy or connections are disturbed.
Open → 2610.37450v1

Concorde improves link prediction in sparse and complex graphs

Concorde: Geometry-Aware Link Prediction via Decoupled Energy Minimization

Abstract: Link prediction remains difficult in sparse graphs, where diffusion heuristics lack connectivity and geometric methods suffer spectral instability when coupling learned representations with diffusion operators. We introduce Concorde, an energy-based framework that resolves this by decomposing link likelihood into three structurally decoupled branches: (i) a parameter-free spectral anchor that establishes permutation-invariant topological stability; (ii) a mixed-curvature residual on a learnable $\mathbb{H}^{d_h}_{c_h} \times \mathbb{S}^{d_s}_{c_s}$ product manifold, regularized by a feature-aware Ollivier-Ricci curvature proxy; and (iii) a continuous vector field on the tangent bundle of hyperbolic space for non-local structural alignment across topological gaps. The branches are fused via learned gating and trained with an N-pair ranking loss aligned with retrieval-style evaluation. Across five benchmarks spanning sparse, dense, featureless, and attributed regimes, Concorde establishes state-of-the-art early retrieval precision, nearly doubling P@10% over leading baselines in sparse settings.

Mon 26 OctMachine LearningArtificial Intelligence
The gist
Link prediction helps guess which connections might form in networks, but this is hard when there isn’t much data or the network structure is complex. The authors introduce Concorde, a new approach that breaks down the problem into three simpler parts using geometry and graph properties to better predict links. One part looks at stable patterns in the network, another learns complex curved spaces to capture structure, and the last aligns distant connections. Tested on various datasets, Concorde shows much better precision especially in sparse networks.
Open → 2610.36204v1

Mapping vulnerabilities to attack techniques using multi-source evidence ranking

CVE-to-ATT&CK Mapping via Evidence-Constrained Ranking

Abstract: Mapping CVEs to MITRE ATT&CK techniques helps defenders translate vulnerability information into hypotheses about adversary behavior. Automating this mapping is challenging because relevant evidence is fragmented across heterogeneous security sources. In addition, ATT&CK techniques can be semantically similar, and existing annotations cover a highly long-tailed subset of the technique space. Existing supervised, retrieval-based, and LLM-based approaches therefore face limitations from closed-set supervision, semantic ambiguity, or unconstrained prediction. We formulate CVE-to-ATT&CK mapping as multi-evidence constrained ranking. Our framework TRACE first integrates complementary structural and semantic evidence from multiple sources to construct a bounded, high-coverage candidate pool over the complete ATT&CK technique space. It then reranks the retained candidates by combining their accumulated evidence with CVE--technique textual interactions and frequency-aware scoring. We evaluate the framework across six public datasets with different annotation processes and vulnerability distributions. Candidate construction reduces the 201-technique ATT&CK search space by approximately 60% while retaining at least one ground-truth technique for 95.11%-100% of CVEs. These results show that combining heterogeneous security evidence with constrained ranking provides a more controlled and generalizable bridge from vulnerability information to adversary behavior.

Sat 24 OctCryptography and Security
The gist
Security defenders want to understand how software vulnerabilities relate to hacker behaviors, but this connection is hard to make automatically because the information is scattered and complex. The authors developed a new method called TRACE that gathers different pieces of evidence from multiple security sources to narrow down the possible hacker techniques related to a vulnerability. Then, it ranks these possibilities using combined evidence and text analysis to pick the most likely matches. Their tests show this method reduces the search space significantly while usually keeping the right attacker techniques among its top choices.
Open → 2610.33924v1

Quantum classical link prediction tested on dark web link graphs

Quantum-Classical Link Prediction on Dark Web Hyperlink Graphs

Abstract: We analyze HTML content and hyperlinks from an offline Tor crawl containing 383 onion hosts and 2,067 directed cross-host links. The study combines semantic analysis with degree-controlled quantum--classical link prediction. Two directory groups emit 94.8\% of the observed host links. Directed preferential attachment reaches ROC-AUC 0.976 with random non-edges, but falls to $0.550\pm0.014$ under source-conditioned target-degree matching. With disjoint training and test pairs, multimodal logistic regression reaches $0.672\pm0.021$, GAE $0.899\pm0.016$, and VGAE $0.906\pm0.016$. A four-qubit variational quantum classifier (VQC) comparison tests two encodings across 20 disjoint-pair graph splits under exact and 1,024-shot simulation, with classical controls using the same inputs and training examples. Its best exact mean ROC-AUC is $0.549\pm0.023$, compared with $0.551\pm0.016$ for RBF SVC and $0.573\pm0.029$ for a 16-parameter MLP on the same inputs and training examples. These results support predictive signal in combined graph/content features and show why degree control, feature compression, and optimization conditions matter in quantum--classical comparisons.

Fri 23 OctNetworking and Internet ArchitectureMachine Learning
The gist
Predicting connections between websites on the dark web is hard because of the hidden and complex structure. The authors studied a small network of websites and tried different ways to guess links, including classical machine learning and a quantum classifier. Classical graph-based models did well, but the quantum classifier performed similarly to simple classical methods on this data. Their work shows how tricky it is to compare quantum and classical approaches fairly, especially when dealing with real-world networks and content features.
Open → 2610.32510v1

Graph learning improves node classification by combining feature and structure insights

DualGSL: Prior-Guided Graph Structure Learning with Node-Adaptive Prediction Fusion

Abstract: Graph structure learning (GSL) adapts propagation graphs to prediction tasks, but the relative predictive value of feature-derived priors and learned relations can vary across nodes. We propose DualGSL, a prior-guided framework for transductive node classification that learns node-specific weights for combining predictions from separate prior and task-adaptive propagation paths. The prior branch augments a feature graph with virtual class nodes to incorporate training-label information, while the structural branch combines learned affinity graphs with the feature-graph prior. The two branches share encoder parameters while preserving distinct representations and classification logits. A node-adaptive gate fuses the branch logits based on their projected representations, element-wise absolute difference, and prediction confidence. A joint objective integrates fused and branch-specific classification losses with prior-branch class-anchor alignment, coordinating graph construction, representation learning, and prediction fusion. Experiments against seven baselines on the AMG18 malware attribution dataset and the widely used 20News text classification and USPS handwritten-digit recognition benchmarks show that DualGSL achieves the highest cross-dataset average accuracy and Macro-F1 among the evaluated methods. Ablation studies on AMG18 further demonstrate the benefit of combining prior and learned propagation through logit fusion.

Fri 23 OctMachine Learning
The gist
Predicting information about items connected in a graph can be tricky because different parts of the graph have different clues about the answers. The authors introduce DualGSL, a method that learns how to best combine predictions from two sources—a graph based on features and one based on learned relationships. By adjusting the combination uniquely for each item, the method makes better overall predictions. Tests on malware, text, and image data show this way of combining predictions works better than other approaches.
Open → 2610.32462v1

Hybrid fuzzy ensemble improves detection of novel cyberattacks

Bridging the Closed-World Gap: Interpretable Anomaly Detection via a Hybrid TSK-FCM Ensemble on the BETH Dataset

Abstract: A fundamental paradox plagues the deployment of Machine Learning in cybersecurity: supervised models generalize poorly to novel, Out-of-Distribution (OoD) attacks, whereas unsupervised models often suffer from poor separability, leading to unmanageable false-alarm rates. This challenge is exemplified by the BETH dataset, a kernel-level benchmark in which the training data consists solely of benign and suspicious insider behaviors, whereas the test set consists almost entirely of novel botnet activation attacks. To bridge this detection gap, we propose a Hybrid Fuzzy Ensemble that synergizes the precision of supervised learning with the adaptability of unsupervised clustering. Our architecture integrates a gradient-optimized Takagi-Sugeno-Kang (TSK) fuzzy classifier to act as an expert on known insider threats, with a parallel Fuzzy C-Means (FCM) module to detect geometric anomalies. A critical finding of our research is that traditional fuzzy membership scores degrade in high-dimensional feature spaces due to the curse of dimensionality. We overcome this by introducing a robust Min Distance metric that exploits the raw geometric isolation of botnet activation attacks. This approach yields a state-of-the-art AUROC of 0.9951 on the BETH test set, outperforming the original Isolation Forest baseline by 17.1%. By combining near-perfect OoD detection with the intrinsic interpretability of fuzzy logic, our framework offers a viable path toward robust, transparent, and autonomous network defense.

Thu 22 OctCryptography and SecurityArtificial IntelligenceMachine Learning
The gist
Detecting new types of cyberattacks is hard because models trained on known threats often miss unfamiliar ones, and models that try to find unusual behavior often mistake normal actions for threats. The authors address this by combining two techniques: one that learns from known insider threats and another that clusters unusual behaviors. They also improve how these techniques measure differences between actions in complex data. Their approach detects new botnet attacks much better than earlier methods while being easier to understand.
Open → 2610.30576v1

Deep research system shows low self-consistency in entity and citation outputs

Self-Consistency of Entity Sets and Citations in a Deep Research System under Repeated Prompting

Abstract: Deep research agents (DRA) are commonly used for open-ended synthesis tasks where closed-world QA benchmarks are poorly suited to characterize relevant aspects of performance. We study the self-consistency of one commercial deep research system under repeated identical prompting, representing each report with the set of named entities it mentions, categorised by a custom schema, and the set of citations it retrieves. Across repeated runs of a single open-ended cybersecurity related prompt, we quantify pairwise overlap to characterize how stable the retrieved and synthesized output structure is under repeated identical prompts. In ten runs, the pairwise entity Jaccard results in a median of 0.12 and the pairwise citation Jaccard is below 0.02, with discovery curves that do not visibly saturate. The magnitude and structure of (dis)agreement between entity sets varies by entity class, which suggests that self-consistency in a DRA is better understood as a function of the underlying entity space than as a stable property of the system.

Mon 19 OctComputation and Language
The gist
When asked the same question multiple times, a popular AI research tool gave very different answers each time about cybersecurity topics. The differences showed up in the specific names and citations it mentioned, which rarely overlapped across tries. The authors found that these inconsistencies were tied to the type of information rather than just random changes in the system. This means the tool's answers can vary a lot even if you don’t change the question.
Open → 2610.26421v1

Security category aware retrieval improves code generation defense

CAT-RAG: Improving Secure Code Generation with Category-Aware Agentic Retrieval

Abstract: Despite rapid progress in LLM-based code generation, security vulnerabilities remain widespread, and retrieval-augmented code generation (RACG) can further amplify risk when retrieved knowledge is verbose or vulnerable to poisoning. Existing secure RACG approaches inject security knowledge at a fine-grained vulnerability level, causing prompt overhead and diluted model attention when a query implicates multiple related weaknesses. We propose CAT-RAG, an agentic security category-aware retrieval-augmented code generation framework. CAT-RAG performs adaptive category selection via an LLM as a categorizer agent and operates either as a standalone security layer or as a drop-in add-on to RACG pipelines, requiring no modification to the underlying model. We replace CWE-level retrieval with compact, language-specific security categories. These categories provide a higher-level abstraction over individual CWE weaknesses, organizing them by the security concern they share, such as Input Validation and Injection Attacks, rather than merely grouping related entries. Each category consolidates best practices and secure code examples into a single, prompt-efficient representation. We perform a comprehensive evaluation across CyberSecEval, CodeGuard+, and HumanEval. On CyberSecEval, CAT-RAG nearly doubles the secure code generation improvement over the state of the art (23.57% vs. 12.11%) while reducing token overhead by 41.71%.

Sat 17 OctCryptography and SecuritySoftware Engineering
The gist
Writing code with fewer security problems is still a challenge even with advanced AI code helpers. The authors designed a new method called CAT-RAG that helps AI models pick the right security advice by grouping vulnerabilities into simpler categories instead of many detailed weaknesses. This way, the AI focuses better and produces safer code using less extra information. In tests, this method nearly doubled improvements in secure code compared to prior techniques and reduced extra content sent to the AI by about 40%.
Open → 2610.24907v1

Care sd improves local language models accuracy and reliability in security interviews

CARE-SD: Explainable Reasoning Architecture for Local SLM Self-Disclosure Analysis in Textual Data

Abstract: Cybersecurity interviews uncover critical security experiences, behaviors, and privacy concerns often not fully captured by conventional technical assessments. Consequently, identifying genuine self-disclosures is challenging because statements are context-dependent, categories overlap, and automated interpretations may introduce unsupported claims. Locally deployed Small Language Models (SLMs) protect sensitive participant data by keeping processing within controlled environments, but their limited reasoning capabilities make simple prompting insufficient for context-aware and factually reliable analysis. This study developed CARE-SD (Context-Adaptive Reasoning and Explanation for Self-Disclosure), a novel four-module architecture integrating context-adaptive processing, hierarchical disclosure reasoning, explanation-consistency verification, and cross-batch reconciliation. We evaluated three local SLMs, including Llama 1B, Qwen 1.5B, and Llama 3B, using 82 independently annotated cybersecurity interviews across five organizational sectors. Comparisons included conventional classifiers, three prompting strategies, larger 8B--32B models, and architectural ablations. Two independent reviewers assessed disclosure labels, factual claims, and explanation correctness. CARE-SD improved the accuracy and evidence reliability of SLMs, increasing Llama 3B Macro-F1 from 0.80 to 0.88 while reducing unsupported claims by 60\%. Remarkably, the 3B model matched the 20B reference model in category Macro-F1, demonstrating the effectiveness of the architecture without requiring a larger model.

Thu 15 OctCryptography and SecurityArtificial IntelligenceComputation and Language
The gist
It can be hard to tell when someone is genuinely sharing personal security information in interviews because meanings depend on context and overlap in categories. The authors created CARE-SD, a system that helps smaller language models better understand and explain these personal disclosures without sending sensitive data outside local devices. CARE-SD made smaller models nearly as accurate as much larger ones while reducing mistakes in claims made about what was said. This could help protect privacy while analyzing security conversations.
Open → 2610.21151v1

Large language models struggle to reliably extract cyber threat entities

From Unreliable to Usable: Decomposing Failure Modes and Confidence Signals in LLM Entity Extraction - Evidence from Cyber Threat Intelligence

Abstract: Audits of large language model (LLM) extraction from full-length documents report severe unreliability, leaving two questions open: what the failures actually consist of, and whether confidence signals can turn unreliable output into usable output. We run a preregistered, fully frozen evaluation of two new-generation low-cost LLMs (DeepSeek-V4-Flash, GLM-5.3-Flash) with a flagship-tier control (GPT-6.1-Sol) on a public corpus of 354 incident campaigns (315 unique reports, 630 model-report evaluations), scoring extraction quality against gold, confidence calibration, and robustness to single-sentence perturbations. Three findings emerge. (1) Unreliability persists across tiers: micro precision is 0.03-0.34 and verbalized calibration error (ECE) 0.53-0.94 across both splits; the gap does not close at the flagship tier. (2) The dominant failure is not hallucination: a full mention census plus a three-tier annotation of 360 sampled candidates (two independent LLM annotators from vendors outside the evaluated set, Cohen's kappa = 0.79 on the preregistered acceptance line, fully disclosed) back-projects to 65.6% background mentions and 19.9% gold-scope gaps, with only 1.2% unsupported candidates. (3) Confidence ranks but does not verify: zero-cost self-consistency-frequency tiering passes a preregistered top-30% precision-gain bar in all six test-split model-type cells (4/6 on train), the zero-cost text-frequency x SC frequency combination wins 3, ties 2, loses 1 across cells, yet relation-level counterfactuals on all 45 targets show that a single misattribution sentence flips high-confidence judgments in 95.6-100% of cases, and even a background sentence explicitly marked as unrelated still binds a fake vulnerability in up to 26.7% of them. We conclude with a deployment boundary: confidence tiering may set review priorities, never truth.

Wed 14 OctComputation and LanguageArtificial Intelligence
The gist
Extracting specific information about cyber threats from long documents using large language models is often very unreliable. The researchers studied why these models fail and found that most mistakes come from missing or background information rather than making things up. They also tested confidence signals from the models, which can help prioritize which information to check but cannot fully guarantee accuracy. This means the outputs need careful human review before use.
Open → 2610.20417v1

AWARE-RG provides tailored cybersecurity explanations for physical systems

AWARE-RG: Abstraction Aware Explanation of Resiliency Graphs for Cyber Physical Systems

Abstract: Understanding the security posture of cyber physical systems (CPS) requires reasoning across both information technology (IT) and operational technology (OT). However, a security analyst often holds an incomplete, role-specific view of the underlying system which has most likely resulted from their knowledge limited by a need-to-know framework. Such an incomplete view can potentially lead them to incorrectly assess if a cyber attack produces an untoward physical consequence resulting in making uninformed decisions about system resilience. In this work, we present AWARE-RG (Abstraction Aware Explanation of Resiliency Graphs), a semi-automated, human-in-the-loop framework that provides an analyst with a role-bounded, need-to-know explanations of resiliency paths in a CPS. The AWARE-RG abstraction structure is derived using Formal Concept Analysis over MITRE ATT&CK for ICS tactics, ordered by the ICS Cyber Kill Chain. For valid attack-fault queries, plan repair and backward means-end analysis identify the missing dependencies, explain why the physical hazard is reachable, and suggest defensive strategies. For invalid attack-fault queries, AWARE-RG localizes the first abstraction level at which the path fails, and reports confirmed blocking conditions as hardening pointers.

Wed 14 OctCryptography and SecurityArtificial Intelligence
The gist
Cyber physical systems, like industrial control setups, combine computers and physical machines, and securing them needs understanding both parts together. Security experts often only see part of the whole system, which can lead to wrong conclusions about attack risks and defenses. The authors designed AWARE-RG, a tool that gives clear, role-specific explanations about how attacks might lead to physical harm and how to fix or block these paths. It breaks down complex security scenarios using known cyber attack steps and suggests practical strategies to improve system resilience.
Open → 2610.19650v1

Graph model explanations warn of failing predictions before errors appear

Does the Explanation Drift Before the Guarantee? Label-Free Early Warning on Evolving Graphs

Abstract: Deployed models can fail silently as the world they describe evolves. Attribution drift has served as an early warning in tabular data; we ask whether, in graph streams, a model's own explanations can forewarn the loss of nominal conformal coverage. Doing so requires repairing the naive drift statistic twice. A vanishing edge loses mask mass regardless of whether the model relied on it, so we condition the importance on edge presence. Evolving graphs also break edge identity: a relabelling that changes nothing shifts the identity-based statistic by 0.69 on synthetic graphs and 0.83 on real ego-networks, whereas aggregating over structural roles brings both to 0.0 and stays well-defined when the support changes. We test six pre-registered regimes on thirty seeds each. A two-channel monitor, tracking conditional mask mass and its distribution over roles, precedes coverage collapse by 8 to 14.5 steps across four gradual regimes (node addition, removal, replacement, and edge thinning), all surviving Holm correction. A sudden knockout yields the expected zero lead, and a harmless change triggers no alarm. Leads track the length of the transitional phase (Spearman 0.79 over 150 runs). On real transaction ego-networks, the untuned mass channel forewarns staged drift by 27 steps and is the only channel, attributional or structural, that never alarms on a stationary stream. The main limitation is that the mass channel is blind to covariate drift, which breaks the guarantee in every run; the distributional channel detects it and also rescues the rewiring regime, so we report the two channels separately rather than as a union.

Mon 12 OctArtificial Intelligence
The gist
Models that analyze graphs can start making mistakes as the graph changes over time without obvious signs. The authors show that tracking how the model explains its own decisions can warn early that its predictions are becoming unreliable. They fix some technical issues with existing measures to better detect these warning signs. Their method can predict failures several steps ahead during gradual changes, while not raising false alarms when things are stable. However, it may miss some types of changes, so they use a second measure to cover those cases.
Open → 2610.16534v1

Security risks in AI coding tools need stronger safeguards

Security in LLM-Assisted Coding: A Systematic Literature Review

Abstract: Large Language Models accelerate software development but introduce severe security vulnerabilities. This systematic review investigates security risks in automated coding, benchmark limitations, and the role of human developers. Findings indicate that models frequently generate insecure code and faulty patches due to training data biases. Additionally, the models themselves are susceptible to direct attacks. Current evaluation methods suffer from data contamination and lack robust security metrics. Consequently, human oversight remains essential. Safer integration of automation will require more security-aware model architectures, stronger security-specific benchmarks, and more effective human-AI collaboration frameworks to mitigate these systemic risks.

Sun 11 OctCryptography and SecurityArtificial IntelligenceSoftware Engineering
The gist
Using large language models to write code can speed up software creation, but these models often produce insecure code or buggy fixes. The authors found that these problems come from biases in the data used to train the models and that the models themselves can be attacked. Current tests to check the security of AI-generated code are weak and sometimes unreliable. That means human experts still have to carefully check code created by these AI tools. Improving safety will need better AI designs, more security-focused tests, and ways for humans and AI to work together effectively.
Open → 2610.15482v1

AI agents match humans in analyzing small software programs fast

Humans vs. Machines: A Comparison With AI Agents in Software Reverse Engineering

Abstract: Can an autonomous AI agent reverse engineer a binary as well as a skilled human analyst? Do they adopt the same strategy, and can agents scale to real-world programs? We compare human and LLM-based software reverse engineering (SRE): nine models tackle two compact static-analysis challenges previously solved by human analysts, scored with a common understanding rubric, and we record their complete interactions with IDA Pro. This lets us compare not only what humans and agents recover, but also how they investigate a binary. The best agents (GPT-5.5 Pro, Claude Opus 4.8, and Kimi K3) achieve statistically human-competitive understanding on both tasks, while weaker models remain far behind. Ablations show that the gap depends on code representation and workflow demands, not on model capability alone: open-weight models improve substantially with richer code representations, whereas frontier models show no significant change. Similar success rates hide different workflows. Humans repeatedly revisit functions and follow local program structure; strong agents jump across the binary, retrieve information broadly, and rarely return to inspected code, a behavior we call greedy fetching. This strategy is not fixed: given semantically richer code, agents fetch less without losing understanding. Because greedy fetching aggregates large amounts of code in the agent's context, we measure context-window saturation across 4,000 real-world binaries: large windows accommodate many programs, but larger applications and lower-level representations quickly exhaust them. Autonomous reverse engineering is becoming competitive, with a large speed advantage, but scaling it will require better navigation, selective retrieval, and persistent analysis state, not merely larger context windows.

Sat 10 OctSoftware EngineeringArtificial Intelligence
The gist
Reversing software means understanding a program by looking at its code without having the original source. This study compares how well humans and AI models can analyze small software programs using a tool called IDA Pro. Some top AI agents perform just as well as skilled humans, but they use different strategies: humans carefully revisit code parts, while AI quickly grabs broad information once. While AI is fast and promising, handling larger software will need new ways to organize their analysis and remember past findings.
Open → 2610.14960v1

Statistical methods improve identification and estimation for nonsymmetric point processes

Identication and Estimation of Nonsymmetric Determinantal Point Processes

Abstract: Determinantal point processes (DPPs) provide tractable distributions for nite random sets, but the usual symmetric-kernel specication imposes nonpositive pairwise dependence. Statistical research on nonsymmetric DPPs, which can accommodate positive dependence, remains limited. We study identication and estimation for this class. First, we establish the equivalence of two sucient conditions for a nonsymmetric kernel to dene a valid DPP. Second, we develop the identication theory for nonsymmetric DPPs. Third, we develop cardinality-truncated maximum-likelihood estimation and estimation by averaged stochastic gradient descent. Under suitable identication and regularity conditions, we establish consistency and asymptotic normality for both estimators. Simulations examine identication, the eects of truncation, and the nite-sample performance of the estimators. We illustrate the methods with two cyber applications at markedly dierent sampling frequencies: weekly sector-by-breach data and second-by-second enterprise authentication data with more than ve million set observations.

Sat 10 OctMachine Learning
The gist
Determinantal point processes (DPPs) help model patterns where items occur randomly, but traditional methods only handle situations where items tend to repel each other. The authors study nonsymmetric DPPs, which can capture situations where items might also attract each other, a more flexible approach. They develop conditions for these models to be valid, create ways to estimate their parameters, and show the statistical properties of these estimators. Their methods are tested through simulations and applied to real-world cybersecurity data with very different time scales.
Open → 2610.14520v1

Network structure affects how AI fights deception with truth or checks

Network Topology Shapes AI Intervention Effectiveness on Deception: Truth-Telling vs. Investigative Agents

Abstract: Deploying AI agents to combat dishonest communication is an intuitive response to deception in hybrid human-AI societies. However, the efficacy of such interventions in realistic networked settings remains unclear. We study this problem using an evolutionary game-theoretic model of the Deceiver's Game by extending it to structured networks, where agents can adopt deception, truth-telling, and investigation strategies. We introduce committed AI agents (zealots) fixed to either truth-telling or investigative strategies and conduct agent-based simulations across three network topologies. Our key findings are: (1) passive committed truth-telling agents can amplify adaptive deception by creating exploitable honest partners, whereas investigative agents increase adaptive truth-telling in the oscillatory regime; (2) intervention effects are non-monotonic in deployment density because committed agents reshape rather than simply suppress the underlying oscillatory dynamics; and (3) response peaks depend on topology, with sampled scale-free populations showing sharp low-density responses and fully connected populations requiring larger committed fractions. Overall, the results highlight the need to distinguish passive truth-telling from active investigation when using committed agents to influence networked deception dynamics.

Fri 9 OctComputer Science and Game Theory
The gist
People and AI sometimes communicate dishonestly, and AI agents can help catch or counter lies. This study looks at how AI agents set to always tell the truth or to actively investigate others influence honesty in social networks. The authors found that simply adding truth-telling AI can sometimes make honest people easier to deceive, while investigative AI encourages more truthful behavior. The impact depends on how many AI are involved and the kind of network connections between people and AI.
Open → 2610.12931v1

Diffusion-integrated scores speed up detecting data changes in real time

Quickest Change Detection with Diffusion-Integrated Scores

Abstract: Classical CUSUM relies on the log-likelihood ratio of the underlying distributions, which cannot generally be computed from finite pre- and post-change samples alone. We propose diffusion-integrated score CUSUM (DI-SCUSUM), a training-free detector. We add Gaussian noise to the samples to form two smooth density estimates and calculate their Hyvärinen scores exactly, without training a score network. For each incoming observation, we sample a diffusion time, perturb the observation, and use the importance-weighted score difference as an increment in the DI-SCUSUM recursion. Under the assumption that observations follow the fixed empirical distributions, the post-change mean increment is proportional to the Kullback-Leibler (KL) divergence from the smoothed post-change to the smoothed pre-change empirical distribution. We establish exponential false-alarm scaling and a first-order delay bound that, for a fixed threshold and increment scaling, is inversely proportional to the KL divergence. In the calibrated anisotropic Gaussian simulation, DI-SCUSUM nearly matches likelihood-ratio CUSUM and reduces the measured detection delay by about 91% relative to score-based CUSUM. On MNIST and Oxford-IIIT Pet, DI-SCUSUM also has lower empirical conditional detection delay than SCUSUM at comparable false-alarm levels.

Thu 8 OctMachine Learning
The gist
Detecting when data changes quickly is important but can be hard because typical methods need detailed knowledge about the data. This paper presents a new method called DI-SCUSUM that uses added noise and mathematical scores to spot changes without training on data. Their method works well by measuring how different the noisy versions of data before and after changes are and does this faster than other score-based techniques. They tested it on both simulated and real image data, showing it detects changes with less delay and similar false alarms.
Open → 2610.12200v1

Quantum model improves anomaly detection with scarce data

Quantum anomaly detection in real scarce data

Abstract: Anomaly detection on small and unbalanced datasets remains very challenging in machine learning, although this scenario is common in several domains, including healthcare, cybersecurity, finance, and energy. Data augmentation and generative AI may mitigate training-data scarcity, but they often fall short because anomalies are, by definition, unpredictable, rare, and highly diverse events compared to high-probability normal data. Overfitting to pseudo-anomalies, model collapse, high-dimensional data, uninterpretable black-box models, and validation challenges are typical issues limiting their practical applicability. In this context, quantum machine learning may provide a promising and more sustainable avenue because it can enable more interpretable models with far fewer trainable parameters and smaller datasets, implementable on energy-efficient quantum hardware. Here, we propose a novel two-step hybrid classical--quantum architecture for sequential data and test it on a realistic scenario in the global energy-transition domain, i.e., automated anomaly detection in large-scale photovoltaic plants. The achieved generalization capability and competitive prediction accuracy may pave the way for new hybrid learning models able to exploit the continuously increasing power of cloud-available and more sustainable quantum accelerators integrated with more traditional energy-hungry High Performance Computing resources.

Wed 7 OctMachine Learning
The gist
Detecting unusual or rare events in small or unbalanced datasets is a tough task for traditional machine learning because anomalies are rare and unpredictable. The authors propose a new approach that combines classical and quantum computing to build a model with fewer parameters that works well on smaller datasets and is more interpretable. They tested their method on data from large solar power plants and found it can detect anomalies effectively and generalize well. This approach holds promise for making anomaly detection more efficient and sustainable using emerging quantum hardware.
Open → 2610.09635v1

Graph neural networks improve out of distribution learning with two representations

Complementary Supervised and Self-Supervised Representations for Out-of-Distribution Graph Learning

Abstract: Out-of-distribution (OOD) generalization remains challenging for graph neural networks (GNNs), as graph distributions can vary substantially across time and domains. Supervised and self-supervised graph representation learning are guided by distinct objectives and offer different perspectives on graph representations. In this work, we study whether self-supervised representations (SSL) can provide complementary signals to improve supervised OOD node classification. We develop two backbone-agnostic frameworks that exploit such information at different stages of learning and prediction. Co-Train jointly learns supervised and SSL representations and adaptively integrates them during training, while Dual-Space Retrieval performs non-parametric prediction in the two representation spaces and combines their predictions through confidence-aware fusion at inference time. The supervised and SSL encoders are separately parameterized and need not share the same GNN architecture. We evaluate multiple GNN backbones and two distinct SSL objectives, DGI and GRACE, on four graph benchmarks spanning temporal and cross-domain distribution shifts. Extensive experiments show that Co-Train consistently outperforms strong supervised OOD baselines, while Dual-Space Retrieval achieves competitive performance as a flexible non-parametric alternative. Results across different backbones and SSL objectives, together with representation analyses and ablations, demonstrate that SSL representations provide complementary information to supervised representations and can improve OOD node classification across diverse settings.

Tue 6 OctMachine Learning
The gist
Graphs can change a lot depending on time or place, and that makes it hard for computers to correctly understand new graphs that look different from those they learned on. The authors studied whether combining two ways of learning graph patterns—one that learns from labeled examples and another that learns from the graph itself without labels—helps computers do better on these new, different graphs. They created two methods: one that learns both kinds of information together, and another that combines the two separately at prediction time. Their tests show that using both kinds of learning leads to better recognition of nodes in new graph situations than just supervised learning alone.
Open → 2610.07628v1

Competition between senders can improve receiver estimates in status updates

Timely Persuasion with Opposing Senders: When Does Competition Help the Receiver?

Abstract: Status updates let a receiver track a changing process, but a sender that controls when they are sent can steer the receiver's estimate without misreporting. We study competition between two such senders with opposing preferences, who report on a binary continuous-time Markov chain using state-dependent Poisson rates under individual budgets. The receiver follows the reports through a zero-order-hold estimator only if this yields at least the long-run weighted correct-estimation utility of a prior-based default estimate. We model the interaction as a Stackelberg game in which the sender favored by this default leads, the opposing sender follows, and the receiver then selects its estimator. We characterize the pure-strategy equilibria in closed form. When the follower can obtain positive utility against a silent leader, limited state-$0$ reporting by the leader merely frees part of the follower's budget for state-$1$ reports, so every optimal leader policy is either silence or full-budget state-$0$ reporting, depending on explicit budget thresholds. A single sender with the same total budget leaves the receiver at its default utility, whereas the full-budget intervention outcome makes the receiver's participation constraint slack and strictly improves its utility. At the intervention threshold, silence and full-budget intervention yield identical sender payoffs but different receiver utilities. Numerical results illustrate these regimes and compare equilibrium performance with a receiver-optimal reporting benchmark.

Sat 3 OctInformation TheoryComputer Science and Game TheoryNetworking and Internet Architecture
The gist
This paper looks at how two competing sources send updates about a changing situation and how this affects a person or system trying to keep track. When both senders want different outcomes, their competition can sometimes help the receiver get better information than just relying on default guesses. The authors show exactly when one sender’s silence or full effort is best and how this impacts the receiver’s overall benefit. They use a game-based model and mathematical formulas to understand this interaction.
Open → 2610.04468v1

Automated attack path creation from vulnerability descriptions using AI

CVE2AP: Automated Generation of PDDL-Encoded Attack Paths via Large Language Models

Abstract: Attack Path (AP) modeling is fundamental to cybersecurity analysis, where the Planning Domain Definition Language (PDDL) has been widely adopted to encode APs into formal and machine-verifiable representations for automated reasoning about vulnerability exploitation, attack progression, and their potential impacts. However, existing AP modeling approaches largely rely on expert-driven manual construction, limiting their scalability and ability to keep pace with rapidly evolving cyber threats. Large language models (LLMs) are promising candidates, as their extensive pre-trained knowledge and reasoning capabilities enable them to interpret and transform threat intelligence into formal representations. In this paper, we propose \textbf{CVE2AP}, an LLM-based approach for automatically generating PDDL-encoded attack paths from natural language CVE (Common Vulnerability Exposure) descriptions. CVE2AP leverages structured prompting and incorporates an error-feedback mechanism that iteratively refines the generated paths using planner-reported syntactic and solvability errors. We conduct a systematic empirical evaluation across multiple LLMs and generation configurations, assessing generation quality across syntactic, solvability and semantic dimensions, together with token consumption and generation time. The results demonstrate that CVE2AP effectively generates high-quality PDDL-encoded attack paths, achieving up to 86.9\% syntax correctness, 78.6\% solvability, and 93.1\% semantic correctness under LLM-as-expert evaluation, while \texttt{GPT-5.5} offers the best quality-cost trade-off and error feedback yields the most consistent quality improvement.

Fri 2 OctArtificial Intelligence
The gist
Creating detailed attack paths in cybersecurity normally takes experts a lot of time and effort. The authors introduce a method called CVE2AP that uses large language models to turn natural language descriptions of vulnerabilities into formal attack paths automatically. This approach improves the speed and consistency of analysis by iteratively fixing errors in the generated attack paths. Their tests show that CVE2AP produces mostly correct and useful attack paths, with GPT-5.5 performing best overall.
Open → 2610.03383v1

Input scaling effects on quantum attention robustness tested

When Normalization Selects the Sign: Auditing Robustness Ablations in Quantum Attention

Abstract: Removing an input-scaling module changes both a classifier and the perturbations reaching its encoder. A robustness difference can therefore reflect the comparison rule as well as the module. We demonstrate this problem in a four-qubit quantum-attention detector on generated power-grid trajectories. A learned scaling module appears beneficial at a fixed physical attack budget, but matching an upper bound on perturbations at the encoder reverses the ordering. Neither comparison alone establishes a robustness benefit caused by the module. The initial test also perturbs clean examples into attacked examples while retaining their original labels; tests restricted to already attacked examples do not establish a benefit. Replacing a trained model's input scales disrupts detection. Retraining its linear classification layer restores the detection rate, but changes individual predictions, leaving the comparison descriptive rather than causal. Two further design checks explain why the input quantum Fisher information regularizer cannot train this model's query parameters, and why removing confidence bounds does not establish a larger certified radius. The evidence is limited to ten seeds, exact simulation, synthetic data, and a restricted set of attacks; classical baselines achieve better clean prediction. The practical lesson is to specify which perturbation budget is fixed, check that attacks preserve labels and interventions preserve predictions, and distinguish exploratory controls from confirmatory evidence.

Fri 2 OctCryptography and SecurityMachine Learning
The gist
This paper looks at how a small part of a quantum-based system, called an input scaling module, impacts its ability to detect changes or attacks. The authors found that simply removing or changing this module can make it look like the system is more or less robust, but this effect might come from how researchers compare versions rather than the module itself. The study shows that testing methods need clear rules about what changes count as attacks and which results really show improvements. The authors give advice on how to better check these kinds of quantum models.
Open → 2610.02641v1

Feature based graph augmentation improves learning on incomplete graphs

Learning the Latent Structure: A Feature-Centric Approach to Graph Data Augmentation

Abstract: Graph-structured data plays a pivotal role in modeling complex relationships. However, real-world graphs are often incomplete due to data collection and observational constraints, severely limiting the effectiveness of modern graph learning pipelines. While existing Graph Data Augmentation (GDA) methods attempt to refine graph structures for improved downstream performance, they are typically label-dependent, computationally expensive, and inherently transductive, limiting their applicability in practical scenarios. In this work, we present a novel feature-centric graph data augmentation framework that bypasses explicit structure modeling by operating directly in the embedding space. Through a self-supervised inverse masking process, our method captures latent ties between observed and complete graphs, enabling recovery of unobserved structural signals through refined node representations. To enhance robustness under noisy and sparse supervision, we introduce a message regularizer and a bootstrap strategy for effective training and generalization. Evaluated on ten graph datasets spanning multiple domains, our approach, SelfAug, consistently outperforms state-of-the-art methods in both accuracy and efficiency across inductive and cold-start settings, highlighting its potential as a scalable and generalizable solution for real-world graph learning scenarios.

Thu 1 OctMachine Learning
The gist
Graphs are helpful for showing how things connect, but real-world graphs often miss some connections, which makes it hard for computers to learn from them. The authors created a new method that works with the features of nodes rather than guessing missing connections directly. This method helps computers figure out hidden links by learning from the patterns in node data, even when labels or supervision are limited. Tested on many different graphs, their method consistently performs better and runs faster than previous approaches.
Open → 2610.02517v1

Malware classification with detailed behavior tracing in code

Behavior-Centric Malware Classification with Fine-Grained Malicious Logic Localization

Abstract: Effective malware analysis requires understanding not only whether a program is malicious, but also which behaviors it exhibits and where those behaviors originate in the code. Existing machine-learning-based malware detectors largely operate as black boxes, providing limited insight into the malicious logic responsible for their decisions. This paper addresses malicious behavior localization and classification at the basic-block level. We propose a behavior-centric analysis framework that decomposes malware samples into behaviors and systematically links these behaviors to their originating code regions. Using context-sensitive backward slicing from security-relevant system API calls, we reconstruct control- and data-dependency chains and represent each behavior as a structured graph of related basic blocks. A Transformer-based model captures instruction-level semantics, while a Graph Neural Network models structural dependencies within behavior graphs. The resulting representations are fused to enable accurate and interpretable classification, with attention-based attribution identifying code regions responsible for malicious behaviors. We evaluate our approach using standard classification metrics and a behavior coverage metric that measures the detection of manually labeled malicious behaviors. Our results demonstrate that the proposed framework achieves accurate malware classification while providing fine-grained, behavior-aware localization of malicious logic.

Tue 29 SeptCryptography and Security
The gist
Deciding if a computer program is bad is not enough; it's important to know what bad actions it does and where in the program. The authors created a method that breaks down harmful programs into their behaviors and finds the exact small pieces of code responsible for them. They use smart techniques to read code and show connections inside the program, then combine this info to accurately label malware and explain why. Their work helps understand malware better by showing both what it does and where the actions come from.
Open → 2609.38390v1

Large language models show promise for evaluating trust in cybersecurity

LLM4Trust: Exploring the Capabilities of Large Language Models for Trust Evaluation

Abstract: Trust evaluation plays a critical role in cybersecurity by supporting risk mitigation and decision-making. A variety of trust evaluation methods have been proposed, with learning-based approaches offering high accuracy and automation. However, they often require substantial ground truth, suffer from low training efficiency, lack support for basic trust properties, and provide limited explainability. Large Language Models (LLMs) offer a compelling alternative due to their strong zero-/few-shot reasoning abilities and broad knowledge. To this end, we propose LLM4Trust, the first benchmark framework that systematically explores the capabilities of LLMs for trust evaluation. We first construct diverse trust graphs to model five basic trust properties and design corresponding property understanding tasks. We then assess the ability of eight representative LLMs to understand these properties under nine prompt methods. Based on this exploration, we identify the most effective LLM-prompt combinations and apply them to five real-world datasets for validating LLMs' trust evaluation capability. During this process, we propose two strategies to extract key information from large-scale trust graphs, addressing the context window limitations of LLMs. Extensive experiments show that LLMs can effectively understand basic trust properties and have great potential for real-world trust evaluation, particularly under limited supervision. However, they remain vulnerable to attacks targeting trust graphs and demonstration examples used in few-shot prompting, and incur high inference costs. Accordingly, we propose a defense mechanism and batch inference to improve the robustness and efficiency of LLM-based trust evaluation. The source code of LLM4Trust is available at https://github.com/Jieerbobo/LLM4Trust

Sun 27 SeptMachine Learning
The gist
Trust evaluation helps computers decide who and what to trust, which is important for cybersecurity safety. Current methods require lots of data and are hard to explain, so the authors tested if large language models (LLMs), which understand language well, could do this better. They created tests to see if LLMs understood key trust concepts and found that some worked well, especially when given little training. However, these models can be tricked and are costly to run, so the authors suggest ways to make them safer and more efficient.
Open → 2609.33521v1

Cyberclear tests ai agents on tracking long cyberattack chains

CyberClear: A Benchmark for LLM Agent Systems on APT Attack Chain Provenance

Abstract: Large language model agents have demonstrated promising capabilities in cybersecurity tasks, yet their ability to reconstruct complete Advanced Persistent Threat attack campaigns from complex security logs remains largely unexplored. Existing cybersecurity benchmarks for agents mainly focus on vulnerability discovery, exploitation, and security analysis tasks, leaving the evaluation of attack chain provenance under realistic security logs insufficiently studied. To address this gap, we introduce CyberClear, a benchmark for evaluating LLM agents and advanced agent systems on APT attack chain provenance from long-context security logs. CyberClear covers both single-step attacks and multi-stage attack chains, requiring agents to identify attack evidence, infer attack progression, and generate provenance graphs containing entities, causal relationships, MITRE ATT&CK techniques, and forensic evidence. To enable comprehensive evaluation, we develop an evaluation method tailored to APT attack chain provenance. Unlike conventional text similarity metrics that focus on surface-level matching, our evaluation examines whether reconstructed graphs preserve the semantics of attack chains across single-step behavior correctness, multi-step behavior identification, temporal and causal consistency, entity and relationship fidelity, and overall attack narrative consistency. Advanced multi-agent systems powered by state-of-the-art LLMs still struggle on CyberClear, motivating us to propose CyberProvenance, an agent cyber harness designed for multi-agents that augments LLM agents with evidence accumulation, execution-based validation, and feedback-guided refinement mechanisms for reliable attack-chain provenance. Extensive evaluations on CyberClear demonstrate the effectiveness of CyberProvenance in improving evidence reasoning, execution-grounded validation, and complete APT attack chain reconstruction.

Sat 26 SeptCryptography and SecurityArtificial Intelligence
The gist
The paper deals with how well AI programs can track complicated cyberattacks that happen step-by-step over time. Existing AI tests mostly focus on finding vulnerabilities or spotting individual attacks, but this work looks at understanding the whole series of attacks from long security logs. The authors created CyberClear, a set of challenges that make AI agents identify attack evidence, figure out how attacks progressed, and map out the relationships and techniques used. They also introduced CyberProvenance, a new AI system that improves reasoning by gathering evidence and checking its conclusions. Their tests show that this new system does better at reconstructing complete attack stories.
Open → 2609.32424v1

MimicSat enables testing satellite missions with software and hardware models

MimicSat: A Reconfigurable Cyber-Physical Testbed For Small Satellite Systems and Cybersecurity Research

Abstract: MimicSat provides a common experimental environment for examining how changes in satellite subsystem behavior propagate to mission outcomes across software-based and hardware-based execution. Its design is motivated by controlled spacecraft cybersecurity studies involving attacks, faults, and defensive responses. In MimicSat, a mission encompasses the spacecraft and ground activities required to achieve defined objectives, and an experiment consists of one or more mission runs used to study selected conditions or interventions. To support such studies, MimicSat offers software-based and hardware-based execution environments that implement the same mission functions and data exchanges, while allowing specific functions to be realized differently. A shared mission definition preserves command and telemetry semantics across environments, and collected observations retain provenance about the originating participants and acquisition paths. As a result, mission behavior can be compared across execution configurations without redefining the surrounding mission. This paper presents the architectural principles of MimicSat, its software and hardware execution forms, and their integrated operation. MimicSat also supports satellite systems engineering, mission operations, resilience studies, and related experimental use cases.

Wed 23 SeptCryptography and Security
The gist
Satellite developers often need to study how changes in parts of a spacecraft affect its overall mission, especially when dealing with cyberattacks or faults. MimicSat provides a shared setup where the same satellite mission can be run using both software and hardware models to observe differences and responses. This helps researchers see how problems in one part spread and impact outcomes, without changing the mission itself. The system keeps track of where data comes from, making it easier to compare results from different setups. Besides cybersecurity, MimicSat can also help in satellite design and operation tests.
Open → 2609.28228v1

Lightweight memory improves learning from few graph examples over time

A Lightweight Plastic-Memory Framework for Graph Few-Shot Class-Incremental Learning

Abstract: Graph Incremental Learning has garnered increasing attention as dynamic graph data continues to emerge across diverse fields. Conventional approaches primarily address catastrophic forgetting by preserving node-related knowledge through replay or distillation techniques; however, they often incur high computational costs and inefficiency. This issue is further exacerbated in real-world scenarios where labeled data for new classes is scarce. In this paper, we propose a novel lightweight plastic-memory framework specifically designed for few-shot incremental learning on graphs. The core idea of our framework is the construction of a plastic-memory module that evolves over time, continuously updating and expanding its memory to accommodate new classes while retaining previously learned knowledge. In contrast to existing techniques, our memory module is both lightweight and effective, featuring an innovative evolving micro-clustering structure that dynamically updates representations of class prototypes, sub-prototypes, and their interaction weights. Building on this memory module, we introduce a memory-driven meta-learning framework that enhances adaptability to new tasks in its inner loop while maintaining stability for earlier tasks in the outer loop. Extensive experiments on four benchmark datasets demonstrate the framework's superior performance in balancing stability for old knowledge and adaptability to new knowledge.

Tue 22 SeptMachine Learning
The gist
Learning to recognize new categories in graph data is hard when few examples exist, and learning many times can cause forgetting old knowledge. The authors created a small, adaptable memory module that updates dynamically with new information while remembering old categories. They combined this with a special training method that balances learning new tasks while keeping old skills stable. Their approach works better than older methods on several test datasets.
Open → 2609.25781v1

Detection methods highlight mislabeled Google Play apps but do not improve predictions

Identifying Suspected Mislabeled Apps in Google Play Application Removal Prediction: An Empirical Comparison of Label Noise Detection Methods

Abstract: Models that predict which Google Play apps will be removed are trained on labels that record only whether an app was still in the store at a later observation. A disappeared app is labeled removed and a present one stable, but neither records why. A voluntary withdrawal and a policy takedown both produce removed, and an uncaught spam app keeps stable. This work calls that mismatch label noise. Three detectors from different methodological families are applied to the 870,514 apps of Mohsen, Karastoyanova, and Azzopardi (2022): Isolation Forest, flagging apps unusual in the feature space, Neighborhood Disagreement, flagging apps whose nearest neighbors carry the opposite label, and Prediction Inconsistency, flagging apps a classifier labels differently from the data. The apps flagged by all three, the overlap, number 7,598 at default settings and are the strongest mislabeling candidates. Two questions follow. First, does removing flagged apps improve the model? It does not. No detector, overlap, or union beats the baseline, and the loss grows with the number removed. Second, do flagged apps appear less often than expected among apps whose label VirusTotal and Quark Engine confirm? Among confirmed removals they do, falling to 0.43 times the expected rate as the threshold tightens, while an excess on the stable side disappears once the age of the scanned apps is accounted for. A model trained on only the 3,021 trainable overlap apps reaches a test AUC of 0.2518, far below chance, so the relationship between features and labels there runs opposite to the rest of the data. The flagged apps run wrong in both directions: abandoned apps that resemble spam carry stable, while apps that look healthy carry removed. The value of the detectors lies in characterizing this label noise. They locate a small set of candidates they cannot profitably remove.

Mon 21 SeptCryptography and Security
The gist
The problem is that apps removed from Google Play can disappear for different reasons, but the data only says if they were removed or not, making the labels noisy. The authors tested three ways to find apps that were likely mislabeled and found a small group where the label didn’t match the app’s features well. Removing these apps didn’t help improve prediction models and confirmed mislabeled apps appear less among those verified by security services. The value of these methods is in understanding the noise, not in improving removal predictions.
Open → 2609.25487v1

Ai agents tested for finding mobile app security flaws with executable checks

MobileCybench: Evaluating Agent Vulnerability Discovery via Executable Probes

Abstract: AI agents now report vulnerabilities faster than maintainers can review them. Reports often depend on security properties specific to the application, and require considerable human labor to process. To mitigate this, we introduce a framework for evaluating vulnerability reports via probes, executable checks of security properties. A reported exploit is evaluated by replaying it against the application and running the probes: a triggered probe indicates both that the exploit succeeded and which security property it violated. As a probe encodes a security property rather than a known vulnerability, it can detect vulnerabilities that were not known when the probe was written. We instantiate the framework as MobileCybench, a benchmark for vulnerability discovery by AI agents in 13 Android applications, with 495 probes written and reviewed by the authors. We evaluate 5 coding agents (OpenCode with GPT-5.5, GPT-5.6-Sol, and GLM-5.2; Claude Code with Opus 4.8 and Opus 5) under 4 settings: as a malicious app on the victim's device or as a remote attacker with a low-privilege account, each with either only an obfuscated APK or access to the application's source code. Given only the obfuscated APK, the top agent, OpenCode with GPT-5.6-Sol, triggers probes in 53.8% of applications in the malicious-app setting and 16.7% in the remote-attacker setting. With source code, the trigger rate across all agents and both attack settings increases from 28.8% to 32.8%. Building and running the benchmark surfaced 23 previously unreported vulnerabilities, the majority of which have been confirmed by maintainers.

Mon 21 SeptCryptography and SecurityArtificial IntelligenceMachine Learning
The gist
Finding security problems in mobile apps is slow and often requires a lot of work to understand the details. The authors created a new way to check if reported problems really exist by running special tests called probes that see which security rules were broken. They built a tool called MobileCybench with these probes to test AI programs on Android apps. The best AI found security problems in over half the apps when it pretended to be a malicious app. This method also found many new problems that app makers confirmed were real.
Open → 2609.23980v1

Temporal window size shapes detection of online coordinated actions

Setting the clock: Evaluating temporal window parameters for coordinated behavior detection

Abstract: Coordinated behavior is a central mechanism of online collective action. On social media platforms, it can support legitimate mobilization, but it can also be exploited in disinformation campaigns, astroturfing, and information operations. Detecting coordinated behavior on social media platforms typically relies on coordination networks, where users are linked when they perform similar actions within shared temporal windows. While the temporal window is central to how coordination is operationalized, it is often treated as an implementation detail rather than as a substantive modeling decision. This paper presents a first analysis of how two key temporal parameters, window length and stride, affect the detection of coordinated communities within information operation campaigns. We find that window length determines which coordination patterns are detectable, while window stride has negligible effect on precision and recall. Our analysis highlights selecting appropriate temporal window parameters as an open methodological challenge requiring careful treatment.

Fri 18 SeptSocial and Information Networks
The gist
Detecting when people work together online often depends on looking at actions they do within certain time frames. This paper studied how the length of these time frames affects finding groups that coordinate, such as in disinformation campaigns. The researchers found that the duration of the time window is important for spotting different coordination patterns, while how often the window moves forward matters less. Their work points out that choosing the right time window is a key challenge for detecting coordinated behavior reliably.
Open → 2609.21959v1

Multi-agent evolution improves fake news detection with large language models

Reasoning through Evolution: Automatic Meta-path Discovery for LLM-based Fake News Detection

Abstract: Propagation structures provide crucial evidence for fake news detection, yet existing approaches primarily rely on supervised GNN-based models, which require substantial labeled data and exhibit limited generalization. Although large language models (LLMs) exhibit strong reasoning capabilities, directly feeding them raw propagation graphs creates a significant modality mismatch and severe information overload, making structure-aware reasoning unreliable in zero-shot and few-shot settings. To bridge this gap, we propose MAGER, a multi-agent genetic evolution framework that automatically discovers meta-paths optimized for LLM reasoning. By compressing complex propagation graphs into informative subgraphs, the evolved meta-paths alleviate both information overload and modality mismatch, enabling frozen LLMs to perform structure-aware veracity reasoning. We further introduce a graph in-context learning strategy that retrieves semantically and structurally similar demonstrations to strengthen classification and reasoning. Extensive experiments show that MAGER substantially improves frozen LLMs as standalone fake news detectors in data-efficient settings. Our code is available at https://github.com/SenticNet/MAGER.

Wed 16 SeptArtificial IntelligenceMachine Learning
The gist
Detecting fake news is hard because news spreading patterns are complex and current methods need lots of labeled examples. The researchers found a way to summarize these complex spreading patterns into simpler parts called meta-paths that help large language models (LLMs) understand the structure better. They use a method inspired by genetic evolution to find the best meta-paths automatically. This helps LLMs make better decisions about whether news is fake, even when there are few labeled examples available.
Open → 2609.18597v1

Network traffic classification improved with human guided semantic validation

Beyond Measurement Metrics: A Human-Centered Framework for Semantic Validation of Network Traffic Classification

Abstract: Machine learning (ML) has become the dominant approach for network traffic classification, achieving very high predictive performance. However, a model is only valuable if it learns semantically meaningful and trustworthy patterns rather than exploiting spurious correlations. Conventional evaluation practices predominantly assess predictive performance. Consequently, whether the model relies on semantically meaningful patterns remains unknown. To address these challenges, we adapt the knowledge generation framework for network traffic classification. The adapted framework combines data, ML models, explainability, visualization, and expert reasoning to support the iterative exploration, verification, and refinement of model behavior and data preprocessing. The framework is grounded in findings from the literature, benchmark dataset analyses, practical experience with XAI-based traffic classification, and expert feedback, providing practical guidance for semantic model validation. By complementing predictive performance with semantic validation and human expertise, the proposed framework supports the development of network traffic classification models that are not only accurate but also robust and trustworthy.

Tue 15 SeptNetworking and Internet ArchitectureHuman-Computer InteractionMachine Learning
The gist
High accuracy in identifying types of network traffic using machine learning is common, but it is unclear if the models learn meaningful patterns or just tricks. The authors propose a new framework that brings together data, machine learning models, explanations for those models, visual tools, and expert judgment to better understand and improve model behavior. This approach helps ensure that the models work in a trustworthy way and are robust, not just accurate. It encourages combining human feedback with machine performance to make smarter network traffic classification.
Open → 2609.17014v1

NIST Bugs Framework offers clearer automated vulnerability classification than CWE

Evaluating the NIST Bugs Framework Against CWE as a Successor for Automated Vulnerability Classification

Abstract: Vulnerability classification based on root cause weaknesses is essential for numerous cybersecurity activities, where the Common Weakness Enumeration (CWE) serves as a public repository of such flaws. However, its overlapping entries create a non-orthogonal structure. The result is the same vulnerability being mapped to multiple weaknesses, complicating Root Cause Analysis (RCA) and triage. To address this, NIST Special Publication 800-231 introduces the Bugs Framework (BF), which organizes vulnerabilities into <cause, operation, consequence> triples and links such triples into a causal chain, so that a vulnerability carries its root cause and its sink together instead of a single terminal label. To date, however, BF has been specified but not evaluated regarding its performance against the challenges to automated classification. The evidence required for adoption has not been investigated empirically. We evaluate BF as a classification target and a complement to CWE using a systematically screened corpus of automated Common Vulnerabilities and Exposures (CVEs) linked to CWE research. We assess the reproducibility of CVE-to-BF classification through two evaluations. The first is qualitative: an anonymized inter-rater study in which 2 subject-matter experts (SMEs) independently mapped 13 CVEs onto the four BF axes. Annotators showed strong agreement on the cause and operation axes, while the attribute axis indicated fair agreement. We also tested our automated framework across two large language model (LLM) deployments under different budgets for reproducibility analysis. Despite limitations, such as evidence availability and the absence of retrievable fix commits for closed-source software, our findings support the claim that BF is a more structured and automation-friendly framework than CWE. Our exploration reveals specific gaps in BF, including under-specified guidance on attributes.

Mon 14 SeptCryptography and SecuritySoftware Engineering
The gist
Classifying software vulnerabilities helps cybersecurity teams understand and fix problems quickly. The existing system, called CWE, often assigns multiple overlapping labels to a single vulnerability, making it confusing. The authors studied a new system called the Bugs Framework that organizes vulnerabilities by cause and effect in a structured way. They found it easier to automate classification with this new method, though some parts need clearer guidelines. Overall, the Bugs Framework could improve how computers sort and explain vulnerabilities.
Open → 2609.16433v1

Score based method controls generation of rare outlier data points

Score-based Outlier Generation via Controlling the Radon-Nikodym Derivative

Abstract: Outliers are important for stress-testing algorithms and understanding system behaviour under rare conditions. Despite being commonly described as low-likelihood events, existing generative approaches rarely control likelihood explicitly. In this work, we introduce a measure-theoretic notion of outliers based on the distribution of log-likelihood values, which is guaranteed to assign higher probability mass to low-likelihood events with a specifiable magnitude. Building on this formulation, we derive how likelihood reweighting modifies the diffusion score and use this relation to motivate a controlled modification of the reverse-time dynamics. In particular, likelihood reweighting implies a scaling of the score function with a control term derived from the Radon-Nikodym derivative of the likelihood distributions. Correspondingly, the updated score function can be obtained with no retraining of the diffusion model. We exploit the Ornstein-Uhlenbeck semigroup underlying diffusion models to motivate an exponentially interpolated controller which approximates the true control. Experiments demonstrate controlled generation of low-likelihood samples while remaining consistent with the data geometry.

Thu 10 SeptMachine Learning
The gist
Outliers are unusual data points that help test how algorithms perform with rare events. Most existing methods don't explicitly control how likely these rare points are. The authors define outliers using math that focuses on low-probability events and show how to change diffusion models to create these outliers without retraining. They test their method and demonstrate it produces rare samples that still fit the overall data structure.
Open → 2609.12113v1

Specified counterfactuals reveal how past changes alter graph predictions

Breaking Predictions Is Not Enough: Specified-Foil Counterfactuals for Temporal Graphs

Abstract: Temporal graph counterfactual explanations typically change past events to change or invalidate an original prediction, while leaving its replacement unspecified. Yet a user facing a predicted outcome often asks which past conditions would make a particular alternative occur instead. We formulate this destination-specific question as the Specified-Foil Counterfactual: given an original prediction A and a foil B fixed before search, find a low-cost past-event intervention under which the same predictor selects B as top-ranked. Our trace-guided intervention search contrasts the completed execution of A with a reconstructed incomplete execution of B, maps their difference to DELETE, INSERT, REWIRE, RELABEL, and SHIFT operations, and verifies B through exact replay. We instantiate this principle with LiFTER on continuous-time dynamic graphs and TLogic on temporal knowledge graphs. On CTDGs, the method retains 85.7-93.6% of black-box greedy successes while reducing predictor evaluations by 75.0-80.0%; on TKGs, it reaches the specified foil in 74.8% of 600 comparisons. Executable traces thereby become computational structures for constructing conditions of unselected alternatives, rather than records used only to explain predictions already made.

Thu 10 SeptArtificial Intelligence
The gist
Sometimes, people want to know how changing past events could lead to a different predicted outcome, not just any different outcome. The authors created a way to find specific past changes that would make a prediction switch from one option to a particular alternative. They do this by comparing how the original and alternative outcomes play out over time and identifying minimal changes to past connections or labels. Their method works well on two types of time-changing graphs and is more efficient than previous approaches.
Open → 2609.11170v1

Belief state engine improves planning in limited view environments

Belief-State Engine: Augmenting LLMs for Principled Planning Under Partial Observability

Abstract: Large language model agents produce fluent action sequences across a wide range of tasks, yet they fail in characteristic ways once the environment becomes partially observable. Ambiguous feedback pushes them into premature commitments. A single informative observation can collapse their uncertainty onto the wrong hypothesis. Policies drift as the history grows. We trace these symptoms to a common structural cause. An LLM agent, as commonly deployed, is a history-conditioned policy with no explicit belief over hidden state. We propose an architectural fix. The Belief-State Engine (BSE) is an inference module placed outside the LLM. It maintains a Bayesian posterior over the latent states of a given POMDP (Partially Observable Markov Decision Process) model, and at each decision step it exposes only that posterior to the LLM. The raw action-observation log is not shown. We set out a minimal four-axiom specification of what a belief-consistent internal state must satisfy, and prove that the LLM paired with the BSE is a sound Markov policy on the belief MDP induced by the underlying POMDP. It therefore inherits the Bellman optimality guarantees of classical POMDP theory, provided the LLM is never exposed to the raw history. We evaluate the architecture on the Tiger POMDP and a red-team attack-graph task, against six baselines: a reactive LLM, Chain-of-Thought, ReAct, a natural-language belief tracker, QMDP, and POMCP. Across both domains, the BSE-augmented agent improves task return, belief calibration, and decision consistency. Ten targeted ablations isolate the contribution of each architectural choice confirms that the effect is not specific to any one model. Code, environment specifications, prompt templates, and seed logs accompany this paper.

Wed 9 SeptArtificial IntelligenceMachine LearningRobotics
The gist
Large language models (LLMs) can follow instructions to perform tasks, but they struggle when they can't see the whole situation clearly. The authors found that this happens because these models don’t keep a clear mental map of what might be hidden. They built a tool called the Belief-State Engine (BSE) that keeps track of what is likely true based on past actions and observations. By only showing the LLM this clear summary instead of all past details, the system plans better and makes smarter decisions in tricky situations.
Open → 2609.10036v1

Multi agent graph learning improves reasoning on complex graphs

Multi-Agent Agentic Graph Learning via Structural Signatures

Abstract: Agentic graph learning (AGL) has recently achieved promising results on graph reasoning tasks, where an agent powered by a large language model (LLM) sequentially samples the graph as evidence to support its final prediction. Existing methods either employ a single agent or orchestrate multiple role-based agents to reason and learn over the entire graph, but both essentially rely on a shared reasoning policy across different graph regions, which can be suboptimal for graphs with heterogeneous structural and semantic patterns. Inspired by the progress of multi-agent collaboration on complex reasoning tasks, a natural remedy is to let multiple agents own different memory and collaborate; however, applying this paradigm to graphs directly faces two challenges. First, existing AGL methods typically verbalize graph structures into natural-language descriptions for LLM agents, making the reasoning process sensitive to the ordering of structural information and thereby breaking the permutation-invariant nature of graphs. Second, incorporating increasingly large sampled neighborhoods leads to rapidly growing contexts. To address these challenges, this paper introduces a multi-agent agentic graph learning (i.e., MAAGL) framework. MAAGL partitions the graph into communities and assigns an independent agent to each community for region-specific specialization. MAAGL represents structural and semantic evidence separately. Structural evidence is summarized by a dynamically updated structural signature that is permutation-invariant and fixed in size, while semantic evidence is filtered to the top-k nodes ranked by relevance. Based on historical trajectories with similar signatures, agents estimate their confidence and trigger debate-style collaboration when needed. Extensive experiments on four benchmark datasets show that MAAGL outperforms SOTA AGL methods.

Wed 9 SeptArtificial Intelligence
The gist
Graphs can be tricky because different parts may have very different patterns. The authors designed a way for multiple AI agents to work together by splitting the graph into communities. Each agent focuses on its own part, using special compact summaries of graph structure that don’t depend on how the graph is described. These agents also check when they need help and debate to improve their answers. This teamwork helped them do better on standard tests than earlier single-agent methods.
Open → 2609.09565v1

Cipher attacks can bypass language model safety without fine tuning

Arbitrary Cipher Attacks Against Large Language Models Do Not Require Fine-Tuning

Abstract: Large language model safety and security research is preoccupied with, among other things, detecting and preventing jailbreak attacks: alignment bypasses that allow an adversarial user to elicit unwanted or harmful outputs from models. Arbitrary cipher, or covert communication, attacks are one such type of jailbreak and have previously been demonstrated against the fine-tuning APIs of commercial models. In these attacks, target models are trained on a corpus of encrypted harmful questions and responses and subsequently respond to harmful requests through the learned encryption scheme. In this paper, we show that newer frontier models do not require fine-tuning to acquire cipher-based communication skills. Instead, they can learn these skills through prompting and, when necessary, through in-context learning. Furthermore, model alignment is significantly weakened or entirely bypassed when communication occurs through the learned cipher. To the best of our knowledge, this constitutes a novel attack vector against commercial black-box large language models. We demonstrate successful jailbreaks against frontier models developed by Anthropic, Google, and OpenAI. Our attack bypasses commercial harmfulness classifiers because harmful content is encrypted and therefore appears as nonsensical text or gibberish.

Wed 9 SeptCryptography and SecurityArtificial Intelligence
The gist
Language models like those behind chatbots have safety features to prevent harmful replies. This paper shows that attackers can secretly encrypt harmful requests so they look like gibberish to the model’s filters. Surprisingly, the attackers don’t need to retrain or fine-tune the model; they can make it understand encrypted harmful messages just by clever prompting. This creates a new way to trick popular AI models into giving unsafe responses without being detected.
Open → 2609.09553v1

HOPE improves graph node classification in networks with diverse connections

HOPE: Heterophily-Aware Open-Set Node Classification with Pseudo-Extrapolation

Abstract: Standard open-set node classification methods rely on the homophily assumption, where connected nodes share labels. However, real-world graphs are often heterophilic, exposing the limitations of current methods and posing new challenges to open-set node classification. On the one hand, cross-class connectivity causes representations from different known or unknown classes to become intertwined after aggregation, undermining their discriminative capacity. On the other hand, structural mixture invalidates threshold-based open-set methods and cross-class feature interpolation, leading to unreliable unknown-class rejection. To address these challenges, we propose HOPE, a Heterophily-aware Open-set node classification method with Pseudo-Extrapolation. To adapt open-set graph neural networks (GNNs) to heterophilic scenarios, HOPE uses a structure-augmented feature initialization layer to capture multi-hop structural patterns. Meanwhile, we design a trustworthy neighborhood aggregation mechanism for standard GNNs to dynamically filter noisy cross-class neighbors. To enhance unknown-class rejection, we introduce a heterophily-guided pseudo-extrapolation strategy. It dynamically maintains known-class centers and extrapolates along cross-class neighborhood displacement directions, synthesizing pseudo-unknown proxies near structurally ambiguous regions. Finally, we optimize the network with joint classification and logit margin regularization, routing synthetic proxies into a dedicated rejection slot without imposing geometric margin constraints in the representation space. Extensive experiments on multiple datasets show that HOPE consistently outperforms state-of-the-art models, validating its effectiveness, robustness, and efficiency.

Tue 8 SeptMachine Learning
The gist
Problems arise when trying to classify nodes in graphs where connected nodes do not share the same label, which is common in real-world networks. The authors propose a new method called HOPE that better handles these diverse connections by carefully filtering neighbors and creating synthetic examples to detect unknown classes. This approach improves the ability to identify nodes that belong to unknown categories and reduces confusion caused by mixed connections. Tests show HOPE performs better than existing methods on various datasets.
Open → 2609.08685v1

Graph topology generates strong node embeddings without training

Topology-induced Operators Reveal Complementary Graph Representations without Training

Abstract: Graph representation learning has largely focused on designing increasingly sophisticated models to transform graph topology into vector representations, or embeddings. However, the extent to which embedding quality depends on model learning, rather than on the underlying topological transformations, remains unclear. Here, we show that informative embeddings can be derived without complicated model design and gradient-based training. Propagating random features through implicit hierarchical structures induced by random walks and anonymous walks yields embeddings that capture node proximity and structural role, respectively. These two training-free embeddings preserve complementary aspects of graph organization and perform competitively with classic and recent methods across various node-, edge-, and graph-level tasks. They often require substantially less computation, resulting in a favorable quality-efficiency trade-off. Combining the two types of embeddings further improves inference quality of some tasks compared with using either embedding type alone. Our results suggest that informative graph embeddings can arise from carefully chosen topological transformations before any learning operation is applied.

Tue 8 SeptMachine LearningSocial and Information Networks
The gist
Graph learning usually uses complex models that learn how to turn networks into numbers you can analyze. This paper shows that you can get useful graph representations without doing any training, just by carefully using random paths in the network. The authors found two ways to create embeddings that capture different information about the graph structure. These simple, training-free methods work well on multiple tasks and often need less computing power. Combining these methods leads to even better results than using either alone.
Open → 2609.08152v1

Cybersecurity knowledge graph made easy with natural language queries

Construction and Natural Language Querying of a Cybersecurity Knowledge Graph

Abstract: Cybersecurity vulnerability information is distributed across numerous platforms and databases, making it difficult for researchers and practitioners to obtain a unified and structured understanding of existing threats. This is a critical issue in cybersecurity, where timely access to accurate vulnerability information directly impacts risk assessment and decision-making. While previous work has shown that knowledge graphs are effective for organizing vulnerability data, a major research gap remains in their accessibility, as querying such graphs typically requires expertise in graph query languages like Cypher. This paper aims to address this gap by proposing an approach that combines the construction of a cybersecurity knowledge graph with natural language-based interrogation. The proposed methodology relies on data collected from the National Vulnerability Database (NVD)(1) through its REST API and models vulnerabilities, products, vendors, severity metrics, weaknesses, and references using the Labeled Property Graph paradigm in Neo4j. The knowledge graph is deployed on Neo4j Aura Cloud and queried through an AI-assisted interface that translates natural language queries into Cypher language. The key contribution of this work is demonstrating that natural language querying significantly lowers the barrier to interacting with cybersecurity knowledge graphs, enabling more intuitive exploration and analysis of vulnerability data, and thereby enhancing their practical usefulness for a broader range of users in the cybersecurity field.

Mon 7 SeptCryptography and Security
The gist
Vulnerability information in cybersecurity is stored in many places, making it hard for people to get a clear picture of threats. The authors built a structured knowledge graph using data from the National Vulnerability Database to organize this information. They also created an AI-assisted tool that lets users ask questions in everyday language instead of learning complex query coding. This approach helps more people explore and understand cybersecurity risks without needing specialized skills.
Open → 2609.07614v1

Large language models struggle to assess cyber threat levels accurately

Benchmarking LLMs for Threat Level Determination

Abstract: The fast progress of large language models (LLMs) opens new opportunities in the management of cyber threat intelligence, but their reliability for operational tasks remains unclear. In this work, we benchmark LLMs on the task of threat level determination. First, we construct a curated dataset derived from publicly available MISP OSINT feeds. Next, we design a tailored prompt to systematically compare eight different LLMs under zero-shot conditions. Finally, we apply supervised fine-tuning on each model and perform a comparative analysis between baseline and fine-tuned versions. Our results show that zero-shot models achieve weak performance, with limited ability to correctly assign threat levels. Fine-tuned models, however, demonstrate substantial improvements, reaching F1 scores between 0.40 and 0.58 depending on the base architecture. Despite this progress, the performance is still low for practical deployment, highlighting the need for additional research on data quality, model adaptation, and domain-specific tuning.

Mon 7 SeptCryptography and Security
The gist
Cybersecurity teams need to know how serious cyber threats are to respond properly. The authors tested several large language models (LLMs) to see if they could automatically judge threat levels from open data. They found that without special training, these models perform poorly at this task. After tuning the models with some examples, performance improved but still wasn’t high enough for reliable use in real settings. This shows more work is needed before LLMs can help with threat level determination in cybersecurity.
Open → 2609.07582v1