Papers for

legal software developers

Papers whose findings have a practical use for this group, as judged from the abstract. Open a paper to read what it means in practice.

Persian legal question answering improved with graph based retrieval

TUSI: A Citation-Grounded Graph-Based Benchmark

Abstract: Evaluating retrieval-augmented generation (RAG) systems in Persian law remains challenging because benchmarks lack realism, grounding, and coverage of legal reasoning. Existing resources are either synthetically generated from statutory texts, lacking natural information needs, or derived from informal legal question--answer sources without explicit linkage to authoritative legal documents, making them unsuitable for rigorous evaluation of grounded legal reasoning. To address this gap, we introduce TUSI-Bench, a structured Persian legal benchmark designed for the evaluation of RAG-based systems. TUSI-Bench is built upon a multi-layered legal knowledge framework containing 7,261 legal articles and integrating codified statutes, legal commentaries, doctrinal writings, and Supreme Court unification rulings. We also construct a legal knowledge graph linking articles and concepts for structure-aware retrieval. Based on this foundation, TUSI-Bench provides two complementary evaluation tasks: (i) TUSI-QA, an open-ended question answering benchmark containing 1,999 questions that requires grounded responses with explicit legal citations, and (ii) TUSI-Bar, a multiple-choice benchmark containing approximately 500 four-option questions derived from Iranian Bar examination questions. Furthermore, we propose a graph-based retrieval baseline that leverages relational structure within the legal knowledge graph. Experimental results demonstrate that incorporating graph-based relations improves retrieval recall by up to 8 percentage points compared to standard baselines, highlighting the importance of structured legal representations for RAG systems. The proposed benchmark provides a standardized resource for evaluating grounded legal reasoning in Persian and enables future research on structured legal intelligence.

Mon 16 NovComputation and LanguageArtificial Intelligence
The gist
It's hard to check how well AI tools answer legal questions in Persian because existing tests don't connect questions to real legal documents or cover detailed legal thinking. The authors created TUSI-Bench, a new benchmark based on an organized database of Persian laws and court rulings. This benchmark lets AI systems answer open legal questions with direct references to laws and also tackle multiple-choice questions from actual Iranian Bar exams. They also introduced a retrieval method that uses the relationships in the law data, making it easier to find correct information and improving accuracy by up to 8%.
Open → 2611.21823v1

Vietnam legal ontology links answers directly to law articles

Vietnamese Legal Ontology: Every legal answer, traced to the article that grounds it

Abstract: A legal answer is only as good as the article it rests on. Vietnam's largest open legal corpus pairs 109,543 published questions and answers with 573,851 legal documents, yet its citations are free text: "Khoan 3 Dieu 101 cua Bo luat nay" ("Clause 3, Article 101 of this Code") names neither the code nor its version. Following the five stages of NVIDIA Auto Ontology, Discover, Ground, Validate, Expose and Learn, we turn four open datasets into a knowledge graph of 11.5 M nodes and 16.0 M edges in which every node and edge carries its source record and method, with no duplicate keys, dangling edges or schema violations. Of 67,868 cited provisions, 61,487 resolve to a dated law version, 51,694 to a parsed article, clause or point, and 19,012 are confirmed word for word. The ontology then shows what flat records hide. 36% of the 78,361 answers whose citations resolve now cite a law that is no longer in force; 2,525 verified citations point to an article number that says something else in the current law; 2,520 citations were re-versioned because their words match a different version than their date suggests; and 5,575 document numbers are shared by several local authorities, one of them by 72. Every number in this paper is computed from the graph.

Sun 8 NovComputation and LanguageArtificial Intelligence
The gist
Legal answers are only trustworthy if they clearly reference the exact laws they rely on. The authors worked on Vietnam's large legal Q&A data to build a detailed knowledge graph connecting each answer to the exact legal article, clause, and version it cites. This graph shows many citations were outdated or ambiguous, revealing inconsistencies and helping clarify which laws really back each answer. Their work helps make Vietnamese legal information more precise and traceable.
Open → 2611.11426v1

Model theoretic formalization clarifies alkhwarizmi inheritance rules

A Model-Theoretic Formalization of AlKhwaremis ilm alfaraid

Abstract: This paper presents a model theoretic and computational formalization of AlKhwarizmis treatment of inheritance within the framework of Computational Fiqh. We first show that every inheritance configuration in a specified class is representable as a finite system of rational linear equalities and inequalities, and that such systems are decided exactly by Fourier Motzkin elimination over Q. We then define the fixed dimensional inheritance structure Vd with distinguished claimant coordinates, and prove that every admissible rational linear coordinate realization is isomorphic to Vd, this establishes the algebraic representation as canonical within that class. The complete first order theory Td of Vd is shown to be complete by construction and is explicitly distinguished from the decidability of the inheritance relevant fragment. The methodological principle is then related to a broader formalization of closed Fiqh domains via exhaustive case generation, Horn clause axiomatization, and terminating deduction, yielding domain relative computational completeness.

Sat 24 OctLogic in Computer ScienceComputation and Language
The gist
The paper translates ancient Islamic inheritance rules into precise mathematical language, showing that these rules can be represented and solved using known mathematical techniques. The authors prove that all valid inheritance divisions in their framework fit a standard structure, making the representation unique and consistent. They also connect this approach to broader methods for automating legal reasoning in Islamic law. This work helps computers understand and apply historic inheritance rules exactly.
Open → 2610.33629v1

Language models struggle to update numeric data in Norwegian laws over time

norregel: a preregistered benchmark of dated numeric values in Norwegian law

Abstract: norregel asks language models for numeric values in Norwegian statutes, regulations and parliamentary decisions (NOK amounts, percentages, multiples of the National Insurance basic amount (G) and age limits), each at a stated date. The 916 items were extracted mechanically from Lovdata's open data, and each carries the dated history of its provision, so an answer can be classed as correct, outdated, wrong or uninterpretable. We report a first and a second preregistered run on the same items. In the first run (five models, listed publicly only after local analysis), H1, that outdated answers are more frequent for values that took effect after a model's cutoff, could not be tested in substance, and H2 and H3 were inconclusive; Opus 5.5 and Sonnet 4.6 answered 46.7% and 40.2% of the 880 primary items correctly. The second run was preregistered and published before any of its calls, and eight models were analysed. Its pooled primary test supported H1 under the preregistered decision rule (d = 17.8 percentage points, 95% interval [7.7, 28.9], p = 0.0001). In the preregistered sensitivity analysis S8, which counts as outdated only the most recent value that differs from the key, d was 3.9 [-3.6, 12.7] (p = 0.1754), an interval that contains 0. H1 was supported in every other preregistered sensitivity analysis, but S8 is the only one that gives both groups one target value, so we do not regard the support for H1 as robust. The share of outdated answers equal to that most recent value (H2) was 56.1% [46.6, 65.0], an interval that contains 0.5, and the pooled test of a lower share correct in Nynorsk than in Bokmål (H3) was inconclusive. Several models, among them Haiku 4.5, gave mostly uninterpretable answers. Items and keys are withheld; item IDs, per-answer classes, code and results are on Zenodo.

Wed 21 OctComputation and Language
The gist
Many legal rules change their numbers, like age limits or payments, over time, but language AI models often give outdated answers if they learned old data. The authors collected 916 numeric points from Norwegian laws with dates showing when they changed, so they could check if model answers were correct or outdated. They found that models tend to copy old numbers more often when the numbers changed after the AI’s last training date, but this tendency depends on how you count outdated answers. Some models also often gave uninterpretable replies. This benchmark helps test how well language models know current legal numbers.
Open → 2610.29207v1

Document automation improved by mixing classic rules with AI tools

In With the Old: Enhancing 'Classical' Document Automation with Generative AI

Abstract: Software-based legal assistance systems have leveraged many different forms of knowledge representation and reasoning. This article explores how document automation services rooted in expert system style and other symbolic approaches can usefully enhance and be enhanced by current generative AI approaches. We discuss the possible benefits and challenges, and report on preliminary experiments in using large language models to identify and fix issues in texts written by laypeople.

Mon 5 OctArtificial IntelligenceComputation and Language
The gist
It can be hard to automate creating legal documents using only traditional software because people’s writing is often unclear or incorrect. The authors show how combining older rule-based systems with newer AI that can understand and fix text problems helps make better legal document automation tools. Their early experiments involved using large language models to spot and correct issues in texts written by everyday users. This approach may make legal assistance software more effective and easier to use.
Open → 2610.07480v1