Papers for

digital archivists

Papers whose findings have a practical use for this group, as judged from the abstract. Open a paper to read what it means in practice.

Vision language models locate and trace cursive handwriting strokes

inkGround: Benchmarking Fine-grained Visual Grounding Capabilities of Vision-Language Models for Cursive Handwriting in the Wild

Abstract: Human handwriting is produced as an ordered sequence of pen movements, but an offline image keeps only the final ink. Handwriting trajectory recovery aims to restore the ordered stroke points and their pen-up/pen-down transitions. Existing image-trajectory pair datasets are recorded with digitizing tablets under controlled conditions, which limits writer coverage and stylistic diversity. Moreover, there is no benchmark that measures the visual grounding capabilities of general-purpose Vision-Language Models (VLMs) for the stroke trajectory recovery task. In this work, we introduce inkGround, a benchmark for stroke trajectory recovery from full-page, camera-captured handwriting. inkGround pairs 537 page images (~18.7k words, ~163k strokes) with reference trajectories produced by a pretrained offline-to-online model, filtered by OCR agreement, and verified by human raters. Because these references are pseudo-labels that represent one plausible pen trajectory, we also evaluate VLMs on the IAM-OnDB dataset, which provides recorded pen trajectories. We cast the task as text-conditioned point grounding: given a page image and a target word, the model must locate the word and output its ordered stroke points. Outputs are scored by trajectory fidelity (DTW, Chamfer distance), readability of the rendered strokes (Accurate Rate, Correct Rate), and style similarity. We benchmark four open-source and three frontier closed-source VLMs with a shared in-context prompt. Closed-source models, notably Gemini-3.1-Pro, produce legible trajectories close to the reference, and this ranking also holds on IAM-OnDB.

Wed 28 OctComputer Vision and Pattern RecognitionArtificial Intelligence
The gist
Handwriting is made by moving a pen in a particular order, but pictures only show the final ink marks. The paper introduces inkGround, a benchmark that tests if vision-language models (VLMs) can find specific words on photographed handwritten pages and trace the order of pen strokes that made the words. The authors created inkGround from real-world handwriting photos paired with predicted pen movement paths, checked by humans for accuracy. They tested several VLMs and found some, like Gemini-3.1-Pro, can closely match the correct stroke paths, helping machines better understand handwriting images.
Open → 2610.38720v1

Patterns in ink khipus are linked to size and cataloging factors

Structural Pattern Mining in Inka Khipus: A KFG Re-Analysis

Abstract: This paper reports a methodological pivot from the Open Khipu Repository to the Khipu Field Guide (KFG) database, prompted by stalled progress on the OKR, and a full re-analysis of the resulting 650-khipu sample. Three findings recur across every analysis attempted. First, khipu size confounds nearly every derived structural count, explaining 42-70% of its variance; all subsequent models control for it. Second, the two-letter name prefix (AS, UR, HP, QU, JC, MM, KH) identifies the original cataloger, not a site or period, which turns documentation completeness into a second confound that must be modeled explicitly. Controlling for both, khipus cataloged by Hugo Pereyra's Proyecto Quipu (HP) show significantly fewer Ascher sum-relation types than Gary Urton's (UR) khipus (p = 0.044), while the Ascher-cataloged (AS) khipus are too collinear with their own near-total lack of side/direction documentation to assess (VIF = 5.0). Third, generic structural clustering (UMAP+HDBSCAN) does not separate the pooled 650-khipu sample from two independent null models (permutation and Gaussian), corroborating an independent conclusion already reached by the KFG itself; the same test restricted to a single cataloger (UR) proved not reproducible across runtime environments and is reported here as a methodological caveat rather than evidence of structure. A targeted replication of the KFG's own S/Z-knot spatial-block heuristic for calendar/astronomical khipus recovers 8 of 10 published candidates and proposes 34 additional ones under the same criterion.

Wed 28 OctComputation and LanguageMachine Learning
The gist
The paper looks again at hundreds of Inka khipus, which are knotted strings used for record-keeping, by switching to a different database after running into problems with the first. The researchers found that the size of a khipu affects many measurements and must be taken into account. They also discovered that the naming codes on khipus relate to who cataloged them rather than when or where they come from, which influences data completeness. Lastly, they tried grouping khipus based on structure but found these patterns similar to random data, meaning strong structural groupings are hard to confirm.
Open → 2610.38580v1

Automatic tagging of medieval manuscript images using ai models

Automatic Iconographic Annotation of Medieval Illuminations: Comparing Generative Vision-Language Models and Supervised Discriminative Classifiers

Abstract: The large-scale digitisation of medieval manuscripts creates a growing need for automated iconographic indexing. We evaluate two complementary paradigms for this task on 9,735 full-folio images annotated with 2,333 TIMEL concepts: generative Vision-Language Models (VLM) and supervised discriminative classifiers (SDC). The VLM experiments evaluate fine-tuning, structured JSON decoding, taxonomybased candidates generation, and deterministic reranking. The discriminative experiments evaluate flat, hierarchy-aware, and patch-attention heads over a frozen DINOv3 encoder. Our results highlight key functional differences: ML-Decoder (SDC) achieves the strongest overall retrieval performance (precision@1 of 0.696, MRR of 0.806), with loss calibration (Asymmetric Loss) serving as the primary performance lever. While SDCs provide superior precision and reliability within a closed vocabulary, VLMs offer strong semantic generalization and broad taxonomic coverage, particularly through structured JSON targets and verify-calibrate reranking (hierarchical F1 of 0.559). Furthermore, model behavior strongly depends on concept abstraction: SDCs excel at perceptually grounded descriptive concepts, whereas VLMs provide useful hypotheses for complex interpretative scenes. Finally, we find that enforcing explicit hierarchy within model architectures limits coverage compared to spatial feature aggregation. Overall, rather than competing approaches, SDCs and VLMs emerge as complementary components for future hybrid indexing systems combining structured retrieval with exploratory annotation assistance. As a methodological contribution, we define the soft F1 metric to provide a taxonomy-aware evaluation that credits semantically close predictions based on lowest common ancestors.

Wed 28 OctComputer Vision and Pattern Recognition
The gist
Medieval manuscripts are being digitized in large numbers, creating a need to automatically label the images inside them with meaningful descriptions. The authors compare two types of AI models: one that generates labels from images and text together, and another that learns to recognize specific labels from examples. They find that the label-learning models are more precise for well-known concepts, while the generative models handle broader and more complex ideas better. Combining both types could improve future tools for exploring and organizing these ancient images.
Open → 2610.38462v1

Iktrace system finds indigenous knowledge in academic texts accurately

IKTRACE: A Natural Language Processing Framework for Identifying Indigenous Knowledge Representation in Academic Literature

Abstract: As artificial intelligence systems increasingly rely on vast textual data, respectful and accurate representation of Indigenous Knowledge has become critical. This paper introduces IKTRACE, a natural language processing framework for identifying, analyzing, and organizing Indigenous Knowledge representations in academic literature while adhering to Indigenous Data Sovereignty (IDsov) principles. We present a community-informed taxonomy co-developed with Inuit partners, comprising nine knowledge domains grounded in Indigenous Data Sovereignty principles. Building on this taxonomy, we implement a multi-method Knowledge identification pipeline using complementary natural language processing approaches. Outputs are integrated into a knowledge graph to support future expert and community validation. Applied to a corpus of Canadian Arctic research documents, IKTRACE demonstrated high accuracy and strong community relevance in expert validation. Our framework provides a scalable, ethically grounded foundation for Community-centered Knowledge validation and the development of Indigenous-informed AI systems.

Wed 28 OctComputers and Society
The gist
Indigenous Knowledge is often missed or misrepresented in large collections of academic articles, which can cause harm or misunderstanding. The authors created IKTRACE, a tool that uses language technology to spot and organize Indigenous Knowledge in writings while respecting Indigenous rights to control their information. They worked with Inuit partners to make a special guide for the tool, and it worked well on Canadian Arctic research papers. This system helps communities check and use their knowledge ethically in future AI projects.
Open → 2610.38186v1

Legacy nineteenth century editions improve medieval handwriting recognition accuracy

Mining the Nineteenth Century for the Thirteenth: Register-Scale Forced Alignment and HTR Bootstrapping via Legacy Regesta and Antiquarian Editions

Abstract: Handwritten text recognition (HTR) for the registers of Pope Honorius III depends on modern expert transcriptions, which exist only for regnal years 1-2 of Reg. Vat. 9. For the remaining registers, nineteenth-century scholarship offers Pressutti's regesta and partial editions. On fol. 1-203, where both layers exist, we measure what this legacy layer can contribute, on transcriptions that we first audit against it, and find a division of labor across three tiers. At the orthographic tier, raw editions are at best neutral for adapting a recognizer to the second regnal year and harmful without replay, whereas projection onto curial spelling with replay of modern source lines turns them into zero-label adaptation targets: pooled over all 134 year-2 sides, the WER falls by 1.50 points (95% CI -1.84 to -1.15), closing 33% of the gap to an oracle; the spelling changes at the year split, through the scribe or the transcriber, whereas the hand changes visibly only at fol. 191r. At the lexical tier, the corpus-wide legacy lexicon contains 82.2% of the out-of-vocabulary words of unedited entries and flags recognition errors with 66.7% precision, and labels from pre-trained medieval NER models, distilled into the recognizer's NER head, reach F1 82.1% on an expert validated benchmark, level with the best tagger applied after recognition. At the topological tier, Pressutti's regests, the closing datum clauses, and the regests' dates converted to the chancery's Roman form find 73.9% of entry starts in the recognized line stream, and edition agreement estimates a CER of 7.80% beyond fol. 203. Antiquarian scholarship thus cannot replace modern transcription, but it can steer, check, and segment HTR across the untranscribed registers.

Tue 27 OctComputer Vision and Pattern RecognitionComputation and Language
The gist
Recognizing handwriting from medieval documents is difficult because modern transcriptions exist for only a small part of the texts. The authors show how older nineteenth-century editions, though imperfect, can help improve computer reading of these manuscripts by providing spelling and structural clues. They combined modern expert data with this legacy material to reduce errors in recognizing the handwriting and better find where entries start in the text. While the old editions can’t replace new transcriptions, they serve as valuable guides to boost automatic recognition for untranscribed documents.
Open → 2610.36956v1

Handwritten text recognition halves errors on medieval latin manuscripts

Reading the Registers of Honorius III without Manual Line Transcription: Forced-Aligned HTR, End to End, Modular or Hybrid

Abstract: Unlocking medieval archives at scale is bottlenecked by the cost of line-level diplomatic transcriptions and manual abbreviation expansion. Focusing on the registers of Pope Honorius III (1216-1227) over 5,000 letters surviving in full only as manuscript images - we show that existing, line-break-free expert transcriptions (edition drafts) suffice to train end-to-end hand-written text recognition (HTR) that jointly transcribes and expands heavily abbreviated Latin. Using forced alignment on 860 unaligned edition entries across 394 pages of Reg. Vat. 9, we automatically bootstrap 13,122 training lines without manual alignment of segmented lines. While the generic CATMuS baseline struggles on this domain (18.9% CER) and a modular space-free HTR + word-segmentation pipeline (cf. Camps et al. 2021) plateaus at 15.6% WER, our from-scratch hybrid Conformer - combining CTC with bidirectional subword attention decoders, iterative self-realignment and n-best LM rescoring - achieves 4.7% CER and 8.7% WER (8.4% WER with ROVER system combination), nearly halving errors on clause-final words (22.7% to 12.2% WER). These figures are measured on the test lines that align with the transcription (86% of all test lines for the best hybrid). Furthermore, we address a tension between paleographic fidelity and editorial normalization: training on targets that preserve scribal name initials reduces the WER against the manuscript text on the 31 affected test lines from 13.3% to 9.2%, at a small cost against the expanded transcription (WER +0.3 points, CER +0.4). Finally, extensive ablations show that none of an auxiliary diplomatic CTC head, a copy mechanism, a permutation decoder or masked-image pretraining improves on direct end-to-end supervision, while strict padding-mask propagation and per-line beam termination make inference batch-invariant.

Mon 26 OctComputer Vision and Pattern RecognitionInformation Retrieval
The gist
Medieval archives contain important handwritten documents that are hard to read and transcribe because the text is old and often abbreviated. The authors worked on letters from Pope Honorius III and used a new computer method to read and expand these writings automatically without needing manual line-by-line transcription. Their hybrid system greatly reduces errors compared to older methods by combining different recognition techniques and clever alignment tricks. This approach helps unlock valuable historical documents more efficiently.
Open → 2610.35085v1

Learnable representations benchmarked for gigapixel image compression and scaling

GigaBench: Benchmarking Learnable Representations for Gigapixel Image Compression and Super-Resolution

Abstract: Learnable Representations (LRs) can fit parametric families of functions to diverse kinds of signals. These emergent neural-native data formats are gathering interest in the scientific community due to their compactness, resolution-agnosticism and amenability to direct neural processing. On the other hand, gigapixel images are becoming increasingly widespread across a variety of scientific, cultural, and industrial domains. In this paper, we present GigaBench, the first benchmark and experimental evaluation focused on deploying LRs with gigapixel imagery. GigaBench includes images collected, acquired, and synthetically rendered across diverse domains, and addresses image compression and super-resolution. We adapt a representative set of LRs, spanning Implicit, Hybrid, and Explicit methods, so as to operate reliably at the gigapixel scale on consumer hardware. Through systematic evaluation across reconstruction quality, model size, compression and inference times, we identify consistent trends across methods and suggest actionable guidance for future investigation.

Thu 22 OctComputer Vision and Pattern Recognition
The gist
High-resolution gigapixel images are very large and difficult to store or process efficiently. The authors created GigaBench, a benchmark that tests how well different neural network-based representations compress and improve these huge images. They compared several methods on various types of big images, measuring quality, speed, and storage size on regular consumer hardware. Their findings help identify which approaches work best for gigapixel images and offer guidance for future research and development.
Open → 2610.31644v1

Multispectral document binarization improved with adaptive feature fusion

Cross-Spectral Feature Fusion for Multispectral Document Binarization

Abstract: Historical document binarization remains challenging when faded ink, bleed-through, and background degradation exhibit wavelength-dependent behavior across visible and near-infrared observations. This study investigates whether adaptive cross-spectral feature fusion and targeted structural guidance can improve multispectral document binarization beyond fixed fusion and generic attention mechanisms. Four registered SMADI bands at 500, 600, 700, and 1000 nm are processed using a multi-branch conditional generative adversarial network (cGAN). Visible, NIR, and structural feature streams are fused at encoder depth L = 3 using spatial- and channel-wise softmax gating, while auxiliary edge maps derived from selected VIS-NIR band pairs provide targeted structural guidance. Nine controlled fusion and structural configurations are evaluated using five-fold document-level cross-validation, DIBCO-standard metrics, and Holm-corrected statistical testing. The F3 + NIR edge-guided configuration provides the strongest overall performance among the evaluated models, achieving mean F1 = 0.7916, p-FM = 0.8044, and IoU = 0.6654. Relative to the fixed Mid AVG baseline, it improves F1 by 0.0269, p-FM by 0.0360, and IoU by 0.0321, with all three gains remaining statistically significant after Holm correction. Mean NRM and DRD are also reduced, although these reductions are not statistically significant after correction. Targeted cross-spectral structural guidance provides an effective mechanism for regulating intermediate multispectral fusion, improving primary foreground-overlap performance while retaining the complete four-band observation.

Thu 22 OctComputer Vision and Pattern Recognition
The gist
Fading ink and damaged backgrounds make old documents hard to read, especially when seen in different types of light. The researchers found a better way to combine information from visible and near-infrared light to distinguish text from background in these documents. They used a special neural network that adapts how it mixes features from multiple light wavelengths and guided the process with edge information. Their method improved accuracy in identifying text compared to older fixed ways of combining these images.
Open → 2610.30863v1

Fine tuning vision language models improves low resource Lakota OCR accuracy

Design Considerations in Low-Resource Archival OCR: A Case Study in Lakota

Abstract: Building and expanding access to digital archives supports language reclamation and creates lasting resources for community revitalization. Designing effective tools to support these efforts requires taking into account the community-, language-, and document-specific context. We investigate how small ($\leq$3B) vision-language models (VLMs) can be adapted as optical character recognition (OCR) tools for Lakota, a North American Indigenous language. In addition to benchmarking modeling approaches, we inspect four practical facets of low-resource archival OCR that arise in previous work and conversations with community members: constrained training budgets, segmentation noise, scan degradation, and orthographic variance. We demonstrate that fine-tuning VLMs for OCR post-correction on 35 pages of transcribed data decreases character error rate (CER) from 17.1 to 3.9\% on a bilingual corpus, and find that training only with nine pages increases CER by only 1.1\% over this. However, evaluating under realistic automatic segmentation nearly doubles the CER of the best-performing models, stressing the importance of taking realistic use cases into account. We hope this work encourages future research on developing language technologies grounded in the workflows and constraints of ongoing revitalization efforts.

Sun 18 OctComputation and Language
The gist
Reading old scanned documents in rare languages can help communities keep their history alive. The authors looked at how small computer vision and language models can read Lakota documents, a language with limited digital resources. They found that training these models on just a small number of pages made them much better at understanding the text. But, when dealing with messy, automatically cut-up images, the error increased, showing that real-world challenges still exist. Their work helps guide future technology to support language preservation efforts.
Open → 2610.25440v1

Large language models struggle to reason with changing conflicting information

Where and Why Search-Augmented LLMs Fail When Reasoning over Rapidly Evolving Knowledge

Abstract: As the world changes, new information is published while older records remain online. This complicates reasoning for large language models (LLMs), which must retrieve evidence and resolve conflicts to determine which information remains valid. Existing evaluations treat information seeking as a black box, revealing little about where and why LLMs fail. To address this gap, we introduce TREK, a suite of three components: TREKTRACE is a plug-and-play framework that attributes failures to specific stages of retrieval and reasoning. We apply it to TREKBENCH-WILD, a meta-benchmark of real-world questions that require complex reasoning over rapidly evolving knowledge. Surprisingly, the main bottleneck is post-retrieval reasoning rather than retrieval: frontier models are often misled by conflicting evidence even after retrieving all the information needed to answer. To study this bottleneck, we build TREKBENCH-CTRL, a controlled benchmark with distractors spanning temporality, relevance, and trustworthiness, and show that benchmarks dominated by outdated distractors substantially underestimate task difficulty. Together, TREK provides a testbed for diagnosing and improving reasoning over rapidly evolving knowledge.

Sun 18 OctComputation and LanguageArtificial IntelligenceInformation Retrieval
The gist
As new information is published every day, it can be hard for AI models to figure out what is still true, especially when old and new facts conflict. The authors created a new set of tests and tools called TREK to understand where these AI models go wrong. They found that the biggest problem isn’t finding the right information, but that the AI often gets confused when reasoning about conflicting or outdated details after it gathers that information. Their work helps developers better diagnose and improve AI reasoning over fast-changing knowledge.
Open → 2610.25323v1

Optical recognition tool extracts notes from string quartet scores

An Optical Music Recognition Tool for String Quartets

Abstract: This paper presents an optical music recognition (OMR) system tailored for PDF scores of string quartet pieces. The approach begins with a SegNet-based segmentation model to localize musical regions, followed by convolutional neural networks and image processing techniques to classify and extract musical symbols. To improve rhythmic precision, dynamic programming methods enforce time signature constraints and explicitly handle tuplets. Evaluation using a longest common subsequence metric across multiple feature matrices demonstrates robust accuracy in recognizing pitch, onset, duration, and accidentals on a benchmark dataset. Code and data are available at https://github.com/lattellie/25-omr.

Sat 17 OctComputer Vision and Pattern Recognition
The gist
Reading music from printed sheets is tricky, especially for groups like string quartets whose music can be complex. The paper presents a computer system that looks at scanned or digital music sheets and identifies notes, rhythms, and other musical marks accurately. It uses special artificial intelligence methods to find and classify these musical symbols, then checks that rhythms make sense according to the time signature rules. The system was tested and shown to work well, and its code and data are publicly shared.
Open → 2610.24530v1

Artificial intelligence framework analyzes large comic book collections

Studying Comics at Scale with Artificial Intelligence: The PAGE Framework and Three Studies of American Comics and Japanese Manga

Abstract: Comics are one of the great visual records of the twentieth century: hundreds of thousands of pages in which a mass readership saw its leaders, its wars and its heroes. Most of this record has never been studied as a whole; comics scholarship proceeds one book at a time. We argue that artificial intelligence, including generative models, can change this to the benefit of the medium itself. We propose PAGE, a framework that makes artificial intelligence an instrument for comics research. It parses every scan into panels, text and a bibliographic record; annotates each page with a vision-language model that follows a written codebook, as a human coder would; grounds samples of these readings in human annotation; and explains change across an archive, with estimates controlled for publisher and genre. We demonstrate the framework on 3,929 American comic books (1938--1956) and 87 volumes of Japanese manga, in three studies, each resting on a different capability. The first pairs text search with visual reading to recover how a mass medium portrayed political power. The second measures the page's visual form across an industry and recovers the hand of individual artists. The third follows who speaks across two comics traditions, checked against human annotation. Beyond research, the same instruments can make archives searchable by what is drawn, open comics to blind and low-vision readers, and help preserve fragile collections and credit uncredited artists. We outline a research agenda in which artificial intelligence strengthens the study, preservation and reach of the medium.

Fri 9 OctArtificial IntelligenceComputation and LanguageComputers and Society
The gist
Most comics from the 20th century haven’t been studied all together because they’re so large and varied. The authors created PAGE, a system that uses artificial intelligence to break down scanned comic pages into parts like panels and text, then describes what’s shown using a model that reads like a human would. They used PAGE on thousands of American comics and Japanese manga to study topics like how political power was shown, artistic styles, and who speaks in the stories. This approach could help make comic archives easier to search, support readers with vision problems, and preserve old comics.
Open → 2610.13840v1

Automated detection and encoding of symbols in historical maps

Automated Detection and Encoding of Cartographic Signs in Historical Maps

Abstract: Symbols and icons in archival maps represent an expansive source of evidence for historical geography. In this paper, we present a two-stage framework for (1) detecting cartographic signs in historical maps and (2) generating interpretable sign embeddings that capture both semantics and stylistic variations. We also introduce CaSiDD, an open benchmark dataset spanning multiple sign categories and diverse cartographic styles, designed for generic sign detection. Using YOLOv10-X, we demonstrate the practicality of automated sign detection on historical maps. We then present strategies for creating contrasted, informative embeddings of cartographic signs. We approach embedding design systematically, maximizing expressiveness while suppressing digitization or background material confounders. Our final method, based on an adapted RADIOv4 backbone, effectively encodes both sign form and semantics, while producing interpretable representations. This work lays a foundation for scalable evidence extraction for the comparative study of map signs within cartographic culture and geohistorical research.

Fri 9 OctComputer Vision and Pattern Recognition
The gist
Historical maps have many symbols that show important information about places and geography from the past. The authors created a system that can find these symbols automatically in old maps and then turn each symbol into a kind of digital ‘fingerprint’ that captures what it means and how it looks. They made a new collection of map images with many symbols to test their system. This helps researchers study old maps more easily by comparing symbols and styles across different maps and times.
Open → 2610.13224v1

Deep learning models improve recognition of handwritten Bangla words

Open Vocabulary Word Recognition From Transcribed Bangla Texts

Abstract: An optical character recognition (OCR) can scan a paper and extract text using technology, making people's jobs easier. While various OCR systems are available in the software industry, finding a reliable equivalent solution for Bangla takes much work. When it comes to handwritten texts, the situation is much more unusual. Recognizing words from word images is the most critical stage in any OCR process. It is the second stage after segmenting words from text pictures. If this stage fails, the overall performance of the OCR will be poor, regardless of how well the other phases perform. This study aims to recognize words using deep learning in a handwritten Bangla word image. Three object detection models, SSD with MobileNetV2, Faster R-CNN with InceptionResNetV2, and an ensemble model of these two, have been used to train and test handwritten word images. A modified Non-Maximum Suppression has been introduced to enhance the effectiveness of the models' results. A customized dataset of 9841 handwritten Bangla word images has been compiled, featuring diverse handwriting styles from various individuals. All three models' performances have been checked against the test dataset, and the ensemble model has been the most impressive, with an F1-score of 92.61%. Also, at the word level, the ensemble model correctly recognizes 96.12% of the words to some extent. The system can be further improved by introducing a post-processing phase to correct errors generated by the system.

Thu 1 OctComputer Vision and Pattern RecognitionMachine Learning
The gist
Reading handwritten Bangla words is hard for computers, especially when handwriting styles vary. The authors trained and compared three deep learning models to recognize words from images of handwritten Bangla text. They combined two models into an ensemble that recognized words quite accurately, with over 92% F1-score and over 96% of words partially recognized. They also created a new dataset of nearly 10,000 handwritten Bangla word images to train these models. Their approach could be improved further by fixing errors after initial recognition.
Open → 2610.01134v1

Large language models struggle to fill narrative gaps reliably

Evaluating Whether LLMs Can Reliably Connect the DOTs?

Abstract: Access to real-world information is often noisy and fragmented. Constructing a coherent narrative from such fragments requires models to reconstruct missing spans within a broader storyline, commonly referred to as text infilling, while preserving consistency with both the local context and the global storyline. Despite using text infilling as a pre-training objective in many Large Language Models (LLMs), their actual performance on real-world narrative infilling remains underexplored. In this paper, we address this gap by introducing a multi-domain benchmark of ~9.2K instances for narrative infilling, constructed by masking one to three sentences across four narrative types: encyclopedic text, commonsense stories, news articles, and visual narratives. Using this benchmark, we evaluate 20 instruction-tuned open-source LLMs ranging from 1.5B to 70B parameters across varying levels of instruction specificity and reasoning guidance. Outputs are assessed using standard automatic metrics and a qualitative framework covering five narrative dimensions. Results show that model scale does not reliably predict infilling quality: Gemma-2-2B achieves the highest qualitative score (4.02/5), outperforming models over ten times larger, including DeepSeek-Qwen-32B (3.77/5, 6.6%) and LLaMA-3.3-70B (3.71/5, 8.3%). We further find that explicit reasoning offers limited benefits as chain-of-thought reasoning yields only a marginal improvement (+0.6%). Additionally, short narratives and domain characteristics emerge as stronger predictors of task difficulty than infill position alone for narrative infilling in current LLMs.

Tue 29 SeptComputation and Language
The gist
Putting together pieces of a story when parts are missing can be really tricky, especially if the information is jumbled or incomplete. The authors studied how well popular language AI models can fill in missing sentences in different types of stories. Surprisingly, they found that bigger models aren't always better, and some smaller models did the job more smoothly. They also discovered that making models explain their reasoning doesn’t help much, but the type and length of the story matters a lot for how well the models do.
Open → 2609.38406v1

Interactive system links entities and documents handling uncertainty

EntityWeaver: Visual Exploration and Curation of Named-Entity Relationships in Document Collections

Abstract: We present an interactive visualization system for exploring named entities and their relationships across document collections, with a strong focus on handling uncertainty and supporting both distant and close reading. The system is built around a graph that links documents, entity mentions, and entities. Uncertainty from mention-to-entity linking is included directly in this graph, so users can see where connections are strong, weak, or ambiguous. A transfer-function control, inspired by approaches in scientific visualization, allows users to adjust how this uncertainty is displayed, making it easy to tune the visualization for different datasets and research questions. The system also provides direct access to the full source texts in a coordinated view, enabling quick context checks, resolving ambiguous cases, and correcting digitization errors. Exploration is further supported through a multi-stage filter query builder, mini-map navigation for large graphs, and export options for downstream analysis. By combining uncertainty-aware graph visualization with direct interaction in the source texts, the system provides a unified workflow that supports both large-scale pattern discovery and curation of named-entity-based document collections. The design choices were supported by the domain experts, who were also involved in the initial system evaluation.

Tue 29 SeptHuman-Computer Interaction
The gist
Collections of documents often mention people, places, or things called named entities, but it's hard to track how these mentions relate to real-world entities due to uncertainties. The authors created a tool called EntityWeaver that visualizes these connections as a graph, showing how strong or uncertain each link is. Users can adjust how uncertainty appears, explore large collections efficiently, and jump directly into full text to verify or fix confusing parts. This helps uncover patterns in documents while letting people clean up and understand ambiguous or unclear links.
Open → 2609.37329v1

Manchu manuscript restoration improves by avoiding overcorrection

Think Before You Restore: Risk-Aware Manchu Manuscript Restoration with Stroke-Guided Attention

Abstract: Full-page blind restoration of historical Manchu manuscripts is challenging due to scarce annotations, unknown degradation regions, and fragile connected strokes. Generic restoration models may improve visual quality but often modify intact content, leading to over-restoration. We propose SAGE-Restore (Stroke-Aware Gated rEstoration), a selective restoration framework that first assesses where restoration is needed and then uses this assessment to guide restoration candidate generation and pixel-level selection. Its encoder predicts patch-level repair probabilities from complementary appearance and stroke-structural cues to condition restoration candidate generation, while the corresponding repair logits are refined into a pixel-level soft gate that selectively controls where the restoration candidate is applied. We further introduce a fidelity-aware evaluation protocol that jointly measures degraded-region recovery, intact-content preservation, and their balance. SAGE-Restore achieves the highest R-Recovery (0.463) and RFS (0.626), while maintaining high U-Fidelity (0.968), demonstrating an effective balance between restoration and content preservation.

Mon 28 SeptComputer Vision and Pattern RecognitionArtificial IntelligenceMachine Learning
The gist
Restoring old Manchu manuscripts is hard because parts are damaged while other parts are still intact and delicate. The authors created a method that first decides which areas actually need fixing and then carefully restores only those parts. This approach helps keep the original writing intact and prevents unnecessary changes. Their method showed better results in fixing damaged areas while preserving the rest of the manuscript.
Open → 2609.36243v1

Hierarchy helps recognize ancient shorthand symbols in manuscripts

Evaluating Hierarchy-Aware Deep Learning for the Recognition of Tironian Notes

Abstract: Tironian notes are generally regarded as the first Latin shorthand system and are notable for their large, fine-grained symbol inventory. Their high visual similarity and large class set make manual reading time-consuming, leaving manuscripts that contain Tironian notes inaccessible to many researchers. Automatic recognition is also challenging because models must distinguish subtle differences in stroke shape and sign structure while realistic training data remain scarce. However, standard flat classifiers do not explicitly use visual or structural relations between related signs. This paper investigates whether structural relationships between Tironian notes can support automatic recognition. We use the Supertextus Notarum Tironianarum (SNT) by Martin Hellmann, which provides idealized sign forms and a hierarchical organization of Tironian notes. We compare flat ResNet18, ConvNeXt, Shifted Window Transformer (Swin), and Vision Transformer (ViT) classifiers with Hierarchical Deep Convolutional Neural Network (HD-CNN)-style coarse-to-fine models and hierarchy-aware routing models based on visual class cleaning and similarity-based re-clustering. The models are evaluated on handwritten samples and manuscript-domain samples from Vergilius Turonensis, both with and without limited few-shot adaptation to the manuscript domain. The results show that the relative performance of flat and hierarchical models depends on adaptation. On Vergilius Turonensis, HD-CNN achieves the best non-adapted Top-1 result with 45.43%, while flat classification reaches the best Top-1 result after few-shot adaptation with 82.09%. Overall, the results indicate that hierarchical structure can support Tironian note recognition, especially under non-adapted conditions.

Mon 28 SeptComputer Vision and Pattern Recognition
The gist
Reading ancient shorthand symbols called Tironian notes is very hard because there are many similar-looking signs. The authors studied whether understanding the relationships between these signs can help computers recognize them better. They compared different deep learning models that either treat the signs as separate classes or use a hierarchy of sign groups. Their tests show that models using the hierarchy perform better when there's no extra tuning to a specific manuscript, while simpler models work better after some adaptation. This means that knowing how these shorthand signs relate can help machines read them, especially in challenging cases.
Open → 2609.35277v1

Historical manuscript illustrations classified with fine-tuned vision models

A Visual Classification Dataset and Model Evaluation for Historical Manuscript Illustrations

Abstract: Historical manuscript illustrations preserve rich visual evidence of past cultures. They depict people, animals, plants, diagrams, music notations, and decorative forms. Although large digitization projects have made many manuscripts available online, the material itself remains difficult to explore at scale. Extraction systems can find illustrations on manuscript pages, but without meaningful categories, large collections remain hard to search and explore. We address this gap by introducing a manually labeled dataset of 15,000 illustrations from manuscripts dating back hundreds of years across 22 categories, and evaluating modern vision models for image classification on this task. The problem is challenging due to stylistic diversity, degradation, and semantic ambiguity, with many images that fit more than one category. We compare fine-tuned CNN and Transformer-based classifiers, zero-shot CLIP, embedding-based classifiers, and direct vision-language models. Results show that fine-tuned image classifiers perform best overall, with ConvNeXt reaching 88.9% accuracy and 81.3% macro-F1. Using CLIP embeddings with XGBoost provides a strong alternative. In contrast, zero-shot CLIP and direct vision-language classification perform substantially worse, highlighting the limits of general-purpose models in this domain. Beyond overall performance, the analysis reveals which categories are visually separable and where errors reflect genuine semantic overlap, suggesting that some limitations arise from the taxonomy itself.

Sun 27 SeptComputer Vision and Pattern RecognitionMachine Learning
The gist
Old manuscripts contain many pictures showing people, animals, plants, and more, but it's hard to sort and search these images online. The authors created a new dataset with 15,000 labeled historical illustrations across 22 groups and tested different computer vision methods to automatically classify these images. They found that models specially trained on this task work much better than general-purpose ones. Their work also shows that some image categories are hard to separate because the pictures overlap in meaning.
Open → 2609.33449v1

Question answering tool cites scanned local history sources precisely

HistoRAG: A Citation-Grounded Question Answering Assistant for Teaching with Scanned Local History and Heritage Archives

Abstract: Teachers who prepare lessons on local history and cultural heritage work from material that is hard to use. The primary sources are scanned books without a text layer, and the supporting records are administrative catalogs released as spreadsheets. A general chatbot answers such questions fluently but without a verifiable source, which is the property a teacher needs most. This paper presents HistoRAG, a question answering assistant that answers from one regional collection and cites a volume and a page for every fact. HistoRAG transcribes each page with a vision language model and keeps a line level confidence from the token probabilities. It builds three stores from the same collection: a hybrid text index, a relational catalog database, and a knowledge graph extracted only from entity dense passages. A lightweight router sends each question to the stores it needs, so that counting questions reach the database and relational questions reach the graph. We build a benchmark of 516 questions over a collection of 36 scanned volumes and the heritage catalogs of the same region, covering statistical, factual, temporal, and multi-hop questions. HistoRAG answers more questions correctly than passage retrieval baselines and than a graph based retrieval system, at a far smaller cost per question. The assistant runs behind a chat interface, so a teacher can check any statement against the page it came from.

Thu 24 SeptSoftware Engineering
The gist
Teachers often struggle to use old scanned books and spreadsheet catalogs for lessons on local history, because these sources lack easy-to-search text and reliable citations. The authors created HistoRAG, a system that reads scanned pages using AI, extracts important facts, and answers teachers’ questions by pointing exactly to the book and page where a fact appears. This helps teachers trust the information and verify it easily. HistoRAG was tested on hundreds of questions and outperformed other search methods while working efficiently.
Open → 2609.29184v1

In-context learning improves Devanagari OCR correction with new retrieval method

Evaluating In-Context Learning and Retrieval Strategies for Devanagari Post-OCR Correction

Abstract: In-context learning using Large Language Models (LLMs) offers a compelling path to training-free post-OCR correction, yet its effectiveness for Devanagari script remains entirely unexplored. We present the first systematic evaluation of LLMs (3B-32B) for post-OCR correction in Hindi and Marathi, comparing three in-context example retrieval strategies: domain-random selection, dense semantic retrieval, and our proposed CharBM25, which retrieves examples by character n-gram BM25 similarity over OCR inputs to target shared error patterns with the test sentence. Across a 20,000-sentence benchmark spanning five news domains, retrieval strategy is the decisive factor in correction quality: CharBM25 outperforms domain-random selection by 2.8-4.0pp absolute WER on Hindi and 2.9-3.8pp on Marathi, using character trigrams, which consistently outperform bigrams and unigrams. Scale dominates performance: Gemma-3-27B achieves WER reductions of 55.0% for Hindi and 33.3% for Marathi under CharBM25-5. Few-shot gains are capacity-gated: models below 8B do not reliably improve over the OCR baseline, and on Marathi the smallest models (3B) degrade more sentences than they improve. Marathi is persistently harder to correct than Hindi across all scales, reflecting its greater morphological complexity. These findings establish CharBM25 as an effective, GPU-free retrieval strategy that matches or exceeds dense retrieval at negligible computational cost, and show that combining it with a general-purpose LLM of 12B+ parameters delivers reliable, training-free Devanagari post-OCR correction without task-specific fine-tuning. Dataset: https://huggingface.co/datasets/AbhishekBhandari/Devanagari-OCR-ICL-Benchmark

Fri 18 SeptComputation and LanguageComputer Vision and Pattern Recognition
The gist
OCR software often makes mistakes reading Hindi and Marathi text in Devanagari script because of complex characters. The authors tested how large language models can fix these mistakes without extra training by showing examples related to the errors. They found that choosing examples based on character patterns in the text works much better than random or semantic choices, especially with bigger models. Marathi text is harder to correct than Hindi due to its complex word forms. Their new method offers a simple way to improve accuracy on scanned documents without extra training.
Open → 2609.21595v1

SkillIR improves image restoration by evolving scene-aware skills

SkillIR: Evolving Scene-Aware Skills for Agentic Image Restoration

Abstract: This paper studies agentic image restoration, in which multimodal agents coordinate specialized restoration tools to recover images affected by complex degradations. Existing restoration agents often derive complete tool-use plans from the original degraded image or retrieve previously successful trajectories, providing limited support for adapting individual actions to evolving intermediate restoration states. We find that accepted tool executions can change the residual degradation state and, consequently, the applicability of subsequent tools. To address this issue, we propose SkillIR, a skill-guided framework that represents restoration experience as degradation-centered action evidence rather than complete tool-use trajectories. SkillIR consolidates context-dependent action outcomes into scene-aware restoration skills that characterize applicable conditions, expected effects, and attributable failure cases. Instead of prescribing a complete restoration plan, the retrieved skills guide one bounded action at a time within a verified residual-state loop: each tool output is treated as a candidate, committed only after transition verification, and followed by reassessment of the active residual degradations. After each rollout, the resulting evidence is used to create, refine, or patch dynamic skills, enabling accumulated restoration experience to improve decision-making for subsequent inputs. Experiments on synthetic and real-world multi-degradation datasets demonstrate that SkillIR improves restoration quality and enables more reliable and effective tool use.

Fri 18 SeptComputer Vision and Pattern Recognition
The gist
Fixing images damaged in complicated ways is tough because each repair step can change what needs to be fixed next. The authors developed SkillIR, which learns how each repair tool works in different situations and adjusts repairs one step at a time based on what happened before. This method helps pick better next steps by checking results before moving on, making image fixes more accurate. SkillIR also remembers what it learned to get better with practice over time.
Open → 2609.21468v1

Compact text recognizer improves historical text recognition with pretraining

A Free Lunch? Adapting PP-OCRv6 for Historical Text Recognition

Abstract: Despite impressive reported scores, large vision-language models have seen limited practical uptake in historical automatic text recognition because of their computational cost, dependence on large-scale pretraining, and hallucination. Historical ATR therefore continues to rely largely on compact CRNN line recognizers, which are visually grounded and trainable on modest data. Lightweight recurrence-free recognizers promise the accuracy of larger models with the practical advantages of CRNNs, yet have not been comprehensively evaluated on historical writing. We adapt PP-OCRv6, a recent compact text recognizer without strong language modeling, for historical line recognition and compare it with a conventional CRNN across generalized pretraining, domain-specific training, corpus-level fine-tuning, and manuscript-specific few-shot adaptation on multilingual Latin- and Arabic-script material. While PP-OCRv6 does not consistently outperform the baseline when trained from scratch, heterogeneous pretraining produces markedly better generalization. Comparisons with the Qwen3.5-based Medusa recognizer further show that fine-tuned PP-OCRv6 can outperform a large VLM tailored towards historical Latin-script HTR.

Thu 17 SeptComputer Vision and Pattern Recognition
The gist
Recognizing old handwritten texts is hard because big AI models are too costly and can make mistakes. The authors study a small, efficient text recognizer called PP-OCRv6 to see if it works well on historical writing. They find that while training from scratch isn’t always better, training the model on diverse data first helps it recognize old texts more accurately. This approach can even beat some large models designed for historical text recognition.
Open → 2609.20064v1

TRACE system improves trustworthy retrieval in historical archives

TRACE: Accountable Agentic Retrieval for Source Discovery in Digital Archives

Abstract: Historical archives pose a difficult retrieval problem for retrievalaugmented generation systems: documents are OCR-degraded, heterogeneous across genres and sources, and require strong source traceability for scholarly and institutional use. We introduce TRACE, a training-free agentic retrieval framework designed for accountable source discovery over historical corpora. The system was developed in the context of DECIDON, an interdisciplinary project on the circulation of political discourse between parliamentary debates and the press during the French Third Republic, involving digitised historical collections and institutional use cases. The prototype is currently deployed internally within the project and accessible to 24 researchers across six partner institutions. We evaluate TRACE on HistoriQA-ThirdRepublic, a benchmark of 1,752 French historical questions over parliamentary debates and newspapers from 1887, with documents derived from Biblioth{è}que nationale de France digitised collections. TRACE achieves R@10 = 0.856 and MRR = 0.653, outperforming sparse, dense, graph-based, and agentic RAG baselines, with the largest gains on multi-hop and cross-corpus questions. At approximately $0.02 per question under the default hosted inference configuration, TRACE also remains economically feasible for heritage institutions, laboratories or companies that cannot rely on costly local GPU infrastructure. These results suggest that, for large digital libraries and archives, retrieval accountability and corpus-aware agent design can provide a practical alternative to heavier training-based or graph-construction approaches.

Thu 17 SeptArtificial Intelligence
The gist
Historical archives are hard to search because the texts are often damaged, come from many different sources, and it's important to know where information originally came from. The authors created TRACE, a tool that helps find and trace the exact sources of information in old documents without needing complex retraining. TRACE was tested on French historical records and worked better than other methods, especially when answers required combining facts from multiple sources. It is also affordable enough for libraries or organizations without expensive computer equipment.
Open → 2609.19897v1

English to syria language translation system aids endangered language use

Machine Translation between English and Syriac (East Syriac Dialect) using Statistical Machine Learning

Abstract: UNESCO considers the Assyrian (Syriac) language an endangered language. Although Assyrians speak the language worldwide, the speaking population is uncertain (ranging from 500,000 to 1,500,000). Syriac is also one of the least studied languages in Natural Language Processing (NLP). Despite advances in Machine Translation (MT) over the past decade, the lack of publicly available corpora and the orthographic complexity of the Syriac script, specifically the Madnkhaya script, have left this language entirely ignored in the computational linguistics literature. This study develops the first phrase-based Statistical MT (SMT) model for English-to-Assyrian MT using the Moses framework. We created a dataset of 38,847 sentence pairs from the complete English and Syriac Bible, merging a pre-existing New Testament dataset with an Old Testament built from scratch through PDF extraction, using custom segmentation scripts and manual alignment review by three bilingual annotators. The Syriac side of the corpus undergoes diacritic removal and Byte-Pair Encoding tokenization to reduce orthographic sparsity before training. We trained and evaluated six models using different configurations and splitting-scheme ratios, language model order, distortion limits, and the inclusion of an Operation Sequence Model. The best-performing configuration achieves a word-level BLEU score of 23.54. Human evaluation by 11 native Assyrian speakers resulted in mean adequacy and fluency scores of 3.42 and 3.34 out of 5, respectively. These results are consistent with comparable low-resource SMT models trained on Biblical corpora for morphologically rich Semitic languages. The corpora, scripts, and trained model are publicly available, providing the research community with the first systematically curated English-Syriac dataset and a reproducible baseline for future MT and broader NLP work on this endangered language.

Wed 16 SeptComputation and Language
The gist
The Syriac language, spoken by Assyrians, is endangered and not well studied in language technology. The authors created a computer system that can translate between English and Syriac using a statistical machine learning method. They built a new dataset from Biblical texts, prepared it carefully, and trained models that produce reasonable translations as judged by native speakers. This work provides the first publicly available dataset and a baseline translation system for this language, making future improvements easier.
Open → 2609.18529v1

Feature matching improves oracle bone script character decoding accuracy

FROD: Feature Matching Residual Denoising Oracle Bone Decipher

Abstract: Oracle bone script (OBS), one of the earliest Chinese writing systems, plays an important role in the study of Chinese etymology. Traditional decipherment relies heavily on domain experts who analyze characters through semantic context and structural evolution. To assist this labor-intensive process, we formulate OBS decipherment assistance as a cross-era image translation task and propose FROD (Feature Matching Residual Denoising Oracle Bone Decipher). Although many OBS characters differ substantially from their modern counterparts, they often preserve local topological invariants at the radical level. During training, FROD leverages fast feature matching to provide gated segmentation supervision: paired samples with sufficient matches are processed patch-wise to align fine-grained radicals, whereas low-similarity pairs are trained holistically to avoid mismatched artifacts. In addition, a Residual Denoising Diffusion Model (RDDM) jointly estimates noise and residual signals, thereby reducing the positional drift and stroke disorder commonly observed in standard diffusion models. Finally, a multi-stage font stylization refinement network refines the generated images by eliminating edge noise and stabilizing stroke structures. On our augmented character-disjoint dataset, FROD achieves higher Top-1 recognition accuracy than the evaluated baselines, with a 3.8% absolute gain over OBSD.

Tue 15 SeptComputer Vision and Pattern RecognitionArtificial Intelligence
The gist
Deciphering ancient Chinese oracle bone script is tough because the characters look very different from modern ones. The authors created FROD, a new computer method that helps translate these old characters by matching small parts that stay similar over time, called radicals. Their approach reduces mistakes in character details and cleans up the final images. When tested, FROD recognized characters more accurately than other methods.
Open → 2609.17227v1

Modeling cultures as knowledge graphs to represent anthropology

Toward non-textual representation of social anthropology: Modeling cultures as knowledge graphs

Abstract: The study examines the emerging field of knowledge representation in the context of the semantic web and linked data, with a focus on knowledge produced within the social sciences - particularly in sociocultural anthropology. It starts from the premise that natural language, especially its textualized form, has long been the primary vehicle for producing and communicating anthropological research. Informed by theoretical approaches from information science, the study explores how computational methods may offer alternative modes of structuring and representing anthropological knowledge. It challenges the dominance of text as the sole representational medium and highlights the potential of semantic modeling to open new epistemological pathways. At the same time, it acknowledges the conceptual and methodological challenges involved in such a transition. This approach shifts emphasis away from metrics and programming, foregrounding processes of conceptualization, semantics, meaning, and reasoning as key to engaging with anthropological knowledge in digital environments.

Mon 14 SeptDigital Libraries
The gist
Anthropology studies cultures and social groups, often using text to share what they learn. This paper looks at how computers could use knowledge graphs—visual maps of ideas connected by meaning—to represent cultural knowledge instead of just text. The authors argue this could open new ways to understand and work with cultural information, though it also brings challenges. They focus on how thinking about meaning and concepts can guide better digital representations of anthropology.
Open → 2609.15214v1

Living Library turns digital archives into in-person conversational exhibits

The Living Library: Transforming Archival Collections into Conversational Knowledge Systems -- Lessons from the Theodore Roosevelt Presidential Library

Abstract: We present the Living Library, an end-to-end framework for transforming fragmented digital archives into governed, conversational, in-person exhibit experiences. Developed and deployed at the Theodore Roosevelt Presidential Library, the framework comprises four layers: digitization and corpus creation, AI-powered processing, retrieval and reasoning, and an optional embodied conversational interface. The first three layers aggregate a 300,000-record collection, apply OCR and structured metadata enrichment for expert curatorial review, and publish records to a hybrid dense/semantic index. Expert review is conducted through the Archivist App, a curator-facing interface that supports correction of AI-generated transcriptions and metadata. The governed corpus powers both a researcher-facing interface and Talk to TR, a continuously operating exhibit that embodies Theodore Roosevelt as a full-scale digital human within a museum environment. To support live, face-to-face interactions, Cross-Era Analogical Grounding reframes contemporary questions through documented historical parallels, allowing Roosevelt to address present-day topics without inventing facts. Dual-path retrieval and end-to-end streaming keep responses grounded and responsive. Layered watchdogs, visitor-session isolation, automated conversation management, and independently restartable services enable reliable unattended operation for hundreds of visitors. Avatar realism, spatial audio, lighting, staging, and conversational design are developed and evaluated as an integrated experience. Rather than report a controlled benchmark, we describe lessons from operating Talk to TR as a public exhibit and offer a transferable model for transforming archival collections into believable, in-person conversational experiences.

Tue 8 SeptComputer Vision and Pattern Recognition
The gist
Many digital archives are disorganized and hard to explore. The authors designed the Living Library system to fix this by turning archival records into interactive, face-to-face exhibits where visitors can talk with historical figures. Using the example of Theodore Roosevelt’s library, their system digitizes and organizes records, uses AI to understand and retrieve information, and powers a lifelike digital Roosevelt who answers questions based on historical facts. This approach helps visitors engage directly with history in a believable conversation without making things up.
Open → 2609.09368v1

Sinhalese word meanings change unevenly over centuries

Dynamics of meaning: Towards the Evaluation of Diachronic Semantic Change in Sinhala

Abstract: Tracking semantic change in low-resource languages across extensive historical timelines presents significant challenges due to data scarcity and the limitations of static embedding alignments. This study investigates the diachronic evolution of the Sinhala language from the 13th to the 20th century using a multi-stage computational framework. We first align century-specific Word2Vec and FastText embeddings using Similarity Matrix Based Alignment (SMA) and Orthogonal Procrustes (OP) techniques, finding that OP alignment provides more stable neighbourhood tracking for identifying temporal similarity dips. To move beyond aggregate measures, we introduce a Bidirectional Semantic Impact Pruning approach using contextualised embeddings from a fine-tuned Llama-3.1-8B. By applying Leave-One-Out (LOO) diagnostics, we attempt to isolate influential sentences to distinguish between systemic semantic shifts and transient polysemic expansion. Our results show that semantic drift in the fine-tuned Llama-3.1-8B is not evenly distributed across all usages. Instead, a significant part of the change is driven by a smaller set of high-impact contextual instances, rather than gradual and uniform change across all occurrences. This work provides a preliminary framework for diachronic analysis in low-resource contexts, highlighting the trade-offs between model sensitivity and data availability.

Tue 8 SeptComputation and Language
The gist
Tracking how word meanings change over a long time is hard, especially for languages with little data like Sinhala. The authors used computer techniques to study Sinhala from the 1200s to the 1900s. They found that word meaning changes often happen in specific important uses, rather than slowly and evenly everywhere. Their approach helps understand language change even when data is scarce.
Open → 2609.08609v1

New method finds cipher symbols in old handwritten documents

Unsupervised Domain Adaptation for Symbol Spotting in Historical Encrypted Manuscripts

Abstract: The decipherment of historical encrypted manuscripts poses a fundamental challenge in Digital Humanities: before any transcription can begin, the symbol inventory of the underlying cipher alphabet must first be identified and characterized. We address this challenge through symbol spotting: given a candidate alphabet specified as a set of rendered font glyphs, the task is to determine whether and where its characters appear in an unseen handwritten document, without any labeled examples from the target script. The main difficulty lies in the domain gap between clean, digitally rendered font queries and degraded handwritten manuscript symbols. We propose a three-stage pipeline that bridges this gap without manual annotation, combining a joint SimCLR+DANN encoder for domain-invariant glyph representations with an embedding-space style-adaptation mechanism applied at retrieval time, requiring no re-training. Experiments on fourteen pages from seven encrypted manuscript collections show that our method outperforms zero-shot foundation models, including CLIP and DINOv2, by a large margin ($+0.194$ P@1 over CLIP ViT-L/14), and surpasses task-specific trained baselines by $+0.138$ P@1. We further demonstrate that the Raw-Cover metric, computed in a fully unsupervised setting, provides a meaningful script-family fingerprint that identifies the underlying alphabet of an unknown document. This capability is of direct practical relevance to palaeographers, historians, and other researchers working with undeciphered manuscripts.

Mon 7 SeptComputer Vision and Pattern Recognition
The gist
It’s very hard to understand old encrypted writings because we first need to know what symbols they use. The researchers created a way to spot these symbols in scanned handwritten pages without needing any examples of the handwriting beforehand. They use a special technique to make their computer recognize symbols even if the handwriting is messy or different from the clean font pictures they start with. Their approach works better than popular existing models and can also help identify which alphabet a document belongs to. This can help historians and experts who study old secret manuscripts.
Open → 2609.07159v1