Papers for

cultural heritage organizations

Papers whose findings have a practical use for this group, as judged from the abstract. Open a paper to read what it means in practice.

ArchiveLens extracts detailed building data from historical urban maps

ArchiveLens: A Generative Spatial Knowledge Framework for Semantic Reconstruction of Historical Maps

Abstract: Historical maps contain dense morphological and semantic information about past urban environments, but many digitization workflows focus primarily on extracting geometry, and do not capture cartographic semantics such as building use and construction materials. This study introduces ArchiveLens, a generative spatial knowledge framework that operationalizes historical maps as entity-centric, machine-queryable geospatial databases. The pipeline decouples morphological and semantic reconstruction through three stages: tiled YOLOv11-seg instance segmentation for building footprint extraction; deterministic material classification via hue, saturation, and value (HSV)-based color thresholds; and localized attribute parsing using a quantized vision-language model constrained by domain-specific prompts. Extracted entities are integrated into a hybrid Spatial-Temporal Retrieval-Augmented Generation (ST-RAG) architecture that combines dense semantic retrieval with symbolic spatio-temporal filtering and mandatory provenance grounding. Applied to 445 georeferenced Sanborn map sheets of Chicago (1918-1950), the framework achieves high geometric and semantic accuracy. Beyond performance, ArchiveLens advances GIScience by formalizing historical cartography as structured spatial knowledge representation, allowing researchers to query building attributes and compare spatial patterns across map sheets and years.

Mon 26 OctArtificial IntelligenceComputers and SocietyMachine Learning
The gist
Historical maps show lots of details about old cities but often only their shapes get digitized. The authors created ArchiveLens, a computer system that not only finds building outlines but also reads their materials and uses by combining image analysis and language understanding. This system turns old maps into digital databases where you can search and compare building features over time. They tested it on 445 pages of Chicago maps from 1918 to 1950 and got accurate results. This helps people study how cities changed using detailed map information.
Open → 2610.35606v1

Vision language models struggle to identify philippine heritage sites accurately

Tanawpamana: Benchmarking Vision-Language Models on Philippine Cultural Heritage Sites

Abstract: Vision-language models are increasingly used to identify and describe places, yet their recognition and knowledge of specific cultures remain poorly understood, particularly in underrepresented regions such as the Philippines. This study introduces the Tanawpamana Dataset, a repository of Philippine heritage site images with metadata based on the Talapamana registry of the National Commission for Culture and the Arts of the Philippines. We also introduce the Tanawpamana Benchmark, comprising 4,046 tasks designed to evaluate models' recognition and knowledge of heritage sites. Evaluating seven vision-language models, we find that they struggle more with fine-grained visual discrimination among similar heritage sites than with coarse recognition, and that their geographic knowledge is weaker when inferred from image inputs than from text.

Tue 13 OctComputer Vision and Pattern RecognitionArtificial IntelligenceComputation and Language
The gist
Vision-language models are tools that can look at pictures and describe what they see using words. This study shows that these models have a hard time correctly identifying specific Philippine cultural heritage sites, especially when the sites look very similar. The authors created a special dataset and a set of tests, called Tanawpamana, to measure how well these models recognize these important places. They found that the models are better at recognizing general categories than telling apart closely related sites and that they understand location information better when given text rather than images.
Open → 2610.17596v1

Chinese historical document benchmark reveals model limits

LongHisDoc: A Comprehensive Benchmark for Chinese Long Historical Document Understanding

Abstract: Chinese historical documents are invaluable cultural treasures, but their complexity poses significant comprehension challenges for non-specialists. Despite the success of Large Language Models (LLMs) and Large Vision-Language Models (LVLMs) in modern document tasks, their capabilities in Long (full-book) Historical Document understanding remain largely unexplored. To bridge this gap, we introduce LongHisDoc, the first benchmark tailored for long historical document understanding. LongHisDoc comprises 1,012 expert-annotated QA pairs derived from 101 PDF documents, with an average of 85.1 pages and 42,776.4 tokens per document. It spans 10 categories and features four QA types: single-page, cross-page, multi-hop, and unanswerable. Answering these questions requires integrating multimodal evidence from text, layout, and visual elements. Our evaluation reveals that the top-performing LVLM and LLM achieve only 62.9% and 69.9% accuracy, respectively, highlighting a substantial performance gap. Furthermore, we assess various modal retrievers and the end-to-end RAG performance to provide references for Retrieval-Augmented Generation (RAG) systems. We believe that LongHisDoc serves as a comprehensive benchmark to catalyze future research in full-book historical document understanding. The benchmark and evaluation code are available at https://huggingface.co/datasets/qweq12433454/LongHisDoc and https://github.com/SCUT-DLVCLab/LongHisDoc.

Sat 10 OctComputation and Language
The gist
Chinese historical documents are long and complex, making them hard to understand, especially for non-experts. The paper presents LongHisDoc, a new test set with many questions about these documents to see how well AI models can understand them. The questions cover different ways of finding answers, including from pictures and text across many pages. The best AI models today still struggle, scoring below 70% accuracy. This benchmark helps guide future improvements in AI for reading long historical documents.
Open → 2610.14531v1

Machine translation enables cross-cultural analysis of folksong lyrics

Towards cross-cultural study of folksong lyrics with machine translation

Abstract: Music is universally present in human societies. Ethnomusicologists have long been documenting the diverse expressions of human musicality, and comparative musicology has recently brought several studies of folksong to a more global scale. Such cross-cultural research has not been conducted on lyrics: the language barrier has so far prevented work with multi-lingual data. However, Natural Language Processing (NLP) technologies have reached a stage where this language barrier may no longer be prohibitive. Combining folksong lyrics corpora across five languages, we machine-translate them to a pivot language with a pre-trained neural topic model, and we examine the relationship between content and social function within each language, and across languages for wedding songs. As expected, human evaluation of translation results shows that non-Indo-European languages suffer from overall worse translation quality. Experiments with topic models then indicate that the content of lyrics is at best partially related to the social function of folksongs across all languages. These experiments are just first steps into cross-cultural folk musics lyrics analysis; however, they do indicate that a previously unobserved web of cross-cultural relationships beyond ethnomusicological typologies may be uncovered through the study of what people sing across the world's diverse folk musics.

Sun 4 OctComputation and LanguageDigital Libraries
The gist
People sing songs in many languages, but studying the meaning of the words across cultures is hard because of language differences. The authors used advanced machine translation to convert folksong lyrics from five languages into one language, making it possible to compare themes in the songs. They found that translation works better for some languages than others and that the meaning of lyrics only partly relates to the social purpose of the songs. This study opens the door for new ways to understand cultural connections in folk music worldwide.
Open → 2610.05084v1

Linking german parliament speakers to wikidata reveals metadata gaps

Linking Speakers of the German Parliament to Wikidata: Scope and Coverage of Metadata

Abstract: This paper links all individuals who spoke in the German Bundestag between 1949 and 2021 to Wikidata, creating a longitudinal dataset that connects parliamentary speech transcripts with structured biographical metadata. We evaluate the coverage, composition, and potential biases of the retrieved properties and statements, with particular attention to gender, professional background, historical legacies, and transnational dimensions such as place of birth, languages, and foreign awards. The results demonstrate both the analytical potential of combining GermaParl with Wikidata and the importance of critically assessing uneven metadata coverage in open knowledge graphs.

Wed 16 SeptDatabasesSocial and Information Networks
The gist
This paper connects all people who spoke in the German parliament from 1949 to 2021 with detailed information on Wikidata, like their background and awards. The authors look at how complete and balanced this information is, focusing on areas like gender and birthplace. They show that combining these datasets can help analyze parliamentary history but also point out that some information is uneven or missing. This warns users to be careful when using open data for research or analysis.
Open → 2609.18289v1

Multimodal AI classifies Emirati homes architectural styles accurately

Multimodal Cultural Heritage Architectural Style Classification for Residential Buildings in the UAE Based on CLIP Embeddings and SVM

Abstract: The analysis and classification of cultural heritage architectural styles remain challenging due to the complexity of visual images of buildings, which are highly relied on in traditional CNN-based classification approaches in comparison to textual descriptions, and the relative lack of non-western region-specific datasets. This paper addresses this gap by proposing a multimodal machine learning framework to analyze and classify Emirati residential architecture using OpenAI's CLIP model. We integrate visual features from images and textual features from expert descriptions into a unified 512-dimensional embedding, followed by dimensionality reduction with UMAP for visualization and unsupervised clustering using K-Means. Cluster labels, which are derived from manual analysis of the K-Means clusters, are used to train an SVM classifier for automated architectural style classification. Our approach achieves a classification accuracy of 98% across eight identified style clusters, higher than every other study in the literature, demonstrating the effectiveness of combining visual and textual modalities. Overall, this paper highlights the potential of using multimodal AI to support architectural heritage analysis, offering scalable and interpretable tools for exploring regional architectural identities.

Tue 15 SeptComputer Vision and Pattern RecognitionArtificial Intelligence
The gist
Classifying architectural styles, especially for cultural heritage buildings, is hard because images alone can be confusing, and there is little data for non-western regions. The authors developed a computer method that looks at both photos of houses and expert-written descriptions together, turning them into a combined data format. They then grouped similar styles and trained a machine to recognize eight different Emirati residential architectural styles with 98% accuracy. This approach shows how combining pictures and text helps machines better understand complex visual categories.
Open → 2609.17181v1

Indonesian AI system expands and deepens cultural heritage records online

Artificial Intelligence-Assisted Digital Inventory of Cultural Heritage & Traditional Knowledge: Case for Indonesian Open Digital Library of Culture

Abstract: The Indonesian Digital Library of Culture (Perpustakaan Digital Budaya Indonesia, PDBI; budaya-indonesia.org) is a participatory platform that has collected tens of thousands of entries on Nusantara cultural heritage through public contribution since 2007. Manual contribution faces three structural barriers: coverage (knowledge is scattered across languages and sites), integrity (open sources mix authentic documentation with noise), and completeness (subjects are recorded but their data remain shallow). This paper presents a methodological framework for autonomous, AI-based harvesting of cultural knowledge from the open web, designed to expand corpus coverage while intensifying per-entry data depth. The methodology is organised as a five-stage economic funnel: focused crawling, multilingual extraction and canonicalisation, vector encoding with blocking, agentic decision-making, and idempotent publication, under the principle of deterministic orchestration, agentic decisions. Each stage is formalised: funnel economics and optimal filter ordering; crawl-frontier dynamics as a subcritical branching process that explains the necessity of recurrent re-seeding; fact-level novelty via a containment measure; Bayesian multi-source evidence fusion with elevated publication thresholds for sacred categories; exactly-once effects via idempotent upserts and the transactional outbox; sliding-window inference budgeting with a reservation protocol; statistical quality auditing; and seed selection as submodular coverage maximisation. The framework retains four high-value human roles: curator of direction, escalation approver, quality auditor, and guardian of meaning, while machine autonomy is raised in stages. Ethical, legal, and cultural-sensitivity implications are discussed, including the architectural guarantee that the machine never overwrites human contributions.

Tue 8 SeptArtificial IntelligenceDigital LibrariesHuman-Computer Interaction
The gist
Collecting and organizing cultural information from many scattered sources is hard, and people do it slowly by hand. The authors created a method using AI to automatically find, verify, and add cultural knowledge about Indonesia from the web, making entries both broader and more detailed. They keep humans involved to oversee sensitive content and ensure quality, while the AI handles most of the data gathering. This approach aims at preserving cultural heritage in a trustworthy and scalable digital library.
Open → 2609.08105v1