Papers for

cultural heritage institutions

Papers whose findings have a practical use for this group, as judged from the abstract. Open a paper to read what it means in practice.

Virtual technologies enhance Italy museums and cultural heritage care

Augmenting Italian Cultural Heritage with Virtual and Digital Technologies: the final outcomes of Project CHANGES' Spoke 4

Abstract: CHANGES (Cultural Heritage Innovation for Next-Gen Sustainable Society) was a project coordinated by the CHANGES Foundation, bringing together complementary disciplines and expertise across the entire cultural heritage lifecycle. This article focuses on the project's research area dedicated to applying virtual technologies to museums and art collections. This research enabled us to experiment with different types of museums and art collections across Italy, designing case studies and best practices that institutions and similar contexts can adapt and reuse. The meta-analysis of the case studies showed that museum types play a decisive role in shaping not only technological choices but also organisational strategies, training models, and pathways to sustainability. This work also allowed us to identify technological and organisational gaps that go beyond single cases and reflect shared challenges across museum contexts. Finally, we documented the success of the engagement, exploitation, and dissemination strategy proposed in the project.

Wed 30 SeptDigital Libraries
The gist
Some museums in Italy explored ways to use digital tools like virtual reality to improve visitors’ experiences and museum management. The researchers found the type of museum influenced which technologies worked best and how museums organized their teams and training. They also spotted common challenges shared by many museums beyond individual examples. Their work helped create guidelines and proven practices that other museums can follow to use digital tools effectively.
Open → 2609.39316v1

Dancer pose improves tagging of Greek traditional music alongside audio

Pose-Aware Multimodal Automatic Tagging for Greek Traditional Music

Abstract: Automatic tagging is a core task in Music Information Retrieval (MIR), yet most tagging systems exploit only audio. Live music performance is inherently multimodal, as semantic labels such as instruments, regional styles, and dance forms are encoded simultaneously across acoustic, visual, and embodied performance cues. This is especially true of culturally specific repertoires such as Greek traditional music, which remain underrepresented in MIR benchmarks. In this paper, we investigate whether the use of dancer pose provides complementary information for automatic tagging in Greek traditional music beyond audio. Using the Lyra dataset, we extend prior audio-only work by extracting aligned video features and pose-derived skeleton streams, enabling an experimental setting for multimodal auto-tagging. We further introduce an automated pipeline for extracting primary-dancer skeleton sequences from in-the-wild dance footage, combining dance-scene detection, multi-person tracking, dancer selection, pose estimation, and quality filtering. We compare unimodal, all bimodal combinations, and trimodal systems using multiple fusion strategies. Audio remains the strongest single modality (AST: macro ROC-AUC 0.821), while skeletons, though weak in isolation, enhance performance through multimodal fusion. The best trimodal system improves macro ROC-AUC by about 4 percentage points over the strongest audio baseline.

Tue 22 SeptSoundComputer Vision and Pattern Recognition
The gist
Automatic tagging of music often uses just the sound, but in performances like Greek traditional music, dancing and visual cues also carry important information. The authors studied whether tracking dancers’ body poses from video can help computers tag music better. They created a method to extract dancers’ skeleton movements from live recordings and combined this with audio features. Even though audio alone is strong, adding pose data helped the system recognize music details more accurately.
Open → 2609.27094v1

TRACE system improves trustworthy retrieval in historical archives

TRACE: Accountable Agentic Retrieval for Source Discovery in Digital Archives

Abstract: Historical archives pose a difficult retrieval problem for retrievalaugmented generation systems: documents are OCR-degraded, heterogeneous across genres and sources, and require strong source traceability for scholarly and institutional use. We introduce TRACE, a training-free agentic retrieval framework designed for accountable source discovery over historical corpora. The system was developed in the context of DECIDON, an interdisciplinary project on the circulation of political discourse between parliamentary debates and the press during the French Third Republic, involving digitised historical collections and institutional use cases. The prototype is currently deployed internally within the project and accessible to 24 researchers across six partner institutions. We evaluate TRACE on HistoriQA-ThirdRepublic, a benchmark of 1,752 French historical questions over parliamentary debates and newspapers from 1887, with documents derived from Biblioth{è}que nationale de France digitised collections. TRACE achieves R@10 = 0.856 and MRR = 0.653, outperforming sparse, dense, graph-based, and agentic RAG baselines, with the largest gains on multi-hop and cross-corpus questions. At approximately $0.02 per question under the default hosted inference configuration, TRACE also remains economically feasible for heritage institutions, laboratories or companies that cannot rely on costly local GPU infrastructure. These results suggest that, for large digital libraries and archives, retrieval accountability and corpus-aware agent design can provide a practical alternative to heavier training-based or graph-construction approaches.

Thu 17 SeptArtificial Intelligence
The gist
Historical archives are hard to search because the texts are often damaged, come from many different sources, and it's important to know where information originally came from. The authors created TRACE, a tool that helps find and trace the exact sources of information in old documents without needing complex retraining. TRACE was tested on French historical records and worked better than other methods, especially when answers required combining facts from multiple sources. It is also affordable enough for libraries or organizations without expensive computer equipment.
Open → 2609.19897v1

Knowledge graphs capture complex contexts in cultural heritage data

Preserving contextual information in cultural heritage metadata through multidimensional knowledge graphs

Abstract: Using Knowledge Graphs (KGs) to describe Cultural Heritage Objects (CHOs) supports semantic richness and interoperability. However, standard KGs fail to capture the context-dependent validity of statements. This limitation is critical for cultural heritage metadata, which must often accommodate evolving or conflicting viewpoints, such as colonial versus post-colonial perspectives or shifting scientific consensus. While current knowledge representation methods address basic contextualization via provenance, qualifiers or reification, they lack a unified framework to simultaneously model and query data across multiple social, cultural, and political dimensions. To bridge this gap, we introduce the conceptual foundations of Multi-dimensional Knowledge Graphs (MKGs) and discuss how they preserve complex, multi-layered contexts in CHO metadata.

Mon 7 SeptDatabases
The gist
Information about cultural heritage objects often has many viewpoints and changes depending on social or political context. Traditional ways of storing this information don’t keep these changing contexts clear and easy to understand. The authors explain a new way called Multi-dimensional Knowledge Graphs that can store and connect different social, cultural, and political perspectives all at once. This helps preserve the full story behind cultural heritage objects in a more complete and organized way.
Open → 2609.07695v1