ProvCards enable portable provenance tracking across diverse scientific workflows

ProvCards: Artifact-Oriented Provenance for Heterogeneous Scientific Workflows

Databases

Summary

Keeping track of how scientific results are made is hard because many different programs and systems are used together. The authors present ProvCards, which treat this tracking info as stand-alone digital cards that can be shared and combined independently of the systems that made them. These cards can be grouped and visualized to understand the full history of data across different tools. This helps scientists better trace, reuse, and repeat experiments even when using many varied software components.

What this means in practice

  • For scientific software developers: Capture and share detailed workflow provenance independently from specific execution systems, enabling better workflow interoperability and reproducibility.
  • For data engineering teams: Assemble provenance information from diverse data pipelines to improve data traceability and facilitate troubleshooting across heterogeneous toolchains.

Authors

Tanja Auge, Marinus Holitschke, Meike Klettke

Abstract

Reproducibility in scientific workflows is hindered by heterogeneous components and execution environments, as well as fragmented provenance capture. Although existing approaches offer established semantics and workflow-specific solutions, provenance remains difficult to capture, exchange, and compose across workflow boundaries. We present ProvCards, an artifact-oriented approach that treats provenance as a first-class artifact grounded in the W3C PROV Data Model. Individual workflow components can generate cards that are stored, exchanged, reused, and composed independently of any workflow system or centralized execution context. ProvDecks group related cards into portable scopes while preserving their identities. ProvGraphs provide derived views for provenance reconstruction, querying, visualization, and analysis. Together, these representations support coherent, task-specific provenance views across heterogeneous components, facilitating traceability, reuse, and reproducibility. We implement ProvCards using a graph-based infrastructure and evaluate them in a scientific data-processing workflow. The results demonstrate independent provenance capture at the component level, composition across component boundaries, and reconstruction for querying and analysis. ProvCards provide a portable, composable, and incrementally extensible foundation for provenance management in heterogeneous scientific workflows.