Systems capture web browsing with privacy safeguards for research

GESIS Surf: An Open-Source Infrastructure for Privacy-Preserving Longitudinal Web Browsing Data Collection

Cryptography and SecurityComputers and Society

Summary

Collecting accurate data about how people browse the web is important for understanding their behavior but is usually difficult due to privacy concerns and limited tools. The authors created GESIS Surf, a system that records web browsing details in a way that respects user privacy by letting people opt in and minimizing personal data collected. It works through a browser extension and stores structured browsing sessions, allowing detailed studies over long periods. This setup has been used with over 1,000 participants and supports research that can be repeated and verified.

What this means in practice

  • For social science research teams: Collect detailed, privacy-respecting longitudinal web browsing data from participants for behavioral studies in natural environments.
  • For digital marketing analysts: Use structured and privacy-aware browsing data to analyze user navigation patterns over time for content strategy development.

Authors

Mario Alberto Ramirez, Frank Mangold, Sebastian Stier

Abstract

Understanding how people navigate digital media environments requires behavioral data beyond survey self-reports. However, existing infrastructures for collecting such data reproducibly, sustainably, and with strong privacy guarantees remain limited: commercial solutions lack transparency and data governance, while academic tools are typically designed for narrow, short-term use cases and do not support general-purpose academic panel data collections. We address this gap with GESIS Surf, a research infrastructure for large-scale longitudinal collection of web behavioral data in naturalistic environments. The system consists of a browser extension (Chrome and Firefox), a backend with a REST application programming interface (API), and a relational database. It passively captures user interactions, page metadata, and full HTML snapshots of each rendered page, embedding each observation within a hierarchical session model that preserves the structure of browsing behavior. GESIS Surf implements privacy-by-design through strict opt-in participation, per-domain collection rules, and client-side data minimization, ensuring that sensitive data are controlled at the point of collection. The system has been deployed with more than 1,000 participants in a large-scale academic panel infrastructure that includes surveys of participants, and supports reproducible, content-level, and structurally rich analysis of digital behavior. By combining hierarchical session modeling, content-level capture, and integrated privacy enforcement within a unified system, GESIS Surf provides a general-purpose infrastructure for studying digital behavior in a reproducible manner over time.