Papers for
museum exhibit designers
Papers whose findings have a practical use for this group, as judged from the abstract. Open a paper to read what it means in practice.
Eye-tracking dataset reveals how people look at paintings
AVAtt: A Free-Viewing Eye-Tracking Dataset and Benchmark for Visual Attention on Paintings
Abstract: Saliency and scanpath models are developed almost exclusively on natural photographs, yet paintings are composed by artists to guide the viewer's eye and differ from photographs in texture, colour and abstraction. We introduce \avatt, a free-viewing eye-tracking dataset on \nImages{} paintings spanning sixteen art movements and five centuries, with \nScanpaths{} scanpaths and \nFixations{} fixations from \nParticipants{} participants (\spPerImageMin--\spPerImageMax{} observers per painting). For every painting we release individual scanpaths with fixation timing and eye--screen distance, fixation maps, saliency maps smoothed at one degree of visual angle, temporal saliency videos and rich art metadata. We benchmark classic and deep saliency models against human agreement, revealing substantial headroom for art-aware models, and rank 44 scanpath-similarity measures, including a new language-free family of image-encoder metrics built on ten CNN, ViT and self-supervised encoders. With controls that remove viewing biases, we show that faces are fixated \faceEnrich$\times$ more than expected and within half a second, that local structure draws the eye, that composition rules fitted from image content predict where people look, and that art style shapes how much viewers agree. Dataset, code and a Python package are available at: https://huggingface.co/datasets/Amine-CV/AVAtt.
Generative AI reshapes museum displays and visitor interaction
From Prefabricated Content to Situated Generation: A Four-Wave Longitudinal Study of AI-Mediated Museum Surfaces and Spaces
Abstract: Generative AI changes a basic condition of interactive surfaces and spaces (ISS): visitor-facing content can be produced during interaction rather than fully authored before it. We report a longitudinal qualitative study with 23 Chinese science museum practitioners, interviewed annually from 2023 to 2026 (retention 23 to 19) and analyzed using reflexive thematic analysis. Participants' accounts moved from anticipated epistemic and operational risks, through backstage experimentation and visitor-facing trials, toward situated governance and renewed questions about the purpose of museum interaction. Following these changes over time shows how generative AI reconfigured the design problems of museum ISS: generated content appeared under institutional authority; inference delay became publicly and bodily experienced; concurrent touch, gesture, and speech created ambiguous multi-user intent; and post-generation editing could leave curators selecting within an AI-defined possibility space. We conceptualize the resulting shift as a movement from prefabricated display to situated generation and formulate four design propositions concerning provenance at the point of display, spatially appropriate fallback, multi-intent negotiation, and curatorial control before generation. These propositions are grounded in practitioner accounts rather than evaluations of implemented solutions.
Physical 3D model shows climate effects for urban heat education
Climate Physicalization: Bridging Tangible Interaction and Data Visualization for Environmental Communication
Abstract: Raising awareness of climate topics, such as urban heat mitigation, requires communicating complex data to a broad audience. Data physicalization has emerged as a novel method to connect audiences to such complex topics through tangible forms while also leveraging interactivity to foster deeper engagement. This paper introduces an situated geospatial thermal physicalization prototype, designed to enhance communication and education of environmental information through hands-on engagement. The physical model depicts a 3D model of an urban neighborhood, with radiation data represented as a layered contour structure. The model incorporates three interchangeable climate adaptation scenarios, alongside an externally mounted, electronically driven solar path representation featuring multiple discrete LEDs that can be switched on and off at will. To investigate how people engage with the model, we conducted a hands-on qualitative lab study with 16 participants, using think-aloud, observational, and questionnaire protocols. Overall, participants responded very favorably to the model, highlighting the novelty of the visualization approach and its capacity to improve the interpretability of the presented information.
Simulation reveals social movement patterns in ancient pompeian household
IMPACT: Modeling Socially Interdependent Movement in a Generative Multi-Agent Simulation of a Pompeian Household
Abstract: Simulations of archaeological sites can make interpretations of past cultural practices observable and examinable. Generative multi-agent simulations offer a bottom-up approach to modeling how people collectively moved through and used historical spaces. However, current agents designed to simulate everyday life often plan and act independently, limiting their ability to capture how movement depends on others' actions. We introduce IMPACT (Interdependent Movement Planning through Inter-Agent Constraints and Triggers), an architecture that uses culturally specific roles and obligations to define dependencies among agents' activities and guide coordination. IMPACT connects socially gated milestone planning, wait-or-prompt resolution, structured directive issuance, and directive integration. These mechanisms determine whether and when activities can begin or change as social conditions evolve, producing socially constrained and prompted movement as their primary observable outcome. We instantiate IMPACT in a five-hour simulation of a Pompeian dinner involving ten agents across interdependent roles. Analysis of five simulation runs shows how social roles, responsibilities, and status relations shape household activities and spatial practices, as reflected in patterns of co-location, asymmetric waiting, co-movement, and social directives. In a controlled ablation evaluation, thirty-seven participants rated the complete architecture's behavior as more socially coherent and believable than that of two reduced architectures. Interviews with six archaeology experts highlighted historically plausible movement patterns and the simulation's potential to support archaeological interpretation, while identifying areas requiring stronger historical grounding for future work.
Visual motion on screens changes pedestrian walking paths in public
Visual-Motion-Induced Modulation of Pedestrian Trajectories Using Spatially Distributed Multi-Display Signage in Public Spaces
Abstract: Multi-display signage (MDS), now ubiquitous in urban environments, has the potential to influence human behavior and experience in public spaces. However, despite its unique capability to present spatially distributed dynamic visual stimuli, its current use is mainly limited to advertising. In this study, we propose a perception-based approach for laterally modulating pedestrian trajectories as a nonverbal means of guiding pedestrians in public spaces. The approach is motivated by vection, the illusion of self-motion, and uses laterally moving monochrome stripes, a standard stimulus in vection research, presented across spatially distributed displays to elicit postural responses that may bias pedestrian trajectories. We evaluated the approach through a controlled laboratory experiment and a real-world field deployment involving actual pedestrian flows in a national museum. The laboratory experiment examined whether the MDS setup induced trajectory shifts in the direction predicted by prior research on the behavioral effects of vection. The field deployment investigated whether comparable effects would emerge in aggregate pedestrian behavior during unconstrained movement under conditions closer to those of urban public spaces. In the laboratory, full-screen motion significantly biased walking trajectories in the direction of visual motion, whereas partial-stripe motion produced no significant directional effect. In the field deployment, opposing full-screen motion conditions produced direction-consistent differences in aggregate pedestrian positions. The field results, observed despite the substantial variability in real-world pedestrian flows, extend the controlled laboratory findings and provide ecologically valid evidence supporting practical MDS-based pedestrian modulation in public settings. The results further suggest that sufficient visual-motion coverage may be important.
Toolkit uses 3D shapes to show London river health data
Exploring 3D Glyph Physicalizations for Public Engagement through River Health
Abstract: Introduction: In this paper, we present the preliminary design of a toolkit for making glyph-based physicalizations for public engagement. We use London river health data as a case study: a data set of significance to urban issues related to climate change and of interest to draw public attention, as part of the Greater London Authority's strategies. Design: We present the components of a 3D glyph-making toolkit, its encodings, and a step-by-step process for crafting a physicalization of a river's water quality using recycled materials. We reason about how users can use the template to learn about a data set while reflecting on the data's significance to their personal experience and self-mapping onto the physicalization. Reflection: We reflect on the opportunities that extending the design space of glyphs to 3D physicalization offers for supporting public engagement with complex, multi-dimensional data sets, scaffolding cognitive processes, and self-reflection, thereby bringing crucial environmental data to life. Conclusion: Future implementation of the 3D glyph template will enable the public of all abilities to explore river health data, physicalize complexity, and realize its relevance. We hope that its use in public engagement workshops will help raise awareness, invite care, and foster a sense of belonging.
Living Library turns digital archives into in-person conversational exhibits
The Living Library: Transforming Archival Collections into Conversational Knowledge Systems -- Lessons from the Theodore Roosevelt Presidential Library
Abstract: We present the Living Library, an end-to-end framework for transforming fragmented digital archives into governed, conversational, in-person exhibit experiences. Developed and deployed at the Theodore Roosevelt Presidential Library, the framework comprises four layers: digitization and corpus creation, AI-powered processing, retrieval and reasoning, and an optional embodied conversational interface. The first three layers aggregate a 300,000-record collection, apply OCR and structured metadata enrichment for expert curatorial review, and publish records to a hybrid dense/semantic index. Expert review is conducted through the Archivist App, a curator-facing interface that supports correction of AI-generated transcriptions and metadata. The governed corpus powers both a researcher-facing interface and Talk to TR, a continuously operating exhibit that embodies Theodore Roosevelt as a full-scale digital human within a museum environment. To support live, face-to-face interactions, Cross-Era Analogical Grounding reframes contemporary questions through documented historical parallels, allowing Roosevelt to address present-day topics without inventing facts. Dual-path retrieval and end-to-end streaming keep responses grounded and responsive. Layered watchdogs, visitor-session isolation, automated conversation management, and independently restartable services enable reliable unattended operation for hundreds of visitors. Avatar realism, spatial audio, lighting, staging, and conversational design are developed and evaluated as an integrated experience. Rather than report a controlled benchmark, we describe lessons from operating Talk to TR as a public exhibit and offer a transferable model for transforming archival collections into believable, in-person conversational experiences.
Visualizing colonial rule through time and geography to reveal power structures
Visualizing Colonial Regimes: A Multi-View Approach to (Historical) Political Transformation
Abstract: This paper takes a critical approach to visualization of colonial regimes. Drawing on critical hermeneutics and postcolonial theory, we created interactive visu- alizations revealing the constructed nature of colonial categories and exposing the hierarchies between empires and territories. Using the Varieties of Political Regimes dataset, our approach combines temporal flow visualization and geo- graphic distribution mapping. This allows us to contextualize colonial rule within broader patterns of political change. Our visualization challenges conventional, static, and isolated representations of colonial data by making the interpre- tive frameworks underlying colonial categorization visible through coordinated temporal, spatial, and relational views.