Papers for
media asset managers
Papers whose findings have a practical use for this group, as judged from the abstract. Open a paper to read what it means in practice.
Trustworthy media needs flexible evidence throughout its lifecycle
Trustworthy synthetic visual media: Evidence across the media lifecycle
Abstract: Images and videos have long helped people understand what happened and how a work came into being. Generative systems complicate that role. Realistic media can now be produced and revised without leaving a stable history, so appearance no longer reveals whether a scene was captured, synthesized, or altered along the way. Trust must instead come from evidence that explains the path an asset has taken and the circumstances in which it was used. Some of this evidence can be recovered from the media, while some must be recorded during production and preserved as the asset circulates. This review brings those approaches together and asks when their claims remain meaningful after ordinary processing or deliberate manipulation. We argue that trustworthy media do not depend on one universal marker of authenticity. The evidence must suit the question at hand, reach the person making the judgment, and remain open to correction when better information emerges. The larger goal is to keep the history of media intelligible even as the media itself continues to change.
ProbeScout improves image searches with attribute guided ranking
ProbeScout: Visual Analytics for Attribute-Guided Image Search
Abstract: Analysts often need to identify images that jointly satisfy multiple visual conditions, such as a crossroads with traffic lights at dusk, for model diagnosis, dataset curation, and targeted training. Embedding-based retrieval can rank the large gallery efficiently, but a visually dominant condition can obscure weaker conditions, and a single similarity score does not enforce the required conjunction. Visual question answering (VQA) can explicitly verify conditions, yet exhaustively applying it to the full gallery is costly, especially when analysts refine their query. These limitations motivate keeping humans in the loop at the attribute level, where analysts can quickly build evidence for each condition and reuse it when the request changes. We therefore present ProbeScout, a visual analytics system that supports this loop. It first builds composable attribute probes from sparse VQA labels and fuses them into a conjunction-aware initial ranking. Coordinated views support rapid screening, near-miss diagnosis, and on-the-fly subset construction by filtering and combining these probe outputs. Analysts provide lightweight attribute- and query-level feedback, which drives staged refinement of fusion weights while keeping the probes fixed. These verified attributes can be reused for future queries. We evaluate ProbeScout on 17 retrieval tasks across three datasets, showing improved retrieval over embedding baselines. A separate 10-task comparison achieves higher task-macro AP and F1 than exhaustive VQA while labeling at most 2% of the gallery images. Two case studies further demonstrate how ProbeScout supports interactive analysis and refinement in realistic workflows.
Generative method finds people from text descriptions without labels
Generative Retrieval for Unsupervised Text-Based Person Search
Abstract: Text-based person search (TBPS) aims to retrieve images of a target person from a large image gallery based on a given natural language description. Most existing methods rely on supervised learning with manually annotated image-text pairs. In this paper, we explore unsupervised TBPS, with only unlabeled images. We propose GTR+, a two-stage generation-then-retrieval framework. In the generation stage, we introduce a tiered description generation framework designed to produce fine-grained and stylistically diverse textual descriptions through a three-tier sequential process. The base tier leverages an automated question-and-answer mechanism to generate basic visual attribute descriptions; the intermediate tier enhances fine-grained detail using an inter-sample contrastive mechanism; the advanced tier further enriches textual diversity via a stylized expansion mechanism. In the retrieval stage, to mitigate the impact of noisy pseudo texts, we develop an adaptive confidence-weighted retrieval learning framework. We model image-text pairs as clean or noisy using a Gaussian Mixture Model, calibrated by real-time image-text similarity and static text generation probability from the prior stage, yielding adaptive sample weights during training. Beyond that, we also contribute LargeFine-Person, a large-scale TBPS dataset with high-quality, fine-grained, and diverse textual annotations, enabling a practical and generalizable TBPS pre-training benchmark under unsupervised setting. Experiments on multiple TBPS benchmarks demonstrate the effectiveness and generalization of both GTR+ and LargeFine-Person. Code is available at: https://github.com/Flame-Chasers/GTR.
Foundation models improve video search by adapting processing depth
Beyond Similarity: Foundation Models as an Efficient Backbone for Training-Free Composed Video Retrieval
Abstract: Composed video retrieval (CoVR) searches a gallery for the target video that realizes a natural-language modification of a source clip. However, at gallery scale, this creates a fundamental tension: compact embeddings enable efficient, reusable search but can miss the transient actions, state changes, and subtle constraints that demand fine-grained video reasoning, whereas applying large multimodal models uniformly sacrifices scalability. To address these limitations, we propose that frozen foundation models should instead occupy complementary roles, with inference depth adapted to query difficulty. Based on this premise, we introduce \methodname{}, a framework for training-free \methodexpansion{}. Specifically, a composed-query embedding first searches reusable video-only gallery representations; uncertain queries undergo bounded reranking and candidate expansion; ambiguous edits trigger target-description generation; and only close leading candidates reach multimodal verification. To support these roles, frame selection, spatial resolution, and time cues are adapted to each stage. Across complete target-gallery evaluations, our method reaches state-of-the-art performance among training-free approaches, with 89.55 and 93.43 R@1 on Dense-WebVid-CoVR and CoVR-R, respectively (with more than +35\% and +25\% absolute margins to the closest counterpart). These results show that adaptively orchestrating foundation-model capabilities can combine scalable retrieval with fine-grained reasoning without task-specific training. The source code and all relevant guidelines are available on https://github.com/demidovd98/CoVRAGE.