Papers for

advertising content creators

Papers whose findings have a practical use for this group, as judged from the abstract. Open a paper to read what it means in practice.

Temporal logic improves order and timing in AI video generation

Temporal Specification Guidance for Text-to-Video Generation

Abstract: Text-to-video models often generate the visual concepts requested in natural language prompts but fail to satisfy their intended ordering, timing, and persistence requirements. We propose representing these requirements as specifications in a formal Temporal Logic, and introduce Temporal Specification Guidance (TSG), a training-free inference-time framework that turns temporal specifications into executable objectives for guiding video generation during sampling. TSG scores traces of visual concept evidence using differentiable quantitative semantics and uses the score's gradients to construct a specification-guided denoising direction. We instantiate this framework with video-text attention traces, efficient differentiable scores for Metric Temporal Logic, and gradient-derived attention biases. This instantiation requires neither an external concept classifier nor backpropagation through the video transformer. Its attention-steered forward pass yields a denoising direction that augments classifier-free guidance (CFG). On a benchmark of 220 prompts spanning 11 categories of temporal constraints, including ordered object entry and state transitions, this instantiation improves specification satisfaction accuracy over CFG by 9.5-20 percentage points across five models, with minimal memory overhead. These results demonstrate the potential of temporal specifications and differentiable satisfaction objectives as a flexible interface for controlling video generation.

Wed 14 OctArtificial IntelligenceComputer Vision and Pattern Recognition
The gist
Creating videos from text prompts is hard because the timing and order of actions might be wrong. The authors introduce a technique that uses a kind of logic to clearly specify when things should happen in the video. Their method guides the video creation process without extra training, helping the video better match the requested timing and sequence. Tests show their approach works better than standard methods on many examples with different timing rules.
Open → 2610.20822v1

Diffusion models improve text accuracy in image super-resolution

TGSR: Text-Grounded Diffusion for Faithful Image Super-Resolution

Abstract: Diffusion models have achieved remarkable success in image super-resolution (SR) by leveraging strong generative priors to enhance perceptual quality. However, for textual content, these priors often produce text hallucinations: non-existent or distorted text, which alter scene semantics and compromise model reliability. While recent methods focus on enhancing text generation, they do so indiscriminately, leaving hallucinations fundamentally unresolved. We argue the core problem is a lack of selective control. Therefore, we reformulate text SR as a selective generation problem: text is resolved only when reliable generation is expected, while other scene content is fully super-resolved. We introduce TGSR (Text-Grounded Super-Resolution), a test-time framework that progressively identifies and suppresses likely hallucinated text regions during generation. To enable this, we train dedicated detectors on a large-scale dataset curated from diverse diffusion-based SR outputs. TGSR consistently improves text fidelity across multiple backbones, increasing recognition precision by up to 17.68 points without degrading perceptual quality, underscoring the value of selective control in generative SR.

Fri 9 OctComputer Vision and Pattern Recognition
The gist
Making blurry pictures clearer often causes text in the image to look wrong or fake. The authors found that this happens because current methods try to improve text everywhere without checking if it's reliable. They propose a way to only sharpen text that is likely correct and avoid making up fake words. Their method uses a special detector to find and reduce these errors, leading to clearer and more accurate text in enhanced images.
Open → 2610.14281v1

Video text rendering quality varies widely across generation tasks

Beyond Legibility: Benchmarking Visual Text Rendering and In-Place Editing in Unified Video Generation

Abstract: A video can exhibit convincing motion and photorealism yet fail immediately when visual text collapses. Unlike generic scene content, visual text is unforgiving in video generation: minor stroke corruption, temporal instability, or editing errors instantly break legibility and realism. Existing benchmarks overlook this challenge by treating text as incidental or using static OCR metrics that ignore temporal dynamics. We introduce VidScribe, a unified diagnostic benchmark spanning four generation regimes: writing from language (T2V), transferring text identity from a reference (R2V), sustaining text under dynamics (I2V), and localized text editing (V2V). VidScribe contains 803 human-verified samples across a 12-axis conditionally orthogonal factor space covering Intrinsic Text Properties, Physical Imaging Conditions, and Temporal Behavior. For reliable evaluation, we build a track-grounded, gated suite with 11 shared metrics and 2 task-specific probes under strict measurability conditions. Benchmarking 11 commercial and open-source systems shows that video text capability is non-monolithic, with content recognition decoupled from stroke-level glyph correctness. Performance is highly task-asymmetric: I2V sustains text most reliably, whereas V2V editing is the primary bottleneck. Counter-intuitively, degradation concentrates on a small subset of text-centric structural and temporal factors rather than adverse imaging conditions. Further probes show that visual references improve glyph and typographic fidelity rather than content accuracy, while localized editing fails to isolate target text without corrupting undeclared source text. Beyond evaluation, VidScribe also provides an actionable training signal, where benchmark-aligned preference optimization measurably improves visual text generation. https://huggingface.co/datasets/Vicky0720/VidScribe.

Tue 29 SeptComputer Vision and Pattern Recognition
The gist
Visual text in videos is very sensitive and easy to ruin, even if the video looks realistic. The authors created VidScribe, a detailed benchmark to test how well different video generation systems handle text across writing, identity transfer, motion, and editing tasks. They found that different tasks have very different levels of success and that some problems come from specific text features rather than simple image quality. Their benchmark also helps improve training so future systems can better create and edit text in videos.
Open → 2609.36598v1