GlyphAtlas improves text look in complex small or dense scenes
GlyphAtlas: Disentangling Stroke Detail from Layout for Scene Text Synthesis
Computer Vision and Pattern Recognition
Summary
Creating realistic text in pictures needs letters that look exactly right and fit well into the scene. Previous methods combined letter shape and position in one image, which made it hard to show tiny details for small or crowded text. The authors came up with GlyphAtlas, which separates fine details of letters from their location, using a special map of characters. This helps produce clearer and more accurate text in images, even for small, busy, or new languages, and works well when many text parts appear together.
What this means in practice
- •For mobile app developers: Generate high-quality, detailed text for augmented reality apps with small or complex scene text elements using GlyphAtlas.
- •For video game designers: Produce visually accurate text rendering for in-game scenes featuring dense or structurally complex text overlays without losing detail.
Authors
Luozheng Qin, Changhai Zhou, Yiyi Zhou
Abstract
Scene text synthesis requires stroke-accurate characters rendered in a specified layout, as well as visual coherence with the surrounding scene. To achieve this, existing methods commonly pre-render the target text at its intended locations to form a glyph image that jointly specifies layout and glyph structure. However, this representation ties the resolution of each glyph to its target region, limiting fine-grained stroke guidance for small, densely packed, or structurally complex text. To tackle this, we propose GlyphAtlas, a scene text synthesis framework that retains the glyph image as a spatial anchor and supplies fine-grained stroke references through a dedicated glyph atlas. The atlas renders and encodes each character or word in a separate cell, decoupling reference resolution from target-region size. We further introduce atlas-anchored attention, which lets each text region retrieve stroke detail only from its corresponding atlas cells to refine the coarse glyph structure provided by the glyph image. This coarse-to-fine conditioning simplifies stroke rendering while preserving explicit layout correspondence. We optimize GlyphAtlas with a mask-weighted flow matching objective and a timestep-weighted text perceptual loss for writing accuracy and background consistency. Random resolution augmentation of atlas cells supports adjustable atlas budgets at inference. Extensive experiments demonstrate that GlyphAtlas achieves stroke-accurate synthesis of small, dense, and structurally complex text, zero-shot transfer to languages unseen during task-specific training, and leading performance in scenes with many text regions. project page: https://fr0zencrane.github.io/project-glyphatlas/