GarmentWeaver: Schema-Aware Structured Synthesis for Multimodal Sewing Patterns
2026-08-31 • Artificial Intelligence
Artificial IntelligenceComputer Vision and Pattern Recognition
AI summaryⓘ
The authors developed GarmentWeaver, a new system that creates sewing patterns from sketches and text descriptions. Unlike older methods that treat garment details as long, mixed-up sequences, GarmentWeaver organizes patterns in a clear, step-by-step structure based on garment parts. It uses a special strategy to understand the design and ensures the generated patterns are practical for making real clothes. Tests showed that GarmentWeaver makes more accurate and usable patterns than other methods and works better for digital garment simulation.
multimodal sewing pattern generationhierarchical target constructionvision-language modelschema-aware frameworkexecutable sewing patternssimulation compatibilitystructured generationdigital garment creationfeasibility-aware regularization
Authors
Yinwen Lu, Weihao Luo, Yueqi Zhong
Abstract
Multimodal Sewing pattern generation aims to infer executable sewing patterns from design cues such as sketches and textual descriptions. As an interpretable and simulation-compatible representation, sewing patterns are particularly valuable for digital garment creation. However, existing methods often model garment specifications as flat long sequences, which entangles garment structure with detailed parameters and leads to redundant components, inaccurate local details, and poor simulation compatibility. In this paper, we present GarmentWeaver, a schema-aware framework for multimodal Sewing pattern generation. GarmentWeaver constructs compact hierarchical targets by activating garment-relevant structural branches and predicts executable Sewing patterns in a structured manner. Specifically, we introduce a schema-aware target construction strategy, build the generator on top of a pretrained vision-language model for multimodal garment understanding, and impose feasibility-aware regularization to encourage structurally valid and simulation-compatible outputs. Extensive experiments show that GarmentWeaver produces more accurate and more executable sewing patterns than strong baselines, while also yielding better simulation results. These findings demonstrate the effectiveness of schema-aware structured generation for reliable multimodal Sewing pattern prediction.