Frequency Decoupled Framework for Screen Content Image Super-Resolution

2026-06-08Computer Vision and Pattern Recognition

Computer Vision and Pattern Recognition
AI summary

The authors improve screen content image super-resolution by focusing on how images store information in frequencies, specifically amplitude and phase. They separate an image into these parts to better recognize regular patterns and overall structure. Their method uses special networks to capture and combine these frequency features, leading to clearer and more accurate image enhancements. Tests show their approach works better than previous ones, and they confirmed that each part of their system helps improve the results.

Screen Content Image Super-ResolutionImplicit Neural RepresentationsAmplitudePhaseFrequency DecouplingSelf-AttentionPeriodic PatternsImage EnhancementNeural NetworksAblation Study
Authors
Xufei Wang, Qicheng Zhang, Qi Wu, Ziyang Gu, Shizhuang Weng
Abstract
Methods based on implicit neural representations have demonstrated superior performance in Screen Content Image Super-Resolution (SCISR) . However, they overlooked the inherent frequency characteristics, leading to suboptimal performance. We propose a frequency decoupled framework (FDF) that rethinks SCISR from a phasor perspective by capturing structured energy in amplitude and relational continuity in phase, and jointly exploiting them with bespoke implicit representations to faithfully recover the regular textures and global configuration of Screen Content Image (SCI). Amplitude-Phase Factorization Network (APFN) first separates images into amplitude and phase streams, where Amplitude Clustering Module (ACM) organizes sparse yet high-energy amplitude responses into representative prototypes for periodic pattern extraction, while Phase Consistency Self-Attention (PCSA) progressively reinforces configuration through continuous consistency propagation. And Oscillation-Anharmonic Implicit Fitting Network (OAIF-Net) integrates periodic and coherent implicit representations for efficient exploitation of the periodic patterns and coherent context embedded in SCI. Experimental results show FDF achieves state-of-the-art SCISR performance at multiple scales across four public SCI datasets. Ablation experiments further demonstrate the effectiveness of each component in extracting and exploiting periodic patterns and coherent context.