融合边缘信息的并行图像修复算法

PARALLEL IMAGE INPAINTING ALGORITHM COMBINING EDGE INFORMATION

  • 摘要: 现有图像修复方法仍存在边缘混淆、纹理缺失或修复失真不连贯等问题。针对上述问题,提出一种融合边缘结构的并行生成对抗修复网络。首先设计一个边缘结构修复网络得到完整的边缘结构信息,接着将待修复数据和边缘结构信息送入基于门卷积的并行网络结构,分别通过改进的感知注意力模块以及多尺度融合块两条支路提取信息来最终修复图像。在Paris StreetView和CelebA-HQ数据集上的实验结果表明该方法在PSNR和SSIM指标上基本优于对比算法,大比例缺失掩码下效果显著平均提升6.2%与5.5%,取得真实良好的修复效果。

     

    Abstract: Existing image inpainting methods still have problems such as edge confusion, missing texture or incoherent repair distortion. Aimed at the above problems, a parallel generative adversarial inpainting network fused with edge structure is proposed. An edge structure repair network was designed to obtain the complete edge structure information, and the damaged image and edge structure information were sent to the parallel network structure based on gate convolution, respectively, through the improved contextual attention module and the multi-scale fusion block. Each branch extracted information to finally repair the image. The experimental results on Paris StreetView and CelebA-HQ datasets show that the method is basically better than the comparison algorithm in PSNR and SSIM, and the improvement is significantly improved by 6.2% and 5.5% on average under the large proportion of missing masks, which achieves realistic restoration results.

     

/

返回文章
返回