一种基于自注意力机制的自动人脸替换方法

AN AUTOMATIC FACE REPLACEMENT METHOD BASED ON SELF-ATTENTION MECHANISM

  • 摘要: 针对DeepFakes人脸替换方法生成人脸图像分辨率低、质量差等问题,提出一种基于自注意力机制的生成对抗网络的自动人脸替换方法,生成对抗网络主体采用类似U型自编码对称结构减少特征信息的损失,引进自注意力机制能够更好地学习图像的纹理特征,提高生成图像的重建质量,应用卡尔曼滤波器平滑处理每一帧上的边界框位置,降低人脸抖动。在FaceForensics++数据集上与DeepFakes替换方法进行对比实验,定性和定量的实验结果证明了该方法能够较好地提升生成图像质量,减少脸部抖动。

     

    Abstract: Aimed at the low resolution and poor quality of face images generated by the DeepFakes face replacement method, a face replacement method based on self-attention generation confrontation network is proposed. The main body of the generation confrontation network adopted a U-shaped self-encoding symmetric structure to reduce the loss of feature information. We introduced the self-attention mechanism to better learn the texture characteristics of the image, improved the reconstruction quality of the generated image, and applied the Kalman filter to smooth the position of the bounding box on each frame thus reducing the face jitter. A comparative experiment was carried out on the FaceForensics++ dataset with the DeepFakes replacement method. The qualitative and quantitative experimental results prove that the method can better improve the quality of the generated image and reduce facial jitter.

     

/

返回文章
返回