Abstract: In order to improve the synthesis quality of virtual viewpoint image, a virtual viewpoint repair method based on two-stage repair model is proposed to solve the problem of holes, overlaps and artifacts after virtual views synthesizing. The virtual viewpoint image was synthesized by double viewpoint mapping, and the hole was filled by using the hole filling network of partial convolution. The overlap, artifact and local color difference caused by partial convolution in the image were removed through the image optimization network. The experimental results show that the restored virtual viewpoint image can accurately deal with the problems such as holes, overlaps and artifacts in the image on the premise of ensuring the original texture information. Compared with the classical algorithms, the objective evaluation indexes PSNR and SSIM reaches 31.878 and 0.9207 respectively, which has high drawing quality.