7 February 2022 Perceptual face inpainting with multicolumn gated convolutional network
You Yang, Kesen Li, Sixun Liu, Ling Luo, Bin Xing
Author Affiliations +
Abstract

Face inpainting is a challenging task in computer vision. Although deep learning-based methods that apply attention mechanism or utilize prior knowledge could reconstruct facial components, they may produce visual artifacts or lack detail texture. To solve mainly these two problems, we propose a multicolumn gated convolutional network (MGCN). MGCN is composed of three parallel branches with gated convolution to dynamically extract multispatial features, which could help to improve the global semantic coherence and achieve more effective performance in irregular mask. Specifically, for generating more plausible texture, we developed a diversified perceptual Markov random field to search correct feature patches in global rather than local images. Experiments on CelebA-HQ face and Flickr-Faces-HQ datasets demonstrate that MGCN achieves a more competitive performance than the state-of-the-art methods.

© 2022 SPIE and IS&T 1017-9909/2022/$28.00 © 2022 SPIE and IS&T
You Yang, Kesen Li, Sixun Liu, Ling Luo, and Bin Xing "Perceptual face inpainting with multicolumn gated convolutional network," Journal of Electronic Imaging 31(1), 013022 (7 February 2022). https://doi.org/10.1117/1.JEI.31.1.013022
Received: 27 September 2021; Accepted: 20 January 2022; Published: 7 February 2022
Lens.org Logo
CITATIONS
Cited by 1 scholarly publication.
Advertisement
Advertisement
RIGHTS & PERMISSIONS
Get copyright permission  Get copyright permission on Copyright Marketplace
KEYWORDS
Convolution

Photonic integrated circuits

Image segmentation

Gallium nitride

Visualization

Computer programming

Lithium

Back to Top