科学研究

Research

首页 >  论文  > 详情

GLEAN Generative Latent Bank for Large-Factor Image Super-Resolution

发表会议及期刊:CVPR

Kelvin C.K. Chan 1 Xintao Wang 2 Xiangyu Xu 1 Jinwei Gu 3,4 Chen Change Loy 1∗

1S-Lab, Nanyang Technological University

2Applied Research Center, Tencent PCG  3 Tetras.AI. 4 Shanghai AI Laboratory

{chan0899, xiangyu.xu, ccloy}@ntu.edu.sg xintao.wang@outlook.com gujinwei@tetras.ai 

Abstract: 

We show that pre-trained Generative Adversarial Net-works (GANs), e.g., StyleGAN, can be used as a latent bank to improve the restoration quality of large-factor image super-resolution (SR). While most existing SR approaches attempt to generate realistic textures through learning with adversarial loss, our method, Generative LatEnt bANk (GLEAN), goes beyond existing practices by directly lever-aging rich and diverse priors encapsulated in a pre-trained GAN. But unlike prevalent GAN inversion methods that require expensive image-specific optimization at runtime, our approach only needs a single forward pass to generate the upscaled image. GLEAN can be easily incorporated in a simple encoder-bank-decoder architecture with multi-resolution skip connections. Switching the bank allows the method to deal with images from diverse categories, e.g.,cat, building, human face, and car. Images upscaled by GLEAN show clear improvements in terms of fidelity and texture faithfulness in comparison to existing methods as shown in Fig. 1.

hr@pjlab.org.cn

上海市徐汇区云锦路701号西岸国际人工智能中心37-38层

沪ICP备2021009351号-1