Publications

Detailed Information

Real-Time Video Super-Resolution on Smartphones with Deep Learning, Mobile AI 2021 Challenge: Report

Cited 23 time in Web of Science Cited 38 time in Scopus
Authors

Ignatov, Andrey; Romero, Andres; Kim, Heewon; Timofte, Radu; Ho, Chiu Man; Meng, Zibo; Lee, Kyoung Mu; Chen, Yuxiang; Wang, Yutong; Long, Zeyu; Wang, Chenhao; Chen, Yifei; Xu, Boshen; Gu, Shuhang; Duan, Lixin; Wen Li; Wang Bofei; Zhang Diankai; Zheng Chengjian; Liu Shaoli; Gao Si; Zhang Xiaofeng; Lu Kaidi; Xu Tianyu; Zheng Hui; Gao, Xinbo; Wang, Xiumei; Guo, Jiaming; Zhou, Xueyi; Hao Jia; Yan, Youliang

Issue Date
2021-06
Publisher
IEEE COMPUTER SOC
Citation
IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops, pp.2535-2544
Abstract
Video super-resolution has recently become one of the most important mobile-related problems due to the rise of video communication and streaming services. While many solutions have been proposed for this task, the majority of them are too computationally expensive to run on portable devices with limited hardware resources. To address this problem, we introduce the first Mobile AI challenge, where the target is to develop an end-to-end deep learning-based video super-resolution solutions that can achieve a real-time performance on mobile GPUs. The participants were provided with the REDS dataset and trained their models to do an efficient 4X video upscaling. The runtime of all models was evaluated on the OPPO Find X2 smartphone with the Snapdragon 865 SoC capable of accelerating floating-point networks on its Adreno GPU. The proposed solutions are fully compatible with any mobile GPU and can upscale videos to HD resolution at up to 80 FPS while demonstrating high fidelity results. A detailed description of all models developed in the challenge is provided in this paper.
ISSN
2160-7508
URI
https://hdl.handle.net/10371/186461
DOI
https://doi.org/10.1109/CVPRW53098.2021.00287
Files in This Item:
There are no files associated with this item.
Appears in Collections:

Altmetrics

Item View & Download Count

  • mendeley

Items in S-Space are protected by copyright, with all rights reserved, unless otherwise indicated.

Share