LFC-SASR: Light Field Coding Using Spatial and Angular Super-Resolution

Published:

Published In: IEEE International Conference on Multimedia and Expo Workshop (ICMEW), July 18-22, 2022, Taipei, Taiwan
Conference Website: http://2022.ieeeicme.org
Paper Link: Coming soon

Authors: Ekrem Çetinkaya, Hadi Amirpour, and Christian Timmerer (Christian Doppler Laboratory ATHENA, Alpen-Adria-Universität Klagenfurt)

Abstract: Light field imaging enables post-capture actions such as refocusing and changing view perspective by capturing both spatial and angular information. However, capturing richer information about the 3D scene results in a huge amount of data. To improve the compression efficiency of the existing light field compression methods, we investigate the impact of light field super-resolution approaches (both spatial and angular super-resolution) on the compression efficiency. To this end, firstly, we downscale light field images over (i) spatial resolution, (ii) angular resolution, and (iii) spatial-angular resolution and encode them using Versatile Video Coding (VVC). We then apply a set of light field super-resolution deep neural networks to reconstruct light field images in their full spatial-angular resolution and compare their compression efficiency. Experimental results show that encoding the low angular resolution light field image and applying angular super-resolution yield bitrate savings of 51.16 % and 53.41 % to maintain the same PSNR and SSIM, respectively, compared to encoding the light field image in high-resolution.

Keywords: Light field, Compression, Super-resolution, VVC.

Citation:

Coming soon