LFC-SASR: Light Field Coding Using Spatial and Angular Super-Resolution

Published In: IEEE International Conference on Multimedia and Expo Workshop (ICMEW), July 18-22, 2022, Taipei, Taiwan - PaperLink

Authors: Ekrem Çetinkaya, Hadi Amirpour, and Christian Timmerer (Christian Doppler Laboratory ATHENA, Alpen-Adria-Universität Klagenfurt)

Abstract: Light field imaging enables post-capture actions such as refocusing and changing view perspective by capturing both spatial and angular information. However, capturing richer information about the 3D scene results in a huge amount of data. To improve the compression efficiency of the existing light field compression methods, we investigate the impact of light field super-resolution approaches (both spatial and angular super-resolution) on the compression efficiency. To this end, firstly, we downscale light field images over (i) spatial resolution, (ii) angular resolution, and (iii) spatial-angular resolution and encode them using Versatile Video Coding (VVC). We then apply a set of light field super-resolution deep neural networks to reconstruct light field images in their full spatial-angular resolution and compare their compression efficiency. Experimental results show that encoding the low angular resolution light field image and applying angular super-resolution yield bitrate savings of 51.16 % and 53.41 % to maintain the same PSNR and SSIM, respectively, compared to encoding the light field image in high-resolution.

Keywords: Light field, Compression, Super-resolution, VVC.

@inproceedings{LFC-SASR,
    author={\c{C}etinkaya, Ekrem and Amirpour, Hadi and Timmerer, Christian},
    booktitle={2022 IEEE International Conference on Multimedia and Expo Workshops (ICMEW)},
    title={{LFC-SASR: Light Field Coding Using Spatial and Angular Super-Resolution}},
    year={2022},
    pages={1-6},
    doi={10.1109/ICMEW56448.2022.9859373}
}