Improving reference picture resampling (RPR) for future video coding

Philippe Bordes; Hassane Guermoud; Franck Galpin; Thierry Dumas; Fabrice Urban

doi:10.1117/12.2632283

3 October 2022 Improving reference picture resampling (RPR) for future video coding

Philippe Bordes, Hassane Guermoud, Franck Galpin, Thierry Dumas, Fabrice Urban

Proceedings Volume 12226, Applications of Digital Image Processing XLV; 1222608 (2022) https://doi.org/10.1117/12.2632283
Event: SPIE Optical Engineering + Applications, 2022, San Diego, California, United States

Abstract

Considering industry needs for further coding efficiency improvements, the Joined Exploration Team on Video (JVET) established by ITU-T and MPEG for standardizing VVC, has developed a new Enhanced Compression Model (ECM) based on VVC which is a common area for testing future video coding algorithms. The Versatile Video Coding (VVC) supports Reference Picture Resampling (RPR) to change frame resolution without inserting an Instantaneous Decoder Refresh (IDR) or Intra Random Access Picture (IRAP). This feature is particularly well adapted to video streaming and low delay scenarios since it allows seamless frame-based bit-rate adaptation, whereas traditional techniques based on streams switching between coded video chunks at fixed resolution can generate bitrate leaps. ECM implements several new tools that improve the coding efficiency compared to VVC, but some of them were not designed to support RPR. In this paper, we first discuss some necessary adaptations to implement RPR in ECM for these new coding tools. At low bit rate, RPR may improve the coding performance of ECM for luma component, and the coding complexity is reduced. However, RPR may show PSNR drop for chroma component because it performs an additional down-scaling filtering on samples that were already filtered from the original canonical 4:4:4 content to create the 4:2:0 format. Then, in a second part, some modifications of RPR to re-scale luma and chroma differently are proposed. It is shown that it improves ECM efficiency in the context of both super-resolution and low-delay coding use cases.

Conference Presentation

Citation Download Citation

Philippe Bordes, Hassane Guermoud, Franck Galpin, Thierry Dumas, and Fabrice Urban "Improving reference picture resampling (RPR) for future video coding", Proc. SPIE 12226, Applications of Digital Image Processing XLV, 1222608 (3 October 2022); https://doi.org/10.1117/12.2632283

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available