Compression method of NeRF model using NNC and VVC

Dong-Ha Kim; Jun Young Jeong; Gwangsoon Lee; Jae-Gon Kim

doi:10.1117/12.3019533

2 May 2024 Compression method of NeRF model using NNC and VVC

Dong-Ha Kim, Jun Young Jeong, Gwangsoon Lee, Jae-Gon Kim

Proceedings Volume 13164, International Workshop on Advanced Imaging Technology (IWAIT) 2024; 131642V (2024) https://doi.org/10.1117/12.3019533
Event: International Workshop on Advanced Imaging Technology (IWAIT) 2024, 2024, Langkawi, Malaysia

Abstract

The Moving Picture Expert Groups (MPEG) recognized that the Neural Radiance Field (NeRF) could serve as a novel image and video compression approach. Therefore, the MPEG established the ad-hoc group called Implicit Neural Visual Representation (INVR) and is currently exploring the potential standardization of 6 Degree of Freedom (6DoF) video compression using NeRF-based technologies. The INVR group is investigating the compression and rendering performance of various NeRF models, including the basic NeRF composed of simple Multi-Layer Perceptrons (MLPs) and the hybrid NeRF that utilizes voxel grids along with MLPs. In this paper, we propose compression methods of basic NeRF and hybrid NeRF using the existing standards, Neural Network Compression (NNC) and Versatile Video Coding (VVC), respectively. The proposed method for the basic NeRF compression utilizes NNC with a network-adaptive bit allocation method. Additionally, the proposed method for compressing the hybrid NeRF, TensoRF, involves transforming the tensor-planes that constitute TensoRF into feature maps and compress them using VVC. In the validation experiments based on the common test conditions (CTCs) defined by INVR, the proposed hybrid NeRF compression demonstrates significantly higher BPP-PSNR performance compared to the state-of-the art method, Vector Quantized Radiance Field (VQRF).

(2024) Published by SPIE. Downloading of the abstract is permitted for personal use only.

Citation Download Citation

Dong-Ha Kim, Jun Young Jeong, Gwangsoon Lee, and Jae-Gon Kim "Compression method of NeRF model using NNC and VVC", Proc. SPIE 13164, International Workshop on Advanced Imaging Technology (IWAIT) 2024, 131642V (2 May 2024); https://doi.org/10.1117/12.3019533

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available

Members: $17.00

Non-members: $21.00 ADD TO CART

PROCEEDINGS
6 PAGES

DOWNLOAD PAPER SAVE TO MY LIBRARY

GET CITATION

RIGHTS & PERMISSIONS

Get copyright permission Get copyright permission on Copyright Marketplace

KEYWORDS

Performance modeling

Data modeling

Voxels

Quantization

Education and training

Video compression

3D modeling

Show All Keywords

Keywords/Phrases

Search In:

Publication Years