Discrete cosine basis oriented motion modeling for fisheye and 360 degree video coding

Research output: Book chapter/Published conference paperConference paperpeer-review

1 Citation (Scopus)

Abstract

Motion modeling plays a central role in video compression. This role is even more critical in fisheye video sequences since the wide-angle fisheye imagery has special characteristics as in exhibiting radial distortion. While the translational motion model employed by modern video coding standards, such as HEVC, is sufficient in most cases, using higher order models is beneficial; for this reason, the upcoming video coding standard, VVC, employs a 4-parameter affine model. Discrete cosine basis has the ability to efficiently model complex motion fields. In this work, we investigate the motion modeling behaviour of the discrete cosine basis equipped with higher frequency cosine vectors. In particular, the developed discrete cosine basis is used as a single high-order model to describe a fisheye frame's motion; we employ this motion to produce an extra prediction reference, which is added to the HEVC list of references. Experimental results show an increase in delta bit rate, over conventional HEVC, when higher frequency cosine vectors are added in the motion modeling process. Then leveraging on this modified discrete cosine basis, we propose to employ it for predicting the motion in 360 degree video frames because of their resemblance with fisheye images. In this case, a delta bit rate of 2% is achieved, over conventional HEVC.

Original languageEnglish
Title of host publicationIEEE 21st International Workshop on Multimedia Signal Processing, MMSP 2019
Place of PublicationUnited States
PublisherIEEE, Institute of Electrical and Electronics Engineers
Pages1-5
Number of pages5
ISBN (Electronic)9781728118178
DOIs
Publication statusPublished - Sep 2019
Event21st IEEE International Workshop on Multimedia Signal Processing, MMSP 2019 - Aloft Kuala Lumpur Sentral Hotel, Kuala Lumpur, Malaysia
Duration: 27 Sep 201929 Sep 2019
https://web.archive.org/web/20201109030652/https://signalprocessingsociety.org/blog/mmsp-2019-2019-ieee-21st-international-workshop-multimedia-signal-processing (conference website)

Publication series

NameIEEE 21st International Workshop on Multimedia Signal Processing, MMSP 2019

Conference

Conference21st IEEE International Workshop on Multimedia Signal Processing, MMSP 2019
Abbreviated titleWhen AI meets Multimedia
CountryMalaysia
CityKuala Lumpur
Period27/09/1929/09/19
Internet address

Fingerprint Dive into the research topics of 'Discrete cosine basis oriented motion modeling for fisheye and 360 degree video coding'. Together they form a unique fingerprint.

Cite this