Mid Sweden University

miun.sePublications
Change search
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf
Towards a generic compression solution for densely and sparsely sampled light field data
Mid Sweden University, Faculty of Science, Technology and Media, Department of Information Systems and Technology. (Realistic3D)
Mid Sweden University, Faculty of Science, Technology and Media, Department of Information Systems and Technology. (Realistic3D)
Mid Sweden University, Faculty of Science, Technology and Media, Department of Information Systems and Technology. (Realistic3D)
2018 (English)In: Proceedings of 25TH IEEE International Conference On Image Processing, 2018, p. 654-658, article id 8451051Conference paper, Published paper (Refereed)
Abstract [en]

Light field (LF) acquisition technologies capture the spatial and angular information present in scenes. The angular information paves the way for various post-processing applications such as scene reconstruction, refocusing, and synthetic aperture. The light field is usually captured by a single plenoptic camera or by multiple traditional cameras. The former captures a dense LF, while the latter captures a sparse LF. This paper presents a generic compression scheme that efficiently compresses both densely and sparsely sampled LFs. A plenoptic image is converted into sub-aperture images, and each sub-aperture image is interpreted as a frame of a multiview sequence. In comparison, each view of the multi-camera system is treated as a frame of a multi-view sequence. The multi-view extension of high efficiency video coding (MVHEVC) is used to encode the pseudo multi-view sequence.This paper proposes an adaptive prediction and rate allocation scheme that efficiently compresses LF data irrespective of the acquisition technology used.

Place, publisher, year, edition, pages
2018. p. 654-658, article id 8451051
Keywords [en]
Light field, plenoptic, Multi-camera, MVHEVC
National Category
Electrical Engineering, Electronic Engineering, Information Engineering
Identifiers
URN: urn:nbn:se:miun:diva-34283DOI: 10.1109/ICIP.2018.8451051ISI: 000455181500132Scopus ID: 2-s2.0-85062918597ISBN: 978-1-4799-7061-2 (print)OAI: oai:DiVA.org:miun-34283DiVA, id: diva2:1240218
Conference
25TH IEEE International Conference On Image Processing (ICIP), Athens, Greece, October 7-10, 2018
Funder
EU, Horizon 2020Available from: 2018-08-20 Created: 2018-08-20 Last updated: 2025-09-25
In thesis
1. High Efficiency Light Field Image Compression: Hierarchical Bit Allocation and Shearlet-based View Interpolation
Open this publication in new window or tab >>High Efficiency Light Field Image Compression: Hierarchical Bit Allocation and Shearlet-based View Interpolation
2021 (English)Doctoral thesis, comprehensive summary (Other academic)
Abstract [en]

Over the years, the pursuit of capturing the precise visual information of a scenehas resulted in various enhancements in digital camera technology, such as highdynamic range, extended depth of field, and high resolution. However, traditionaldigital cameras only capture the spatial information of the scene and cannot pro-vide an immersive presentation of it. Light field (LF) capturing is a new-generationimaging technology that records the spatial and angular information of the scene. Inrecent years, LF imaging has become increasingly popular among the industry andresearch community mainly for two reasons: (1) the advancements made in optical and computational technology have facilitated the process of capturing and processing LF information and (2) LF data have the potential to offer various post-processing applications, such as refocusing at different depth planes, synthetic aperture, 3Dscene reconstruction, and novel view generation. Generally, LF-capturing devicesacquire large amounts of data, which poses a challenge for storage and transmissionresources. Off-the-shelf image and video compression schemes, built on assump-tions drawn from natural images and video, tend to exploit spatial and temporalcorrelations. However, 4D LF data inherit different properties, and hence there is aneed to advance the current compression methods to efficiently address the correla-tion present in LF data.

In this thesis, compression of LF data captured using a plenoptic camera andmulti-camera system (MCS) is considered. Perspective views of a scene capturedfrom different positions are interpreted as a frame of multiple pseudo-video se-quences and given as an input to a multi-view extension of high-efficiency videocoding (MV-HEVC). A 2D prediction and hierarchical coding scheme is proposedin MV-HEVC to improve the compression efficiency of LF data. To further increasethe compression efficiency of views captured using an MCS, an LF reconstructionscheme based on shearlet transform is introduced in LF compression. A sparse set of views is coded using MV-HEVC and later used to predict the remaining views by applying shearlet transform. The prediction error is also coded to further increase the compression efficiency. Publicly available LF datasets are used to benchmark the proposed compression schemes. The anchor scheme specified in the JPEG Plenocommon test conditions is used to evaluate the performance of the proposed scheme. Objective evaluations show that the proposed scheme outperforms state-of-the-art schemes in the compression of LF data captured using a plenoptic camera and an MCS. Moreover, the introduction of shearlet transform in LF compression further improves the compression efficiency at low bitrates, at which the human vision sys-tem is sensitive to the perceived quality.The work presented in this thesis has been published in four peer-reviewed con-ference proceedings and two scientific journals. The proposed compression solu-tions outlined in this thesis significantly improve the rate-distortion efficiency forLF content, which reduces the transmission and storage resources. The MV-HEVC-based LF coding scheme is made publicly available, which can help researchers totest novel compression tools and it can serve as an anchor scheme for future researchstudies. The shearlet-transform-based LF compression scheme presents a compre-hensive framework for testing LF reconstruction methods in the context of LF com-pression.

Place, publisher, year, edition, pages
Sundsvall: Mid Sweden University, 2021. p. 46
Series
Mid Sweden University doctoral thesis, ISSN 1652-893X ; 341
National Category
Information Systems
Identifiers
urn:nbn:se:miun:diva-41704 (URN)978-91-88947-81-9 (ISBN)
Public defence
2021-04-22, C312, Holmgatan 10, Sundsvall, 09:00 (English)
Opponent
Supervisors
Available from: 2021-03-23 Created: 2021-03-19 Last updated: 2025-09-25Bibliographically approved

Open Access in DiVA

fulltext(219 kB)1295 downloads
File information
File name FULLTEXT01.pdfFile size 219 kBChecksum SHA-512
3fb1fd9a41b06a4f618f1ae6702dd1f4f25dc1206c8b856e4573104515332ad24d08cd2541cb8b708add5ede304640c04e9e26deb813adf008e00449ee5545e6
Type fulltextMimetype application/pdf

Other links

Publisher's full textScopus

Authority records

Ahmad, WaqasOlsson, RogerSjöström, Mårten

Search in DiVA

By author/editor
Ahmad, WaqasOlsson, RogerSjöström, Mårten
By organisation
Department of Information Systems and Technology
Electrical Engineering, Electronic Engineering, Information Engineering

Search outside of DiVA

GoogleGoogle Scholar
Total: 1296 downloads
The number of downloads is the sum of all downloads of full texts. It may include eg previous versions that are now no longer available

doi
isbn
urn-nbn

Altmetric score

doi
isbn
urn-nbn
Total: 1082 hits
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf