miun.sePublications
Change search
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • harvard1
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf
Spatio-Temporal Consistent Depth-Image Based Rendering Using Layered Depth Image and Inpainting
Mid Sweden University, Faculty of Science, Technology and Media, Department of Information and Communication systems. (Realistic3D)
Mid Sweden University, Faculty of Science, Technology and Media, Department of Information and Communication systems. (Realistic3D)
Mid Sweden University, Faculty of Science, Technology and Media, Department of Information and Communication systems. (Realistic3D)
2016 (English)In: EURASIP Journal on Image and Video Processing, ISSN 1687-5176, E-ISSN 1687-5281, Vol. 9, no 1, 1-19 p.Article in journal (Refereed) Published
Abstract [en]

Depth-image-based rendering (DIBR) is a commonly used method for synthesizing additional views using video-plus-depth (V+D) format. A critical issue with DIBR based view synthesis is the lack of information behind foreground objects. This lack is manifested as disocclusions, holes, next to the foreground objects in rendered virtual views as a consequence of the virtual camera “seeing” behind the foreground object. The disocclusions are larger in the extrapolation case, i.e. the single camera case. Texture synthesis methods (inpainting methods) aim to fill these disocclusions by producing plausible texture content. However, virtual views inevitably exhibit both spatial and temporal inconsistencies at the filled disocclusion areas, depending on the scene content. In this paper we propose a layered depth image (LDI) approach that improves the spatio-temporal consistency. In the process of LDI generation, depth information is used to classify the foreground and background in order to form a static scene sprite from a set of neighboring frames. Occlusions in the LDI are then identified and filled using inpainting, such that no disocclusions appear when the LDI data is rendered to a virtual view. In addition to the depth information, optical flow is computed to extract the stationary parts of the scene and to classify the occlusions in the inpainting process. Experimental results demonstrate that spatio-temporal inconsistencies are significantly reduced using the proposed method. Furthermore, subjective and objective qualities are improved compared to state-of-the-art reference methods.

Place, publisher, year, edition, pages
Springer, 2016. Vol. 9, no 1, 1-19 p.
Keyword [en]
view synthesis; depth-image based rendering; image inpainting; texture synthesis; hole lling; disocclusions; layered depth image; temporal consistency
National Category
Signal Processing Media and Communication Technology
Identifiers
URN: urn:nbn:se:miun:diva-26904DOI: 10.1186/s13640-016-0109-6ISI: 000391585200001Scopus ID: 2-s2.0-84959266613Local ID: STCOAI: oai:DiVA.org:miun-26904DiVA: diva2:896962
Available from: 2016-01-22 Created: 2016-01-22 Last updated: 2017-06-30Bibliographically approved

Open Access in DiVA

Fulltext Open Access(7538 kB)302 downloads
File information
File name FULLTEXT01.pdfFile size 7538 kBChecksum SHA-512
0959bb3ca95eac863b2d968120eb82f7eaa14d99ba0e4bae693601701f6dfb92f3ce4e2a317a1f3a7905ee40cc15cd7a791c027a0ad5b2e76eb707d9a24f6a2e
Type fulltextMimetype application/pdf

Other links

Publisher's full textScopusOpen Access

Search in DiVA

By author/editor
Muddala, SuryanarayanaOlsson, RogerSjöström, Mårten
By organisation
Department of Information and Communication systems
In the same journal
EURASIP Journal on Image and Video Processing
Signal ProcessingMedia and Communication Technology

Search outside of DiVA

GoogleGoogle Scholar
Total: 302 downloads
The number of downloads is the sum of all downloads of full texts. It may include eg previous versions that are now no longer available

Altmetric score

Total: 511 hits
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • harvard1
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf