Mid Sweden University

miun.sePublications
Change search
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf
Disocclusion Handling Using Depth-Based Inpainting
Mid Sweden University, Faculty of Science, Technology and Media, Department of Information and Communication systems. (Realistic 3D)
Mid Sweden University, Faculty of Science, Technology and Media, Department of Information and Communication systems. (Realistic 3D)
Mid Sweden University, Faculty of Science, Technology and Media, Department of Information and Communication systems. (Realistic 3D)ORCID iD: 0000-0003-3751-6089
2013 (English)In: Proceedings of MMEDIA 2013, The Fifth InternationalConferences on Advances in Multimedia, Venice, Italy, 2013, International Academy, Research and Industry Association (IARIA), 2013, p. 136-141Conference paper, Oral presentation with published abstract (Refereed)
Abstract [en]

Depth image based rendering (DIBR) plays an important role in producing virtual views using 3D-video formats such as video plus depth (V+D) and multi view-videoplus-depth (MVD). Pixel regions with non-defined values (due to disoccluded areas) are exposed when DIBR is used. In this paper, we propose a depth-based inpainting method aimed to handle Disocclusions in DIBR from V+D and MVD. Our proposed method adopts the curvature driven diffusion (CDD) model as a data term, to which we add a depth constraint. In addition, we add depth to further guide a directional priority term in the exemplar based texture synthesis. Finally, we add depth in the patch-matching step to prioritize background texture when inpainting. The proposed method is evaluated by comparing inpainted virtual views with corresponding views produced by three state-of-the-art inpainting methods as references. The evaluation shows the proposed method yielding an increased objective quality compared to the reference methods, and visual inspection further indicate an improved visual quality.

Place, publisher, year, edition, pages
International Academy, Research and Industry Association (IARIA), 2013. p. 136-141
Keywords [en]
video plus depth, warping, depth-image-based rendering, inpainting
National Category
Signal Processing Other Electrical Engineering, Electronic Engineering, Information Engineering
Identifiers
URN: urn:nbn:se:miun:diva-18890Scopus ID: 2-s2.0-84905842575Local ID: STCOAI: oai:DiVA.org:miun-18890DiVA, id: diva2:619541
Conference
Fifth International Conferences on Advances in Multimedia; MMEDIA 2013; Apr 21-26 2013; Venice, Italy
Available from: 2013-05-04 Created: 2013-05-04 Last updated: 2017-08-22Bibliographically approved
In thesis
1. View Rendering for 3DTV
Open this publication in new window or tab >>View Rendering for 3DTV
2013 (English)Licentiate thesis, comprehensive summary (Other academic)
Abstract [en]

Advancements in three dimensional (3D) technologies are rapidly increasing. Three Dimensional Television (3DTV) aims at creating 3D experience for the home user. Moreover, multiview autostereoscopic displays provide a depth impression without the requirement for any special glasses and can be viewed from multiple locations. One of the key issues in the 3DTV processing chain is the content generation from the available input data format video plus depth and multiview video plus depth. This data allows for the possibility of producing virtual views using depth-image-based rendering. Although depth-image-based rendering is an efficient method, it is known for appearance of artifacts such as cracks, corona and empty regions in rendered images. While several approaches have tackled the problem, reducing the artifacts in rendered images is still an active field of research.

 

Two problems are addressed in this thesis in order to achieve a better 3D video quality in the context of view rendering: firstly, how to improve the quality of rendered views using a direct approach (i.e. without applying specific processing steps for each artifact), and secondly, how to fill the large missing areas in a visually plausible manner using neighbouring details from around the missing regions. This

thesis introduces a new depth-image-based rendering and depth-based texture inpainting in order to address these two problems. The first problem is solved by an edge-aided rendering method that relies on the principles of forward warping and one dimensional interpolation. The other problem is addressed by using the depth-included curvature inpainting method that uses appropriate depth level texture details around disocclusions.

 

The proposed edge-aided rendering method and depth-included curvature inpainting methods are evaluated and compared with the state-of-the-art methods. The results show an increase in the objective quality and the visual gain over reference methods. The quality gain is encouraging as the edge-aided rendering method omits the specific processing steps to remove the rendering artifacts. Moreover, the results show that large disocclusions can be effectively filled using the depth-included curvature inpainting approach. Overall, the proposed approaches improve the content generation for 3DTV and additionally, for free view point television.

Place, publisher, year, edition, pages
Sundsvall: Mid Sweden University, 2013. p. 49
Series
Mid Sweden University licentiate thesis, ISSN 1652-8948 ; 101
Keywords
3DTV, view rendering, depth-image-based rendering, disocclusion filling, inpainting.
National Category
Other Electrical Engineering, Electronic Engineering, Information Engineering
Identifiers
urn:nbn:se:miun:diva-19194 (URN)STC (Local ID)9789187103773 (ISBN)STC (Archive number)STC (OAI)
Presentation
2013-06-11, L111, Holmgatan10, Sundsvall, 10:15 (English)
Opponent
Supervisors
Available from: 2013-06-13 Created: 2013-06-12 Last updated: 2016-10-20Bibliographically approved

Open Access in DiVA

fulltext(2615 kB)991 downloads
File information
File name FULLTEXT01.pdfFile size 2615 kBChecksum SHA-512
db9c8fa4434630ed19a8423cc38b5c0f660bfc8c2c9fe0e6b73d7aae7c2babc702e85e4df8bf4a80e899365815806d6fbc45c9e2bd643e6b60b2f4347e98c8f2
Type fulltextMimetype application/pdf

Other links

ScopusFull text on ThinkMind Digital Libary

Authority records

Muddala, Suryanarayana M.Olsson, RogerSjöström, Mårten

Search in DiVA

By author/editor
Muddala, Suryanarayana M.Olsson, RogerSjöström, Mårten
By organisation
Department of Information and Communication systems
Signal ProcessingOther Electrical Engineering, Electronic Engineering, Information Engineering

Search outside of DiVA

GoogleGoogle Scholar
Total: 992 downloads
The number of downloads is the sum of all downloads of full texts. It may include eg previous versions that are now no longer available

urn-nbn

Altmetric score

urn-nbn
Total: 1438 hits
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf