miun.sePublikasjoner
Endre søk
RefereraExporteraLink to record
Permanent link

Direct link
Referera
Referensformat
  • apa
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • Annet format
Fler format
Språk
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Annet språk
Fler språk
Utmatningsformat
  • html
  • text
  • asciidoc
  • rtf
View Rendering for 3DTV
Mittuniversitetet, Fakulteten för naturvetenskap, teknik och medier, Avdelningen för informations- och kommunikationssystem. (Realistic3D)
2013 (engelsk)Licentiatavhandling, med artikler (Annet vitenskapelig)
Abstract [en]

Advancements in three dimensional (3D) technologies are rapidly increasing. Three Dimensional Television (3DTV) aims at creating 3D experience for the home user. Moreover, multiview autostereoscopic displays provide a depth impression without the requirement for any special glasses and can be viewed from multiple locations. One of the key issues in the 3DTV processing chain is the content generation from the available input data format video plus depth and multiview video plus depth. This data allows for the possibility of producing virtual views using depth-image-based rendering. Although depth-image-based rendering is an efficient method, it is known for appearance of artifacts such as cracks, corona and empty regions in rendered images. While several approaches have tackled the problem, reducing the artifacts in rendered images is still an active field of research.

 

Two problems are addressed in this thesis in order to achieve a better 3D video quality in the context of view rendering: firstly, how to improve the quality of rendered views using a direct approach (i.e. without applying specific processing steps for each artifact), and secondly, how to fill the large missing areas in a visually plausible manner using neighbouring details from around the missing regions. This

thesis introduces a new depth-image-based rendering and depth-based texture inpainting in order to address these two problems. The first problem is solved by an edge-aided rendering method that relies on the principles of forward warping and one dimensional interpolation. The other problem is addressed by using the depth-included curvature inpainting method that uses appropriate depth level texture details around disocclusions.

 

The proposed edge-aided rendering method and depth-included curvature inpainting methods are evaluated and compared with the state-of-the-art methods. The results show an increase in the objective quality and the visual gain over reference methods. The quality gain is encouraging as the edge-aided rendering method omits the specific processing steps to remove the rendering artifacts. Moreover, the results show that large disocclusions can be effectively filled using the depth-included curvature inpainting approach. Overall, the proposed approaches improve the content generation for 3DTV and additionally, for free view point television.

sted, utgiver, år, opplag, sider
Sundsvall: Mid Sweden University , 2013. , s. 49
Serie
Mid Sweden University licentiate thesis, ISSN 1652-8948 ; 101
Emneord [en]
3DTV, view rendering, depth-image-based rendering, disocclusion filling, inpainting.
HSV kategori
Identifikatorer
URN: urn:nbn:se:miun:diva-19194Lokal ID: STCISBN: 9789187103773 (tryckt)OAI: oai:DiVA.org:miun-19194DiVA, id: diva2:627745
Presentation
2013-06-11, L111, Holmgatan10, Sundsvall, 10:15 (engelsk)
Opponent
Veileder
Tilgjengelig fra: 2013-06-13 Laget: 2013-06-12 Sist oppdatert: 2016-10-20bibliografisk kontrollert
Delarbeid
1. Edge-preserving depth-image-based rendering method
Åpne denne publikasjonen i ny fane eller vindu >>Edge-preserving depth-image-based rendering method
2012 (engelsk)Inngår i: 2012 International Conference on 3D Imaging, IC3D 2012 - Proceedings, 2012, s. Art. no. 6615113-Konferansepaper, Publicerat paper (Fagfellevurdert)
Abstract [en]

Distributionof future 3DTV is likely to use supplementary depth information to a videosequence. New virtual views may then be rendered in order to adjust todifferent 3D displays. All depth-imaged-based rendering (DIBR) methods sufferfrom artifacts in the resulting images, which are corrected by differentpost-processing. The proposed method is based on fundamental principles of3D-warping. The novelty lies in how the virtual view sample values are obtainedfrom one-dimensional interpolation, where edges are preserved by introducing specificedge-pixels with information about both foreground and background data. Thisavoids fully the post-processing of filling cracks and holes. We comparedrendered virtual views of our method and of the View Synthesis ReferenceSoftware (VSRS) and analyzed the results based on typical artifacts. Theproposed method obtained better quality for photographic images and similarquality for synthetic images.

Emneord
3D, video plus depth, warping, depth-image-based view rendering.
HSV kategori
Identifikatorer
urn:nbn:se:miun:diva-18051 (URN)10.1109/IC3D.2012.6615113 (DOI)2-s2.0-84887863563 (Scopus ID)STC (Lokal ID)978-147991580-4 (ISBN)STC (Arkivnummer)STC (OAI)
Konferanse
2012 2nd International Conference on 3D Imaging, IC3D 2012; Liege; Belgium; 3 December 2012 through 5 December 2012; Category numberCFP12IC3-ART; Code 100759
Tilgjengelig fra: 2012-12-20 Laget: 2012-12-20 Sist oppdatert: 2017-08-22
2. Edge-aided virtual view rendering for multiview video plus depth
Åpne denne publikasjonen i ny fane eller vindu >>Edge-aided virtual view rendering for multiview video plus depth
2013 (engelsk)Inngår i: Proceedings of SPIE Volume 8650, Burlingame, CA, USA, 2013: 3D Image Processing (3DIP) and Applications 2013, SPIE - International Society for Optical Engineering, 2013, s. Art. no. 86500E-Konferansepaper, Publicerat paper (Annet vitenskapelig)
Abstract [en]

Depth-Image-Based Rendering (DIBR) of virtual views is a fundamental method in three dimensional 3-D video applications to produce dierent perspectives from texture and depth information, in particular the multi-viewplus-depth (MVD) format. Artifacts are still present in virtual views as a consequence of imperfect rendering using existing DIBR methods. In this paper, we propose an alternative DIBR method for MVD. In the proposed method we introduce an edge pixel and interpolate pixel values in the virtual view using the actual projected coordinates from two adjacent views, by which cracks and disocclusions are automatically lled. In particular, we propose a method to merge pixel information from two adjacent views in the virtual view before the interpolation; we apply a weighted averaging of projected pixels within the range of one pixel in the virtual view. We compared virtual view images rendered by the proposed method to the corresponding view images rendered by state-of-theart methods. Objective metrics demonstrated an advantage of the proposed method for most investigated media contents. Subjective test results showed preference to dierent methods depending on media content, and the test could not demonstrate a signicant dierence between the proposed method and state-of-the-art methods.

sted, utgiver, år, opplag, sider
SPIE - International Society for Optical Engineering, 2013
Emneord
View rendering, 3DTV, multiview plus depth (MVD), depth-image-based-rendering (DIBR), warping
HSV kategori
Identifikatorer
urn:nbn:se:miun:diva-18474 (URN)10.1117/12.2004116 (DOI)000322110500012 ()2-s2.0-84878267120 (Scopus ID)STC (Lokal ID)978-081949423-8 (ISBN)STC (Arkivnummer)STC (OAI)
Konferanse
3D Image Processing (3DIP) and Applications 2013, 3-7 Feb 2013; Burlingame, Ca, USA, Conference 8650
Tilgjengelig fra: 2013-02-12 Laget: 2013-02-12 Sist oppdatert: 2017-08-22
3. Disocclusion Handling Using Depth-Based Inpainting
Åpne denne publikasjonen i ny fane eller vindu >>Disocclusion Handling Using Depth-Based Inpainting
2013 (engelsk)Inngår i: Proceedings of MMEDIA 2013, The Fifth InternationalConferences on Advances in Multimedia, Venice, Italy, 2013, International Academy, Research and Industry Association (IARIA), 2013, s. 136-141Konferansepaper, Oral presentation with published abstract (Fagfellevurdert)
Abstract [en]

Depth image based rendering (DIBR) plays an important role in producing virtual views using 3D-video formats such as video plus depth (V+D) and multi view-videoplus-depth (MVD). Pixel regions with non-defined values (due to disoccluded areas) are exposed when DIBR is used. In this paper, we propose a depth-based inpainting method aimed to handle Disocclusions in DIBR from V+D and MVD. Our proposed method adopts the curvature driven diffusion (CDD) model as a data term, to which we add a depth constraint. In addition, we add depth to further guide a directional priority term in the exemplar based texture synthesis. Finally, we add depth in the patch-matching step to prioritize background texture when inpainting. The proposed method is evaluated by comparing inpainted virtual views with corresponding views produced by three state-of-the-art inpainting methods as references. The evaluation shows the proposed method yielding an increased objective quality compared to the reference methods, and visual inspection further indicate an improved visual quality.

sted, utgiver, år, opplag, sider
International Academy, Research and Industry Association (IARIA), 2013
Emneord
video plus depth, warping, depth-image-based rendering, inpainting
HSV kategori
Identifikatorer
urn:nbn:se:miun:diva-18890 (URN)2-s2.0-84905842575 (Scopus ID)STC (Lokal ID)STC (Arkivnummer)STC (OAI)
Konferanse
Fifth International Conferences on Advances in Multimedia; MMEDIA 2013; Apr 21-26 2013; Venice, Italy
Tilgjengelig fra: 2013-05-04 Laget: 2013-05-04 Sist oppdatert: 2017-08-22bibliografisk kontrollert

Open Access i DiVA

fulltext(3722 kB)1070 nedlastinger
Filinformasjon
Fil FULLTEXT01.pdfFilstørrelse 3722 kBChecksum SHA-512
7649ce696773d93e54fe43f5b920e08d3673b0ec8bb09fae819eacbb687d413b7748e314c51bd251c841bfb7335d4df9cc67a2461eff4198adcc912d37653557
Type fulltextMimetype application/pdf

Personposter BETA

Muddala, Suryanarayana Murthy

Søk i DiVA

Av forfatter/redaktør
Muddala, Suryanarayana Murthy
Av organisasjonen

Søk utenfor DiVA

GoogleGoogle Scholar
Totalt: 1070 nedlastinger
Antall nedlastinger er summen av alle nedlastinger av alle fulltekster. Det kan for eksempel være tidligere versjoner som er ikke lenger tilgjengelige

isbn
urn-nbn

Altmetric

isbn
urn-nbn
Totalt: 1701 treff
RefereraExporteraLink to record
Permanent link

Direct link
Referera
Referensformat
  • apa
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • Annet format
Fler format
Språk
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Annet språk
Fler språk
Utmatningsformat
  • html
  • text
  • asciidoc
  • rtf