Improving The Quality of Depth Image Based Rendering for 3D Video Systems

Zefeng Ni (1), Dong Tian (2), Sitaram Bhagavathy (2), Joan Llach (2) and B. S. Manjunath (1)
(1) Department of Electrical and Computer Engineering,
University of California, Santa Barbara
(2) Thomson Research Lab,
Princeton, New Jersey
zefeng_ni [at] umail.ucsb.edu, manj [at] ece.ucsb.edu

Abstract

In 3D Video (3DV) applications, a reduced number of views plus depth maps are transmitted or stored. When there is a need to render virtual views in between the actual views, the technique of depth image based rendering (DIBR) can be used to generate the intermediate views. To address the problem of noisy depth information in 3DV systems, we propose novel methods that can be easily incorporated into DIBR to improve synthesized image quality. These include: (1) a heuristic scheme with adaptive spatting that blends multiple warped reference pixels based on their depth, warped pixel positions and camera parameters; (2) an approximation of the first scheme with up-sampling for fast processing; (3) boundary only splatting; and (4) view weighting based on hole distribution. Experimental results show that the proposed methods can improve synthesis quality significantly.
[PDF] [BibTex]
Zefeng Ni, Dong Tian, Sitaram Bhagavathy, Joan Llach and B. S. Manjunath,
IEEE International Conference on Image Processing, 2009, pp. 513-516, Cairo, Egypt, Nov. 2009.
Node ID: 526 , DB ID: 333 , Lab: VRL , Target: Conference