ZTE Communications ›› 2016, Vol. 14 ›› Issue (3): 55-59.doi: DOI:10.3969/j.issn.1673-5188.2016.03.007

• Research Paper • Previous Articles     Next Articles

Light Field Virtual View Rendering Based on EPI-Representations

SUN Yule and YU Lu   

  1. Department of Information Science & Electronic Engineering, Zhejiang University, Hangzhou 310007, China
  • Received:2015-11-15 Online:2016-08-01 Published:2019-11-29
  • About author:SUN Yule (sunyule@zju.edu.cn) received his BEng degree in information and communication engineering from Zhejiang University, China in 2015. He is currently completing his PhD degree at the Institute of Information and Communication Engineering, Zhejiang University. His research interests include 3D video processing and video coding.
    YU Lu (yul@zju.edu.cn) received her BEng degree in radio engineering and PhD degree in communication and electronic systems from Zhejiang University, China in 1991 and 1996. She is currently a professor at the Institute of Information and Communication Engineering, Zhejiang University. In 2002, she was a senior visiting scholar at the University of Hannover, German, supported by the China Scholarship Council and German Research Foundation. In 2004, she was a senior visiting scholar at the Chinese University of Hong Kong, supported by the United College Resident Fellow Scheme. She has published more than 100 technical papers and contributed more than 200 proposals to national and international standards. Her research interests include video coding, multimedia communication, and relative applicationspecific integrated circuit design. She is the chair of the Video Subgroup of the Audio Video Coding Standard (AVS) of China and was previously co-chair of the Implementation Subgroup of AVS.

Abstract: Image-Based Rendering (IBR) is one powerful approach for generating virtual views. It can provide convincing animations without an explicit geometric representation. In this paper, several implementations of light field rendering are summarized from prior arts. Several characteristics, such as the regular pattern in Epipolar Plane Images (EPIs), of light field are explored with detail under 1D parallel camera arrangement. It is proved that it is quite efficient to synthesize virtual views for Super Multi-View (SMV) application, which is in the third phase of Free - Viewpoint Television (FTV). In comparison with convolutional stereo matching method, in which the intermediate view is synthesized by the two adjacent views, light field rendering makes use of more views supplied to get the high-quality views.

Key words: depth estimate, Epipolar Plane Image (EPI), light field, view synthesis