ZTE

ZTE Communications ›› 2013, Vol. 11 ›› Issue (1): 11-16.

• Special Topic • Previous Articles     Next Articles

3D Perception Algorithms: Towards Perceptually Driven Compression of 3D Video

Ruimin Hu, Rui Zhong, Zhongyuan Wang, and Zhen Han   

  1. National Engineering Research Center for Multimedia Software, School of Computer, Wuhan University, Wuhan 430072, China
  • Received:2013-01-21 Online:2013-03-25 Published:2013-03-25
  • About author:Ruimin Hu (hrm1964@163.com) (M’09-SM’10) received his BS and MS degrees in communication and electronic systems from Nanjing University of Posts and Telecommunications in 1984 and 1990. He received his PhD degree in communications and electronic systems from Huazhong University of Science and Technology, Wuhan, in 2000. He is currently a professor at Wuhan University. He is also the associate dean of the School of Computer Science, Wuhan University, and Director of the National Engineering Research Center on Multimedia Software. His research interests include audio and video signal processing, multimedia network communication, security and surveillance technology, digital multimedia content management, and protection.

    Rui Zhong (zhongrui0824@126.com) received her MS degree in telecommunications engineering from Wuhan University, China, in 2008. She is currently a PhD student in the School of Computer Science, Wuhan University. Her research interests include video compression, 3D image processing, and multimedia communications.

    Zhongyuan Wang (wzy_hope@163.com) received his PhD degree in communication and information systems from Wuhan University, China, in 2008. He is currently an associate professor in the School of Computer Science, Wuhan University. He is directing two projects funded by the National Natural Science Foundation Program of China. His research interests include video compression, image processing, and multimedia communications.

    Zhen Han (hanzhen_2003@hotmail.com) received his PhD degree in communication and information systems from Wuhan University, China, in 2009. He is currently a lecturer in the School of Computer Science, Wuhan University and is directing a project funded by the National Natural Science Foundation Program of China. His research interests include image super-resolution, and multimedia communications.

3D Perception Algorithms: Towards Perceptually Driven Compression of 3D Video

Ruimin Hu, Rui Zhong, Zhongyuan Wang, and Zhen Han   

  1. National Engineering Research Center for Multimedia Software, School of Computer, Wuhan University, Wuhan 430072, China
  • 作者简介:Ruimin Hu (hrm1964@163.com) (M’09-SM’10) received his BS and MS degrees in communication and electronic systems from Nanjing University of Posts and Telecommunications in 1984 and 1990. He received his PhD degree in communications and electronic systems from Huazhong University of Science and Technology, Wuhan, in 2000. He is currently a professor at Wuhan University. He is also the associate dean of the School of Computer Science, Wuhan University, and Director of the National Engineering Research Center on Multimedia Software. His research interests include audio and video signal processing, multimedia network communication, security and surveillance technology, digital multimedia content management, and protection.

    Rui Zhong (zhongrui0824@126.com) received her MS degree in telecommunications engineering from Wuhan University, China, in 2008. She is currently a PhD student in the School of Computer Science, Wuhan University. Her research interests include video compression, 3D image processing, and multimedia communications.

    Zhongyuan Wang (wzy_hope@163.com) received his PhD degree in communication and information systems from Wuhan University, China, in 2008. He is currently an associate professor in the School of Computer Science, Wuhan University. He is directing two projects funded by the National Natural Science Foundation Program of China. His research interests include video compression, image processing, and multimedia communications.

    Zhen Han (hanzhen_2003@hotmail.com) received his PhD degree in communication and information systems from Wuhan University, China, in 2009. He is currently a lecturer in the School of Computer Science, Wuhan University and is directing a project funded by the National Natural Science Foundation Program of China. His research interests include image super-resolution, and multimedia communications.

PDF

Abstract: In this paper, we summarize 3D perception-oriented algorithms for perceptually driven 3D video coding. Several perceptual effects have been exploited for 2D video viewing; however, this is not yet the case for 3D video viewing. 3D video requires depth perception, which implies binocular effects such as con fl icts, fusion, and rivalry. A better understanding of these effects is necessary for 3D perceptual compression, which provides users with a more comfortable visual experience for video that is delivered over a channel with limited bandwidth. We present state-of-the-art of 3D visual attention models, 3D just-noticeable difference models, and 3D texture-synthesis models that address 3D human vision issues in 3D video coding and transmission.

Key words: 3D perception, 3D visual attention, 3D just-noticeable difference, 3D texture-synthesis, 3D video compression

摘要： In this paper, we summarize 3D perception-oriented algorithms for perceptually driven 3D video coding. Several perceptual effects have been exploited for 2D video viewing; however, this is not yet the case for 3D video viewing. 3D video requires depth perception, which implies binocular effects such as con fl icts, fusion, and rivalry. A better understanding of these effects is necessary for 3D perceptual compression, which provides users with a more comfortable visual experience for video that is delivered over a channel with limited bandwidth. We present state-of-the-art of 3D visual attention models, 3D just-noticeable difference models, and 3D texture-synthesis models that address 3D human vision issues in 3D video coding and transmission.

关键词: 3D perception, 3D visual attention, 3D just-noticeable difference, 3D texture-synthesis, 3D video compression