Multi-View Structured Light 3D Measurement System

doi:10.12142/ZTECOM.202404008

ZTE Communications ›› 2024, Vol. 22 ›› Issue (4): 53-58.DOI: 10.12142/ZTECOM.202404008

• Research Papers • Previous Articles Next Articles

Multi-View Structured Light 3D Measurement System

LU Ping¹, ZHANG Yingjie², DENG Fangwei¹, LIU Wei²(), HUANG Shijun¹

^1.ZTE Corporation, Shenzhen 518057, China
^2.Southern University of Science and Technology, Shenzhen 513000, China

Received:2023-10-22 Online:2024-12-20 Published:2024-12-03
About author:LU Ping is the deputy president of ZTE Corporation, where he is also the general manager of the Industrial Digitalization Solution Dept., and the executive deputy director of State Key Laboratory of Mobile Network and Mobile Multimedia Technology. His research interests include cloud computing, big data, augmented reality, and multimedia service-based technologies. He has supported and participated in multiple major national science and technology projects and national science and technology support projects. He has published multiple papers and authored two books.
ZHANG Yingjie is a second year graduate student at Southern University of Science and Technology, China, with research interests in machine vision and 3D structured light technology.
DENG Fangwei is the product director of the Industry Digital Solution Department of ZTE Corporation. His research direction is to provide industry digital bases and mobile robots for industrial digital transformation, as well as supporting products.
LIU Wei (liuw2@sustech.edu.cn) is a research professor with Southern University of Science and Technology, China. His research focuses on robotic perception, such as sensing, tracking, localization and navigation.
HUANG Shijun is a senior strategic planner at ZTE Corporation. His research interests include machine vision, artificial intelligence, computer vision and deep learning.
Supported by:
the 2023 Guangdong Basic and Applied Basic Research Fund Regional Joint Fund Key Project(2023B1515120017);2023 Key Project of Guangdong Provincial Department of Education for General Universities(2023ZDZX3024);ZTE Industry?University?Institute Cooperation Funds(K2133Z167)

Abstract

Abstract:

Vision-based measurement technology benefits high-quality manufacturers through improved dimensional precision, enhanced geometric tolerance, and increased product yield. The monocular 3D structured light visual sensing method is popular for detecting online parts since it can reach micron-meter depth accuracy. However, the line-of-sight requirement of a single viewpoint vision system often fails when hiding occurs due to the object’s surface structure, such as edges, slopes, and holes. To address this issue, a multi-view 3D structured light vision system is proposed in this paper to achieve high accuracy, i.e., Z-direction repeatability, and reduce hiding probability during mechanical dimension measurement. The main contribution of this paper includes the use of industrial cameras with high resolution and high frame rates to achieve high-precision 3D reconstruction. Moreover, a multi-wavelength (heterodyne) phase expansion method is employed for high-precision phase calculation. By leveraging multiple industrial cameras, the system overcomes field of view occlusions, thereby broadening the 3D reconstruction field of view. Finally, the system achieves a Z-axis repetition accuracy of 0.48 μm.

Key words: 3D measurement, structured light, multi-view

LU Ping, ZHANG Yingjie, DENG Fangwei, LIU Wei, HUANG Shijun. Multi-View Structured Light 3D Measurement System[J]. ZTE Communications, 2024, 22(4): 53-58.

Figures/Tables 5

References 12

1	HOCKEN R J, PEREIRA P H. Coordinate measuring machines and systems, second edition [M]. Boca Raton: CRC Press, 2011
2	KUNZMANN H, TRAPET E, WÄLDELE F. A uniform concept for calibration, acceptance test, and periodic inspection of coordinate measuring machines using reference objects [J]. CIRP annals, 1990, 39(1): 561–564. DOI: 10.1016/s0007-8506(07)61119-6
3	EI-HAKIM S F, BERALDIN J A, BLAIS F. Comparative evaluation of the performance of passive and active 3D vision systems [C]//Digital Photogrammetry and Remote Sensing'95. SPIE, 1995: 14–25. DOI: 10.1117/12.227862
4	VILAÇA J L, FONSECA J C, PINHO A M. Calibration procedure for 3D measurement systems using two cameras and a laser line [J]. Optics & laser technology, 2009, 41(2): 112–119. DOI: 10.1016/j.optlastec.2008.05.012
5	GENG J. Structured-light 3D surface imaging: a tutorial [J]. Advances in optics and photonics, 2011, 3(2): 128. DOI: 10.1364/aop.3.000128
6	MOTTA J M S T, DE CARVALHO G C, MCMASTER R S. Robot calibration using a 3D vision-based measurement system with a single camera [J]. Robotics and computer-integrated manufacturing, 2001, 17(6): 487–497. DOI: 10.1016/s0736-5845(01)00024-2
7	GALLUCCI A, ZNAMENSKIY D, PETKOVIC M. Prediction of 3D body parts from face shape and anthropometric measurements [J]. Journal of image and graphics, 2020, 8(3): 67–77. DOI: 10.18178/joig.8.3.67-74
8	FURUNO T, FUJITA S, WANG D H, et al. 3D bow and posture measurements for virtual reality customer service training system [J]. Journal of image and graphics, 2021, 9(4): 152–156. DOI: 10.18178/joig.9.4.152-156
9	AILANI V, PRAKASH D, VENKATESH K S. Self localization with edge detection in 3D space [J]. Journal of image and graphics, 2013, 1(2): 99–103. DOI: 10.12720/joig.1.2.99-103
10	LEE H M, CHOI W C. Algorithm of 3D spatial coordinates measurement using a camera image [J]. Journal of image and graphics, 2015, 3(1): 30–33. DOI: 10.18178/joig.3.1.30-33
11	HU H H, GAO J, ZHOU H Y, et al. A combined binary defocusing technique with multi-frequency phase error compensation in 3D shape measurement [J]. Optics and lasers in engineering, 2020, 124: 105806. DOI: 10.1016/j.optlaseng.2019.105806
12	ZHANG Z. A flexible new technique for camera calibration [J]. IEEE transactions on pattern analysis and machine intelligence, 2000, 22(11): 1330–1334. DOI: 10.1109/34.888718

Tested Objects	Our Method/mm	Our Method RMS/mm	CMM/mm	CMM RMS/mm	M051090/mm	M051090 RMS/mm
Cellphone middle frame	0.446 5	0.001 53	0.454 0	0.000 82	0.447 1	0.001 85
	0.444 7		0.455 2		0.448 4
	0.445 0		0.453 4		0.447 8
	0.444 3		0.453 4		0.446 3
	0.448 0		0.453 2		0.447 9
Ceramic ball	19.993 4	0.000 15	20.004 5	0.000 04	20.014 5	0.000 31
	19.993 7		20.004 5		20.015 6
	19.993 6		20.004 6		20.015 3
	19.993 8		20.004 5		20.016 1
	19.993 6		20.004 5		20.016 4
PCB 1	7.226 2	0.015 15	7.258 8	0.007 81	7.296 6	0.017 21
	7.259 2		7.263 0		7.272 4
	7.238 2		7.257 2		7.282 8
	7.228 0		7.274 5		7.299 8
PCB 2	7.304 9	0.040 76	7.302 8	0.030 59	7.328 9	0.044 17
	7.259 2		7.326 0		7.381 2
	7.311 9		7.372 9		7.398 9
	7.358 8		7.352 4		7.415 9

Tested Objects	Our Method/mm	Our Method RMS/mm	CMM/mm	CMM RMS/mm	M051090/mm	M051090 RMS/mm
Cellphone middle frame	0.446 5	0.001 53	0.454 0	0.000 82	0.447 1	0.001 85
	0.444 7		0.455 2		0.448 4
	0.445 0		0.453 4		0.447 8
	0.444 3		0.453 4		0.446 3
	0.448 0		0.453 2		0.447 9
Ceramic ball	19.993 4	0.000 15	20.004 5	0.000 04	20.014 5	0.000 31
	19.993 7		20.004 5		20.015 6
	19.993 6		20.004 6		20.015 3
	19.993 8		20.004 5		20.016 1
	19.993 6		20.004 5		20.016 4
PCB 1	7.226 2	0.015 15	7.258 8	0.007 81	7.296 6	0.017 21
	7.259 2		7.263 0		7.272 4
	7.238 2		7.257 2		7.282 8
	7.228 0		7.274 5		7.299 8
PCB 2	7.304 9	0.040 76	7.302 8	0.030 59	7.328 9	0.044 17
	7.259 2		7.326 0		7.381 2
	7.311 9		7.372 9		7.398 9
	7.358 8		7.352 4		7.415 9

Multi-View Structured Light 3D Measurement System

RichHTML

PDF

Knowledge

Abstract

Cite this article

share this article

Figures/Tables 5

References 12

Related Articles 0

Recommended Articles

Metrics