2D Viewpoint Synthesis Based on Hierarchical Clustering Integral Imaging System

Abstract

Abstract: An integral imaging system based on hierarchical clustering two-dimensional viewpoint synthesis is proposed. In this integral imaging system, a sparse viewpoint image is collected using a motorized translation stage combined with a single camera viewpoint collection method. In order to improve the efficiency of viewpoint collection, a two-dimensional virtual viewpoint synthesis method based on hierarchical clustering is used to realize virtual viewpoint synthesis between images, and the synthesized multi-viewpoint image is used to obtain an elemental image array through pixel mapping. By using pixel mapping to obtain elemental image array, the computational reconstruction process is achieved. Experimental results show that the system can not only meet the high-efficiency three-dimensional information collection, but also improve the resolution quality and increase the application flexibility while ensuring quality of the synthetic viewpoint.

Key words: integral imaging, sparse viewpoint acquisition, virtual viewpoint synthesis, elemental image array

CLC Number:

XING Yuhua, HU Xiaolong, YANG Chen∗. 2D Viewpoint Synthesis Based on Hierarchical Clustering Integral Imaging System[J]. Chinese Journal of Quantum Electronics, 2021, 38(1): 2-9.

References 20

[1]	Xiao X, Javidi B, Martinez-Corral M. Advances in three-dimensional integral imaging: Sensing, display, and applications
	[Invited] [J]. Applied Optics, 2013, 52(4): 546-560.
[2]	Piao Y, Wang Y. Integrated Stereo Imaging Technology [M]. Beijing: Publishing House of Electronics Industry, 2015: 14-20.
	朴燕, 王宇. 集成立体成像技术[M]. 北京: 电子工业出版社, 2015: 14-20.
[3]	Xing Y, Wang Q H. 3D information acquisition technology of integral imaging [J]. Infrared and Laser Engineering, 2020,
49	(3): 66-77.
	邢燕, 王琼华. 集成成像3D 信息获取技术[J]. 红外与激光工程, 2020, 49 (3): 66-77. [4] Xu J, Ming H. Enhanced depth extraction based on integral imaging with linear interpolation [J]. Chinese Journal of Quantum
	Electronics, 2012, 29(2): 135-141.
	徐晶, 明海. 基于集成成像的深度提取线性插值增强方法[J]. 量子电子学报, 2012, 29(2): 135-141.
[5]	Jang J S, Javid B. Improvement of viewing angle in integral imaging by use of moving lenslet arrays with low fill factor [J].
	Applied Optics, 2003, 42(11): 1996-2002.
[6]	Zhang J L, Wang X R, Wu X X, et al. Wide-viewing integral imaging using fiber-coupled monocentric lens array [J]. Optics
	Express, 2015, 23(18): 23339-23347.
[7]	Yang C, Wang J G, Javidi B, et al. Three-dimensional super resolution reconstruction by integral imaging [J]. Journal of
	Display Technology, 2015, 11(11): 947-952.
[8]	Kwon K C, Erdenebat M, Alam A, et al. Integral imaging microscopy with enhanced depth-of-field using a spatial multiplexing
[J]	Optics Express, 2016, 24(3): 2072-2083.
[9]	Chen K M, Li X N, Huang X Q, et al. Mathematical model for integral imaging system using curved pick-up method [J]. Optik,
20	19, 194: 163026.
[10]	Okaichin N, Arai J, Mishina T. Integral three-dimensional capture system with enhanced viewing angle by using camera array
[C]	Proceedings of SPIE, 2015, 9391: 939106.
[11]	Xing Y, Xiong Z L, Zhao M, et al. Real-time integral imaging pickup system using camera array [C]. Advances in Display
	Technologies VIII, 2018, 10556: 105560D.
[12]	LYU Y Z, Wang S G, Ren G X, et al. Two dimensional multiview image array pickup and virtual viewpoint image synthesis
	algorithm [J]. Journal of Harbin Engineering University, 2013, 34 (6): 763-795.
	吕源治, 王世刚, 任广旭, 等. 二维多视点图像阵列采集及虚拟视点合成算法[J]. 哈尔滨工程大学学报, 2013, 34(6):
76	3-795.
[13]	Hui R, Qiong-Hua W, Yan X, et al. Super-multiview integral imaging scheme based on sparse camera array and CNN superresolution
[J]	Applied Optics, 2019, 58(5): A190-A196.
[14]	Ahn I, Kim C. A novel depth-based virtual view synthesis method for free viewpoint video [J]. IEEE Transactions on Broadcasting,
20	13, 59(4): 614-626.
[15]	Nguyen T, Dai J. View synthesis with hierarchical clustering based occlusion filling [C]. Image Processing, IEEE International
	Conference, 2017: 1387-1391.
[16]	Park J H, Kim J, Lee B. Three-dimensional optical correlator using a sub-image array [J]. Optics Express, 2005, 13(13): 5116-
	5126.
[17]	Park J H, Jung S, Choi H, et al. Depth extraction by use of a rectangular lens array and one-dimensional elemental image
	modification [J]. Applied Optics, 2004, 43(25): 4882-4895.
[18]	Tanimoto M, Fujii T, Suzuki K. Software for view synthesis [OL]. http://www.fujii.nuee.nagoya-u.ac.jp/multiviewdata/
	mpeg2/VS.htm.
[19]	Jing L, Chun-Peng F, Zhao-QiW, et al. View synthesis with 3D object segmentation-based asynchronous blending and boundary
	misalignment rectification [J]. Visual Computer, 2016, 32: 989-999.
[20]	Hong S, Jang J, Javid B. Three-dimensional volumetric object reconstruction using computational integral imaging [J]. Optical
	Express, 2004, 12: 483-491.