基于分层聚类二维视点合成的集成成像系统

量子电子学报 ›› 2021, Vol. 38 ›› Issue (1): 2-9.

基于分层聚类二维视点合成的集成成像系统

邢毓华, 胡晓龙, 杨琛∗

西安理工大学自动化与信息工程学院, 陕西西安710048

收稿日期:2020-04-26 修回日期:2020-08-11 出版日期:2021-01-28 发布日期:2021-02-01
通讯作者: E-mail:yangchen@xaut.edu.cn E-mail:yangchen@xaut.edu.cn
作者简介:邢毓华( 1966 - ), 陕西西安人, 硕士, 副教授, 硕士生导师, 主要从事大数据及物联网通信技术等方面的研究。 E-mail: xyh@xaut.edu.cn
基金资助:
Supported by National Natural Science Foundation of China (国家自然科学基金, 61705179), Shaanxi Provincial Department of Education Natural Science Special Project (陕西省教育厅自然科学专项, 17JK0536)

2D Viewpoint Synthesis Based on Hierarchical Clustering Integral Imaging System

XING Yuhua, HU Xiaolong, YANG Chen∗

School of Automation and Information Engineering, Xi’an University of Technology, Xi’an 710048, China

Received:2020-04-26 Revised:2020-08-11 Published:2021-01-28 Online:2021-02-01

摘要/Abstract

摘要： 提出了一种基于分层聚类二维视点合成的集成成像系统。在该集成成像系统中, 采用电动平移台结合单个相机的视点采集方式采集稀疏视点图像; 为提高视点采集效率, 使用基于分层聚类二维虚拟视点合成方法实现图像间的虚拟视点合成, 并利用合成的多视点图像通过像素映射得到微单元图像阵列; 利用像素映射得到微单元图像阵列, 实现计算重建过程。实验结果表明该系统不仅可以满足高效率的三维信息采集, 而且在保证合成视点质量的同时还提高了分辨率质量, 增加了集成成像应用的灵活性。

关键词: 集成成像, 稀疏视点采集, 虚拟视点合成, 微单元图像阵列

Abstract: An integral imaging system based on hierarchical clustering two-dimensional viewpoint synthesis is proposed. In this integral imaging system, a sparse viewpoint image is collected using a motorized translation stage combined with a single camera viewpoint collection method. In order to improve the efficiency of viewpoint collection, a two-dimensional virtual viewpoint synthesis method based on hierarchical clustering is used to realize virtual viewpoint synthesis between images, and the synthesized multi-viewpoint image is used to obtain an elemental image array through pixel mapping. By using pixel mapping to obtain elemental image array, the computational reconstruction process is achieved. Experimental results show that the system can not only meet the high-efficiency three-dimensional information collection, but also improve the resolution quality and increase the application flexibility while ensuring quality of the synthetic viewpoint.

Key words: integral imaging, sparse viewpoint acquisition, virtual viewpoint synthesis, elemental image array

中图分类号:

邢毓华, 胡晓龙, 杨琛∗. 基于分层聚类二维视点合成的集成成像系统[J]. 量子电子学报, 2021, 38(1): 2-9.

XING Yuhua, HU Xiaolong, YANG Chen∗. 2D Viewpoint Synthesis Based on Hierarchical Clustering Integral Imaging System[J]. Chinese Journal of Quantum Electronics, 2021, 38(1): 2-9.

参考文献 20

[1]	Xiao X, Javidi B, Martinez-Corral M. Advances in three-dimensional integral imaging: Sensing, display, and applications
	[Invited] [J]. Applied Optics, 2013, 52(4): 546-560.
[2]	Piao Y, Wang Y. Integrated Stereo Imaging Technology [M]. Beijing: Publishing House of Electronics Industry, 2015: 14-20.
	朴燕, 王宇. 集成立体成像技术[M]. 北京: 电子工业出版社, 2015: 14-20.
[3]	Xing Y, Wang Q H. 3D information acquisition technology of integral imaging [J]. Infrared and Laser Engineering, 2020,
49	(3): 66-77.
	邢燕, 王琼华. 集成成像3D 信息获取技术[J]. 红外与激光工程, 2020, 49 (3): 66-77. [4] Xu J, Ming H. Enhanced depth extraction based on integral imaging with linear interpolation [J]. Chinese Journal of Quantum
	Electronics, 2012, 29(2): 135-141.
	徐晶, 明海. 基于集成成像的深度提取线性插值增强方法[J]. 量子电子学报, 2012, 29(2): 135-141.
[5]	Jang J S, Javid B. Improvement of viewing angle in integral imaging by use of moving lenslet arrays with low fill factor [J].
	Applied Optics, 2003, 42(11): 1996-2002.
[6]	Zhang J L, Wang X R, Wu X X, et al. Wide-viewing integral imaging using fiber-coupled monocentric lens array [J]. Optics
	Express, 2015, 23(18): 23339-23347.
[7]	Yang C, Wang J G, Javidi B, et al. Three-dimensional super resolution reconstruction by integral imaging [J]. Journal of
	Display Technology, 2015, 11(11): 947-952.
[8]	Kwon K C, Erdenebat M, Alam A, et al. Integral imaging microscopy with enhanced depth-of-field using a spatial multiplexing
[J]	Optics Express, 2016, 24(3): 2072-2083.
[9]	Chen K M, Li X N, Huang X Q, et al. Mathematical model for integral imaging system using curved pick-up method [J]. Optik,
20	19, 194: 163026.
[10]	Okaichin N, Arai J, Mishina T. Integral three-dimensional capture system with enhanced viewing angle by using camera array
[C]	Proceedings of SPIE, 2015, 9391: 939106.
[11]	Xing Y, Xiong Z L, Zhao M, et al. Real-time integral imaging pickup system using camera array [C]. Advances in Display
	Technologies VIII, 2018, 10556: 105560D.
[12]	LYU Y Z, Wang S G, Ren G X, et al. Two dimensional multiview image array pickup and virtual viewpoint image synthesis
	algorithm [J]. Journal of Harbin Engineering University, 2013, 34 (6): 763-795.
	吕源治, 王世刚, 任广旭, 等. 二维多视点图像阵列采集及虚拟视点合成算法[J]. 哈尔滨工程大学学报, 2013, 34(6):
76	3-795.
[13]	Hui R, Qiong-Hua W, Yan X, et al. Super-multiview integral imaging scheme based on sparse camera array and CNN superresolution
[J]	Applied Optics, 2019, 58(5): A190-A196.
[14]	Ahn I, Kim C. A novel depth-based virtual view synthesis method for free viewpoint video [J]. IEEE Transactions on Broadcasting,
20	13, 59(4): 614-626.
[15]	Nguyen T, Dai J. View synthesis with hierarchical clustering based occlusion filling [C]. Image Processing, IEEE International
	Conference, 2017: 1387-1391.
[16]	Park J H, Kim J, Lee B. Three-dimensional optical correlator using a sub-image array [J]. Optics Express, 2005, 13(13): 5116-
	5126.
[17]	Park J H, Jung S, Choi H, et al. Depth extraction by use of a rectangular lens array and one-dimensional elemental image
	modification [J]. Applied Optics, 2004, 43(25): 4882-4895.
[18]	Tanimoto M, Fujii T, Suzuki K. Software for view synthesis [OL]. http://www.fujii.nuee.nagoya-u.ac.jp/multiviewdata/
	mpeg2/VS.htm.
[19]	Jing L, Chun-Peng F, Zhao-QiW, et al. View synthesis with 3D object segmentation-based asynchronous blending and boundary
	misalignment rectification [J]. Visual Computer, 2016, 32: 989-999.
[20]	Hong S, Jang J, Javid B. Three-dimensional volumetric object reconstruction using computational integral imaging [J]. Optical
	Express, 2004, 12: 483-491.