软硬件协同实现 DQN-Hadamard
单像素成像的研究

doi:10.3969/j.issn.1007-5461.2022.06.010

量子电子学报 ›› 2022, Vol. 39 ›› Issue (6): 962-972.doi: 10.3969/j.issn.1007-5461.2022.06.010

• "光电探测与成像新技术及应用"专辑 • 上一篇下一篇

软硬件协同实现 DQN-Hadamard 单像素成像的研究

王之润1 , 何鹏1 , 赵文静1 , 翟爱平1 , 王东1,2∗

( 1 太原理工大学物理与光电工程学院, 山西太原 030024; 2 太原理工大学新型传感器与智能控制教育部重点实验室, 山西太原 030024 )

收稿日期:2022-06-23 修回日期:2022-07-28 出版日期:2022-11-28 发布日期:2022-12-14
通讯作者: E-mail: wangdong@tyut.edu.cn E-mail:E-mail: wangdong@tyut.edu.cn
作者简介:王之润 ( 1997 - ), 山东临沂人, 研究生, 主要从事单像素成像及其应用方面的研究。 E-mail: wangzhirun0839@link.tyut.edu.cn
基金资助:
Supported by International Scientific and Technological Cooperative Project in Shanxi Province (山西省国际科技合作项目, 202104041101009), Shanxi Scholarship Council of China (山西省回国留学人员科研资助项目, 2021-035), Natural Science Foundation of Shanxi Province of China (山西省自然科学基金, 202103021223091, 20210302123169)

Research on DQN-Hadamard single-pixel imaging with software and hardware cooperation

WANG Zhirun 1 , HE Peng 1 , ZHAO Wenjing 1 , ZHAI Aiping 1 , WANG Dong 1,2∗

( 1 College of Physics and Optoelectronics, Taiyuan University of Technology, Taiyuan 030024, China; 2 Key Laboratory of Advanced Transducers and Intelligent Control Systems, Ministry of Education and Shanxi Province, Taiyuan University of Technology, Taiyuan 030024, China )

Received:2022-06-23 Revised:2022-07-28 Published:2022-11-28 Online:2022-12-14

摘要/Abstract

摘要： 为在较低成本下解决单像素成像速度问题, 从硬件和算法两个层面提出解决方案, 搭建软硬件协同的单像素成像体系。算法层面在 Hadamard 单像素成像中引入 DQN 算法, 提出 DQN-Hadamard 单像素成像, 获得对特定目标物体的相对最优采样顺序。硬件层面基于 LED 阵列的高速低成本基底图案投射方案, 选择 ARM 与 FPGA 特性结合的 ZYNQ 7020 作为主控, 搭建 ARM 与 FPGA 协同的 Hadamard 单像素成像系统。最后结合算法与硬件, 完成 DQN-Hadamard 单像素成像在 ARM 与 FPGA 协同的 Hadamard 单像素成像系统的移植, 并与自适应斜 Z 字形采样单像素成像做了详细比较。成像结果显示, 所提方案在 30% 的采样率下即可重建目标物体图像, 验证了低成本软硬件协同单像素成像的可行性。

关键词: 单像素成像, ZYNQ, DQN, 低成本, 软硬件协同

Abstract: To speed up single pixel imaging at a low cost, solutions are proposed on the hardware and algorithm, so that a single pixel imaging system with software and hardware cooperation is built. On algorithm, DQN-Hadamard single pixel imaging is proposed by introducing DQN algorithm into Hadamard single pixel imaging, to obtain the relatively optimal sampling sequence for specific target objects. On hardware, based on the high-speed and low-cost pattern projection scheme using LED array, ZYNQ 7020, which combines the characteristics of ARM and FPGA, is selected as the controller to build a Hadamard single pixel imaging system with ARM and FPGA cooperation. Finally, combined with the algorithm and hardware, the transplantation of DQN-Hadamard single pixel imaging to the built Hadamard single pixel imaging system is completed. The imaging results are detailed compared with the results of the single pixel imaging using adaptive zig-zag sampling. The imaging results show that the target object can be reconstructed at the sampling rate of 30%, which verifies the feasibility of low-cost single-pixel imaging with software and hardware cooperation.

Key words: single-pixel imaging, ZYNQ, DQN, low-cost, hardware and software coordination

中图分类号:

TP391

王之润 , 何鹏 , 赵文静 , 翟爱平 , 王东, ∗. 软硬件协同实现 DQN-Hadamard 单像素成像的研究[J]. 量子电子学报, 2022, 39(6): 962-972.

WANG Zhirun , HE Peng , ZHAO Wenjing , ZHAI Aiping , WANG Dong , ∗. Research on DQN-Hadamard single-pixel imaging with software and hardware cooperation[J]. Chinese Journal of Quantum Electronics, 2022, 39(6): 962-972.

参考文献

[1] Edgar M, Gibson G M, Bowman R W, et al. Simultaneous real-time visible and infrared video with
single-pixel detectors [J]. Scientific Reports, 2015, 5(1): 1-8.
[2] Watts C M, Shrekenhamer D, Montota J, et al. Terahertz compressive imaging with metamaterial
spatial light modulators [J]. Nature Photonics, 2014, 8(8): 605-609.
[3] Huang J, Shi D. Multispectral computational ghost imaging with multiplexed illumination [J]. Journal of Optics, 2017, 19(7): 075701
[4] Zhao W, Chen H, Yuan Y, et al. Ultrahigh-speed color imaging with single-pixel detectors at low light level [J]. Physical Review Applied, 2019, 12(3): 034049.
[5] Radwell N, Mitchell K J, Gibson G M, et al. Single-pixel infrared and visible microscope [J]. Optica, 2014, 1(5): 285-289.
[6] Studer V, Bobin J, Chahid M, et al. Compressive fluorescence microscopy for biological and hyperspectral imaging [J]. Proceedings of the National Academy of Sciences, 2012, 109(26): E1679-E1687.
[7] Tajahuerce E, Duran V, Clemente P, et al. Image transmission through dynamic scattering media by single-pixel photodetection [J]. Optics Express, 2014, 22(14): 16945-16955.
[8] Ma H, Sang A, Zhou C, et al. A zigzag scanning ordering of four-dimensional Walsh basis for single-pixel imaging [J]. Optics Communications, 2019, 443: 69-75.
[9] Sun M J, Meng L T, Edgar M P, et al. A Russian Dolls ordering of the Hadamard basis for compressive single-pixel imaging [J]. Scientific Reports, 2017, 7(1): 1-7.
[10] Zhang Z, Wang X, Zheng G, et al. Hadamard single-pixel imaging versus Fourier single-pixel imaging [J]. Optics Express, 2017, 25(16): 19619-19639.
[11] Xu C, Zhai A, Zhao W, et al. Orthogonal single-pixel imaging using an adaptive under-Nyquist sampling method [J]. Optics Communications, 2021, 500: 127326.
[12] Su Jie, Zhai Aiping, Zhao Wenjing, et al. Hadamard single-pixel imaging using adaptive oblique zigzag sampling [J]. Acta Photonica Sinica, 2021, 50(3): 0311003.
苏杰,翟爱平,赵文静,等. 自适应斜Z字形采样Hadamard单像素成像 [J]. 光子学报, 2021, 50(3) 0311003.
[13] Higham C F, Murray-Smith R, Padgett M J, et al. Deep learning for real-time single-pixel video [J]. Scientific Reports, 2018, 8(1): 1-9.
[14] Lyu M, Wang W, Wang H, et al. Deep-learning-based ghost imaging [J]. Scientific Reports, 2017, 7(1): 1-6.
[15] Wang Z, Zhao W, Zhai A, et al. DQN based single-pixel imaging [J]. Optics Express, 2021, 29(10): 15463-15477.
[16] Wang Zhirun, Zhao Wenjing, Zhai Aiping, et al. Comparison on Performance of Deep Q Network based Single-pixel Imaging Using Different Orthogonal Transformations [J]. Acta Photonica Sinica, 2022, 51(3)：0311003.
王之润，赵文静，翟爱平，等. 不同正交变换深度Q网络单像素成像性能比较 [J]. 光子学报，2022，51(3): 0311003.
[17] Sun M J, Zhang J M. Single-pixel imaging and its application in three-dimensional reconstruction: A brief review [J]. Sensors, 2019, 19(3): 732.
[18] Thibault P, Dierolf M, Menzel A, et al. High-resolution scanning x-ray diffraction microscopy [J]. Science, 2008, 321(5887): 379-382.
[19] Zhao C, Gong W, Chen M, et al. Ghost imaging lidar via sparsity constraints [J]. Applied Physics Letters, 2012, 101(14): 141123.
[20] Bromberg Y, Katz O, Silberberg Y. Ghost imaging with a single detector [J]. Physical Review A, 2009, 79(5): 053840.
[21] Huang J, Shi D, Yuan K, et al. Computational-weighted Fourier single-pixel imaging via binary illumination [J]. Optics Express, 2018, 26(13): 16547-16559.
[22] Xu Z H, Chen W, Penuelas J, et al. 1000 fps computational ghost imaging using LED-based structured illumination [J]. Optics Express, 2018, 26(3): 2427-2434.

软硬件协同实现 DQN-Hadamard 单像素成像的研究

Research on DQN-Hadamard single-pixel imaging with software and hardware cooperation

PDF

可视化

摘要/Abstract

引用本文

使用本文

参考文献

相关文章 2

编辑推荐

Metrics

本文评价

[1]	郭岩, 何忆康, 李显业∗ , 孙宝清. 单像素复光场成像研究进展[J]. 量子电子学报, 2022, 39(6): 817-834.
[2]	李靖胡海芝. 散斑密度对单像素计算成像系统的影响分析[J]. J4, 2016, 33(2): 148-152.