Remote situational intelligent sensing system for human-machine integration [人机共融的远程态势智能感知系统]

作者：Niu W.; Fan M.; Li Y.; Peng X.^*; Xie W.; Ren J.; Yang Z.

来源：Journal of National University of Defense Technology, 2021, 43(6): 85-94.

DOI：10.11887/j.cn.202106011

• 3D scene reconstruction
• Augmented reality
• Collaborative positioning
• Human-machine integration
• Remote situational awareness

Aiming at the urgent need for human and remote unmanned devices to cooperate precisely and accurately, a remote situational awareness system of human-machine integration was proposed based on the robot operating system, and experiments and analysis were carried out. Based on visual positioning technology, with the integration of human-machine perception as the breakthrough point, through real-time 3D scene reconstruction technology and scene consistency fusion method, the environment and target information detected by unmanned equipment were 3D reconstructed. The result was consistent and fused with the human visual information, and displayed by the augmented reality device, realizing the coordinated positioning between the remote unmanned device and the augmented reality device worn by the person without GPS. The experimental results show that the system has better performance at close range. The accuracy of human-machine coordinated positioning is gradually reduced as the distance increases. The proposed system makes the unmanned device an extension of the human eye, realizing the ability to penetrate obstacles, and crosses the sight distance without interfering with the normal movement of personnel. It can play an important role in future information operations.

• 单位
  中国科学院大学