阅读说明：本技术 一种采集三维音视频及运动姿态的装置及方法 (Device and method for acquiring three-dimensional audio and video and motion gestures ) 是由 戴永峰 于 2020-06-15 设计创作，主要内容包括：本发明涉及音视频采集装置,具体涉及一种采集三维音视频及运动姿态的装置及方法,包括壳体、摄像头、声音采集器、电子罗盘、6轴运动跟踪计、TOF数据采集装置、气压计、控制器、存储器和电源管理单元,电子罗盘以及6轴运动跟踪计采集装置的运动姿态数据,摄像头、声音采集器、TOF数据采集装置以及气压计均安装在壳体上,声音采集器以及摄像头分别采集音视频数据,TOF数据采集装置采集三维深度图像,摄像头、声音采集器、TOF数据采集装置、气压计、电子罗盘、6轴运动跟踪计以及存储器均与控制器链接,电源管理单元为其他元件供电。本发明的实质性效果是：适合搭载在移动载体上工作,扩展了音视频采集装置的使用范围。(The invention relates to an audio and video acquisition device, in particular to a device and a method for acquiring three-dimensional audio and video and a motion attitude, which comprise a shell, a camera, a sound collector, an electronic compass, a 6-axis motion tracker, a TOF data acquisition device, a barometer, a controller, a memory and a power management unit, wherein the electronic compass and the 6-axis motion tracker acquire motion attitude data of the device, the camera, the sound collector, the TOF data acquisition device and the barometer are all arranged on the shell, the sound collector and the camera respectively acquire audio and video data, the TOF data acquisition device acquires three-dimensional depth images, the camera, the sound collector, the TOF data acquisition device, the barometer, the electronic compass, the 6-axis motion tracker and the memory are all linked with the controller, and the power management unit supplies power to other elements. The substantial effects of the invention are as follows: the audio and video acquisition device is suitable for being carried on a mobile carrier to work, and the application range of the audio and video acquisition device is expanded.)

1. A device for collecting three-dimensional audio and video and motion gestures, which is characterized in that,

including casing, camera, sound collection station, electron compass, 6 axis motion tracker, TOF data collection system, barometer, controller, memory and power management unit, electron compass, 6 axis motion tracker, controller, memory and power management unit all install in the casing, electron compass and 6 axis motion tracker collection system's motion gesture data, camera, sound collection station, TOF data collection system and barometer all install on the casing, the barometer detects the atmospheric pressure of the each side of casing, sound collection station and camera gather audio and video data respectively, TOF data collection system gathers three-dimensional depth image, camera, sound collection station, TOF data collection system, barometer, electron compass, 6 axis motion tracker and memory all link with the controller, the power management unit supplies power to other elements.

2. The device for acquiring the three-dimensional audio and video and the motion gesture according to claim 1,

TOF data acquisition device includes TOF data acquisition controller, TOF sensor, infrared emitting diode and TOF equipment treater, infrared emitting diode inlays on the casing, infrared emitting diode is to emission infrared light in the place ahead, TOF sensor receives the reverberation of the infrared light of TOF sensor transmission, TOF sensor and infrared emitting diode all are connected with TOF data acquisition controller, TOF data acquisition controller is connected with TOF equipment treater, TOF equipment treater is connected with the controller.

3. The device for acquiring the three-dimensional audio and video and the motion gesture according to the claim 1 or 2,

the USB-HUB controller is characterized by further comprising a USB interface and a USB-HUB, wherein the USB-HUB is installed in the shell, the USB interface is installed on the shell and connected with the USB-HUB, and the USB-HUB is linked with the controller.

4. The device for acquiring the three-dimensional audio and video and the motion gesture according to the claim 1 or 2,

the memory comprises an EEPROM and a high-speed memory, and the EEPROM and the high-speed memory are connected with the controller.

5. The device for acquiring the three-dimensional audio and video and the motion gesture according to claim 2,

the casing outside is provided with a plurality of infrared emission window and pilot lamp, infrared emitting diode has a plurality ofly, and a plurality of infrared emitting diode install respectively in infrared emission window, and a plurality of infrared emitting diode transmitting direction are different, the pilot lamp is connected with the controller.

6. The device for acquiring the three-dimensional audio and video and the motion gesture according to the claim 1 or 2,

the sound collector comprises a plurality of digital microphones and a digital signal processor, the digital microphones are arranged on the shell side by side and located below the camera, sound collecting holes corresponding to the digital microphones are formed in the shell, the digital microphones are connected with the digital signal processor, and the digital signal processor is connected with the controller.

7. The device for acquiring the three-dimensional audio and video and the motion gesture according to claim 6,

sound collector still includes at least three spring and elastic diaphragm, and is three spring one end ground connection, it is three the spring other end is connected with the controller respectively, the sound collecting hole inboard of casing is equipped with solid fixed ring, the elastic diaphragm is one end confined tube-shape, the elastic diaphragm open end is connected with solid fixed ring, digital microphone installs at the elastic diaphragm blind end, the elastic diaphragm blind end is with three the one end of spring is connected, and is three the spring other end is along equidirectional and casing fixed connection.

8. A method for acquiring three-dimensional audio-video and motion gestures by using the device for acquiring three-dimensional audio-video and motion gestures according to any one of claims 1 to 7,

the method comprises the following steps:

recording the movement direction and the acceleration of the device through an electronic compass and a 6-axis movement tracker, and calculating the movement speed of the device through the movement direction and the acceleration;

the TOF data acquisition device obtains and records depth data of surrounding environment in real time, the depth data is used for generating a three-dimensional depth picture, when the device is static, the possible direction of a sound source is identified through the change of the three-dimensional depth picture, and then directional enhancement is carried out by using parallel digital microphones to obtain clearer audio signals.

Technical Field

The invention relates to an audio and video acquisition device, in particular to a device and a method for acquiring three-dimensional audio and video and motion gestures.

Background

With the development of high-speed application of artificial intelligence technology, the face recognition technology surrounding human identity confirmation and the voice positioning recognition technology of confirmation personnel are applied more and more, various face recognition and voice recognition module devices are also appeared successively, for the application of the biological feature safety recognition based on the human body, on one hand, the intelligent handling requirements of some businesses can be met, on the other hand, the effect of effectively verifying the three-dimensional features and the real identity of a person entity cannot be achieved due to the fact that more products of the face recognition module are represented by a camera, the acquired image is planar image or video information, and the information does not contain three-dimensional data of the face, and is easy to be utilized and deceived by lawbreakers. Meanwhile, the face acquisition cameras do not have the capability of directionally acquiring voice, even if the voice acquired by the microphone is influenced by environmental noise reduction, the application requirements of scenes needing voice recognition and voice directional functions cannot be met, and a microphone voice acquisition array module has to be added, so that two physically independent different module devices are formed, the two modules are inconvenient to integrate and apply, and the application cost is increased.

Chinese patent CN105282516A, published 2016, 1, 27, a video/audio track return system for a rotorcraft, which comprises a camera device, a video/audio transmitter, a camera servo system, a video/audio receiver, a head tracking function monitor, a network data processor and a mobile terminal, wherein the camera device, the video/audio transmitter and the camera servo system are installed on the rotorcraft, and the video/audio receiver, the head tracking function monitor, the network data processor and the mobile terminal are located on the ground. The system provided by the system is installed on the rotorcraft, can realize the return of the video/audio to the ground, can check the video, the audio and the flight path of the rotorcraft on a monitor, a mobile terminal and the Internet, and has low requirements on the operation skills of operators. However, although the technical scheme can only collect audio and video signals, the motion data cannot be collected at the same time, and the definition of the collected audio and video signals, especially the audio signals, is not good enough.

Disclosure of Invention

The technical problem to be solved by the invention is as follows: the current audio and video acquisition device has single function. A device and a method for acquiring three-dimensional audio and video and motion gestures are provided. The device can collect abundant field data, is suitable to be carried on a mobile carrier to work, and expands the application range of the audio and video acquisition device.

In order to solve the technical problems, the technical scheme adopted by the invention is as follows: a device for collecting three-dimensional audio and video and motion postures comprises a shell, a camera, a sound collector, an electronic compass, a 6-axis motion tracker, a TOF data collecting device, a barometer, a controller, a storage and a power management unit, wherein the electronic compass, the 6-axis motion tracker, the controller, the storage and the power management unit are all installed in the shell, the motion posture data of the electronic compass and the 6-axis motion tracker collecting device are collected by the electronic compass and the 6-axis motion tracker collecting device, the camera, the sound collector, the TOF data collecting device and the barometer are all installed on the shell, the barometer detects the air pressure in each direction of the shell, the sound collector and the camera respectively collect audio and video data, the TOF data collecting device collects three-dimensional depth images, and the camera, the sound collector, the TOF data collecting device, the barometer, the electronic compass, the 6-axis motion tracker and the storage are all linked with the, the power management unit supplies power to other elements. The TOF data acquisition device can acquire depth information, stores the depth information and audio and video information in a time axis in a correlated manner, can facilitate subsequent equipment to extract information, and measures X, Y, Z triaxial angular velocity and X, Y, Z triaxial acceleration of the device in a motion-removing state through a 6-axis motion tracker sensor. The azimuth and direction of the device are measured by an electronic compass sensor. Through the acquisition of the information, the whole device can simultaneously supplement the position, the direction, the moving state and the altitude information of the current acquisition device on the basis of acquiring the audio and video information, and improve the data enrichment, so that the device has richer functions and wider application range.

Preferably, the TOF data acquisition device comprises a TOF data acquisition controller, a TOF sensor, an infrared light emitting diode and a TOF equipment processor, wherein the infrared light emitting diode is embedded on the shell, the infrared light emitting diode emits infrared light forward, the TOF sensor receives reflected light of the infrared light emitted by the TOF sensor, the TOF sensor and the infrared light emitting diode are both connected with the TOF data acquisition controller, the TOF data acquisition controller is connected with the TOF equipment processor, and the TOF equipment processor is connected with the TOF equipment processor. By generating high frequency pulses to be applied to the IR-LED to generate invisible infrared light irradiation, the wavelength of the infrared light is about 850nm generally, if the emitted infrared light meets people and environmental objects in the irradiation direction, reflection can be formed, the TOF data acquisition controller can receive the information by using the TOF image receiving sensor, and then the actual distance length is calculated according to the time length of the transmitted and received infrared reflection information, so that a complete depth 3D image can be formed.

Preferably, the USB-HUB controller further comprises a USB interface and a USB-HUB, wherein the USB-HUB is installed in the shell, the USB interface is installed on the shell, the USB interface is connected with the USB-HUB, and the USB-HUB is linked with the controller. And the USB interface is converged with the USB-HUB, so that the communication interaction of USB data is realized.

Preferably, the memory comprises an EEPROM and a high-speed memory, and the EEPROM and the high-speed memory are both connected with the controller.

Preferably, a plurality of infrared emission windows and indicator lamps are arranged on the outer side of the shell, the infrared light-emitting diodes are provided with a plurality of infrared light-emitting diodes, the infrared light-emitting diodes are respectively installed in the infrared emission windows, the emission directions of the infrared light-emitting diodes are different, and the indicator lamps are connected with the controller. The multiple infrared emission windows can improve the acquisition efficiency of the depth image.

Preferably, the sound collector comprises a plurality of digital microphones and a digital signal processor, the digital microphones are arranged on the shell side by side and located below the camera, sound collecting holes corresponding to the digital microphones are formed in the shell, the digital microphones are connected with the digital signal processor, and the digital signal processor is connected with the controller. The multiple microphones can support the digital directional acquisition technology in the prior art, and the functions of the device are enriched.

As preferred, sound collector still includes at least three spring and elastic membrane, and is three spring one end ground connection, it is three the spring other end is connected with the controller respectively, the sound collecting hole inboard of casing is equipped with solid fixed ring, the elastic membrane is one end confined tube-shape, the elastic membrane open end is connected with solid fixed ring, digital microphone installs at the elastic membrane blind end, the elastic membrane blind end is with three the one end of spring is connected, and is three the spring other end is along equidirectional and casing fixed connection. The elastic membrane can play the effect of concentrated sound, and the spring can change the degree of collection sound, through controller pin periodic output 0 or 1, adopts the mode of PMW to change the equivalent current through the spring, can change the tensile length of elastic membrane through the spring, changes the opening angle of collection sound, and the orientation of elastic membrane can be changed to the different shrinkage of three spring, finely tunes the direction that the audio frequency was gathered.

A method for acquiring three-dimensional audio and video and motion gestures by using the device for acquiring three-dimensional audio and video and motion gestures comprises the following steps: recording the movement direction and the acceleration of the device through an electronic compass and a 6-axis movement tracker, and calculating the movement speed of the device through the movement direction and the acceleration; the TOF data acquisition device obtains and records depth data of surrounding environment in real time, the depth data is used for generating a three-dimensional depth picture, when the device is static, the possible direction of a sound source is identified through the change of the three-dimensional depth picture, and then directional enhancement is carried out by using parallel digital microphones to obtain clearer audio signals.

The substantial effects of the invention are as follows: on the basis of obtaining audio and video information, motion removing posture information such as the position, the direction, the moving state, the altitude and the like of the current acquisition device can be obtained simultaneously, the device is suitable for being carried on a moving carrier to work, data acquisition carried out simultaneously by audio and video acquisition is enriched, field information can be mastered more accurately, the application range of the audio and video acquisition device is expanded, and the device has wide application prospects in intelligent equipment, artificial intelligent identification, automobile unmanned driving, human body interactive identification, robot intelligent walking and the like.

Drawings

FIG. 1 is a schematic diagram of a component connection according to an embodiment.

FIG. 2 is a schematic structural diagram of an embodiment.

Fig. 3 is a schematic diagram of a digital microphone according to an embodiment.

Wherein: 1. camera, 2, TOF data acquisition controller, 3, TOF sensor, 4, infrared emitting diode, 5, digital microphone, 6, digital signal processor, 7, high-speed memory, 8, barometer, 9, electronic compass, 10, 6 axis motion tracker, 11, TOF equipment treater, 12, USB interface, 13, USB-HUB, 14, EEPROM, 15, power management unit, 16, infrared emission window, 17, casing, 18, pilot lamp, 19, spring, 20, solid fixed ring, 21, elastic membrane.

Detailed Description

The following provides a more detailed description of the present invention, with reference to the accompanying drawings.