Self-calibration method and device of distributed microphone array and electronic equipment

文档序号：36637 发布日期：2021-09-24 浏览：20次中文

阅读说明：本技术 分布式麦克风阵列的自校准方法、装置和电子设备 (Self-calibration method and device of distributed microphone array and electronic equipment ) 是由陶凯尹明婕韩博缪海波刘鑫鲍光照于 2020-03-23 设计创作，主要内容包括：本申请实施例提供一种分布式麦克风阵列的自校准方法、装置和电子设备,该上述方法中,获取每个拾音设备的麦克风在所属拾音设备的坐标系中的坐标,所述拾音设备是进行协同拾音的设备,并且,从所述拾音设备中选择至少一个拾音设备作为参考设备,基于每个所述参考设备,获取该参考设备的超声波发射器与除该参考设备外的设备的麦克风之间的距离,并且,获取所述除该参考设备外的设备的超声波发射器与该参考设备的麦克风之间的距离,计算非主参考设备的原点相对主原点的相对位置坐标,再计算每个所述拾音设备的麦克风在主坐标系中的坐标,得到分布式麦克风阵列,从而能够拓宽声场信息,提升空间滤波增强效果,改善拾音质量。(The embodiment of the application provides a self-calibration method, a self-calibration device and an electronic device of a distributed microphone array, in the method, the coordinates of a microphone of each sound pickup device in a coordinate system of the sound pickup device are obtained, the sound pickup device is a device for carrying out coordinated sound pickup, at least one sound pickup device is selected from the sound pickup devices to be used as a reference device, the distance between an ultrasonic transmitter of the reference device and the microphones of devices except the reference device is obtained based on each reference device, the distance between the ultrasonic transmitter of the device except the reference device and the microphones of the reference device is obtained, the relative position coordinates of the origin of the non-main reference device relative to a main origin are calculated, the coordinates of the microphones of each sound pickup device in a main coordinate system are calculated, and the distributed microphone array is obtained, therefore, sound field information can be widened, the spatial filtering enhancement effect is improved, and the pickup quality is improved.)

1. A method of self-calibration of a distributed microphone array, comprising:

acquiring coordinates of a microphone of each sound pickup equipment in a coordinate system of the sound pickup equipment, wherein the sound pickup equipment is used for carrying out coordinated sound pickup, and the coordinate system of the sound pickup equipment is a three-dimensional coordinate system established by taking an ultrasonic transmitter of the sound pickup equipment as an origin; and the number of the first and second electrodes,

selecting at least one sound pickup apparatus from the sound pickup apparatuses as a reference apparatus; acquiring the distance between the ultrasonic transmitter of the reference equipment and the microphone of the equipment except the reference equipment and acquiring the distance between the ultrasonic transmitter of the equipment except the reference equipment and the microphone of the reference equipment on the basis of each reference equipment;

calculating relative position coordinates of an origin of the non-main reference equipment relative to a main origin according to the coordinates and the distance acquired based on each reference equipment; the master reference device is one of the reference devices, the non-master reference device is a device other than a master reference device, and the master origin is an origin of a coordinate system of the master reference device;

calculating the coordinate of the microphone of each pickup device in a main coordinate system according to the relative position coordinate and the coordinate of the microphone of each pickup device in the coordinate system of the pickup device to obtain a distributed microphone array; the master coordinate system is the coordinate system of the master reference device.

2. The method according to claim 1, wherein the obtaining, on a per reference device basis, the distance between the ultrasonic transmitter of the reference device and the microphone of the device other than the reference device, and before obtaining the distance between the ultrasonic transmitter of the device other than the reference device and the microphone of the reference device, further comprises:

acquiring the distance between the ultrasonic transmitter of each sound pickup equipment and the microphones of other sound pickup equipment;

correspondingly, the acquiring, on a per reference device basis, the distances between the ultrasonic transmitters of the reference devices and the microphones of the devices other than the reference devices, respectively, and the acquiring the distances between the ultrasonic transmitters of the devices other than the reference devices and the microphones of the reference devices, includes:

and acquiring the distance between the ultrasonic transmitter of the reference equipment and the microphone of the equipment except the reference equipment and the distance between the ultrasonic transmitter of the equipment except the reference equipment and the microphone of the reference equipment from the distances between the ultrasonic transmitter of each sound pickup equipment and the microphones of other sound pickup equipment on the basis of each reference equipment.

3. The method of claim 2, wherein the obtaining a distance between an ultrasonic emitter of each pickup device and a microphone of the other pickup device comprises:

acquiring a first moment when the sound pickup equipment sends a first ultrasonic signal by using an ultrasonic transmitter on the basis of each sound pickup equipment;

and acquiring a second moment when the microphone receives the ultrasonic signal based on the microphone of each other pickup equipment, and calculating the distance between the ultrasonic transmitter of the pickup equipment and the microphone according to the time difference between the second moment and the first moment.

4. The method of claim 2, wherein the obtaining a distance between an ultrasonic emitter of each pickup device and a microphone of the other pickup device comprises:

receiving first distance information sent by each pickup device, wherein the distance information comprises: the distance between the ultrasonic wave emitter of other sound pickup equipment and the microphone of the sound pickup equipment.

5. The method of claim 1, wherein the obtaining, on a per reference device basis, a distance between an ultrasonic transmitter of the reference device and a microphone of a device other than the reference device comprises:

acquiring a third moment when the reference equipment transmits a second ultrasonic signal based on each reference equipment;

acquiring a fourth moment when the microphone receives the second ultrasonic signal based on each microphone of the devices except the reference device;

and calculating the distance between the ultrasonic transmitter of the reference device and the microphone according to the time difference between the fourth time and the third time.

6. The method of claim 5, wherein the obtaining, on a per reference device basis, the distance between the ultrasonic transmitter of the device other than the reference device and the microphone of the reference device comprises:

acquiring a fifth moment when the equipment transmits the third ultrasonic signal based on each equipment except the reference equipment;

acquiring a sixth moment when the microphone receives the third ultrasonic signal based on each microphone of the reference device;

and calculating the distance between the ultrasonic transmitter of the equipment except the reference equipment and the microphone of the reference equipment according to the time difference between the sixth time and the fifth time.

7. The method of claim 1, wherein the obtaining, on a per reference device basis, the distance between the ultrasonic transmitter of the reference device and the microphone of the device other than the reference device, and the obtaining the distance between the ultrasonic transmitter of the device other than the reference device and the microphone of the reference device, comprises:

receiving, based on each of the reference devices, second distance information sent by the reference device, where the second distance information includes: a distance between a microphone of the reference device and an ultrasonic transmitter other than the reference device;

receiving third distance information sent by devices except the reference device, wherein the third distance information comprises: the distance between the microphone of a device other than the reference device and the ultrasonic transmitter of the reference device.

8. The method of any of claims 1 to 7, wherein selecting one of said tone pickups as a reference device, said calculating relative location coordinates of an origin of a non-master reference device with respect to a master origin from said coordinates and based on said distance calculated by each of said reference devices comprises:

and calculating the relative position coordinate of the origin of the non-main reference equipment relative to the main origin according to the coordinate and the distance calculated based on the main reference equipment.

9. The method of any of claims 1 to 7, wherein selecting at least two of said tone pickups as reference devices, said calculating relative location coordinates of the origin of the non-master reference device with respect to the master origin from said coordinates and based on said distance calculated by each of said reference devices comprises:

calculating, based on each of the reference devices, relative position coordinates of an origin of a device other than the reference device with respect to an origin of the reference device from the coordinates and the distance calculated based on the reference device; converting the relative position coordinates to relative position coordinates of an origin of the non-primary reference device relative to the primary origin;

based on each non-main reference device, calculating an average value of relative position coordinates of the origin of the non-main reference device with respect to the main origin, and taking the average value as the relative position coordinates of the origin of the non-main reference device with respect to the main origin.

10. A self-calibration arrangement for a distributed microphone array, comprising:

the coordinate acquisition unit is used for acquiring the coordinates of a microphone of each sound pickup equipment in a coordinate system of the sound pickup equipment, wherein the sound pickup equipment is used for carrying out coordinated sound pickup, and the coordinate system of the sound pickup equipment is a three-dimensional coordinate system established by taking an ultrasonic transmitter of the sound pickup equipment as an origin;

a first distance acquisition unit configured to select at least one sound pickup apparatus from the sound pickup apparatuses as a reference apparatus; acquiring the distance between the ultrasonic transmitter of the reference equipment and the microphone of the equipment except the reference equipment and acquiring the distance between the ultrasonic transmitter of the equipment except the reference equipment and the microphone of the reference equipment on the basis of each reference equipment;

a relative coordinate calculation unit, configured to calculate, according to the coordinates acquired by the coordinate acquisition unit and the distance acquired by the distance acquisition unit, a relative position coordinate of an origin of the non-main reference device with respect to a main origin; the master reference device is one of the reference devices, the non-master reference device is a device other than a master reference device, and the master origin is an origin of a coordinate system of the master reference device;

the microphone coordinate calculation unit is used for calculating the coordinate of the microphone of each pickup device in a main coordinate system according to the relative position coordinate calculated by the relative coordinate calculation unit and the coordinate acquired by the coordinate acquisition unit to obtain a distributed microphone array; the master coordinate system is the coordinate system of the master reference device.

11. The apparatus of claim 10, further comprising:

a second distance acquisition unit for acquiring a distance between the ultrasonic transmitter of each sound pickup apparatus and the microphone of the other sound pickup apparatus;

correspondingly, the first distance obtaining unit is specifically configured to: on the basis of each of the reference devices, the distance between the ultrasonic transmitter of the reference device and the microphone of the device other than the reference device and the distance between the ultrasonic transmitter of the device other than the reference device and the microphone of the reference device are acquired from the distances acquired by the second distance acquisition unit.

12. The apparatus according to claim 11, wherein the second distance obtaining unit is specifically configured to:

acquiring a first moment when the sound pickup equipment sends a first ultrasonic signal by using an ultrasonic transmitter on the basis of each sound pickup equipment;

13. The apparatus according to claim 11, wherein the second distance obtaining unit is specifically configured to:

14. The apparatus of claim 10, wherein the first distance obtaining unit comprises:

a time acquiring subunit, configured to acquire, based on each of the reference devices, a third time at which the reference device transmits the second ultrasonic signal; acquiring a fourth moment when the microphone receives the second ultrasonic signal based on each microphone of the devices except the reference device;

and the distance calculating subunit is used for calculating the distance between the ultrasonic transmitter of the reference device and the microphone according to the time difference between the fourth time and the third time.

15. The apparatus of claim 14, wherein the first distance obtaining unit comprises:

the time acquisition subunit is further configured to: acquiring a fifth moment when the equipment transmits the third ultrasonic signal based on each equipment except the reference equipment; acquiring a sixth moment when the microphone receives the third ultrasonic signal based on each microphone of the reference device;

the distance calculation subunit is further configured to: and calculating the distance between the ultrasonic transmitter of the equipment except the reference equipment and the microphone of the reference equipment according to the time difference between the sixth time and the fifth time.

16. The apparatus according to claim 10, wherein the first distance obtaining unit is specifically configured to:

17. The apparatus according to any one of claims 10 to 16, wherein if a pickup device is selected from the pickup devices as a reference device, the relative coordinate calculation unit is specifically configured to:

18. The apparatus according to any one of claims 10 to 16, wherein at least two of the sound pickup apparatuses are selected as reference apparatuses, and the relative coordinate calculation unit is specifically configured to:

19. An electronic device, comprising:

one or more processors; a memory; and one or more computer programs, wherein the one or more computer programs are stored in the memory, the one or more computer programs comprising instructions which, when executed by the apparatus, cause the apparatus to perform the steps of:

20. A computer-readable storage medium, in which a computer program is stored which, when run on a computer, causes the computer to carry out the method according to any one of claims 1 to 9.

Technical Field

The embodiment of the application relates to the field of signal processing, in particular to a self-calibration method and device of a distributed microphone array and electronic equipment.

Background

With the popularization of popular applications such as short videos, live broadcasts, video podcasts (vlog), and the like, more and more common users can record life drops, creative works, and even become a member of the self-media army in the form of audio or video by using portable electronic devices. However, due to the particularity of the sound field environment, such as the interference of the environmental noise, the influence of the indoor reverberation, the attenuation caused by the sound source distance, and the like, the quality and the definition of the sound recording in reality are poor, and the shooting experience is greatly influenced.

The spatial filter based on the multi-microphone array separates and reduces noise of audio streams through sound field spatial information difference of sound sources, and can meet recording requirements in fidelity performance, so that electronic equipment in the market, such as a smart phone, a tablet computer, a recording pen, a camera and the like, generally performs spatial filtering enhancement processing on the audio streams based on the multi-microphone array or a directional microphone, and the pickup quality is improved.

In a patent application with application number 201410468440.X and patent name "a voice noise reduction method and system based on microphone array", a voice noise reduction method and system based on microphone array is disclosed, which comprises: constructing two non-directional microphones forming a microphone array into two opposite heart-shaped directional microphones to obtain a forward target speech signal and a backward noise signal; carrying out frequency balance with the same degree on the forward target voice signal and the backward noise signal to obtain an equalized target voice signal and an equalized noise signal; performing adaptive double filtering on the forward target voice signal and the backward noise signal to obtain a corrected noise signal and a corrected target voice signal; and obtaining a restored target voice signal based on the corrected target voice signal. According to the technical scheme, the target voice signal after being restored is prevented from generating frequency distortion through frequency equalization, the problem that the target voice signal is damaged when noise is reduced through a self-adaptive filter is solved by adopting a self-adaptive double-filtering method, and then the target voice signal after being restored is thoroughly prevented from generating distortion.

However, the technical scheme is realized based on a dual-microphone array, and is limited by the number of microphones and the size of the array, so that the formed space directivity is weak, the generated space filtering enhancement effect is low, and particularly in complex scenes such as multipath reverberation and the like, the audio stream is easy to fail or voice damage and other negative problems occur.

Disclosure of Invention

The embodiment of the application provides a self-calibration method and device of a distributed microphone array and electronic equipment, which can widen sound field information, improve the spatial filtering enhancement effect and improve the pickup quality.

In a first aspect, an embodiment of the present application provides a self-calibration method for a distributed microphone array, including:

acquiring coordinates of a microphone of each sound pickup device in a coordinate system of the sound pickup device, wherein the sound pickup device is used for carrying out coordinated sound pickup, and the coordinate system of the sound pickup device is a three-dimensional coordinate system established by taking an ultrasonic transmitter of the sound pickup device as an origin; and the number of the first and second electrodes,

selecting at least one sound pickup apparatus from the sound pickup apparatuses as a reference apparatus; acquiring, on a per reference device basis, a distance between an ultrasonic transmitter of the reference device and a microphone of a device other than the reference device, and acquiring a distance between an ultrasonic transmitter of a device other than the reference device and a microphone of the reference device;

calculating the relative position coordinates of the origin of the non-main reference equipment relative to the main origin according to the coordinates and the distance acquired based on each reference equipment; the main reference device is one of the reference devices, the non-main reference device is a device other than the main reference device, and the main origin is the origin of the coordinate system of the main reference device;

calculating the coordinate of the microphone of each pickup device in the main coordinate system according to the relative position coordinate and the coordinate of the microphone of each pickup device in the coordinate system of the pickup device to obtain a distributed microphone array; the master coordinate system is the coordinate system of the master reference device.

Above-mentioned pickup equipment can be for the electronic equipment that can pick up, and electronic equipment can include equipment such as mobile terminal (cell-phone), Intelligent screen, unmanned aerial Vehicle, Intelligent internet Vehicle (ICV, Intelligent Connected Vehicle), Intelligent (car) car (smart/Intelligent car) or mobile unit.

According to the method, the distributed microphone array is established based on the microphones of the plurality of pickup devices, the array element number and the space size of the microphone array for picking up sound are greatly expanded, sound field information is widened, the spatial filtering enhancement effect is improved, and the pickup quality is improved.

In one possible implementation manner, on a per reference device basis, before acquiring the distance between the ultrasonic transmitter of the reference device and the microphone of the device other than the reference device, the method further includes:

acquiring the distance between the ultrasonic transmitter of each sound pickup equipment and the microphones of other sound pickup equipment;

accordingly, acquiring, on a per reference device basis, distances between the ultrasonic transmitters of the reference devices and the microphones of the devices other than the reference devices, respectively, and acquiring distances between the ultrasonic transmitters of the devices other than the reference devices and the microphones of the reference devices, includes:

on the basis of each reference device, the distance between the ultrasonic transmitter of the reference device and the microphone of the device except the reference device and the distance between the ultrasonic transmitter of the device except the reference device and the microphone of the reference device are obtained from the distances between the ultrasonic transmitter of each sound pickup device and the microphones of other sound pickup devices.

In one possible implementation, acquiring a distance between the ultrasonic transmitter of each sound pickup apparatus and the microphone of the other sound pickup apparatus includes:

acquiring a first moment when the sound pickup equipment sends a first ultrasonic signal by using an ultrasonic transmitter on the basis of each sound pickup equipment;

and acquiring a second moment when the microphone receives the ultrasonic signal based on the microphone of each other sound pickup equipment, and calculating the distance between the ultrasonic transmitter of the sound pickup equipment and the microphone according to the time difference between the second moment and the first moment.

In one possible implementation, acquiring a distance between the ultrasonic transmitter of each sound pickup apparatus and the microphone of the other sound pickup apparatus includes:

receiving first distance information sent by each sound pickup device, wherein the distance information comprises: the distance between the ultrasonic transmitters of other sound pickup equipment and the microphone of the sound pickup equipment.

acquiring a third moment when the reference equipment transmits the second ultrasonic signal based on each reference equipment;

acquiring a fourth moment when the microphone receives the second ultrasonic signal based on each microphone of the devices except the reference device;

and calculating the distance between the ultrasonic transmitter of the reference device and the microphone according to the time difference between the fourth time and the third time.

In one possible implementation, acquiring, on a per reference device basis, a distance between an ultrasonic transmitter of a device other than the reference device and a microphone of the reference device includes:

acquiring a fifth moment when the equipment transmits the third ultrasonic signal based on each equipment except the reference equipment;

acquiring a sixth moment when the microphone receives the third ultrasonic signal based on each microphone of the reference device;

In one possible implementation, acquiring, on a per reference device basis, a distance between an ultrasonic transmitter of the reference device and a microphone of a device other than the reference device, and acquiring a distance between an ultrasonic transmitter of a device other than the reference device and a microphone of the reference device, includes:

receiving, on a per reference device basis, second distance information sent by the reference device, where the second distance information includes: a distance between a microphone of the reference device and an ultrasonic transmitter other than the reference device;

In one possible implementation, selecting one of the sound pickup apparatuses as a reference apparatus, calculating a relative position coordinate of an origin of the non-main reference apparatus with respect to the main origin from the coordinates and a distance calculated based on each reference apparatus includes:

relative position coordinates of the origin of the non-main reference device with respect to the main origin are calculated from the coordinates and the distance calculated based on the main reference device.

In one possible implementation, selecting at least two sound pickup apparatuses from among the sound pickup apparatuses as reference apparatuses, calculating relative position coordinates of an origin of the non-main reference apparatus with respect to the main origin from the coordinates and a distance calculated based on each reference apparatus includes:

calculating, based on each reference device, relative position coordinates of an origin of a device other than the reference device with respect to an origin of the reference device from the coordinates and a distance calculated based on the reference device; converting the relative position coordinates into relative position coordinates of the origin of the non-main reference device relative to the main origin;

based on each non-main reference device, calculating an average value of relative position coordinates of the origin of the non-main reference device relative to the main origin, and taking the average value as the relative position coordinates of the origin of the non-main reference device relative to the main origin.

In a second aspect, an embodiment of the present application provides a self-calibration apparatus for a distributed microphone array, including:

the coordinate acquisition unit is used for acquiring the coordinates of the microphone of each sound pickup equipment in the coordinate system of the sound pickup equipment, the sound pickup equipment is used for carrying out coordinated sound pickup, and the coordinate system of the sound pickup equipment is a three-dimensional coordinate system established by taking the ultrasonic transmitter of the sound pickup equipment as an original point;

a first distance acquisition unit for selecting at least one sound pickup apparatus from the sound pickup apparatuses as a reference apparatus; acquiring, on a per reference device basis, a distance between an ultrasonic transmitter of the reference device and a microphone of a device other than the reference device, and acquiring a distance between an ultrasonic transmitter of a device other than the reference device and a microphone of the reference device;

the relative coordinate calculation unit is used for calculating the relative position coordinate of the origin of the non-main reference equipment relative to the main origin according to the coordinate acquired by the coordinate acquisition unit and the distance acquired by the distance acquisition unit; the main reference device is one of the reference devices, the non-main reference device is a device other than the main reference device, and the main origin is the origin of the coordinate system of the main reference device;

the microphone coordinate calculation unit is used for calculating the coordinate of the microphone of each pickup device in the main coordinate system according to the relative position coordinate calculated by the relative coordinate calculation unit and the coordinate acquired by the coordinate acquisition unit to obtain a distributed microphone array; the master coordinate system is the coordinate system of the master reference device.

In one possible implementation manner, the method further includes:

a second distance acquisition unit for acquiring a distance between the ultrasonic transmitter of each sound pickup apparatus and the microphone of the other sound pickup apparatus;

correspondingly, the first distance obtaining unit is specifically configured to: on a per reference device basis, the distance between the ultrasonic transmitter of the reference device and the microphone of the device other than the reference device, and the distance between the ultrasonic transmitter of the device other than the reference device and the microphone of the reference device are acquired from the distances acquired by the second distance acquisition unit.

In a possible implementation manner, the second distance obtaining unit is specifically configured to:

acquiring a first moment when the sound pickup equipment sends a first ultrasonic signal by using an ultrasonic transmitter on the basis of each sound pickup equipment;

In a possible implementation manner, the second distance obtaining unit is specifically configured to:

In one possible implementation manner, the first distance obtaining unit includes:

a time acquisition subunit, configured to acquire, on a per reference device basis, a third time at which the reference device transmits the second ultrasonic signal; acquiring a fourth moment when the microphone receives the second ultrasonic signal based on each microphone of the devices except the reference device;

and the distance calculating subunit is used for calculating the distance between the ultrasonic transmitter and the microphone of the reference device according to the time difference between the fourth time and the third time.

In one possible implementation manner, the first distance obtaining unit includes:

In a possible implementation manner, the first distance obtaining unit is specifically configured to:

In a possible implementation manner, if one of the sound pickup apparatuses is selected as a reference apparatus, the relative coordinate calculation unit is specifically configured to:

In a possible implementation manner, if at least two sound pickup apparatuses are selected from the sound pickup apparatuses as the reference apparatuses, the relative coordinate calculation unit is specifically configured to:

In a third aspect, an embodiment of the present application provides an electronic device, including:

one or more processors; a memory; a plurality of application programs; and one or more computer programs, wherein the one or more computer programs are stored in the memory, the one or more computer programs comprising instructions which, when executed by the apparatus, cause the apparatus to perform the steps of:

In a fourth aspect, embodiments of the present application provide a computer-readable storage medium having stored thereon a computer program, which, when run on a computer, causes the computer to perform the method of the first aspect.

In a fifth aspect, the present application provides a computer program for performing the method of the first aspect when the computer program is executed by a computer.

In a possible design, the program of the fifth aspect may be stored in whole or in part on a storage medium packaged with the processor, or in part or in whole on a memory not packaged with the processor.

Drawings

Fig. 1 is a flow chart of an embodiment of a self-calibration method for a distributed microphone array of the present application;

FIG. 2a is a flow chart of another embodiment of a self-calibration method for a distributed microphone array of the present application;

fig. 2b is an exemplary diagram of a coordinate system of a sound pickup apparatus according to an embodiment of the present application;

FIG. 2c is a schematic diagram of the distance between the ultrasonic transmitter and the microphone of various devices according to the embodiment of the present application;

FIG. 3 is a flow chart of yet another embodiment of a method for self-calibration of a distributed microphone array of the present application;

FIGS. 4a and 4b are flow charts of embodiments of methods for obtaining a distance according to the present application;

FIG. 5 is a flow chart of yet another embodiment of a method for self-calibration of a distributed microphone array of the present application;

FIG. 6 is a flow chart of yet another embodiment of a method for self-calibration of a distributed microphone array of the present application;

FIG. 7a is an exemplary diagram of a single-phone video recording scenario and a 5-phone collaborative video recording scenario;

FIG. 7b is a schematic diagram of spatial directivity of a microphone array of a single handset in a single handset video scene;

fig. 7c is a schematic diagram of spatial directivity of a distributed microphone array in a 5-handset collaborative video scene;

FIG. 7d is a schematic diagram of a waveform after spatial filtering enhancement in a single-handset video scene;

FIG. 7e is a schematic diagram of a waveform after spatial filtering enhancement in a scenario of 5 mobile phone collaborative recording;

FIG. 8 is a block diagram of one embodiment of a self-calibration apparatus for a distributed microphone array of the present application;

FIG. 9 is a block diagram of another embodiment of a self-calibration apparatus for a distributed microphone array of the present application;

FIG. 10 is a block diagram of yet another embodiment of a self-calibration apparatus for a distributed microphone array of the present application;

fig. 11 is a schematic structural diagram of an embodiment of an electronic device according to the present application.

Detailed Description

The terminology used in the description of the embodiments section of the present application is for the purpose of describing particular embodiments of the present application only and is not intended to be limiting of the present application.

In the existing implementation scheme, important characteristics such as noise reduction capability and directivity sharpness of a spatial filter strongly depend on the size of a microphone array and the number of microphones forming the microphone array, electronic equipment is limited by the size and the manufacturing cost of the electronic equipment, a few microphones can be distributed, the spatial filtering enhancement capability of the microphone array cannot be fully exerted, and the quality improvement effect under a video recording scene is very limited.

The embodiment of the application focuses on the collaborative sound pickup of the electronic equipment, the microphones of the collaborative multi-electronic equipment form a distributed microphone array, the distributed microphone array can also be called a microphone collaborative sound pickup array, the array element number and the spatial size of the microphone array for sound pickup are greatly expanded, the spatial filtering enhancement effect is improved, and the effect of improving the sound pickup quality of the electronic equipment is achieved.

Therefore, the self-calibration method and device of the distributed microphone array and the electronic equipment are provided by the embodiment of the application, so that the sound field information can be widened, the spatial filtering enhancement effect can be improved, and the pickup quality can be improved.

The applicable scenarios of the embodiment of the present application at least include: at least 2 electronic equipment that are provided with the microphone, the microphone quantity that sets up on every electronic equipment is at least 1, is provided with at least one ultrasonic transmitter on every electronic equipment, ultrasonic transmitter can be: a speaker horn, or a professional ultrasonic horn, etc.; the electronic devices have a network capable of data sharing therebetween, and the network may be a wired network or a wireless network, and is preferably a wireless network such as WiFi, bluetooth, or a mobile network.

In a possible implementation manner, at least one electronic device may be provided with a camera, so that the method of the present application may be applied to sound pickup of the electronic device in video shooting. Hereinafter, the present embodiment will refer to an electronic apparatus participating in the coordinated sound pickup as a sound pickup apparatus.

Fig. 1 is a flowchart of an embodiment of a self-calibration method for a distributed microphone array according to the present invention, as shown in fig. 1, the method may include:

step 101: the coordinate of the microphone of each sound pickup equipment in the coordinate system of the sound pickup equipment is acquired, the sound pickup equipment is used for carrying out coordinated sound pickup, and the coordinate system of the sound pickup equipment is a three-dimensional coordinate system established by taking an ultrasonic transmitter of the sound pickup equipment as an origin.

Step 102: selecting at least one sound pickup apparatus from the sound pickup apparatuses as a reference apparatus; based on each of the reference devices, a distance between the ultrasonic transmitter of the reference device and the microphone of the device other than the reference device is acquired, and a distance between the ultrasonic transmitter of the device other than the reference device and the microphone of the reference device is acquired.

The execution order of steps 101 and 102 is not limited.

Step 103: calculating relative position coordinates of an origin of the non-main reference device with respect to a main origin from the coordinates and the distance calculated based on each of the reference devices; the master reference device is one of the reference devices, the non-master reference device is a device other than the master reference device, and the master origin is an origin of a coordinate system of the master reference device.

Step 104: calculating the coordinate of the microphone of each pickup device in a main coordinate system according to the relative position coordinate and the coordinate of the microphone of each pickup device in the coordinate system of the pickup device to obtain a distributed microphone array; the master coordinate system is the coordinate system of the master reference device.

In the method shown in fig. 1, a distributed microphone array is established based on microphones of a plurality of pickup devices, the number of array elements and the spatial size of the microphone array for pickup are greatly expanded, and further, sound field information is widened.

Fig. 2a is a flow chart of another embodiment of a self-calibration method for a distributed microphone array according to the present invention, as shown in fig. 2a, the method may include:

step 201: the User of the main device starts the cooperative sound pickup function on a User Interface (UI) page, and selects an electronic device to be invited to perform cooperative sound pickup from a device list provided by the UI page and capable of communicating with the main device.

The master device in this embodiment refers to an electronic device that actively initiates coordination of sound pickup. The main equipment is the electronic equipment which needs to acquire the audio stream, and the sound pickup quality of the main equipment is improved by inviting other electronic equipment to pick up sound in a coordinated mode.

Step 202: the master device sends a collaborative pickup invitation to each of the selected electronic devices.

Step 203: the electronic equipment receiving the collaborative sound pickup invitation prompts the user of the information invited to carry out collaborative sound pickup, the user selects to approve the joining or refuses the joining, and according to the selection of the user, the electronic equipment sends reply information based on the collaborative sound pickup invitation to the main equipment.

For the electronic device including the consent information in the reply information, the master device establishes a cooperative sound pickup relationship therewith. The following steps are directed to a master device and an electronic device establishing a cooperative sound pickup relationship therewith. The devices that establish a cooperative sound pickup relationship with the main device are called auxiliary devices, and the main device and the auxiliary devices are collectively called sound pickup devices.

Step 204: the primary device and the secondary device perform clock information synchronization.

The clock information synchronization may be initiated by the master device or initiated by any auxiliary device, and the present application is not limited as long as the clock information of the master device and the clock information of the auxiliary device are synchronized.

Step 205: the master device acquires the coordinates of the microphone of each sound pickup device in the coordinate system of the sound pickup device.

The coordinate system of the sound pickup equipment is a three-dimensional coordinate system established by taking an ultrasonic transmitter of the sound pickup equipment as an origin.

One possible method of establishing a three-dimensional coordinate system is shown in fig. 2 b: the origin of the three-dimensional coordinate system can be the central point of an ultrasonic transmitter of the sound pickup equipment; the x axis and the y axis of the three-dimensional coordinate system are respectively parallel to the symmetry axis of the upper surface of the sound pickup equipment, and the z axis is perpendicular to the plane determined by the x axis and the y axis.

Step 206: the master device acquires the distance between the ultrasonic transmitter of each sound pickup device and the microphones of the other sound pickup devices.

As shown in fig. 2c, a schematic diagram of the distances between the ultrasonic transmitters and the microphones required to be calculated by the master device is shown, assuming that the sound pickup device includes device 1, device 2, …, and device K, each device includes 1 ultrasonic transmitter and 2 microphones Mic1 and Mic 2; then, referring to fig. 2c, the distances to be acquired include:

distances between the ultrasonic transmitter of device 1 and the microphones 1 of device 2, device 3 (not shown in fig. 2c), …, device K, respectively;

distances between the ultrasonic transmitter of the device 1 and the microphones 2 of the devices 2, 3, …, and K, respectively;

distances between the ultrasonic transmitter of the device 2 and the microphones 1 of the devices 1, 3, …, and K, respectively;

distances between the ultrasonic transmitter of the device 2 and the microphones 2 of the devices 1, 3, …, and K, respectively;

by analogy, until

Distance between the ultrasonic transmitter of device K and the microphone 1 of device 1, device 2, …, device K-1 (not shown in fig. 2c), respectively;

distance between the ultrasonic transmitter of device K and the microphone 2 of device 1, device 2, …, device K-1, respectively.

In one possible implementation, the acquiring, by the master device, a distance between the ultrasonic transmitter of each sound pickup device and the microphone of the other sound pickup device may include:

on a per sound pickup apparatus basis, the master apparatus acquires a first timing at which the sound pickup apparatus transmits a first ultrasonic signal using the ultrasonic transmitter;

based on the microphone of each other pickup device, the master device acquires a second time when the microphone receives the ultrasonic signal, and calculates the distance between the ultrasonic transmitter of the pickup device and the microphone according to the time difference between the second time and the first time.

In another possible implementation manner, the acquiring, by the master device, a distance between the ultrasonic transmitter of each sound pickup device and the microphone of the other sound pickup devices may include:

the main equipment receives first distance information sent by each pickup equipment, and the distance information comprises: the distance between the ultrasonic wave emitter of other sound pickup equipment and the microphone of the sound pickup equipment.

For a more specific implementation of this step, refer to the related descriptions in fig. 4a and fig. 4b, which are not described herein again.

Step 207: the master device selects one sound pickup device from the sound pickup devices as a reference device.

In this step, taking an example that the main device selects one sound pickup device from the sound pickup devices as a reference device, the reference device may be the main device or an auxiliary device, and the main device specifically selects which sound pickup devices to use as the reference device, which is not limited in this application. In practical application, the main device may also select two or more than two or even all of the sound pickup devices as reference devices, specifically referring to the embodiment shown in fig. 3, the main device selects N sound pickup devices as the reference devices, where N is an integer greater than 1 and less than or equal to K, and K is the total number of the sound pickup devices, which is not described herein again.

In terms of statistical probability, the more reference devices, the more accurate the relative position coordinates of the origin of each non-main reference device, which are calculated in the subsequent steps, with respect to the main origin, and the more accurate the calculated coordinates of the microphone of each non-main reference device in the main coordinate system.

Step 208: the master device acquires the distance between the ultrasonic transmitter of the reference device and the microphone of the device other than the reference device and the distance between the ultrasonic transmitter of the device other than the reference device and the microphone of the reference device from the distances acquired in step 206.

That is, what the master needs to obtain is: the distance between the ultrasonic transmitter of the reference device and the microphone of the device other than the reference device, and the distance between the microphone of the reference device and the ultrasonic transmitter of the device other than the reference device.

For example, the reference device is a master device, which needs to obtain: the distance between the ultrasonic transmitter of the primary device and the microphone of the secondary device, and the distance between the microphone of the primary device and the ultrasonic transmitter of the secondary device.

The pickup equipment has 3 equipment 1, 2, 3 totally, is provided with 1 ultrasonic emitter on every pickup equipment, and 2 microphones, and supposing that the reference equipment is equipment 1, then the distance that the main equipment needs to obtain includes:

the distance between the ultrasonic transmitter of the device 1 and the microphone 1 of the device 2;

the distance between the ultrasonic transmitter of the device 1 and the microphone 2 of the device 2;

the distance between the ultrasonic transmitter of the device 1 and the microphone 1 of the device 3;

the distance between the ultrasonic transmitter of the device 1 and the microphone 2 of the device 3;

the distance between the ultrasonic transmitter of the device 2 and the microphone 1 of the device 1;

the distance between the ultrasonic transmitter of the device 2 and the microphone 2 of the device 1;

the distance between the ultrasonic transmitter of the device 3 and the microphone 1 of the device 1;

distance between the ultrasonic transmitter of the device 3 and the microphone 2 of the device 1.

Assuming that the reference device is device 2, the distances that the master device needs to acquire include:

the distance between the ultrasonic transmitter of the device 2 and the microphone 1 of the device 1;

the distance between the ultrasonic transmitter of the device 2 and the microphone 2 of the device 1;

the distance between the ultrasonic transmitter of the device 2 and the microphone 1 of the device 3;

the distance between the ultrasonic transmitter of the device 2 and the microphone 2 of the device 3;

the distance between the ultrasonic transmitter of the device 1 and the microphone 1 of the device 2;

the distance between the ultrasonic transmitter of the device 1 and the microphone 2 of the device 2;

the distance between the ultrasonic transmitter of the device 3 and the microphone 1 of the device 2;

distance between the ultrasonic transmitter of the device 3 and the microphone 2 of the device 2.

The execution sequence between step 205 and steps 206 to 208 is not limited.

Step 209: the master device calculates the relative position coordinates of the origin of the non-master reference device with respect to the master origin from the coordinates acquired in step 205 and the distance calculated based on the reference device in step 208; the master reference device is one of the reference devices, the non-master reference device is a device other than a master reference device, and the master origin is an origin of a coordinate system of the master reference device.

Since one reference device is selected in step 207, the reference device is the master reference device in this step. Assuming that the main reference device is a main device, the non-main reference device is an auxiliary device, the main coordinate system is a three-dimensional coordinate system established by taking an ultrasonic transmitter of the main device as an origin, and the main origin is the origin of the main coordinate system. Assuming that the main reference device is an auxiliary device a, the non-main reference device is an auxiliary device other than the auxiliary device a, and the main device, the main coordinate system is a three-dimensional coordinate system established by using the ultrasonic transmitter of the auxiliary device a as an origin, and the main origin is the origin of the main coordinate system.

Hereinafter, a method of calculating relative position coordinates between the origins of two sound pickup apparatuses will be described. Assuming a total of K sound pickup apparatuses, the ith sound pickup apparatus is a reference apparatus, and the jth sound pickup apparatus is a device other than the reference apparatusFor convenience of description and understanding, reference is made to an off-device, j ═ 1, …, i-1, i +1, …, K, hereinafter referred to simply as pickup i, pickup j; the pick-up device i having n_iA microphone, pickup j having n_jA microphone, n_iIs a natural number, n_jIs a natural number; the relative position coordinate of the origin of the sound pickup device j to the origin of the sound pickup device i isThe solution can be obtained by the following formula (1):

wherein the content of the first and second substances,the coordinate of the 1 st microphone of the pickup apparatus i in the coordinate system of the pickup apparatus i;the distance between an ultrasonic emitter of the sound pickup device j and a 1 st microphone of the sound pickup device i;is the tone pickup apparatus ith_iCoordinates of each microphone in a coordinate system of the sound pickup device i;ultrasonic emitter as pickup j and pickup ith_iThe distance between the microphones;the 1 st microphone of pickup j is the coordinate in the coordinate system of pickup j,ultrasonic emitter of pickup i and 1 st microphone of pickup jThe distance between the two or more of the two or more,is the n-th of tone pick-up apparatus j_jThe coordinates of the microphones in the coordinate system of the sound pick-up device j,the ultrasonic emitter of pickup i and the nth of pickup j_jThe distance between the microphones.

Through the above formula set, the relative position coordinate of the origin of the sound pickup j to the origin of the sound pickup i can be calculated

If the sound pickup device i is a reference device, the sound pickup device j is a device except the reference device, and the relative position coordinates of the origin of the device except the reference device relative to the origin of the reference device can be calculated through the formula;

if the pickup i is the main reference device and the pickup j is the non-main reference device, the relative position coordinates of the origin of the non-main reference device relative to the main origin can be calculated by the above formula.

Preferably, the relative position coordinate of the origin of the sound pickup j to the origin of the sound pickup i is obtained for better calculationThe number of formulas of the above formula set is preferably not less than 4, and therefore, the sum of the numbers of microphones on the sound pickup apparatus i and the sound pickup apparatus j is preferably not less than 4. For example, if the sound pickup device i has 1 microphone, then there are preferably at least 3 microphones on the sound pickup device j; the sound pickup device i is provided with 2 microphones, and at least 2 microphones are preferably arranged on the sound pickup device j; and so on.

Step 210: the main equipment calculates the coordinate of the microphone of each pickup equipment in a main coordinate system according to the relative position coordinate of the origin of the non-main reference equipment relative to the main origin and the coordinate of the microphone of each pickup equipment in the coordinate system of the pickup equipment, so as to obtain a distributed microphone array; the master coordinate system is the coordinate system of the master reference device.

In this step, when calculating the coordinate of the microphone of each piece of sound pickup equipment in the main coordinate system, the above formula 1 may be referred to. For example, assuming that the sound pickup apparatus i is the main reference apparatus, for the 1 st microphone of the sound pickup apparatus j, the coordinates in the main coordinate system are:

step 211: the main equipment acquires the pickup specification parameters of the microphone in the auxiliary equipment.

The pickup specification parameters may be cached in a memory of the master device.

The execution sequence between this step and steps 204 to 209 is not limited.

Pickup specification parameters of the microphone may include, but are not limited to: microphone sensitivity, frequency response, delay, etc.

Step 211 is an optional step.

Through the steps 201 to 211, self-calibration of the distributed microphone array is realized, and the distributed microphone array is formed by the microphones of the electronic devices, so that the number of array elements and the space size of the microphone array for sound pickup are greatly expanded. The self-calibration method of the distributed microphone array in the embodiment of the present application may be applied to spatial filtering enhancement processing to improve a spatial filtering enhancement effect, and at this time, as shown in fig. 2a, the method may further include:

step 212: when the microphones of the sound pickup devices are used for cooperatively picking up sound, the master device uses the sound pickup specification parameters of the microphones to carry out normalization processing on the audio stream.

Step 213: the master device performs spatial filter enhancement processing on the sound pickup direction of the audio stream after the normalization processing using the distributed microphone array obtained in step 212.

The spatial filtering enhancement processing method adopted in this step may include, but is not limited to: a more commonly used time delay cumulative beam forming (DBF) method, or a data-independent optimal pattern design method such as Chebychev, spectral weighting, least square fitting, etc., or a data adaptive statistical optimal waveform estimation algorithm such as MVDR, GSC, LCMV, etc., or other fused/variant spatial filtering algorithms, which is not limited herein.

The DBF is realized by calculating the position information of each microphone element in the microphone array to obtain the time delay difference information of the sound source incident in different spatial directions to each microphone element, and performing time delay compensation and accumulation summation processing on the audio streams of each microphone element to enable the audio streams to achieve the purpose of homodromous addition in the direction needing to be enhanced, thereby realizing the spatial filtering enhancement in the direction.

Fig. 3 is a flow chart of another embodiment of a self-calibration method for a distributed microphone array according to the present invention, as shown in fig. 3, the method may include:

step 301 to step 306 are the same as step 201 to step 206, and are not described herein.

Step 307: the master device selects N sound pickup devices from the sound pickup devices as reference devices.

Where N is an integer greater than 1 and equal to or less than K, and K is the total number of sound pickup apparatuses, that is, K is the total number of main apparatuses and auxiliary apparatuses.

Step 308: on the basis of each of the reference devices, the master device acquires the distance between the ultrasonic transmitter of the reference device and the microphone of the device other than the reference device from the distance acquired in step 306, and acquires the distance between the ultrasonic transmitter of the device other than the reference device and the microphone of the reference device.

Step 309: based on each reference device, the main device calculates relative position coordinates of the origin of the devices except the reference device relative to the origin of the reference device according to the coordinates and the distance calculated based on the reference device; converting the relative position coordinates to relative position coordinates of an origin of the non-primary reference device relative to the primary origin;

the method for the main device to calculate the relative position coordinates of the origin of the device other than the reference device with respect to the origin of the reference device according to the coordinates and the distance calculated by the reference device may refer to the related description in step 209, which is not repeated herein.

Assuming that the master device is device 1, the reference devices are device 2 and device 3, and the master reference device is device 3, then:

for device 2 as the reference device, the master device calculates: relative position coordinates of the origin of the device 1 with respect to the origin of the device 2, and relative position coordinates of the origin of the device 3 with respect to the origin of the device 2;

for device 3 as the reference device, the master device calculates: relative position coordinates of the origin of the device 1 with respect to the origin of the device 3, and relative position coordinates of the origin of the device 2 with respect to the origin of the device 3;

then, when the main device converts the relative position coordinates of the origin of the device 1 with respect to the origin of the device 2 into the relative position coordinates of the origin of the device 1 with respect to the origin of the device 3, the relative position coordinates of the origin of the device 1 with respect to the origin of the device 2 and the relative position coordinates of the origin of the device 2 with respect to the origin of the device 3 may be calculated to obtain the relative position coordinates of the origin of the device 1 with respect to the origin of the device 3;

at this time, the relative position coordinates of the origin of the 2 devices 1 with respect to the origin of the device 3 are obtained in the above calculation, and for the device 1, the average value of these two relative position coordinates is calculated in the subsequent step 310.

Extending this example to a scenario of more than 3 devices, there will be more devices like device 1 that, based on the calculations of this step, will result in 2 or more relative position coordinates of this device with respect to the primary origin.

Step 310: based on each non-main reference device, the main device calculates an average value of relative position coordinates of the origin of the non-main reference device with respect to the main origin, and takes the average value as a relative position coordinate of the origin of the non-main reference device with respect to the main origin.

In a possible implementation manner, the average value of the x-axis coordinate values, the average value of the y-axis coordinate values, and the average value of the z-axis coordinate values may be respectively calculated based on all the relative position coordinates of the origin of the non-main reference device with respect to the main origin, so as to obtain the average value of the relative position coordinates of the origin of the non-main reference device with respect to the main origin.

Further, in order to improve the calculation accuracy in this step, a weight value may be set for each relative position coordinate of the origin of the non-main reference device with respect to the main origin, and then the average value of the x-axis coordinate values, the average value of the y-axis coordinate values, and the average value of the z-axis coordinate values may be calculated based on the weight values.

Continuing with the example in step 309, assuming that the two relative position coordinates of the origin of device 1 with respect to the origin of device 3 are (x1, y1, z1), (x2, y2, z2), respectively, then,

when the average is calculated directly, the average relative position coordinates of the origin of the device 1 with respect to the origin of the device 3 are:

when calculating the average value based on the weighted values, assuming that the weighted value of (x1, y1, z1) is p and the weighted value of (x2, y2, z2) is q, the average relative position coordinates of the origin of the apparatus 1 with respect to the origin of the apparatus 3 are:

the weighted value of each relative position coordinate of the origin of the device 1 with respect to the origin of the device 3 may be determined according to the distance between the devices, the detection accuracy of the ultrasonic transmitter, and the like, and the specific determination method is not limited in the embodiment of the present application.

Step 311: the master equipment calculates the coordinates of the microphone of each pickup equipment in a master coordinate system according to the relative position coordinates and the coordinates of the microphone of each pickup equipment in the coordinate system of the pickup equipment to obtain a distributed microphone array; the master coordinate system is the coordinate system of the master reference device.

Through the above steps 301 to 311, self-calibration of the distributed microphone array is realized, and the self-calibration method of the distributed microphone array according to the embodiment of the present application may be applied to spatial filtering enhancement processing to improve a spatial filtering enhancement effect, which may specifically refer to steps 211 to 213 shown in fig. 2a, and is not described herein again.

In the following, the implementation of step 206 and step 306 is exemplarily illustrated by fig. 4a and 4 b. Referring to fig. 4a and 4b, taking the example that the master device obtains the distance between the ultrasonic emitter of the first sound pickup device and the first microphone of the second sound pickup device except the first sound pickup device, the first sound pickup device may be any one of the sound pickup devices, the second sound pickup device may be any one of the sound pickup devices except the first sound pickup device, the first microphone may be any one of the microphones of the second sound pickup device, and so on, the master device may obtain the distances between the ultrasonic emitters of all the sound pickup devices and the microphones of the other sound pickup devices.

As shown in fig. 4a, the method comprises the following steps:

step 401: the master apparatus instructs the first sound pickup apparatus to prepare to transmit the ultrasonic wave signal, and instructs the first sound pickup apparatus to transmit the first transmission timing of the ultrasonic wave signal to the first sound pickup apparatus and the other sound pickup apparatuses.

In step 401, the first transmission time at which the first sound pickup apparatus transmits the ultrasonic signal is determined by the master apparatus, and in another possible implementation manner, the first sound pickup apparatus may determine the first transmission time at which the first sound pickup apparatus transmits the ultrasonic signal, notify the first sound pickup apparatus to the master apparatus, and instruct the first transmission time to the other sound pickup apparatuses by the master apparatus, which is not limited herein.

Step 402: the first sound pickup apparatus transmits a first ultrasonic signal at a first transmission timing.

The ultrasonic signals sent by each sound pickup apparatus may be the same or different, and preferably, the sound pickup apparatus identifier is carried in the ultrasonic signals sent by the sound pickup apparatus, so that the sound pickup apparatus receiving the ultrasonic signals identifies the sending apparatus of the ultrasonic signals. Thus, in one possible implementation, the first ultrasonic signal includes: an identification of the first sound pickup device.

Step 403: the second sound pickup device starts recording and detecting the first ultrasonic signal by using the first microphone at a first sending time, and sends a first receiving time when the first microphone receives the first ultrasonic signal to the main device.

Step 404: and the main equipment calculates the distance between the ultrasonic emitter of the first sound pickup equipment and the first microphone of the second sound pickup equipment according to the time difference between the first receiving time and the first sending time.

Specifically, because of the ultrasonic signal, the distance between the ultrasonic transmitter of the first sound pickup apparatus and the first microphone of the second sound pickup apparatus is equal to the sound propagation speed in the air (the time difference between the first reception time and the first transmission time).

Fig. 4b provides another embodiment of a method for acquiring the distance between the ultrasonic transmitter of the first sound pickup apparatus and the first microphone of the second sound pickup apparatus by the master apparatus, and in place of the above steps 403 and 404, the method further includes, on the basis of the above steps 401 and 402:

step 405: the second sound pickup apparatus starts recording and detecting the first ultrasonic signal using the first microphone at the first transmission time, and obtains a first reception time at which the first microphone receives the first ultrasonic signal.

Step 406: and the second sound pickup equipment calculates the distance between the ultrasonic transmitter of the first sound pickup equipment and the first microphone of the second sound pickup equipment according to the time difference between the first receiving time and the first sending time, and sends the distance to the main equipment.

If the second sound pickup apparatus is the master apparatus, the step of transmitting the distance to the master apparatus in this step and the step of receiving the distance by the master apparatus in step 407 need not be performed.

Step 407: the main equipment receives the distance between the ultrasonic transmitter of the first sound pickup equipment and the first microphone of the second sound pickup equipment, which is sent by the second sound pickup equipment.

In the method shown in fig. 4b, the distance between the microphone of the sound pickup device and the ultrasonic wave transmitter of the other sound pickup device is calculated by each sound pickup device and transmitted to the main device, so that the data processing amount of the main device is reduced.

By the method of fig. 4a or 4b, the master device obtains the distance between the ultrasonic wave emitter of the first sound pickup device and the first microphone of the second sound pickup device, and so on, the master device can obtain the distance between the ultrasonic wave emitter of the first sound pickup device and each microphone of each other sound pickup device, and further obtain the distance between the ultrasonic wave emitter of each sound pickup device and each microphone of each other sound pickup device.

An example of the method shown in FIG. 4a is illustrated: assuming that the sound pickup apparatus has 3 apparatuses 1, 2, 3, and 1 ultrasonic wave transmitter and 2 microphones are provided on each sound pickup apparatus, assuming that the master apparatus is the apparatus 2 and the first sound pickup apparatus is the apparatus 1, then:

in step 401, the device 2 instructs the device 1 to prepare to transmit an ultrasonic signal, and notifies the device 1 and the device 3 of time 1;

in step 402, the device 1 transmits an ultrasonic signal at time 1;

in step 403, the microphone 21 of the device 2, the microphone 22 of the device 2, the microphone 31 of the device 3, and the microphone 32 of the device 3 start recording at time 1, respectively, the device 2 detects time 2 when the microphone 21 receives an ultrasonic signal from the recording of the microphone 21, detects time 3 when the microphone 22 receives an ultrasonic signal from the recording of the microphone 22, and transmits time 2 corresponding to the microphone 21 and time 3 corresponding to the microphone 22 to the host device; the device 3 detects a time 4 when the microphone 31 receives the ultrasonic signal from the recording of the microphone 31, detects a time 5 when the microphone 32 receives the ultrasonic signal from the recording of the microphone 32, and sends the time 4 corresponding to the microphone 31 and the time 5 corresponding to the microphone 32 to the master device;

in step 404, the device 2 calculates the distance between the ultrasonic transmitter of the device 1 and the microphone 21 of the device 2 according to the time difference between the time 2 and the time 1, calculates the distance between the ultrasonic transmitter of the device 1 and the microphone 22 of the device 2 according to the time difference between the time 3 and the time 1, calculates the distance between the ultrasonic transmitter of the device 1 and the microphone 31 of the device 3 according to the time difference between the time 4 and the time 1, and calculates the distance between the ultrasonic transmitter of the device 1 and the microphone 32 of the device 3 according to the time difference between the time 5 and the time 1. In the same way, the device 2 can obtain the distance between the ultrasonic transmitter of the device 2 and the respective microphone of the device 1, the distance between the ultrasonic transmitter of the device 2 and the respective microphone of the device 3, the distance between the ultrasonic transmitter of the device 3 and the respective microphone of the device 1, and the distance between the ultrasonic transmitter of the device 3 and the respective microphone of the device 2.

An example of the method shown in FIG. 4b is illustrated: assuming that the sound pickup apparatus has 3 apparatuses 1, 2, 3, and 1 ultrasonic wave transmitter and 2 microphones are provided on each sound pickup apparatus, assuming that the master apparatus is the apparatus 2 and the first sound pickup apparatus is the apparatus 1, then:

in step 401, the device 2 instructs the device 1 to prepare to transmit an ultrasonic signal, and notifies the device 1 and the device 3 of time 1;

in step 402, the device 1 transmits an ultrasonic signal at time 1;

in steps 405 to 406, the microphone 21 of the device 2, the microphone 22 of the device 2, the microphone 31 of the device 3, and the microphone 32 of the device 3 start recording at time 1, respectively, the device 2 detects time 2 at which the microphone 21 receives an ultrasonic signal from the recording of the microphone 21, and calculates the distance between the ultrasonic transmitter of the device 1 and the microphone 21 of the device 2 according to the time difference between the time 2 and the time 1; the device 2 detects the time 3 when the microphone 22 receives the ultrasonic signal from the recording of the microphone 22, and calculates the distance between the ultrasonic transmitter of the device 1 and the microphone 22 of the device 2 according to the time difference between the time 3 and the time 1; the device 3 detects the time 4 when the microphone 31 receives the ultrasonic signal from the recording of the microphone 31, and calculates the distance between the ultrasonic transmitter of the device 1 and the microphone 31 of the device 3 according to the time difference between the time 4 and the time 1; detecting the time 5 when the microphone 32 receives the ultrasonic signal from the recording of the microphone 32, and calculating the distance between the ultrasonic transmitter of the device 1 and the microphone 32 of the device 3 according to the time difference between the time 5 and the time 1; the device 3 transmits the calculated two distances to the device 2.

In step 407, device 2 receives the two distance values transmitted by device 3. Thus, the device 2 obtains the distances between the ultrasonic transmitter of the device 1 and the respective microphones of the device 2, and the distances between the ultrasonic transmitter of the device 1 and the respective microphones of the device 3.

In the same way, the device 2 can obtain the distance between the ultrasonic transmitter of the device 2 and the respective microphone of the device 1, the distance between the ultrasonic transmitter of the device 2 and the respective microphone of the device 3, the distance between the ultrasonic transmitter of the device 3 and the respective microphone of the device 1, and the distance between the ultrasonic transmitter of the device 3 and the respective microphone of the device 2.

In the method shown in fig. 2a and 3, the master device first obtains the distance between the ultrasonic transmitter of each sound pickup device and the microphones of other sound pickup devices, so as to provide possible data for processing in the subsequent steps. However, in practical applications, if only a part of the sound pickup apparatus is selected as the reference apparatus in the subsequent steps, it is not necessary to use all values of the distance acquired by the master apparatus in the subsequent calculation process, that is, there is redundancy in the distance acquired by the master apparatus, and therefore, the present application also provides the following methods shown in fig. 5 and 6, and the master apparatus only acquires the distance that needs to be used, so as to eliminate the occurrence of the aforementioned redundancy.

Fig. 5 is a flowchart of another embodiment of the spatial filter enhancement method of the present application, which differs from the embodiment shown in fig. 2a mainly in that:

step 206 of fig. 2a is not included in the method of fig. 5, and the reference numerals of the subsequent steps are correspondingly modified; and, step 507 is modified to:

step 507: the master device acquires a distance between the ultrasonic transmitter of the reference device and the microphone of the device other than the reference device, and a distance between the ultrasonic transmitter of the device other than the reference device and the microphone of the reference device.

In one possible implementation manner, for the reference device selected by the master device in step 506, the acquiring, by the master device, the distance between the ultrasonic transmitter of the reference device and the microphone of the device other than the reference device in step 507 may include:

the main equipment acquires a third moment when the reference equipment sends a second ultrasonic signal;

based on each microphone of the devices except the reference device, the master device acquires a fourth moment when the microphone receives the second ultrasonic wave signal;

and the main equipment calculates the distance between the ultrasonic transmitter of the reference equipment and the microphone according to the time difference between the fourth time and the third time.

For the reference device selected by the master device in step 506, the acquiring, by the master device, the distance between the ultrasonic transmitter of the device other than the reference device and the microphone of the reference device in step 507 may include:

the master device acquires a fifth moment when the device transmits the third ultrasonic signal based on each device except the reference device;

based on each microphone of the reference device, the master device acquires a sixth moment when the microphone receives the third ultrasonic signal;

and the main equipment calculates the distance between the ultrasonic transmitter of the equipment except the reference equipment and the microphone of the reference equipment according to the time difference between the sixth time and the fifth time.

In another possible implementation manner, for the reference device selected by the master device in step 506, the acquiring, by the master device, the distance between the ultrasonic transmitter of the reference device and the microphone of the device other than the reference device and the distance between the ultrasonic transmitter of the device other than the reference device and the microphone of the reference device in step 507 may include:

the master device receives second distance information sent by the reference device, wherein the second distance information comprises: a distance between a microphone of the reference device and an ultrasonic transmitter other than the reference device;

The specific implementation of this step may also refer to the descriptions of fig. 4a to 4b, which are not described herein.

Fig. 6 is a flow chart of another embodiment of a self-calibration method for a distributed microphone array of the present application, which differs from the embodiment shown in fig. 3 mainly in that:

step 306 of fig. 3 is not included in the method of fig. 6. At this point, step 607 is modified to:

step 607: based on each of the reference devices, the master device acquires a distance between the ultrasonic transmitter of the reference device and the microphone of the device other than the reference device, and acquires a distance between the ultrasonic transmitter of the device other than the reference device and the microphone of the reference device.

In a possible implementation manner, the, on a per reference device basis, acquiring, by the master device, a distance between the ultrasonic transmitter of the reference device and a microphone of a device other than the reference device may include:

acquiring a third moment when the reference equipment transmits a second ultrasonic signal based on each reference equipment;

acquiring a fourth moment when the microphone receives the second ultrasonic signal based on each microphone of the devices except the reference device;

and calculating the distance between the ultrasonic transmitter of the reference device and the microphone according to the time difference between the fourth time and the third time.

The acquiring, by the master device, a distance between the ultrasonic transmitter of the device other than the reference device and the microphone of the reference device based on each of the reference devices may include:

acquiring a fifth moment when the equipment transmits the third ultrasonic signal based on each equipment except the reference equipment;

acquiring a sixth moment when the microphone receives the third ultrasonic signal based on each microphone of the reference device;

In another possible implementation manner, the, on a per reference device basis, acquiring, by the master device, distances between the ultrasonic transmitters of the reference device and microphones of other devices except the reference device, and acquiring distances between the ultrasonic transmitters of the other devices and the microphones of the reference device may include:

The specific implementation of this step may also refer to the descriptions in fig. 4a and fig. 4b, which are not described herein again.

Based on the above embodiment of the present application, in a certain mobile phone video live broadcast scene, the effects of picking up a single mobile phone video and picking up a multi-mobile phone collaborative video in the present application are compared, in the scene, the arrangement of mobile phones is shown in two figures in fig. 7a, in the example, a common 5-position mobile phone video live broadcast scene is referred to, assuming that each mobile phone has 2 microphones, the microphones are placed at the top edge and the bottom edge of the mobile phone, and the collaborative array self-calibration and the time delay summation spatial enhancement processing are performed according to the method of the present application, and it can be seen through the comparison between fig. 7b and fig. 7 c: the cooperative processing can generate a sharper spatial directivity effect, and the comparison between fig. 7d and fig. 7e shows that the method can bring better noise suppression capability and obviously improve the pickup quality.

The embodiment of the application does not need to fix and measure the position information of the cooperative equipment in advance, and can be suitable for the video and audio recording scene of a user for the mobile terminal equipment;

according to the embodiment of the application, self-calibration positioning calculation is carried out on the microphone position information of the cooperative array by combining an ultrasonic ranging and spherical intersection positioning calculation model, the orientation is assisted without depending on the orientation characteristic of high-frequency-band ultrasound, and the requirement can be met by selecting audible sound wave boundary frequency bands (such as 18 k-24 k Hz) generally, so that the requirement can be met even if a speaker of portable terminal equipment is adopted, and a receiver is a microphone of the equipment, so that a professional ultrasonic transmitter and a receiver are not required to be additionally added, and the hardware cost advantage is achieved.

Spatial filtering enhancement processing based on mobile portable equipment cooperative array, and better video and pickup quality of equipment

It is to be understood that some or all of the steps or operations in the above-described embodiments are merely examples, and other operations or variations of various operations may be performed by the embodiments of the present application. Further, the various steps may be performed in a different order presented in the above-described embodiments, and it is possible that not all of the operations in the above-described embodiments are performed.

Fig. 8 is a schematic structural diagram of an embodiment of a self-calibration apparatus for a distributed microphone array according to the present invention, as shown in fig. 9, the apparatus 800 may include:

a coordinate acquiring unit 810, configured to acquire a coordinate of a microphone of each sound pickup apparatus in a coordinate system of the sound pickup apparatus to which the microphone belongs, where the sound pickup apparatus is an apparatus that performs coordinated sound pickup, and the coordinate system of the sound pickup apparatus is a coordinate system established with an ultrasonic transmitter of the sound pickup apparatus as an origin;

a first distance acquisition unit 820 for selecting at least one sound pickup apparatus from the sound pickup apparatuses as a reference apparatus; acquiring the distance between the ultrasonic transmitter of the reference equipment and the microphone of the equipment except the reference equipment and acquiring the distance between the ultrasonic transmitter of the equipment except the reference equipment and the microphone of the reference equipment on the basis of each reference equipment;

a relative coordinate calculation unit 830, configured to calculate, according to the coordinates acquired by the coordinate acquisition unit 810 and the distance acquired by the distance acquisition unit 820, relative position coordinates of an origin of the non-main reference device with respect to a main origin; the primary reference device is one of the reference devices, the non-primary reference device is a device other than a primary reference device, and the primary origin is an origin of a coordinate system of the primary reference device;

a microphone coordinate calculating unit 840, configured to calculate coordinates of a microphone of each sound pickup device in a main coordinate system according to the relative position coordinates calculated by the relative coordinate calculating unit 830 and the coordinates acquired by the coordinate acquiring unit 810, so as to obtain a distributed microphone array; the master coordinate system is the coordinate system of the master reference device.

In one possible implementation, referring to fig. 9, the apparatus 800 may further include:

a second distance acquisition unit 910 for acquiring a distance between the ultrasonic transmitter of each sound pickup apparatus and the microphone of the other sound pickup apparatus;

correspondingly, the first distance obtaining unit 820 may specifically be configured to: on the basis of each of the reference devices, the distance between the ultrasonic transmitter of the reference device and the microphone of the device other than the reference device, and the distance between the ultrasonic transmitter of the device other than the reference device and the microphone of the reference device are acquired from the distances acquired by the second distance acquisition unit 910.

In a possible implementation manner, the second distance obtaining unit 910 may specifically be configured to:

acquiring a first moment when the sound pickup equipment sends a first ultrasonic signal by using an ultrasonic transmitter on the basis of each sound pickup equipment;

In another possible implementation manner, the second distance obtaining unit 910 may specifically be configured to:

In a possible implementation manner, the first distance obtaining unit 820 may include:

the time acquiring subunit is configured to acquire, based on each device other than the reference device, a fifth time at which the device transmits the third ultrasonic signal; acquiring a sixth moment when the microphone receives the third ultrasonic signal based on each microphone of the reference device;

and the distance calculating subunit is configured to calculate, according to the time difference between the sixth time and the fifth time, the distance between the ultrasonic transmitter of the device other than the reference device and the microphone of the reference device.

In a possible implementation manner, the first distance obtaining unit 820 may specifically be configured to:

In a possible implementation manner, if one of the sound pickup apparatuses is selected as a reference apparatus, the relative coordinate calculation unit 830 may be specifically configured to:

and calculating relative position coordinates of the origin of the non-main reference equipment relative to the main origin according to the coordinates and the distance calculated based on the main reference equipment.

In a possible implementation manner, if at least two sound pickup apparatuses are selected from the sound pickup apparatuses as a reference apparatus, the relative coordinate calculation unit 830 may be specifically configured to:

In a possible implementation manner, referring to fig. 10, on the basis of the apparatus shown in fig. 8, the apparatus 800 may further include:

a synchronization unit 1010 configured to synchronize clock information of the sound pickup apparatus before the first distance acquisition unit acquires the distance.

Referring to fig. 10, the apparatus 800 may further include:

a sound pickup negotiation unit 1020, configured to select, before the coordinate obtaining unit obtains the coordinate, sound pickup devices in the same network from a device list in a UI page; sending a collaborative sound pickup invitation to the selected sound pickup equipment; receiving reply information of the sound pickup equipment based on the collaborative sound pickup invitation.

The above-mentioned apparatus may be used to implement the technical solutions of the method embodiments shown in fig. 1 to fig. 6 of the present application, and the implementation principles and technical effects thereof may further refer to the related descriptions in the method embodiments.

It should be understood that the division of the units of the above-shown devices is only a logical division, and the actual implementation may be wholly or partially integrated into one physical entity or may be physically separated. And these units can be implemented entirely in software, invoked by a processing element; or may be implemented entirely in hardware; part of the units can also be realized in the form of software called by a processing element, and part of the units can be realized in the form of hardware. For example, the coordinate obtaining unit may be a processing element separately set up, or may be implemented by being integrated in a certain chip of the electronic device. The implementation of the other units is similar. In addition, all or part of the units can be integrated together or can be independently realized. In the implementation, the steps of the above method or the above units may be implemented by integrated logic circuits of hardware in a processor element or instructions in the form of software.

For example, the above units may be one or more integrated circuits configured to implement the above methods, such as: one or more Application Specific Integrated Circuits (ASICs), one or more microprocessors (DSPs), one or more Field Programmable Gate Arrays (FPGAs), etc. For another example, these units may be integrated together and implemented in the form of a System-On-a-Chip (SOC).

Fig. 11 is a schematic structural diagram of an embodiment of an electronic device of the present application, and as shown in fig. 11, the electronic device may include: a display screen; one or more processors; a memory; and one or more computer programs.

Wherein, the display screen can comprise a display screen of a vehicle-mounted computer (Mobile Data Center); the electronic equipment can be mobile terminals (mobile phones), smart screens, unmanned aerial vehicles, Intelligent networked vehicles (ICV), smart car (smart/Intelligent car) or Vehicle-mounted equipment and the like.

Wherein the one or more computer programs are stored in the memory, the one or more computer programs comprising instructions which, when executed by the apparatus, cause the apparatus to perform the steps of:

acquiring coordinates of a microphone of each sound pickup equipment in a coordinate system of the sound pickup equipment, wherein the sound pickup equipment is used for carrying out coordinated sound pickup, and the coordinate system of the sound pickup equipment is a coordinate system established by taking an ultrasonic transmitter of the sound pickup equipment as an origin; and the number of the first and second electrodes,

In one possible implementation, when the instructions are executed by the apparatus, the apparatus is caused to perform the steps of, based on each of the reference apparatuses, acquiring a distance between the ultrasonic transmitter of the reference apparatus and the microphone of the apparatus other than the reference apparatus, and, before the step of acquiring the distance between the ultrasonic transmitter of the apparatus other than the reference apparatus and the microphone of the reference apparatus, further performing the steps of:

acquiring the distance between the ultrasonic transmitter of each sound pickup equipment and the microphones of other sound pickup equipment;

In one possible implementation, when the instructions are executed by the apparatus, the apparatus is caused to perform the step of obtaining the distance between the ultrasonic transmitter of each sound pickup apparatus and the microphones of the other sound pickup apparatuses includes:

acquiring a first moment when the sound pickup equipment sends a first ultrasonic signal by using an ultrasonic transmitter on the basis of each sound pickup equipment;

In one possible implementation, the instructions, when executed by the device, cause the device to perform the step of acquiring, on a per reference device basis, a distance between an ultrasonic transmitter of the reference device and a microphone of a device other than the reference device, including:

acquiring a third moment when the reference equipment transmits a second ultrasonic signal based on each reference equipment;

acquiring a fourth moment when the microphone receives the second ultrasonic signal based on each microphone of the devices except the reference device;

and calculating the distance between the ultrasonic transmitter of the reference device and the microphone according to the time difference between the fourth time and the third time.

In one possible implementation, the instructions, when executed by the device, cause the device to perform the step of acquiring, on a per reference device basis, the distance between the ultrasonic transmitter of the device other than the reference device and the microphone of the reference device, including:

acquiring a fifth moment when the equipment transmits the third ultrasonic signal based on each equipment except the reference equipment;

acquiring a sixth moment when the microphone receives the third ultrasonic signal based on each microphone of the reference device;

In one possible implementation, when the instructions are executed by the apparatus, the apparatus is caused to execute the step of acquiring, based on each of the reference apparatuses, a distance between the ultrasonic transmitter of the reference apparatus and the microphone of the apparatus other than the reference apparatus, and the step of acquiring the distance between the ultrasonic transmitter of the apparatus other than the reference apparatus and the microphone of the reference apparatus includes:

Selecting one of the sound pickup apparatuses as a reference apparatus, the instructions when executed by the apparatus causing the apparatus to perform the step of calculating relative position coordinates of an origin of a non-main reference apparatus with respect to a main origin from the coordinates and based on the distance calculated by each of the reference apparatuses comprising:

Selecting at least two of the pickups as reference devices, the instructions when executed by the device causing the device to perform the step of calculating relative position coordinates of an origin of a non-main reference device with respect to a main origin from the coordinates and based on the distance calculated by each of the reference devices comprises:

and synchronizing clock information of the sound pickup equipment.

In a possible implementation, when the instructions are executed by the apparatus, the apparatus is caused to perform the following steps before the step of obtaining the coordinates of the microphone of each pickup apparatus in the coordinate system of the pickup apparatus:

selecting pickup equipment in the same network from an equipment list in a UI page;

sending a collaborative sound pickup invitation to the selected sound pickup equipment;

and receiving reply information of the sound pickup equipment based on the collaborative sound pickup invitation.

The electronic device shown in fig. 11 may be a terminal device or a circuit device built in the terminal device. The apparatus may be used to perform the functions/steps of the methods provided by the embodiments of fig. 1-6 of the present application.

The electronic device 1100 may include a processor 1110, an external memory interface 1120, an internal memory 1121, a Universal Serial Bus (USB) interface 1130, a charging management module 1140, a power management module 1141, a battery 1142, an antenna 1, an antenna 2, a mobile communication module 1150, a wireless communication module 1160, an audio module 1170, a speaker 1170A, a receiver 1170B, a microphone 1170C, an earphone interface 1170D, a sensor module 1180, a button 1190, a motor 1191, an indicator 1192, a camera 1193, a display 1194, and a Subscriber Identity Module (SIM) card interface 1195, among others. The sensor module 1180 may include a pressure sensor 1180A, a gyroscope sensor 1180B, an air pressure sensor 1180C, a magnetic sensor 1180D, an acceleration sensor 1180E, a distance sensor 1180F, a proximity light sensor 1180G, a fingerprint sensor 1180H, a temperature sensor 1180J, a touch sensor 1180K, an ambient light sensor 1180L, a bone conduction sensor 1180M, and the like.

It is to be understood that the illustrated configuration of the embodiment of the invention does not constitute a specific limitation on the electronic device 1100. In other embodiments of the present application, electronic device 1100 may include more or fewer components than shown, or some components may be combined, some components may be split, or a different arrangement of components. The illustrated components may be implemented in hardware, software, or a combination of software and hardware.

Processor 1110 may include one or more processing units, such as: processor 1110 may include an Application Processor (AP), a modem processor, a Graphics Processing Unit (GPU), an Image Signal Processor (ISP), a controller, a video codec, a Digital Signal Processor (DSP), a baseband processor, and/or a neural-Network Processing Unit (NPU), among others. The different processing units may be separate devices or may be integrated into one or more processors.

The controller can generate an operation control signal according to the instruction operation code and the timing signal to complete the control of instruction fetching and instruction execution.

A memory may also be provided in processor 1110 for storing instructions and data. In some embodiments, the memory in processor 1110 is a cache memory. The memory may hold instructions or data that have just been used or recycled by processor 1110. If processor 1110 needs to use the instruction or data again, it can be called directly from the memory. Avoiding repeated accesses reduces the latency of the processor 1110, thereby increasing the efficiency of the system.

In some embodiments, processor 1110 may include one or more interfaces. The interface may include an integrated circuit (I2C) interface, an integrated circuit built-in audio (I2S) interface, a Pulse Code Modulation (PCM) interface, a universal asynchronous receiver/transmitter (UART) interface, a Mobile Industry Processor Interface (MIPI), a general-purpose input/output (GPIO) interface, a Subscriber Identity Module (SIM) interface, and/or a Universal Serial Bus (USB) interface, etc.

The I2C interface is a bi-directional synchronous serial bus that includes a serial data line (SDA) and a Serial Clock Line (SCL). In some embodiments, processor 1110 may include multiple sets of I2C buses. The processor 1110 may be respectively coupled to the touch sensor 1180K, the charger, the flash lamp, the camera 1193, and the like through different I2C bus interfaces. For example: the processor 1110 may be coupled to the touch sensor 1180K through an I2C interface, so that the processor 1110 and the touch sensor 1180K communicate through an I2C bus interface to implement a touch function of the electronic device 1100.

The I2S interface may be used for audio communication. In some embodiments, processor 1110 may include multiple sets of I2S buses. The processor 1110 may be coupled to the audio module 1170 via an I2S bus for enabling communication between the processor 1110 and the audio module 1170. In some embodiments, the audio module 1170 may communicate audio signals to the wireless communication module 1160 via the I2S interface to enable answering a call via a bluetooth headset.

The PCM interface may also be used for audio communication, sampling, quantizing and encoding analog signals. In some embodiments, the audio module 1170 and the wireless communication module 1160 may be coupled by a PCM bus interface. In some embodiments, the audio module 1170 may also pass audio signals through the PCM interface to the wireless communication module 1160 to enable answering a phone call through a Bluetooth headset. Both the I2S interface and the PCM interface may be used for audio communication.

The UART interface is a universal serial data bus used for asynchronous communications. The bus may be a bidirectional communication bus. It converts the data to be transmitted between serial communication and parallel communication. In some embodiments, a UART interface is generally used to connect the processor 1110 with the wireless communication module 1160. For example: the processor 1110 communicates with the bluetooth module in the wireless communication module 1160 through the UART interface to implement the bluetooth function. In some embodiments, the audio module 1170 may pass audio signals to the wireless communication module 1160 via the UART interface to implement the function of playing music via the bluetooth headset.

The MIPI interface may be used to connect the processor 1110 with peripheral devices such as a display 1194, a camera 1193, and the like. The MIPI interface includes a Camera Serial Interface (CSI), a Display Serial Interface (DSI), and the like. In some embodiments, processor 1110 and camera 1193 communicate over a CSI interface to implement the capture functions of electronic device 1100. Processor 1110 and display screen 1194 communicate via a DSI interface to implement display functions of electronic device 1100.

The GPIO interface may be configured by software. The GPIO interface may be configured as a control signal and may also be configured as a data signal. In some embodiments, a GPIO interface may be used to connect the processor 1110 with the camera 1193, the display screen 1194, the wireless communication module 1160, the audio module 1170, the sensor module 1180, and the like. The GPIO interface may also be configured as an I2C interface, an I2S interface, a UART interface, a MIPI interface, and the like.

The USB interface 1130 is an interface conforming to the USB standard specification, and may specifically be a Mini USB interface, a Micro USB interface, a USB Type C interface, or the like. The USB interface 1130 may be used to connect a charger to charge the electronic device 1100, and may also be used to transmit data between the electronic device 1100 and a peripheral device. And the earphone can be connected to play audio through the earphone. The interface may also be used to connect other electronic devices, such as AR devices and the like.

It is to be understood that the connection relationship between the modules according to the embodiment of the present invention is only illustrative, and does not limit the structure of the electronic device 1100. In other embodiments of the present application, the electronic device 1100 may also adopt different interface connection manners or a combination of multiple interface connection manners in the above embodiments.

The charge management module 1140 is used to receive charging input from a charger. The charger may be a wireless charger or a wired charger. In some wired charging embodiments, the charging management module 1140 may receive charging input from a wired charger via the USB interface 1130. In some wireless charging embodiments, the charging management module 1140 may receive a wireless charging input through a wireless charging coil of the electronic device 1100. The charging management module 1140 can also supply power to the electronic device through the power management module 1141 while charging the battery 1142.

The power management module 1141 is used to connect the battery 1142, the charging management module 1140 and the processor 1110. The power management module 1141 receives input from the battery 1142 and/or the charging management module 1140, and provides power to the processor 1110, the internal memory 1121, the display 1194, the camera 1193, the wireless communication module 1160, and the like. The power management module 1141 may also be used to monitor parameters such as battery capacity, battery cycle number, battery state of health (leakage, impedance), etc. In other embodiments, the power management module 1141 may be disposed in the processor 1110. In other embodiments, the power management module 1141 and the charging management module 1140 may be disposed in the same device.

The wireless communication function of the electronic device 1100 may be implemented by the antenna 1, the antenna 2, the mobile communication module 1150, the wireless communication module 1160, the modem processor, the baseband processor, and the like.

The antennas 1 and 2 are used for transmitting and receiving electromagnetic wave signals. Each antenna in the electronic device 1100 may be used to cover a single or multiple communication bands. Different antennas can also be multiplexed to improve the utilization of the antennas. For example: the antenna 1 may be multiplexed as a diversity antenna of a wireless local area network. In other embodiments, the antenna may be used in conjunction with a tuning switch.

The mobile communication module 1150 may provide a solution including 2G/3G/4G/5G and the like wireless communication applied on the electronic device 1100. The mobile communication module 1150 may include at least one filter, switch, power amplifier, Low Noise Amplifier (LNA), and the like. The mobile communication module 1150 may receive electromagnetic waves from the antenna 1, filter, amplify, etc. the received electromagnetic waves, and transmit the processed electromagnetic waves to the modem processor for demodulation. The mobile communication module 1150 may also amplify the signal modulated by the modem processor, and convert the signal into electromagnetic wave through the antenna 1 to radiate the electromagnetic wave. In some embodiments, at least some of the functional modules of the mobile communication module 1150 may be disposed in the processor 1110. In some embodiments, at least some of the functional blocks of the mobile communication module 1150 may be disposed in the same device as at least some of the blocks of the processor 1110.

The modem processor may include a modulator and a demodulator. The modulator is used for modulating a low-frequency baseband signal to be transmitted into a medium-high frequency signal. The demodulator is used for demodulating the received electromagnetic wave signal into a low-frequency baseband signal. The demodulator then passes the demodulated low frequency baseband signal to a baseband processor for processing. The low frequency baseband signal is processed by the baseband processor and then transferred to the application processor. The application processor outputs sound signals through an audio device (not limited to speaker 1170A, receiver 1170B, etc.) or displays images or video through display screen 1194. In some embodiments, the modem processor may be a stand-alone device. In other embodiments, the modem processor may be separate from the processor 1110, and may be located in the same device as the mobile communication module 1150 or other functional modules.

The wireless communication module 1160 may provide a solution for wireless communication applied to the electronic device 1100, including Wireless Local Area Networks (WLANs) (e.g., wireless fidelity (Wi-Fi) networks), Bluetooth (BT), Global Navigation Satellite System (GNSS), Frequency Modulation (FM), Near Field Communication (NFC), Infrared (IR), and the like. The wireless communication module 1160 may be one or more devices that integrate at least one communication processing module. The wireless communication module 1160 receives electromagnetic waves via the antenna 2, performs frequency modulation and filtering on electromagnetic wave signals, and transmits the processed signals to the processor 1110. Wireless communication module 1160 may also receive signals to be transmitted from processor 1110, frequency modulate, amplify, and convert to electromagnetic radiation via antenna 2.

In some embodiments, the antenna 1 and the mobile communication module 1150 of the electronic device 1100 are coupled and the antenna 2 and the wireless communication module 1160 are coupled such that the electronic device 1100 can communicate with networks and other devices through wireless communication techniques. The wireless communication technology may include global system for mobile communications (GSM), General Packet Radio Service (GPRS), code division multiple access (code division multiple access, CDMA), Wideband Code Division Multiple Access (WCDMA), time-division code division multiple access (time-division code division multiple access, TD-SCDMA), Long Term Evolution (LTE), BT, GNSS, WLAN, NFC, FM, and/or IR technologies, etc. The GNSS may include a Global Positioning System (GPS), a global navigation satellite system (GLONASS), a beidou navigation satellite system (BDS), a quasi-zenith satellite system (QZSS), and/or a Satellite Based Augmentation System (SBAS).

The electronic device 1100 implements display functions via the GPU, the display screen 1194, and the application processor, among others. The GPU is a microprocessor for image processing, connected to the display screen 1194 and the application processor. The GPU is used to perform mathematical and geometric calculations for graphics rendering. Processor 1110 may include one or more GPUs that execute program instructions to generate or alter display information.

The display screen 1194 is used to display images, video, and the like. Display screen 1194 includes a display panel. The display panel may adopt a Liquid Crystal Display (LCD), an organic light-emitting diode (OLED), an active-matrix organic light-emitting diode (active-matrix organic light-emitting diode, AMOLED), a flexible light-emitting diode (FLED), a miniature, a Micro-oeld, a quantum dot light-emitting diode (QLED), and the like. In some embodiments, the electronic device 1100 may include 1 or N display screens 1194, N being a positive integer greater than 1.

The electronic device 1100 may implement a shooting function via the ISP, the camera 1193, the video codec, the GPU, the display screen 1194, the application processor, and the like.

The ISP is used to process the data fed back by the camera 1193. For example, when a photo is taken, the shutter is opened, light is transmitted to the camera photosensitive element through the lens, the optical signal is converted into an electrical signal, and the camera photosensitive element transmits the electrical signal to the ISP for processing and converting into an image visible to naked eyes. The ISP can also carry out algorithm optimization on the noise, brightness and skin color of the image. The ISP can also optimize parameters such as exposure, color temperature and the like of a shooting scene. In some embodiments, the ISP may be provided in camera 1193.

The camera 1193 is used to capture still images or video. The object generates an optical image through the lens and projects the optical image to the photosensitive element. The photosensitive element may be a Charge Coupled Device (CCD) or a complementary metal-oxide-semiconductor (CMOS) phototransistor. The light sensing element converts the optical signal into an electrical signal, which is then passed to the ISP where it is converted into a digital image signal. And the ISP outputs the digital image signal to the DSP for processing. The DSP converts the digital image signal into image signal in standard RGB, YUV and other formats. In some embodiments, the electronic device 1100 may include 1 or N cameras 1193, N being a positive integer greater than 1.

The digital signal processor is used for processing digital signals, and can process digital image signals and other digital signals. For example, when the electronic device 1100 selects frequency points, the digital signal processor is used to perform fourier transform or the like on the frequency point energy.

Video codecs are used to compress or decompress digital video. The electronic device 1100 may support one or more video codecs. As such, electronic device 1100 may play or record video in a variety of encoding formats, such as: moving Picture Experts Group (MPEG) 1, MPEG2, MPEG3, MPEG4, and the like.

The NPU is a neural-network (NN) computing processor, which processes input information quickly by referring to a biological neural network structure, for example, by referring to a transfer mode between neurons of a human brain, and can also learn by itself continuously. Applications such as intelligent cognition of the electronic device 1100 can be achieved through the NPU, for example: image recognition, face recognition, speech recognition, text understanding, and the like.

The external memory interface 1120 can be used for connecting an external memory card, such as a Micro SD card, to extend the memory capability of the electronic device 1100. The external memory card communicates with the processor 1110 through the external memory interface 1120 to implement a data storage function. For example, files such as music, video, etc. are saved in an external memory card.

The internal memory 1121 may be used to store computer-executable program code, including instructions. The internal memory 1121 may include a program storage area and a data storage area. The storage program area may store an operating system, an application program (such as a sound playing function, an image playing function, etc.) required by at least one function, and the like. The data storage area may store data (e.g., audio data, a phonebook, etc.) created during use of the electronic device 1100, and the like. In addition, the internal memory 1121 may include a high-speed random access memory, and may also include a nonvolatile memory, such as at least one magnetic disk storage device, a flash memory device, a universal flash memory (UFS), and the like. The processor 1110 executes various functional applications of the electronic device 1100 and data processing by executing instructions stored in the internal memory 1121 and/or instructions stored in a memory provided in the processor.

The electronic device 1100 may implement audio functions via an audio module 1170, speaker 1170A, receiver 1170B, microphone 1170C, headset interface 1170D, and application processor, among other things. Such as music playing, recording, etc.

The audio module 1170 functions to convert digital audio information into an analog audio signal for output and also functions to convert an analog audio input into a digital audio signal. The audio module 1170 may also be used to encode and decode audio signals. In some embodiments, the audio module 1170 may be disposed in the processor 1110, or some of the functional modules of the audio module 1170 may be disposed in the processor 1110.

The speaker 1170A, also referred to as a "horn", is used to convert electrical audio signals into sound signals. The electronic device 1100 may listen to music through the speaker 1170A or listen to a hands-free conversation.

Receiver 1170B, also called "earpiece", is used to convert the electrical audio signal into an acoustic signal. When the electronic device 1100 receives a call or voice information, it can receive the voice by bringing the receiver 1170B close to the ear of the person.

Microphone 1170C, also known as a "microphone," converts sound signals into electrical signals. When making a call or transmitting voice information, a user can input a voice signal to the microphone 1170C by uttering sound through the mouth close to the microphone 1170C. The electronic device 1100 may be provided with at least one microphone 1170C. In other embodiments, the electronic device 1100 may be provided with two microphones 1170C to perform noise reduction functions in addition to collecting sound signals. In other embodiments, the electronic device 1100 may further include three, four or more microphones 1170C to collect sound signals, reduce noise, identify sound sources, perform directional recording, and so on.

The headphone interface 1170D is used to connect wired headphones. The headset interface 1170D may be a USB interface 1130, or may be a 3.5mm open mobile electronic device platform (OMTP) standard interface, a cellular telecommunications industry association (cellular telecommunications industry association of the USA, CTIA) standard interface.

Pressure sensor 1180A is configured to sense a pressure signal, which may be converted to an electrical signal. In some embodiments, pressure sensor 1180A may be disposed on display screen 1194. Pressure sensor 1180A may be of a wide variety of types, such as a resistive pressure sensor, an inductive pressure sensor, a capacitive pressure sensor, or the like. The capacitive pressure sensor may be a sensor comprising at least two parallel plates having an electrically conductive material. When a force acts on pressure sensor 1180A, the capacitance between the electrodes changes. The electronic device 1100 determines the strength of the pressure from the change in capacitance. When a touch operation is applied to the display screen 1194, the electronic device 1100 detects the intensity of the touch operation according to the pressure sensor 1180A. The electronic device 1100 may also calculate the touched position from the detection signal of the pressure sensor 1180A. In some embodiments, touch operations that are applied to the same touch position but with different touch operation intensities may correspond to different operation instructions. For example: and when the touch operation with the touch operation intensity smaller than the first pressure threshold value acts on the short message application icon, executing an instruction for viewing the short message. And when the touch operation with the touch operation intensity larger than or equal to the first pressure threshold value acts on the short message application icon, executing an instruction of newly building the short message.

The gyro sensor 1180B may be used to determine a motion gesture of the electronic device 1100. In some embodiments, the angular velocity of electronic device 100 about three axes (i.e., the x, y, and z axes) may be determined by gyroscope sensor 1180B. The gyro sensor 1180B may be used to photograph anti-shake. Illustratively, when the shutter is pressed, the gyro sensor 1180B detects a shake angle of the electronic device 1100, calculates a distance that the lens module needs to compensate according to the shake angle, and allows the lens to counteract the shake of the electronic device 1100 through a reverse movement, thereby achieving anti-shake. The gyro sensor 1180B may also be used for navigation, somatosensory gaming scenes.

Barometric pressure sensor 1180C is used to measure barometric pressure. In some embodiments, electronic device 1100 calculates altitude, aiding in positioning and navigation from barometric pressure values measured by barometric pressure sensor 1180C.

The magnetic sensor 1180D includes a hall sensor. The electronic device 1100 may detect the opening and closing of the flip holster using the magnetic sensor 1180D. In some embodiments, when the electronic device 1100 is a flip phone, the electronic device 1100 may detect the opening and closing of the flip according to the magnetic sensor 1180D. And then according to the opening and closing state of the leather sheath or the opening and closing state of the flip cover, the characteristics of automatic unlocking of the flip cover and the like are set.

Acceleration sensor 1180E may detect the magnitude of acceleration of electronic device 1100 in various directions (typically three axes). The magnitude and direction of gravity may be detected when the electronic device 1100 is stationary. The method can also be used for recognizing the posture of the electronic equipment, and can be applied to horizontal and vertical screen switching, pedometers and other applications.

A distance sensor 1180F for measuring distance. The electronic device 1100 may measure distance by infrared or laser. In some embodiments, shooting a scene, the electronic device 1100 may utilize the distance sensor 1180F to range to achieve fast focus.

The proximity light sensor 1180G may include, for example, a Light Emitting Diode (LED) and a light detector, such as a photodiode. The light emitting diode may be an infrared light emitting diode. The electronic device 1100 emits infrared light to the outside through the light emitting diode. The electronic device 1100 uses a photodiode to detect infrared reflected light from nearby objects. When sufficient reflected light is detected, it can be determined that there is an object near the electronic device 1100. When insufficient reflected light is detected, the electronic device 1100 can determine that there are no objects near the electronic device 1100. The electronic device 1100 may detect that the user holds the electronic device 1100 close to the ear by using the proximity light sensor 1180G, so as to automatically turn off the screen to save power. The proximity light sensor 1180G may also be used in a holster mode, with the pocket mode automatically unlocking and locking the screen.

The ambient light sensor 1180L is used to sense ambient light brightness. The electronic device 1100 may adaptively adjust the brightness of the display screen 1194 based on the perceived ambient light brightness. The ambient light sensor 1180L may also be used to automatically adjust the white balance when taking a picture. The ambient light sensor 1180L may also cooperate with the proximity light sensor 1180G to detect whether the electronic device 1100 is in a pocket, so as to prevent accidental touch.

The fingerprint sensor 1180H is used to collect a fingerprint. The electronic device 1100 may utilize the collected fingerprint characteristics to implement fingerprint unlocking, access an application lock, fingerprint photographing, fingerprint incoming call answering, and the like.

The temperature sensor 1180J is used to detect temperature. In some embodiments, electronic device 1100 implements a temperature processing strategy using the temperature detected by temperature sensor 1180J. For example, when the temperature reported by the temperature sensor 1180J exceeds a threshold, the electronic device 1100 may perform a reduction in performance of a processor located near the temperature sensor 1180J, so as to reduce power consumption and implement thermal protection. In other embodiments, the electronic device 1100 heats the battery 1142 when the temperature is below another threshold to avoid abnormal shutdown of the electronic device 1100 due to low temperature. In other embodiments, the electronic device 1100 performs a boost on the output voltage of the battery 1142 when the temperature is below a further threshold to avoid abnormal shutdown due to low temperature.

The touch sensor 1180K is also referred to as a "touch device". The touch sensor 1180K may be disposed on the display screen 1194, and the touch sensor 1180K and the display screen 1194 form a touch screen, which is also referred to as a "touch screen". The touch sensor 1180K is used to detect a touch operation applied thereto or thereabout. The touch sensor can communicate the detected touch operation to the application processor to determine the touch event type. Visual output related to the touch operation may be provided through the display screen 1194. In other embodiments, the touch sensor 1180K may be disposed on a surface of the electronic device 1100 at a different location than the display screen 1194.

The bone conduction sensor 1180M may acquire a vibration signal. In some embodiments, the bone conduction sensor 1180M may acquire a vibration signal of the human voice vibrating the bone mass. The bone conduction sensor 1180M may also contact the human body pulse to receive the blood pressure pulsation signal. In some embodiments, the bone conduction sensor 1180M may also be disposed in a headset, integrated into a bone conduction headset. The audio module 1170 may analyze a voice signal based on the vibration signal of the bone mass vibrated by the sound part obtained by the bone conduction sensor 1180M, so as to implement a voice function. The application processor can analyze heart rate information based on the blood pressure pulsation signal acquired by the bone conduction sensor 1180M, so as to realize a heart rate detection function.

Keys 1190 include a power on key, volume key, etc. Keys 1190 may be mechanical keys. Or may be touch keys. The electronic device 1100 may receive a key input, and generate a key signal input related to user setting and function control of the electronic device 1100.

The motor 1191 may generate a vibration cue. Motor 1191 may be used for incoming vibration prompts, as well as for touch vibration feedback. For example, touch operations applied to different applications (e.g., photographing, audio playing, etc.) may correspond to different vibration feedback effects. The motor 1191 may also respond to different vibration feedback effects for touch operations applied to different areas of the display screen 1194. Different application scenes (such as time reminding, information receiving, alarm clock, game and the like) can also correspond to different vibration feedback effects. The touch vibration feedback effect may also support customization.

Indicator 1192 may be an indicator light that may be used to indicate a state of charge, a change in charge, or may be used to indicate a message, a missed call, a notification, etc.

The SIM card interface 1195 is used to connect a SIM card. The SIM card can be attached to and detached from the electronic device 1100 by being inserted into the SIM card interface 1195 or being pulled out of the SIM card interface 1195. The electronic device 1100 may support 1 or N SIM card interfaces, N being a positive integer greater than 1. The SIM card interface 1195 may support a Nano SIM card, a Micro SIM card, a SIM card, etc. The same SIM card interface 1195 can be inserted with multiple cards at the same time. The types of the plurality of cards may be the same or different. The SIM card interface 1195 may also be compatible with different types of SIM cards. The SIM card interface 1195 may also be compatible with external memory cards. The electronic device 1100 interacts with the network through the SIM card to implement functions such as telephony and data communication. In some embodiments, the electronic device 1100 employs esims, namely: an embedded SIM card. The eSIM card can be embedded in the electronic device 1100 and cannot be separated from the electronic device 1100.

It should be understood that the electronic device 1100 shown in fig. 11 is capable of implementing the processes of the methods provided by the embodiments shown in fig. 1-6 of the present application. The operations and/or functions of the respective modules in the electronic device 1100 are respectively for implementing the corresponding flows in the above-described method embodiments. For details, reference may be made to the description of the method embodiment shown in fig. 1 to 6 of the present application, and a detailed description is appropriately omitted herein to avoid redundancy.

It should be understood that the processor 1110 in the electronic device 1100 shown in fig. 11 may be a system on chip SOC, and the processor 1110 may include a Central Processing Unit (CPU) and may further include other types of processors, for example: an image Processing Unit (GPU), and the like.

In summary, various parts of the processor or processing units inside the processor 1110 may cooperate to implement the foregoing method procedures, and corresponding software programs of the various parts of the processor or processing units may be stored in the internal memory 121.

The application also provides an electronic device, which includes a storage medium and a central processing unit, where the storage medium may be a non-volatile storage medium, and a computer executable program is stored in the storage medium, and the central processing unit is connected to the non-volatile storage medium and executes the computer executable program to implement the method provided by the embodiment illustrated in fig. 1 to 6 of the present application.

In the above embodiments, the processors may include, for example, a CPU, a DSP, a microcontroller, or a digital Signal processor, and may further include a GPU, an embedded Neural Network Processor (NPU), and an Image Signal Processing (ISP), and the processors may further include necessary hardware accelerators or logic Processing hardware circuits, such as an ASIC, or one or more integrated circuits for controlling the execution of the program according to the present application. Further, the processor may have the functionality to operate one or more software programs, which may be stored in the storage medium.

Embodiments of the present application further provide a computer-readable storage medium, in which a computer program is stored, and when the computer program runs on a computer, the computer is enabled to execute the method provided by the embodiments shown in fig. 1 to 6 of the present application.

Embodiments of the present application further provide a computer program product, which includes a computer program and when the computer program runs on a computer, the computer executes the method provided in the embodiments shown in fig. 1 to 6 of the present application.

In the embodiments of the present application, "at least one" means one or more, "a plurality" means two or more. "and/or" describes the association relationship of the associated objects, and means that there may be three relationships, for example, a and/or B, and may mean that a exists alone, a and B exist simultaneously, and B exists alone. Wherein A and B can be singular or complex. The character "/" generally indicates that the former and latter associated objects are in an "or" relationship. "at least one of the following" and similar expressions refer to any combination of these items, including any combination of singular or plural items. For example, at least one of a, b, and c may represent: a, b, c, a and b, a and c, b and c or a and b and c, wherein a, b and c can be single or multiple.

Those of ordinary skill in the art will appreciate that the various elements and algorithm steps described in connection with the embodiments disclosed herein can be implemented as electronic hardware, computer software, or combinations of electronic hardware. Whether such functionality is implemented as hardware or software depends upon the particular application and design constraints imposed on the implementation. Skilled artisans may implement the described functionality in varying ways for each particular application, but such implementation decisions should not be interpreted as causing a departure from the scope of the present application.

It is clear to those skilled in the art that, for convenience and brevity of description, the specific working processes of the above-described systems, apparatuses and units may refer to the corresponding processes in the foregoing method embodiments, and are not described herein again.

In the several embodiments provided in the present application, any function, if implemented in the form of a software functional unit and sold or used as a separate product, may be stored in a computer readable storage medium. Based on such understanding, the technical solution of the present application or portions thereof that substantially contribute to the prior art may be embodied in the form of a software product stored in a storage medium and including instructions for causing a computer device (which may be a personal computer, a server, or a network device) to execute all or part of the steps of the method according to the embodiments of the present application. And the aforementioned storage medium includes: a U disk, a removable hard disk, a Read-Only Memory (ROM), a Random Access Memory (RAM), a magnetic disk or an optical disk, and other various media capable of storing program codes.

The above description is only for the specific embodiments of the present application, and any person skilled in the art can easily conceive of the changes or substitutions within the technical scope of the present disclosure, and all the changes or substitutions should be covered by the protection scope of the present application. The protection scope of the present application shall be subject to the protection scope of the claims.

47页详细技术资料下载

上一篇：一种医用注射器针头装配设备

下一篇：基于自适应滤波器和神经网络的声学回声消除方法及系统

Self-calibration method and device of distributed microphone array and electronic equipment

相关技术

网友询问留言