Howling suppression method, howling suppression device, headphone, and storage medium
阅读说明：本技术 啸叫声的抑制方法、啸叫声的抑制装置、耳机及存储介质 (Howling suppression method, howling suppression device, headphone, and storage medium ) 是由 周岭松 于 2021-07-30 设计创作，主要内容包括：本公开是关于一种啸叫声的抑制方法、啸叫声的抑制装置、耳机及存储介质。该啸叫声的抑制方法包括获取被检测对象反射后被麦克风采集的超声波反射信号；根据超声波反射信号确定检测对象与耳机的相对位置；如果相对位置不满足预设的啸叫条件,则根据第一滤波器组对第一音频信号进行滤波,得到第二音频信号；如果相对位置满足啸叫条件,则根据第二滤波器组对第一音频信号进行滤波,得到第三音频信号。在采用第二滤波器组进行滤波时,保持透通效果的同时滤除第一音频信号中可能包含的啸叫音,实现耳机在通透模式时,避免由于检测对象压迫耳机等原因造成耳机腔体变形而产生啸叫,提高耳机在通透模式下环境音的获取质量。(The present disclosure relates to a howling suppression method, a howling suppression device, an earphone, and a storage medium. The inhibition method of the howling comprises the steps of obtaining ultrasonic reflection signals collected by a microphone after being reflected by a detected object; determining the relative position of the detection object and the earphone according to the ultrasonic reflection signal; if the relative position does not meet the preset howling condition, filtering the first audio signal according to the first filter bank to obtain a second audio signal; and if the relative position meets the howling condition, filtering the first audio signal according to the second filter bank to obtain a third audio signal. When adopting the second filter bank to filter, the whistle sound that probably contains in the filtering first audio signal when keeping penetrating the effect, when realizing that the earphone is in penetrating mode, avoid because reasons such as detection object oppression earphone cause the earphone cavity to warp and produce the whistle, improve the earphone and the quality of acquireing of environment sound under penetrating mode.)
1. A howling suppression method, characterized by comprising:
acquiring an ultrasonic reflection signal, wherein the ultrasonic reflection signal is a signal which is emitted by a loudspeaker and is collected by a microphone after being reflected by a detected object;
determining the relative position of the detection object and the earphone according to the ultrasonic reflection signal;
if the relative position does not meet the preset howling condition, filtering a first audio signal acquired in advance according to a preset first filter bank to obtain a second audio signal;
and if the relative position meets a preset howling condition, filtering the pre-acquired first audio signal according to a preset second filter bank to obtain a third audio signal.
2. The method of claim 1,
the first filter bank is used for through filtering, and the second filter bank is used for through filtering and howling suppression;
and/or the gain value of the second filter is smaller than the gain value of the first filter;
and/or the third audio signal is smaller than the average amplitude of the second audio signal.
3. The method of claim 1,
the first filter bank comprises a plurality of first filters and the second filter bank comprises a plurality of second filters;
the number of the first filters is the same as that of the second filters, and the first filters and the second filters correspond to each other one by one;
the gain value of each second filter is smaller than the gain value of the corresponding first filter.
4. The method of claim 3,
the frequency value of each second filter is equal to the frequency value of the corresponding first filter;
the Q value of each second filter is equal to the Q value of the corresponding first filter.
5. The method of claim 1, wherein detecting the relative position of the object and the headset comprises: a first distance, which is a vertical distance from the detection object to a straight line where the microphone and the loudspeaker are located; the howling condition is that x is more than or equal to 0 and less than or equal to M; wherein x represents the first distance and M represents a preset threshold.
6. The method of claim 5, wherein detecting the relative position of the object and the headset further comprises: and a second distance representing a vertical distance from the detection object to a preset plane, wherein the loudspeaker is located on the preset plane, and the preset plane is perpendicular to a straight line where the microphone and the loudspeaker are located.
7. The method of claim 6, wherein the microphones comprise a first microphone and a second microphone, and the speaker is located between the first microphone and the second microphone;
if the detection object is located on a side of the speaker close to the first microphone, the howling condition is: x is more than or equal to 0 and less than or equal to M, and y is less than L1; wherein y represents the second distance, and L1 represents the distance of the first microphone from the speaker;
if the detection object is located on a side of the speaker close to the second microphone, the howling condition is: x is more than or equal to 0 and less than or equal to M, and y is less than L2; where y represents the second distance and L2 represents the distance of the second microphone from the speaker.
8. The method of claim 1, wherein determining the relative position of the test object and the headset from the ultrasonic reflection signals comprises:
determining an ultrasonic reflection path length according to the ultrasonic reflection signal, wherein the ultrasonic reflection path length is used for indicating the length of a path of the ultrasonic signal from the loudspeaker to the microphone after passing through the detection object;
determining the relative position based on the ultrasonic reflection path length.
9. The method of claim 8, wherein determining an ultrasonic reflection path length from the ultrasonic reflection signal comprises:
determining the ultrasonic reflection path length according to the ultrasonic first reflection signal and the ultrasonic second reflection signal; the first ultrasonic reflection signal is acquired by a first microphone arranged on the earphone, and the second ultrasonic reflection signal is acquired by a second microphone arranged on the earphone.
10. The method of claim 9, wherein determining the ultrasonic reflection path length from the ultrasonic first reflection signal and the ultrasonic second reflection signal comprises:
determining a first reflection path length according to the phase information of the ultrasonic first reflection signal, wherein the first reflection path length is used for representing the length of a path of the ultrasonic signal from the loudspeaker to the first microphone through the detection object;
and determining a second reflection path length according to the phase information of the ultrasonic second reflection signal, wherein the second reflection path length is used for representing the length of the path of the ultrasonic signal from the loudspeaker to the second microphone through the detection object.
11. The method of claim 10, wherein said determining the relative position from the ultrasonic reflection path length comprises:
determining the relative position based on a first reflected path length, a second reflected path length, a distance of the first microphone from the speaker, and a distance of the second microphone from the speaker.
12. The method of claim 11, wherein the relative position is determined according to the following equation:
wherein L1 represents the distance of the first microphone to the speaker;
l2 denotes the distance of the second microphone to the loudspeaker;
d1 denotes the first reflected path length, d2 denotes the second reflected path length;
x and y represent two parameters comprised by said relative distance.
13. A howling suppression device is characterized by comprising:
the device comprises a first processing unit, a second processing unit and a third processing unit, wherein the first processing unit is used for acquiring ultrasonic reflection signals, and the ultrasonic reflection signals are signals which are sent by a loudspeaker and collected by a microphone after being reflected by a detected object;
the second processing unit is used for determining the relative position of the detection object and the earphone according to the ultrasonic reflection signal;
a third processing unit, configured to filter the acquired first audio signal according to a preset first filter bank to obtain a second audio signal if the relative position does not meet a preset howling condition;
and the fourth processing unit is configured to, if the relative position meets the howling condition, filter the first audio signal according to a preset second filter bank to obtain a third audio signal.
14. The apparatus of claim 13,
the first filter bank is used for through filtering, and the second filter bank is used for through filtering and howling suppression;
and/or the gain value of the second filter is smaller than the gain value of the first filter;
and/or the third audio signal is smaller than the average amplitude of the second audio signal.
15. The apparatus of claim 13,
the first filter bank comprises a plurality of first filters and the second filter bank comprises a plurality of second filters;
the number of the first filters is the same as that of the second filters, and the first filters and the second filters correspond to each other one by one;
the gain value of each second filter is smaller than the gain value of the corresponding first filter.
16. The apparatus of claim 15,
the frequency value of each second filter is equal to the frequency value of the corresponding first filter;
the Q value of each second filter is equal to the Q value of the corresponding first filter.
17. The apparatus of claim 13, wherein detecting the relative position of the object and the headset comprises: a first distance, which is a vertical distance from the detection object to a straight line where the microphone and the loudspeaker are located;
the howling condition is that x is more than or equal to 0 and less than or equal to M; wherein x represents the first distance and M represents a preset threshold.
18. The apparatus of claim 17, wherein detecting the relative position of the object and the headset further comprises:
and a second distance representing a vertical distance from the detection object to a preset plane, wherein the loudspeaker is located on the preset plane, and the preset plane is perpendicular to a straight line where the microphone and the loudspeaker are located.
19. An earphone, comprising: a microphone, a loudspeaker, a processor and a memory, the memory having stored thereon a computer program operable on the processor to, when executed, perform the steps of the method of any of claims 1 to 12.
20. The headset of claim 25, wherein the microphones comprise a first microphone and a second microphone, the speaker, the first microphone, and the second microphone are collinear, and the speaker is located between the first microphone and the second microphone, respectively.
21. The headset of claim 25, wherein the microphones comprise a first microphone and a second microphone, the speakers comprise a first speaker and a second speaker, the first speaker is configured to transmit ultrasonic signals, the second speaker is configured to play audio, the first speaker, the first microphone, and the second microphone are co-located in a same line, and the first speaker is respectively located between the first microphone and the second microphone.
22. A computer-readable storage medium, on which a computer program is stored, which, when being executed by a processor, carries out the steps of the method of any one of claims 1 to 12.
Technical Field
The present disclosure relates to the field of signal processing technologies, and in particular, to a howling suppression method, a howling suppression device, an earphone, and a storage medium.
Background
In the audio field, audio devices that collect and output sound signals are diverse. Including audio devices that are used in a pass-through mode. The transparent mode refers to that the audio equipment collects the environmental sound, filters the environmental sound and then outputs the environmental sound, and superposes the sound leaked into the human ear to enable the human ear to receive the complete environmental sound. However, when the audio device collects an external sound signal, the audio device may be interfered by a nearby object, thereby affecting the output quality of the sound signal.
Disclosure of Invention
The present disclosure provides a howling suppression method, a howling suppression device, an earphone, and a storage medium.
In a first aspect of the embodiments of the present disclosure, a method for suppressing howling is provided, including:
acquiring an ultrasonic reflection signal, wherein the ultrasonic reflection signal is a signal which is emitted by a loudspeaker and is collected by a microphone after being reflected by a detected object;
determining the relative position of the detection object and the earphone according to the ultrasonic reflection signal;
if the relative position does not meet the preset howling condition, filtering the acquired first audio signal according to a preset first filter bank to obtain a second audio signal;
and if the relative position meets the howling condition, filtering the first audio signal according to a preset second filter bank to obtain a third audio signal.
In some embodiments, the first filter bank is used for pass-through filtering, and the second filter bank is used for pass-through filtering and howling suppression;
and/or the gain value of the second filter is smaller than the gain value of the first filter;
and/or the third audio signal is smaller than the average amplitude of the second audio signal.
In some embodiments, the first filter bank comprises a plurality of first filters and the second filter bank comprises a plurality of second filters;
the number of the first filters is the same as that of the second filters, and the first filters and the second filters correspond to each other one by one;
the gain value of each second filter is smaller than the gain value of the corresponding first filter.
In some embodiments, the frequency value of each of the second filters is equal to the frequency value of the corresponding first filter;
the Q value of each second filter is equal to the Q value of the corresponding first filter.
In some embodiments, detecting the relative position of the object and the headset comprises: a first distance, which is a vertical distance from the detection object to a straight line where the microphone and the loudspeaker are located;
the howling condition is that x is more than or equal to 0 and less than or equal to M; wherein x represents the first distance and M represents a preset threshold.
In some embodiments, detecting the relative position of the object and the headset further comprises:
and a second distance representing a vertical distance from the detection object to a preset plane, wherein the loudspeaker is located on the preset plane, and the preset plane is perpendicular to a straight line where the microphone and the loudspeaker are located.
In some embodiments, the microphones include a first microphone and a second microphone, and the speaker is located between the first microphone and the second microphone;
if the detection object is located on a side of the speaker close to the first microphone, the howling condition is: x is more than or equal to 0 and less than or equal to M, and y is less than L1; wherein y represents the second distance, and L1 represents the distance of the first microphone from the speaker;
if the detection object is located on a side of the speaker close to the second microphone, the howling condition is: x is more than or equal to 0 and less than or equal to M, and y is less than L2; where y represents the second distance and L2 represents the distance of the second microphone from the speaker.
In some embodiments, said determining the relative position of the test object and the headset from the ultrasonic reflection signal comprises:
determining an ultrasonic reflection path length according to the ultrasonic reflection signal, wherein the ultrasonic reflection path length is used for indicating the length of a path of the ultrasonic signal from the loudspeaker to the microphone after passing through the detection object;
determining the relative position based on the ultrasonic reflection path length.
In some embodiments, said determining an ultrasonic reflection path length from the ultrasonic reflection signal comprises:
determining the ultrasonic reflection path length according to the ultrasonic first reflection signal and the ultrasonic second reflection signal; the first ultrasonic reflection signal is acquired by a first microphone arranged on the earphone, and the second ultrasonic reflection signal is acquired by a second microphone arranged on the earphone.
In some embodiments, the determining an ultrasonic reflection path length from the ultrasonic first reflection signal and the ultrasonic second reflection signal comprises:
determining a first reflection path length according to the phase information of the ultrasonic first reflection signal, wherein the first reflection path length is used for representing the length of a path of the ultrasonic signal from the loudspeaker to the first microphone through the detection object;
and determining a second reflection path length according to the phase information of the ultrasonic second reflection signal, wherein the second reflection path length is used for representing the length of the path of the ultrasonic signal from the loudspeaker to the second microphone through the detection object.
In some embodiments, said determining said relative position from said ultrasonic reflection path length comprises:
determining the relative position based on a first reflected path length, a second reflected path length, a distance of the first microphone from the speaker, and a distance of the second microphone from the speaker.
In some embodiments, the relative position is determined according to the following equation:
wherein L1 represents the distance of the first microphone to the speaker;
l2 denotes the distance of the second microphone to the loudspeaker;
d1 denotes the first reflected path length, d2 denotes the second reflected path length;
x and y represent two parameters comprised by said relative distance.
In a second aspect of the embodiments of the present disclosure, there is provided a howling suppression apparatus including:
the device comprises a first processing unit, a second processing unit and a third processing unit, wherein the first processing unit is used for acquiring ultrasonic reflection signals, and the ultrasonic reflection signals are signals which are sent by a loudspeaker and collected by a microphone after being reflected by a detected object;
the second processing unit is used for determining the relative position of the detection object and the earphone according to the ultrasonic reflection signal;
a third processing unit, configured to filter the acquired first audio signal according to a preset first filter bank to obtain a second audio signal if the relative position does not meet a preset howling condition;
and the fourth processing unit is configured to, if the relative position meets the howling condition, filter the first audio signal according to a preset second filter bank to obtain a third audio signal.
In some embodiments, the first filter bank is used for pass-through filtering, and the second filter bank is used for pass-through filtering and howling suppression;
and/or the gain value of the second filter is smaller than the gain value of the first filter;
and/or the third audio signal is smaller than the average amplitude of the second audio signal.
In some embodiments, the first filter bank comprises a plurality of first filters and the second filter bank comprises a plurality of second filters;
the number of the first filters is the same as that of the second filters, and the first filters and the second filters correspond to each other one by one;
the gain value of each second filter is smaller than the gain value of the corresponding first filter.
In some embodiments, the frequency value of each of the second filters is equal to the frequency value of the corresponding first filter;
the Q value of each second filter is equal to the Q value of the corresponding first filter.
In some embodiments, detecting the relative position of the object and the headset comprises: a first distance, which is a vertical distance from the detection object to a straight line where the microphone and the loudspeaker are located;
the howling condition is that x is more than or equal to 0 and less than or equal to M; wherein x represents the first distance and M represents a preset threshold.
In some embodiments, detecting the relative position of the object and the headset further comprises:
and a second distance representing a vertical distance from the detection object to a preset plane, wherein the loudspeaker is located on the preset plane, and the preset plane is perpendicular to a straight line where the microphone and the loudspeaker are located.
In some embodiments, the microphones include a first microphone and a second microphone, and the speaker is located between the first microphone and the second microphone;
if the detection object is located on a side of the speaker close to the first microphone, the howling condition is: x is more than or equal to 0 and less than or equal to M, and y is less than L1; wherein y represents the second distance, and L1 represents the distance of the first microphone from the speaker;
if the detection object is located on a side of the speaker close to the second microphone, the howling condition is: x is more than or equal to 0 and less than or equal to M, and y is less than L2; where y represents the second distance and L2 represents the distance of the second microphone from the speaker.
In some embodiments, the second processing unit is specifically configured to determine an ultrasonic reflection path length according to the ultrasonic reflection signal, where the ultrasonic reflection path length is used to indicate a length of a path of the ultrasonic signal from the speaker to the microphone after passing through the detection object;
determining the relative position based on the ultrasonic reflection path length.
In some embodiments, the second processing unit is specifically configured to determine an ultrasonic reflection path length from the ultrasonic first reflection signal and the ultrasonic second reflection signal; the first ultrasonic reflection signal is acquired by a first microphone arranged on the earphone, and the second ultrasonic reflection signal is acquired by a second microphone arranged on the earphone.
In some embodiments, the second processing unit is specifically for
Determining a first reflection path length according to the phase information of the ultrasonic first reflection signal, wherein the first reflection path length is used for representing the length of a path of the ultrasonic signal from the loudspeaker to the first microphone through the detection object;
and determining a second reflection path length according to the phase information of the ultrasonic second reflection signal, wherein the second reflection path length is used for representing the length of the path of the ultrasonic signal from the loudspeaker to the second microphone through the detection object.
In some embodiments, the second processing unit is specifically configured to determine the relative position according to a first reflection path length, a second reflection path length, a distance from the first microphone to the speaker, and a distance from the second microphone to the speaker.
In some embodiments, the relative position is determined according to the following equation:
wherein L1 represents the distance of the first microphone to the speaker;
l2 denotes the distance of the second microphone to the loudspeaker;
d1 denotes the first reflected path length, d2 denotes the second reflected path length;
x and y represent two parameters comprised by said relative distance.
In a third aspect of the disclosed embodiments, there is provided a headset, comprising: a microphone, a loudspeaker, a processor and a memory, the memory having stored thereon a computer program being executable on the processor, the processor being adapted to perform the steps of the method of the first aspect when the computer program is executed.
In some embodiments, the microphones include a first microphone and a second microphone, the speaker, the first microphone and the second microphone are located on a same straight line, and the speaker is located between the first microphone and the second microphone respectively.
In some embodiments, the microphones include a first microphone and a second microphone, the speakers include a first speaker and a second speaker, the first speaker is used for sending ultrasonic signals, the second speaker is used for playing audio, the first speaker, the first microphone and the second microphone are located on the same straight line, and the first speaker is respectively located between the first microphone and the second microphone.
In a fourth aspect of the embodiments of the present disclosure, a computer-readable storage medium is provided, on which a computer program is stored, wherein the computer program, when executed by a processor, implements the steps of the method of the first aspect.
The technical scheme provided by the embodiment of the disclosure can have the following beneficial effects:
in the howling suppression method in the embodiment of the disclosure, the phase position of the detection object and the earphone is determined by detecting the ultrasonic reflection signal reflected by the detection object, and it is determined which group of filter sets is used to filter the collected ambient sound (the first audio signal) by judging whether the phase position meets the preset condition. Specifically, if the relative position does not satisfy the howling condition, filtering is performed by adopting a first filter bank; if the relative position meets the howling condition, namely the first audio signal possibly contains howling sound, filtering is carried out by adopting the second filter bank so as to filter the howling sound possibly contained in the first audio signal while keeping the through effect, so that when the earphone is in the through mode, the phenomenon that the cavity of the earphone is deformed to generate howling due to the fact that a detection object presses the earphone and the like is avoided, and the acquisition quality of the environment sound of the earphone in the through mode is improved.
It is to be understood that both the foregoing general description and the following detailed description are exemplary and explanatory only and are not restrictive of the disclosure.
Drawings
The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the present disclosure and together with the description, serve to explain the principles of the disclosure.
Fig. 1 is a flow chart illustrating a howling suppression method according to an exemplary embodiment.
Fig. 2 is a schematic diagram illustrating relative positions of a detection object and a headset according to an exemplary embodiment.
FIG. 3 is a schematic diagram illustrating an ultrasonic reflection signal path according to an exemplary embodiment.
FIG. 4 is a graph illustrating a comparison of frequency response curves of ambient sound and passively denoised ambient sound, according to an example embodiment.
Fig. 5 is a schematic diagram illustrating a frequency response curve of ambient sounds required to be output by the earphone in the pass-through mode according to an exemplary embodiment.
Fig. 6 is a graph comparing frequency response curves when the headset howling occurs in the pass-through mode according to an exemplary embodiment.
Fig. 7 is a schematic structural diagram illustrating a howling suppression apparatus according to an exemplary embodiment.
Fig. 8 is a block diagram illustrating a terminal device according to an example embodiment.
Detailed Description
Reference will now be made in detail to the exemplary embodiments, examples of which are illustrated in the accompanying drawings. When the following description refers to the accompanying drawings, like numbers in different drawings represent the same or similar elements unless otherwise indicated. The implementations described in the exemplary embodiments below are not intended to represent all implementations consistent with the present disclosure. Rather, they are merely examples of devices consistent with certain aspects of the present disclosure, as detailed in the appended claims.
In the audio field, audio devices that collect and output sound signals are diverse. Including audio devices that are used in a pass-through mode. In particular earphones with a pass-through mode. When a user wears the earphone and wants to have a conversation with other people, the user can switch to a transparent mode without taking off the earphone, and the effect of taking off the earphone is the same, so that clear conversation with the other party is realized. The rapid popularization of true wireless stereo earphones enables users to increase the frequency and duration of use in a transparent mode. The through transmission of ambient sound is also moving towards more and more accurate and natural hearing.
The transparent mode is realized by collecting environmental sounds through a microphone on the earphone, playing the environmental sounds through a loudspeaker on the earphone after the environmental sounds are filtered by a transparent filter, and overlapping the environmental sounds leaked in. However, when a user wears the real wireless stereo headset and starts the transparent mode, the cavity of the headset is pressed by hands or other operations cause the change of the acoustic structure of the cavity, so that the change of the acoustic transmission path causes the howling of the headset.
The embodiment of the disclosure provides a method for suppressing howling, which determines whether the headset generates howling by detecting relative positions of objects such as hands and the headset, continues to use an original transparent filter for filtering if the headset does not generate howling, and performs filtering through a preset transparent filter capable of eliminating the howling if the headset generates howling, so that the situation that the cavity of the headset in a transparent mode is deformed to generate howling due to pressing of the headset in the transparent mode is avoided, and user experience is improved.
Fig. 1 is a flow chart illustrating a howling suppression method according to an exemplary embodiment. As shown in fig. 1, the howling suppression method includes:
step 10, acquiring an ultrasonic reflection signal, wherein the ultrasonic reflection signal is a signal which is sent by a loudspeaker and is collected by a microphone after being reflected by a detected object;
step 11, determining the relative position of the detection object and the earphone according to the ultrasonic reflection signal;
step 12, if the relative position does not meet a preset howling condition, filtering a first audio signal acquired in advance according to a preset first filter bank to obtain a second audio signal;
and step 13, if the relative position meets the howling condition, filtering the pre-acquired first audio signal according to a preset second filter bank to obtain a third audio signal.
In the embodiment of the present disclosure, the method for suppressing howling is applied to an earphone, and particularly applied to a transparent mode of the earphone. The earphone is provided with a loudspeaker for transmitting ultrasonic signals and a microphone for collecting ultrasonic reflection signals.
In the embodiment of the present disclosure, the detection object refers to an object that moves around the earphone and may contact with the earphone to cause the earphone to generate howling. For example, the hand limbs (including palm, arm, etc.) or other limb organs of a person, or the article can be a hat, a helmet, a scarf, a neck band, etc.
In the embodiment of the present disclosure, the first audio signal is a sound signal in the surrounding environment of the earphone, which is collected by the microphone in advance. The second audio signal and the third audio signal are both audio signals obtained by filtering the first audio signal through the filter bank. The first audio signal is filtered through the first filter bank to obtain a second audio signal, and the first audio signal is filtered through the second filter bank to obtain a third audio signal.
In the embodiment of the present disclosure, the howling condition indicates a relative position where the detection object can cause the howling of the earphone, and is used to determine whether the detection object is about to contact or has contacted the earphone. When the relative position of the detection object and the earphone does not meet the howling condition, the detection object does not contact the earphone, the earphone does not generate howling, and under the condition, the first audio signal is filtered through the first filter bank; when the relative position of the detection object and the earphone meets the howling condition, which indicates that the detection object will or has contacted the earphone, the earphone may be caused to generate howling, and in this case, the first audio signal is filtered by the second filter bank.
In the embodiment of the present disclosure, the second audio signal and the environmental sound leaked into the human ear bypassing the earphone are superimposed at the human ear, so that the user wearing the earphone can hear the sound of the superimposed second audio signal and the environmental sound leaked into the human ear bypassing the earphone. At the moment, the superposed sound heard by the user is consistent with the sound heard without the earphone, so that the transparent perception of the environmental sound is realized.
In the embodiment of the disclosure, when the third audio signal is obtained by filtering the first audio signal through the second filter bank, the second filter can filter an interference signal causing an earphone howling sound in the first audio signal to obtain the third audio signal, in addition to filtering an audio signal portion corresponding to an environmental sound leaked into the human ear by bypassing the earphone in the first audio signal. And superposing the third audio signal and the environmental sound leaked into the human ear by bypassing the earphone to obtain a sound signal consistent with the environmental sound heard by the user when the user does not wear the earphone.
In the howling suppression method in the embodiment of the disclosure, the phase position of the detection object and the earphone is determined by detecting the ultrasonic reflection signal reflected by the detection object, and it is determined which group of filter sets is used to filter the collected ambient sound (the first audio signal) by judging whether the phase position meets the preset condition. Specifically, if the relative position does not satisfy the howling condition, filtering is performed by adopting a first filter bank; if the relative position meets the howling condition, namely the first audio signal possibly contains howling sound, filtering is carried out by adopting the second filter bank so as to filter the howling sound possibly contained in the first audio signal while keeping the through effect, so that when the earphone is in the through mode, the phenomenon that the cavity of the earphone is deformed to generate howling due to the fact that a detection object presses the earphone and the like is avoided, and the acquisition quality of the environment sound of the earphone in the through mode is improved.
In some embodiments, the first filter bank is used for pass-through filtering, and the second filter bank is used for pass-through filtering and howling suppression;
and/or the gain value of the second filter bank is smaller than the gain value of the first filter bank;
and/or the third audio signal is smaller than the average amplitude of the second audio signal.
In the embodiment of the disclosure, when the first audio signal is filtered by the filter bank, the gain value of the second filter bank may be smaller than the gain value of the first filter bank, or the third audio signal is smaller than the average amplitude value of the second audio signal, so that when the first audio signal is filtered by the second filter bank, not only the audio signal part corresponding to the environmental sound leaked into the ear around the earphone in the first audio signal is filtered, but also the interference signal causing the howling of the earphone in the first audio signal is filtered, thereby suppressing the howling generated by the earphone. The third audio signal is smaller than the average amplitude of the second audio signal, so that the third audio signal and the interference signal can be superposed to reduce the amplitude of the interference signal, and the interference signal is inhibited from causing the earphone howling.
In some embodiments, the first filter bank comprises a plurality of first filters and the second filter bank comprises a plurality of second filters;
the number of the first filters is the same as that of the second filters, and the first filters and the second filters correspond to each other one by one;
the gain value of each second filter is smaller than the gain value of the corresponding first filter.
In the embodiment of the present disclosure, the number of filters in each of the first filter bank and the second filter bank may be 6. The first filter bank and the second filter bank each comprise 6 cascaded filters. The first filter and the second filter each contain a gain value. The gain value of each second filter is smaller than the gain value of the corresponding first filter. Table 1 is a first filter bank filtering setting look-up table. Table 2 is a second filter bank filtering setting look-up table. As shown in tables 1 and 2, the gain of each filter in the second filter bank is smaller than the gain of the corresponding filter in the first filter bank. The gain value of each second filter is smaller than that of the corresponding first filter, so that when the second filter group filters the first audio signal, the second filter group not only can filter the audio signal part corresponding to the environmental sound leaked into the human ear by bypassing the earphone in the first audio signal, but also can filter the interference signal causing the howling of the earphone in the first audio signal, and the howling generated by the earphone is restrained.
In one embodiment, the gain value of each of the second filters is 1/3 of the gain value of the corresponding first filter. 1/3 is an empirical value obtained after a number of experiments.
TABLE 1 first Filter Bank Filter setup look-up Table
Filtering module
Type (B)
Gain of
Filtering frequency (Hz)
Q value
First filter
Peak/Notch
12
3000
0.9
Second filter
Peak/Notch
4
1400
1
Third filter
Peak/Notch
4
3800
1
Fourth filter
Peak/Notch
2
2000
1
Fifth filter
Peak/Notch
5
8000
1
Sixth filter
HighShelf
4
1000
1
TABLE 2 second filterbank filter settings look-up table
Filtering module
Type (B)
Gain of
Filtering frequency (Hz)
Q value
First filter
Peak/Notch
2
3000
0.8
Second filter
Peak/Notch
0.9
1400
1
Third filter
Peak/Notch
1
3800
1
Fourth filter
Peak/Notch
1
2000
0.8
Fifth filter
Peak/Notch
0.6
8000
1
Sixth filter
HighShelf
0.5
1000
1
In some embodiments, the frequency value of each of the second filters is equal to the frequency value of the corresponding first filter;
the Q value of each second filter is equal to the Q value of the corresponding first filter.
In the disclosed embodiment, the Q value represents a figure of merit. Q-value-center frequency ÷ filter bandwidth. The larger the Q value, the narrower the filter bandwidth, and the smaller the filter bandwidth.
In the embodiment of the present disclosure, the filtering bandwidth of each filter in the first filter bank is substantially the same as the filtering bandwidth of the corresponding filter in the second filter bank. For example, as shown in tables 1 and 2, the bandwidth of the sixth filter in the first filter bank is the same as the bandwidth of the sixth filter in the second filter bank, and the bandwidth of the fifth filter in the first filter bank is the same as the bandwidth of the fifth filter in the second filter bank, so that the first filter bank and the second filter bank have the same filtering bandwidth for audio signals of the same center frequency, thereby facilitating processing of the first audio signal of the same bandwidth.
In some embodiments, detecting the relative position of the object and the headset comprises: a first distance, which is a vertical distance from the detection object to a straight line where the microphone and the loudspeaker are located;
the howling condition is that x is more than or equal to 0 and less than or equal to M; wherein x represents the first distance and M represents a preset threshold.
In the embodiment of the present disclosure, fig. 2 is a schematic diagram illustrating relative positions of a detection object and an earphone according to an exemplary embodiment. As shown in fig. 2, the first distance: the vertical distance from the detection object to the straight line where the microphone and the speaker are located can be used as a judgment condition for judging the relative position of the detection object and the earphone. I.e. the relative position of the detected object and the earpiece is determined with the first distance. When the vertical distance from the detection object to the straight line where the microphone and the speaker are located is between 0 and M, it can be basically determined that the relative position of the detection object and the earphone satisfies the preset howling condition. At this time, the detection object will contact the earphone, causing the earphone to generate howling.
In the embodiment of the disclosure, the value range of the threshold is 0.1-1 cm, and preferably 0.5 cm.
In some embodiments, detecting the relative position of the object and the headset further comprises:
and a second distance representing a vertical distance from the detection object to a preset plane, wherein the loudspeaker is located on the preset plane, and the preset plane is perpendicular to a straight line where the microphone and the loudspeaker are located.
In the embodiment of the present disclosure, in order to determine the relative position between the detection object and the earphone more accurately, as shown in fig. 2, the determination of the second distance may be added on the basis of the first distance. The second distance represents a vertical distance of the detection object to the preset plane. The detection object is determined to be in contact with the earphone through the limitation of the second distance, and the situation that the detection object does not act on the earphone when the first distance meets the howling condition is avoided. For example, when the hand is placed on the temple rather than on the headset, it may also happen that the first distance satisfies the howling condition. Therefore, the determination of the second distance may be increased to reduce the erroneous determination, thereby improving the accuracy of determining whether the detection object may contact the earphone to cause howling.
In some embodiments, the microphones include a first microphone and a second microphone, and the speaker is located between the first microphone and the second microphone;
if the detection object is located on a side of the speaker close to the first microphone, the howling condition is: x is more than or equal to 0 and less than or equal to M, and y is less than L1; wherein, as shown in fig. 2, y represents the second distance, and L1 represents the distance from the first microphone to the speaker;
if the detection object is located on a side of the speaker close to the second microphone, the howling condition is: x is more than or equal to 0 and less than or equal to M, and y is less than L2; wherein y represents the second distance and L2 represents the distance of the second microphone from the speaker, as shown in fig. 2.
In the embodiment of the disclosure, when determining the relative position of the detection object and the earphone, the relative position of the detection object and the loudspeaker in the earphone is used as a judgment standard. The determination condition of the relative position includes the first distance and the second distance. The first distance and the second distance are distances from the detection object to the speaker in two mutually perpendicular directions. Wherein the second distance includes two parts, one is the distance between the detection object and the speaker when the detection object is located on the side of the speaker close to the first microphone, and the other is the distance between the detection object and the speaker when the detection object is located on the side of the speaker close to the second microphone.
In the embodiment of the present disclosure, when the detection object is located on the side of the speaker close to the first microphone, the first distance is within 0 to M, and the second distance is smaller than L1, it may be determined that the relative position of the detection object and the earphone satisfies the preset howling condition. At this time, it is described that the detection object will or has touched the headphone, and howling may be caused to the headphone.
In the embodiment of the present disclosure, when the detection object is located on the side of the speaker close to the second microphone, the first distance is within 0 to M, and the second distance is smaller than L2, it may be determined that the relative position of the detection object and the earphone satisfies the preset howling condition. At this time, it is described that the detection object will or has touched the headphone, and howling may be caused to the headphone.
In the embodiment of the present disclosure, when the first distance is not within 0 to M, or the second distance is greater than L1, or the second distance is greater than L2, or the like, as long as one of the three conditions is satisfied, it may be determined that the relative position of the detection object and the headphone does not satisfy the preset howling condition. At this time, it is explained that the detection object does not contact the headphone, and howling is not caused to the headphone.
In some embodiments, said determining the relative position of the test object and the headset from the ultrasonic reflection signal comprises:
determining an ultrasonic reflection path length according to the ultrasonic reflection signal, wherein the ultrasonic reflection path length is used for indicating the length of a path of the ultrasonic signal from the loudspeaker to the microphone after passing through the detection object;
determining the relative position based on the ultrasonic reflection path length.
In the embodiment of the present disclosure, when determining the relative position between the detection object and the earphone, the length of the path from the speaker to the microphone after passing through the detection object may be determined. And determining the relative position of the detection object and the earphone according to the determined ultrasonic reflection path length.
In some embodiments, said determining an ultrasonic reflection path length from the ultrasonic reflection signal comprises:
determining the ultrasonic reflection path length according to the ultrasonic first reflection signal and the ultrasonic second reflection signal; the first ultrasonic reflection signal is acquired by a first microphone arranged on the earphone, and the second ultrasonic reflection signal is acquired by a second microphone arranged on the earphone.
In the disclosed embodiments, the first microphone may be a feed-forward microphone in the headset. The second microphone may be a talk microphone in the headset. Ultrasonic signals emitted by the loudspeaker can be reflected to multiple directions after being reflected by a detection object, and can be collected by the microphones at two different positions. The signals collected by the microphones at two different positions are respectively ultrasonic first reflection signals and ultrasonic second reflection signals. And determining the length of an ultrasonic wave reflection path through the ultrasonic wave first reflection signal and the ultrasonic wave second reflection signal so as to determine the relative position of the detection object and the earphone according to the determined length of the ultrasonic wave reflection path.
In some embodiments, the determining an ultrasonic reflection path length from the ultrasonic first reflection signal and the ultrasonic second reflection signal comprises:
determining a first reflection path length according to the phase information of the ultrasonic first reflection signal, wherein the first reflection path length is used for representing the length of a path of the ultrasonic signal from the loudspeaker to the first microphone through the detection object;
and determining a second reflection path length according to the phase information of the ultrasonic second reflection signal, wherein the second reflection path length is used for representing the length of the path of the ultrasonic signal from the loudspeaker to the second microphone through the detection object.
In the disclosed embodiment, fig. 3 is a schematic diagram illustrating an ultrasonic reflection signal path according to an exemplary embodiment. As shown in fig. 3, the ultrasonic reflection signal collected by the microphones at two different positions forms two ultrasonic reflection paths including a first reflection path and a second reflection path. The first reflection path represents a path of an ultrasonic signal from a speaker to the first microphone through the detection object. The second reflection path represents a path of the ultrasonic wave signal from the speaker to the second microphone through the detection object.
In the disclosed embodiment, the first reflection path length d1 may be determined by a change in phase information of the ultrasonic first reflection signal, and the second reflection path length d2 may be determined by a change in phase information of the ultrasonic second reflection signal. And determining the relative position of the detection object and the earphone through the first reflection path length and the second reflection path length.
In some embodiments, said determining said relative position from said ultrasonic reflection path length comprises:
determining the relative position based on a first reflected path length, a second reflected path length, a distance of the first microphone from the speaker, and a distance of the second microphone from the speaker.
In the embodiment of the disclosure, the relative position of the detection object and the earphone can be determined through the first reflection path length, the second reflection path length, the distance from the first microphone to the loudspeaker and the distance from the second microphone to the loudspeaker.
In some embodiments, the relative position is determined according to the following equation:
wherein, as shown in fig. 3, L1 represents the distance from the first microphone to the speaker;
l2 denotes the distance of the second microphone to the loudspeaker;
d1 denotes the first reflected path length, d2 denotes the second reflected path length;
x and y represent two parameters comprised by said relative distance.
In the embodiment of the present disclosure, x represents a first distance, and the first distance is a vertical distance from the detection object to a straight line where the microphone and the speaker are located. y represents the second distance. The second distance represents a vertical distance from the detection object to a preset plane, the preset plane is perpendicular to the straight line, and the loudspeaker is located on the preset plane.
The embodiment of the disclosure also provides a device for suppressing howling. Fig. 7 is a schematic structural diagram illustrating a howling suppression apparatus according to an exemplary embodiment. As shown in fig. 7, the apparatus includes:
the first processing unit 71 is configured to acquire an ultrasonic reflection signal, where the ultrasonic reflection signal is a signal that is sent by a speaker and is collected by a microphone after being reflected by a detection object;
a second processing unit 72, configured to determine a relative position between the detection object and the earphone according to the ultrasonic reflection signal;
a third processing unit 73, configured to filter the acquired first audio signal according to a preset first filter bank to obtain a second audio signal if the relative position does not meet a preset howling condition;
a fourth processing unit 74, configured to, if the relative position meets the howling condition, filter the first audio signal according to a preset second filter bank to obtain a third audio signal.
In the embodiment of the present disclosure, the device for suppressing howling is applied to an earphone, and particularly applied to a transparent mode of the earphone. The earphone is provided with a loudspeaker for transmitting ultrasonic signals and a microphone for collecting ultrasonic reflection signals.
In the embodiment of the present disclosure, the detection object refers to an object that moves around the earphone and may contact with the earphone to cause the earphone to generate howling. For example, the hand limbs (including palm, arm, etc.) or other limb organs of a person, or the article can be a hat, a helmet, a scarf, a neck band, etc.
In the embodiment of the present disclosure, the first audio signal is a sound signal in the surrounding environment of the earphone, which is collected by the microphone in advance. The second audio signal and the third audio signal are both audio signals obtained by filtering the first audio signal through the filter bank. The first audio signal is filtered through the first filter bank to obtain a second audio signal, and the first audio signal is filtered through the second filter bank to obtain a third audio signal.
In the embodiment of the present disclosure, the howling condition indicates a relative position where the detection object can cause the howling of the earphone, and is used to determine whether the detection object is about to contact or has contacted the earphone. When the relative position of the detection object and the earphone does not meet the howling condition, the detection object does not contact the earphone, the earphone does not generate howling, and under the condition, the first audio signal is filtered through the first filter bank; when the relative position of the detection object and the earphone meets the howling condition, which indicates that the detection object will or has contacted the earphone, the earphone may be caused to generate howling, and in this case, the first audio signal is filtered by the second filter bank.
In the embodiment of the present disclosure, the second audio signal and the environmental sound leaked into the human ear bypassing the earphone are superimposed at the human ear, so that the user wearing the earphone can hear the sound of the superimposed second audio signal and the environmental sound leaked into the human ear bypassing the earphone. At the moment, the superposed sound heard by the user is consistent with the sound heard without the earphone, so that the transparent perception of the environmental sound is realized.
In the embodiment of the disclosure, when the third audio signal is obtained by filtering the first audio signal through the second filter bank, the second filter can filter an interference signal causing an earphone howling sound in the first audio signal to obtain the third audio signal, in addition to filtering an audio signal portion corresponding to an environmental sound leaked into the human ear by bypassing the earphone in the first audio signal. And superposing the third audio signal and the environmental sound leaked into the human ear by bypassing the earphone to obtain a sound signal consistent with the environmental sound heard by the user when the user does not wear the earphone.
The howling suppression device in the embodiment of the disclosure determines the phase position of the detection object and the earphone by detecting the ultrasonic reflection signal reflected by the detection object, and determines which filter set is used to filter the collected ambient sound (the first audio signal) by judging whether the phase position meets a preset condition. Specifically, if the relative position does not satisfy the howling condition, filtering is performed by adopting a first filter bank; if the relative position meets the howling condition, namely the first audio signal possibly contains howling sound, filtering is carried out by adopting the second filter bank so as to filter the howling sound possibly contained in the first audio signal while keeping the through effect, so that when the earphone is in the through mode, the phenomenon that the cavity of the earphone is deformed to generate howling due to the fact that a detection object presses the earphone and the like is avoided, and the acquisition quality of the environment sound of the earphone in the through mode is improved.
In some embodiments, the first filter bank is used for pass-through filtering, and the second filter bank is used for pass-through filtering and howling suppression;
and/or the gain value of the second filter is smaller than the gain value of the first filter;
and/or the third audio signal is smaller than the average amplitude of the second audio signal.
In the embodiment of the disclosure, when the first audio signal is filtered by the filter bank, the gain value of the second filter bank may be smaller than the gain value of the first filter bank, or the third audio signal is smaller than the average amplitude value of the second audio signal, so that when the first audio signal is filtered by the second filter bank, not only the audio signal part corresponding to the environmental sound leaked into the ear around the earphone in the first audio signal is filtered, but also the interference signal causing the howling of the earphone in the first audio signal is filtered, thereby suppressing the howling generated by the earphone. The third audio signal is smaller than the average amplitude of the second audio signal, so that the third audio signal and the interference signal can be superposed to reduce the amplitude of the interference signal, and the interference signal is inhibited from causing the earphone howling.
In some embodiments, the first filter bank comprises a plurality of first filters and the second filter bank comprises a plurality of second filters;
the number of the first filters is the same as that of the second filters, and the first filters and the second filters correspond to each other one by one;
the gain value of each second filter is smaller than the gain value of the corresponding first filter.
In the embodiment of the present disclosure, the number of filters in each of the first filter bank and the second filter bank may be 6. The first filter bank and the second filter bank each comprise 6 cascaded filters. The first filter and the second filter each contain a gain value. The gain value of each second filter is smaller than the gain value of the corresponding first filter. Table 1 is a first filter bank filtering setting look-up table. Table 2 is a second filter bank filtering setting look-up table. As shown in tables 1 and 2, the gain of each filter in the second filter bank is smaller than the gain of the corresponding filter in the first filter bank. The gain value of each second filter is smaller than that of the corresponding first filter, so that when the second filter group filters the first audio signal, the second filter group not only can filter the audio signal part corresponding to the environmental sound leaked into the human ear by bypassing the earphone in the first audio signal, but also can filter the interference signal causing the howling of the earphone in the first audio signal, and the howling generated by the earphone is restrained.
In one embodiment, the gain value of each of the second filters is 1/3 of the gain value of the corresponding first filter. 1/3 is an empirical value obtained after a number of experiments.
In the present application, when the number of filters in the first filter bank and the second filter bank varies, the gain value, the frequency value, and the Q value corresponding to each filter can be flexibly adjusted. The data of tables 1 and 2 are examples only.
In some embodiments, the frequency value of each of the second filters is equal to the frequency value of the corresponding first filter;
the Q value of each second filter is equal to the Q value of the corresponding first filter.
In the disclosed embodiment, the Q value represents a figure of merit. Q-value-center frequency ÷ filter bandwidth. The larger the Q value, the narrower the filter bandwidth, and the smaller the filter bandwidth.
In the embodiment of the present disclosure, the filtering bandwidth of each filter in the first filter bank is substantially the same as the filtering bandwidth of the corresponding filter in the second filter bank. For example, as shown in tables 1 and 2, the bandwidth of the sixth filter in the first filter bank is the same as the bandwidth of the sixth filter in the second filter bank, and the bandwidth of the fifth filter in the first filter bank is the same as the bandwidth of the fifth filter in the second filter bank, so that the first filter bank and the second filter bank have the same filtering bandwidth for audio signals of the same center frequency, thereby facilitating processing of the first audio signal of the same bandwidth.
In the present application, the frequency, gain and Q value of each filter can be determined in advance by analyzing the frequency response curve of the sound signal, and the method is as follows:
1) determining the frequency response of the environment sound and the environment sound after passive noise reduction;
FIG. 3 is a graph illustrating a comparison of frequency response curves of ambient sound and passively denoised ambient sound, according to an example embodiment. As shown in fig. 3, a curve a in fig. 3 represents the frequency response of the complete ambient sound, and a curve B represents the frequency response of the ambient sound leaked into the human ear after passive noise reduction when the earphone is worn on the human ear.
2) Determining the frequency response of an audio signal required to be output when an audio device (earphone) works in a transparent mode;
fig. 4 is a schematic diagram illustrating a frequency response curve of ambient sounds required to be output by the earphone in the pass-through mode according to an exemplary embodiment. Curve C in fig. 4 is the frequency response for curve a minus the frequency response for curve B.
Fig. 5 is a diagram illustrating a comparison of frequency response curves when the headset howling occurs in the pass-through mode according to an exemplary embodiment. In fig. 5, a curve D is a frequency response curve of the ambient sound actually output by the headphone by adjusting the frequency, gain, and Q value of each filter when the relative position between the detection object and the headphone does not satisfy the howling condition. The frequency, the gain and the Q value of each filter of the first filter bank are adjusted, so that the frequency response of the environment sound actually output by the earphone approaches to the frequency response of a theoretical value C. In the adjustment process, the frequency, the gain and the Q value corresponding to each filter shown in table 1 are obtained by making D approach to C, so that the first filter bank filters the environmental sound (the environmental sound part leaked into the ear) corresponding to the curve B, and the environmental sound corresponding to the curve D is obtained. The superposition of the environmental sound corresponding to the curve D and the environmental sound corresponding to the leaked curve B obtained in the above way is the environmental sound corresponding to the complete curve A received by the human ear.
Curve E in fig. 5 is the frequency response of an interference signal causing howling present in the headphone when the relative position of the detection object and the headphone satisfies the howling condition. The frequency, gain and Q value of each filter of the second filter bank are adjusted to be data as shown in table 2, so that the second filter bank filters the environmental sound corresponding to the curve B, and simultaneously filters the interference signal corresponding to the curve E to obtain the environmental sound corresponding to the curve D.
In some embodiments, detecting the relative position of the object and the headset comprises: a first distance, which is a vertical distance from the detection object to a straight line where the microphone and the loudspeaker are located;
the howling condition is that x is more than or equal to 0 and less than or equal to M; wherein x represents the first distance and M represents a preset threshold.
In the embodiment of the present disclosure, the first distance: the vertical distance from the detection object to the straight line where the microphone and the speaker are located can be used as a judgment condition for judging the relative position of the detection object and the earphone. I.e. the relative position of the detected object and the earpiece is determined with the first distance. When the vertical distance from the detection object to the straight line where the microphone and the speaker are located is between 0 and M, it can be basically determined that the relative position of the detection object and the earphone satisfies the preset howling condition. At this time, the detection object will contact the earphone, causing the earphone to generate howling.
In the embodiment of the disclosure, the value range of the threshold is 0.1-1 cm, and preferably 0.5 cm.
In some embodiments, detecting the relative position of the object and the headset further comprises:
and a second distance representing a vertical distance from the detection object to a preset plane, wherein the loudspeaker is located on the preset plane, and the preset plane is perpendicular to a straight line where the microphone and the loudspeaker are located.
In the embodiment of the disclosure, in order to determine the relative position of the detection object and the earphone more accurately, the judgment of the second distance may be added on the basis of the first distance. The detection object is determined to be in contact with the earphone through the limitation of the second distance, and the situation that the detection object does not act on the earphone when the first distance meets the howling condition is avoided. For example, when the hand is placed on the temple rather than on the headset, it may also happen that the first distance satisfies the howling condition. Therefore, the determination of the second distance may be increased to reduce the erroneous determination, thereby improving the accuracy of determining whether the detection object may contact the earphone to cause howling.
In some embodiments, the microphones include a first microphone and a second microphone, and the speaker is located between the first microphone and the second microphone;
if the detection object is located on a side of the speaker close to the first microphone, the howling condition is: x is more than or equal to 0 and less than or equal to M, and y is less than L1; wherein y represents the second distance, and L1 represents the distance of the first microphone from the speaker;
if the detection object is located on a side of the speaker close to the second microphone, the howling condition is: x is more than or equal to 0 and less than or equal to M, and y is less than L2; where y represents the second distance and L2 represents the distance of the second microphone from the speaker.
In the embodiment of the disclosure, when determining the relative position of the detection object and the earphone, the relative position of the detection object and the loudspeaker in the earphone is used as a judgment standard. The determination condition of the relative position includes the first distance and the second distance. The first distance and the second distance are distances from the detection object to the speaker in two mutually perpendicular directions. Wherein the second distance includes two parts, one is the distance between the detection object and the speaker when the detection object is located on the side of the speaker close to the first microphone, and the other is the distance between the detection object and the speaker when the detection object is located on the side of the speaker close to the second microphone.
In the embodiment of the present disclosure, when the detection object is located on the side of the speaker close to the first microphone, the first distance is within 0 to M, and the second distance is smaller than L1, it may be determined that the relative position of the detection object and the earphone satisfies the preset howling condition. At this time, it is described that the detection object will or has touched the headphone, and howling may be caused to the headphone.
In the embodiment of the present disclosure, when the detection object is located on the side of the speaker close to the second microphone, the first distance is within 0 to M, and the second distance is smaller than L2, it may be determined that the relative position of the detection object and the earphone satisfies the preset howling condition. At this time, it is described that the detection object will or has touched the headphone, and howling may be caused to the headphone.
In the embodiment of the present disclosure, when the first distance is not within 0 to M, or the second distance is greater than L1, or the second distance is greater than L2, or the like, as long as one of the three conditions is satisfied, it may be determined that the relative position of the detection object and the headphone does not satisfy the preset howling condition. At this time, it is explained that the detection object does not contact the headphone, and howling is not caused to the headphone.
In some embodiments, the second processing unit is specifically configured to determine an ultrasonic reflection path length according to the ultrasonic reflection signal, where the ultrasonic reflection path length is used to indicate a length of a path of the ultrasonic signal from the speaker to the microphone after passing through the detection object;
determining the relative position based on the ultrasonic reflection path length.
In the embodiment of the present disclosure, when determining the relative position between the detection object and the earphone, the length of the path from the speaker to the microphone after passing through the detection object may be determined. And determining the relative position of the detection object and the earphone according to the determined ultrasonic reflection path length.
In some embodiments, the second processing unit is specifically configured to determine an ultrasonic reflection path length from the ultrasonic first reflection signal and the ultrasonic second reflection signal; the first ultrasonic reflection signal is acquired by a first microphone arranged on the earphone, and the second ultrasonic reflection signal is acquired by a second microphone arranged on the earphone.
In the disclosed embodiments, the first microphone may be a feed-forward microphone in the headset. The second microphone may be a talk microphone in the headset. Ultrasonic signals emitted by the loudspeaker can be reflected to multiple directions after being reflected by a detection object, and can be collected by the microphones at two different positions. The signals collected by the microphones at two different positions are respectively ultrasonic first reflection signals and ultrasonic second reflection signals. And determining the length of an ultrasonic wave reflection path through the ultrasonic wave first reflection signal and the ultrasonic wave second reflection signal so as to determine the relative position of the detection object and the earphone according to the determined length of the ultrasonic wave reflection path.
In some embodiments, the second processing unit is specifically for
Determining a first reflection path length according to the phase information of the ultrasonic first reflection signal, wherein the first reflection path length is used for representing the length of a path of the ultrasonic signal from the loudspeaker to the first microphone through the detection object;
and determining a second reflection path length according to the phase information of the ultrasonic second reflection signal, wherein the second reflection path length is used for representing the length of the path of the ultrasonic signal from the loudspeaker to the second microphone through the detection object.
In the embodiment of the present disclosure, the ultrasonic reflection paths formed by the ultrasonic reflection signals collected by the microphones at two different positions include a first reflection path and a second reflection path. The first reflection path represents a path of an ultrasonic signal from a speaker to the first microphone through the detection object. The second reflection path represents a path of the ultrasonic wave signal from the speaker to the second microphone through the detection object.
In the embodiment of the present disclosure, the first reflection path length may be determined by a change in phase information of the ultrasonic first reflection signal, and the second reflection path length may be determined by a change in phase information of the ultrasonic second reflection signal. And determining the relative position of the detection object and the earphone through the first reflection path length and the second reflection path length.
In some embodiments, the second processing unit is specifically configured to determine the relative position according to a first reflection path length, a second reflection path length, a distance from the first microphone to the speaker, and a distance from the second microphone to the speaker.
In the embodiment of the disclosure, the relative position of the detection object and the earphone can be determined through the first reflection path length, the second reflection path length, the distance from the first microphone to the loudspeaker and the distance from the second microphone to the loudspeaker.
In some embodiments, the relative position is determined according to the following equation:
wherein L1 represents the distance of the first microphone to the speaker;
l2 denotes the distance of the second microphone to the loudspeaker;
d1 denotes the first reflected path length, d2 denotes the second reflected path length;
x and y represent two parameters comprised by said relative distance.
In the embodiment of the present disclosure, x represents a first distance, and the first distance is a vertical distance from the detection object to a straight line where the microphone and the speaker are located. y represents the second distance. The second distance represents a vertical distance from the detection object to a preset plane, the preset plane is perpendicular to the straight line, and the loudspeaker is located on the preset plane.
The disclosed embodiment also provides an earphone, including: a microphone, a loudspeaker, a processor and a memory, the memory having stored thereon a computer program operable on the processor to, when executed, perform the steps of the method of the embodiments.
The earphone described in the embodiments of the present disclosure refers to a single earphone.
In the embodiment of the present disclosure, when a user needs to use one earphone, each earphone needs to include a microphone, a speaker, a processor and a memory.
In some embodiments, the microphones include a first microphone and a second microphone, the speaker, the first microphone and the second microphone are located on a same straight line, and the speaker is located between the first microphone and the second microphone respectively.
In the embodiment of the present disclosure, the earphone may include a speaker. The loudspeaker can play ultrasonic signals and can also play audio signals at the same time. The frequency of the ultrasonic signal is much higher than that of a general audio signal. Because the ultrasonic signal has a high frequency and cannot be heard by the user, the ultrasonic signal cannot cause interference to the audio received by the user, and therefore, a loudspeaker can be used in the earphone.
In the disclosed embodiment, the first microphone may be a feed-forward microphone for acquiring the ultrasonic first reflected signal; the second microphone may be a call microphone in the headset for collecting the ultrasonic second reflected signal and ambient sounds around the headset.
In some embodiments, the microphones include a first microphone and a second microphone, the speakers include a first speaker and a second speaker, the first speaker is used for sending ultrasonic signals, the second speaker is used for playing audio, the first speaker, the first microphone and the second microphone are located on the same straight line, and the first speaker is respectively located between the first microphone and the second microphone.
In the embodiment of the present disclosure, the earphone may also include two speakers. The first loudspeaker is used for emitting ultrasonic signals, and the second loudspeaker is used for playing audio. The audio frequency here is a sound signal having a low frequency relative to the ultrasonic signal. Generally refers to the sound signal that the user can hear.
The disclosed embodiments also provide a computer-readable storage medium, on which a computer program is stored, wherein the computer program is used for implementing the steps of the method according to the embodiments when being executed by a processor.
Fig. 8 is a block diagram illustrating a terminal device according to an example embodiment. For example, the terminal device may be a mobile phone, a computer, a digital broadcast terminal, a messaging device, a game console, a tablet device, a medical device, a fitness device, a personal digital assistant, and the like.
Referring to fig. 8, the terminal device may include one or more of the following components: a processing component 802, a memory 804, a power component 806, a multimedia component 808, an audio component 810, an input/output (I/O) interface 812, a sensor component 814, and a communication component 816.
The processing component 802 generally controls overall operation of the terminal device, such as operations associated with display, telephone calls, data communications, camera operations, and recording operations. The processing components 802 may include one or more processors 820 to execute instructions to perform all or a portion of the steps of the methods described above. Further, the processing component 802 can include one or more modules that facilitate interaction between the processing component 802 and other components. For example, the processing component 802 can include a multimedia module to facilitate interaction between the multimedia component 808 and the processing component 802.
The memory 804 is configured to store various types of data to support operations at the terminal device. Examples of such data include instructions for any application or method operating on the terminal device, contact data, phonebook data, messages, pictures, videos, etc. The memory 804 may be implemented by any type or combination of volatile or non-volatile memory devices such as Static Random Access Memory (SRAM), electrically erasable programmable read-only memory (EEPROM), erasable programmable read-only memory (EPROM), programmable read-only memory (PROM), read-only memory (ROM), magnetic memory, flash memory, magnetic or optical disks.
The power component 806 provides power to various components of the terminal device. The power components 806 may include a power management system, one or more power sources, and other components associated with generating, managing, and distributing power for the terminal device.
The multimedia component 808 includes a screen that provides an output interface between the terminal device and the user. In some embodiments, the screen may include a Liquid Crystal Display (LCD) and a Touch Panel (TP). If the screen includes a touch panel, the screen may be implemented as a touch screen to receive an input signal from a user. The touch panel includes one or more touch sensors to sense touch, slide, and gestures on the touch panel. The touch sensor may not only sense the boundary of a touch or slide action, but also detect the duration and pressure associated with the touch or slide operation. In some embodiments, the multimedia component 808 includes a front facing camera and/or a rear facing camera. When the terminal device is in an operation mode, such as a shooting mode or a video mode, the front camera and/or the rear camera can receive external multimedia data. Each front camera and rear camera may be a fixed optical lens system or have a focal length and optical zoom capability.
The audio component 810 is configured to output and/or input audio signals. For example, the audio component 810 includes a Microphone (MIC) configured to receive external audio signals when the terminal device is in an operational mode, such as a call mode, a recording mode, and a voice recognition mode. The received audio signals may further be stored in the memory 804 or transmitted via the communication component 816. In some embodiments, audio component 810 also includes a speaker for outputting audio signals.
The I/O interface 812 provides an interface between the processing component 802 and peripheral interface modules, which may be keyboards, click wheels, buttons, etc. These buttons may include, but are not limited to: a home button, a volume button, a start button, and a lock button.
The sensor component 814 includes one or more sensors for providing various aspects of state assessment for the terminal device. For example, sensor assembly 814 may detect the open/closed status of the terminal device, the relative positioning of components, such as a display and keypad of the terminal device, the change in position of the terminal device or a component of the terminal device, the presence or absence of user contact with the terminal device, the orientation or acceleration/deceleration of the terminal device, and the change in temperature of the terminal device. Sensor assembly 814 may include a proximity sensor configured to detect the presence of a nearby object without any physical contact. The sensor assembly 814 may also include a light sensor, such as a CMOS or CCD image sensor, for use in imaging applications. In some embodiments, the sensor assembly 814 may also include an acceleration sensor, a gyroscope sensor, a magnetic sensor, a pressure sensor, or a temperature sensor.
The communication component 816 is configured to facilitate communication between the terminal device and other devices in a wired or wireless manner. The terminal device may access a wireless network based on a communication standard, such as WiFi, 2G or 3G, or a combination thereof. In an exemplary embodiment, the communication component 816 receives a broadcast signal or broadcast related information from an external broadcast management system via a broadcast channel. In an exemplary embodiment, communications component 816 further includes a Near Field Communications (NFC) module to facilitate short-range communications. For example, the NFC module may be implemented based on Radio Frequency Identification (RFID) technology, infrared data association (IrDA) technology, Ultra Wideband (UWB) technology, Bluetooth (BT) technology, and other technologies.
In an exemplary embodiment, the terminal device may be implemented by one or more Application Specific Integrated Circuits (ASICs), Digital Signal Processors (DSPs), Digital Signal Processing Devices (DSPDs), Programmable Logic Devices (PLDs), Field Programmable Gate Arrays (FPGAs), controllers, micro-controllers, microprocessors or other electronic components for performing the above-described methods.
Other embodiments of the disclosure will be apparent to those skilled in the art from consideration of the specification and practice of the disclosure disclosed herein. This disclosure is intended to cover any variations, uses, or adaptations of the disclosure following, in general, the principles of the disclosure and including such departures from the present disclosure as come within known or customary practice within the art to which the disclosure pertains. It is intended that the specification and examples be considered as exemplary only, with a true scope and spirit of the disclosure being indicated by the following claims.
It will be understood that the present disclosure is not limited to the precise arrangements described above and shown in the drawings and that various modifications and changes may be made without departing from the scope thereof. The scope of the present disclosure is limited only by the appended claims.
- 上一篇：一种医用注射器针头装配设备
- 下一篇：一种耳机输出阻抗自适应系统及方法