阅读说明：本技术 助听方法及装置、存储介质、智能终端 (Hearing aid method and device, storage medium and intelligent terminal ) 是由 周恪睿 周波 于 2021-09-06 设计创作，主要内容包括：一种助听方法及装置、存储介质、智能终端,所述方法由智能终端执行,所述方法包括：在获取助听启动指令时,检测耳机与所述智能终端是否连接,在所述耳机与所述智能终端连接时,通过所述智能终端的麦克风接收外界环境的声音信号；通过选定的一组助听参数对所述声音信号进行处理,所述选定的一组助听参数选自助听参数集合；将处理后的声音信号发送至所述耳机,以使得所述耳机播放处理后的声音信号。通过该方案,用户能够用较低的成本实现有效助听效果,且用户能够自助配置和调试助听设备的各项参数,提高用户的使用便利性。(A hearing aid method and device, a storage medium and a smart terminal, wherein the method is executed by the smart terminal and comprises the following steps: detecting whether an earphone is connected with the intelligent terminal or not when a hearing aid starting instruction is obtained, and receiving a sound signal of an external environment through a microphone of the intelligent terminal when the earphone is connected with the intelligent terminal; processing the sound signal by a selected set of hearing assistance parameters, the selected set of hearing assistance parameters being selected from a set of hearing assistance parameters; and sending the processed sound signal to the earphone so that the earphone plays the processed sound signal. Through the scheme, the user can realize the effective hearing aid effect with lower cost, and the user can configure and debug various parameters of the hearing aid equipment by self, so that the use convenience of the user is improved.)

1. A hearing assistance method, the method being performed by a smart terminal, the method comprising: detecting whether an earphone is connected with the intelligent terminal or not when a hearing aid starting instruction is obtained, and receiving a sound signal of an external environment through a microphone of the intelligent terminal when the earphone is connected with the intelligent terminal;

processing the sound signal by a selected set of hearing assistance parameters, the selected set of hearing assistance parameters being selected from a set of hearing assistance parameters;

and sending the processed sound signal to the earphone so that the earphone plays the processed sound signal.

2. The method of claim 1, wherein a plurality of sets of hearing assistance parameters for different scenarios are preconfigured in the hearing assistance parameter set, each set of hearing assistance parameters comprising at least one or more of: frequency adjustment parameters, volume adjustment parameters, and noise reduction parameters;

the frequency adjustment parameter is used for adjusting the frequency of the sound signal, the volume adjustment parameter is used for adjusting the amplitude of the sound signal, and the noise reduction parameter is used for suppressing noise in the sound signal.

3. The method of claim 2, wherein the processing the sound signal with the selected set of hearing assistance parameters comprises:

and judging a scene corresponding to the external environment according to the sound signal, and selecting the hearing aid parameters of the scene corresponding to the external environment.

4. The method of any of claims 1 to 3, further comprising:

step A, when a parameter calibration instruction is received, sending a test audio signal to the earphone so that the earphone plays the test audio signal;

step B, when an adjusting instruction aiming at one or more hearing aid parameters in a group of hearing aid parameters is received, adjusting the corresponding hearing aid parameters according to the received adjusting instruction;

step C, processing the test audio signal through the adjusted hearing aid parameters, and sending the processed test audio signal to the earphone, so that the earphone plays the processed test audio signal;

skipping to the step B, and repeatedly executing the step B and the step C until a calibration ending instruction is received;

and D, saving the current hearing aid parameters when the calibration ending instruction is received.

5. The method of claim 4, wherein after step D, the method further comprises:

generating a corresponding hearing deficiency curve according to the current hearing aid parameters;

and automatically calibrating the hearing aid parameters of other uncalibrated scenes according to the hearing deficiency curve.

6. The method of claim 5, wherein after generating the corresponding hearing deficiency curve according to the current hearing assistance parameters, further comprising:

sending the hearing deficiency curve to a server;

and receiving hearing analysis and/or recommended hearing aid parameter configuration which is sent by the server and is based on the hearing deficiency curve.

7. The method according to claim 1, wherein after receiving the sound signal of the external environment through the microphone of the smart terminal, the method further comprises:

performing sound source analysis on the sound signal and outputting characteristics of one or more sound sources, the characteristics of each sound source including at least one of: the distance between the sound source and the intelligent terminal, the relative position between the sound source and the intelligent terminal and the type of the sound source.

8. The method of claim 7, wherein outputting characteristics of one or more sound sources comprises:

determining the orientation of a reference vector of the intelligent terminal according to the current attitude of the terminal;

and outputting the characteristic of the sound source aimed at by the reference vector of the intelligent terminal.

9. A hearing assistance device, wherein the hearing assistance device is disposed in or coupled to a smart terminal, the hearing assistance device comprising:

the starting module is used for detecting whether an earphone is connected with the intelligent terminal or not when a hearing aid starting instruction is obtained, and receiving sound signals of an external environment through a microphone of the intelligent terminal when the earphone is connected with the intelligent terminal;

a sound signal processing module for processing the sound signal by a selected set of hearing assistance parameters, the selected set of hearing assistance parameters being selected from a set of hearing assistance parameters;

and the playing module is used for sending the processed sound signal to the earphone so that the earphone plays the processed sound signal.

10. A storage medium having a computer program stored thereon, the computer program, when being executed by a processor, performing the steps of the method according to any of the claims 1 to 8.

11. An intelligent terminal comprising a memory and a processor, the memory having stored thereon a computer program operable on the processor, wherein the processor, when executing the computer program, performs the steps of the method of any of claims 1 to 8.

Technical Field

The invention relates to the field of development and debugging of hearing-aid equipment, in particular to a hearing-aid method and device, a storage medium and an intelligent terminal.

Background

The conventional hearing aid method is realized by a special hearing aid, wherein the hearing aid is a small-sized microphone, originally inaudible sound is amplified, and the residual hearing of the hearing-impaired person is utilized to enable the sound to be transmitted to the auditory center of the brain to feel the sound.

However, the special hearing aids are generally expensive, and require the user to go to a hospital or a fitting center, and a doctor or a professional fitting engineer performs hearing test, hearing aid fitting, and the like to implement fitting and configuration of parameters of each item in the hearing aids, so that the requirements on places and personnel are high, and the user is inconvenient to use.

Disclosure of Invention

The technical problem to be solved by the invention is how to provide a hearing aid method, so that a user can realize an effective hearing aid effect with lower cost, and the user can self-configure and debug various parameters of hearing aid equipment, thereby improving the use convenience of the user.

In order to solve the above problem, an embodiment of the present invention provides a hearing aid method, where the method is executed by an intelligent terminal, and the method includes: detecting whether an earphone is connected with the intelligent terminal or not when a hearing aid starting instruction is obtained, and receiving a sound signal of an external environment through a microphone of the intelligent terminal when the earphone is connected with the intelligent terminal; processing the sound signal by a selected set of hearing assistance parameters, the selected set of hearing assistance parameters being selected from a set of hearing assistance parameters; and sending the processed sound signal to the earphone so that the earphone plays the processed sound signal.

Optionally, a plurality of sets of hearing assistance parameters for different scenes are preconfigured in the hearing assistance parameter set, and each set of hearing assistance parameters at least includes one or more of the following: frequency adjustment parameters, volume adjustment parameters, and noise reduction parameters; the frequency adjustment parameter is used for adjusting the frequency of the sound signal, the volume adjustment parameter is used for adjusting the amplitude of the sound signal, and the noise reduction parameter is used for suppressing noise in the sound signal.

Optionally, the processing the sound signal by the selected set of hearing assistance parameters includes: and judging a scene corresponding to the external environment according to the sound signal, and selecting the hearing aid parameters of the scene corresponding to the external environment.

Optionally, the method further includes: step A, when a parameter calibration instruction is received, sending a test audio signal to the earphone so that the earphone plays the test audio signal; step B, when an adjusting instruction aiming at one or more hearing aid parameters in a group of hearing aid parameters is received, adjusting the corresponding hearing aid parameters according to the received adjusting instruction; step C, processing the test audio signal through the adjusted hearing aid parameters, and sending the processed test audio signal to the earphone, so that the earphone plays the processed test audio signal; skipping to the step B, and repeatedly executing the step B and the step C until a calibration ending instruction is received; and D, saving the current hearing aid parameters when the calibration ending instruction is received.

Optionally, after step D, the method further includes: generating a corresponding hearing deficiency curve according to the current hearing aid parameters; and automatically calibrating the hearing aid parameters of other uncalibrated scenes according to the hearing deficiency curve.

Optionally, after generating the corresponding hearing deficiency curve according to the current hearing assistance parameter, the method further includes: sending the hearing deficiency curve to a server; and receiving hearing analysis and/or recommended hearing aid parameter configuration which is sent by the server and is based on the hearing deficiency curve.

Optionally, after receiving the sound signal of the external environment through the microphone of the intelligent terminal, the method further includes: performing sound source analysis on the sound signal and outputting characteristics of one or more sound sources, the characteristics of each sound source including at least one of: the distance between the sound source and the intelligent terminal, the relative position between the sound source and the intelligent terminal and the type of the sound source.

Optionally, the outputting characteristics of one or more sound sources includes: determining the orientation of a reference vector of the intelligent terminal according to the current attitude of the terminal; and outputting the characteristic of the sound source aimed at by the reference vector of the intelligent terminal.

The embodiment of the present invention further provides a hearing aid device, where the hearing aid device is disposed in an intelligent terminal or coupled to the intelligent terminal, and the hearing aid device includes: the starting module is used for detecting whether an earphone is connected with the intelligent terminal or not when a hearing aid starting instruction is obtained, and receiving sound signals of an external environment through a microphone of the intelligent terminal when the earphone is connected with the intelligent terminal; a sound signal processing module for processing the sound signal by a selected set of hearing assistance parameters, the selected set of hearing assistance parameters being selected from a set of hearing assistance parameters; and the playing module is used for sending the processed sound signal to the earphone so that the earphone plays the processed sound signal.

Embodiments of the present invention further provide a storage medium having a computer program stored thereon, where the computer program is executed by a processor to perform any of the steps of the hearing aid method.

The embodiment of the invention also provides an intelligent terminal, which comprises a memory and a processor, wherein the memory is stored with a computer program capable of running on the processor, and the processor executes the steps of any hearing aid method when running the computer program.

Compared with the prior art, the technical scheme of the embodiment of the application has the following beneficial effects:

the hearing aid method provided by the embodiment of the invention can realize the hearing aid effect by matching the intelligent terminal and the earphone instead of the traditional hearing aid, thereby reducing the cost of hearing aid equipment. And the intelligent terminal can manage a self-help hearing parameter set comprising a plurality of hearing aid parameters, and the user can select the appropriate hearing aid parameters from the hearing aid parameters to change the hearing aid effect, thereby realizing self-help configuration and debugging of various parameters of the hearing aid equipment and improving the use convenience of the user.

Furthermore, the intelligent terminal can judge the scene that external environment corresponds according to the sound signal of the external environment that the microphone was gathered, automatically selects the hearing aid parameter that external environment is suitable for the user, and when monitoring the scene that external environment corresponds and changing, can carry out the switching of hearing aid parameter automatically to can select the best hearing aid parameter of hearing aid effect for the user in real time.

Furthermore, the user can realize self-help calibration of the hearing aid parameters of the hearing aid equipment through the intelligent terminal, and does not need to go to a hospital or a fitting center to calibrate all parameters of the hearing aid, so that the use convenience of the user can be improved.

Furthermore, the intelligent terminal can also analyze the sound source of the collected external sound signal to obtain the characteristics of all or part of the sound sources near the intelligent terminal, and the characteristics can be output and displayed on a screen as hearing aid information to better help a user to understand the external sound signal.

Drawings

Fig. 1 is a schematic flow chart of a hearing aid method according to an embodiment of the present invention;

fig. 2 is a schematic structural diagram of a hearing aid system according to an embodiment of the present invention;

FIG. 3 is a flowchart illustrating a parameter calibration method according to an embodiment of the present invention;

fig. 4 is a schematic diagram of a reference vector of an intelligent terminal according to an embodiment of the present invention;

fig. 5 is a schematic structural diagram of a hearing aid device according to an embodiment of the present invention.

Detailed Description

As background art, conventional hearing aids are expensive, and the requirements for the location and personnel for the configuration and fitting of parameters of the hearing aids are high, which is inconvenient for the user.

In order to solve the above problem, an embodiment of the present invention provides a hearing assistance method and apparatus, a storage medium, and an intelligent terminal, where the hearing assistance method is executed by the intelligent terminal, and the hearing assistance method includes: detecting whether an earphone is connected with the intelligent terminal or not when a hearing aid starting instruction is obtained, and receiving a sound signal of an external environment through a microphone of the intelligent terminal when the earphone is connected with the intelligent terminal; processing the sound signal by a selected set of hearing assistance parameters, the selected set of hearing assistance parameters being selected from a set of hearing assistance parameters; and sending the processed sound signal to the earphone so that the earphone plays the processed sound signal. The scheme of the embodiment of the invention can realize the hearing-aid effect through the cooperation of the intelligent terminal and the earphone, thereby reducing the cost of hearing-aid equipment. And the intelligent terminal can manage a self-help hearing parameter set comprising a plurality of hearing aid parameters, and the user can select the appropriate hearing aid parameters from the hearing aid parameters to change the hearing aid effect, thereby realizing self-help configuration and debugging of various parameters of the hearing aid equipment and improving the use convenience of the user.

In order to make the aforementioned objects, features and advantages of the present invention comprehensible, embodiments accompanied with figures are described in detail below.

Referring to fig. 1, fig. 1 is a schematic flowchart of a hearing assistance method according to an embodiment of the present invention, where the hearing assistance method is executed by an intelligent terminal, and the intelligent terminal may include a smart phone, a computer, a tablet computer, or a smart watch, and the method includes the following steps S101 to S103, which are described in detail as follows.

Step S101, when a hearing aid starting instruction is obtained, whether an earphone is connected with the intelligent terminal or not is detected, and when the earphone is connected with the intelligent terminal, a microphone of the intelligent terminal receives sound signals of an external environment.

The hearing aid starting instruction is an instruction for starting the hearing aid method, the hearing aid starting instruction can be an instruction input by the user in an input device of the intelligent terminal (for example, a screen of a smart phone is input through a touch screen), and the hearing aid starting instruction can also be an instruction received by the intelligent terminal and sent by other devices.

Referring to fig. 2, fig. 2 is a schematic structural diagram of a hearing assistance system according to an embodiment of the present invention, where the hearing assistance system may include an intelligent terminal 201 and an earphone 202. The earphone 202 and the intelligent terminal 201 can be connected through a circuit connection, a bluetooth connection or other modes. An existing smart terminal (e.g., a mobile phone, etc.) may generally automatically detect that an earphone is connected thereto, and the smart terminal should be equipped with a microphone, when the hearing aid method is activated, a sound signal of an external environment where the terminal is located is collected by the microphone, and the collected sound signal is played by the earphone after being processed (e.g., amplified, noise reduced, etc.), and is heard by a user through hearing (e.g., residual hearing).

Step S102, the sound signal is processed by a selected set of hearing assistance parameters, the selected set of hearing assistance parameters being selected from a set of hearing assistance parameters.

The intelligent terminal is configured with a hearing aid parameter set comprising a plurality of sets of hearing aid parameters, each set of hearing aid parameters may include one or more parameters, and the types of the hearing aid parameters may include parameters for adjusting the volume or frequency of a sound signal, filter coefficients, noise reduction coefficients, and the like. Optionally, the hearing aid parameters are the same as the hearing aid parameters configured in the conventional hearing aid, and the values of the hearing aid parameters correspond to the hearing conditions of the user. The intelligent terminal can filter the sound signal based on the filter coefficient to realize processing such as noise reduction.

Step S103, the processed sound signal is sent to the earphone, so that the earphone plays the processed sound signal.

The intelligent terminal processes the sound signals of the external environment based on a group of hearing aid parameters selected by the user, adjusts the sound signals into sound signals which can be heard by the residual hearing of the user, and sends the sound signals to the earphone to be played to the user.

The method shown in fig. 1 can realize the hearing-aid effect by the cooperation of the intelligent terminal and the earphone instead of the traditional hearing aid, thereby reducing the cost of the hearing-aid equipment. And the intelligent terminal can manage a self-help hearing parameter set comprising a plurality of hearing aid parameters, and the user can select the appropriate hearing aid parameters from the hearing aid parameters to change the hearing aid effect, thereby realizing self-help configuration and debugging of various parameters of the hearing aid equipment and improving the use convenience of the user.

In one embodiment, the headset may be a bone conduction headset, and one or more hearing assistance parameters in the set of hearing assistance parameters are bone conduction related parameters, which may include parameters such as response frequency, sensitivity, signal-to-noise ratio, transient response, and distortion level. Wherein the bone conduction related parameter varies with the make and/or model of the headset. The method further comprises the following steps: acquiring the brand and/or model of the earphone to judge the contact information between the earphone and the human ear after the earphone is worn on the human ear, wherein the contact information at least comprises the contact position between the earphone and the human ear and the tightness when the earphone is worn on the human ear; determining the bone conduction related parameter according to the contact information.

The hearing deficiency of the hearing-impaired user is usually determined by air conduction hearing and bone conduction hearing, and the condition that when the earphone plays a sound signal, the sound signal is transmitted to the brain of the user through the bone conduction of the human ear can be predicted through the position of the earphone, which is in contact with the human ear when the earphone is worn correctly, and the tightness of a cavity formed between the earphone and the human ear. The bone conduction related parameters and wearing conditions of different brands and/or models of earphones are different, and the intelligent terminal can acquire the brands and/or models of earphones to select the corresponding bone conduction related parameters for the user.

In a specific embodiment, please refer to fig. 1 and fig. 2 again, the method shown in fig. 1 may be implemented by an Application (APP) or system software installed on the smart terminal 201, and the user opens the APP or system software on the smart terminal 201 and issues a hearing assistance starting instruction. The hearing aid parameter set comprises a plurality of groups of hearing aid parameters, each group of hearing aid parameters can comprise numerical values corresponding to a plurality of different types of hearing aid parameters, and if a user needs to change the currently selected hearing aid parameters, the hearing aid parameters can be modified through a parameter modification page in APP or system software. The APP or system software is further configured to perform sound analysis and processing on a sound signal collected by a microphone of the intelligent terminal 201. With reference to fig. 2, the hearing aid system may further include a server 203, where the server 203 is connected to one or more intelligent terminals 201 through a connection manner such as network connection, and can perform software upgrade or problem collection on APP or system software on each intelligent terminal 201. Optionally, the APP or system software further includes a problem feedback page for collecting problems and opinions of the user, and the collected problems and opinions are sent to the server 203 by the intelligent terminal 201, so that interaction between the user and a remote manufacturer can be realized.

In one embodiment, a plurality of sets of hearing assistance parameters for different scenes are preconfigured in the hearing assistance parameter set, and each set of hearing assistance parameters at least includes one or more of the following: frequency adjustment parameters, volume adjustment parameters, and noise reduction parameters; the frequency adjustment parameter is used for adjusting the frequency of the sound signal, the volume adjustment parameter is used for adjusting the amplitude of the sound signal, and the noise reduction parameter is used for suppressing noise in the sound signal.

The different scenes may include an indoor scene, an outdoor scene, a high-noise scene (e.g., a scene with high environmental noise such as a factory or a decoration place), and the like. For the hearing condition of the same user, the hearing aid parameters of different scenes are different. For example, the noise in the indoor scene is the smallest, the noise in the outdoor scene is the next largest, and the noise in the high-noise scene is the largest, and correspondingly, the noise reduction coefficient corresponding to the indoor scene is the smallest, the noise reduction coefficient in the outdoor scene is the next largest, and the noise reduction coefficient in the high-noise scene is the highest.

It should be noted that each scene may be set according to the requirement of a large number of users using the hearing aid method, and the numerical values of a set of hearing aid parameters corresponding to each scene may also be determined according to the actual requirement, including but not limited to the above examples.

In one embodiment, the processing of the sound signal by the selected set of hearing aid parameters in step S102 in fig. 1 may include: and judging a scene corresponding to the external environment according to the sound signal, and selecting the hearing aid parameters of the scene corresponding to the external environment.

After the sound signal of the external environment is collected by the intelligent terminal through the microphone, the scene of the external environment can be judged according to the volume of noise (such as wind sound, engine sound and the like) contained in the collected sound signal and the volume of effective sound signals (such as speaking sound, music sound and the like), so that hearing aid parameters corresponding to the scene can be automatically selected according to the scene corresponding to the external environment.

Optionally, when the intelligent terminal and the earphone are continuously used as the hearing aid, the scene corresponding to the external environment is determined once at intervals (e.g., every 10 minutes or half an hour), and if the scene corresponding to the external environment is found to be changed, the selected hearing aid parameter is switched to the hearing aid parameter corresponding to the changed scene.

In this embodiment, the intelligent terminal can judge the scene that external environment corresponds according to the sound signal of the external environment that the microphone was gathered, selects the hearing aid parameter that external environment is suitable for the user automatically, and when monitoring the scene that external environment corresponds and changing, can carry out the switching of hearing aid parameter automatically to can select the best hearing aid parameter of hearing aid effect for the user in real time.

In an embodiment, please refer to fig. 3, fig. 3 is a flowchart illustrating a parameter calibration method according to an embodiment of the present invention, the parameter calibration method is used for calibrating one or more hearing aid parameters in the hearing aid parameter set, and the parameter calibration method may include the following steps a to D, which are described in detail below.

Step A, when a parameter calibration instruction is received, sending a test audio signal to the earphone so that the earphone plays the test audio signal.

The parameter calibration instruction is an instruction for starting calibration of one or more parameters in the hearing aid parameter set, the parameter calibration instruction may be an instruction input by the user in an input device of the intelligent terminal, and the parameter calibration instruction may also be an instruction sent by another device received by the intelligent terminal.

After the calibration is started, the intelligent terminal sends a test audio signal to the earphone, where the test audio signal may be an audio signal collected from an external environment or an audio signal obtained by downloading by the intelligent terminal, such as a piece of music or a session. Optionally, the user may select the played test audio signal on the smart terminal. Optionally, the test audio signal corresponds to a current scenario of the hearing aid parameter to be calibrated, for example, if the user needs to calibrate the hearing aid parameter of an outdoor scenario, the played test audio signal is a segment of audio recorded outdoors.

And step B, when an adjusting instruction aiming at one or more hearing-aid parameters in the group of hearing-aid parameters is received, adjusting the corresponding hearing-aid parameters according to the received adjusting instruction.

The adjustment instruction is an instruction for adjusting one or more parameters in the hearing aid parameter set, and optionally, the adjustment instruction may be an instruction input by a user or received by an intelligent terminal. If the hearing aid method is executed through the APP or the system software installed on the intelligent terminal, the APP or the system software can provide a single page or a region of the page for a user to input an adjustment instruction and adjust the value of each hearing aid parameter. Optionally, the values corresponding to one or more hearing aid parameters are displayed in the page, and the user can change the values displayed by the hearing aid parameters on the page through the input adjustment instruction to adjust the values of the hearing aid parameters, so as to adjust the hearing aid parameters corresponding to one or more scenes.

And step C, processing the test audio signal through the adjusted group of hearing aid parameters, and sending the processed test audio signal to the earphone, so that the earphone plays the processed test audio signal. And then jumping to the step B, and repeatedly executing the step B and the step C until a calibration end instruction is received.

Optionally, after the user adjusts the hearing aid parameters each time, the test audio signal is processed according to the adjusted hearing aid parameters, and the test audio signal played by the earphone is updated to the processed test audio signal, so that the user can feel the hearing aid effect of the adjusted hearing aid parameters in real time, and if the user is not satisfied with the hearing aid effect of the current hearing aid parameters, the hearing aid parameters can be continuously adjusted.

And D, saving the current hearing aid parameters when the calibration ending instruction is received.

After the user obtains a satisfactory hearing aid effect, a calibration ending instruction can be issued to the intelligent terminal to end the parameter calibration process, the intelligent terminal stores each adjusted hearing aid parameter, and when the user uses the hearing aid method later, the hearing aid parameter stored after calibration can be used for processing the collected sound signal. Optionally, if the APP or the system software provides a separate page or a specific area of the page for adjusting the value of each hearing aid parameter, the separate page may be closed or the specific area of the page may be retracted when the calibration end instruction is received.

In this embodiment, the user can realize self-service calibration of the hearing aid parameters of the hearing aid device through the intelligent terminal, and does not need to go to a hospital or a fitting center to calibrate all parameters of the hearing aid, so that the convenience of use of the user can be improved.

In one embodiment, referring again to fig. after step D, the hearing assistance method further comprises: generating a corresponding hearing deficiency curve according to the current hearing aid parameters; and automatically calibrating the hearing aid parameters of other uncalibrated scenes according to the hearing deficiency curve.

The hearing deficiency curve, also called hearing curve, is used to represent the hearing deficiency of the user. Conventionally, a user needs to go to a hospital or a fitting center to measure the hearing deficiency condition of the user by using a hearing tester. In the clinical hearing test, the threshold value is traced on the same audiogram through the sound response threshold value of a tester to each frequency, and each point is connected to draw an air conduction hearing curve and a bone conduction hearing curve to obtain the hearing deficiency curve. The doctor or the dispenser compares and analyzes the two curves to determine the normal hearing range of the tester, the degree of hearing loss (including mild, moderate, severe or extremely severe), the nature and the position of the hearing disorder and other information.

The contact position of the earphone and the ear of the user and the tightness between the earphone and the ear can be determined through the brand and the model of the earphone, optionally, the intelligent terminal can acquire the brand and the model of the earphone, and then the hearing-aid parameters stored by the intelligent terminal after calibration are combined to determine the hearing-aid defect condition of the user so as to generate the hearing-aid defect curve of the user.

Furthermore, the hearing deficiency curve generated in a certain scene can be used for automatically calibrating various hearing aid parameters corresponding to other scenes. Generally, hearing aid parameters related to noise reduction in each scene change according to the scene, while related hearing aid parameters for compensating the hearing deficiency of the user are not restricted by the scene, and the intelligent terminal can automatically calibrate each group of hearing aid parameters in other scenes by one key according to the hearing deficiency curve of the user without calibrating the hearing aid parameters by scenes of the user, so that the use convenience of the user is improved.

In one embodiment, after generating the corresponding hearing deficiency curve according to the current hearing assistance parameters, the method further includes: sending the hearing deficiency curve to a server; and receiving hearing analysis and/or recommended hearing aid parameter configuration which is sent by the server and is based on the hearing deficiency curve.

After the intelligent terminal generates the hearing deficiency curve of the user, the hearing deficiency curve can be sent to the server to serve as feedback of the hearing condition of the user. The server can send the hearing deficiency curves of the users to a doctor or a terminal such as a computer or a mobile phone of an expert, and the doctor or the expert can remotely perform hearing diagnosis for the users and recommend hearing aid parameter configuration for the users based on the hearing deficiency curves of the users.

Optionally, after receiving the hearing deficiency curves of one or more users, the server may determine whether the scene/hearing aid parameter configuration provided by the current APP or system software for the user can meet the calibration requirement of the user according to the hearing deficiency curves, and if not, issue an instruction for updating the APP or system software to the terminal of the user, so as to remotely update the APP or system software of the user terminal.

In one embodiment, with continuing reference to fig. 1, after the step S101 receives the sound signal of the external environment through the microphone of the smart terminal, the hearing aid method further includes: performing sound source analysis on the sound signal and outputting characteristics of one or more sound sources, the characteristics of each sound source including at least one of: the distance between the sound source and the intelligent terminal, the relative position between the sound source and the intelligent terminal and the type of the sound source.

The sound source is a sound source, and the collected sound signals may be from a plurality of sound sources, or may not be from a specific sound source, i.e., a pure noise environment. The intelligent terminal can judge the sound source of each sound in the sound signals based on factors such as the timbre, the frequency and the like of each sound in the collected sound signals. Furthermore, the intelligent terminal divides the collected sound signals according to frequency bands and analyzes each frequency band respectively, so that the type of the sound source corresponding to the sound signals of each frequency band is judged. For example, if the external sound signal contains the voice of a human speaking, the sound source of the voice is a human; if the external sound signal includes the sound of the automobile whistle, the corresponding sound source is the automobile and the like.

Optionally, the factors such as timbre and frequency corresponding to sound generated by a plurality of different sound sources can be stored in the intelligent terminal. The intelligent terminal compares a plurality of factors of each sound in the collected sound signals with the stored factors of different sound sources so as to determine the sound corresponding to the sound contained in the collected sound signals. Furthermore, factors such as timbre, frequency and the like corresponding to sounds generated by a plurality of different sound sources stored on the intelligent terminal can be acquired from the server side through the APP or system software.

After the smart terminal determines the sound source corresponding to each sound, characteristics of each sound source may be output (e.g., displayed on a screen) on the screen of the smart terminal as hearing aid information. The intelligent terminal can judge the distance between the sound source and the intelligent terminal according to the volume of the sound signal corresponding to each sound source, judge the relative position between the sound source and the intelligent terminal through the echo or the spatial sensation of the sound signal corresponding to each sound source, and the type of the sound source can be people, automobiles and the like.

In a specific embodiment, when a user opens an APP or system software for implementing a hearing aid method and performs hearing aid on sounds of an external environment through an earphone, a schematic diagram of one or more sound sources included in currently acquired sound signals of the external environment, and distances and relative positions between the respective sound sources and the intelligent terminal may be output on a display page of the APP or system software. For example, the following may be output on a display page of the APP or system software: a sound source automobile exists at the position 50 meters in front of the left side, and at the moment, collected sound signals of the external environment can be played simultaneously in the earphone, wherein the sound signals comprise whistle sound of the automobile. Furthermore, a map around the position where the current intelligent terminal is located can be output in a display page of the APP or system software, and each sound source is displayed at a corresponding position on the output map according to the relative position and distance between the sound source and the intelligent terminal, so that the user can understand the sound source more conveniently.

Optionally, the outputting characteristics of one or more sound sources includes: determining the orientation of a reference vector of the intelligent terminal according to the current attitude of the terminal; and outputting the characteristic of the sound source aimed at by the reference vector of the intelligent terminal.

The gesture of the intelligent terminal is an included angle of a display area (namely a terminal screen) of the terminal deviating from a horizontal plane and/or an included angle deviating from a gravity direction. And monitoring the attitude of the terminal, and acquiring the attitude of the terminal at each moment in real time as the current attitude of the terminal. Optionally, the current posture of the intelligent terminal is obtained through a posture sensor on the intelligent terminal, wherein the posture sensor is a high-performance three-dimensional motion posture measurement System based on Micro-Electro-Mechanical System (MEMS for short), and may include motion sensors such as a three-axis gyroscope, a three-axis accelerometer, and a three-axis electronic compass.

For example, when the intelligent terminal is an intelligent mobile phone, the reference vector of the intelligent terminal may be a vector pointing to the top of the bottom of a screen of the intelligent mobile phone, and please refer to fig. 4, where fig. 4 is a schematic diagram of the reference vector of the intelligent terminal.

When there are a plurality of sound sources in the collected sound signal of the external environment, if the characteristics of the plurality of sound sources are output simultaneously, the output information may be too much, and the user may not conveniently check the sound signal. At this time, the user may change the orientation of the reference vector of the smart terminal, and cause the smart terminal to output only the characteristics of the sound source existing in that direction. For example, the user changes the posture of the smartphone to make the reference vector as shown in fig. 4 face to the left 45 degrees right in front of the user, and the APP of the smartphone or the display page of the system software displays only the characteristics of the sound source existing in the left 45 degrees in front of the user.

In this embodiment, the intelligent terminal can also perform sound source analysis on the acquired external sound signals to obtain the characteristics of all or part of sound sources near the intelligent terminal, and the characteristics can be output and displayed on a screen as hearing aid information to better help a user understand the external sound signals.

Referring to fig. 5, an embodiment of the present invention further provides a hearing assistance device 50, where the hearing assistance device 50 is disposed in a smart terminal, or the hearing assistance device 50 is disposed separately from the smart terminal and coupled to the smart terminal, and the hearing assistance device 50 includes: the starting module 501 is configured to detect whether an earphone is connected to the intelligent terminal when a hearing aid starting instruction is obtained, and receive a sound signal of an external environment through a microphone of the intelligent terminal when the earphone is connected to the intelligent terminal; a sound signal processing module 502 for processing the sound signal by a selected set of hearing assistance parameters selected from a set of hearing assistance parameters; the playing module 503 is configured to send the processed sound signal to the earphone, so that the earphone plays the processed sound signal.

In one embodiment, a plurality of sets of hearing assistance parameters for different scenes are preconfigured in the hearing assistance parameter set, and each set of hearing assistance parameters at least includes one or more of the following: frequency adjustment parameters, volume adjustment parameters, and noise reduction parameters; the frequency adjustment parameter is used for adjusting the frequency of the sound signal, the volume adjustment parameter is used for adjusting the amplitude of the sound signal, and the noise reduction parameter is used for suppressing noise in the sound signal.

In an embodiment, the sound signal processing module 502 may be further configured to determine a scene corresponding to an external environment according to the sound signal, and select a hearing aid parameter of the scene corresponding to the external environment.

In one embodiment, the hearing assistance device 50 can further comprise: a calibration starting module, configured to execute step a, and send a test audio signal to the earphone when receiving a parameter calibration instruction, so that the earphone plays the test audio signal; the parameter adjusting module is used for executing the step B, and when an adjusting instruction aiming at one or more hearing-aid parameters in a group of hearing-aid parameters is received, adjusting the corresponding hearing-aid parameters according to the received adjusting instruction; the testing module is used for executing the step C, processing the testing audio signal through the adjusted group of hearing aid parameters and sending the processed testing audio signal to the earphone so that the earphone plays the processed testing audio signal; a loop module, configured to jump to the step B, and repeatedly execute the step B and the step C until a calibration end instruction is received; and D, a calibration ending module used for executing the step D and saving the current hearing aid parameters when the calibration ending instruction is received.

In one embodiment, after the calibration end module, the hearing device 50 can further include: the hearing-deficiency curve generating module is used for generating a corresponding hearing-deficiency curve according to the current hearing-aid parameters; and the automatic calibration module is used for automatically calibrating the hearing aid parameters of other uncalibrated scenes according to the hearing aid defect curve.

In one embodiment, after the automatic calibration module, the hearing device 50 may further include: the sending module is used for sending the hearing deficiency curve to a server; and the remote assistance module is used for receiving hearing analysis and/or recommended hearing aid parameter configuration which is sent by the server and is based on the hearing deficiency curve.

In an embodiment, after the receiving of the sound signal of the external environment through the microphone of the smart terminal is performed, the starting module 501 may be further configured to: performing sound source analysis on the sound signal and outputting characteristics of one or more sound sources, the characteristics of each sound source including at least one of: the distance between the sound source and the intelligent terminal, the relative position between the sound source and the intelligent terminal and the type of the sound source.

In one embodiment, the starting module 501 may include: the orientation determining unit is used for determining the orientation of a reference vector of the intelligent terminal according to the current attitude of the terminal; and the sound source characteristic output unit is used for outputting the characteristic of the sound source aimed at by the reference vector of the intelligent terminal.

For more details on the operation principle and the operation mode of the hearing aid device 50, reference may be made to fig. 1 to 4 for the related description of the hearing aid method, which is not repeated here.

An embodiment of the present invention further provides a storage medium, on which a computer program is stored, where the computer program is executed by a processor to perform the steps of the hearing aid method described in fig. 1 to 4. The storage medium may be a computer-readable storage medium, and may include, for example, a non-volatile (non-volatile) or non-transitory (non-transitory) memory, and may further include an optical disc, a mechanical hard disk, a solid state hard disk, and the like.

The embodiment of the invention also provides the intelligent terminal. The intelligent terminal may comprise a memory and a processor, the memory having stored thereon a computer program operable on the processor, the processor executing the steps of the hearing assistance method of fig. 1-4 when executing the computer program.

Specifically, in the embodiment of the present invention, the processor may be a Central Processing Unit (CPU), and the processor may also be other general-purpose processors, Digital Signal Processors (DSPs), Application Specific Integrated Circuits (ASICs), Field Programmable Gate Arrays (FPGAs) or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components, and the like. A general purpose processor may be a microprocessor or the processor may be any conventional processor or the like.

It will also be appreciated that the memory in the embodiments of the subject application can be either volatile memory or nonvolatile memory, or can include both volatile and nonvolatile memory. The nonvolatile memory may be a read-only memory (ROM), a Programmable ROM (PROM), an Erasable PROM (EPROM), an Electrically Erasable PROM (EEPROM), or a flash memory. Volatile memory can be Random Access Memory (RAM), which acts as external cache memory. By way of example and not limitation, many forms of Random Access Memory (RAM) are available, such as Static RAM (SRAM), Dynamic RAM (DRAM), Synchronous DRAM (SDRAM), double data rate SDRAM (DDR SDRAM), enhanced SDRAM (enhanced SDRAM), SDRAM (SLDRAM), synchlink DRAM (SLDRAM), and direct bus RAM (DR RAM).

It should be understood that the term "and/or" herein is merely one type of association relationship that describes an associated object, meaning that three relationships may exist, e.g., a and/or B may mean: a exists alone, A and B exist simultaneously, and B exists alone. In addition, the character "/" in this document indicates that the former and latter related objects are in an "or" relationship.

The "plurality" appearing in the embodiments of the present application means two or more.

The descriptions of the first, second, etc. appearing in the embodiments of the present application are only for illustrating and differentiating the objects, and do not represent the order or the particular limitation of the number of the devices in the embodiments of the present application, and do not constitute any limitation to the embodiments of the present application.

The term "connect" in the embodiments of the present application refers to various connection manners, such as direct connection or indirect connection, to implement communication between devices, which is not limited in this embodiment of the present application.

Although the present invention is disclosed above, the present invention is not limited thereto. Various changes and modifications may be effected therein by one skilled in the art without departing from the spirit and scope of the invention as defined in the appended claims.