阅读说明：本技术 一种基于命令词识别的语音通信干扰效果客观评估方法 (Voice communication interference effect objective evaluation method based on command word recognition ) 是由 董树理 王建路 崔建岭 王岩 赵琳锋 刘敏 王琼 孙丹辉 徐娜娜 于 2021-07-01 设计创作，主要内容包括：本发明属于电子对抗技术领域,公开的一种基于命令词识别的语音通信干扰效果客观评估方法,首先基于深度学习法,针对通信报文、命令词进行模型训练,建立命令词识别模型；其次,将原始语音、受扰语音信号作为输入进行命令词识别,将原始语音识别结果作为正确结果,统计受扰语音的识别准确率；最后,通过识别准确率与主观评估值之间的映射关系曲线,将识别准确率转换为主观评估值,并确定干扰等级和干扰效果；本发明解决了低信噪比条件下语音通信干扰效果客观评估中同步困难、主客观评估相关系数低的难题,对传统的人机交互系统能够形成很好的补充,有利于改善操作者的交互体验,提高人机工效。(The invention belongs to the technical field of electronic countermeasure, and discloses a voice communication interference effect objective evaluation method based on command word recognition, which comprises the steps of firstly, carrying out model training aiming at communication messages and command words based on a deep learning method, and establishing a command word recognition model; secondly, using the original voice and the disturbed voice signal as input to carry out command word recognition, using the original voice recognition result as a correct result, and counting the recognition accuracy rate of the disturbed voice; finally, converting the identification accuracy into a subjective evaluation value through a mapping relation curve between the identification accuracy and the subjective evaluation value, and determining the interference level and the interference effect; the invention solves the problems of difficult synchronization and low subjective and objective evaluation correlation coefficient in the objective evaluation of the voice communication interference effect under the condition of low signal-to-noise ratio, can well supplement the traditional human-computer interaction system, is beneficial to improving the interaction experience of operators and improving the human-computer work efficiency.)

1. A voice communication interference effect objective evaluation method based on command word recognition is characterized by comprising the following steps: firstly, performing model training aiming at communication messages and command words based on a deep learning method, and establishing a command word recognition model; secondly, using the original voice and the disturbed voice signal as input to carry out command word recognition, using the original voice recognition result as a correct result, and counting the recognition accuracy rate of the disturbed voice; finally, converting the identification accuracy into a subjective evaluation value through a mapping relation curve between the identification accuracy and the subjective evaluation value, and determining the interference level and the interference effect; the specific implementation steps are as follows:

the method comprises the following steps: establishing a command word recognition model based on a deep learning method, adopting recognition of a command word based on a deep learning framework under the low signal-to-noise ratio environment of communication countermeasure, establishing the command word recognition model based on the adaptability and recognition performance of GMM-HMM recognition and a feedforward-type sequence Memory Network (FSMN), introducing a Chinese tone type through a voice characteristic level, adopting digital independent whole word modeling on a modeling scheme, improving the recognition rate under the low signal-to-noise ratio environment by adopting a multi-pass decoding architecture method for recognition and decoding, and training the model based on training data sets with different signal-to-noise ratios;

the identification accuracy rate under the quiet environment is required to be better than 92%, and the correlation coefficient of subjective and objective evaluation on a test set is better than 0.90;

step two: counting the recognition accuracy of the disturbed voice, taking the recognition result of the original voice signal or the original voice text as a correct result, and inputting the disturbed voice into the trained command word recognition model to obtain a corresponding recognition result; comparing the recognition result of the disturbed voice with the correct result, and counting the recognition accuracy of the disturbed voice, wherein the recognition accuracy is defined as:

wherein: n represents the number of all words participating in the test; i represents the number of words with errors inserted; d represents the number of words with deletion errors of the recognition result relative to the marked correct result; s represents the number of words with replacement errors;

step three: and establishing a mapping between the recognition accuracy and the subjective evaluation value, and mapping the recognition accuracy into an interference grade of the subjective evaluation according to the recognition accuracy of the disturbed voice aiming at different types of interference and different signal to noise ratios to determine the interference grade and the interference effect.

Technical Field

The invention belongs to the technical field of electronic countermeasure, and provides a voice communication interference effect objective evaluation method based on command word recognition, which is suitable for evaluating and identifying voice communication interference effects in a complex environment with a low signal-to-noise ratio.

Background

Voice communication is one of the primary communication means of communication devices. The evaluation of the interference effect of voice communication is the main content of the performance test of the communication and communication countermeasure equipment, and the performance and efficiency of the evaluation method directly influence the performance evaluation and test efficiency of the communication and communication countermeasure equipment.

The objective evaluation of the interference effect of voice communication is based on the mathematical comparison of the original voice signal and the interfered voice signal, and the interference effect of voice is predicted by measuring the characteristics and physical parameters of the waveform of the voice signal. In general, it is desirable that objective assessment methods give the same results as subjective assessment methods, or that objective assessment algorithms be found that closely approximate the performance of subjective assessment over a fairly wide range. The objective evaluation has the advantages of convenience, rapidness, time saving and labor saving, particularly has more obvious advantages when large-scale and systematic evaluation is carried out on communication and communication countermeasure equipment, can solve the problem of large subjective evaluation deviation caused by completely depending on manual interpretation in the evaluation of the voice interference effect, and can play an important role in the test of communication and communication countermeasure performance.

The command word recognition mainly aims at the voice of isolated words, industry terms, communication messages, short sentences and other specific use environments to carry out recognition. The command word recognition has the characteristics of high efficiency, naturalness, flexibility, sensitivity, quick information presentation and the like, and if the command word recognition technology can be used for a relevant test scene, the advantages of the characteristics of the command word recognition can be exerted. The command word recognition technology is used for realizing the command voice recognition of the operator, so that the traditional human-computer interaction system can be well supplemented, the interaction experience of the operator can be improved, and the human-computer work efficiency can be improved.

Disclosure of Invention

The invention provides a voice communication interference effect objective evaluation method based on command word recognition, which aims to solve the problems of difficult synchronization and low correlation coefficient in objective evaluation of voice communication interference effect under the condition of low signal-to-noise ratio. The method is suitable for objectively evaluating the voice communication interference effect under the conditions of low signal-to-noise ratio and interference, and has good adaptability and reliability.

In order to achieve the purpose, the invention adopts the following technical scheme:

a voice communication interference effect objective assessment method based on command word recognition is characterized by firstly carrying out model training aiming at communication messages, command words and the like based on a deep learning method and establishing a command word recognition model; secondly, using the original voice and the disturbed voice signal as input to carry out command word recognition, using the original voice recognition result as a correct result, and counting the recognition accuracy rate of the disturbed voice; and finally, converting the identification accuracy into a subjective evaluation value through a mapping relation curve between the identification accuracy and the subjective evaluation value, and determining the interference level and the interference effect.

The method comprises the following steps: establishing a command word recognition model based on a deep learning method

Under the low signal-to-noise ratio environment of communication countermeasure, better adaptability and recognition performance can be achieved by adopting a command word recognition method based on a deep learning framework compared with recognition methods based on GMM-HMM and the like. A command word recognition model is established based on a feedforward type sequence Memory Network FSMN (Feed-forward Sequential Memory Network), Chinese tone type is introduced through a speech characteristic layer, a digital independent whole word modeling is adopted on a modeling scheme, a multi-pass decoding framework is adopted for recognition decoding, the recognition rate in a low signal-to-noise ratio environment is improved, and the model is trained based on training data sets with different signal-to-noise ratios. The identification accuracy rate under the quiet environment is required to be better than 92%, and the correlation coefficient evaluated subjectively and objectively on the test set is better than 0.90.

Step two: recognition accuracy rate of statistic disturbed voice

And inputting the disturbed voice into the trained command word recognition model to obtain a corresponding recognition result by taking the recognition result of the original voice signal or the original voice text as a correct result. And comparing the recognition result of the disturbed voice with the correct result, and counting the recognition accuracy of the disturbed voice. The recognition accuracy is defined as:

wherein: n represents the number of all words participating in the test; i represents the number of words with errors inserted; d represents the number of words with deletion errors of the recognition result relative to the marked correct result; s represents the number of words for which a replacement error has occurred.

Step three: establishing a mapping of recognition accuracy and subjective assessment value

And aiming at different types of interference and different signal-to-noise ratios, mapping the recognition accuracy into the interference grade of subjective evaluation according to the recognition accuracy of the disturbed voice, and determining the interference grade and the interference effect.

Due to the adoption of the technical scheme, the invention has the following advantages:

a voice communication interference effect objective evaluation method based on command word recognition is suitable for objective evaluation of voice communication interference effects under the conditions of low signal-to-noise ratio and interference, and has good adaptability and credibility. By using the command word recognition technology for the relevant test scenarios, the advantages of command word recognition in these features are exploited. The command word recognition technology is used for realizing the command voice recognition of an operator, the problems of difficult synchronization and low subjective and objective evaluation correlation coefficient in the objective evaluation of voice communication interference effect under the condition of low signal-to-noise ratio are solved, the traditional human-computer interaction system can be well supplemented, the interaction experience of the operator can be improved, and the human-computer work efficiency can be improved.

Drawings

FIG. 1 illustrates the workflow of the present invention;

FIG. 2 is a block diagram of an FSMN architecture for command word recognition;

fig. 3 is a relationship curve for subjective and objective evaluation mapping of recognition accuracy.

The specific implementation mode is as follows:

the invention is further described below with reference to the accompanying drawings.

FIG. 1 is a workflow of the present invention. Firstly, a command word recognition model is established based on a deep learning framework, and the model is trained by utilizing voice data and text data. In order to meet the application requirements under the condition of low signal-to-noise ratio, the training voice data needs to be trained aiming at the disturbed voices of different types and different signal-to-noise ratio levels.

When the voice recognition device works, the collected original voice signals and the collected disturbed voice signals are input into a command word recognition model, and the model outputs recognition results of the original voice and the disturbed voice; taking the voice recognition result as a correct result, and counting the recognition accuracy of the disturbed voice according to the recognition result of the disturbed voice; and mapping subjective and objective evaluation according to the identification accuracy, and judging the interference level according to the subjective evaluation score of the mapping.

Fig. 2 is a block diagram of an FSMN architecture for command word recognition. The diagram (a) is a structural schematic of the FSMN, and compared with a traditional deep neural network, the FSMN adds a module in a hidden layer for storing and judging historical and future information in a current speech frame. The diagram (b) is a time sequence expansion diagram of the added memory module, the left and right sides respectively memorize the information of 1 frame, and the length of the memory frame can be adjusted according to the actual requirement. The FSMN adopts a feedforward structure, so that when historical information is memorized, the voice input does not need to be waited for ending, only a voice frame with a limited length can be collected, and the delay can be controlled within 0.2s, so that a better effect can be obtained. The FSMN only needs to return the weights according to the connection relation between the hidden layer and the memory module in the training process based on the feedforward memory network, the weights determine the mutual influence of the input and the current voice signal, the attenuation of the gradient propagation at any moment is a trainable constant, the problem of gradient disappearance can be effectively solved, the parallel degree of the FSMN is higher in the stability and the training efficiency of the model, and the calculation performance of the GPU can be fully exerted.

Fig. 3 is a relationship curve for subjective and objective evaluation mapping of recognition accuracy. Inputting the voice data to be evaluated into a command word recognition model, outputting a recognition result, comparing and counting the recognition result with a correct result, wherein the recognition accuracy calculation formula is as follows:

wherein: n represents the number of all words participating in the test; i represents the number of words with errors inserted; d represents the number of words with deletion errors of the recognition result relative to the marked correct result; s represents the number of words for which a replacement error has occurred.

In fig. 3, the abscissa of the subjective and objective evaluation mapping curve is the recognition accuracy, the ordinate is the subjective evaluation value calculated by fitting, the recognition accuracy is converted into the subjective evaluation value by the mapping curve, and when the evaluation value is greater than or equal to 3, the interference is judged to be effective; when the evaluation value is less than 3, it is determined that the interference is invalid.