阅读说明：本技术 优化音频处理方法、装置、终端及可读存储介质 (Method, device and terminal for optimizing audio processing and readable storage medium ) 是由 季海交 张志丰 陈伟 谌名林 韦芳南 于 2020-05-18 设计创作，主要内容包括：本申请公开了一种优化音频处理方法、装置、终端和计算机可读存储介质,接收模拟信号输入输出通道输入到主板DSP中的音频数据；获取所述音频数据,并将所述音频数据传输至主板ARM或从板ARM进行优化处理,以释放所述主板DSP中的资源；同时优化所述主板DSP中的算法,所述主板DSP中的算法包括如下至少一种方法：优化计算逻辑,反馈抑制、回声消除、噪声消除和自动增益；并同时优化动态调节所述音频数据中音频处理帧长,从而使得实时性高的音频算法拥有更多现有资源,实现音频处理速度和效率的提高,优化了音频处理。(The application discloses an optimized audio processing method, an optimized audio processing device, a terminal and a computer readable storage medium, wherein the method comprises the steps of receiving audio data input into a mainboard DSP by an analog signal input and output channel; acquiring the audio data, and transmitting the audio data to a mainboard ARM or a slave ARM for optimization processing so as to release resources in the mainboard DSP; and simultaneously optimizing an algorithm in the mainboard DSP, wherein the algorithm in the mainboard DSP comprises at least one of the following methods: optimizing computation logic, feedback suppression, echo cancellation, noise cancellation and automatic gain; and simultaneously, the length of an audio processing frame in the audio data is optimized and dynamically adjusted, so that an audio algorithm with high real-time property has more existing resources, the audio processing speed and efficiency are improved, and the audio processing is optimized.)

1. A method for optimizing audio processing, the step of optimizing audio processing comprising:

receiving audio data input into a mainboard DSP by an analog signal input and output channel;

acquiring the audio data, and transmitting the audio data to a mainboard ARM or a slave ARM for optimization processing so as to release resources in the mainboard DSP;

optimizing an algorithm in the motherboard DSP, wherein the algorithm in the motherboard DSP comprises at least one of the following methods: optimizing computation logic, feedback suppression, echo cancellation, noise cancellation and automatic gain;

and optimizing and dynamically adjusting the length of an audio processing frame in the audio data.

2. The method for optimizing audio processing according to claim 1, wherein the step of transmitting the audio data to a motherboard ARM or performing optimization processing from the motherboard ARM comprises:

level calculation and reporting optimization, UPP communication optimization and spectrum analysis optimization.

3. The method of claim 2, wherein the step of level calculation and reporting optimization comprises:

transmitting the audio data from the mainboard DSP to the mainboard ARM through a shared memory;

processing and calculating the audio data at regular time on the mainboard ARM to obtain level data of each channel;

and acquiring the level data of each channel, and reporting the level data of each channel to a display interface through a network port.

4. The method for optimizing audio processing according to claim 2 wherein said step of UPP communication optimization comprises:

transmitting the audio data from the mainboard DSP to the mainboard ARM through a shared memory;

processing the audio data at the master board ARM, and transmitting the audio data to the slave board ARM;

and processing the audio data at the slave board ARM, and transmitting the audio data to the master board ARM.

5. The method of optimizing audio processing according to claim 2, wherein the step of spectral analysis optimization comprises:

transmitting the audio data from the mainboard DSP to the mainboard ARM through a shared memory, and transmitting the audio data from the mainboard ARM to the slave ARM through a UPP;

calculating the information of the audio data under different frequencies at fixed time of the slave ARM to obtain spectral analysis data;

and transmitting the spectrum analysis data to the main board ARM through the UPP, and reporting the spectrum analysis data to a display interface through a network port.

6. The method of claim 1, wherein the step of optimizing dynamically adjusting audio processing frame lengths in the audio data comprises:

acquiring a processing frame length selection result of the display interface on the audio data, the level data of each channel or the spectral analysis data;

and adjusting the processing frame length of the audio data, the level data of each channel or the spectral analysis data according to the selection result.

7. An optimized audio processing apparatus, comprising:

the receiving module is used for receiving audio data input into the DSP of the mainboard by the analog signal input and output channel;

the transmission module is used for acquiring the audio data and transmitting the audio data to a mainboard ARM or a slave ARM for optimization processing so as to release resources in the mainboard DSP;

an algorithm optimization module, configured to optimize an algorithm in the motherboard DSP, where the algorithm in the motherboard DSP includes at least one of the following methods: optimizing computation logic, feedback suppression, echo cancellation, noise cancellation and automatic gain;

and the frame length adjusting module is used for optimizing and dynamically adjusting the length of an audio processing frame in the audio data.

8. The optimized audio processing device according to claim 7, wherein said frame length adjustment module comprises:

a frame length obtaining unit, configured to obtain a result of selecting a processing frame length for the audio data, the level data of each channel, or the spectral analysis data on the display interface;

and the frame length processing unit is used for adjusting the processing frame length of the audio data, the level data of each channel or the spectral analysis data according to the selection result.

9. A terminal, characterized in that the terminal comprises: memory, a processor and an optimized audio processing program stored on the memory and executable on the processor, which when executed by the processor implements the steps of the optimized audio processing method of any one of claims 1 to 6.

10. A storage medium having stored thereon an optimized audio processing program, which when executed by a processor implements the steps of the optimized audio processing method of any one of claims 1 to 6.

Technical Field

The present application relates to the field of audio processing technologies, and in particular, to an audio processing optimization method, an audio processing optimization device, a terminal, and a readable storage medium.

Background

The existing digital audio processor adopts a double OMAPL138 chip development (OMAP-L138 is a Texas Instrument (TI) in America to develop a brand-new DSP + ARM industrial processor, the chip is also a floating point Digital Signal Processor (DSP) + ARM9 processor with lowest power consumption in the industry, the development difficulty of dual-core communication is greatly reduced, and the requirements of high energy efficiency and connectivity design for high integration degree peripheral equipment, lower heat dissipation and longer battery service life of industrial application can be fully met. The mainboard Arm mainly processes service logics such as network control, serial port control, GPIO (bus expansion) control and the like, and the mainboard DSP processes UPP audio transmission, AD and DA logic conversion, audio control and algorithm processing; the slave board ARM processes the UPP audio transmission, the DANTE input/output audio transmission, the slave board DSP processes the audio control and algorithm processing, etc., see fig. 7. The existing digital audio processing has a series of problems:

1. the audio processing delay, namely the delay from analog input to analog output is 11ms, and the delay from Dante input to Dante output is 22ms, some of the delay time can not meet the requirement of low delay of part of users.

2. The length of the audio processing frame is fixed (256 points), and the audio processing frame cannot be dynamically adjusted, so that CPU resources are dynamically and reasonably utilized.

And 3.Arm and DSP resources are not fully and reasonably utilized.

4. The service control and processing logic of the audio data is not fully isolated, which causes resource waste, and thus, the existing digital audio processing resources are not fully utilized, the processing speed is low, the processing efficiency is low, and the user experience is not high.

Disclosure of Invention

The application mainly aims to provide an optimized audio processing method, a terminal and a computer storage medium, and aims to solve the technical problems of high occupancy rate of an audio processing DSP, low processing speed and low processing efficiency in the prior art.

In order to achieve the above object, an embodiment of the present application provides an audio processing optimization method, where the audio processing optimization method includes:

receiving audio data input into a mainboard DSP by an analog signal input and output channel;

acquiring the audio data, and transmitting the audio data to a mainboard ARM or a slave ARM for optimization processing so as to release resources in the mainboard DSP;

optimizing an algorithm in the motherboard DSP, wherein the algorithm in the motherboard DSP comprises at least one of the following methods: optimizing computation logic, feedback suppression, echo cancellation, noise cancellation and automatic gain;

and optimizing and dynamically adjusting the length of an audio processing frame in the audio data.

Optionally, the step of transmitting the audio data to the motherboard ARM or performing optimization processing on the motherboard ARM includes:

level calculation and reporting optimization, UPP communication optimization and spectrum analysis optimization.

Optionally, the step of level calculation and report optimization includes:

transmitting the audio data from the mainboard DSP to the mainboard ARM through a shared memory;

processing and calculating the audio data at regular time on the mainboard ARM to obtain level data of each channel;

and acquiring the level data of each channel, and reporting the level data of each channel to a display interface through a network port.

Optionally, the step of UPP communication optimization includes:

transmitting the audio data from the mainboard DSP to the mainboard ARM through a shared memory;

processing the audio data at the master board ARM, and transmitting the audio data to the slave board ARM;

and processing the audio data at the slave board ARM, and transmitting the audio data to the master board ARM.

Optionally, the step of optimizing the spectral analysis comprises:

transmitting the audio data from the mainboard DSP to the mainboard ARM through a shared memory, and transmitting the audio data from the mainboard ARM to the slave ARM through a UPP;

calculating the information of the audio data under different frequencies at fixed time of the slave ARM to obtain spectral analysis data;

and transmitting the spectrum analysis data to the main board ARM through the UPP, and reporting the spectrum analysis data to a display interface through a network port.

Optionally, the step of optimizing and dynamically adjusting the length of the audio processing frame in the audio data includes:

acquiring a processing frame length selection result of the display interface on the audio data, the level data of each channel or the spectral analysis data;

and adjusting the processing frame length of the audio data, the level data of each channel or the spectral analysis data according to the selection result.

The present application further provides an optimized audio processing apparatus, comprising:

the receiving module is used for receiving audio data input into the DSP of the mainboard by the analog signal input and output channel;

the transmission module is used for acquiring the audio data and transmitting the audio data to a mainboard ARM or a slave ARM for optimization processing so as to release resources in the mainboard DSP;

an algorithm optimization module, configured to optimize an algorithm in the motherboard DSP, where the algorithm in the motherboard DSP includes at least one of the following methods: optimizing computation logic, feedback suppression, echo cancellation, noise cancellation and automatic gain;

and the frame length adjusting module is used for optimizing and dynamically adjusting the length of an audio processing frame in the audio data.

Optionally, the frame length adjusting module includes:

a frame length obtaining unit, configured to obtain a result of selecting a processing frame length for the audio data, the level data of each channel, or the spectral analysis data on the display interface;

and the frame length processing unit is used for adjusting the processing frame length of the audio data, the level data of each channel or the spectral analysis data according to the selection result.

The present application further provides a terminal, the terminal including: a memory, a processor and an optimized audio processing program stored on the memory and executable on the processor, the optimized audio processing program when executed by the processor implementing the steps of the optimized audio processing method as described above.

The present application further provides a computer storage medium having an optimized audio processing program stored thereon, which when executed by a processor implements the steps of the optimized audio processing method as described above.

In the process of optimizing audio processing, the method receives audio data input into a DSP of a mainboard by an analog signal input and output channel; acquiring the audio data, and transmitting the audio data to a mainboard ARM or a slave ARM for optimization processing so as to release resources in the mainboard DSP; and simultaneously optimizing an algorithm in the mainboard DSP, wherein the algorithm in the mainboard DSP comprises at least one of the following methods: optimizing computation logic, feedback suppression, echo cancellation, noise cancellation and automatic gain; and simultaneously, the length of an audio processing frame in the audio data is optimized and dynamically adjusted, so that an audio algorithm with high real-time property has more existing resources, the audio processing speed and efficiency are improved, and the audio processing is optimized.

Drawings

The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the present application and together with the description, serve to explain the principles of the application.

In order to more clearly illustrate the embodiments of the present application or the technical solutions in the prior art, the drawings needed to be used in the description of the embodiments or the prior art will be briefly described below, and it is obvious for those skilled in the art to obtain other drawings without inventive exercise.

Fig. 1 is a schematic diagram of a hardware structure of an optional terminal according to an embodiment of the present application;

FIG. 2 is a flowchart illustrating a first embodiment of an optimized audio processing method according to the present application;

FIG. 3 is a flowchart illustrating a second embodiment of the method for optimizing audio processing according to the present application;

FIG. 4 is a flowchart illustrating a third embodiment of the method for optimizing audio processing according to the present application;

FIG. 5 is a flowchart illustrating a fourth embodiment of an optimized audio processing method according to the present application;

FIG. 6 is a flowchart illustrating a fifth embodiment of the method for optimizing audio processing according to the present application;

FIG. 7 is a diagram of a background art of the optimized audio processing method related to the present application with respect to a current audio processing platform;

FIG. 8 is a schematic diagram of an audio processing platform after the application optimizes the audio processing method to improve;

FIG. 9 is a functional block diagram of an audio processing apparatus according to the present application;

fig. 10 is a schematic diagram of a detailed functional module for applying for optimizing the frame length adjustment module of the audio processing device.

The implementation, functional features and advantages of the objectives of the present application will be further explained with reference to the accompanying drawings.

Detailed Description

It should be understood that the specific embodiments described herein are merely illustrative of the present application and are not intended to limit the present application.

In the following description, suffixes such as "module", "component", or "unit" used to denote elements are used only for the convenience of description of the present application, and have no specific meaning by themselves. Thus, "module", "component" or "unit" may be used mixedly.

As shown in fig. 1, fig. 1 is a schematic terminal structure diagram of a hardware operating environment according to an embodiment of the present application.

The terminal in the embodiment of the application can be a fixed terminal, such as an internet of things intelligent device, and comprises an intelligent air conditioner, an intelligent lamp, an intelligent power supply, an intelligent router and other intelligent homes; the system can also be a mobile terminal, and comprises a smart phone, a wearable networking AR/VR device, a smart sound box, an automatic driving automobile and other networking equipment.

As shown in fig. 1, the architecture design of the optimized audio processing system includes nodes and servers, and the device structure thereof may include: a processor 1001, such as a CPU, a memory 1005, and a communication bus 1002. The communication bus 1002 is used for realizing connection communication between the processor 1001 and the memory 1005. The memory 1005 may be a high-speed RAM memory or a non-volatile memory (e.g., a magnetic disk memory). The memory 1005 may alternatively be a storage device separate from the processor 1001.

Optionally, the optimized audio processing system may further include a user interface, a network interface, a camera, RF (radio frequency) circuitry, sensors, audio circuitry, a WiFi module, and the like. The user interface may include a Display screen (Display), touch screen, camera (including AR/VR devices), etc., and the optional user interface may also include a standard wired interface, a wireless interface. The network interface may optionally include a standard wired interface, a wireless interface (e.g., WI-FI interface, bluetooth interface, probe interface, 3G/4G/5G networking communication interface, etc.).

Those skilled in the art will appreciate that the optimized audio processing system architecture shown in fig. 1 does not constitute a limitation of the optimized audio processing system and may include more or fewer components than shown, or some components in combination, or a different arrangement of components.

As shown in fig. 1, a memory 1005, which is a kind of computer storage medium, may include therein an operating system, a network communication module, and an optimized audio processing program. An operating system is a program that manages and controls the optimization of the hardware and software resources of an audio processing system, supporting the operation of the optimization of the audio processing program, as well as other software and/or programs. The network communication module is used to enable communication between the various components within the memory 1005, as well as to optimize other hardware and software within the audio processing system.

In the optimized audio processing system shown in fig. 1, the processor 1001 is configured to execute an optimized audio processing program stored in the memory 1005, and implement the following steps:

receiving audio data input into a mainboard DSP by an analog signal input and output channel;

acquiring the audio data, and transmitting the audio data to a mainboard ARM or a slave ARM for optimization processing so as to release resources in the mainboard DSP;

optimizing an algorithm in the motherboard DSP, wherein the algorithm in the motherboard DSP comprises at least one of the following methods: optimizing computation logic, feedback suppression, echo cancellation, noise cancellation and automatic gain;

and optimizing and dynamically adjusting the length of an audio processing frame in the audio data.

Further, the processor 1001 may call the optimized audio processing program stored in the memory 1005, and also perform the following operations:

transmitting the audio data from the mainboard DSP to the mainboard ARM through a shared memory;

processing and calculating the audio data at regular time on the mainboard ARM to obtain level data of each channel;

and acquiring the level data of each channel, and reporting the level data of each channel to a display interface through a network port.

Further, the processor 1001 may call the optimized audio processing program stored in the memory 1005, and also perform the following operations:

transmitting the audio data from the mainboard DSP to the mainboard ARM through a shared memory;

processing the audio data at the master board ARM, and transmitting the audio data to the slave board ARM;

and processing the audio data at the slave board ARM, and transmitting the audio data to the master board ARM.

Further, the processor 1001 may call the optimized audio processing program stored in the memory 1005, and also perform the following operations:

transmitting the audio data from the mainboard DSP to the mainboard ARM through a shared memory, and transmitting the audio data from the mainboard ARM to the slave ARM through a UPP;

calculating the information of the audio data under different frequencies at fixed time of the slave ARM to obtain spectral analysis data;

and transmitting the spectrum analysis data to the main board ARM through the UPP, and reporting the spectrum analysis data to a display interface through a network port.

Further, the processor 1001 may call the optimized audio processing program stored in the memory 1005, and also perform the following operations:

acquiring a processing frame length selection result of the display interface on the audio data, the level data of each channel or the spectral analysis data;

and adjusting the processing frame length of the audio data, the level data of each channel or the spectral analysis data according to the selection result.

Based on the hardware structure, various embodiments of the method for optimizing audio processing are provided.

Referring to fig. 2, a first embodiment of the optimized audio processing method of the present application provides an optimized audio processing method, including:

step S10, receiving audio data input into the DSP of the mainboard by the analog signal input and output channel;

step S20, acquiring audio data, and transmitting the audio data to a mainboard ARM or a slave ARM for optimization processing so as to release resources in a mainboard DSP;

step S30, optimizing an algorithm in the motherboard DSP, where the algorithm in the motherboard DSP includes at least one of the following methods: optimizing computation logic, feedback suppression, echo cancellation, noise cancellation and automatic gain;

and step S40, optimizing and dynamically adjusting the length of the audio processing frame in the audio data.

In this embodiment, referring to fig. 8, a terminal of the present application is provided with a master board (the master board is connected to an analog signal input/output channel) and a slave board (the slave board is connected to a digital signal input/output channel), where the master board is composed of a master board DSP and a master board ARM, and the slave board is composed of a slave board DSP and a slave board ARM; and the master board and the slave board communicate through UPP. When the audio data are processed, the DSP of the mainboard receives the audio data input by the analog input and output channel.

The DSP is called Digital Signal Processing (DSP) in English. The function is digital signal processing, namely, the signal is processed by numerical calculation.

The full English name of ARM is Advanced RISC Machine, called ARM for short, which is the name of a home electronics company in the UK and is essentially a microprocessor.

Specifically, after receiving audio data input into the motherboard DSP by the analog signal input/output channel, transmitting the audio data to the motherboard ARM or the slave board ARM for optimization processing; the optimization processing method comprises the following steps: level calculation and reporting optimization, UPP communication optimization and spectrum analysis optimization. Level calculation and reporting optimization and UPP communication optimization are carried out on the main board ARM, and spectrum analysis optimization is carried out on the slave board ARM; therefore, the resources of the mainboard DSP are released, the working pressure of the mainboard DSP is reduced, the resources of the mainboard ARM and the slave ARM are effectively utilized, and the speed and the efficiency of the whole audio processing are improved.

Level calculation and reporting optimization: high frequency signals are often transmitted with the current voltage or power measured and calculated at some point. When measuring or calculating these physical quantities, we generally do not measure or calculate the current (a), voltage (V) or power (W) at that point directly, but rather represent them by measuring or calculating their ratio to some reference value in a logarithmic relationship, called level. Spectral analysis is a technique that decomposes complex signals into simpler signals. Many physical signals can be represented as the sum of many simple signals of different frequencies. The spectral analysis is performed to find information (e.g., amplitude, power, strength, or phase) of a signal at different frequencies. The spectrum is a representation of a signal in the frequency domain in the time domain, and can be obtained by fourier transform of the signal, and the result is obtained by two graphs in which the amplitude and the phase are taken as vertical axes and the frequency is taken as horizontal axis, but information on the phase may be omitted and only data corresponding to the amplitude at different frequencies is obtained. Sometimes, the amplitude spectrum represents the situation of amplitude variation with frequency, and the phase spectrum represents the situation of phase variation with frequency. In short, the spectrum can indicate which frequencies of the sinusoidal wave constitute a signal, and the information such as the magnitude and phase of the sinusoidal wave of each frequency can be seen. If the signal changes over time and can be represented by amplitude, it has its corresponding frequency spectrum. When these physical phenomena are represented by frequency spectra, some information about the cause of the signal generation can be provided. For example, for the vibration of an instrument, the frequency components of the spectrum of the vibration signal can be used to estimate which elements the vibration is caused by.

Specifically, the optimal computation logic can be implemented by methods of extracting constants, reducing if judgment logic, and the like, and can be flexibly set in a specific implementation process, which is not limited herein; the feedback suppression algorithm can suppress the feedback of the audio, and mainly has the function of suppressing the acoustic feedback howling caused by the sound of the sound box transmitted to the microphone; the echo cancellation algorithm can cancel the feedback signal; the noise elimination algorithm can eliminate the noise in the audio frequency; the automatic gain algorithm can instantaneously stabilize the audio data within a set range when the input of the audio data signal is unstable.

In the process of optimizing audio processing, receiving audio data input into a DSP (digital signal processor) of a mainboard by an analog signal input and output channel; acquiring the audio data, and transmitting the audio data to a mainboard ARM or a slave ARM for optimization processing so as to release resources in the mainboard DSP; and simultaneously optimizing an algorithm in the mainboard DSP, wherein the algorithm in the mainboard DSP comprises at least one of the following methods: optimizing computation logic, feedback suppression, echo cancellation, noise cancellation and automatic gain; and simultaneously, the length of an audio processing frame in the audio data is optimized and dynamically adjusted, so that an audio algorithm with high real-time property has more existing resources, the audio processing speed and efficiency are improved, and the audio processing is optimized.

Further, in another embodiment of the method for optimizing audio processing according to the present application, referring to fig. 3, step S01 includes:

step S011, transmitting the audio data from the main board DSP to the main board ARM through the shared memory;

step S012, processing and calculating audio data in the mainboard ARM at regular time to obtain level data of each channel;

and S013, acquiring the level data of each channel, and reporting the level data of each channel to a display interface through the network port.

In this embodiment, specifically, the audio data of the motherboard DSP is transmitted to the motherboard ARM through the shared memory, the motherboard ARM processes and calculates the audio data at regular time to obtain the level data of each channel, and reports the level data of each channel to the display interface through the network interface (network interface).

Shared memory, which allows two unrelated processes to access the same logical memory, is a very efficient way to share and transfer data between two running processes. And the DSP audio data of the mainboard is transmitted to the ARM of the mainboard through the shared memory. The memory shared between different processes is usually the same physical memory segment. The processes may connect the same segment of physical memory to their own address space, and all processes may access addresses in the shared memory. If a process writes data to shared memory, the changes made will immediately affect any other process that can access the same segment of shared memory.

Further, in another embodiment of the method for optimizing audio processing according to the present application, referring to fig. 4, step S02 includes:

step S021, transmitting the audio data from the mainboard DSP to the mainboard ARM through the shared memory;

step S022, processing audio data on the master ARM and transmitting the audio data to the slave ARM;

and step S023, processing the audio data by the slave board ARM and transmitting the audio data to the master board ARM.

In this embodiment, first, audio data is transmitted from the motherboard DSP to the motherboard ARM through a shared memory (the shared memory is to enable multiple processes to access the same memory space), then the motherboard ARM processes the audio data and transmits the processed audio data to the slave board ARM, then the slave board ARM processes the audio data and transmits the processed audio data to the motherboard ARM, that is, audio data is transmitted and controlled between the motherboard ARM and the slave board ARM, that is, the inherent logic is switched to a service control thread with low real-time performance, so as to optimize the audio processing thread logic. Audio data are transmitted and controlled between the main board ARM and the slave board ARM, and the UPP thread scheduling of the main board DSP does not need to occupy corresponding DSP resources, so that the audio algorithm with high real-time performance has more existing resources, the audio processing speed and efficiency are improved, and the audio processing is optimized.

Further, in another embodiment of the method for optimizing audio processing according to the present application, referring to fig. 5, step S03 includes:

step S031, transmit the audio data from the motherboard DSP to the motherboard ARM through the shared memory, and then transmit the audio data from the motherboard ARM to the slave ARM through UPP;

step S032, regularly calculating information of the audio data under different frequencies from the ARM to obtain spectral analysis data;

step S033, transmitting the spectrum analysis data to the motherboard ARM through the UPP, and reporting to the display interface through the internet access.

In this embodiment, the audio data of the DSP on the motherboard is sent to the ARM on the motherboard through the shared memory, and then is sent to the ARM on the slave board through the UPP, and the slave board ARM calls the spectrum analysis algorithm, and then sends the calculation result to the ARM on the motherboard through the UPP, and reports the calculation result to the display interface through the internet access (network interface).

Specifically, the board ARM calls a spectrum analysis algorithm, that is, audio data is input to the electrical measurement software SmaartLive for analysis processing, a spectrum mode is a key part of the electroacoustic measurement software SmaartLive, an advanced sound signal measurement means can be provided, and a flexible and variable Fast Fourier Transform (FFT) real-time analyzer function is provided, and spectrum measurement is performed in the spectrum mode. The method has the applications of noise measurement, visual measurement of sound signals, acoustic feedback frequency determination of an acoustic amplification system, optimization processing of a cinema sound system, sound signal monitoring and the like. Real-time spectral analysis is a very useful tool in many applications, such as finding feedback spurious oscillations, ear listening training, and monitoring the frequency range of program data. The method can be flexibly processed in the implementation process, and is not limited herein.

Further, in another embodiment of the method for optimizing audio processing of the present application, referring to fig. 6, step a00 includes:

step A01, obtaining the processing frame length selection result of the display interface to the audio data, the level data of each channel or the spectral analysis data;

and step A02, adjusting the processing frame length of the audio data, the level data of each channel or the spectral analysis data according to the selection result.

In this embodiment, an interface for controlling the frame length is created first, and a user is given control through a UI interface: 64, 128, 256, 512, etc. can be arbitrarily selected, so that the delay and the default CPU occupancy can be adjusted, the smaller the frame length, the lower the delay, and the higher the default CPU occupancy.

Therefore, the length of the software audio processing frame is dynamically adjusted, the length of the software audio processing frame is adjusted to be reduced, the audio processing time delay is reduced, the length of the software audio processing frame is adjusted to be increased, the starting number of the whole algorithm is increased, and the audio processing platform is optimized. Compared with the prior art, the length of the audio processing frame is fixed (256 points) and cannot be dynamically adjusted, the method and the device open an interface for a user to randomly select the lengths of the frames 64, 128, 256 and 512, and the like, so that CPU resources are dynamically and reasonably utilized, audio processing is optimized, an audio algorithm with high real-time performance has more existing resources, and the audio processing speed and efficiency are improved.

In addition, referring to fig. 9, an optimized audio processing apparatus according to an embodiment of the present invention includes:

the receiving module is used for receiving audio data input into the DSP of the mainboard by the analog signal input and output channel;

the transmission module is used for acquiring the audio data and transmitting the audio data to a mainboard ARM or a slave ARM for optimization processing so as to release resources in the mainboard DSP;

an algorithm optimization module, configured to optimize an algorithm in the motherboard DSP, where the algorithm in the motherboard DSP includes at least one of the following methods: optimizing computation logic, feedback suppression, echo cancellation, noise cancellation and automatic gain;

and the frame length adjusting module is used for optimizing and dynamically adjusting the length of an audio processing frame in the audio data.

In addition, referring to fig. 10, an embodiment of the present invention further provides a frame length adjusting module, where the frame length adjusting module includes:

a frame length obtaining unit, configured to obtain a result of selecting a processing frame length for the audio data, the level data of each channel, or the spectral analysis data on the display interface;

and the frame length processing unit is used for adjusting the processing frame length of the audio data, the level data of each channel or the spectral analysis data according to the selection result.

The present application further provides a terminal, the terminal including: a memory, a processor and an optimized audio processing program stored on the memory and executable on the processor, the optimized audio processing program when executed by the processor implementing the steps of the optimized audio processing method described above.

The present application further provides a computer-readable storage medium having an optimized audio processing program stored thereon, which when executed by a processor implements the steps of the optimized audio processing method described above.

In the embodiments of the method, the apparatus, the terminal and the readable storage medium for optimizing audio processing according to the present application, all technical features of the embodiments of the method for optimizing audio processing are included, and the expanding and explaining contents of the specification are substantially the same as those of the embodiments of the method for optimizing audio processing, and are not described herein again.

It should be noted that, in this document, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or system that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or system. Without further limitation, an element defined by the phrase "comprising an … …" does not exclude the presence of other like elements in a process, method, article, or system that comprises the element.

The above-mentioned serial numbers of the embodiments of the present application are merely for description and do not represent the merits of the embodiments.

Through the above description of the embodiments, those skilled in the art will clearly understand that the method of the above embodiments can be implemented by software plus a necessary general hardware platform, and certainly can also be implemented by hardware, but in many cases, the former is a better implementation manner. Based on such understanding, the technical solutions of the present application may be embodied in the form of a software product, which is stored in a storage medium (such as ROM/RAM, magnetic disk, optical disk) and includes instructions for enabling a terminal device (such as a mobile phone, a computer, a server, an air conditioner, or a network device) to execute the method according to the embodiments of the present application.

The above description is only a preferred embodiment of the present application, and not intended to limit the scope of the present application, and all modifications of equivalent structures and equivalent processes, which are made by the contents of the specification and the drawings of the present application, or which are directly or indirectly applied to other related technical fields, are included in the scope of the present application.