阅读说明：本技术 一种连麦音频处理方法、装置及连麦云端 (Continuous microphone audio processing method and device and continuous microphone cloud ) 是由 杨建国 张宇 于 2021-08-11 设计创作，主要内容包括：本公开实施例提供一种连麦音频处理方法、装置、连麦云端及存储介质,其中,所述方法运用在云端中,所述云端包括连麦应用程序和音频处理器,所述音频处理器支持对应音频类型的合成音频,所述方法包括：调用所述连麦应用程序读取所述对应音频类型的待处理波形；按照所述连麦应用程序中的预设处理方案对所述待处理波形进行音色处理,得到所述对应音频类型的合成音频；通过所述连麦应用程序将所述对应音频类型的合成音频发送至所述音频处理器,以便所述音频处理器对所述对应音频类型的合成音频进行封装得到待发送声音数据。通过上述方案,可以将原有在己方客户端中进行音频处理的工作转移到云端进行处理,从而大大降低了客户端的工作负荷,从而降低了丢包和卡顿的可能性,提升了用户体验。(The embodiment of the disclosure provides a microphone connecting audio processing method and device, a microphone connecting cloud and a storage medium, wherein the method is applied to the cloud, the cloud comprises a microphone connecting application program and an audio processor, the audio processor supports synthetic audio of a corresponding audio type, and the method comprises the following steps: calling the microphone connecting application program to read the waveform to be processed of the corresponding audio type; performing timbre processing on the waveform to be processed according to a preset processing scheme in the microphone connecting application program to obtain a synthetic audio of the corresponding audio type; and sending the synthetic audio of the corresponding audio type to the audio processor through the microphone connecting application program so that the audio processor packages the synthetic audio of the corresponding audio type to obtain the sound data to be sent. Through the scheme, the original work of audio processing in the own client side can be transferred to the cloud side for processing, so that the work load of the client side is greatly reduced, the possibility of packet loss and blockage is reduced, and the user experience is improved.)

1. A microphone-connected audio processing method, the method being performed by a cloud, the cloud comprising a microphone-connected application and an audio processor, the audio processor supporting synthesized audio of a corresponding audio type, the method comprising:

calling the microphone connecting application program to read the waveform to be processed of the corresponding audio type;

performing timbre processing on the waveform to be processed according to a preset processing scheme in the microphone connecting application program to obtain a synthetic audio of the corresponding audio type;

and sending the synthetic audio of the corresponding audio type to the audio processor through the microphone connecting application program so that the audio processor packages the synthetic audio of the corresponding audio type to obtain the sound data to be sent.

2. The method of claim 1, wherein prior to said invoking the microphone application to read the pending waveform for the corresponding audio type, the method further comprises:

responding to a first operation, and optimizing an audio input mode and an audio output mode of the microphone connecting application program to the corresponding audio type;

and responding to a second operation, and optimizing a processing scheme in the microphone connecting application program according to the position of the numerical axis of the waveform extreme value corresponding to the corresponding audio type to obtain the preset processing scheme.

3. The method of claim 2, wherein the invoking the microphone application to read the pending waveform for the corresponding audio type comprises:

reading the waveform to be processed of the corresponding audio type according to the optimized audio input mode;

performing tone processing on the waveform to be processed according to a preset processing scheme in the microphone connection application program to obtain the synthetic audio of the corresponding audio type, including:

and performing tone processing on the waveform to be processed, and outputting the synthesized audio according to the optimized audio output mode.

4. The method according to claim 1, wherein performing timbre processing on the waveform to be processed according to a preset processing scheme in the microphone application to obtain the synthetic audio of the corresponding audio type comprises:

determining a waveform area range to be modified according to the preset processing scheme;

and performing peak value extraction on the waveform to be processed according to the preset processing scheme, and superposing corresponding waveform numerical values in the waveform region range through extracted waveform extreme values to obtain the synthetic audio.

5. The method of claim 4, wherein the superimposing the corresponding waveform values in the waveform region range by the extracted waveform extremum comprises:

determining a synthetic tone corresponding to the waveform to be processed from the preset processing scheme;

and superposing the waveform numerical value corresponding to the synthesized tone to the corresponding waveform numerical value in the waveform area range to obtain the synthesized audio.

6. The method of claim 5, wherein the synthesized timbre comprises at least one of: youth sound, maiden sound, yujie sound, tergent sound, and senior sound.

7. The utility model provides a link wheat audio processing apparatus, its characterized in that, the device deploys on the high in the clouds, the high in the clouds is including linking wheat application and audio processor, audio processor supports the synthetic audio of corresponding audio type, the device includes recording unit, tone color processing unit and transmission unit:

the recording unit is used for calling the microphone connecting application program to read the waveform to be processed of the corresponding audio type;

the tone processing unit is used for performing tone processing on the waveform to be processed according to a preset processing scheme in the microphone connecting application program to obtain the synthetic audio of the corresponding audio type;

the transmission unit is used for sending the synthetic audio of the corresponding audio type to the audio processor through the microphone connecting application program, so that the audio processor packages the synthetic audio of the corresponding audio type to obtain the sound data to be sent.

8. A computer readable storage medium storing instructions/executable code which, when executed by a processor of an electronic device, causes the electronic device to implement the method of any of claims 1-6.

9. A microphone connecting cloud end, characterized in that the microphone connecting cloud end comprises a processor, a machine-readable storage medium and a network interface, the machine-readable storage medium, the network interface and the processor are connected through a bus system, the network interface is used for being connected with at least one microphone connecting client in a communication manner, the machine-readable storage medium is used for storing programs, instructions or codes, and the processor is used for executing the programs, instructions or codes in the machine-readable storage medium so as to execute the microphone connecting audio processing method according to any one of claims 1 to 6.

Technical Field

The disclosure relates to the technical field of audio processing, in particular to a microphone connecting audio processing method and device and a microphone connecting cloud.

Background

With the development of the internet, more and more people start to use the microphone connecting tool of the social platform to replace the traditional mobile phone communication, the microphone connecting tool can connect users under different network environments through a contact mechanism of the social platform, and the microphone connecting tool is deeply loved by the users due to the characteristics of high speed, less dropped packages, low cost and the like.

In the prior art, some users may not be satisfied with their speaking voices, and when a user needs to process their voices, the user usually performs a tone conversion adjustment through their own client and then transmits the tone to the opposite client for playing. The above scheme can increase the processing load of the own client, so that the risk of causing jamming and even packet loss exists.

Disclosure of Invention

In order to overcome at least the above disadvantages in the prior art, an object of the present disclosure is to provide a method and an apparatus for processing a microphone connecting audio, and a microphone connecting cloud.

In a first aspect, the present disclosure provides a microphone connecting audio processing method, where the method is performed by a cloud, where the cloud includes a microphone connecting application and an audio processor, and the audio processor supports synthetic audio of a corresponding audio type, and the method includes:

calling the microphone connecting application program to read the waveform to be processed of the corresponding audio type;

performing timbre processing on the waveform to be processed according to a preset processing scheme in the microphone connecting application program to obtain a synthetic audio of the corresponding audio type;

and sending the synthetic audio of the corresponding audio type to the audio processor through the microphone connecting application program so that the audio processor packages the synthetic audio of the corresponding audio type to obtain the sound data to be sent.

In a second aspect, the present disclosure provides a microphone connecting audio processing apparatus, the apparatus is deployed on a cloud, the cloud includes a microphone connecting application and an audio processor, the audio processor supports a synthetic audio of a corresponding audio type, the apparatus includes a recording unit, a tone processing unit, and a transmission unit:

the recording unit is used for calling the microphone connecting application program to read the waveform to be processed of the corresponding audio type;

the tone processing unit is used for performing tone processing on the waveform to be processed according to a preset processing scheme in the microphone connecting application program to obtain the synthetic audio of the corresponding audio type;

the transmission unit is used for sending the synthetic audio of the corresponding audio type to the audio processor through the microphone connecting application program, so that the audio processor packages the synthetic audio of the corresponding audio type to obtain the sound data to be sent.

In a third aspect, an embodiment of the present disclosure provides a computer-readable storage medium, where instructions are stored, and when executed, cause a computer to perform the method for processing live microphone audio in the first aspect or any one of the possible designs of the first aspect.

In a fourth aspect, an embodiment of the present disclosure further provides a mic cloud, where the mic cloud includes a processor, a machine-readable storage medium, and a network interface, where the machine-readable storage medium, the network interface, and the processor are connected through a bus system, the network interface is used for being communicatively connected with at least one mic client, the machine-readable storage medium is used for storing a program, an instruction, or a code, and the processor is used for executing the program, the instruction, or the code in the machine-readable storage medium to execute the mic audio processing method in the first aspect or any one of possible designs in the first aspect.

Based on any one of the above aspects, with the above technical solution, the microphone connecting application program may be invoked to read the waveform to be processed of the corresponding audio type; performing timbre processing on the waveform to be processed according to a preset processing scheme in the microphone connecting application program to obtain a synthetic audio of the corresponding audio type; and sending the synthetic audio of the corresponding audio type to the audio processor through the microphone connecting application program so that the audio processor packages the synthetic audio of the corresponding audio type to obtain the sound data to be sent. Through the scheme, the original work of audio processing in the own client side can be transferred to the cloud side for processing, so that the work load of the client side is greatly reduced, the possibility of packet loss and blockage is reduced, and the user experience is improved.

Drawings

To more clearly illustrate the technical solutions of the embodiments of the present disclosure, the drawings that are required to be used in the embodiments will be briefly described below, it should be understood that the following drawings only illustrate some embodiments of the present disclosure and therefore should not be considered as limiting the scope, and for those skilled in the art, other related drawings may be obtained from the drawings without inventive effort.

Fig. 1 is a schematic view of an application scenario of a microphone-connected audio processing system according to an embodiment of the present disclosure;

fig. 2 is a schematic flow chart of a microphone connecting audio processing method according to an embodiment of the present disclosure;

fig. 3 is a schematic functional block diagram of a microphone-connected audio processing apparatus according to an embodiment of the present disclosure;

fig. 4 is a block diagram schematically illustrating a structure of a microphone connecting cloud for implementing the microphone connecting audio processing method according to the embodiment of the present disclosure.

Detailed Description

The present disclosure is described in detail below with reference to the drawings, and the specific operation methods in the method embodiments can also be applied to the device embodiments or the system embodiments.

Fig. 1 is an interactive schematic diagram of a microphone-connected audio processing system 10 according to an embodiment of the present disclosure. The live audio processing system 10 may include a live cloud 100 and a live client 200 communicatively coupled to the live cloud 100. The microphone-connected audio processing system 10 shown in fig. 1 is only one possible example, and in other possible embodiments, the microphone-connected audio processing system 10 may include only one of the components shown in fig. 1 or may include other components.

In this embodiment, the microphone client 200 may comprise a mobile device, a tablet computer, a laptop computer, etc., or any combination thereof. In some embodiments, the mobile device may include a smart home device, a wearable device, a smart mobile device, a virtual reality device, an augmented reality device, or the like, or any combination thereof. In some embodiments, the smart home devices may include control devices of smart electrical devices, smart monitoring devices, smart televisions, smart cameras, and the like, or any combination thereof. In some embodiments, the wearable device may include a smart bracelet, a smart lace, smart glass, a smart helmet, a smart watch, a smart garment, a smart backpack, a smart accessory, or the like, or any combination thereof. In some embodiments, the smart mobile device may include a smartphone, a personal digital assistant, a gaming device, and the like, or any combination thereof. In some embodiments, the virtual reality device and/or the augmented reality device may include a virtual reality helmet, virtual reality glass, a virtual reality patch, an augmented reality helmet, augmented reality glass, an augmented reality patch, or the like, or any combination thereof. For example, the virtual reality device and/or augmented reality device may include various virtual reality products and the like.

In this embodiment, the connected microphone cloud 100 and the connected microphone client 200 in the connected microphone audio processing system 10 may execute the connected microphone audio processing method described in the following method embodiment in a matching manner, and the specific steps of the connected microphone cloud 100 and the connected microphone client 200 may refer to the detailed description of the following method embodiment.

To solve the technical problem in the foregoing background art, fig. 2 is a schematic flow chart of a microphone connecting audio processing method according to an embodiment of the present disclosure, where the microphone connecting audio processing method according to the present embodiment may be executed by the microphone connecting cloud 100 shown in fig. 1, and the microphone connecting audio processing method is described in detail below.

Step S110, calling the microphone connecting application program to read the waveform to be processed of the corresponding audio type;

step S120, performing timbre processing on the waveform to be processed according to a preset processing scheme in the microphone connecting application program to obtain the synthetic audio of the corresponding audio type;

step S130, sending the synthesized audio of the corresponding audio type to the audio processor through the microphone connection application program, so that the audio processor packages the synthesized audio of the corresponding audio type to obtain the to-be-sent sound data.

In a possible embodiment, step S110 further includes:

step S101, responding to a first operation, and optimizing an audio input mode and an audio output mode of the microphone connecting application program to the corresponding audio type;

and step S102, responding to a second operation, and optimizing a processing scheme in the microphone connecting application program according to the position of the axis of the waveform extreme value corresponding to the corresponding audio type to obtain the preset processing scheme.

In one possible embodiment, step S110 further includes:

step S111, reading the waveform to be processed of the corresponding audio type according to the optimized audio input mode;

step S120 further includes:

and step S121, performing timbre processing on the waveform to be processed, and outputting the synthesized audio according to the optimized audio output mode.

In one possible embodiment, step S120 further includes:

step S122, determining a waveform area range to be modified according to the preset processing scheme;

and S123, performing peak value extraction on the waveform to be processed according to the preset processing scheme, and superposing corresponding waveform numerical values in the waveform region range through the extracted waveform extreme value to obtain the synthetic audio.

In one possible embodiment, step S123 further includes:

step S1231, determining a synthetic tone corresponding to the waveform to be processed from the preset processing scheme;

and S1232, superposing the waveform numerical value corresponding to the synthesized tone to the corresponding waveform numerical value in the waveform region range to obtain the synthesized audio.

In one possible embodiment, step S1231 further includes:

step S12311, the synthesized tone color at least includes one of: youth sound, maiden sound, yujie sound, tergent sound, and senior sound. ,

fig. 3 is a schematic diagram of functional modules of the microphone connecting audio processing device 300 according to the embodiment of the present disclosure, and in this embodiment, the functional modules of the microphone connecting audio processing device 300 may be divided according to the method embodiment executed by the microphone connecting cloud 100, that is, the following functional modules corresponding to the microphone connecting audio processing device 300 may be used to execute the method embodiments executed by the microphone connecting cloud 100. The microphone audio processing apparatus 300 may include a recording unit 310, a tone processing unit 320, and a transmission unit 330, and the functions of the functional modules of the microphone audio processing apparatus 300 are described in detail below.

The recording unit 310 may be configured to perform the step S110 described above, that is, to invoke the microphone application to read the waveform to be processed of the corresponding audio type.

The tone processing unit 320 may be configured to execute step S120, that is, configured to perform tone processing on the waveform to be processed according to a preset processing scheme in the microphone application program, so as to obtain the synthesized audio of the corresponding audio type.

The transmission unit 330 may be configured to execute the step S130, that is, to send the synthesized audio of the corresponding audio type to the audio processor through the microphone application, so that the audio processor encapsulates the synthesized audio of the corresponding audio type to obtain to-be-sent sound data.

It should be noted that the division of the modules of the above apparatus is only a logical division, and the actual implementation may be wholly or partially integrated into one physical entity, or may be physically separated. And these modules can be realized in the form of software called by processing element; or may be implemented entirely in hardware; and part of the modules can be realized in the form of calling software by the processing element, and part of the modules can be realized in the form of hardware. For example, the recording unit 310 may be a separate processing element, or may be integrated into a chip of the apparatus, or may be stored in a memory of the apparatus in the form of program code, and a processing element of the apparatus calls and executes the functions of the recording unit 310. Other modules are implemented similarly. In addition, all or part of the modules can be integrated together or can be independently realized. The processing element described herein may be an integrated circuit having signal processing capabilities. In implementation, each step of the above method or each module above may be implemented by an integrated logic circuit of hardware in a processor element or an instruction in the form of software.

For example, the above modules may be one or more integrated circuits configured to implement the above methods, such as: one or more Application Specific Integrated Circuits (ASICs), or one or more microprocessors (DSPs), or one or more Field Programmable Gate Arrays (FPGAs), etc. For another example, when some of the above modules are implemented in the form of a processing element scheduler code, the processing element may be a general-purpose processor, such as a Central Processing Unit (CPU) or other processor that can call the program code. As another example, these modules may be integrated together, implemented in the form of a system-on-a-chip (SOC).

Fig. 4 is a schematic diagram illustrating a hardware structure of the mic cloud 100 for implementing the control device according to the embodiment of the disclosure, and as shown in fig. 4, the mic cloud 100 may include a processor 110, a machine-readable storage medium 120, a bus 130, and a transceiver 140.

In a specific implementation process, at least one processor 110 executes computer-executable instructions stored in the machine-readable storage medium 120 (for example, included in the microphone-connected audio processing apparatus 300 shown in fig. 3), so that the processor 110 may perform the microphone-connected audio processing method according to the above method embodiment, where the processor 110, the machine-readable storage medium 120, and the transceiver 140 are connected through the bus 130, and the processor 110 may be configured to control transceiving actions of the transceiver 140, so as to perform data transceiving with the microphone-connected client 200.

For a specific implementation process of the processor 110, reference may be made to the above-mentioned method embodiments executed by the cloud 100, which have similar implementation principles and technical effects, and details of this embodiment are not described herein again.

In the embodiment shown in fig. 4, it should be understood that the processor may be a Central Processing Unit (CPU), other general-purpose processor, a Digital Signal Processor (DSP), an Application Specific Integrated Circuit (ASIC), etc. A general purpose processor may be a microprocessor or the processor may be any conventional processor or the like. The steps of a method disclosed in connection with the present invention may be embodied directly in a hardware processor, or in a combination of the hardware and software modules within the processor.

The machine-readable storage medium 120 may comprise high-speed RAM memory and may also include non-volatile storage NVM, such as at least one disk memory.

The bus 130 may be an Industry Standard Architecture (ISA) bus, a Peripheral Component Interconnect (PCI) bus, an Extended ISA (EISA) bus, or the like. The bus 130 may be divided into an address bus, a data bus, a control bus, and the like. For ease of illustration, the buses in the figures of the present application are not limited to only one bus or one type of bus.

In addition, the embodiment of the disclosure also provides a readable storage medium, in which a computer executing instruction is stored, and when the processor executes the computer executing instruction, the method for processing the audio of the microphone is implemented.

The readable storage medium described above may be implemented by any type of volatile or non-volatile memory device or combination thereof, such as Static Random Access Memory (SRAM), electrically erasable programmable read-only memory (EEPROM), erasable programmable read-only memory (EPROM), programmable read-only memory (PROM), read-only memory (ROM), magnetic memory, flash memory, magnetic or optical disk. Readable storage media can be any available media that can be accessed by a general purpose or special purpose computer.

Finally, it should be noted that: the above embodiments are only used for illustrating the technical solutions of the present disclosure, and not for limiting the same; while the present disclosure has been described in detail with reference to the foregoing embodiments, those of ordinary skill in the art will understand that: the technical solutions described in the foregoing embodiments may still be modified, or some or all of the technical features may be equivalently replaced; and such modifications or substitutions do not depart from the spirit and scope of the corresponding technical solutions of the embodiments of the present disclosure.