阅读说明：本技术 无线多声道音频传输方法、装置和电子设备 (Wireless multi-channel audio transmission method and device and electronic equipment ) 是由 徐斌 于 2021-09-18 设计创作，主要内容包括：本申请公开了一种无线多声道音频传输方法、装置和电子设备,属于无线音频技术领域。本申请的无线多声道音频传输方法包括：把N个声道的音频数据划分成M组子集声道数据音频数据,N≥2,M≥2,每一组子集声道音频数据包括至少一个声道的音频数据；通过M个发送模组并行地将M组子集声道数据音频数据分别发送给M个子集声道音频接收设备,每个发送模组的发送频率不同,针对某一组子集声道数据,交替的通过M个发送模组向某一个子集声道音频接收设备发送所述某一组子集声道数据；采用不同频率信道并行发送子集声道数据,利用时分复用、频分复用和空间分集提高无线多声道音频传输系统的传输的带宽、降低延迟、增加传输可靠性。(The application discloses a wireless multi-channel audio transmission method, a wireless multi-channel audio transmission device and electronic equipment, and belongs to the technical field of wireless audio. The wireless multichannel audio transmission method of the application comprises the following steps: dividing the audio data of N sound channels into M groups of subset sound channel data audio data, wherein N is more than or equal to 2, M is more than or equal to 2, and each group of subset sound channel audio data comprises audio data of at least one sound channel; respectively sending M groups of subset channel data audio data to M subsets of channel audio receiving equipment in parallel through M sending modules, wherein the sending frequency of each sending module is different, and aiming at a certain group of subset channel data, the M sending modules alternately send the certain group of subset channel data to the certain subset channel audio receiving equipment; the method adopts different frequency channels to transmit the subset channel data in parallel, and utilizes time division multiplexing, frequency division multiplexing and space diversity to improve the transmission bandwidth of the wireless multi-channel audio transmission system, reduce delay and increase transmission reliability.)

1. A wireless multi-channel audio transmission method is used for sending audio data of N channels to M audio receiving devices of subset channels, M and N are positive integers, M is larger than or equal to 2, and N is larger than or equal to 2, and the method comprises the following steps:

dividing the audio data of the N channels into M groups of subset channel data, wherein each group of subset channel data comprises the audio data of at least one channel;

the M groups of subset channel data are sent to the M groups of subset channel audio receiving equipment in parallel through the M sending modules, wherein the sending frequency adopted by each sending module at the same moment is different, and the sending modules used for sending the target group subset channel data are changed according to a preset sending module changing rule aiming at the target group subset channel data.

2. The method for wireless multi-channel audio transmission according to claim 1, wherein the dividing the audio data of the N channels into M groups of subset channel data comprises:

and grouping the audio data of the N sound channels according to the sound channel information of the audio data received by each subset sound channel audio receiving device, wherein one subset sound channel audio receiving device correspondingly receives a group of subset sound channel data.

3. The method of claim 1, wherein the predetermined transform rule of the sending module comprises:

and alternately sending the target group subset channel data through M sending modules.

4. The method of claim 1, wherein the predetermined transform rule of the sending module comprises:

and when the target group subset channel data is repeatedly sent in one sending time period, different sending modules are adopted for sending at least once.

5. The method of claim 1, wherein the transmitting module serially transmits the audio data of the at least two channels of the target set of subset channel data in a time division multiplexed manner when the target set of subset channel data includes audio data of at least two channels.

6. The wireless multi-channel audio transmission method according to claim 1, when the wireless multi-channel audio transmission method is used for bluetooth low energy communication, comprising:

a group of connection isochronous stream CIS links are respectively established between each subset channel audio receiving device and used for transmitting a group of subset channel data, each group of connection isochronous stream CIS links at least comprises one connection isochronous stream CIS link, and one connection isochronous stream CIS link is used for transmitting audio data of one channel; alternatively, the first and second electrodes may be,

and a group of broadcast isochronous stream BIS links are respectively established between each subset channel audio receiving device and used for transmitting a group of subset channel data, at least one broadcast isochronous stream BIS link is included in the group of broadcast isochronous stream BIS links, and one broadcast isochronous stream BIS link is used for transmitting audio data of one channel.

7. The wireless multi-channel audio transmission method according to claim 6, wherein the dividing the audio data of the N channels into M groups of subset channel data comprises:

and encoding the audio data of the N sound channels, respectively encapsulating the audio data into protocol data packets of the N sound channels according to a connection isochronous stream CIS protocol or a broadcast isochronous stream BIS protocol, and grouping the protocol data packets of the N sound channels into M groups of subset sound channel data according to the sound channel information of the audio data received by each subset sound channel audio receiving device.

8. The wireless multichannel audio transmission method according to claim 7, wherein the transmitting module includes a Bluetooth Low Energy (BLE) radio frequency unit and an antenna;

the sending M groups of subset channel data to M groups of subset channel audio receiving equipment in parallel through M sending modules comprises: respectively sending the M groups of subset channel data to corresponding subset channel audio receiving equipment in parallel through M transmitting modules; wherein the content of the first and second substances,

for a protocol data packet of one channel transmitted through a CIS link or a BIS link with a sequence number of X, in a sub-event with a sequence number of S of an isochronous channel event with a sequence number of E, a Bluetooth Low Energy (BLE) radio frequency unit with a sequence number of R and an antenna are adopted for transmission, wherein R ═ X + E + S) mod M, R, X, E and S are all natural numbers.

9. A method of wireless multi-channel audio transmission, comprising:

receiving target group subset channel data sent by wireless multichannel audio sending equipment, wherein the target group subset channel data is one of M groups of subset channel data sent by M sending modules of the wireless multichannel audio sending equipment in parallel; the M groups of subset channel data comprise audio data of N sound channels, and the target group of subset channel data at least comprise audio data of one sound channel, wherein M is more than or equal to 2, N is more than or equal to 2, and M and N are positive integers;

and when the wireless multi-channel audio transmitting equipment changes the transmitting module used for transmitting the target group subset channel data according to a preset transmitting module changing rule, the subset channel audio receiving equipment correspondingly receives the target group subset channel data transmitted by the changed transmitting module.

10. Wireless multi-channel audio transmission method according to claim 9, wherein said subset channel audio receiving devices comprise at least one mono audio receiving device, and/or

At least one multi-channel audio receiving device.

11. A wireless multi-channel audio transmitting device is characterized in that the device is used for transmitting audio data of N channels to M audio receiving devices of subset channels, M and N are positive integers, M is larger than or equal to 2, N is larger than or equal to 2, the device comprises an audio processing and storing unit, a baseband and protocol processing unit and M transmitting modules,

the audio processing and storage unit is used for dividing the audio data of the N sound channels into M groups of subset sound channel data, and each group of subset sound channel data comprises the audio data of at least one sound channel;

the baseband and protocol processing unit respectively sends the M groups of subset channel data to the M subsets of channel audio receiving equipment in parallel through the M sending modules, wherein, the sending frequency adopted by each sending module is different at the same time,

the baseband and protocol processing unit is further configured to transform a sending module for sending the target group subset channel data according to a preset sending module transformation rule for the target group subset channel data.

12. The wireless multi-channel audio transmitting device according to claim 11, wherein the transmitting module includes a radio frequency unit and an antenna.

13. A wireless multi-channel audio transmission system, characterized in that the audio transmission system comprises a wireless multi-channel audio transmitting device and M subset channel audio receiving devices,

the wireless multi-channel audio transmitting apparatus transmitting M sets of subset channel data in parallel, the M sets of subset channel data including audio data of N channels, according to the wireless multi-channel audio transmission method as claimed in one of claims 1 to 8; wherein M is more than or equal to 2, N is more than or equal to 2, and M and N are positive integers;

the M subset channel audio receiving apparatuses receive M groups of subset channel data from the wireless multi-channel audio transmitting apparatus according to the wireless multi-channel audio transmission method as claimed in one of claims 9 or 10.

14. An electronic device, comprising: processor, memory and program stored on the memory and executable on the processor, which when executed by the processor implements the steps of the wireless multichannel audio transmission method according to one of claims 1 to 8 or claims 9 to 10.

15. A computer-readable storage medium, characterized in that the computer-readable storage medium has stored thereon a computer program which, when being executed by a processor, carries out the steps of the wireless multi-channel audio transmission method according to one of claims 1 to 8 or 9 to 10.

Technical Field

The present application relates to the field of wireless audio, and in particular, to a wireless multi-channel audio transmission method, apparatus and electronic device.

Background

Nowadays, the wireless audio technology has brought free talk and music enjoyment to people without limitation, and has gained wide favor of people. Especially, Bluetooth Low Energy (BLE) Audio (Audio) technology, which adopts a Connected Isochronous Stream (CIS) protocol for point-to-point communication and a Broadcast Isochronous Stream (BIS) protocol for point-to-multipoint communication, and a Connected Isochronous Group (CIG) protocol composed of at least one CIS and a Broadcast Isochronous Group (BIG) protocol composed of at least one BIS corresponding thereto, thereby being capable of providing a Multi-channel (Multi-channel) wireless Audio service with lower power consumption, lower cost and higher quality to people. For example, two-channel True Wireless Stereo (TWS) headphones based on two-way CIS or BIS.

However, the physical layer maximum transmission rate of bluetooth low energy audio is only 2Mbps, which limits further improvement of the quality of wireless multi-channel audio, in particular, the reliable transmission of wireless high resolution multi-channel audio. At the same time, this also limits the further reduction of wireless multi-channel audio delay, in particular, affecting the performance of wireless multi-channel gaming headsets requiring ultra-low delay; further increases in the number of channels for wireless multi-channel audio are also limited, and in particular, the performance of high quality low delay wireless 5.1 or 7.1 multi-channel surround sound enclosures is affected.

In order to improve the wireless transmission rate of bluetooth low-power consumption audio, symbol periods of GFSK modulation used by BLE, differential phase shift keying modulation with the same symbol period, or multi-carrier modulation technology are generally adopted to improve the transmission rate, or a BLE radio frequency transmitter with the same number of channels is simply adopted to transmit multi-channel audio in a frequency division multiplexing manner to improve the transmission rate or expand the number of channels, however, these methods have defects, for example, the shorter the symbol period is, the more influenced by multipath interference is, the worse the performance of long-distance wireless transmission is; such as power difficulties to meet low power consumption requirements; for example, the switching time ratio increases with the increase of the transmission rate and the number of transmission channels when time division multiplexing transmission is performed, which leads to the reduction of link efficiency; such as increased complexity, reduced flexibility and reliability as channels are added.

Disclosure of Invention

The application provides a wireless multi-channel audio transmission method, a wireless multi-channel audio transmission device and electronic equipment, which are used for solving the problems in the prior art and improving the performance of wireless multi-channel audio transmission.

In order to achieve the purpose, the following scheme is adopted in the application:

on one hand, the embodiment of the application provides a wireless multi-channel audio transmission method, which is used for sending audio data of N channels to M audio receiving equipment with subset channels, wherein M and N are positive integers, M is larger than or equal to 2, and N is larger than or equal to 2, and the method comprises the following steps:

dividing the audio data of the N channels into M groups of subset channel data, wherein each group of subset channel data comprises the audio data of at least one channel;

the M groups of subset channel data are sent to the M groups of subset channel audio receiving equipment in parallel through the M sending modules, wherein the sending frequency adopted by each sending module at the same moment is different, and the sending modules used for sending the target group subset channel data are changed according to a preset sending module changing rule aiming at the target group subset channel data.

Optionally, the dividing the audio data of the N channels into M groups of subset channel data includes:

and grouping the audio data of the N sound channels according to the sound channel information of the audio data received by each subset sound channel audio receiving device, wherein one subset sound channel audio receiving device correspondingly receives a group of subset sound channel data.

Optionally, the preset sending module transformation rule includes:

and alternately sending the target group subset channel data through M sending modules.

Optionally, the preset sending module transformation rule includes:

and when the target group subset channel data is repeatedly sent in one sending time period, different sending modules are adopted for sending at least once.

Optionally, when the target group subset channel data includes audio data of at least two channels, the sending module sends the audio data of the at least two channels of the target group subset channel data in series in a time division multiplexing manner.

Optionally, when the wireless multichannel audio transmission method is used for bluetooth low energy communication, the method includes:

a group of connection isochronous stream CIS links are respectively established between each subset channel audio receiving device and used for transmitting a group of subset channel data, each group of connection isochronous stream CIS links at least comprises one connection isochronous stream CIS link, and one connection isochronous stream CIS link is used for transmitting audio data of one channel; alternatively, the first and second electrodes may be,

and a group of broadcast isochronous stream BIS links are respectively established between each subset channel audio receiving device and used for transmitting a group of subset channel data, at least one broadcast isochronous stream BIS link is included in the group of broadcast isochronous stream BIS links, and one broadcast isochronous stream BIS link is used for transmitting audio data of one channel.

Optionally, the audio data of the N channels are encoded, and are respectively encapsulated into protocol data packets of the N channels according to a CIS protocol for connecting isochronous streams or a BIS protocol for broadcasting isochronous streams, and the protocol data packets of the N channels are grouped into M groups of subset channel data according to channel information of audio data received by each subset channel audio receiving device.

Optionally, the sending module includes a bluetooth low energy BLE radio frequency unit and an antenna;

the sending M groups of subset channel data to M groups of subset channel audio receiving equipment in parallel through M sending modules comprises: respectively sending the M groups of subset channel data to corresponding subset channel audio receiving equipment in parallel through M transmitting modules; wherein the content of the first and second substances,

for a protocol data packet of one channel transmitted through a CIS link or a BIS link with a sequence number of X, in a sub-event with a sequence number of S of an isochronous channel event with a sequence number of E, a Bluetooth Low Energy (BLE) radio frequency unit with a sequence number of R and an antenna are adopted for transmission, wherein R ═ X + E + S) mod M, R, X, E and S are all natural numbers.

In one aspect, an embodiment of the present application provides a wireless multi-channel audio transmission method, including:

receiving target group subset channel data sent by wireless multichannel audio sending equipment, wherein the target group subset channel data is one of M groups of subset channel data sent by M sending modules of the wireless multichannel audio sending equipment in parallel; the M groups of subset channel data comprise audio data of N sound channels, and the target group of subset channel data at least comprise audio data of one sound channel, wherein M is more than or equal to 2, N is more than or equal to 2, and M and N are positive integers;

and when the wireless multi-channel audio transmitting equipment changes the transmitting module used for transmitting the target group subset channel data according to a preset transmitting module changing rule, the subset channel audio receiving equipment correspondingly receives the target group subset channel data transmitted by the changed transmitting module.

Optionally, the subset channel audio receiving device comprises at least one mono audio receiving device, and/or

At least one multi-channel audio receiving device.

On one hand, the embodiment of the application also provides wireless multi-channel audio transmitting equipment which is used for transmitting the audio data of N channels to M audio receiving equipment with subset channels, wherein M and N are positive integers, M is more than or equal to 2, N is more than or equal to 2, the equipment comprises an audio processing and storing unit, a baseband and protocol processing unit and M transmitting modules,

the audio processing and storage unit is used for dividing the audio data of the N sound channels into M groups of subset sound channel data, and each group of subset sound channel data comprises the audio data of at least one sound channel;

the baseband and protocol processing unit respectively sends the M groups of subset channel data to the M subsets of channel audio receiving equipment in parallel through the M sending modules, wherein, the sending frequency adopted by each sending module is different at the same time,

the baseband and protocol processing unit is further configured to transform a sending module for sending the target group subset channel data according to a preset sending module transformation rule for the target group subset channel data.

Optionally, the sending module includes a radio frequency unit and an antenna.

In one aspect, embodiments of the present application further provide a wireless multi-channel audio transmission system, which includes a wireless multi-channel audio transmitting device and M subset channel audio receiving devices,

the wireless multichannel audio transmitting equipment parallelly transmits M groups of subset channel data according to any one of the wireless multichannel audio transmission methods provided by the embodiment of the application, wherein the M groups of subset channel data comprise audio data of N channels; wherein M is more than or equal to 2, N is more than or equal to 2, and M and N are positive integers;

the M subset channel audio receiving devices receive M groups of subset channel data from the wireless multichannel audio transmitting device according to any one of the wireless multichannel audio transmission methods provided by the embodiments of the present application.

In another aspect, an embodiment of the present application provides an electronic device, including: the wireless multichannel audio transmission method comprises a processor, a memory and a program stored on the memory and capable of running on the processor, wherein the program realizes the steps of any one of the wireless multichannel audio transmission methods provided by the embodiment of the application when being executed by the processor.

In another aspect, the present application provides a computer-readable storage medium, on which a computer program is stored, and the computer program, when executed by a processor, implements the steps of the wireless multi-channel audio transmission method according to any one of the embodiments of the present application.

The beneficial effects brought by the technical scheme provided by the embodiment of the application at least comprise:

the embodiment of the application provides a wireless multichannel audio transmission method, a corresponding wireless multichannel audio transmission system and a corresponding wireless multichannel audio sending device. The wireless multichannel audio transmission method comprises the steps of dividing audio data of N channels into M groups of subset channel data, wherein each group of subset channel data comprises audio data of at least one channel; respectively sending M groups of subset channel data to M groups of subset channel audio receiving equipment in parallel through M sending modules, wherein the sending frequency adopted by each sending module at the same moment is different, and aiming at the target group of subset channel data, the sending modules used for sending the target group of subset channel data are changed according to a preset sending module changing rule; the method adopts a plurality of frequency channels to transmit the subset channel data in parallel, and utilizes frequency division multiplexing and space diversity to improve the transmission bandwidth of the wireless multi-channel audio transmission system, reduce transmission delay and increase transmission reliability.

Drawings

Fig. 1 is a flowchart of a wireless multi-channel audio transmission method according to an embodiment of the present application;

fig. 2 is a schematic diagram of a wireless multi-channel audio transmission system according to an embodiment of the present application;

fig. 3 is a flowchart of a wireless multi-channel audio transmission method according to an embodiment of the present application;

fig. 4 is a schematic diagram of a wireless multi-channel audio transmitting device according to an embodiment of the present application;

FIG. 5a is a schematic diagram of a timeslot structure of a wireless multi-channel audio system;

FIG. 5b is a schematic diagram of a timeslot structure of a wireless multi-channel audio system;

FIG. 6a is a schematic time slot diagram of a wireless multi-channel audio system according to an embodiment of the present application;

FIG. 6b is a schematic time slot diagram of a wireless multi-channel audio system according to an embodiment of the present application;

FIG. 7 is a schematic diagram of a timeslot structure for a wireless multi-channel audio system;

fig. 8 is a schematic time slot diagram of a wireless multi-channel audio system according to an embodiment of the present application;

fig. 9 is a schematic structural diagram of an electronic device according to an embodiment of the present application.

Detailed Description

In order to make the objects, technical solutions and advantages of the embodiments of the present application clearer, the technical solutions of the embodiments of the present application will be clearly and completely described below with reference to the drawings of the embodiments of the present application. It should be apparent that the described embodiments are only some of the embodiments of the present application, and not all embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present application.

The terms first, second and the like in the description and in the claims of the present application are used for distinguishing between similar elements and not necessarily for describing a particular sequential or chronological order. It will be appreciated that the data so used may be interchanged under appropriate circumstances such that embodiments of the application may be practiced in sequences other than those illustrated or described herein, and that the terms "first," "second," and the like are generally used herein in a generic sense and do not limit the number of terms, e.g., the first term can be one or more than one. In addition, "and/or" in the specification and claims means at least one of connected objects, a character "/" generally means that a preceding and succeeding related objects are in an "or" relationship.

In addition, the technical features mentioned in the different embodiments of the present application described below may be combined with each other as long as they do not conflict with each other.

The following describes in detail a wireless multi-channel audio transmission method provided by the embodiments of the present application with reference to the accompanying drawings.

Referring to fig. 1, a schematic flowchart of a wireless multichannel audio transmission method provided in an embodiment of the present application is shown, where the wireless multichannel audio transmission method is used to send audio data of N channels to M subset channel audio receiving devices, M and N are positive integers, M ≧ 2, and N ≧ 2, the method includes:

step 101, dividing the audio data of N channels into M groups of subset channel data, wherein each group of subset channel data includes audio data of at least one channel.

Specifically, when dividing, the number of channels of each group of subset channel data may be the same or different, for example, the number of channels of a certain group of subset channel data is K_mThen, thenm∈M，M≥2。

Optionally, the dividing the audio data of the N channels into M groups of subset channel data includes:

and grouping the audio data of the N sound channels according to the sound channel information of the audio data received by each subset sound channel audio receiving device, wherein one subset sound channel audio receiving device correspondingly receives a group of subset sound channel data.

Specifically, the channel information includes the number of channels that the subset channel audio receiving apparatus needs to receive and which channels to receive.

Illustratively, if M is2, there are 2 subset channel audio receiving devices, and N is3, where a first subset channel audio receiving device can receive two channels and a second subset channel audio receiving device can receive only single channel, then the audio data of N channels is divided into two sets of subset channel data, the first set is2 channels of audio data corresponding to the first subset channel audio receiving device, and the second set is single channel of audio data corresponding to the second subset channel audio receiving device.

And step 102, respectively sending the M groups of subset channel data to M groups of subset channel audio receiving equipment in parallel through M sending modules, wherein the sending frequency adopted by each sending module at the same moment is different, and aiming at the target group of subset channel data, the sending modules for sending the target group of subset channel data are changed according to a preset sending module changing rule.

Specifically, the sending module may include a radio frequency unit and an antenna.

Specifically, the M transmitting modules transmit M groups of subset channel data in parallel by using different channels, and the frequencies of each channel are different at the same time, so that the frequency diversity mode can ensure that the channels of each subset channel do not interfere with each other. In a specific implementation, each channel may be calculated by using various existing channel selection algorithms, for example, a time division multiplexing BLE channel selection algorithm is used to calculate the channel used by each transmitting module at each time.

Specifically, in the process of sending M groups of subset channel data in parallel through M sending modules, a sending module for sending the target group subset channel data is also changed according to a preset sending module change rule for the target group subset channel data.

In some embodiments, the preset sending module transformation rule includes:

and alternately sending the target group subset channel data through M sending modules.

Illustratively, if there are 3 sending modules, at time 1, sending the target group subset channel data by using the sending module 1; and at the moment 2, the sending module 2 is adopted to send the target group subset channel data, and at the moment 3, the sending module 3 is adopted to send the target group subset channel data, so that the sending of the target group subset channel data is alternately and cyclically carried out, and the transmission bandwidth of wireless communication can be improved, the transmission delay can be reduced, and the transmission reliability can be improved by comprehensively utilizing the frequency division multiplexing and space diversity characteristics.

Specifically, for example, when the bluetooth low energy BLE wireless communication is used, the subset channel data of each subset channel audio receiving device is transmitted through different channels and BLE radio frequency units and antennas in different sub-event (Subevent) time slots, that is, a certain subset channel audio receiving device does not receive a group of subset channel data corresponding to the certain subset channel audio receiving device from a certain fixed transmitting module or a certain fixed channel, and for example, the transmitting module is a BLE radio frequency unit and an antenna, for example: when receiving a second group of subset channel data, the subset channel audio receiving device 2 corresponds to the channel 1, the BLE radio frequency unit 3 and the antenna 3 at time 1; at time 2, the channel 5, BLE rf unit 2 and antenna 2 are mapped.

As another specific implementation, the preset sending module transformation rule includes:

and when the target group subset channel data is repeatedly sent in one sending time period, different sending modules are adopted for sending at least once.

Specifically, in a sending period, if retransmission of the target group subset channel data occurs, at least one retransmission is sent by using different sending modules. For example, the sending module used for the first retransmission may be set to be different from the sending module used for the first transmission, so that the frequency division multiplexing and the spatial diversity characteristics may be utilized comprehensively to improve the transmission bandwidth of the wireless communication, reduce the transmission delay, and increase the transmission reliability. .

It is understood that other similar transmission module transformation rules may be adopted based on the technical idea of the present invention.

Optionally, when the target group subset channel data includes audio data of at least two channels, the sending module sends the audio data of the at least two channels of the target group subset channel data in series in a time division multiplexing manner. At this time, while M groups of subset channel data are transmitted in parallel by M groups of transmission modules, audio data of a plurality of channels in one group of subset channel data is transmitted serially by time-division multiplexing one transmission module, so that the present embodiment sufficiently combines the characteristics of frequency division multiplexing, time division multiplexing, and spatial diversity to transmit multichannel data, further improving the transmission bandwidth of the wireless multichannel audio system, reducing transmission delay, and increasing transmission reliability.

Specifically, the wireless multichannel audio transmission method provided by the embodiment of the application can be applied to various wireless frequency hopping communication scenes.

Optionally, when the wireless multichannel audio transmission method is used for bluetooth low energy communication, the method includes:

and respectively establishing a group of connection isochronous stream CIS links with each subset channel audio receiving device for transmitting a group of subset channel data. One or more CIS links may be included in a set of connected isochronous stream CIS links, one connected isochronous stream CIS link being used to transport one channel of audio data.

Optionally, when the wireless multichannel audio transmission method is used for bluetooth low energy communication, the method includes:

and respectively establishing a group of broadcast isochronous stream BIS links with each subset channel audio receiving device for transmitting a group of subset channel data, wherein one or more BIS links can be included in the group of broadcast isochronous stream BIS links, and one broadcast isochronous stream BIS link is used for transmitting audio data of one channel.

Optionally, the dividing the audio data of the N channels into M groups of subset channel data includes: coding the audio data of the N sound channels, respectively encapsulating the coded audio data into protocol data packets of the N sound channels according to a CIS (contact synchronous streaming) protocol for connection or a BIS (bit information service) protocol for broadcast and isochronous streaming, and grouping the protocol data packets of the N sound channels into M groups of subset sound channel data according to sound channel information of audio data received by each subset sound channel audio receiving device;

the sending module comprises a Bluetooth low energy BLE radio frequency unit and an antenna; the sending M groups of subset channel data to M groups of subset channel audio receiving equipment in parallel through M sending modules comprises: and respectively sending the M groups of subset channel data to corresponding subset channel audio receiving equipment in parallel through M transmitting modules.

Taking an implementation scenario of a Bluetooth Low Energy (BLE) Audio (Audio) technology as an example, first, the Audio Data of the N channels may be encoded into Audio Data of N channels of one channel or Audio service Data packets (SDU, service Data Unit) according to a BLE Audio communication Protocol by using a Data encoding and encapsulating method commonly used in the BLE Audio technology, and then the Audio Data or SDU of the N channels of one channel is encapsulated into Protocol Data packets (PDU: Protocol Data Unit) according to a CIS or BIS Protocol. And then, according to the channel information of the audio data received by each subset channel audio receiving device, grouping the protocol data packets of the channels to form M groups of subset channel data, so as to transmit the M groups of subset channel data to the corresponding M subset channel audio receiving devices in parallel through the M transmitting modules. For example, if a subset channel audio receiving device needs to receive the 0 th channel and the 2 nd channel, the protocol data packet of the 0 th channel and the protocol data packet of the 2 nd channel are used as a set of subset channel data.

Illustratively, the BLE radio frequency unit modulates the input PDU into a radio frequency signal and transmits the radio frequency signal to the corresponding subset channel audio receiving device through the connected antenna.

Optionally, M groups of subset channel data may be sent alternately through M sending modules according to the preset sending module conversion rule, where:

for a protocol data packet of one channel transmitted through a CIS link or a BIS link with a sequence number of X, in a sub-event with a sequence number of S of an isochronous channel event with a sequence number of E, a Bluetooth Low Energy (BLE) radio frequency unit with a sequence number of R and an antenna are adopted for transmission, wherein R ═ X + E + S) mod M, R, X, E and S are all natural numbers.

This alternating transmission module arrangement can achieve better communication performance through space diversity.

By the wireless multi-channel audio transmission method, the multi-channel audio data can be divided into at least two groups of subset channel data, the subset channel audio is transmitted in parallel through a plurality of frequency channels and a plurality of antennas by adopting a plurality of transmitting modules, and the transmission bandwidth, the transmission delay and the transmission reliability of a wireless multi-channel audio system can be improved by utilizing time division multiplexing, frequency division multiplexing and space diversity.

The embodiment of the application also provides a wireless multichannel audio transmission method, which comprises the following steps:

step 301, receiving target group subset channel data sent by a wireless multichannel audio sending device, where the target group subset channel data is one of M groups of subset channel data sent in parallel by M sending modules of the wireless multichannel audio sending device; the M groups of subset channel data comprise audio data of N sound channels, and the target group of subset channel data at least comprise audio data of one sound channel, wherein M is more than or equal to 2, N is more than or equal to 2, and M and N are positive integers;

and when the wireless multi-channel audio transmitting equipment changes the transmitting module used for transmitting the target group subset channel data according to a preset transmitting module changing rule, the subset channel audio receiving equipment correspondingly receives the target group subset channel data transmitted by the changed transmitting module.

Exemplary, e.g., N-5, M-3, K_mNumber of channels, K, received for subset channel data set m₁＝1，K₂＝2，K₃2, namely, the 3 subset channel audio receiving devices respectively receive the wireless audio data of 1 channel, 2 channels and 2 channels; or may be K₁＝1，K₂＝1，K₃3, that is, 3 subset channel audio receiving apparatuses receive wireless audio data of 1, and 3 channels, respectively.

Optionally, the subset channel audio receiving device comprises at least one mono audio receiving device, and/or

At least one multi-channel audio receiving device.

Specifically, each subset channel audio receiving device may include a single-channel audio receiving device, a multi-channel audio receiving device, or several single-channel audio receiving devices and/or multi-channel audio receiving devices.

Optionally, the receiving the target group subset channel data sent by the wireless multichannel audio sending device includes:

each subset channel audio receiving device establishes a set of connected isochronous stream CIS links or a set of broadcast isochronous stream BIS links with the wireless multi-channel audio transmitting device.

By the wireless multi-channel audio transmission method, the audio receiving equipment of the subset channel can receive a group of subset channel data from the wireless multi-channel audio transmitting equipment, and the communication process has the characteristics of low transmission bandwidth, low transmission delay and high transmission reliability.

Referring to fig. 4, an embodiment of the present application further provides a wireless multi-channel audio transmitting device 40, configured to transmit audio data of N channels to M audio receiving devices of subset channels, where M and N are positive integers, M is greater than or equal to 2, N is greater than or equal to 2, the device includes an audio processing and storing unit 41, a baseband and protocol processing unit 42, and M transmitting modules,

an audio processing and storing unit 41, configured to divide the audio data of the N channels into M groups of subset channel data, where each group of subset channel data includes audio data of at least one channel;

the baseband and protocol processing unit 42, which sends M groups of subset channel data to M subsets of channel audio receiving devices in parallel through the M sending modules, wherein the sending frequency adopted by each sending module is different at the same time;

the baseband and protocol processing unit is further configured to transform a sending module for sending the target group subset channel data according to a preset sending module transformation rule for the target group subset channel data.

Optionally, the sending module includes a radio frequency unit and an antenna.

Specifically, referring to fig. 4, the wireless multichannel audio transmitting device further includes M BLE radio frequency units (M ≧ 2), and each BLE radio frequency unit is connected to one antenna.

Optionally, the audio processing and storing unit 41 is further configured to group the audio data of the N channels according to the channel information of the audio data received by each subset channel audio receiving device, and one subset channel audio receiving device correspondingly receives a group of subset channel data.

Optionally, the preset sending module transformation rule includes:

and alternately sending the target group subset channel data through M sending modules.

Optionally, the preset sending module transformation rule includes:

and when the target group subset channel data is repeatedly sent in one sending time period, different sending modules are adopted for sending at least once.

Optionally, when the target group subset channel data includes audio data of at least two channels, the sending module sends the audio data of the at least two channels of the target group subset channel data in series in a time division multiplexing manner.

Optionally, when the wireless multi-channel audio transmission method is used for bluetooth low energy communication, the baseband and protocol processing unit 42 is further configured to:

a group of connection isochronous stream CIS links are respectively established between each subset channel audio receiving device and used for transmitting a group of subset channel data, each group of connection isochronous stream CIS links at least comprises one connection isochronous stream CIS link, and one connection isochronous stream CIS link is used for transmitting audio data of one channel; alternatively, the first and second electrodes may be,

and a group of broadcast isochronous stream BIS links are respectively established between each subset channel audio receiving device and used for transmitting a group of subset channel data, at least one broadcast isochronous stream BIS link is included in the group of broadcast isochronous stream BIS links, and one broadcast isochronous stream BIS link is used for transmitting audio data of one channel.

Optionally, the audio processing and storing unit 41 is further configured to encode the audio data of the N channels according to a bluetooth low energy communication protocol, and generate the audio data or audio service data packet of the N channels of single channels;

the baseband and protocol processing unit 42 is further configured to encapsulate the audio data or audio service data packets of the N channels of monophonic channels into protocol data packets of N channels respectively according to a CIS protocol for connecting isochronous streams or a BIS protocol for broadcasting isochronous streams, and form M groups of subset channel data by grouping the protocol data packets of the N channels according to channel information of audio data received by each subset channel audio receiving device;

the sending module includes bluetooth low energy BLE radio frequency unit and antenna, send M group subset sound channel data respectively to M subset sound channel audio frequency receiving equipment through M sending modules parallelly including: and respectively sending the M groups of subset channel data to corresponding subset channel audio receiving equipment in parallel through M transmitting modules.

Optionally, the audio processing and storing unit 41 can also be used to collect and store multi-channel audio data and perform related audio processing.

Specifically, the baseband and protocol processing unit 41 may be configured to transmit protocol data packets PDU in M groups of subset channel data to M BLE radio frequency units alternately, where in a sub-event with a sequence number S of an isochronous channel event with a sequence number E, a bluetooth low energy BLE radio frequency unit with a sequence number R and an antenna are used, and a protocol data packet PDU of an xth channel is transmitted based on a CIS link or a BIS link with a sequence number X, where R ═ X + E + S) mod M, R, X, E, and S are all natural numbers. The BLE radio frequency unit modulates the input PDU into a radio frequency signal and transmits the radio frequency signal to the corresponding subset channel audio receiving equipment through the connected antenna.

Referring to fig. 2, an embodiment of the present application further provides a wireless multi-channel audio transmission system,

the audio transmission system includes a wireless multi-channel audio transmitting device and M subset channel audio receiving devices,

the wireless multichannel audio transmitting equipment parallelly transmits M groups of subset channel data according to any one of the wireless multichannel audio transmission methods provided by the embodiment of the application, wherein the M groups of subset channel data comprise audio data of N channels; wherein M is more than or equal to 2, N is more than or equal to 2, and M and N are positive integers;

the M subset channel audio receiving devices receive M groups of subset channel data from the wireless multichannel audio transmitting device according to any one of the wireless multichannel audio transmission methods provided by the embodiments of the present application.

Specifically, the wireless multichannel audio transmission method provided by the present application can be applied to a wireless multichannel audio system, such as a wireless multichannel audio system composed of a wireless multichannel audio transmitting device and M subset channel audio receiving devices, as shown in fig. 2.

Specifically, the total number N of the sound channels is more than or equal to 2, the sound channels comprise at least two subset sound channel audio receiving devices, M is more than or equal to 2, and the subset sound channel audio receiving device M receives K_mAudio data of individual channels, (N)>K_m≧ 1), that is, each subset channel audio receiving apparatus receives audio data of at least one channel; the sum of the channels of all subset channel audio receiving devices is equal to N, i.e.

In particular, each subset channel audio receiving device comprises at least one mono audio receiving device, and/or

At least one multi-channel audio receiving device.

Illustratively, the receiver comprises at least one single-channel audio receiver, or a multi-channel receiver capable of receiving multiple channels simultaneously, or at least one single-channel receiver capable of receiving one channel and/or a multi-channel receiver capable of receiving multiple channels simultaneously.

Other technical details and working principles of the wireless multi-channel audio transmission system provided by the embodiment of the present application can be implemented by referring to the foregoing embodiments, and are not described herein again.

By way of example, the working principle of the wireless multichannel Audio transmission method and the wireless multichannel Audio transmission system provided by the embodiment of the present application is described by taking a BLE Audio two-channel True Wireless (TWS) headset as an Audio receiving device.

Specifically, when the TWS headset is used as an audio receiving device, the wireless multichannel audio transmitting device may be a smart phone, a smart television, a smart speaker, or other audio transmitting devices.

Specifically, the TWS headphone pair includes two subset channel audio receiving devices, each subset channel audio receiving device is a monaural audio receiving device, and corresponds to the left channel headphone and the right channel headphone, respectively. Each subset channel audio receiving device receives one channel, corresponding to a left channel and a right channel, respectively. A CIS link or a BIS link is respectively established between the wireless multichannel audio transmitting device and a left channel earphone and a right channel earphone of the TWS earphone pair, and each CIS or BIS adopts different channels to ensure that each CIS or BIS does not interfere with each other. Specifically, the existing time division multiplexing BLE channel selection algorithm can be adopted to determine the channel of the CIS or BIS, so that sufficient frequency isolation can be ensured.

Referring to the wireless multi-channel audio transmitting device 40 shown in fig. 4, when M is2, two BLE radio frequency units and corresponding antennas are included. And a CIS link or a BIS link is respectively established between the wireless multichannel audio transmitting equipment and the left channel earphone and the right channel earphone of the TWS earphone pair. The Audio processing and storing unit 41 of the wireless multi-channel Audio transmitting device 40 collects, processes and stores the two-channel Audio data, and encodes the two-channel Audio data into two-channel single-channel Audio data or Audio service data packets (SDUs) respectively by using a Low-Complexity Communication Codec (LC 3) according to a BLE Audio Communication protocol. The baseband and Protocol processing and storing Unit 42 stores and executes BLE communication Protocol, CIG or BIG Protocol of the binaural audio transmitting device, encapsulates binaural audio Data SDU into Protocol Data Packets (PDU) according to CIS or BIS Protocol, and transmits them to two different BLE radio frequency units in parallel. The BLE radio frequency unit modulates the corresponding PDU into a radio frequency signal and sends the radio frequency signal to a left channel earphone and a right channel of a corresponding channel of the TWS earphone through an antenna connected with the BLE radio frequency unit.

As shown in fig. 5a and 5b, a CIG or BIG slot structure between a conventional time division multiplexing BLE Audio transmitting device and a TWS headset pair is shown. Wherein, the CIG in fig. 5a includes two CIS links, which are CIS0 and CIS 1. The BIG in FIG. 5b contains two BIS links, BIS0 and BIS1, respectively. Each CIS link or BIS link contains 4 sub-events (Subevents), sub-event 0, sub-event 1, sub-event 2, and sub-event 3 during an equal time Interval (Isochronous Interval). The sub-events of the CIS0 link and the CIS1 link are time division multiplexed for alternate execution. The sub-events of the BIS0 link and the BIS1 link are time division multiplexed and performed alternately.

As shown in fig. 6a and 6b, a CIG or BIG slot structure between a wireless multi-channel audio transmitting device and a TWS headset pair is provided for the embodiment of the present application. Wherein, the wireless multi-channel audio transmitting equipment is connected with the TWS earphone through the CIG or the BIG. The CIG as in fig. 6a contains two CIS links, CIS0 and CIS1 respectively. The BIG in FIG. 6b contains two BISs, BIS0 and BIS 1. Each CIS link or BIS link contains 4 sub-events (Subevents), sub-event 0, sub-event 1, sub-event 2, and sub-event 3, within an equal time interval. The sub-events of the CIS0 link and the CIS1 link are performed in parallel and alternately through different channels and two BLE radio frequency units and antennas. The sub-events of the BIS0 link and the BIS1 link are performed in parallel and alternately by the two BLE radio units and the antenna.

As shown in fig. 6a and 6b, for example, at sub-Event 0 of time 0(Event0), the CIS0 link is transmitted through BLE radio unit 0 and antenna 0, and the CIS1 link is transmitted through BLE radio unit 1 and antenna 1; at sub-event 1 of time 0, the CIS0 line is transmitted through BLE radio unit 1 and antenna 1, and the CIS1 link is transmitted through BLE radio unit 0 and antenna 0. Compared to the time division multiplexing method shown in fig. 5a and 5b, the method shown in fig. 6a and 6b can improve the reliability of wireless transmission by spatial diversity obtained by two antennas, reduce half of the transmission delay by frequency division multiplexing, or can have more time to perform more sub-events, i.e. more retransmission times, within an equal time interval, thereby improving the wireless transmission performance or wireless transmission reliability.

Illustratively, the working principle of the wireless Multi-Channel audio system provided by the embodiment of the present application is described by taking a wireless Multi-Channel 5.1 Surround (5.1Multi-Channel Surround) audio system as an example. The wireless multichannel Audio transmitting equipment is an intelligent television or an intelligent main sound box, and the subset channel Audio receiving equipment is a BLE Audio wireless sound box.

Specifically, in a wireless multi-channel 5.1 Surround sound Audio system, there are 6 channels of speakers, where the Center speaker (Center) and Subwoofer (LFE or Subwoofer) are typically smart tvs or smart home speakers, and the other 4 channels of speakers are BLE wireless speakers including a Front Left speaker (Front Left), a Front Right speaker (Front Right), a Left Surround speaker (Left Surround), and a Right Surround speaker (Right Surround).

If the existing time division multiplexing BLE Audio technology is adopted, a CIG link comprising 4 CIS links needs to be adopted between the intelligent television or the intelligent main sound box and the BLE Audio wireless sound box. The audio is encoded by LC3, the encoding rate of each channel is 96kbps, the length of the encoding frame is 10ms, the size of the audio service data packet SDU is 120 bytes, and the equal time interval is 10 ms. With a BLE 2Mbps transmission rate, the air time occupied by an encrypted audio protocol data Packet (PDU) is 540us, the Frame interval (T _ IFS: Inter Frame Space) is 150us, the air time occupied by an acknowledgement packet (ACK) is 44us, and the sub-event interval (T _ MSS: Minimum Subevent Space) is 150 us. Thus, each sub-event takes 884us (540+150+44+ 150). In order to guarantee the basic reliability of wireless transmission, each CIS link needs at least 3 sub-events. Then, the total of 12 CIS links, 10.608ms, are needed for 4 CIS links, exceeding the maximum time that an equal time interval (10ms) can provide. Thus, the BLE Audio technology using existing time division multiplexing cannot address the above-mentioned need for a wireless multi-channel 5.1 surround sound Audio system.

By adopting the wireless multichannel audio transmission method provided by the application, the wireless multichannel audio transmitting device of the 5.1 surround sound audio system can use 4 BLE radio frequency units and 4 antennas, and comprises 4 subset channel audio receiving devices, and each subset channel audio receiving device comprises 1 single-channel audio receiving device, namely a left front loudspeaker, a right front loudspeaker, a left surround loudspeaker and a right surround loudspeaker. A CIG is created between a wireless multi-channel audio transmitting device and 4 subset channel audio receiving devices, and is divided into four CIG subsets, each CIG subset comprises a CIS link which is respectively connected with the 4 subset channel audio receiving devices, namely a left front loudspeaker, a right front loudspeaker, a left surround loudspeaker and a right surround loudspeaker.

Specifically, as shown in fig. 7, for a wireless multichannel 5.1 surround sound audio system CIG timeslot structure employing 4 BLE radio frequency units and 4 antennas, as the sequence numbers of events and sub-events are updated, different BLE radio frequency units and antennas are alternately used by each CIS link for data transmission. Therefore, within the time interval of 10ms and the like, the requirement of at least 3 sub-events of each CIS link can be met by adopting frequency division multiplexing and spatial diversity, and the reliability of wireless transmission is improved through the spatial diversity. Each CIS link may also support more sub-events, further improving the reliability of wireless transmission. However, this approach requires 4 BLE rf units and 4 antennas, and the complexity of the wireless multi-channel audio transmitting device is high.

In order to reduce the complexity of the wireless multichannel audio transmitting device, by using the wireless multichannel audio transmitting method provided by the present application, the wireless multichannel audio transmitting device in the wireless multichannel audio system may further combine time division multiplexing and frequency division multiplexing methods, for example, using 2 BLE radio frequency units and 2 antennas, wherein the wireless multichannel audio system includes two subset channel audio receiving devices. Each subset channel audio receiving device comprises two single-channel audio receiving devices which respectively receive two channels. For example, a set of connecting isochronous stream CIS links is established between the wireless multichannel audio transmitting device and the subset channel audio receiving device using the left front speaker and the right front speaker as a subset channel audio receiving device, including a CIS0 link and a CIS2 link connecting the left front speaker and the right front speaker, respectively, CIS0 and CIS2 forming a subset CIG, and similarly, a set of connecting isochronous stream CIS links is established using the left surround speaker and the right surround speaker as another subset channel audio receiving device, including a CIS1 connecting the left surround speaker and a CIS3 connecting the right surround speaker, and a CIS1 and a CIS3 forming another subset CIG. Thus, each CIS needs 3 sub-events, and each BLE radio frequency unit and two CIS time-division multiplexed on the antenna need 6 sub-events in total, that is, 5.304ms, so that the requirement can be met. Moreover, each CIS may also support more sub-events, i.e., more retransmission times, to further improve the reliability of wireless transmission.

As shown in fig. 8, the structure of a CIG timeslot for a wireless multi-channel 5.1 surround sound audio system using 2 BLE rf units and 2 antennas is shown. Wherein, one CIG is created between the wireless multi-channel audio transmitting device and the 4 audio receiving devices with sub-set channels, and the CIG is divided into two subsets CIG, each subset CIG comprises two CIS links, namely CIS0 link and CIS2 link, CIS1 link and CIS3 link. Within an equal time interval, each CIS contains 3 sub-events, sub-event 0, sub-event 1, and sub-event 2. In sub-event 0 of event0, the CIS0 link and the CIS2 link are time-division multiplexed by the BLE radio unit 0 and the antenna 0, and the CIS1 link and the CIS3 link are time-division multiplexed by the BLE radio unit 1 and the antenna 1. In sub-event 1 of event0, the CIS0 link and the CIS2 link are time-division multiplexed by the BLE radio unit 1 and the antenna 1, and the CIS1 link and the CIS3 link are time-division multiplexed by the BLE radio unit 0 and the antenna 0. Namely, the subset CIG formed by the CIS0 link and the CIS2 link, and the subset CIG formed by the CIS1 link and the CIS3 link are alternately executed on different radio frequency units and antennas through frequency division multiplexing. Through time division multiplexing and frequency division multiplexing, the complexity of the wireless multichannel audio transmitting equipment is properly increased, the requirement of retransmission times of wireless multichannel 5.1 surround sound audio transmission can be met in an equal time interval, and the reliability of wireless transmission is improved through space diversity.

Referring to fig. 9, an electronic device 90 according to an embodiment of the present invention includes a processor 91, a memory 92, and a computer program stored in the memory 92 and capable of running on the processor 91, where the computer program is executed by the processor 91 to implement the processes of the above-mentioned embodiment of the wireless multi-channel audio transmission method, and can achieve the same technical effects, and therefore, the descriptions thereof are omitted here to avoid repetition.

An embodiment of the present invention further provides a computer-readable storage medium, where a computer program is stored on the computer-readable storage medium, and when the computer program is executed by a processor, the computer program implements each process of the above-mentioned embodiment of the wireless multi-channel audio transmission method, and can achieve the same technical effect, and in order to avoid repetition, the detailed description is omitted here. The computer-readable storage medium may be a Read-Only Memory (ROM), a Random Access Memory (RAM), a magnetic disk or an optical disk.

It should be noted that, in this document, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, an element defined by the phrase "comprising an … …" does not exclude the presence of other like elements in a process, method, article, or apparatus that comprises the element.

Through the above description of the embodiments, those skilled in the art will clearly understand that the method of the above embodiments can be implemented by software plus a necessary general hardware platform, and certainly can also be implemented by hardware, but in many cases, the former is a better implementation manner. Based on such understanding, the technical solutions of the present invention may be embodied in the form of a software product, which is stored in a storage medium (such as ROM/RAM, magnetic disk, optical disk) and includes instructions for enabling a terminal (such as a mobile phone, a computer, a server, an air conditioner, or a network device) to execute the method according to the embodiments of the present invention.

It should be understood that the above examples are only for clarity of illustration and are not intended to limit the embodiments. Other variations and modifications will be apparent to persons skilled in the art in light of the above description. And are neither required nor exhaustive of all embodiments. And obvious variations or modifications of this invention are intended to be covered by the scope of the invention as expressed herein.