阅读说明：本技术 音频叠加控制方法、装置及音频设备、系统 (Audio superposition control method and device, audio equipment and system ) 是由 桑耀 许飞 李超 于 2021-04-26 设计创作，主要内容包括：本发明提供了一种音频叠加控制方法、装置及音频设备、系统。该方法包括步骤：主设备在一参考时钟上进行连续且相同时长的参考采样时段的划分,并在主设备与从设备建立蓝牙连接后,主设备向从设备发送主设备划分的参考采样时段的信息；从设备同步参考时钟,并在接收到主设备划分的参考采样时段的信息后,进行与主设备一致的参考采样时段的划分；主设备向从设备发送多路同步音频数据中每一路同步音频数据起始的参考采样时段的信息。本发明有利于降低多路音频数据同步播放时音频数据处理的复杂度。(The invention provides an audio superposition control method and device, audio equipment and an audio system. The method comprises the following steps: the method comprises the steps that the master device divides reference sampling periods which are continuous and have the same duration on a reference clock, and after the master device and the slave device establish Bluetooth connection, the master device sends information of the reference sampling periods divided by the master device to the slave device; the slave device synchronizes a reference clock and divides a reference sampling time period consistent with the master device after receiving the information of the reference sampling time period divided by the master device; the master device sends information of a reference sampling period at the beginning of each path of synchronous audio data in the multiple paths of synchronous audio data to the slave device. The invention is beneficial to reducing the complexity of audio data processing when the multi-channel audio data are synchronously played.)

1. An audio superimposition control method of an audio device including a TWS master device and a TWS slave device, characterized by comprising the steps of:

s10: the TWS master device divides reference sampling periods with continuous and same duration on a reference clock, and after the TWS master device establishes Bluetooth connection with the TWS slave device, the TWS master device sends information of the reference sampling periods divided by the TWS master device to the TWS slave device;

s20: after the TWS slave device establishes Bluetooth connection with the TWS master device, the TWS slave device synchronizes the reference clock, and divides the reference sampling period consistent with the TWS master device after receiving the information of the reference sampling period divided by the TWS master device;

s30: the TWS master device sends information of a reference sampling time period of the start of each path of synchronous audio data in the multi-path synchronous audio data to the TWS slave device, divides each path of synchronous audio data from the reference sampling time period of the start according to a playing sequence, superposes audio data segments corresponding to the same reference sampling time period and different paths, and controls the sampling time of the superposed audio data segments according to the corresponding reference sampling time period, wherein the reference sampling time period divided by the TWS master device and the audio data segments thereof are sequentially in one-to-one correspondence from the reference sampling time period of the start of each path of synchronous audio data;

the TWS slave device divides each path of synchronous audio data in the multi-path synchronous audio data into audio data segments with fixed sampling length from the initial reference sampling period after receiving the initial reference sampling period information, superposes the audio data segments corresponding to the same reference sampling period and different paths of audio data segments according to the playing sequence, and controls the sampling time of the superposed audio data segments according to the corresponding reference sampling period, wherein the reference sampling period divided by the TWS slave device and the audio data segments of the synchronous audio data segments are sequentially in one-to-one correspondence from the initial reference sampling period for each path of synchronous audio data.

2. The method according to claim 1, wherein the step S30 includes:

s301: the TWS master device sends information of a reference sampling period of the start of the first path of synchronous audio data to the TWS slave device, then divides the first path of synchronous audio data into audio data segments with fixed sampling length according to a playing sequence from the reference sampling period of the start of the first path of synchronous audio data, and controls the sampling time of the audio data segments according to the corresponding reference sampling period, wherein the reference sampling period divided by the TWS master device and the audio data segments of the first path of synchronous audio data are in one-to-one correspondence in the dividing sequence from the reference sampling period of the start of the first path of synchronous audio data;

after receiving the information of the reference sampling period started by the first path of synchronous audio data, the TWS slave device divides the audio data segment with the fixed sampling length from the reference sampling period started by the first path of synchronous audio data according to the playing sequence, and controls the sampling time of the audio data segment according to the corresponding reference sampling period, wherein the reference sampling period divided by the TWS slave device and the audio data segment of the first path of synchronous audio data correspond to each other one by one according to the division sequence from the reference sampling period started by the first path of synchronous audio data;

s302: the TWS master device sends information of a reference sampling time period of the start of the second path of synchronous audio data to the TWS slave device, then divides the second path of synchronous audio data into audio data segments with fixed sampling length from the reference sampling time period of the start of the second path of synchronous audio data, carries out audio superposition on the audio data segments of the first path of synchronous audio data and the second path of synchronous audio data corresponding to the same reference sampling time period, and controls the sampling time of the superposed audio data segments according to the corresponding reference sampling time period, wherein the reference sampling time period divided by the TWS master device and the audio data segments of the second path of synchronous audio data are in one-to-one correspondence according to the division sequence from the reference sampling time period of the start of the second path of synchronous audio data;

and after receiving the information of the initial reference sampling period of the second path of synchronous audio data, the TWS slave device divides the second path of synchronous audio data into audio data segments with fixed sampling length from the initial reference sampling period of the second path of synchronous audio data, performs audio superposition on the audio data segments of the first path of synchronous audio data and the second path of synchronous audio data corresponding to the same reference sampling period, and controls the sampling time of the superposed audio data segments according to the corresponding reference sampling period, wherein the TWS slave device divides the reference sampling period into the reference sampling period corresponding to the audio data segments divided by the second path of synchronous audio data one by one in sequence.

3. An audio superimposition control method of a TWS master device, characterized by comprising the steps of:

s110: the TWS master device divides reference sampling periods with continuous and same duration on a reference clock, and after the TWS master device establishes Bluetooth connection with the TWS slave device, the TWS master device sends information of the reference sampling periods divided by the TWS master device to the TWS slave device, so that the TWS slave device adopts the reference sampling periods consistent with the TWS master device;

s120: the TWS master device sends information of a reference sampling time period of the start of each path of synchronous audio data in the multi-path synchronous audio data to the TWS slave device, divides each path of synchronous audio data from the reference sampling time period of the start of the synchronous audio data according to a playing sequence, superposes audio data segments corresponding to the same reference sampling time period and different paths, and controls the sampling time of the superposed audio data segments according to the corresponding reference sampling time period, wherein the reference sampling time period divided by the TWS master device and the audio data segments of the synchronous audio data of each path sequentially correspond to each other one by one from the reference sampling time period of the start of the synchronous audio data of each path.

4. The method according to any one of claims 1-3, wherein in the step S30 or the step S120, the TWS master device controlling the sampling time of the superimposed audio data segments according to the corresponding reference sampling period comprises:

step A: the TWS main equipment pre-estimates the sampling end time of the audio data segment after superposition;

and B: and the TWS main equipment performs audio resampling on the superposed audio data segment according to the time difference between the estimated sampling end time and the end time of the corresponding reference sampling time period so as to reduce the deviation between the actual sampling time period and the reference sampling time period.

5. The method according to claim 4, wherein the TWS master device performs steps A-B once every preset time interval.

6. An audio superposition control method of a TWS slave device, characterized by comprising the steps of:

s210: after the TWS slave device establishes Bluetooth connection with a TWS master device, the TWS slave device synchronizes a reference clock of the TWS master device, and divides a reference sampling period consistent with the TWS master device after receiving the information of the reference sampling period divided on the reference clock by the TWS master device;

s220: for each path of synchronous audio data in the multi-path synchronous audio data, after receiving the information of the initial reference sampling period, the TWS slave device divides the audio data segments with fixed sampling length from the initial reference sampling period according to the playing sequence, superposes the audio data segments corresponding to the same reference sampling period and different paths, and controls the sampling time of the superposed audio data segments according to the corresponding reference sampling period, wherein for each path of synchronous audio data, the reference sampling period divided by the TWS slave device and the audio data segments thereof sequentially correspond one by one according to the division sequence from the initial reference sampling period.

7. The method according to any one of claims 1, 2 and 6, wherein in step S30 or step S220, the TWS slave device controlling the sampling time of the superimposed audio data segments according to the corresponding reference sampling period comprises:

and C: the TWS slave equipment pre-estimates the sampling end time of the audio data segment after superposition;

step D: and the TWS slave equipment performs audio resampling on the superposed audio data segment according to the time difference between the estimated sampling end time and the end time of the corresponding reference sampling time period.

8. The method of claim 7, wherein the TWS slave device performs steps C-D once every preset time interval.

9. The method according to any of claims 1, 2, 6, wherein the audio data sampled by the TWS slave device is muted audio data before receiving the information of the reference sampling periods divided by the TWS master device on the reference clock.

10. An audio superimposition control apparatus of a TWS host device, characterized in that the apparatus comprises:

the first control unit is used for dividing a reference sampling period continuously and in the same time length on a reference clock, and sending information of the divided reference sampling period to the TWS slave device after the TWS master device and the TWS slave device establish Bluetooth connection, so that the TWS slave device adopts the reference sampling period consistent with the TWS master device;

and the second control unit is used for sending information of a reference sampling time period of the start of each path of synchronous audio data in the multiple paths of synchronous audio data to the TWS slave equipment, dividing each path of synchronous audio data from the reference sampling time period of the start of the synchronous audio data into audio data segments with fixed sampling length according to a playing sequence, performing audio superposition on the audio data segments corresponding to the same reference sampling time period and different paths, and controlling the sampling time of the superposed audio data segments according to the corresponding reference sampling time period, wherein for each path of synchronous audio data from the reference sampling time period of the start of the synchronous audio data, the reference sampling time periods divided by the first control unit and the audio data segments of the synchronous audio data are sequentially in one-to-one correspondence according to division.

11. A TWS master device comprising the audio superimposition control apparatus of claim 10.

12. The TWS master device of claim 11, wherein the TWS master device is a master in a pair of Bluetooth headsets or a master in a pair of Bluetooth speakers.

13. An audio superimposition control apparatus of a TWS slave device, characterized in that the apparatus comprises:

the first control unit is used for synchronizing a reference clock of the TWS master device after the TWS slave device establishes Bluetooth connection with the TWS master device, and dividing a reference sampling period consistent with the TWS master device after receiving information of the reference sampling period divided on the reference clock by the TWS master device;

and the second control unit is used for dividing each path of synchronous audio data in the multi-path synchronous audio data into audio data segments with fixed sampling length from the initial reference sampling period after receiving the information of the initial reference sampling period, performing audio superposition on the audio data segments which correspond to the same reference sampling period and are in different paths according to the playing sequence, and controlling the sampling time of the superposed audio data segments according to the corresponding reference sampling period, wherein for each path of synchronous audio data, the reference sampling period divided by the first control unit and the audio data segments thereof sequentially correspond one to one according to the division sequence from the initial reference sampling period.

14. A TWS slave device comprising the audio superimposition control apparatus of claim 13.

15. A TWS slave device according to claim 14, characterized in that the TWS slave device is a slave in a pair of bluetooth headsets or a slave in a pair of bluetooth stereos.

16. An audio device comprising a TWS master device and a TWS slave device, the TWS master device being a TWS master device as claimed in claim 11 or 12; the TWS slave device is a TWS slave device according to claim 14 or 15.

17. An audio system, comprising:

the audio device of claim 16;

and the Bluetooth sound source equipment is used for providing audio data for the audio equipment.

18. A readable storage medium, characterized in that the readable storage medium has stored thereon a computer program which, when being executed by a processor, carries out the method according to any one of claims 1-9.

Technical Field

The invention relates to the technical field of TWS audio, in particular to an audio superposition control method and device, audio equipment and an audio system.

Background

With the development of wireless communication technology, intelligent and wireless products have been deeply developed into people's daily life, wherein, a TWS audio device is an extension of a smart device, and has been rapidly developed in recent years, the current TWS audio device generally includes a TWS master device and a TWS slave device, and the TWS master device and the TWS slave device generally need to perform synchronous processing on audio signals in order to realize audio synchronous playing of the TWS master device and the TWS slave device.

In the existing audio synchronization mode, the TWS master device is required to estimate the playing time of a certain audio frequency point at intervals in the future, and then the estimated playing time is sent to the TWS slave device, and the TWS slave device performs corresponding audio playing adjustment after receiving the information, so as to realize audio synchronization playing between the two devices.

Disclosure of Invention

Based on the above situation, the present invention is directed to provide an audio overlay control method, an audio overlay control device, an audio device, and an audio system, which are beneficial to reducing the complexity of audio data processing when multiple paths of audio data are played synchronously.

In order to achieve the above object, an embodiment of the present invention provides an audio superposition control method for an audio device, where the audio device includes a TWS master device and a TWS slave device, and the method includes:

s10: the TWS master device divides reference sampling periods with continuous and same duration on a reference clock, and after the TWS master device establishes Bluetooth connection with the TWS slave device, the TWS master device sends information of the reference sampling periods divided by the TWS master device to the TWS slave device;

s20: after the TWS slave device establishes Bluetooth connection with the TWS master device, the TWS slave device synchronizes the reference clock, and divides the reference sampling period consistent with the TWS master device after receiving the information of the reference sampling period divided by the TWS master device;

s30: the TWS master device sends information of a reference sampling time period of the start of each path of synchronous audio data in the multi-path synchronous audio data to the TWS slave device, divides each path of synchronous audio data from the reference sampling time period of the start according to a playing sequence, superposes audio data segments corresponding to the same reference sampling time period and different paths, and controls the sampling time of the superposed audio data segments according to the corresponding reference sampling time period, wherein the reference sampling time period divided by the TWS master device and the audio data segments thereof are sequentially in one-to-one correspondence from the reference sampling time period of the start of each path of synchronous audio data;

the TWS slave device divides each path of synchronous audio data in the multi-path synchronous audio data into audio data segments with fixed sampling length from the initial reference sampling period after receiving the initial reference sampling period information, superposes the audio data segments corresponding to the same reference sampling period and different paths of audio data segments according to the playing sequence, and controls the sampling time of the superposed audio data segments according to the corresponding reference sampling period, wherein the reference sampling period divided by the TWS slave device and the audio data segments of the synchronous audio data segments are sequentially in one-to-one correspondence from the initial reference sampling period for each path of synchronous audio data.

Further, the step S30 includes:

s301: the TWS master device sends information of a reference sampling period of the start of the first path of synchronous audio data to the TWS slave device, then divides the first path of synchronous audio data into audio data segments with fixed sampling length according to a playing sequence from the reference sampling period of the start of the first path of synchronous audio data, and controls the sampling time of the audio data segments according to the corresponding reference sampling period, wherein the reference sampling period divided by the TWS master device and the audio data segments of the first path of synchronous audio data are in one-to-one correspondence in the dividing sequence from the reference sampling period of the start of the first path of synchronous audio data;

after receiving the information of the reference sampling period started by the first path of synchronous audio data, the TWS slave device divides the audio data segment with the fixed sampling length from the reference sampling period started by the first path of synchronous audio data according to the playing sequence, and controls the sampling time of the audio data segment according to the corresponding reference sampling period, wherein the reference sampling period divided by the TWS slave device and the audio data segment of the first path of synchronous audio data correspond to each other one by one according to the division sequence from the reference sampling period started by the first path of synchronous audio data;

s302: the TWS master device sends information of a reference sampling time period of the start of the second path of synchronous audio data to the TWS slave device, then divides the second path of synchronous audio data into audio data segments with fixed sampling length from the reference sampling time period of the start of the second path of synchronous audio data, carries out audio superposition on the audio data segments of the first path of synchronous audio data and the second path of synchronous audio data corresponding to the same reference sampling time period, and controls the sampling time of the superposed audio data segments according to the corresponding reference sampling time period, wherein the reference sampling time period divided by the TWS master device and the audio data segments of the second path of synchronous audio data are in one-to-one correspondence according to the division sequence from the reference sampling time period of the start of the second path of synchronous audio data;

and after receiving the information of the initial reference sampling period of the second path of synchronous audio data, the TWS slave device divides the second path of synchronous audio data into audio data segments with fixed sampling length from the initial reference sampling period of the second path of synchronous audio data, performs audio superposition on the audio data segments of the first path of synchronous audio data and the second path of synchronous audio data corresponding to the same reference sampling period, and controls the sampling time of the superposed audio data segments according to the corresponding reference sampling period, wherein the TWS slave device divides the reference sampling period into the reference sampling period corresponding to the audio data segments divided by the second path of synchronous audio data one by one in sequence.

In order to achieve the above object, the technical solution of the present invention further provides an audio superposition control method for a TWS master device, including:

s110: the TWS master device divides reference sampling periods with continuous and same duration on a reference clock, and after the TWS master device establishes Bluetooth connection with the TWS slave device, the TWS master device sends information of the reference sampling periods divided by the TWS master device to the TWS slave device, so that the TWS slave device adopts the reference sampling periods consistent with the TWS master device;

s120: the TWS master device sends information of a reference sampling time period of the start of each path of synchronous audio data in the multi-path synchronous audio data to the TWS slave device, divides each path of synchronous audio data from the reference sampling time period of the start of the synchronous audio data according to a playing sequence, superposes audio data segments corresponding to the same reference sampling time period and different paths, and controls the sampling time of the superposed audio data segments according to the corresponding reference sampling time period, wherein the reference sampling time period divided by the TWS master device and the audio data segments of the synchronous audio data of each path sequentially correspond to each other one by one from the reference sampling time period of the start of the synchronous audio data of each path.

Further, in the step S30 or the step S120, the controlling, by the TWS master device, the sampling time of the superimposed audio data segment according to the corresponding reference sampling period includes:

step A: the TWS main equipment pre-estimates the sampling end time of the audio data segment after superposition;

and B: the TWS main equipment performs audio resampling on the superposed audio data segment according to the time difference between the estimated sampling end time and the end time of the corresponding reference sampling time period so as to reduce the deviation between the actual sampling time period and the reference sampling time period;

further, the TWS master performs steps a-B once every preset time interval.

In order to achieve the above object, the technical solution of the present invention further provides an audio superposition control method for a TWS slave device, including:

s210: after the TWS slave device establishes Bluetooth connection with a TWS master device, the TWS slave device synchronizes a reference clock of the TWS master device, and divides a reference sampling period consistent with the TWS master device after receiving the information of the reference sampling period divided on the reference clock by the TWS master device;

s220: for each path of synchronous audio data in the multi-path synchronous audio data, after receiving the information of the initial reference sampling period, the TWS slave device divides the audio data segments with fixed sampling length from the initial reference sampling period according to the playing sequence, superposes the audio data segments corresponding to the same reference sampling period and different paths, and controls the sampling time of the superposed audio data segments according to the corresponding reference sampling period, wherein for each path of synchronous audio data, the reference sampling period divided by the TWS slave device and the audio data segments thereof sequentially correspond one by one according to the division sequence from the initial reference sampling period.

Further, in the step S30 or the step S220, the controlling, by the TWS slave device, the sampling time of the superimposed audio data segment according to the corresponding reference sampling period includes:

and C: the TWS slave equipment pre-estimates the sampling end time of the audio data segment after superposition;

step D: the TWS slave equipment performs audio resampling on the superposed audio data segment according to the time difference between the estimated sampling end time and the end time of the corresponding reference sampling time period;

further, the TWS slave device performs steps C-D once every preset time interval.

Further, the audio data sampled by the TWS slave device is mute audio data before receiving the information of the reference sampling period divided by the TWS master device on the reference clock.

In order to achieve the above object, an embodiment of the present invention further provides an audio superimposition control apparatus for a TWS host device, including:

the first control unit is used for dividing a reference sampling period continuously and in the same time length on a reference clock, and sending information of the divided reference sampling period to the TWS slave device after the TWS master device and the TWS slave device establish Bluetooth connection, so that the TWS slave device adopts the reference sampling period consistent with the TWS master device;

and the second control unit is used for sending information of a reference sampling time period of the start of each path of synchronous audio data in the multiple paths of synchronous audio data to the TWS slave equipment, dividing each path of synchronous audio data from the reference sampling time period of the start of the synchronous audio data into audio data segments with fixed sampling length according to a playing sequence, performing audio superposition on the audio data segments corresponding to the same reference sampling time period and different paths, and controlling the sampling time of the superposed audio data segments according to the corresponding reference sampling time period, wherein for each path of synchronous audio data from the reference sampling time period of the start of the synchronous audio data, the reference sampling time periods divided by the first control unit and the audio data segments of the synchronous audio data are sequentially in one-to-one correspondence according to division.

In order to achieve the above object, the technical solution of the present invention further provides a TWS master device, including the above audio superimposition control apparatus.

Further, the TWS master device is a master earphone in the paired Bluetooth earphones, or a master stereo in the paired Bluetooth stereo.

In order to achieve the above object, an embodiment of the present invention further provides an audio superposition control apparatus for a TWS slave device, including:

the first control unit is used for synchronizing a reference clock of the TWS master device after the TWS slave device establishes Bluetooth connection with the TWS master device, and dividing a reference sampling period consistent with the TWS master device after receiving information of the reference sampling period divided on the reference clock by the TWS master device;

and the second control unit is used for dividing each path of synchronous audio data in the multi-path synchronous audio data into audio data segments with fixed sampling length from the initial reference sampling period after receiving the information of the initial reference sampling period, performing audio superposition on the audio data segments which correspond to the same reference sampling period and are in different paths according to the playing sequence, and controlling the sampling time of the superposed audio data segments according to the corresponding reference sampling period, wherein for each path of synchronous audio data, the reference sampling period divided by the first control unit and the audio data segments thereof sequentially correspond one to one according to the division sequence from the initial reference sampling period.

In order to achieve the above object, the technical solution of the present invention further provides a TWS slave device, including the above audio superimposition control apparatus.

Further, the TWS slave device is a slave in a pair of bluetooth headsets or a slave in a pair of bluetooth speakers.

In order to achieve the above object, the present invention further provides an audio device, including the TWS master device and the TWS slave device.

In order to achieve the above object, the present invention further provides an audio system, including:

the audio device described above;

and the Bluetooth sound source equipment is used for providing audio data for the audio equipment.

In order to achieve the above object, the present invention further provides a readable storage medium, where a computer program is stored, and when the computer program is executed by a processor, the computer program implements any one of the above audio superimposition control methods.

The audio superposition control method provided by the invention comprises the steps that a TWS master device sets a division rule of a reference sampling time interval and sends the division rule to a TWS slave device, so that the TWS slave device adopts the reference sampling time interval consistent with the TWS master device, when the synchronous playing of multi-path synchronous audio data is carried out, the TWS master device and the TWS slave device carry out the division of audio data segments with fixed sampling length on each path of synchronous audio data from the initial reference sampling time interval and according to the playing sequence, and carry out audio superposition on the audio data segments which correspond to the same reference sampling time interval and are different paths, and then control the sampling time of the audio data segments after the superposition according to the corresponding reference sampling time interval, thereby not only reducing the complexity of audio data processing when the multi-path audio data are synchronously played, but also reducing the interaction times required by the TWS master device and the TWS slave device due to the audio synchronization, the method reduces the occupation of bandwidth, is favorable for quickly realizing audio synchronization between the TWS master device and the TWS slave device, and can output the synchronized audio with smaller deviation when the TWS master device and the TWS slave device start audio synchronization.

Drawings

Preferred embodiments of the present invention will be described below with reference to the accompanying drawings. In the figure:

fig. 1 is a flowchart of an audio superimposition control method according to the present invention;

fig. 2, 3 and 4 are schematic diagrams of an audio data segment and a reference sampling period provided by an embodiment of the present invention.

Detailed Description

The present invention will be described below based on examples, but the present invention is not limited to only these examples. In the following detailed description of the present invention, certain specific details are set forth in order to avoid obscuring the nature of the present invention, well-known methods, procedures, and components have not been described in detail.

Further, those of ordinary skill in the art will appreciate that the drawings provided herein are for illustrative purposes and are not necessarily drawn to scale.

Unless the context clearly requires otherwise, throughout the description and the claims, the words "comprise", "comprising", and the like are to be construed in an inclusive sense as opposed to an exclusive or exhaustive sense; that is, what is meant is "including, but not limited to".

In the description of the present invention, it is to be understood that the terms "first," "second," and the like are used for descriptive purposes only and are not to be construed as indicating or implying relative importance. In addition, in the description of the present invention, "a plurality" means two or more unless otherwise specified.

Referring to fig. 1, fig. 1 is a flowchart of an audio superposition control method for an audio device according to an embodiment of the present invention, where the audio device includes a TWS master device and a TWS slave device, and the method includes:

s10: the TWS master device divides reference sampling periods with continuous and same duration on a reference clock, and after the TWS master device establishes Bluetooth connection with the TWS slave device, the TWS master device sends information of the reference sampling periods divided by the TWS master device to the TWS slave device;

the reference clock may be a local clock of the TWS master device, or a local clock of a bluetooth sound source device that establishes a bluetooth connection with the TWS master device, and the TWS master device may use the reference clock as a TWS network clock between itself and the TWS slave device;

for example, the TWS master device may divide the reference sampling period from the initial sampling time T0 after itself is turned on, that is, the first audio data segment as a sampling object corresponds to the reference sampling period (T0, T0+ Δ T), the second audio data segment as a sampling object corresponds to the reference sampling period (T0+ Δ T, T0+ Δ T2), and the third audio data segment as a sampling object corresponds to the reference sampling period (T0+ Δ T2, T0+ Δ T3) … …;

where Δ t is a preset value, which is a duration of each reference sampling period, and a sampling duration of each fixed-sampling-length audio data segment at a preset sampling rate (an audio sampling rate used by the TWS master device and the TWS slave device), for example, taking a sampling rate of 48k as an example, if Δ t is 2ms, each fixed-sampling-length audio data segment contains 96 sample data;

in the embodiment of the present invention, the magnitude of Δ t may be set as required, and it can be understood that the larger Δ t is, the larger the delay time is;

preferably, Δ t may be less than the sampling duration of audio data in a standard bluetooth audio packet, for example, Δ t may be any value between 2ms and 5ms, for example, 2.9 ms;

the information of the reference sampling period divided by the TWS master device to the TWS slave device may be information of any reference sampling period, for example, the information may be a start time and/or an end time of a reference sampling period, and since the reference sampling period is continuously divided and a duration Δ t of each reference sampling period is fixed (Δ t may be preset in the TWS slave device), after the TWS slave device obtains the start time and/or the end time of any reference sampling period divided by the TWS master device, the TWS slave device can know the information of each reference sampling period, so that the TWS master device does not need to send the information of each reference sampling period to the TWS slave device;

s20: after the TWS slave device establishes Bluetooth connection with the TWS master device, the TWS slave device synchronizes the reference clock, and divides the reference sampling period consistent with the TWS master device after receiving the information of the reference sampling period divided by the TWS master device;

it is understood that the sample length (or data size) of each audio data segment divided by the TWS slave device is the same as that of each audio data segment divided by the TWS master device;

s30: the TWS master device sends information of a reference sampling time period of the start of each path of synchronous audio data in the multi-path synchronous audio data to the TWS slave device, divides each path of synchronous audio data from the reference sampling time period of the start according to a playing sequence, superposes audio data segments corresponding to the same reference sampling time period and different paths, and controls the sampling time of the superposed audio data segments according to the corresponding reference sampling time period, wherein the reference sampling time period divided by the TWS master device and the audio data segments thereof are sequentially in one-to-one correspondence from the reference sampling time period of the start of each path of synchronous audio data;

for the TWS master device, the multiple paths of synchronous audio data may include one path of synchronous audio data from its own local site and one path of synchronous audio data from the bluetooth sound source device, and when there are audio data segments corresponding to the same reference sampling period and different paths, the TWS master device performs audio superposition on the audio data segments corresponding to the same reference sampling period and different paths to obtain an audio data segment as a sampling object, and the audio data segment is still the fixed sampling length mentioned above

For each path of synchronous audio data in the multi-path synchronous audio data, after receiving information of an initial reference sampling period of the TWS slave device, the TWS slave device divides the audio data segments with fixed sampling length from the initial reference sampling period according to a playing sequence, superposes audio data segments corresponding to the same reference sampling period and different paths, and controls the sampling time of the superposed audio data segments according to the corresponding reference sampling period, wherein for each path of synchronous audio data, the reference sampling period divided by the TWS slave device and the audio data segments thereof sequentially correspond one by one according to division;

it can be understood that, for the TWS slave device, the multiple paths of synchronous audio data may include one path of synchronous audio data from its own local area and one path of synchronous audio data from the bluetooth sound source device or the TWS master device, and when there are audio data segments corresponding to the same reference sampling period and different paths, the TWS slave device performs audio superposition on the audio data segments corresponding to the same reference sampling period and different paths to obtain an audio data segment as a sampling object, and the audio data segment is still the fixed sampling length.

After the TWS master device and the TWS slave device control the playing of the audio data segments by using the same reference sampling period, the TWS master device and the TWS slave device may start to sample the same synchronous audio data from the same reference sampling period, in this case, for each path of synchronous audio data, since the synchronous audio data is the same, the first audio data segments divided from the synchronous audio data by the TWS master device and the TWS slave device are the same and the corresponding reference sampling periods are also the same, and the divided second audio data segments are the same and the corresponding reference sampling periods are also the same … …, so that the TWS master device and the TWS slave device can respectively superimpose audio data segments playing at the same time in different paths, thereby realizing the superimposed audio synchronous playing.

The audio superposition control method provided by the embodiment of the invention comprises the steps that a TWS master device sets a division rule of a reference sampling time interval and sends the division rule to a TWS slave device, so that the TWS slave device adopts the reference sampling time interval consistent with the TWS master device, when multi-path synchronous audio data are synchronously played, the TWS master device and the TWS slave device divide audio data segments with fixed sampling length from the initial reference sampling time interval of each path of synchronous audio data according to the playing sequence, audio superposition is carried out on the audio data segments which correspond to the same reference sampling time interval and different paths, and the sampling time of the audio data segments after superposition is controlled according to the corresponding reference sampling time interval, thereby not only reducing the complexity of audio data processing when the multi-path audio data are synchronously played, but also reducing the interaction times required by the TWS master device and the TWS slave device due to audio synchronization, the method reduces the occupation of bandwidth, is favorable for quickly realizing audio synchronization between the TWS master device and the TWS slave device, and can output the synchronized audio with smaller deviation when the TWS master device and the TWS slave device start audio synchronization.

For example, in the embodiment of the present invention, both the TWS master device and the TWS slave device may implement, through a superposition cache with a fixed storage space size, division of an audio data segment with a fixed sampling length for each path of synchronous audio data, and audio superposition for audio data segments corresponding to the same reference sampling period and different paths, where the storage space size of the superposition cache is the same as the data size of the audio data segment with the fixed sampling length;

the TWS master device and the TWS slave device start to write the audio data segments with fixed sampling length into the superposition cache according to the initial reference sampling time period of each path of synchronous audio data, audio superposition is carried out on the audio data segments which correspond to the same reference sampling time period and are in different paths through the superposition cache, and then after the audio data segments in the superposition cache are sampled, the audio data segments with the next fixed sampling length of each synchronous audio data are written into the superposition cache.

For example, in the embodiment of the present invention, the TWS master device and the TWS slave device may implement division of reference sampling periods of consecutive and same duration by using counters, where in the TWS master device, a sampling number may be recorded by using the counters, and when audio sampling is performed on a first audio data segment as a sampling object, a count value (representing the sampling number) of the counters is 1, which corresponds to the reference sampling period (T0, T0+ Δ T), and then, each time audio sampling is completed on an audio data segment as the sampling object in the TWS master device, a count value of the counters of the TWS master device is incremented by 1, so that when audio sampling is performed on an nth audio data segment as the sampling object, the count value (representing the sampling number) of the counters is N, which corresponds to the reference sampling period (T0+ Δ T (N-1), T0+ Δ T N);

for the TWS slave device, the T0 and the current count value of the counter may be obtained after receiving the information of the reference sampling period of the TWS master device, then the counter of the TWS slave device is set according to the obtained information, and then, every time when an audio data segment as a sampling object in the TWS slave device completes audio sampling, the count value of the counter of the TWS slave device performs an operation of adding 1, and the TWS slave device may obtain the reference sampling period of the audio data segment as the sampling object by the current count value of the counter, and obtain the same reference sampling period as the TWS slave device.

For example, in one embodiment, the step S30 includes:

s301: the TWS master device sends information of a reference sampling period of the start of the first path of synchronous audio data to the TWS slave device, then divides the first path of synchronous audio data into audio data segments with fixed sampling length according to a playing sequence from the reference sampling period of the start of the first path of synchronous audio data, and controls the sampling time of the audio data segments according to the corresponding reference sampling period, wherein the reference sampling period divided by the TWS master device and the audio data segments of the first path of synchronous audio data are in one-to-one correspondence in the dividing sequence from the reference sampling period of the start of the first path of synchronous audio data;

after receiving the information of the reference sampling period started by the first path of synchronous audio data, the TWS slave device divides the audio data segment with the fixed sampling length from the reference sampling period started by the first path of synchronous audio data according to the playing sequence, and controls the sampling time of the audio data segment according to the corresponding reference sampling period, wherein the reference sampling period divided by the TWS slave device and the audio data segment of the first path of synchronous audio data correspond to each other one by one according to the division sequence from the reference sampling period started by the first path of synchronous audio data;

s302: the TWS master device sends information of a reference sampling time period of the start of the second path of synchronous audio data to the TWS slave device, then divides the second path of synchronous audio data into audio data segments with fixed sampling length from the reference sampling time period of the start of the second path of synchronous audio data, carries out audio superposition on the audio data segments of the first path of synchronous audio data and the second path of synchronous audio data corresponding to the same reference sampling time period, and controls the sampling time of the superposed audio data segments according to the corresponding reference sampling time period, wherein the reference sampling time period divided by the TWS master device and the audio data segments of the second path of synchronous audio data are in one-to-one correspondence according to the division sequence from the reference sampling time period of the start of the second path of synchronous audio data;

and after receiving the information of the initial reference sampling period of the second path of synchronous audio data, the TWS slave device divides the second path of synchronous audio data into audio data segments with fixed sampling length from the initial reference sampling period of the second path of synchronous audio data, performs audio superposition on the audio data segments of the first path of synchronous audio data and the second path of synchronous audio data corresponding to the same reference sampling period, and controls the sampling time of the superposed audio data segments according to the corresponding reference sampling period, wherein the TWS slave device divides the reference sampling period into the reference sampling period corresponding to the audio data segments divided by the second path of synchronous audio data one by one in sequence.

For example, the first channel of synchronized audio data may be from a bluetooth sound source device, and the second channel of synchronized audio data may be from a local audio file of a TWS master device, i.e. for the TWS master device, the second channel of synchronized audio data is from a local audio file of the TWS master device, i.e. for the TWS slave device, the second channel of synchronized audio data is from a local audio file of the TWS slave device, and the local audio files of the TWS master device and the TWS slave device are the same.

For example, in an embodiment, in step S30, the TWS master device controlling the sampling time of the superimposed audio data segment according to the corresponding reference sampling period includes:

step A: the TWS main equipment pre-estimates the sampling end time of the audio data segment after superposition;

for example, the TWS host apparatus may estimate the sampling end time of the audio data segment currently being a sampling object based on the actual sampling end time of the last audio data segment currently being a sampling object, or the TWS host apparatus may estimate the sampling end time of the audio data segment currently being a sampling object based on the current sampling condition information (including, for example, the actual sampling start time of the audio data segment, the current time, and the sampled data amount of the audio data segment at the current time) of the audio data segment currently being a sampling object;

and B: the TWS main equipment performs audio resampling on the superposed audio data segment according to the time difference between the estimated sampling end time and the end time of the corresponding reference sampling time period so as to reduce the deviation between the actual sampling time period and the reference sampling time period;

specifically, if the estimated sampling end time exceeds the end time of the reference sampling period corresponding to the audio data segment, the TWS master device may compress the audio data segment in a resampling manner (e.g., reduce the number of sampling points in the audio data segment), where the compression amount may be determined by a time difference between the two;

if the estimated sampling end time does not exceed the end time of the reference sampling period corresponding to the audio data segment, the TWS-capable master device stretches the audio data segment in a resampling manner (for example, increases the number of sampling points in the audio data segment), and the stretching amount may be determined by a time difference between the two.

Preferably, in the embodiment of the present invention, the TWS host device may perform the step a-B once at preset time intervals, that is, the TWS host device does not need to perform audio resampling on each audio data segment as a sampling object according to its corresponding reference sampling period, and may perform the step a-B once at intervals of multiple audio data segments, so as to reduce the operation load of the TWS host device.

For example, in an embodiment, in step S30, the controlling, by the TWS slave device, the sampling time of the superimposed audio data segment according to the corresponding reference sampling period includes:

and C: the TWS slave equipment pre-estimates the sampling end time of the audio data segment after superposition;

for example, the TWS slave device may estimate the sampling end time of the audio data segment currently being the sampling object according to the actual sampling end time of the last audio data segment currently being the sampling object, or the TWS slave device may estimate the sampling end time of the audio data segment currently being the sampling object according to the current sampling condition information (including the actual sampling start time of the audio data segment, the current time, and the sampled data amount of the audio data segment at the current time, for example) of the audio data segment currently being the sampling object;

step D: the TWS slave equipment performs audio resampling on the superposed audio data segment according to the time difference between the estimated sampling end time and the end time of the corresponding reference sampling time period;

specifically, if the estimated sampling end time exceeds the end time of the reference sampling period corresponding to the audio data segment, the TWS slave device may compress the audio data segment in a resampling manner (e.g., reduce the number of sampling points in the audio data segment), where the compression amount may be determined by a time difference between the two;

if the estimated sampling end time does not exceed the end time of the reference sampling period corresponding to the audio data segment, the TWS slave device may stretch the audio data segment in a resampling manner (e.g., increase the number of sampling points in the audio data segment), and the stretching amount may be determined by a time difference between the two.

Preferably, in the embodiment of the present invention, the TWS slave device may perform the step C-D once at preset time intervals, that is, the TWS slave device does not need to perform audio resampling on each audio data segment as a sampling object according to its corresponding reference sampling period, and may perform the step C-D once at intervals of multiple audio data segments, so as to reduce the operation load of the TWS slave device.

Preferably, for the TWS slave device, before receiving the information of the reference sampling period divided by the TWS master device on the reference clock, the audio data sampled by the TWS slave device is mute audio data (i.e. play mute audio) to improve the user experience.

After the TWS slave device and the TWS master device establish Bluetooth connection, audio data segments for realizing mute playing can be generated firstly, the sampling length of each audio data segment for realizing mute playing is still the fixed sampling length, the TWS slave device can perform audio sampling on the audio data segment for realizing mute playing to realize mute playing, after receiving information of reference sampling time segments divided by the TWS master device, the TWS slave device can determine the reference sampling time segment at the current time according to the information, then estimate the sampling end time of the audio data segment (the audio data segment for realizing mute playing) which is currently used as a sampling object, and perform audio resampling on the audio data segment according to the time difference between the estimated sampling end time and the end time of the reference sampling time segment at the current time, so that the TWS slave device starts to control the sampling time of the audio data segments according to the reference sampling time segments divided by the TWS master device, and after receiving the information of the reference sampling period of the start of the synchronous audio data sent by the TWS master device, the TWS slave device starts audio sampling of the synchronous audio data from the reference sampling period of the start of the synchronous audio data.

As shown in fig. 2, Q1, Q2, Q3, Q4, and Q5 are 5 audio data segments sequentially divided by the TWS host device according to the playing order, the reference sampling period corresponding to Q1 is a period from clock 1 to clock 2, the reference sampling period corresponding to Q2 is a period from clock 2 to clock 3, the reference sampling period corresponding to Q3 is a period from clock 3 to clock 4, the reference sampling period corresponding to Q4 is a period from clock 4 to clock 5, the reference sampling period corresponding to Q5 is a period from clock 5 to clock 6, and the sampling time of each audio data segment of the TWS host device is controlled according to the reference sampling period, so that each audio data segment of the TWS host device can be sampled substantially within the corresponding reference sampling period;

p1, P2, P3, P4 and P5 are 5 audio data segments sequentially divided by the TWS slave device according to the playing sequence, as shown in fig. 2, if the TWS slave device does not adopt the reference sampling period divided by the TWS master device, it can be seen that there is a large time deviation between the actual playing period of each audio data segment of the TWS slave device and the TWS master device;

after receiving the information of the reference sampling period divided by the TWS master device, the TWS slave device may determine the reference sampling period (i.e. the reference sampling period divided by the TWS master device and corresponding to the audio data segment currently being the sampling object) in which the current time is located according to the information, and then perform audio resampling on the audio data segment currently being the sampling object according to the reference sampling period to reduce the deviation between the actual sampling period of the next audio data segment and the reference sampling period, so that the actual sampling periods of the audio data segment of the TWS slave device and the audio data segment of the TWS master device can substantially coincide with each other, for example, referring to fig. 3, when sampling an audio data segment P2, the TWS slave device performs audio resampling according to the corresponding reference sampling period (i.e. the period in which the clock 2 to clock 3 are located), so that the actual sampling periods of the subsequent Q3 and P3 can substantially coincide with each other (both in the period in which the clock 3 to clock 4 are located) ) The actual sampling periods of Q4 and P4 can be substantially coincident (both at the time of clock 4 to clock 5), the actual sampling periods of Q5 and P5 can be substantially coincident (both at the time of clock 5 to clock 6), … …;

thereafter, as shown in fig. 4, for the first path of synchronized audio data (decode 0), the TWS master device and the TWS slave device each start dividing the audio data segment with a fixed sample length from the time period where the clock n to the clock n +1 exist, resulting in K1, K2, K3, K4, K5, respectively, that is, for both the TWS master device and the TWS slave device: the reference sampling period corresponding to the audio data segment K1 is the period from the clock n to the clock n +1, and the reference sampling period corresponding to the audio data segment K2 is the period from the clock n +1 to the clock n +2, … …, so that the TWS slave device and the TWS master device can synchronously play on the first path of synchronous audio data;

for the second way of synchronous audio data (decoding 1), the TWS master device and the TWS slave device may each divide the audio data segment with a fixed sample length from the time period where the clock n +1 to the clock n +2 are located, to obtain H1, H2, H3, and H4, respectively, that is, for both the TWS master device and the TWS slave device: the reference sampling period corresponding to the audio data segment H1 is a period where the clock n +1 is located to the clock n +2, the reference sampling period corresponding to the audio data segment H2 is a period … … where the clock n +2 is located to the clock n +3, and the TWS master device and the TWS slave device perform audio superposition on audio data segments corresponding to the same reference sampling period and different paths, that is, both perform the following operations: the audio overlap sampling and playing are carried out on the K2 and the H1, and then the audio overlap sampling and playing are carried out on the K3 and the H2, … …, so that the multi-channel audio synchronous overlap playing between the TWS slave device and the TWS master device is realized, and in the multi-channel audio synchronous overlap playing process, the deviation between the actual sampling period and the reference sampling period of the audio data segment can be gradually increased along with the prolonging of time, therefore, the TWS master device and the TWS slave device can also carry out a calibration operation (namely, the audio resampling is carried out on the audio data segment which is currently taken as a sampling object according to the corresponding reference sampling period) at preset intervals so as to reduce the deviation.

The embodiment of the invention also provides an audio superposition control method of the TWS main equipment, which comprises the following steps:

s110: the TWS master device divides reference sampling periods with continuous and same duration on a reference clock, and after the TWS master device establishes Bluetooth connection with the TWS slave device, the TWS master device sends information of the reference sampling periods divided by the TWS master device to the TWS slave device, so that the TWS slave device adopts the reference sampling periods consistent with the TWS master device;

s120: the TWS master device sends information of a reference sampling time period of the start of each path of synchronous audio data in the multi-path synchronous audio data to the TWS slave device, divides each path of synchronous audio data from the reference sampling time period of the start of the synchronous audio data according to a playing sequence, superposes audio data segments corresponding to the same reference sampling time period and different paths, and controls the sampling time of the superposed audio data segments according to the corresponding reference sampling time period, wherein the reference sampling time period divided by the TWS master device and the audio data segments of the synchronous audio data of each path sequentially correspond to each other one by one from the reference sampling time period of the start of the synchronous audio data of each path.

Preferably, in an embodiment, in step S120, the TWS master device controlling the sampling time of the superimposed audio data segment according to the corresponding reference sampling period includes:

step A: the TWS main equipment pre-estimates the sampling end time of the audio data segment after superposition;

and B: the TWS main equipment performs audio resampling on the superposed audio data segment according to the time difference between the estimated sampling end time and the end time of the corresponding reference sampling time period so as to reduce the deviation between the actual sampling time period and the reference sampling time period;

the specific manner of step a-B in step S120 may be the same as that of step a-B in step S30, and is not described herein again;

preferably, in an embodiment, the TWS master performs steps a-B once every preset time interval.

The embodiment of the invention also provides an audio superposition control method of the TWS slave equipment, which comprises the following steps:

s210: after the TWS slave device establishes Bluetooth connection with a TWS master device, the TWS slave device synchronizes a reference clock of the TWS master device, and divides a reference sampling period consistent with the TWS master device after receiving the information of the reference sampling period divided on the reference clock by the TWS master device;

s220: for each path of synchronous audio data in the multi-path synchronous audio data, after receiving the information of the initial reference sampling period, the TWS slave device divides the audio data segments with fixed sampling length from the initial reference sampling period according to the playing sequence, superposes the audio data segments corresponding to the same reference sampling period and different paths, and controls the sampling time of the superposed audio data segments according to the corresponding reference sampling period, wherein for each path of synchronous audio data, the reference sampling period divided by the TWS slave device and the audio data segments thereof sequentially correspond one by one according to the division sequence from the initial reference sampling period.

Preferably, in an embodiment, in step S220, the controlling, by the TWS slave device, the sampling time of the superimposed audio data segment according to the corresponding reference sampling period includes:

and C: the TWS slave equipment pre-estimates the sampling end time of the audio data segment after superposition;

step D: the TWS slave equipment performs audio resampling on the superposed audio data segment according to the time difference between the estimated sampling end time and the end time of the corresponding reference sampling time period;

the specific manner of the step C-D in the step S220 may be the same as that of the step C-D in the step S30, and is not described herein again;

preferably, in an embodiment, the TWS slave device performs steps C-D once every preset time interval.

Preferably, in an embodiment, the audio data sampled by the TWS slave device is mute audio data before receiving the information of the reference sampling period divided by the TWS master device on the reference clock.

The embodiment of the invention also provides an audio superposition control device of the TWS main equipment, which comprises the following components:

the first control unit is used for dividing a reference sampling period continuously and in the same time length on a reference clock, and sending information of the divided reference sampling period to the TWS slave device after the TWS master device and the TWS slave device establish Bluetooth connection, so that the TWS slave device adopts the reference sampling period consistent with the TWS master device;

and the second control unit is used for sending information of a reference sampling time period of the start of each path of synchronous audio data in the multiple paths of synchronous audio data to the TWS slave equipment, dividing each path of synchronous audio data from the reference sampling time period of the start of the synchronous audio data into audio data segments with fixed sampling length according to a playing sequence, performing audio superposition on the audio data segments corresponding to the same reference sampling time period and different paths, and controlling the sampling time of the superposed audio data segments according to the corresponding reference sampling time period, wherein for each path of synchronous audio data from the reference sampling time period of the start of the synchronous audio data, the reference sampling time periods divided by the first control unit and the audio data segments of the synchronous audio data are sequentially in one-to-one correspondence according to division.

Preferably, in an embodiment, the above mentioned audio superposition control apparatus for a TWS host device, the second control unit includes:

the pre-estimation unit is used for pre-estimating the sampling end time of the audio data segment after superposition;

and the resampling unit is used for carrying out audio resampling on the superposed audio data segment according to the time difference between the estimated sampling end time and the end time of the corresponding reference sampling time interval so as to reduce the deviation between the actual sampling time interval and the reference sampling time interval.

The embodiment of the invention also provides TWS main equipment which comprises the audio superposition control device.

For example, the TWS master is the master in a pair of bluetooth headsets, or the master in a pair of bluetooth speakers.

The embodiment of the invention also provides an audio superposition control device of the TWS slave equipment, which comprises the following components:

the first control unit is used for synchronizing a reference clock of the TWS master device after the TWS slave device establishes Bluetooth connection with the TWS master device, and dividing a reference sampling period consistent with the TWS master device after receiving information of the reference sampling period divided on the reference clock by the TWS master device;

and the second control unit is used for dividing each path of synchronous audio data in the multi-path synchronous audio data into audio data segments with fixed sampling length from the initial reference sampling period after receiving the information of the initial reference sampling period, performing audio superposition on the audio data segments which correspond to the same reference sampling period and are in different paths according to the playing sequence, and controlling the sampling time of the superposed audio data segments according to the corresponding reference sampling period, wherein for each path of synchronous audio data, the reference sampling period divided by the first control unit and the audio data segments thereof sequentially correspond one to one according to the division sequence from the initial reference sampling period.

Preferably, in an embodiment, in the above-mentioned audio superimposition control apparatus of a TWS slave device, the second control unit includes:

the pre-estimation unit is used for pre-estimating the sampling end time of the audio data segment after superposition;

and the resampling unit is used for carrying out audio resampling on the superposed audio data segment according to the time difference between the estimated sampling end time and the end time of the corresponding reference sampling time interval.

The embodiment of the invention also provides TWS slave equipment which comprises the audio superposition control device.

For example, the TWS slave device is a slave in a pair of bluetooth headsets, or a slave in a pair of bluetooth speakers.

The embodiment of the invention also provides audio equipment which comprises the TWS master equipment and the Bluetooth TWS slave equipment.

An embodiment of the present invention further provides an audio system, including:

an audio device as described above;

and the Bluetooth sound source equipment is used for providing audio data for the audio equipment.

For example, the bluetooth sound source device includes a mobile phone, a tablet computer, a notebook computer or a video player.

The present invention also provides a readable storage medium, such as a chip, a usb disk, an optical disk, etc., on which a computer program is stored, wherein the computer program, when executed by a processor, implements any of the above-mentioned audio overlay control methods.

The readable storage medium according to the embodiments of the present disclosure is not limited to the above-described embodiments, and may be, for example, an electric, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any combination thereof. More specific examples of the computer readable storage medium may include, but are not limited to: an electrical connection having one or more wires, a portable computer diskette, a hard disk, a Random Access Memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disc read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing. In embodiments of the disclosure, a computer readable storage medium may be any tangible medium that can contain, or store a program for use by or in connection with an instruction execution system, apparatus, or device.

It will be appreciated by those skilled in the art that the above-described preferred embodiments may be freely combined, superimposed, without conflict. The flowchart and block diagrams in the figures illustrate the architecture, functionality, and operation of possible implementations of systems, methods and computer program products according to various embodiments of the present disclosure. In this regard, each block in the flowchart or block diagrams may represent a module, segment, or portion of code, which comprises one or more executable instructions for implementing the specified logical function(s). It should also be noted that, in some alternative implementations, the functions noted in the block may occur out of the order noted in the figures, for example, two blocks shown in succession may, in fact, be executed substantially concurrently, or the blocks may sometimes be executed in the reverse order, depending upon the functionality involved. It will also be noted that each block of the block diagrams and/or flowchart illustration, and combinations of blocks in the block diagrams and/or flowchart illustration, can be implemented by special purpose hardware-based systems which perform the specified functions or acts, or combinations of special purpose hardware and computer instructions. The numbering of the steps herein is for convenience of description and reference only and is not intended to limit the order of the steps, which may be performed simultaneously or in any order without conflict.

It will be appreciated by those skilled in the art that the above-described preferred embodiments may be freely combined, superimposed, without conflict.

It will be understood that the embodiments described above are illustrative only and not restrictive, and that various obvious and equivalent modifications and substitutions for details described herein may be made by those skilled in the art without departing from the basic principles of the invention.