阅读说明：本技术 音视频传输方法、装置、设备及存储介质 (Audio and video transmission method, device, equipment and storage medium ) 是由 吴嵩 贾正东 周玉龙 陆品李 于 2021-07-08 设计创作，主要内容包括：本申请公开了一种音视频传输方法、装置、设备及存储介质。该音视频传输装置,包括：至少一个第一音视频接口,第一音视频接口用于传输音视频数据；音视频传输电路,音视频传输电路与第一音视频接口连接,用于对音视频数据进行处理；其中,第一音视频接口为公头形式的接口,用于直接与其他音视频传输装置直接连接。上述方案,通过使用公头形式的接口进行音视频传输,无需使用音视频线,提高了音视频传输装置的便捷性。(The application discloses an audio and video transmission method, device, equipment and storage medium. The audio and video transmission device comprises: the first audio/video interface is used for transmitting audio/video data; the audio and video transmission circuit is connected with the first audio and video interface and is used for processing audio and video data; the first audio/video interface is a male interface and is used for being directly connected with other audio/video transmission devices. According to the scheme, the interface in the male form is used for audio and video transmission, an audio and video wire is not needed, and convenience of the audio and video transmission device is improved.)

1. An audio-video transmission device, comprising:

the first audio/video interface is used for transmitting audio/video data;

the audio and video transmission circuit is connected with the first audio and video interface and is used for processing the audio and video data;

the first audio and video interface is a male interface.

2. Audio-video transmission device according to claim 1,

the audio and video transmission device comprises an operation key, wherein the operation key is used for generating at least one selection instruction so that the audio and video transmission device responds to the selection instruction and starts a function mode corresponding to the selection instruction;

wherein each selection instruction corresponds to a different functional mode.

3. Audio-video transmission device according to claim 2,

the functional modes include a first setting mode and a second setting mode;

when the audio and video transmission device is in a first setting mode, the audio and video transmission device is used for restoring at least part of working parameters of the audio and video transmission device to an initial state when the audio and video transmission device leaves a factory;

and when the audio and video transmission device is in a second setting mode, the audio and video transmission device is used for adjusting the working parameters of the audio and video transmission device according to the adjustment instruction of the user.

4. Audio-video transmission device according to claim 2, characterized in that said functional modes comprise at least one transmission mode;

when the audio and video transmission device is in a first transmission mode, the operation key is used for generating a first operation instruction so that the audio and video transmission device can respond to the first operation instruction to pause audio and video transmission or switch a frequency point for audio and video transmission; and/or the presence of a gas in the gas,

when the audio and video transmission device is in a second transmission mode, the operation key is used for generating a second operation instruction so that the audio and video transmission device responds to the second operation instruction and switches the state and/or the number of other audio and video transmission devices connected with the audio and video transmission device;

wherein the network access point is different in the first transmission mode and the second transmission mode.

5. The audio-video transmission device according to claim 1, wherein the audio-video transmission circuit comprises:

the communication module is used for establishing communication connection with other audio and video transmission devices;

the media coding and decoding processing module is used for coding or decoding the audio and video data;

and the electronic power supply circuit is used for supplying power to other modules.

6. Audio-video transmission device according to claim 1,

the audio and video transmission device comprises a second audio and video interface, the second audio and video interface is a Micro USB interface, and the first audio and video interface is an HDMI interface.

7. An audio-video transmission method applied to the audio-video transmission device according to any one of claims 1 to 6, characterized by comprising:

acquiring preset information of an audio and video transmission device;

establishing communication connection between the audio and video transmission device and other audio and video transmission devices based on the preset information;

and audio and video transmission with the other audio and video transmission devices is carried out by utilizing the communication connection.

8. The method of claim 7, wherein the predetermined information comprises a pairing code and at least one key;

the establishing of the communication connection between the audio and video transmission device and other audio and video transmission devices based on the preset information comprises the following steps:

encrypting the pairing code based on the secret key to obtain a network parameter of a first network, wherein the network parameter of the first network comprises a network name and a network password;

broadcasting the network name of the first network so that other audio and video transmission devices can search the network name of the first network and join the first network; or, the network name of the first network is used for searching, and the network password of the first network is used for joining the first network when the first network is searched.

9. The method of claim 8, wherein the key comprises a first key and a second key;

the encrypting the pairing code based on the secret key to obtain the network parameter of the first network includes:

obtaining the network name by using the first secret key to the pairing code according to a first preset encryption algorithm; and the number of the first and second groups,

and obtaining the network password by using the second secret key to the pairing code according to a second preset encryption algorithm.

10. The method according to claim 7, wherein the using the communication connection for audio-video transmission with the other audio-video transmission device comprises:

acquiring audio and video data to be transmitted and encoding parameters, wherein the encoding parameters comprise one or more of an encoding frame rate, an encoding code rate, a code rate control mode and a key frame interval;

encoding the audio and video data according to the encoding parameters;

and sending the coded audio and video data to other audio and video transmission devices in communication connection with the audio and video transmission device.

11. The method according to claim 7, wherein the using the communication connection for audio-video transmission with the other audio-video transmission device comprises:

acquiring encoded audio and video data and a decoding mode, wherein the decoding mode comprises a smooth mode and a low delay mode;

decoding the coded audio and video data according to the decoding mode;

and outputting the decoded audio and video data to display equipment.

12. The method according to claim 7, wherein the preset information comprises an audio/video source table, and the audio/video source table comprises an identifier of an audio/video transmission device corresponding to audio/video data to be transmitted;

the establishing of the communication connection between the audio and video transmission device and other audio and video transmission devices based on the preset information comprises the following steps:

after receiving the current audio and video data, disconnecting the communication connection between the audio and video transmission devices corresponding to the current audio and video data;

and establishing communication connection between the audio and video transmission devices corresponding to the audio and video data to be transmitted.

13. A terminal device comprising a memory and a processor for executing program instructions stored in the memory to implement the method of any one of claims 7 to 12.

14. A computer readable storage medium having stored thereon program instructions, which when executed by a processor implement the method of any of claims 7 to 12.

Technical Field

The present application relates to the field of communications, and in particular, to an audio/video transmission method, apparatus, device, and storage medium.

Background

With the development of science and technology, wireless audio and video transmitters are more and more popular, but wireless high-definition video transmitters acquire audio and video data to be transmitted from audio and video source equipment in an audio and video line mode or output the audio and video data to display equipment in an audio and video line mode for displaying. The wireless high-definition video transmitter is inconvenient to arrange and carry due to the fact that the audio and video wires are inconvenient to carry, and therefore the wireless audio and video transmitter is inconvenient to use.

Disclosure of Invention

The application at least provides an audio and video transmission method, an audio and video transmission device, audio and video transmission equipment and a storage medium.

The application provides an audio and video transmission device, includes: the first audio/video interface is used for transmitting audio/video data; the audio and video transmission circuit is connected with the first audio and video interface and is used for processing audio and video data; the first audio and video interface is a male interface.

The audio and video transmission device comprises an operation key, wherein the operation key is used for generating at least one selection instruction so that the audio and video transmission device responds to the selection instruction and starts a function mode corresponding to the selection instruction; wherein each selection instruction corresponds to a different functional mode.

Wherein the functional mode comprises a first setting mode and a second setting mode; when the audio and video transmission device is in a first setting mode, the audio and video transmission device is used for restoring at least part of working parameters of the audio and video transmission device to an initial state when the audio and video transmission device leaves a factory; and when the audio and video transmission device is in the second setting mode, the audio and video transmission device is used for adjusting the working parameters of the audio and video transmission device according to the adjustment instruction of the user.

Wherein the functional modes include at least one transmission mode; when the audio and video transmission device is in a first transmission mode, the operation key is used for generating a first operation instruction so that the audio and video transmission device can respond to the first operation instruction to pause audio and video transmission or switch frequency points for audio and video transmission; and/or when the audio and video transmission device is in a second transmission mode, the operation key is used for generating a second operation instruction so that the audio and video transmission device responds to the second operation instruction and switches the state and/or the number of other audio and video transmission devices connected with the audio and video transmission device; and the network access point is different in the first transmission mode and the second transmission mode.

Wherein, audio frequency and video transmission circuit includes: the communication module is used for establishing communication connection with other audio and video transmission devices; the media coding and decoding processing module is used for coding or decoding the audio and video data; and the power supply electronic circuit is used for supplying power to other modules.

The audio and video transmission device comprises a second audio and video interface, the second audio and video interface is a Micro USB interface, and the first audio and video interface is an HDMI interface.

The application provides an audio and video transmission method, which is applied to any one of the audio and video transmission devices, and comprises the following steps: acquiring preset information of an audio and video transmission device; establishing communication connection between the audio and video transmission device and other audio and video transmission devices based on preset information; and audio and video transmission with other audio and video transmission devices is carried out by utilizing the communication connection.

The preset information comprises a pairing code and at least one secret key; based on the preset information, the communication connection between the audio and video transmission device and other audio and video transmission devices is established, and the method comprises the following steps: encrypting the pairing code based on the secret key to obtain network parameters of the first network, wherein the network parameters of the first network comprise a network name and a network password; broadcasting the network name of the first network so that other audio and video transmission devices can search the network name of the first network and join the first network; or, the network name of the first network is used for searching, and the first network is added by using the network password of the first network when the first network is searched.

Wherein the key comprises a first key and a second key; encrypting the pairing code based on the key to obtain the network parameters of the first network, including: obtaining a network name by using a first key pair pairing code according to a first preset encryption algorithm; and obtaining the network password by using the second key pair pairing code according to a second preset encryption algorithm.

The method for transmitting the audio and video between the audio and video transmission device and other audio and video transmission devices by utilizing the communication connection comprises the following steps: acquiring audio and video data to be transmitted and encoding parameters, wherein the encoding parameters comprise one or more of an encoding frame rate, an encoding code rate, a code rate control mode and a key frame interval; encoding the audio and video data according to the encoding parameters; and sending the encoded audio and video data to other audio and video transmission devices in communication connection with the audio and video transmission device.

The method for transmitting the audio and video between the audio and video transmission device and other audio and video transmission devices by utilizing the communication connection comprises the following steps: acquiring encoded audio and video data and a decoding mode, wherein the decoding mode comprises a smooth mode and a low delay mode; decoding the encoded audio/video data according to a decoding mode; and outputting the decoded audio and video data to display equipment.

The preset information comprises an audio and video source table, wherein the audio and video source table comprises an identifier of an audio and video transmission device corresponding to audio and video data to be transmitted; based on the preset information, the communication connection between the audio and video transmission device and other audio and video transmission devices is established, and the method comprises the following steps: after the current audio and video data are received, the communication connection between the audio and video transmission devices corresponding to the current audio and video data is disconnected; and establishing communication connection between the audio and video transmission devices corresponding to the audio and video data to be transmitted.

The application provides a terminal device, which comprises a memory and a processor, wherein the processor is used for executing program instructions stored in the memory so as to realize the audio and video transmission method.

The present application provides a computer readable storage medium having stored thereon program instructions which, when executed by a processor, implement the above-described audio-video transmission method.

According to the scheme, the audio and video transmission device transmits the audio and video through the interface in the male form, so that the audio and video transmission device does not need to transmit the audio and video through a bloated audio and video wire, the audio and video transmission device is convenient to carry, and the convenience of the audio and video transmission process is improved.

It is to be understood that both the foregoing general description and the following detailed description are exemplary and explanatory only and are not restrictive of the application.

Drawings

The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the present application and, together with the description, serve to explain the principles of the application.

Fig. 1 is an appearance structure schematic diagram of an embodiment of an audio/video transmission device according to the present application;

fig. 2 is a schematic structural diagram of an audio/video transmission circuit in an embodiment of the audio/video transmission device according to the present application;

fig. 3 is a schematic structural diagram of an audio/video transmission circuit in another embodiment of the audio/video transmission device of the present application;

fig. 4 is a schematic diagram illustrating two audio/video transmission devices establishing a communication connection in an embodiment of the present application;

fig. 5 is a schematic diagram illustrating that a plurality of audio/video transmission devices establish communication connection in another embodiment of the audio/video transmission device of the present application;

fig. 6 is a schematic flowchart of an embodiment of an audio/video transmission method according to the present application;

FIG. 7 is a schematic structural diagram of an embodiment of a terminal device according to the present application;

FIG. 8 is a schematic structural diagram of an embodiment of a computer-readable storage medium of the present application.

Detailed Description

The technical solutions in the embodiments of the present application will be clearly and completely described below with reference to the drawings in the embodiments of the present application, and the following embodiments may be combined with each other without conflict. It is to be understood that the embodiments described are only a few embodiments of the present application and not all embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present application.

The term "and/or" herein is merely an association describing an associated object, meaning that three relationships may exist, e.g., a and/or B, may mean: a exists alone, A and B exist simultaneously, and B exists alone. In addition, the character "/" herein generally indicates that the former and latter related objects are in an "or" relationship. Further, the term "plurality" herein means two or more than two. In addition, the term "at least one" herein means any one of a plurality or any combination of at least two of a plurality, for example, including at least one of A, B, C, and may mean including any one or more elements selected from the group consisting of A, B and C.

In some specific application scenarios, the mode of transmitting the audio and video through the audio and video transmission device may be to use two audio and video transmission devices for audio and video transmission. Specifically, an audio/video transmission device is used as a sending end, and an audio/video transmission device is used as an output end. The audio and video transmission device serving as the transmitting end is connected with the source equipment, namely the audio and video transmission device of the transmitting end acquires audio and video needing to be transmitted from the source equipment, and the audio and video transmission device serving as the receiving end is connected with the display equipment, namely the audio and video transmission device serving as the receiving end can output the received audio and video to the display equipment after receiving the audio and video, so that the audio and video transmission between the source equipment and the display equipment is realized. The source device may be a computer, a recorder, a camera, etc., and the display device may be a computer, a projector, a television, a display, etc.

Specifically, the audio/video transmission process may be that an audio/video transmission device serving as a sending end encodes audio/video to be transmitted, then sends the encoded audio/video data to an audio/video transmission device serving as a receiving end in a wireless communication manner or the like, and the audio/video transmission device serving as the receiving end decodes the received audio/video data, so as to output the decoded audio/video data to the display device.

Referring to fig. 1 to 3, fig. 1 is an appearance structure schematic diagram of an embodiment of an audio/video transmission device of the present application, fig. 2 is a structure schematic diagram of an audio/video transmission circuit in an embodiment of an audio/video transmission device of the present application, and fig. 3 is a structure schematic diagram of an audio/video transmission circuit in another embodiment of an audio/video transmission device of the present application. The overall appearance structures of the audio and video transmission device at the transmitting end and the audio and video transmission device at the receiving end are the same, and both fig. 1 can be referred to. Fig. 2 shows an audio/video transmission circuit in which the audio/video transmission device is used as a transmitting end, and fig. 3 shows an audio/video transmission circuit in which the audio/video transmission device is used as a receiving end. In the following embodiments, when the audio/video transmission device 10 is a transmitting end, the audio/video transmission circuit 102 of the audio/video transmission device 10 refers to fig. 2, and when the audio/video transmission device 10 is a receiving end, the audio/video transmission circuit 102 of the audio/video transmission device 10 refers to fig. 3. In other disclosed embodiments, the audio/video transmission device 10 can transmit audio/video and can also receive audio/video.

In particular, the audiovisual transmission device 10 comprises at least one first audiovisual interface 101 and an audiovisual transmission circuit 102.

In some application scenarios, the audio and video transmitted by the audio and video transmission device 10 may be video data, or may be separate audio data. The video data comprises a single-frame image and a video formed by a plurality of frame images, wherein the video formed by the plurality of frame images can be an audio/video including sound or an audio/video not including sound. The video data and the audio data are collectively referred to as audio-video.

At least one of which may be one or more. The first audio/video interface 101 is used for transmitting audio/video data. The first audio/video interface 101 is an HDMI interface. When the audio/video transmission apparatus 10 is used as a transmitting end, the first audio/video interface 101 is used to obtain audio/video data from a source device, that is, the first audio/video interface 101 realizes audio/video transmission between the source device and the audio/video transmission apparatus 10. When the audio/video transmission device 10 serves as a receiving end, the first audio/video interface 101 is configured to decode audio/video data received by the audio/video transmission device 10 and output the decoded audio/video data to the display device, that is, under such a condition, the first audio/video interface 101 is configured to implement audio/video transmission between the audio/video transmission device 10 and the display device. Wherein, the first audio/video interface 101 is a male interface. Specifically, the first audio/video interface 101 is an HDMI TYPE-a male.

In some disclosed embodiments, the audio-visual transmission device 10 further comprises a second audio-visual interface 104. Specifically, the second audio/video interface 104 is a Micro USB interface. The second audio/video interface 104 may be connected to a power supply device to supply power to the audio/video transmission apparatus 10. When the audio/video transmission device 10 is used as a transmitting end, the second audio/video interface 104 may also be used as a compressed audio/video input interface. When the audio/video transmission device 10 is used as a receiving end, the second audio/video interface 104 may also be used as a compressed audio/video data output interface. A third audio-visual interface 105 is also included, the third audio-visual interface 105 being arranged to transmit analog audio signals. When the audio/video transmission apparatus 10 serves as a transmitting end, the third audio/video interface 105 is configured to input an analog audio from a source device, and when the audio/video transmission apparatus 10 serves as a receiving end, the third audio/video interface 105 is configured to output the analog audio to a display device.

The audio/video transmission circuit 102 is connected to the first audio/video interface 101, and is configured to process audio/video data. When the audio/video transmission device 10 is used as a transmitting end, the audio/video transmission circuit 102 is configured to encode audio/video data from a source device. When the audio/video transmission device 10 is used as a receiving end, the audio/video transmission circuit 102 is configured to decode the received audio/video data. The audio-video transmission circuit 102 is provided inside the audio-video transmission device 10.

The audio/video transmission circuit 102 includes a communication module 1021, a media codec processing module 1022, and a power supply electronic circuit 1023.

The communication module 1021 can be used for establishing communication connection with other audio/video transmission devices. Specifically, the communication module 1021 may be a WIFI module. The media codec processing module 1022 is configured to encode or decode the audio/video data. Wherein, when the audio/video transmission device 10 is a transmitting end, the media encoding/decoding processing module 1022 is a media encoding processing module 10221. When the audio/video transmission apparatus 10 is a receiving end, the media codec processing module 1022 is a media codec processing module 10222. The power supply electronic circuit 1023 is used to power the other modules. The first audio/video interface 101 may be used as an input terminal of the power supply electronic circuit 1023, and the second audio/video interface 104 may also be used as an input terminal of the power supply electronic circuit 1023.

Specifically, when the audio/video transmission device 10 is a transmitting end, under the condition that the driving capability of the +5V signal output by the output interface of the source device is strong enough, the power supply electronic circuit 1023 in the audio/video transmission device 10 does not need to supply power through the Micro USB interface. When the audio/video transmission device 10 is a receiving end, the +5V power input through the second audio/video interface 104 is converted into a power required by each circuit.

When the audio/video transmission device 10 is a transmitting end, the audio/video transmission device 10 further includes an audio/video receiving sub-circuit 1024. The audio/video receiving sub-circuit 1024 is connected to the first audio/video interface 101, and is configured to receive audio/video data from a source device. Specifically, the purpose of each module of the audio/video transmission circuit 102 in the audio/video transmission process is as follows: the audio/video receiving sub-circuit 1024 receives a signal from the first audio/video interface 101, converts the received signal into a TTL image signal, and outputs the TTL image signal to the media encoding processing module 10221. The media encoding processing module 10221 includes a CPU and an H264/H265 encoding engine. The media encoding processing module 10221 collects TTL image signals and digital audio signals from the audio/video receiving sub-circuit 1024, encodes the TTL image signals and the digital audio signals into H264/H265 compressed video streams and AAC compressed audio streams, and finally forms compressed audio/video streams to be transmitted and transmits the compressed audio/video streams to an output transmission device of a receiving end through the communication module 1021.

When the audio/video transmission device 10 is a receiving end, the audio/video transmission circuit 102 has the following functions in the audio/video transmission process: the communication module 1021 receives the compressed video stream audio and video from the sending end, and the media decoding processing module 10222 includes a CPU and an H264/H265 decoding engine, and implements audio and video transmission by running a program on the CPU. Specifically, the received compressed video stream audio and video is decoded by the H264/H265 decoding engine and output through the first audio and video interface 101.

In some disclosed embodiments, audio-video transmission circuitry 102 includes an antenna 1025. Both the audio/video transmission apparatus 10 at the transmitting end and the audio/video transmission apparatus 10 at the receiving end use the built-in antenna 1025. And each audio-visual transmission device 10 has a volume of 30mmx70mmx12mm (LxWxH)). The audio-video transmission device 10 is portable by using the built-in antenna 1025.

In some disclosed embodiments, the audio-visual transmission device 10 includes an operation key 103. The operation keys 103 may be physical keys of a push type or a knob type. The embodiment of the present disclosure takes a pressing type physical key as an example. Wherein the number of the operation keys 103 is at least one. The operation key 103 is used for generating at least one selection instruction so that the audio/video transmission device 10 responds to the selection instruction to start the function mode corresponding to the selection instruction. Wherein each selection instruction corresponds to a different functional mode.

Specifically, the operation keys 103 may generate two or more selection instructions. Each selection instruction corresponds to a different functional mode, specifically, different selection instructions correspond to different functional modes. The manner of generating different selection instructions by the operation key 103 may be that a corresponding selection instruction is generated by the time when the user presses the operation key 103, where the time when the operation key 103 is pressed refers to the time when the operation key 103 is in a pressed state and keeps the pressed state. In the embodiment of the present disclosure, three types of operations, short-press operation, long-press operation, and extra-long-press operation, are classified according to the time for which the operation key 103 is kept in the pressed state. The short-press operation means a state of being pressed and held for less than 2.5 seconds, and the long-press operation means a state of being pressed and held for 2.5 seconds or more and less than 15 seconds. The extra-long press operation means pressing and holding the pressed state for 15 seconds or more.

Alternatively, the functional mode may include a first setting mode and a second setting mode. When the audio/video transmission device 10 is in the first setting mode, the audio/video transmission device 10 is configured to restore at least part of the operating parameters of the audio/video transmission device 10 to the original state when the device leaves the factory. Specifically, the initial state of the audio/video transmission device 10 at the time of factory shipment is restored. At least part of the working parameters can be the working parameters which are set by the user in advance and can be partially restored to the initial state, or all the working parameters can be restored to the initial state. In some disclosed embodiments, the working parameters that are allowed to be restored to the initial state may be saved in a working list, and the working parameters that need to be restored to the initial state in the first setting mode may be searched by querying the working list. Wherein the worklist is not restored to an initial state in the first mode.

When the audio/video transmission device 10 is in the second setting mode, the audio/video transmission device 10 is configured to adjust the operating parameter of the audio/video transmission device 10 according to the adjustment instruction of the user. Specifically, in the second setting mode, the user may set the operating parameters of the control device through the built-in web page, that is, the audio/video transmission device 10 receives the adjustment instruction of the user through the built-in web page.

The working parameter may be any parameter that needs to be used in the audio/video transmission process, such as an encoding parameter or a decoding parameter.

In some disclosed embodiments, the functional modes include at least one transmission mode. Wherein, in the transmission mode, the audio/video transmission device 10 can perform audio/video transmission. Specifically, in the transmission mode, the audio/video transmission device 10 processes and transmits the audio/video data to be transmitted according to the current working parameter set in the first setting mode or the second setting mode.

In the transmission mode, if the operation key 103 receives an overlong pressing operation of the user, the operation key is used to generate a corresponding first selection instruction, and the audio/video transmission device 10 enters the first setting mode in response to the first selection instruction. After entering the first setting mode, after restoring at least part of the operating parameters of the audio/video transmission device 10 to the initial state, exiting the first setting mode and entering the transmission mode. Wherein, under the condition that a plurality of transmission modes exist, the transmission mode before the first selection instruction is generated is entered.

In the transmission mode, if the operation key 103 receives a long-press operation of the user, a corresponding second selection instruction is generated, and the audio/video transmission device 10 enters a second setting mode in response to the second selection instruction. And in the second setting mode, the working parameters of the audio and video transmission device 10 are adjusted according to the adjustment instruction of the user. And after receiving an instruction of exiting the second setting mode, exiting the second setting mode and entering a transmission mode. Wherein, under the condition that a plurality of transmission modes exist, the transmission mode before the second selection instruction is generated is entered.

In some disclosed embodiments, the functional modes include a first transmission mode and a second transmission mode. And the network access point is different in the first transmission mode and the second transmission mode. In the embodiment of the present disclosure, the audio/video transmission device 10 at the transmitting end and the receiving end performs audio/video transmission by using a WIFI wireless transmission technology. The network access point is the WIFI-AP. The first transmission mode refers to that the audio/video transmission device 10 is in a one-to-one configuration. The second transmission mode refers to the audio/video transmission device 10 being in a many-to-many configuration. The one-to-one configuration means that the transmitting end only has one audio/video transmission device 10, and the receiving end only has one audio/video transmission device 10. Moreover, one of the audio/video transmission devices 10 serves as a network access point, i.e., as a WIFI-AP device, and the other audio/video transmission device 10 serves as a WIFI-STA. In the embodiment of the present disclosure, the audio/video transmission device 10 at the receiving end serves as a network access point. The many-to-many configuration refers to adding a router between the audio and video transmission devices 10 at the transmitting end and the receiving end, wherein each audio and video transmission device 10 is used as a WIFI-STA. In the many-to-many configuration, the number of the audio/video transmission devices 10 at the transmitting end and the number of the audio/video transmission devices 10 at the receiving end may be multiple. In the embodiment of the present disclosure, the numbers of the audio/video transmission devices 10 at the transmitting end and the audio/video transmission devices 10 at the receiving end are both greater than or equal to 1 and less than or equal to 10. In the many-to-many configuration, the audio/video transmission apparatus 10 at each transmitting end is connected to a source device, and the audio/video transmission apparatus 10 at each receiving end is connected to a display device.

When the audio/video transmission device 10 is in the first transmission mode, the operation key 103 is used to generate a first operation instruction, so that the audio/video transmission device 10 can respond to the first operation instruction to suspend audio/video transmission or switch a frequency point for audio/video transmission. The first operation instruction is generated based on a short-press operation of a user.

In some disclosed embodiments, when the audio/video transmission apparatus 10 is a transmitting end, the audio/video transmission apparatus 10 is configured to suspend audio/video transmission in response to the first operation instruction. And the audio/video transmission device 10 at the receiving end connected with the same keeps outputting the picture. Specifically, the transmitting-end audio/video transmission device 10 responding to the first operation instruction suspends audio/video transmission with the receiving-end audio/video transmission device 10 to which the connection has been established, and the receiving-end audio/video transmission device 10 maintains the output picture content at the time of generating the first operation instruction. When the audio/video transmission device 10 is a receiving end, the audio/video transmission device 10 switches the frequency point for audio/video transmission in response to the first operation instruction. Specifically, the frequency point for audio and video transmission is a frequency point used for WIFI connection.

When the audio/video transmission device 10 is in the second transmission mode, the operation key 103 is configured to generate a second operation instruction, so that the audio/video transmission device 10 switches states and/or numbers of other audio/video transmission devices connected to the audio/video transmission device 10 in response to the second operation instruction. Here, the second operation instruction and the first operation instruction may both be generated based on a short-press operation of the operation key 103 by the user.

In some disclosed embodiments, when the audio/video transmission device 10 is a transmitting end, the audio/video transmission device 10 switches the number of the audio/video transmission devices 10 on the receiving end side connected to the audio/video transmission device 10 in response to the second operation instruction. Specifically, the audio/video transmission device 10 on the transmitting end side responds to the second operation instruction, and executes a broadcasting process, so that the audio/video transmission devices 10 on the multiple receiving ends receive the audio/video data transmitted by the audio/video transmission device 10.

In some disclosed embodiments, when the audio/video transmission device 10 is a receiving end, the audio/video transmission device 10 responds to the second operation instruction to switch the state of the audio/video transmission device 10 at the transmitting end connected to the audio/video transmission device 10 at the receiving end. The switching state may be a state switched from a connected state to an unconnected state, or a state switched from an unconnected state to a connected state. Specifically, the receiving-end audio/video transmission device 10 disconnects from one transmitting-end audio/video transmission device 10, and connects to another transmitting-end audio/video transmission device 10.

In some disclosed embodiments, the audiovisual transmission device 10 includes an indicator light 106. The different lighting modes of the indicator lamp 106 are used for indicating the operation state of the audio-visual transmission device 10. For example, the indicator light 106 of the audiovisual transmission device 10 is a two-color indicator light 106 that may be used to present three colors. For example, three colors of red, green and orange can be presented. Of course, in other embodiments, other colors may be used, by way of example only.

In some application scenarios, when the audio/video transmission device 10 is in the first setting mode, the indicator light 106 is in red and green states and alternately flashes. When the audio-video transmission device 10 is in the second setting mode, the status of the indicator light 106 is orange and slowly flashes. The audio and video transmission device 10 in the second setting mode is used as a WIFI-AP, a web service is started, a user can use a computer to connect to the WI-FI AP network, a built-in web page is opened through a browser, and working parameters of the audio and video transmission device 10 are adjusted. In some application scenarios, when the audio/video transmission apparatus 10 is a sending end, a video application scenario of the sending device may be set through a web page. The audio/video transmission device 10 may preset a plurality of sets of selectable encoding parameters, so that the plurality of sets of encoding parameters of the audio/video transmission device 10 respectively correspond to various video application scenes. For example, the groups can be two groups, and the video application scene is divided into a video mode and a presentation mode. The coding parameters include one or more of key frame interval, coding rate and rate control mode. In some application scenarios, when the audio/video transmission device 10 is a receiving end, the receiving end can set a video application scenario of the audio/video transmission device 10 of the receiving end through a built-in web page. Video application scenarios have a smooth mode and a low-latency mode.

In some disclosed embodiments, the WI-FI AP network in which the audio/video transmission apparatus 10 is located in the second setting mode is not the same as the WI-FI AP network in which the audio/video transmission apparatus 10 is located in the other modes, and the audio/video transmission apparatus 10 in the other modes does not provide the web service.

The status of the indicator light 106 is related to the actual status of the audiovisual transmission device 10 when the audiovisual transmission device 10 is in the transmission mode. Specifically, when audio/video data connection is not established, the status of the indicator light 106 is red and normally on, and when audio/video data connection is established but audio/video is not transmitted, the status of the indicator light 106 is orange and normally on or green and normally on. Specifically, the color of the audio/video transmission device 10 is orange and the color of the audio/video transmission device is always bright when the audio/video transmission device is in the first transmission mode, and the color of the audio/video transmission device 10 is green and the color of the audio/video transmission device is always bright when the audio/video transmission device is in the second transmission mode. The indicator light 106 flashes fast orange or fast green while audio/video data is being transmitted. Specifically, the audio/video transmission device 10 flashes fast in orange when in the first transmission mode, and flashes fast in green when in the second transmission mode.

According to the scheme, the audio and video transmission device 10 is enabled to be connected with an audio and video source without using a bulky audio and video line by using the interface in the male form for transmitting the audio and video, so that the audio and video transmission device 10 is convenient to carry, and the convenience of the audio and video transmission process is improved.

For better understanding, the transmitting end and the receiving end both have only one audio/video transmission device, and each party has a plurality of audio/video transmission devices, please refer to fig. 4 and fig. 5. Fig. 4 is a schematic diagram illustrating that two audio/video transmission devices establish communication connection in an embodiment of the audio/video transmission device of the present application, and fig. 5 is a schematic diagram illustrating that a plurality of audio/video transmission devices establish communication connection in another embodiment of the audio/video transmission device of the present application.

In order to distinguish the transmitting end and the receiving end, in the embodiment of the present disclosure, the audio/video transmission device at the transmitting end is marked as 10, and the audio/video transmission device at the receiving end is marked as 20. As shown in fig. 4 and 5, when the transmitting end has only one audio/video transmission device 10 and the receiving end has only one audio/video transmission device 20, the audio/video transmission device 10 and the audio/video transmission device 20 are not connected by a router, while the transmitting end has a plurality of audio/video transmission devices 10 and the receiving end has a plurality of audio/video transmission devices 20, the receiving end can be connected by a router. Moreover, the audio/video transmission apparatus 10 of each transmitting end is connected to a source device, and the audio/video transmission apparatus 20 of each receiving end is connected to a display device.

The audio and video transmission device provided by the embodiment of the disclosure can be used in the fields of video conferences, home videos, multimedia teaching and the like.

Referring to fig. 6, fig. 6 is a schematic flowchart of an embodiment of an audio/video transmission method according to the present application.

As shown in fig. 6, the audio and video transmission method provided by the embodiment of the present disclosure may include the following steps:

step S11: and acquiring preset information of the audio and video transmission device.

The audio and video transmission method provided by the embodiment of the disclosure is applied to the audio and video transmission device provided by the embodiment of the audio and video transmission device.

The preset information is information set by a user in advance or set when the user leaves a factory. The mode of the user for setting the preset information in advance can be determined by a built-in webpage of the audio and video transmission device. In addition, the transmission mode of the audio/video transmission device can be set through the built-in webpage of the audio/video transmission device, and as described in the above embodiment, the transmission mode of the audio/video transmission device includes the first transmission mode and the second transmission mode. For the specific forms of the first transmission mode and the second transmission mode, please refer to the description of the embodiment of the audio/video transmission apparatus, which is not described herein again.

Step S12: and establishing communication connection between the audio and video transmission device and other audio and video transmission devices based on the preset information.

In some disclosed embodiments, the preset information includes a pairing code and at least one key. And encrypting the pairing code based on the secret key to obtain the network parameter of the first network. The network parameters of the first network comprise a network name and a network password.

In some disclosed embodiments, the keys include a first key and a second key. The first key and the second key may be the same or different, and in the embodiment of the present disclosure, the first key and the second key are selected to be different. Specifically, the first key and the second key are preset and are set and unreadable when the audio/video transmission device is shipped from a factory.

The method for obtaining the network parameter of the first network by encrypting the pairing code based on the key may be that the first key is used to obtain the network name of the pairing code according to a first preset encryption algorithm. And obtaining the network password by using the second key pair pairing code according to a second preset encryption algorithm. The first preset encryption algorithm and the second preset encryption algorithm may be the same or different. In the embodiment of the present disclosure, the first preset encryption algorithm and the second preset encryption algorithm may both be AES encryption algorithms. The network name and the network password of the first network are acquired through a communication module of the audio and video transmission device. Specifically, the connection parameter is obtained by a generation module according to the connection parameter in the communication module.

The first network may be a WIFI network formed by the audio/video transmission device at the transmitting end as a network access point, or may be a WIFI network formed by the audio/video transmission device at the receiving end as a network access point.

Further, the pairing code and the key in the audio and video transmission device of the sending end and the receiving end are the same. In the embodiment of the disclosure, the audio/video transmission device at the receiving end is selected as the access point of the first network. The receiving end and the sending end both need to obtain the network name and the network password of the first network through the pairing code and the secret key.

After the audio and video transmission device at the receiving end acquires the network name and the network password of the first network, broadcasting is carried out, so that other audio and video transmission devices can search the first network and join the first network. Specifically, the audio/video transmission device performs hidden broadcasting and broadcasts the network name of the first network, so that other audio/video transmission devices search for the network name of the first network and join the first network.

After the audio and video transmission device at the sending end acquires the network name and the network password of the first network, the network name of the first network is used for searching, and the network password of the first network is used for joining the first network when the first network is searched.

Therefore, the audio and video transmission device at the sending end is in communication connection with the audio and video transmission device at the receiving end.

In some disclosed embodiments, the preset information may also be one or more of a network name and a password to be added to the network, group information, an identifier of the audio/video transmission device, and an audio/video source table. In some disclosed embodiments, the audio/video transmission device at the sending end includes a network name and a password to be added to the network, group information, and an identifier of the audio/video transmission device. In the audio/video transmission device at the receiving end, the preset information comprises the network name and the password to be added into the network, group information, the identification of the audio/video transmission device and an audio/video source table. The audio and video source table comprises audio and video data to be received and audio and video transmission identifications of a sending end corresponding to each audio and video data. Wherein, the identification of the audio and video transmission device can be a number.

In some application scenarios, the network access point to be added into the network is a wireless router, and the audio and video transmission devices at the transmitting end and the receiving end are both used as STAs to be added into the network. The audio and video transmission devices of the sending end and the receiving end are added into the WIFI network of the wireless router by searching the network names of the networks to be added and using the corresponding passwords.

And the audio and video transmission devices of each sending end and each receiving end generate the IP addresses of the bodies in the WIFI network by using the group information and the codes. And the encoding value of the audio and video transmission device is less than or equal to 10. In the embodiment of the present disclosure, the configuration of the IP address of the audio/video transmission device at the transmitting end may be group information, number + 100. The IP address of the audio-video transmission device at the receiving end can be formed by group information, number + 120. For example, the group information is 192.168.2, and the numbers of the audio/video transmission devices at the transmitting end and the receiving end are both 1, the IP address of the audio/video transmission device at the transmitting end is 192.168.2.101, and the IP address of the audio/video transmission device at the receiving end is 192.168.2.121.

Therefore, the audio and video transmission devices of each sending end and each receiving end are added into the WIFI network provided by the same wireless router.

In some disclosed embodiments, the audio and video transmission devices of the transmitting end and the receiving end which use the same set of information form a device set. Wherein, a plurality of device sets can be allowed to exist under one wireless local area network. Wherein the network address part of the IP address of each device in the wireless local area network may be generated from the group information of the devices, and the network addresses generated by different group information are different. The audio and video transmission devices of the sending end and the receiving end which are set as the same group of information have the same network address, and then the devices which are set as the same group of information in the wireless local area network to which each audio and video transmission device belongs can transmit information mutually through the IP address, and the network protocol stack layer of the device ensures that audio and video data among different device sets are mutually isolated. In one device set, the audio/video transmission device at the receiving end can only request the audio/video transmission device at the transmitting end in the same set to transmit audio/video data to the transmitting end.

Step S13: and audio and video transmission with other audio and video transmission devices is carried out by utilizing the communication connection.

In some disclosed embodiments, if both the sending end and the receiving end only have one audio/video transmission device, the audio/video transmission device of the sending end sends audio/video data to the receiving end in a TCP manner, and the audio/video data is received by the audio/video transmission device of the receiving end and decoded and output to the display device. Specifically, the transmitting end is connected to the source device, and the receiving end is connected to the display device. The audio and video signals output by the source equipment are collected, compressed and encoded into audio and video data to be transmitted by the sending end, then the audio and video data are transmitted to the receiving end through the WIFI connection established between the sending end and the receiving end, and then the audio and video data are decoded by the receiving end and finally output to the display equipment for playing.

In some disclosed embodiments, when two or more audio/video transmission devices exist at least one of the transmitting end and the receiving end, the audio/video transmission device at the receiving end sends an audio/video request to the audio/video transmission device at one of the transmitting end, and the audio/video transmission device at the transmitting end responds to the audio/video request sent by the audio/video transmission device at the receiving end and sends corresponding audio/video to the audio/video transmission device at the receiving end. As described above, the audio/video transmission device at the receiving end includes the audio/video source table. The audio and video source table comprises the identification of the audio and video transmission device corresponding to the audio and video data to be transmitted. In some application scenarios, the audio/video source table may be regarded as a number set of the audio/video transmission device at the transmitting end. The audio and video transmission device at the receiving end can send an audio and video request to any one audio and video transmission device in the audio and video source table. In some application scenarios, after the current audio/video data is received, the communication connection between the audio/video transmission devices corresponding to the current audio/video data is disconnected. The communication connection described in the embodiments of the present disclosure may be regarded as a data connection. And then establishing communication connection between the audio and video transmission devices corresponding to the audio and video data to be transmitted.

In some disclosed embodiments, when two or more audio/video transmission devices exist at least one of the transmitting end and the receiving end, the audio/video transmission devices may be considered to be in the second transmission mode.

And if the operation key in the audio and video transmission device at the sending end generates a second operation instruction based on the short-time pressing operation of the user, the audio and video transmission device responds to the second operation instruction and switches the number of other audio and video transmission devices connected with the audio and video transmission device. Specifically, the audio/video transmission device generates IP addresses of all the audio/video transmission devices at the receiving end according to the group information, and broadcasts a request signaling to the IP addresses in a UDP manner, wherein the source broadcast request signaling includes the number of the audio/video transmission device. Therefore, after the audio/video transmission device at the receiving end receives the source broadcast request signaling, the source broadcast request signaling is responded. Specifically, the IP address of the audio/video transmission device at the source broadcast signaling corresponding to the sending end is taken out and stored. Judging whether the serial number of the audio and video transmission device contained in the source broadcast request signaling is included in an audio and video source table in the audio and video transmission device, if so, responding to the source broadcast request signaling, and sending an audio and video request to the audio and video transmission device of the sending end to obtain the corresponding audio and video. If the judgment result is no, the processing related to the source broadcast request signaling is ended. In some disclosed embodiments, the signaling process is unidirectional, and there is no need to wait for the response and reply of any receiving-end audio/video transmission device. That is, after receiving the signaling, the audio/video transmission device at the receiving end does not need to send a reply signaling indicating that the signaling is received to the audio/video transmission device at the transmitting end, and the audio/video transmission device at the transmitting end does not need to wait for a response of the broadcast request signaling.

And if the operation key in the audio and video transmission device at the receiving end generates a second operation instruction based on the short-time pressing operation of the user, the audio and video transmission device responds to the second operation instruction and switches the states of other audio and video transmission devices connected with the audio and video transmission device. Specifically, the audio/video transmission device at the receiving end reads the next entry of the entry corresponding to the currently decoded audio/video from the audio/video source table, and uses the next entry as the number of the audio/video transmission device at the transmitting end to be connected. And then, the audio and video connection with the currently decoded audio and video transmission device at the sending end is disconnected, and the corresponding IP address is obtained based on the serial number of the audio and video transmission device corresponding to the audio and video to be transmitted. And sending an audio/video request to the IP address to acquire corresponding audio/video. And finally, decoding the received audio and video and outputting the decoded audio and video to display equipment, displaying the number of the new audio and video transmission device at the sending end on an output picture of the audio and video transmission device through OSD, and closing the OSD display after a preset time period. The preset time period can be set by itself, and the preset time period is set to be 10 seconds in an optional mode according to the embodiment of the disclosure.

In some disclosed embodiments, when the audio/video transmission device is a transmitting end, the manner of performing audio/video transmission with other audio/video transmission devices by using the communication connection may further include: and acquiring the audio and video to be transmitted and the coding parameters. The encoding parameters comprise one or more of an encoding frame rate, an encoding code rate, a code rate control mode and a key frame interval. The encoding parameters can be set by the audio and video transmission device in the second mode. The specific setting mode can be that the optimal parameter values of the video with heavy moving pictures and the video with heavy definition are obtained through an experimental mode and stored. Based on the adjustment instruction from the user, the corresponding encoding parameters are selected to be applied to the encoding process of the media encoding processing module 10221.

And then, encoding the audio and video data according to the encoding parameters. In the embodiment of the present disclosure, it is preferable that the H265 encoding method compresses and encodes the acquired video, and uses AAC compression encoding for the acquired audio. And then the encoded audio and video data is sent to other audio and video transmission devices which are in communication connection with the audio and video transmission device.

In some disclosed embodiments, when the audio/video transmission device is a receiving end, the manner of performing audio/video transmission with other audio/video transmission devices by using communication connection may further include: and acquiring the coded audio and video data and a decoding mode. Wherein the decoding mode includes a fluency mode and a low-latency mode. The fluency mode and the low-delay mode correspond to different decoding modes, and specifically, the depths of the receiving end for providing audio/video coding receiving buffering in different decoding modes are different.

In different application scenarios, users have different emphasis on the quality of observed video images, for example, users pay more attention to the fluency of videos when playing video programs, but users pay more emphasis on the picture definition when displaying PPT with heavy still pictures or displaying pictures. Therefore, different coding parameters are set through the audio and video transmission device at the sending end, so that a user can select proper coding parameters according to specific requirements, and the applicability of the audio and video transmission method in each scene is improved. And different decoding modes are set in the audio and video transmission device at the receiving end, so that the applicability of the audio and video transmission method in each scene can be improved.

According to the scheme, the audio and video transmission device provided by the embodiment of the audio and video transmission device transmits the audio and video by using the interface in a male form, and the audio and video are not required to be transmitted through a overstaffed audio and video wire, so that the convenience in the audio and video transmission process is improved.

It will be understood by those skilled in the art that in the method of the present invention, the order of writing the steps does not imply a strict order of execution and any limitations on the implementation, and the specific order of execution of the steps should be determined by their function and possible inherent logic.

The execution subject of the audio/video transmission method may be an audio/video transmission device, for example, the audio/video transmission method may be executed by a terminal device or a server or other processing devices. Mobile devices, user terminals, cellular phones, cordless phones, Personal Digital Assistants (PDAs), handheld devices, computing devices, in-vehicle devices, wearable devices, and the like. In some possible implementations, the audio-video transmission method may be implemented by a processor calling computer readable instructions stored in a memory.

Referring to fig. 7, fig. 7 is a schematic structural diagram of a terminal device according to an embodiment of the present application. The terminal device 70 includes a memory 71 and a processor 72, and the processor 72 is configured to execute the program instructions stored in the memory 71 to implement the steps in the above-described embodiment of the audio/video transmission method. In one particular implementation scenario, terminal device 70 may include, but is not limited to: the robot may be, for example, a robot for rehabilitation training, a microcomputer, a server, and the terminal device 70 may further include a mobile device such as a laptop computer, a tablet computer, and the like, which is not limited herein.

In particular, the processor 72 is configured to control itself and the memory 71 to implement the steps in the above-described embodiment of the audio-video transmission method. The processor 72 may also be referred to as a CPU (Central Processing Unit). The processor 72 may be an integrated circuit chip having signal processing capabilities. The Processor 72 may also be a general purpose Processor, a Digital Signal Processor (DSP), an Application Specific Integrated Circuit (ASIC), a Field Programmable Gate Array (FPGA) or other Programmable logic device, discrete Gate or transistor logic, discrete hardware components. A general purpose processor may be a microprocessor or the processor may be any conventional processor or the like. Additionally, the processor 72 may be collectively implemented by an integrated circuit chip.

According to the scheme, the audio and video transmission is carried out by using the audio and video transmission device provided by the embodiment of the audio and video transmission device, so that convenience in the audio and video transmission process is improved.

Referring to fig. 8, fig. 8 is a schematic structural diagram of an embodiment of a computer-readable storage medium according to the present application. The computer readable storage medium 80 stores program instructions 801 that can be executed by the processor, and the program instructions 801 are used for implementing the steps in the above-described embodiment of the audio and video transmission method.

According to the scheme, the audio and video transmission is carried out by using the audio and video transmission device provided by the embodiment of the audio and video transmission device, so that convenience in the audio and video transmission process is improved.

In some embodiments, functions of or modules included in the apparatus provided in the embodiments of the present disclosure may be used to execute the method described in the above method embodiments, and specific implementation thereof may refer to the description of the above method embodiments, and for brevity, will not be described again here.

The foregoing description of the various embodiments is intended to highlight various differences between the embodiments, and the same or similar parts may be referred to each other, and for brevity, will not be described again herein.

In the several embodiments provided in the present application, it should be understood that the disclosed method and apparatus may be implemented in other ways. For example, the above-described apparatus embodiments are merely illustrative, and for example, a division of a module or a unit is merely one type of logical division, and an actual implementation may have another division, for example, a unit or a component may be combined or integrated with another system, or some features may be omitted, or not implemented. In addition, the shown or discussed mutual coupling or direct coupling or communication connection may be an indirect coupling or communication connection of devices or units through some interfaces, and may be in an electrical, mechanical or other form.

In addition, functional units in the embodiments of the present application may be integrated into one processing unit, or each unit may exist alone physically, or two or more units are integrated into one unit. The integrated unit can be realized in a form of hardware, and can also be realized in a form of a software functional unit.

The integrated unit, if implemented in the form of a software functional unit and sold or used as a stand-alone product, may be stored in a computer readable storage medium. Based on such understanding, the technical solution of the present application may be substantially implemented or contributed to by the prior art, or all or part of the technical solution may be embodied in a software product, which is stored in a storage medium and includes instructions for causing a computer device (which may be a personal computer, a server, a network device, or the like) or a processor (processor) to execute all or part of the steps of the method according to the embodiments of the present application. And the aforementioned storage medium includes: a U-disk, a removable hard disk, a Read-Only Memory (ROM), a Random Access Memory (RAM), a magnetic disk or an optical disk, and other various media capable of storing program codes.