阅读说明：本技术 视频播放方法、系统以及电子设备 (Video playing method and system and electronic equipment ) 是由 龙亮 胡子明 刘浩 李忠 于 2021-09-13 设计创作，主要内容包括：本申请实施例提供一种视频播放方法、系统以及电子设备,所述方法应用于视频播放系统,所述视频播放系统与浏览器以及视频终端建立连接,所述浏览器包括播放器,所述方法包括：接收由所述浏览器发送的视频播放请求；响应于所述视频播放请求,向所述视频终端发送视频调用请求,所述视频调用请求用于请求所述视频终端上传视频数据；接收由所述视频终端发送的视频数据,所述视频数据包括第一格式；将所述视频数据的第一格式转换为第二格式,所述第二格式的视频数据用于所述浏览器的播放器进行播放；将所述第二格式的视频数据发送至所述浏览器,以供所述浏览器的播放器对所述第二格式的视频数据进行播放。(The embodiment of the application provides a video playing method, a video playing system and electronic equipment, wherein the method is applied to the video playing system, the video playing system is connected with a browser and a video terminal, the browser comprises a player, and the method comprises the following steps: receiving a video playing request sent by the browser; responding to the video playing request, and sending a video calling request to the video terminal, wherein the video calling request is used for requesting the video terminal to upload video data; receiving video data transmitted by the video terminal, the video data including a first format; converting the first format of the video data into a second format, wherein the video data in the second format is used for being played by a player of the browser; and sending the video data in the second format to the browser so that a player of the browser can play the video data in the second format.)

1. A video playing method is applied to a video playing system, the video playing system is connected with a browser and a video terminal, the browser comprises a player, and the method is characterized by comprising the following steps:

receiving a video playing request sent by the browser;

responding to the video playing request, and sending a video calling request to the video terminal, wherein the video calling request is used for requesting the video terminal to upload video data;

receiving video data transmitted by the video terminal, the video data including a first format;

converting the first format of the video data into a second format, wherein the video data in the second format is used for being played by a player of the browser;

and sending the video data in the second format to the browser so that a player of the browser can play the video data in the second format.

2. The method of claim 1, wherein the browser player is an open source player, the first format is a video compression format, and the second format is a format for video decoding and playing by the open source player.

3. The method according to claim 1 or 2, wherein said sending the video data in the second format to the browser comprises:

generating a video playing address corresponding to the video data in the second format;

sending the video playing address to the browser;

receiving a video transmission request sent by the browser;

and sending the video data in the second format to the browser in response to the video transmission request.

4. The method of claim 3, wherein the video transmission request does not carry a length of video data, and wherein sending the video data in the second format to the browser in response to the video transmission request comprises:

responding to the video transmission request, and establishing a data transmission channel with the browser;

and continuously transmitting the video data in the second format to the browser through the data transmission channel.

5. The method of claim 3, further comprising:

and if the player of the browser stops playing, stopping sending the video data in the second format to the browser.

6. A video playing method is applied to a browser, the browser is connected with a video playing system, the browser comprises a player, and the method is characterized by comprising the following steps:

responding to the video playing operation of a user, and sending a video playing request to the video playing system;

receiving a video playing address sent by the video playing system, wherein the video playing address corresponds to video data;

sending a video transmission request to the video playing system according to the video playing address;

and receiving and playing the video data sent by the video playing system.

7. The method of claim 6, wherein the browser player is an open source player, and the format of the video data is a format for video decoding and playing by the open source player.

8. A video playing system is connected with a browser and a video terminal, the browser comprises a player, and the video playing system is characterized by comprising:

the playing request module is used for receiving a video playing request sent by the browser;

the video calling module is used for responding to the video playing request and sending a video calling request to the video terminal, wherein the video calling request is used for requesting the video terminal to upload video data;

a video receiving module, configured to receive video data sent by the video terminal, where the video data includes a first format;

the format conversion module is used for converting the first format of the video data into a second format, and the video data in the second format is used for being played by a player of the browser;

and the video sending module is used for sending the video data in the second format to the browser so that a player of the browser can play the video data in the second format.

9. An electronic device, comprising:

one or more processors; a memory; and one or more computer programs, wherein the one or more computer programs are stored in the memory, the one or more computer programs comprising instructions which, when executed by the apparatus, cause the apparatus to perform the method of any of claims 1-5 or 6-7.

10. A computer-readable storage medium, in which a computer program is stored which, when run on a computer, causes the computer to perform the method of any one of claims 1-5 or 6-7.

Technical Field

The present application relates to the field of video playing technologies, and in particular, to a video playing method, a video playing system, and an electronic device.

Background

Flash (adobe Flash player) plays a key role in the creation of Web content such as animation, interactivity, audio and video. Flash Player, a product of the last century, was produced since 1995, and Flash Player was active in various industries. It plays an important role in games, animations, websites, etc.

Although the Flash Player was used in many websites and programs, it has been gradually eliminated due to its own drawbacks such as occupation of CPU resources, poor compatibility, and security. Finally, Adobe decides to stop supporting Flash Player technology after 12/31/2020 and will prohibit Flash-based content (such as video) from running on the Player from 1/12/2021. The Adobe aspect suggests that all users unload the Flash Player immediately and encourages developers to use other software instead. At the same time, Adobe will delete all Flash Player download pages, and Flash-based content will also be prevented from running in Adobe Flash Player.

Therefore, when the Flash Player is disabled, the browser (or web browser, etc.) may not be able to play video (e.g., live video). Although a Player such as VLC can also be compatible with video stream based on the RTMP protocol (real time messaging protocol) as well as the Flash Player, it is not compatible with a browser and still cannot meet the video playing requirement when used as a plug-in.

Disclosure of Invention

The application provides a video playing method, a video playing system and electronic equipment, which can meet the video playing requirement on a browser under the condition that a Flash Player is forbidden.

In a first aspect, the present application provides a video playing method, which is applied to a video playing system, where the video playing system establishes a connection with a browser and a video terminal, the browser includes a player, and the method includes:

receiving a video playing request sent by the browser;

responding to the video playing request, and sending a video calling request to the video terminal, wherein the video calling request is used for requesting the video terminal to upload video data;

receiving video data transmitted by the video terminal, the video data including a first format;

converting the first format of the video data into a second format, wherein the video data in the second format is used for being played by a player of the browser;

and sending the video data in the second format to the browser so that a player of the browser can play the video data in the second format.

In one possible implementation manner, the player of the browser is an open source player, the first format is a video compression format, and the second format is a format in which the open source player performs video decoding playing.

In one possible implementation manner, the sending the video data in the second format to the browser includes:

generating a video playing address corresponding to the video data in the second format;

sending the video playing address to the browser;

receiving a video transmission request sent by the browser;

and sending the video data in the second format to the browser in response to the video transmission request.

In one possible implementation manner, the sending the video data in the second format to the browser in response to the video transmission request, where the length of the video data is not carried in the video transmission request includes:

responding to the video transmission request, and establishing a data transmission channel with the browser;

and continuously transmitting the video data in the second format to the browser through the data transmission channel.

In one possible implementation manner, the method further includes:

and if the player of the browser stops playing, stopping sending the video data in the second format to the browser.

In a second aspect, the present application provides a video playing method, which is applied to a browser, where the browser establishes a connection with a video playing system, the browser includes a player, and the method includes:

responding to the video playing operation of a user, and sending a video playing request to the video playing system;

receiving a video playing address sent by the video playing system, wherein the video playing address corresponds to video data;

sending a video transmission request to the video playing system according to the video playing address;

and receiving and playing the video data sent by the video playing system.

In one possible implementation manner, the player of the browser is an open source player, and the format of the video data is a format in which the open source player performs video decoding playing.

In a third aspect, the present application provides a video playing system, where the video playing system establishes a connection with a browser and a video terminal, the browser includes a player, and the video playing system includes:

the playing request module is used for receiving a video playing request sent by the browser;

the video calling module is used for responding to the video playing request and sending a video calling request to the video terminal, wherein the video calling request is used for requesting the video terminal to upload video data;

a video receiving module, configured to receive video data sent by the video terminal, where the video data includes a first format;

the format conversion module is used for converting the first format of the video data into a second format, and the video data in the second format is used for being played by a player of the browser;

and the video sending module is used for sending the video data in the second format to the browser so that a player of the browser can play the video data in the second format.

In a fourth aspect, the present application provides an electronic device comprising:

one or more processors; a memory; and one or more computer programs, wherein the one or more computer programs are stored in the memory, the one or more computer programs comprising instructions which, when executed by the apparatus, cause the apparatus to perform the method of the first aspect or the second aspect.

In a fifth aspect, the present application provides a computer readable storage medium having stored thereon a computer program which, when run on a computer, causes the computer to perform the method according to the first or second aspect.

In a sixth aspect, the present application provides a computer program for performing the method of the first or second aspect when the computer program is executed by a computer.

In a possible design, the program in the sixth aspect may be stored in whole or in part on a storage medium packaged with the processor, or in part or in whole on a memory not packaged with the processor.

Drawings

Fig. 1 is a schematic method diagram of an embodiment of a video playing method according to the present application;

FIG. 2 is a schematic diagram of data interaction in an embodiment of a video playing method according to the present application;

FIG. 3 is a schematic diagram illustrating a video playback method according to another embodiment of the present application;

FIG. 4 is a schematic structural diagram of an embodiment of a video playback system of the present application;

fig. 5 is a schematic structural diagram of an embodiment of an electronic device according to the present application.

Detailed Description

The terminology used in the description of the embodiments section of the present application is for the purpose of describing particular embodiments of the present application only and is not intended to be limiting of the present application.

In the prior art, under the condition that the Flash Player is forbidden, a browser (or a web browser and the like) cannot play videos (such as live videos and the like). Although a Player such as VLC can also be compatible with video data such as video stream based on the RTMP protocol (real time messaging protocol) as well as the Flash Player, it cannot be compatible with a browser and still cannot meet the video playing requirement when used as a plug-in.

Therefore, the video playing method, the video playing system and the electronic equipment can meet the video playing requirement on the browser under the condition that the Flash Player is forbidden.

Fig. 1 shows that a video playing method according to an embodiment of the present application is applied to a video playing system, the video playing system is connected to a browser and a video terminal, the video terminal is used for acquiring video data and uploading the video data to the video playing system, such as real-time video streaming, etc., the video playing system is used for executing the video playing method to process the video data uploaded by the video terminal and send the processed video data to the browser, and the browser is used for playing the video data sent by the video playing system on a webpage, such as live video, etc., so that the video playing requirement on the browser is met under the condition that a Flash Player is disabled.

Fig. 1 is a flowchart of an embodiment of a video playing method of the present application, and as shown in fig. 1 and fig. 2, the video playing method may include:

s101, receiving a video playing request sent by the browser.

For example, a browser, such as a web browser, may log in the browser by a user, execute a video playing operation, and send a video playing request to a video playing system in response to the video playing operation by the user, where the video playing request is used to request to play a video, such as live video. The browser may include a player for playing video, and the operation of playing video may include a user opening a play button of the browser player, and the like.

In contrast to the Flash Player, in the present embodiment, the Player of the browser may be used to perform video decoding playing on video data transmitted based on a non-RTMP protocol (such as RTSP, HLS protocol, etc.), and preferably, the Player is an open source Player, such as flv.

Further, the player may include a plurality of playing ports and a playing port identifier corresponding to each playing port, each playing port is used for playing a video, and a user may select one or more playing ports to play the video respectively. The video playing request may include a playing port identifier, such as a number, a channel, a name, and the like of the playing port.

And S102, responding to the video playing request, and sending a video calling request to the video terminal, wherein the video calling request is used for requesting the video terminal to upload video data.

That is, the video terminal may include an image pickup device for picking up video data such as a video stream or the like photographed in real time and storing the video data in the memory of the video terminal in the first format. The video terminal is, for example, a vehicle-mounted terminal, a monitoring device, a mobile phone, a computer, a cell system in which a camera device is arranged, a company system, a city monitoring system, or a traffic system. The first format is a video compression format, such as H.264, H.265, etc., H.264 is a new generation digital video compression format following MPEG4, which is commonly proposed by the International organization for standardization (ISO) and the International Telecommunication Union (ITU), H.265 is a new video coding standard established following H.264 by ITU-T VCEG, and the storage space of video data can be greatly reduced by adopting the video compression format.

The video playing system may include a corresponding relationship between the playing port identifier and the video terminal, so as to send a video call request to the video terminal corresponding to the playing port identifier, where the video call request may include an IP address and a data transmission port required for uploading video data, so that the video terminal establishes a network connection with the video playing system through the IP address and the data transmission port, thereby implementing transmission of the video data. The video terminal is connected to the IP address and the data transmission port of the video playing system in a wired or wireless mode, and after receiving a video calling request sent by the video playing system, the video terminal sends video data in a first format to the video playing system.

Further, the video call request may further include a video playing time or a video playing time period, and the like, which is used to request video data corresponding to the video playing time or the video playing time period. The video data corresponding to the video play time is used to indicate video data or the like that the video terminal has shot in real time from the video play time. The video data corresponding to the video playing time period is used for representing the video data and the like shot by the video terminal in the video playing data period.

S103, receiving video data sent by the video terminal, wherein the video data comprises a first format.

That is, the video data received by the video playing system is in the first format. The first format is preferably a video compression format, which can improve the video data transmission efficiency.

S104, converting the first format of the video data into a second format, wherein the video data in the second format is used for playing by a player of the browser.

Since the video data in the first format cannot be decoded and played by the player of the browser, in order to meet the requirement or compatibility of the playing format of the player of the browser, in this embodiment, the video playing system converts the video data in the first format uploaded by the video terminal into the video data in the second format (the format that can be decoded and played by the player of the browser) by using a coding and decoding algorithm. Preferably, the second format is flv (flash video) format or the like, which is a format that can be decoded and played by an open source player.

S105, sending the video data in the second format to the browser so that a player of the browser can play the video data in the second format.

That is to say, after the browser receives the video data in the second format, the player decodes and plays the video data in the second format, so that the video playing requirement in the browser can be met.

In one possible implementation manner, step S105 may include:

s201, generating a video playing address corresponding to the video data in the second format;

s202, sending the video playing address to the browser;

s203, receiving a video transmission request sent by the browser;

and S204, responding to the video transmission request, and sending the video data in the second format to the browser.

That is, the video playing address is used to indicate a web page link (e.g., a URL link, etc.) generated by the video playing system through a certain naming rule for each piece of video data in the second format, where the web page link is wss:// rxcx.cu-sc.com:8080/live port 11935& app ═ live & stream _018010607034_ 1. Each video playing address corresponds to one playing port or playing channel of the player, and the browser makes a video transmission request through the video playing address, that is, the browser can request the video data in the second format, so that video playing is performed through the playing port of the player corresponding to the video playing address.

In one possible implementation manner, the length of the video data is not carried in the video transmission request, and step S204 may include:

s301, responding to the video transmission request, and establishing a data transmission channel with the browser;

s302, continuously transmitting the video data in the second format to the browser through the data transmission channel.

Preferably, the video playing system transmits the video data to the browser by using an http FLV protocol, which is a code stream transfer protocol for carrying the video data (e.g., the video data in the FLV format) on the http protocol. Video transmission requests such as GET http request, which is a general method of http request, require specifying the length of video data to be transmitted this time. Or, the length of the video data not carried in the video transmission request is used to indicate the length of the video data not required to be transmitted, so that the video data can be transmitted as an infinite file in an FLV format. The infinite is used to indicate that the video data is continuously transmitted during the video playing process, and the size of the video data or the duration of the video playing cannot be predicted.

That is to say, before transmitting video data, the browser sends a GET http request to the video playing system through the video playing address, and (if the video playing address is correct), after responding to the request, the video playing system establishes a data transmission channel (such as a TCP connection channel or a websocket connection channel) with the browser, and continuously transmits the video data to the browser through the data transmission channel, so that the browser can continuously receive the video data, decode and play the video data, and realize the live video effect.

Optionally, the video transmission request may further include a video playing time length, where the video playing time length is used to indicate a time length for transmitting video data, and when the cumulative time length for playing the video by the browser reaches the video playing time length, the video playing system stops transmitting the video data to the browser, so that the browser plays the video data with a fixed time length or size.

In one possible implementation manner, the method further includes:

and S303, if the player of the browser stops playing, stopping sending the video data in the second format to the browser.

That is, the user can perform a stop play operation on the browser, such as closing the browser or the player, or pausing a play button of the player, or the like. In response to the user stopping the play operation, the browser stops requesting the video data. And if the video playing system monitors that the browser stops requesting the video data, the video playing system stops sending the video data to the browser.

It is to be understood that some or all of the steps or operations in the above-described embodiments are merely examples, and other operations or variations of various operations may be performed by the embodiments of the present application. Further, the various steps may be performed in a different order presented in the above-described embodiments, and it is possible that not all of the operations in the above-described embodiments are performed.

Fig. 3 is a schematic method diagram illustrating another embodiment of the video playing method according to the present application, where the video playing method is applied to a browser, and the browser establishes a connection with a video playing system. As shown in fig. 3, the video playing method includes:

s401, responding to video playing operation of a user, and sending a video playing request to the video playing system;

s402, receiving a video playing address sent by the video playing system, wherein the video playing address corresponds to video data;

s403, sending a video transmission request to the video playing system according to the video playing address;

s404, receiving and playing the video data sent by the video playing system.

Referring to the video playing method of the embodiment of the method shown in fig. 1, the browser may include a player, which may be used to perform video decoding playing on video data transmitted based on a non-RTMP protocol (such as RTSP, HLS protocol, etc.), and preferably, the player is an open source player, such as flv. The format of the video data received by the browser is the second format, such as flv (flash video) format, which is a format that can be decoded and played by an open source player.

That is to say, a video transmission request such as an http request and the like is sent to the video playing system by the browser through the video playing address, and after responding to the request, (if the video playing address is correct) the video playing system establishes a data transmission channel (such as a TCP connection channel or a websocket connection channel and the like) with the browser, and continuously transmits the video data to the browser through the data transmission channel, so that the browser can continuously receive the video data and perform decoding and playing, thereby realizing the effect of live video.

It is to be understood that some or all of the steps or operations in the above-described embodiments are merely examples, and other operations or variations of various operations may be performed by the embodiments of the present application. Further, the various steps may be performed in a different order presented in the above-described embodiments, and it is possible that not all of the operations in the above-described embodiments are performed.

Fig. 4 is a schematic structural diagram of an embodiment of the video playback system 100 of the present application. As shown in fig. 4, the video player system 100 may include:

a playing request module 10, configured to receive a video playing request sent by the browser;

the video calling module 20 is configured to send a video calling request to the video terminal in response to the video playing request, where the video calling request is used to request the video terminal to upload video data;

a video receiving module 30, configured to receive video data sent by the video terminal, where the video data includes a first format;

a format conversion module 40, configured to convert the first format of the video data into a second format, where the video data in the second format is used for being played by a player of the browser;

a video sending module 50, configured to send the video data in the second format to the browser, so that a player of the browser plays the video data in the second format.

In one possible implementation manner, the player of the browser is an open source player, the first format is a video compression format, and the second format is a format in which the open source player performs video decoding playing.

In one possible implementation manner, the video sending module 50 is further configured to:

generating a video playing address corresponding to the video data in the second format;

sending the video playing address to the browser;

receiving a video transmission request sent by the browser;

and sending the video data in the second format to the browser in response to the video transmission request.

In one possible implementation manner, the video transmission request does not carry the length of the video data, and the video sending module 50 is further configured to:

responding to the video transmission request, and establishing a data transmission channel with the browser;

and continuously transmitting the video data in the second format to the browser through the data transmission channel.

In one possible implementation manner, the video sending module 50 is further configured to:

and if the player of the browser stops playing, stopping sending the video data in the second format to the browser.

The video playing system shown in fig. 4 can be used to execute the functions/steps in the method provided by the embodiment shown in fig. 1 of the present application, and will not be described herein again.

It should be understood that the division of the modules of the video playing system shown in fig. 4 is merely a logical division, and the actual implementation may be wholly or partially integrated into one physical entity, or may be physically separated. And these modules can be realized in the form of software called by processing element; or may be implemented entirely in hardware; and part of the modules can be realized in the form of calling by the processing element in software, and part of the modules can be realized in the form of hardware. For example, the video transmission module may be a separate processing element, or may be integrated into a chip of the electronic device. Other modules are implemented similarly. In addition, all or part of the modules can be integrated together or can be independently realized. In implementation, each step of the above method or each module above may be implemented by an integrated logic circuit of hardware in a processor element or an instruction in the form of software.

For example, the above modules may be one or more integrated circuits configured to implement the above methods, such as: one or more Application Specific Integrated Circuits (ASICs), one or more microprocessors (DSPs), one or more Field Programmable Gate Arrays (FPGAs), etc. For another example, these modules may be integrated together and implemented in the form of a System-On-a-Chip (SOC).

Fig. 5 is a schematic structural diagram of an embodiment of an electronic device according to the present application, and as shown in fig. 5, the electronic device may include: one or more processors; a memory; and one or more computer programs.

The electronic device may be a video playing device, a server, a browser, or the like.

Wherein the one or more computer programs are stored in the memory, the one or more computer programs comprising instructions which, when executed by the apparatus, cause the apparatus to perform the steps of:

receiving a video playing request sent by a browser;

responding to the video playing request, and sending a video calling request to the video terminal, wherein the video calling request is used for requesting the video terminal to upload video data;

receiving video data transmitted by the video terminal, the video data including a first format;

converting the first format of the video data into a second format, wherein the video data in the second format is used for being played by a player of the browser;

and sending the video data in the second format to the browser so that a player of the browser can play the video data in the second format.

In one possible implementation manner, the player of the browser is an open source player, the first format is a video compression format, and the second format is a format in which the open source player performs video decoding playing.

In one possible implementation manner, when the instruction is executed by the apparatus, the apparatus is caused to perform the sending of the video data in the second format to the browser, and the sending includes:

generating a video playing address corresponding to the video data in the second format;

sending the video playing address to the browser;

receiving a video transmission request sent by the browser;

and sending the video data in the second format to the browser in response to the video transmission request.

In a possible implementation manner, the length of the video data is not carried in the video transmission request, and when the instruction is executed by the apparatus, the apparatus is caused to execute the sending, to the browser, the video data in the second format in response to the video transmission request, where the sending includes:

responding to the video transmission request, and establishing a data transmission channel with the browser;

and continuously transmitting the video data in the second format to the browser through the data transmission channel.

In one possible implementation manner, when the instruction is executed by the apparatus, the apparatus is further caused to perform:

and if the player of the browser stops playing, stopping sending the video data in the second format to the browser.

In one possible implementation manner, when the instruction is executed by the apparatus, the apparatus is further caused to perform:

responding to the video playing operation of a user, and sending a video playing request to the video playing system;

receiving a video playing address sent by the video playing system, wherein the video playing address corresponds to video data;

sending a video transmission request to the video playing system according to the video playing address;

and receiving and playing the video data sent by the video playing system.

The electronic device shown in fig. 5 may be a terminal device or a circuit device built in the terminal device. The apparatus may be used to perform the functions/steps of the method provided by the embodiment of fig. 1 of the present application.

As shown in fig. 5, the electronic device 900 includes a processor 910 and a memory 920. Wherein, the processor 910 and the memory 920 can communicate with each other through the internal connection path to transmit control and/or data signals, the memory 920 is used for storing computer programs, and the processor 910 is used for calling and running the computer programs from the memory 920.

The memory 920 may be a read-only memory (ROM), other types of static storage devices that can store static information and instructions, a Random Access Memory (RAM), or other types of dynamic storage devices that can store information and instructions, an electrically erasable programmable read-only memory (EEPROM), a compact disc read-only memory (CD-ROM) or other optical disc storage, optical disc storage (including compact disc, laser disc, optical disc, digital versatile disc, blu-ray disc, etc.), magnetic disc storage media or other magnetic storage devices, or any other medium that can be used to carry or store desired program code in the form of instructions or data structures and that can be accessed by a computer, etc.

The processor 910 and the memory 920 may be combined into a processing device, and more generally, independent components, and the processor 910 is configured to execute the program codes stored in the memory 920 to realize the functions. In particular implementations, the memory 920 may be integrated with the processor 910 or may be separate from the processor 910.

It should be understood that the electronic device 900 shown in fig. 5 is capable of implementing the processes of the methods provided by the embodiments shown in fig. 1 of the present application. The operations and/or functions of the respective modules in the electronic device 900 are respectively for implementing the corresponding flows in the above-described method embodiments. Reference may be made specifically to the description of the embodiment of the method illustrated in fig. 1 of the present application, and a detailed description is appropriately omitted herein to avoid redundancy.

It should be understood that the processor 910 in the electronic device 900 shown in fig. 5 may be a system on chip SOC, and the processor 910 may include a Central Processing Unit (CPU), and may further include other types of processors, such as: an image Processing Unit (hereinafter, referred to as GPU), and the like.

In summary, various portions of the processors or processing units within the processor 910 may cooperate to implement the foregoing method flows, and corresponding software programs for the various portions of the processors or processing units may be stored in the memory 930.

The application also provides an electronic device, the device includes a storage medium and a central processing unit, the storage medium may be a non-volatile storage medium, a computer executable program is stored in the storage medium, and the central processing unit is connected with the non-volatile storage medium and executes the computer executable program to implement the method provided by the embodiment shown in fig. 1 of the application.

In the above embodiments, the processors may include, for example, a CPU, a DSP, a microcontroller, or a digital Signal processor, and may further include a GPU, an embedded Neural Network Processor (NPU), and an Image Signal Processing (ISP), and the processors may further include necessary hardware accelerators or logic Processing hardware circuits, such as an ASIC, or one or more integrated circuits for controlling the execution of the program according to the technical solution of the present application. Further, the processor may have the functionality to operate one or more software programs, which may be stored in the storage medium.

Embodiments of the present application further provide a computer-readable storage medium, in which a computer program is stored, and when the computer program runs on a computer, the computer is enabled to execute the method provided by the embodiment shown in fig. 1 of the present application.

Embodiments of the present application also provide a computer program product, which includes a computer program, when the computer program runs on a computer, causing the computer to execute the method provided by the embodiment shown in fig. 1 of the present application.

In the embodiments of the present application, "at least one" means one or more, "a plurality" means two or more. "and/or" describes the association relationship of the associated objects, and means that there may be three relationships, for example, a and/or B, and may mean that a exists alone, a and B exist simultaneously, and B exists alone. Wherein A and B can be singular or plural. The character "/" generally indicates that the former and latter associated objects are in an "or" relationship. "at least one of the following" and similar expressions refer to any combination of these items, including any combination of singular or plural items. For example, at least one of a, b, and c may represent: a, b, c, a and b, a and c, b and c or a and b and c, wherein a, b and c can be single or multiple.

Those of ordinary skill in the art will appreciate that the various elements and algorithm steps described in connection with the embodiments disclosed herein can be implemented as electronic hardware, computer software, or combinations of electronic hardware. Whether such functionality is implemented as hardware or software depends upon the particular application and design constraints imposed on the implementation. Skilled artisans may implement the described functionality in varying ways for each particular application, but such implementation decisions should not be interpreted as causing a departure from the scope of the present application.

It is clear to those skilled in the art that, for convenience and brevity of description, the specific working processes of the above-described systems, apparatuses and units may refer to the corresponding processes in the foregoing method embodiments, and are not described herein again.

In the several embodiments provided in the present application, any function, if implemented in the form of a software functional unit and sold or used as a separate product, may be stored in a computer readable storage medium. Based on such understanding, the technical solution of the present application or portions thereof that substantially contribute to the prior art may be embodied in the form of a software product stored in a storage medium and including instructions for causing a computer device (which may be a personal computer, a server, or a network device) to execute all or part of the steps of the method according to the embodiments of the present application. And the aforementioned storage medium includes: a U disk, a removable hard disk, a Read-Only Memory (ROM), a Random Access Memory (RAM), a magnetic disk or an optical disk, and other various media capable of storing program codes.

The above description is only for the specific embodiments of the present application, and any person skilled in the art can easily conceive of the changes or substitutions within the technical scope of the present disclosure, and all the changes or substitutions should be covered by the protection scope of the present application. The protection scope of the present application shall be subject to the protection scope of the claims.