阅读说明：本技术 专网下ims在媒体协商后向用户放音的方法及ims (Method for IMS (IP multimedia subsystem) under private network to play audio to user after media negotiation and IMS ) 是由 马圆圆 张增涛 楚彬 于 2018-08-17 设计创作，主要内容包括：本发明实施例公开一种专网下IMS在媒体协商后向用户放音的方法及IMS,能实现专网中IMS与媒体“不干预”模式下的放音业务。方法包括：S1、在被叫用户设备挂机后,IMS通过向主叫用户设备发起媒体协商,获取媒体协商结果；S2、所述IMS根据所述媒体协商结果获取对应的放音媒体资源,利用所述放音媒体资源对所述主叫用户设备进行放音。(The embodiment of the invention discloses a method for playing a sound to a user by an IMS (IP multimedia subsystem) after media negotiation in a private network and the IMS, which can realize a sound playing service in a mode of 'no interference' between the IMS and media in the private network. The method comprises the following steps: s1, after the called user equipment hangs up, the IMS obtains the media negotiation result by initiating the media negotiation to the calling user equipment; and S2, the IMS acquires the corresponding playback media resource according to the media negotiation result, and plays the sound of the calling user equipment by using the playback media resource.)

1. A method for playing back audio to a user after media negotiation by an Internet protocol multimedia subsystem under a private network is characterized by comprising the following steps:

s1, after the called user device hangs up, the Internet protocol multimedia subsystem initiates media negotiation to the calling user device to obtain the result of media negotiation;

and S2, the Internet protocol multimedia subsystem acquires the corresponding playback media resource according to the media negotiation result, and plays the sound to the calling user equipment by using the playback media resource.

2. The method of claim 1, wherein if the calling user equipment and the called user equipment cannot directly communicate with each other,

the playing the calling user equipment by using the playing media resource comprises the following steps:

the internet protocol multimedia subsystem plays the sound of the calling user equipment by using the sound playing media resource and a media channel between the calling user equipment and the internet protocol multimedia subsystem established before the called user equipment hangs up.

3. The method of claim 2, wherein the internet protocol multimedia subsystem obtains the media negotiation result by initiating media negotiation to the calling user equipment, comprising:

the internet protocol multimedia subsystem generates a session description protocol negotiation message and sends the session description protocol negotiation message to the calling user equipment, so that the calling user equipment performs media negotiation with the internet protocol multimedia subsystem according to the session description protocol negotiation message, refreshing the media channel between the Internet protocol multimedia subsystem and the media negotiation result according to the media negotiation result, feeding back the media negotiation result, wherein the session description protocol negotiation message comprises the address of the media channel established by the internet protocol multimedia subsystem on the calling user equipment side before the called user equipment hangs up and all media formats supported by the internet protocol multimedia subsystem, the media negotiation result comprises a negotiation result of the media address and the media format of the calling user equipment;

the internet protocol multimedia subsystem acquires corresponding playback media resources according to the media negotiation result, and the method comprises the following steps:

the Internet protocol multimedia subsystem acquires a corresponding playback media resource according to the negotiation result of the media format;

the internet protocol multimedia subsystem plays the sound of the calling user equipment by utilizing the sound playing media resource and a media channel between the calling user equipment and the internet protocol multimedia subsystem established before the called user equipment hangs up, and the method comprises the following steps:

the internet protocol multimedia subsystem determines the media channel according to the media address of the calling user equipment, and the playback media resource and the media channel are used for playing the playback to the calling user equipment.

4. The method of claim 1, wherein if the calling user equipment and the called user equipment can directly communicate with each other,

before the playing back is performed on the calling user equipment by using the playing back media resource, the method further comprises the following steps:

the internet protocol multimedia subsystem establishes a media channel with the calling user equipment;

wherein, the playing the calling user equipment by using the playing media resource comprises:

and the Internet protocol multimedia subsystem plays the sound of the calling user equipment by utilizing the sound playing media resource and the media channel.

5. The method of claim 4, wherein the internet protocol multimedia subsystem obtains the media negotiation result by initiating media negotiation to the calling user equipment, comprising:

the Internet protocol multimedia subsystem obtains the media address of the Internet protocol multimedia subsystem by applying for the media resource of the local side;

the internet protocol multimedia subsystem generates a session description protocol negotiation message according to a media address of the internet protocol multimedia subsystem, and sends the session description protocol negotiation message to the calling user equipment, so that the calling user equipment performs media negotiation with the internet protocol multimedia subsystem according to the session description protocol negotiation message, updates a media channel to a media channel between the calling user equipment and the internet protocol multimedia subsystem, and feeds back a media negotiation result, wherein the session description protocol negotiation message comprises the media address of the internet protocol multimedia subsystem and all media formats supported by the internet protocol multimedia subsystem, and the media negotiation result comprises the media address of the calling user equipment and the negotiation result of the media formats;

wherein the internet protocol multimedia subsystem establishes a media channel with the calling user equipment, comprising:

the Internet protocol multimedia subsystem establishes a media channel with the calling user equipment according to the media address of the calling user equipment;

the internet protocol multimedia subsystem obtains the corresponding playback media resource according to the media negotiation result, and comprises the following steps:

and the Internet protocol multimedia subsystem acquires the corresponding playback media resource according to the negotiation result of the media format.

6. The method according to claim 1, prior to the S1, further comprising:

after the calling user equipment and the called user equipment finish media negotiation, the Internet protocol multimedia subsystem receives a 180 message sent by the called user equipment and sends the 180 message to the calling user equipment;

and the Internet protocol multimedia subsystem receives the 4XX message sent by the called user equipment and replies a confirmation message to the called user equipment.

7. The method of claim 1, further comprising:

and after the playback is finished, the Internet protocol multimedia subsystem sends a 4XX message to the calling user equipment and receives a confirmation message replied by the calling user equipment.

8. An internet protocol multimedia subsystem, comprising:

the obtaining unit is used for obtaining a media negotiation result by initiating media negotiation to the calling user equipment after the called user equipment hangs up;

and the playback unit is used for acquiring corresponding playback media resources according to the media negotiation result and playing the playback of the calling user equipment by using the playback media resources.

9. An electronic device, comprising: a processor, a memory, a bus, and a computer program stored on the memory and executable on the processor;

the processor and the memory complete mutual communication through the bus;

the processor, when executing the computer program, implements the method of any of claims 1-7.

10. A non-transitory computer-readable storage medium, characterized in that the storage medium has stored thereon a computer program which, when executed by a processor, implements the method of any one of claims 1-7.

Technical Field

The embodiment of the invention relates to the technical field of communication, in particular to a method for playing a sound to a user after media negotiation of an Internet protocol multimedia Subsystem (IMS) under a private network and the IMS.

Background

In the existing private network, in the IMS session establishment process, when a calling party and a called party can not communicate with each other, the IMS only forwards media and does not participate in media negotiation and transcoding, and after the calling party and the called party complete the negotiation, the IMS has a media channel but does not negotiate with a calling party for media encoding and decoding, so that the calling party can not be played; when the calling party and the called party can be intercommunicated, the IMS completely does not interfere with media, namely does not participate in media negotiation, does not transcode and does not forward media streams, and after the calling party and the called party complete negotiation, the IMS and the calling party have no media channel, so that the user can not be played.

The existing IMS playback technology can play the audio to the user, but the existing IMS playback technology is not compatible with the session flow of the existing private network because the media channel is not refreshed again; meanwhile, the requirements of high performance and low cost of a private network cannot be met. Therefore, the existing playback technology cannot be applied to a private network.

Disclosure of Invention

Aiming at the defects and shortcomings of the prior art, the embodiment of the invention provides a method for playing a voice to a user after media negotiation of an IMS under a private network and the IMS.

On one hand, the embodiment of the invention provides a method for playing back a sound to a user after media negotiation by an IMS under a private network, which comprises the following steps:

s1, after the called user equipment hangs up, the IMS obtains the media negotiation result by initiating the media negotiation to the calling user equipment;

and S2, the IMS acquires the corresponding playback media resource according to the media negotiation result, and plays the sound of the calling user equipment by using the playback media resource.

In another aspect, an embodiment of the present invention provides an IMS, including:

the obtaining unit is used for obtaining a media negotiation result by initiating media negotiation to the calling user equipment after the called user equipment hangs up;

and the playback unit is used for acquiring corresponding playback media resources according to the media negotiation result and playing the playback of the calling user equipment by using the playback media resources.

In a third aspect, an embodiment of the present invention provides an electronic device, including: a processor, a memory, a bus, and a computer program stored on the memory and executable on the processor;

the processor and the memory complete mutual communication through the bus;

the processor, when executing the computer program, implements the method described above.

In a fourth aspect, an embodiment of the present invention provides a non-transitory computer-readable storage medium, on which a computer program is stored, and the computer program, when executed by a processor, implements the above method.

The IMS under the private network and the method for playing the sound to the user after the media negotiation and the IMS provided by the embodiment of the invention have the advantages that after the called user equipment hangs up, the IMS initiates the media negotiation to the calling user equipment to obtain the media negotiation result; the IMS acquires corresponding playback media resources according to the media negotiation result, and plays the sound to the calling user equipment by using the playback media resources, compared with the prior art, the scheme can be compatible with the private network conversation process by performing media negotiation with the calling user equipment after the called user equipment is hung up and performing the sound playing according to the media negotiation result, and can avoid the problem that the existing playback method cannot be compatible with the conversation process of the existing private network because the media channel is not refreshed again; in addition, the IMS and the media are not interfered in the playing process, so that the requirements of low cost, high performance and high quality of a private network can be met, and the playing service in the mode of no interference between the IMS and the media in the private network is realized.

Drawings

Fig. 1 is a schematic flow chart illustrating an embodiment of a method for playing a voice to a user after media negotiation in an IMS under a private network according to the present invention;

FIG. 2 is a flow chart of IMS playing to a user, wherein the calling party and the called party can not intercommunicate;

FIG. 3 is a flow chart of the calling and called parties being able to communicate and IMS playing the sound to the user;

FIG. 4 is a schematic structural diagram of an IMS according to an embodiment of the present invention;

fig. 5 is a schematic physical structure diagram of an electronic device according to an embodiment of the present invention.

Detailed Description

In order to make the objects, technical solutions and advantages of the embodiments of the present invention clearer, the technical solutions in the embodiments of the present invention will be clearly described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are some embodiments, but not all embodiments, of the present invention. All other embodiments obtained by a person of ordinary skill in the art based on the embodiments of the present invention without any creative effort belong to the protection scope of the embodiments of the present invention.

Referring to fig. 1, the present embodiment discloses a method for playing a voice to a user after a media negotiation in an IMS under a private network, including:

s1, after the called user equipment hangs up, the IMS obtains the media negotiation result by initiating the media negotiation to the calling user equipment;

and S2, the IMS acquires the corresponding playback media resource according to the media negotiation result, and plays the sound of the calling user equipment by using the playback media resource.

The method for playing the voice to the user after the IMS negotiates the media under the private network provided by the embodiment of the invention has the advantages that after the called user equipment hangs up, the IMS initiates the media negotiation to the calling user equipment to obtain the media negotiation result; the IMS acquires corresponding playback media resources according to the media negotiation result, and plays the sound to the calling user equipment by using the playback media resources, compared with the prior art, the scheme can be compatible with the private network conversation process by performing media negotiation with the calling user equipment after the called user equipment is hung up and performing the sound playing according to the media negotiation result, and can avoid the problem that the existing playback method cannot be compatible with the conversation process of the existing private network because the media channel is not refreshed again; in addition, the IMS and the media are not interfered in the playing process, so that the requirements of low cost, high performance and high quality of a private network can be met, and the playing service in the mode of no interference between the IMS and the media in the private network is realized.

On the basis of the foregoing method embodiment, if the calling user equipment and the called user equipment cannot directly communicate with each other,

the playing the sound to the calling user equipment by using the playing media resource may include:

and the IMS carries out sound reproduction on the calling user equipment by utilizing the sound reproduction media resources and a media channel which is established by the IMS and is arranged between the called user equipment and the calling user equipment before the called user equipment is hung up.

On the basis of the foregoing method embodiment, the obtaining, by the IMS, a media negotiation result by initiating a media negotiation to a calling user equipment may include:

the IMS generates an SDP (Session Description Protocol) negotiation message, and sends the SDP negotiation message to the calling user equipment, so that the calling user equipment performs media negotiation with the IMS according to the SDP negotiation message, refreshes a media channel between the calling user equipment and the IMS according to the media negotiation result, and feeds back a media negotiation result, where the SDP negotiation message may include an address of the media channel established by the IMS on the calling user equipment side before the called user equipment hangs up and all media formats supported by the IMS, and the media negotiation result may include a negotiation result of a media address of the calling user equipment and a media format;

the obtaining, by the IMS, a corresponding playback media resource according to the media negotiation result may include:

the IMS acquires corresponding playback media resources according to the negotiation result of the media format;

the IMS playing the sound to the calling user equipment by using the playback media resource and a media channel between the calling user equipment and the IMS before the called user equipment hangs up, which may include:

and the IMS determines the media channel according to the media address of the calling user equipment and plays the sound of the calling user equipment by using the sound playing media resource and the media channel.

In this embodiment, fig. 2 is a flow chart of the IMS playing the voice to the user, where steps 1 to 4 are media negotiation flows and steps 5 to 14 are playback flows. The following describes each step in detail:

in step 1, the calling User UE1 initiates SDP negotiation by sending an SDP negotiation message SDP _ offer to the IMS, where the SDP negotiation message SDP _ offer carries media codec information media _ UE1 supported by the UE (User Equipment) 1 and a media address ipport _ UE1 of the UE 1.

Step 2, after receiving SDP negotiation message SDP _ offer sent by UE1, IMS stores media address ipport _ UE1 of UE1, and cannot determine that UE1 and called UE2 can directly communicate with each other through user registration information, and IMS establishes a media channel for UE 2. Based on the principle of no transcoding, the IMS does not modify the codec information carried in the SDP negotiation message SDP _ offer sent by the UE1, only modifies ipport _ UE1 to the address ipport _ IMS2 of the media channel established by the IMS for the UE2, and then sends the modified SDP negotiation message SDP _ offer to the UE 2.

Step 3, after receiving SDP negotiation message SDP _ offer sent by IMS, UE2 performs media codec negotiation with UE1, generates SDP _ answer message containing negotiation result mediaodec _ UE1_ UE2 and media address ipport _ UE2 of UE2, and returns SDP _ answer message to IMS.

Step 4, after receiving the SDP _ answer message, the IMS stores the media address ipport _ UE2 of the UE2, establishes a media channel for the UE1, generates an SDP message including the address ipport _ IMS1 of the media channel established for the UE1 and the negotiation result mediaodec _ UE1_ UE2, and sends the SDP message to the UE 1.

It should be noted that, in the above steps 1 to 4, the existing flow of the private network is followed, and the media negotiation process of the calling and called parties may be composed of multiple signaling, or may be circulated for multiple times, depending on different services and terminals. At this time, the IMS can forward the media, but the IMS does not negotiate the media codec with the calling user.

Step 5-6, ringing the UE2, including: UE2 sends 180 message to IMS; the IMS sends the 180 message to the UE 1.

7-8, hanging up the UE2, and ending the UE2 call by the IMS, wherein the method comprises the following steps: UE2 sends a 4XX message to the IMS; IMS replies to an ACK (Acknowledgement message).

Step 9, the IMS sends an sdp _ offer message of media negotiation (carrying addresses ipport _ IMS1 of all media formats and media channels supported by the IMS) to the UE1 to perform a media format negotiation procedure, thereby ensuring that the IMS can play back to the UE 1.

As for step 9, it can be understood that, after receiving the 4XX message from the UE2, the IMS needs to play a media to the UE1, and at this time, although the IMS establishes a media channel with the UE1, the IMS does not negotiate the media coding format with the UE1 and cannot play a media to the UE1, so that it needs to negotiate the media coding format with the UE1 first.

In step 10, after receiving the sdp _ offer message, the UE1 negotiates the media format with the IMS, refreshes the media channel according to the negotiation result of the media format, and returns an sdp _ answer message carrying the negotiation result of the media format, media _ IMS _ UE1, and the media address ipport _ UE1 of the UE 1.

Step 11, the IMS prepares playback media resources in a corresponding format according to the negotiation result mediaodec _ IMS _ UE1 in the media format returned by the UE 1.

In step 12, the IMS determines a media channel with the UE1 according to the media address ipport _ UE1 of the UE1, and plays an audio stream to the UE1 through the media channel.

And step 13, after the playback is finished, the IMS replies a 4XX message to the UE 1.

At step 14, the UE1 replies with an ACK message to the IMS.

On the basis of the foregoing method embodiment, if the calling user equipment and the called user equipment can directly communicate with each other,

before the playing back the calling user equipment by using the playing back media resource, the method may further include:

the IMS establishes a media channel with the calling user equipment;

the playing the sound to the calling user equipment by using the playing media resource may include:

and the IMS carries out playback on the calling user equipment by utilizing the playback media resources and the media channel.

On the basis of the foregoing method embodiment, the obtaining, by the IMS, a media negotiation result by initiating a media negotiation to a calling user equipment may include:

the IMS acquires a media address of the IMS by applying for the media resources of the IMS side;

the IMS generates an SDP negotiation message according to the media address of the IMS, and sends the SDP negotiation message to the calling party device, so that the calling party device performs media negotiation with the IMS according to the SDP negotiation message, updates a media channel to a media channel between the calling party device and the IMS, and feeds back a media negotiation result, where the SDP negotiation message may include the media address of the IMS and all media formats supported by the IMS, and the media negotiation result may include a negotiation result of the media address and the media format of the calling party device;

the IMS establishing a media channel with the calling user equipment may include:

the IMS establishes a media channel with the calling user equipment according to the media address of the calling user equipment;

the obtaining, by the IMS, a corresponding playback media resource according to the media negotiation result may include:

and the IMS acquires the corresponding playback media resource according to the negotiation result of the media format.

In this embodiment, fig. 3 is a flow chart of the interworking between the calling and called parties and the playback from the IMS to the user, where steps 1 to 4 are media negotiation flows and steps 5 to 15 are playback flows. The following describes each step in detail:

step 1, the UE1 initiates SDP negotiation, carrying media codec information supported by the UE1 and the media address of the UE 1.

Step 2, the IMS receives the SDP negotiation initiated by the UE1, determines that the calling user UE1 and the UE2 can communicate directly through the user registration information, and forwards the SDP information carried by the UE1 to the UE2 based on the non-transcoding principle. The IMS need not establish a media channel for the UE 2.

Step 3, the called UE2 performs media codec negotiation with the UE1, and returns the negotiation result and the media address of the UE2 to the IMS.

Step 4, the IMS forwards the negotiation result of UE2 and UE1 to UE 1. The IMS need not establish a media channel for the UE 1.

And step 5, after the call is connected, the UE2 and the UE1 directly send and receive the media stream, and the media stream does not pass through the IMS.

And 1-4, following the existing flow of the private network, wherein the negotiation process of the calling and called media may be composed of a plurality of signaling or can be circulated for a plurality of times according to different services and terminals. At this time, the IMS does not intervene in the media at all, does not apply for media resources, and does not negotiate the media format.

And 5-6, ringing the called user.

And 7-8, the called party hangs up, and the IMS finishes the calling of the called party.

Step 9, after receiving the called 4XX, the IMS needs to play the sound to the calling party, and at this time, no media channel is established between the IMS and the UE1, and no negotiation of the media coding format is performed with the UE1, and the sound cannot be played to the calling UE 1. The patent proposes that the IMS applies for the media resource of the local side at this time, and sends sdp _ offer to the calling party to perform the procedures of media channel establishment and media format negotiation, thereby ensuring that the IMS can play the sound to the calling party.

Step 10, the IMS sends sdp _ offer (carrying the new media address information, all supported media formats, etc. of the IMS) to the caller.

In step 11, after receiving sdp _ offer, the calling UE1 performs media format negotiation with the IMS, updates the media channel (from the media channel with UE2 to the media channel with IMS), and returns the result of the media format negotiation with the media address of UE1 using sdp _ answer.

Step 12, the IMS establishes a media channel with the UE1 according to the media address returned by the calling UE 1; the IMS prepares the playback media resources with corresponding formats according to the media format negotiation result returned by the calling UE 1.

Step 13, the IMS plays the audio stream to the calling subscriber.

And step 14, after the playback is finished, the IMS returns a 4XX response to the calling party.

And step 15, the calling party replies ACK.

On the basis of the foregoing method embodiment, before the S1, the method may further include:

after the calling user equipment and the called user equipment complete media negotiation, the IMS receives a 180 message sent by the called user equipment and sends the 180 message to the calling user equipment;

and the IMS receives the first 4XX message sent by the called user equipment and replies a first ACK message to the called user equipment.

The 180 message is a standard signaling message for SIP messages and 180 is a 180ringing message indicating that the called subscriber has rung and the calling subscriber has been able to hear the ringback tone. After the called user rings, the called user can have the on-hook operation, i.e. send 4XX to IMS. 4XX is the signaling message of the called subscriber hanging up, IMS receives the 4XX message of the called subscriber hanging up, the process of playing sound to the calling subscriber, namely IMS receives the 4XX message, it is the precondition of playing sound.

On the basis of the foregoing method embodiment, the method may further include:

and after the playback is finished, the IMS sends a second 4XX message to the calling user equipment and receives a second ACK message replied by the calling user equipment.

Referring to fig. 4, the present embodiment discloses an IMS, including:

the system comprises an acquisition unit 1, a media negotiation unit and a processing unit, wherein the acquisition unit is used for initiating media negotiation to calling user equipment after the called user equipment hangs up;

and the playback unit 2 is used for acquiring a corresponding playback media resource according to the media negotiation result and playing the calling user equipment by using the playback media resource.

Specifically, the obtaining unit 1 obtains a media negotiation result by initiating media negotiation to a calling user equipment after a called user equipment hangs up; the playback unit 2 obtains the corresponding playback media resource according to the media negotiation result, and plays the sound to the calling user equipment by using the playback media resource.

The IMS provided by the embodiment of the invention acquires the 2D image to be processed, and after the called user equipment hangs up, the IMS firstly initiates media negotiation to the calling user equipment by means of the acquisition unit to acquire a media negotiation result; and then, a corresponding playback media resource is obtained by the playback unit according to the media negotiation result, and the playback media resource is utilized to play the sound to the calling user equipment.

The IMS of this embodiment may be configured to implement the technical solution of the foregoing method embodiment, and the implementation principle and the technical effect are similar, which are not described herein again.

Fig. 5 is a schematic entity structure diagram of an electronic device according to an embodiment of the present invention, and as shown in fig. 5, the electronic device may include: a processor 11, a memory 12, a bus 13, and a computer program stored on the memory 12 and executable on the processor 11;

the processor 11 and the memory 12 complete mutual communication through the bus 13;

when the processor 11 executes the computer program, the method provided by the foregoing method embodiments is implemented, for example, including: after the called user equipment hangs up, a media negotiation result is obtained by initiating media negotiation to the calling user equipment; and acquiring a corresponding playback media resource according to the media negotiation result, and playing the calling user equipment by using the playback media resource.

An embodiment of the present invention provides a non-transitory computer-readable storage medium, on which a computer program is stored, where the computer program, when executed by a processor, implements the method provided by the foregoing method embodiments, and for example, the method includes: after the called user equipment hangs up, a media negotiation result is obtained by initiating media negotiation to the calling user equipment; and acquiring a corresponding playback media resource according to the media negotiation result, and playing the calling user equipment by using the playback media resource.

As will be appreciated by one skilled in the art, embodiments of the present application may be provided as a method, system, or computer program product. Accordingly, the present application may take the form of an entirely hardware embodiment, an entirely software embodiment or an embodiment combining software and hardware aspects. Furthermore, the present application may take the form of a computer program product embodied on one or more computer-usable storage media (including, but not limited to, disk storage, CD-ROM, optical storage, and the like) having computer-usable program code embodied therein.

The present application is described with reference to flowchart illustrations and/or block diagrams of methods, apparatus (systems), and computer program products according to embodiments of the application. It will be understood that each flow and/or block of the flow diagrams and/or block diagrams, and combinations of flows and/or blocks in the flow diagrams and/or block diagrams, can be implemented by computer program instructions. These computer program instructions may be provided to a processor of a general purpose computer, special purpose computer, embedded processor, or other programmable data processing apparatus to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable data processing apparatus, create means for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.

These computer program instructions may also be stored in a computer-readable memory that can direct a computer or other programmable data processing apparatus to function in a particular manner, such that the instructions stored in the computer-readable memory produce an article of manufacture including instruction means which implement the function specified in the flowchart flow or flows and/or block diagram block or blocks.

These computer program instructions may also be loaded onto a computer or other programmable data processing apparatus to cause a series of operational steps to be performed on the computer or other programmable apparatus to produce a computer implemented process such that the instructions which execute on the computer or other programmable apparatus provide steps for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.

It is noted that, herein, relational terms such as first and second, and the like may be used solely to distinguish one entity or action from another entity or action without necessarily requiring or implying any actual such relationship or order between such entities or actions. Also, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, an element defined by the phrase "comprising an … …" does not exclude the presence of other identical elements in a process, method, article, or apparatus that comprises the element. The terms "upper", "lower", and the like, indicate orientations or positional relationships based on the orientations or positional relationships shown in the drawings, and are only for convenience in describing the present invention and simplifying the description, but do not indicate or imply that the referred devices or elements must have a specific orientation, be constructed and operated in a specific orientation, and thus, should not be construed as limiting the present invention. Unless expressly stated or limited otherwise, the terms "mounted," "connected," and "connected" are intended to be inclusive and mean, for example, that they may be fixedly connected, detachably connected, or integrally connected; can be mechanically or electrically connected; they may be connected directly or indirectly through intervening media, or they may be interconnected between two elements. The specific meanings of the above terms in the present invention can be understood by those skilled in the art according to specific situations.