阅读说明：本技术 一种大型超市用智能自助一体机方法及装置 (Method and device for intelligent self-service all-in-one machine for large supermarket ) 是由 王东 于 2020-03-08 设计创作，主要内容包括：本发明实施例提供了一种超市用智能自助一体机方法及装置,所述方法包括：由摄像头对购物袋内的商品拍照,将图片传递给中央处理器,通过图像识别系统识别出商品；通过扎口装置对购物袋扎口；扎口后,压力传感器采集到压力得出重量信息,中央处理器计算出总价；将物品名称、单价、重量和总价等相关信息显示在显示屏上,同时由打印装置打印出不贴,不干胶贴打印装置位于称重底盘的漏斗上,将打印出的不干胶贴向上顶出,利用商品的自重,将不干胶贴贴于购物袋底部；最后,弹出商品。另外,在该智能自助一体机上部装有显示器,显示器可以播放广告及显示所称商品信息。通过本发明实施例可以取代大型超市设置的电子秤工作人员,可以为超市降低人工成本。(The embodiment of the invention provides a method and a device for an intelligent self-service all-in-one machine for a supermarket, wherein the method comprises the following steps: the commodity in the shopping bag is photographed by the camera, the picture is transmitted to the central processing unit, and the commodity is identified by the image identification system; tying the shopping bag through a tying device; after tying, the pressure sensor acquires pressure to obtain weight information, and the central processing unit calculates the total price; displaying related information such as article names, unit prices, weights, total prices and the like on a display screen, printing out non-stickers by a printing device, positioning a non-setting adhesive sticker printing device on a hopper of a weighing chassis, ejecting the printed non-setting adhesive sticker upwards, and sticking the non-setting adhesive sticker to the bottom of a shopping bag by using the self weight of a commodity; finally, the article is ejected. In addition, a display is arranged on the upper part of the intelligent self-service all-in-one machine, and the display can play advertisements and display the information of the named commodities. The embodiment of the invention can replace electronic scale workers arranged in a large supermarket and can reduce the labor cost for the supermarket.)

1. A method for recognizing and weighing an intelligent self-service all-in-one machine for a large supermarket is characterized in that the intelligent self-service all-in-one machine comprises the following steps: the counting hook is arranged outside the spinning cone body convenient for hanging the shopping bag; the camera shooting range of the camera is the inside of the shopping bag; the top of the integrated machine is a light source (which can be an LED light source or other light sources with enough brightness) required by light supplement; a tying device for tying the shopping bag (which can be a tying machine using plastic adhesive tapes or other devices capable of realizing the same function); the weighing device is used for weighing the shopping bags (can be a common weighing platform, and can also be other devices such as a pressure sensor and the like which can realize the functions); a print label device (which may be a printer or other method of printing stickers); and the network unit (can connect a plurality of intelligent self-service integrated machines with the cloud server through a network).

2. The intelligent self-service kiosk of claim 1 wherein the kiosk further comprises: the intelligent display is located above the intelligent self-service all-in-one machine, the rotating shaft is connected with the body of the intelligent self-service all-in-one machine, and the camera is additionally arranged on the upper portion of the display and used for photographing and recognizing the customer and drawing images. The display is divided into an upper part and a lower part through related programs: the upper half part is used for playing advertisements, the lower half part displays weighing commodity information (commodity name, unit price, weight, amount and the like), particularly, a camera is arranged above the front face of the display, the camera can collect customer information of the commodity weighed before in real time, after physical and physical features of a customer are collected, the customer information is identified and analyzed by a corresponding program, and accurate advertisement pushing is carried out on the customer.

3. The weighing method of the intelligent self-service all-in-one machine as claimed in claim 1, wherein the weighing method comprises a spinning cone (or called rugby ball, i.e. thin at both ends and thick at the middle) hook or other methods which can open the shopping bag opening by adopting an electrostatic adsorption principle and the like: after the shopping bag is sent into the intelligent self-service all-in-one machine, a camera is started to shoot the commodity in the shopping bag, and the commodity is identified through an image identification system; and acquiring the type of the commodity according to the identification result.

4. The weighing method of claim 3, further comprising building a database of image characteristics, volume characteristics of the commodity.

5. The weighing method of claim 4, wherein the method comprises interacting the captured image with a remote cloud server.

6. After the commodity image is shot and identified, the tying operation is carried out on the shopping bag containing the commodity, and the method is characterized in that plastic adhesive tapes can be selected as consumables but is not limited to the method.

7. Weighing the shopping bag containing the commodity is performed after the tying operation step of claim 6 is completed, and the weight of the commodity is weighed by a weighing sensor.

8. The concentric circle device (can be funnel etc.) on the tray of weighing, its characterized in that includes, prints the non-setting adhesive machine and is located the tray upper portion of weighing, sets up a plurality of concentric circle device in the tray of weighing, and the concentric circle device plays upwards to lift the function of the shopping bag that contains commodity.

9. A network element portion. The intelligent kiosk, as recited in claim 2, comprising, said network element portion of the kiosk is divided into two aspects: on one hand, all the intelligent self-service all-in-one machines are connected with the cloud server to form a network structure, and interaction can be formed between the server and each intelligent self-service all-in-one machine; on the other hand, taking a supermarket as an example, a small local area network is formed among the intelligent self-service all-in-one machines distributed in the supermarket, and a certain intelligent self-service all-in-one machine serves as a host to manage the intelligent self-service all-in-one machines in the small local area network, for example: and uniformly updating commodity information and the like.

Technical Field

The invention belongs to the technical field of artificial intelligence and automation, and particularly relates to a method and a device for an intelligent self-service all-in-one machine for a large supermarket, intelligent display equipment and the field of networks.

Background

With the development of artificial intelligence technology, the artificial intelligence technology is more and more widely applied in industry, people are liberated from mechanical and repeated labor, and the replacement of people by machines is a necessary result brought by the progress of the artificial intelligence technology. In some large supermarkets, various vegetables, fruits, rice, beans and the like are bagged after being personally selected by customers, and then are weighed, sealed and labeled on an electronic scale by supermarket staff. The supermarket staff only need continuous repeated work of simple machinery, meanwhile, because the traditional electronic scale for the supermarket is operated manually, and because the mistake is made by pressing wrong keys and the like, the poor shopping experience is brought to customers. In order to free the weighing staff in the supermarket from such simple and repeated work and also to reduce or even avoid human weighing errors.

Disclosure of Invention

In view of this, the embodiment of the present invention provides a method for hanging a bag from a customer, taking a picture by a camera for identification, tying, weighing, and labeling based on an image identification technology, and a self-service device that is self-service by the customer, so that the intellectualization of the device and the full automation of the weighing process are realized, and supermarket staff can be liberated from simple and repeated work.

In order to achieve the purpose, the embodiment of the invention provides an intelligent self-service all-in-one machine which comprises a spinning cone hook method design for hanging a supermarket shopping bag, a supermarket shopping bag called with commodities is arranged in a closed type method (or a drawer type design or other mode) for isolating from a customer, a plurality of cameras arranged at the top position in the intelligent self-service all-in-one machine are used for designing an automatic opening tying method for the shopping bag after photographing and identification are completed, a weighing platform is arranged on the bottom of the intelligent self-service all-in-one machine, the concentric circles at the innermost side of the weighing platform are provided with a ticket printing function, the shopping bag called with the commodities is pushed upwards after weighing is completed, and self-adhesive stickers are attached to the bottom of the shopping bag by using the self weight of the commodities.

And (3) double network management design of the intelligent self-service all-in-one machine. On one hand, the pictures shot by the camera are uploaded to a remote cloud server through a network unit (according to the quantity and scale of the intelligent self-service all-in-one machine, a single-centralized or multi-centralized wide area network design mode can be adopted); on the other hand, a plurality of intelligent self-service all-in-one machines in each supermarket are interconnected to form a local area network, and a host is arranged so as to conveniently manage commodity information and the like of the intelligent self-service all-in-one machines in the supermarket.

An intelligent display system based on a physical feature recognition technology (including face recognition, body type recognition and the like). The display is located the top of the self-service all-in-one of intelligence, and the display top edge sets up the camera to the appearance characteristic of the customer who comes to weigh before gathering. According to the collected image information, the client is portrait, and advertisements which accord with the identity characteristics of the client are accurately pushed according to the portrait result.

Furthermore, the supermarket shopping bag used at present is slightly modified, holes are punched in the middle of the upper edge of the shopping bag symmetrically (the holes are preferably just thickest through the spinning cone hook) so as to be hung on the spinning cone hook, meanwhile, the shopping bag is marked with a maximum commodity containing volume line (called a max line), and the max line is spaced from the upper edge of the shopping bag by a certain distance and is left with allowance for subsequent tying operation. As shown in particular in figure 1.

Furthermore, the spinning cone-shaped hook for hanging the supermarket shopping bag is designed in shape. As shown in particular in fig. 2. The spinning cone body can ensure that the shopping bag is not easy to fall off after being hung, so that two pieces of the shopping bag are separated, and the shooting by the camera is not blocked. The spinning cone hook is made of materials with smooth surfaces, and when the tying operation is executed, the spinning cone hook can fall off from the hook conveniently.

Furthermore, when shooting and identifying operations are carried out, a plurality of cameras are needed, meanwhile, a fluorescent lamp is used for enhancing a light source, natural light is approached to the maximum extent, color difference during shooting is smaller, the shopping bag is slightly jacked upwards by the smallest concentric circle at the bottom of the weighing table, commodities at the bottom of the shopping bag are pushed upwards, and therefore the shopping bag can be shot comprehensively without dead angles. The camera shoots the commodities in the shopping bag, the shot pictures are sent to the central processing unit, and the shot pictures are compared with the images in the image library so as to obtain the types of the commodities and further obtain the unit price information of the corresponding commodities.

Further, the supermarket shopping bag called with goods is designed in a closed method isolated from customers (or in a drawer type design or in a barrel type or other ways), as shown in fig. 3 and 4. This design can effectively keep apart shopping bag and customer, avoids the human factor to disturb and influences the result of weighing.

Furthermore, the tying machine is positioned in the inner wall of the barrel-type intelligent self-service all-in-one machine (or in the front drawer surface of the drawer-type intelligent self-service all-in-one machine), when photographing identification is finished, a signal is transmitted to the central processing unit, the central processing unit sends a signal to the tying machine, and the tying machine executes tying operation.

Furthermore, after the tying operation is finished, a signal is sent to the central processing unit, a signal for executing the weighing operation is sent by the central processing unit, the weighing result is transmitted to the central processing unit by the pressure sensor in the weighing operation, and the weighing data is processed by the central processing unit.

Furthermore, after the central processing unit processes the data acquired in the previous steps, the printer executes printing operation to print the adhesive sticker with commodity information, the adhesive sticker is positioned on the innermost concentric circle in the weighing platform, the adhesive sticker facing surface with the character information faces downwards, the adhesive sticker faces upwards, a plurality of concentric circles on the weighing platform are gradually slightly jacked up to a certain height, the shopping bag containing the commodities is supported by the concentric circles, and the concentric circles positioned on the innermost layer continue to be jacked up upwards, so that the adhesive sticker is adhered to the bottom of the shopping bag.

Furthermore, after all operations are finished, the intelligent self-service all-in-one machine sends flashing lights and sound signals to the customer to prompt the customer to take out the shopping bag containing the commodities.

Furthermore, the intelligent display system is based on the body feature recognition technology (including face recognition, body type recognition and the like). After the physical signs of the customers are collected through the camera, a customer characteristic database is established at a remote server, and the customer characteristics can be divided into gender, age group, body type, clothes characteristics and the like. According to the result of drawing pictures of the customers, the corresponding advertisements are accurately pushed, and the marketing success rate is improved.

Drawings

In order to more clearly illustrate the technical solutions in the embodiments of the present invention, the drawings needed to be used in the embodiments or the prior art descriptions will be briefly described below, and it is obvious that the drawings in the following description are only some embodiments of the present invention, and it is obvious for those skilled in the art to obtain other drawings based on these drawings without inventive exercise.

FIG. 1 is a flow chart of the steps of the operation of the intelligent self-service all-in-one machine;

FIG. 2 shows a modified shopping bag, wherein MAX lines are punched and marked at the upper edge of the shopping bag;

FIG. 3 is a view of a spinning cone hook, with two vertical line sides symmetrically fixed in a circular frame, respectively;

FIG. 4 shows an internal device of the barrel all-in-one machine;

FIG. 5 is a view showing the internal structure of the barrel type all-in-one machine;

FIG. 6 is a view showing an internal structure of the drawer type all-in-one machine;

FIG. 7 is an alternative internal arrangement of a funnel and electrostatic generator bucket all-in-one machine;

FIG. 8 is a self-service all-in-one machine of slim commodity intelligence;

fig. 9 is an architecture diagram of modules of the intelligent self-help all-in-one machine.

Detailed Description

In the following description, for purposes of explanation and not limitation, specific details are set forth, such as particular system structures, techniques, etc. in order to provide a thorough understanding of the embodiments of the invention. It will be apparent, however, to one skilled in the art that the present invention may be practiced in other embodiments that depart from these specific details. In other instances, detailed descriptions of well-known systems, devices, circuits, and methods are omitted so as not to obscure the description of the present invention with unnecessary detail.

In order to explain the technical means of the present invention, the following description will be given by way of specific examples. Fig. 4 shows the internal structure of the intelligent self-service all-in-one machine (barrel structure) according to the invention. This self-service all-in-one of intelligence inner structure includes: the device comprises a spinning cone hook 401, a tying frame 402 for placing tying belts, a side wall type tying machine 403, a concentric circle 404 of a weighing chassis, a concentric circle 405 of the innermost side printed non-adhesive tape and a weighing base 406.

Fig. 5 shows the intelligent self-service all-in-one machine. The shopping bag comprises an upward flip 501, the whole shopping bag is placed in a closed-type all-in-one barrel machine for preventing weighing interference caused by human factors, the upward flip is designed in the barrel design, and when a customer weighs commodities, the upward flip needs to be pulled up firstly. Many cameras and light source 502, for the accuracy of guaranteeing the discernment is reliable, installs 3 cameras at last flip inner wall, shoots commodity in the shopping bag respectively from different angles, guarantees not to have the dead angle. The spinning cone hook 503 is designed to be a spinning cone, and the surface is uniform and smooth, so that the shopping bag is not easy to fall off after being hung, and when the tying operation is performed, the spinning cone hook can smoothly fall off from the hook. A tying ring 504 for placing a tying belt is naturally threaded through the tying ring when the shopping bag is hung on the spinning cone hook, and the tying belt is installed in the tying ring. Supporting the binder ring side wall 505. A plurality of concentric circle type weighing sensors are designed for enabling all weighed commodities to be smoothly supported by a circular weighing platform in view of different sizes of the weighed commodities 506. The innermost side is a concentric circle type printer 507 for printing non-setting adhesive stickers, after the shopping bag is weighed, when the shopping bag is supported by a certain concentric circle, the printer prints out the non-setting adhesive stickers (one side of the non-setting adhesive stickers is downward when the commodity information is pasted, and the other side of the non-setting adhesive stickers is upward) and jacks up, and the non-setting adhesive stickers are pasted at the bottom of the shopping bag by means of the gravity of the commodity. The weighing base 508 is provided with a central processing unit, a memory, a thermal printer, various interfaces and other devices. The intelligent display camera 509 has the camera on display upper portion, is convenient for shoot customer's physical signs, draws pictures for customer according to customer's physical signs to for the accurate propelling movement advertisement of customer. The intelligent display 510 is divided into two parts, wherein the upper half part of the intelligent display accounts for three quarters of the whole area of the intelligent display and mainly plays advertisements; the lower half of the display occupies one fourth of the whole display area, and mainly displays the weighing information of the commodity. The upper flip cover handle 511 is provided with a plurality of cameras and light sources inside the upper flip cover, so that the upper flip cover handle is required to be lightly pulled and lightly placed, and the use by customers is more convenient. The shopping bag ladder-shaped bucket 512 is accepted, after the operation of pasting, printing and pasting is completed, all the operations are completed, the shopping bag containing commodities slides into the ladder-shaped bucket from the all-in-one machine, and a customer can take out the shopping bag conveniently.

Fig. 7 shows another internal structural arrangement. The internal structure adopts an electrostatic generator and a funnel structure. As shown in the figure, 701 is an inner ring of the electrostatic generator, and after the intelligent self-service all-in-one machine is started, the upper edge of the shopping bag can be attached to the inner ring of the electrostatic generator due to the electrostatic adsorption effect. 702 is a tie frame for holding a tie strap. 703 is a side wall type tying machine. 704 is a circular funnel and can be placed in the circular funnel according to the amount of goods in the shopping bag. 705 the lower opening of the funnel is provided with a self-adhesive sticker printer, when the self-adhesive sticker is printed out, the self-adhesive sticker is pushed upwards to be attached to the bottom of the shopping bag by the aid of the self weight of the commodity. 706 is a weigh station sensor.

Fig. 8 is a self-service all-in-one machine of slim commodity intelligence. Aiming at some slender commodities in a large supermarket, such as: the commodities such as scallion, iron stick yam and the like cannot be put into a shopping bag due to long and thin shapes, and a cuboid intelligent self-service all-in-one machine is designed in a targeted manner. 801 is a display camera, 802 is an intelligent display, 803 is a built-in multi-part shooting commodity camera, 804 is a round binding frame of a tying machine, 805 is a sliding door of an intelligent self-service all-in-one machine, and 806 is a weighing platform and a printer.

Fig. 9 is a main circuit board architecture diagram of the intelligent self-service all-in-one machine according to the invention. The intelligent self-service all-in-one machine is provided with a central processing unit, a power supply (the power supply is the intelligent self-service all-in-one machine provides a stable power supply), a reset switch (used for hot start after system crash), a plurality of cameras, a display, a storage, a thermosensitive printing module, an image recognition module, an analog/digital (A/D) conversion module, a network unit module, an amplifying circuit module, a weighing sensor module and a tying machine module. The camera, the display and the memory are all connected with the central processing unit, the thermal printer module is used for printing commodity information, one end of the amplifying circuit module is connected with the weighing sensor, the other end of the amplifying circuit module is connected with the A/D conversion module, and the other end of the A/D conversion module is connected with the central processing unit. The amplifying circuit module is used for amplifying the analog signals transmitted by the symmetrical retransmission sensor and transmitting the processed signals to the A/D conversion module, the A/D conversion module converts the analog signals transmitted by the amplifying circuit module into digital signals and transmits the converted digital signals to the central processing unit, the storage is used for storing the type, unit price and commodity image characteristic models of commodities, and the image recognition module is connected with the central processing unit and used for analyzing and comparing the images shot by the camera and comparing the images with the image characteristic models of the commodities in the storage, so that the commodity type is accurately judged, and the price information of the commodities is further obtained. And sending the related information of the commodity to the intelligent display for the customer to view. A plurality of intelligent self-service all-in-one machines exist in a supermarket, and one machine can be set as a host machine so as to modify information such as commodity types and prices. The database is arranged in each supermarket, and the database of each supermarket is a distributed database from the whole network. Through the network unit, each intelligent self-service all-in-one machine can be connected with the remote cloud server, the cloud server can monitor each intelligent self-service all-in-one machine, and information of each distributed database is backed up on the cloud server, so that a centralized database is formed. Meanwhile, the centralized database can store the advertisement information uploaded by each supermarket, and in practice, a database management system of the central database needs to check the uploaded advertisement information, so that inappropriate contents are prevented from being played.

Yet another innovation of the present invention is the invention of the smart display. The display is different from the traditional display, and when a customer weighs a commodity, the camera above the display shoots the physical and physical characteristics of the customer. Based on the technology of human face feature recognition, including human face recognition, body type recognition and the like. After physical signs of a customer are collected through a camera, a customer characteristic database is established at a remote server, and the customer characteristics can be divided into gender, approximate age groups (1-10 years old, 11-20 years old, 21-30 years old, 31-40 years old, 41-50 years old, 51-60 years old, 61-70 years old, more than 70 years old and the like), body types (multiple characteristics of thin, uniform, fat and the like), and clothing characteristics (plain, general and gorgeous, whether to wear glasses, necklaces, earrings, hairstyles and the like). According to the result of drawing pictures of the customers, the corresponding advertisements are accurately pushed, and the marketing success rate is improved.

The basic structure and the module composition of the intelligent self-service all-in-one machine are described above. Implementation steps of the inventive examples are described below. As shown in figure 1, the invention is divided into five steps in the concrete realization.

Firstly, a customer hangs a supermarket shopping bag containing commodities on a spinning cone hook of the intelligent self-service all-in-one machine, closes an upward flip cover after hanging the shopping bag, and presses a start key. The step is only completed by the customer in the embodiment of the invention, and the operation is easier to be executed for most people in reality without obstacles.

And secondly, after receiving the starting signal, carrying out multi-angle shooting by a plurality of cameras for preventing dead angles, transmitting a plurality of shot pictures to a central processing unit, analyzing and comparing the pictures with a local database, and executing the next operation after the pictures are compared to be consistent. If the comparison is inconsistent, a signal is sent out, the recognition is quitted, and the customer is prompted whether more than one commodity exists in the shopping bag.

And thirdly, after the identification completion signal is received, unit price information of the commodity can be searched in the local database, and the signal is sent to the central processing unit, the central processing unit sends a binding command to the intelligent self-service all-in-one machine, the all-in-one machine executes binding operation, and after binding is completed, the signal is sent to the central processing unit.

Fourthly, after receiving the tying ending signal, the central processing unit sends a weighing signal to the gravity sensor, the gravity sensor executes weighing operation and transmits an analog signal, the analog signal transmitted by the sensor is amplified by the amplifying circuit module, the processed signal is transmitted to the A/D conversion module, the A/D conversion module converts the analog signal transmitted by the amplifying circuit module into a digital signal, and the converted digital signal is transmitted to the central processing unit.

After the weighing operation is finished, the central processing unit sends a printing signal to the thermal printer module, after the thermal printer receives the printing signal, an operation command is executed, the non-setting adhesive sticker is printed, the side, printed with the commodity information, of the non-setting adhesive sticker faces downwards, and the side, printed with the commodity information, of the non-setting adhesive sticker faces upwards. The printing outlet of the non-setting adhesive sticker is positioned on the innermost concentric circle of the weighing platform, at the moment, all the concentric circles are jacked upwards, after the shopping bag is supported, the innermost concentric circle is jacked upwards, and the non-setting adhesive sticker is stuck to the bottom of the shopping bag by virtue of the self weight of the commodity. After the step is finished, the indicator light and the buzzer are directly driven to send signals to the customer, and the customer takes out the signals.

Image recognition technology for commodities in the supermarket is mature day by day. The feasibility of the invention is demonstrated by a brief introduction. The image to be identified is input into a computer in a certain mode, and the image to be identified is subjected to computer preprocessing and feature extraction and then is subjected to matching and classification. The computer preprocessing process mainly separates an image area from a background area of an image to be recognized, thins the image, enhances the binaryzation of the image and improves the speed and efficiency of post-processing of computer intelligent image recognition. The characteristic features of the image can be represented by numerical values in order to reduce the authenticity of the image and reduce the false features. In image recognition systems, if matching of an input image with an existing image is required, it is necessary to assign it to a different image library in an accurate way to reduce the search time. In order to accurately determine the nature of the input image, the currently input test image must be compared to a previously stored image and analyzed. It should be noted that the technology is mature.

It will be apparent to those skilled in the art that, for convenience and brevity of description, only the above-mentioned division of the functional units and modules is illustrated, and in practical applications, the above-mentioned function distribution may be performed by different functional units and modules according to needs, that is, the internal structure of the apparatus is divided into different functional units or modules to perform all or part of the above-mentioned functions. Each functional unit and module in the embodiments may be integrated in one processing unit, or each unit may exist alone physically, or two or more units are integrated in one unit, and the integrated unit may be implemented in a form of hardware, or in a form of software functional unit. In addition, specific names of the functional units and modules are only for convenience of distinguishing from each other, and are not used for limiting the protection scope of the present application. The specific working processes of the units and modules in the system may refer to the corresponding processes in the foregoing method embodiments, and are not described herein again.

In the above embodiments, the descriptions of the respective embodiments have respective emphasis, and reference may be made to the related descriptions of other embodiments for parts that are not described or illustrated in a certain embodiment.

Those of ordinary skill in the art will appreciate that the various illustrative elements and algorithm steps described in connection with the embodiments disclosed herein may be implemented as electronic hardware or combinations of computer software and electronic hardware. Whether such functionality is implemented as hardware or software depends upon the particular application and design constraints imposed on the implementation. Skilled artisans may implement the described functionality in varying ways for each particular application, but such implementation decisions should not be interpreted as causing a departure from the scope of the present invention.

In the embodiments provided in the present invention, it should be understood that the disclosed apparatus/terminal device and method may be implemented in other ways. For example, the above-described embodiments of the apparatus/terminal device are merely illustrative, and for example, the division of the modules or units is only one logical division, and there may be other divisions when actually implemented, for example, a plurality of units or components may be combined or integrated into another system, or some features may be omitted, or not executed. In addition, the shown or discussed mutual coupling or direct coupling or communication connection may be an indirect coupling or communication connection through some interfaces, devices or units, and may be in an electrical, mechanical or other form.

The units described as separate parts may or may not be physically separate, and parts displayed as units may or may not be physical units, may be located in one place, or may be distributed on a plurality of network units. Some or all of the units can be selected according to actual needs to achieve the purpose of the solution of the embodiment.

In addition, functional units in the embodiments of the present invention may be integrated into one processing unit, or each unit may exist alone physically, or two or more units are integrated into one unit. The integrated unit can be realized in a form of hardware, and can also be realized in a form of a software functional unit.

The integrated modules/units, if implemented in the form of software functional units and sold or used as separate products, may be stored in a computer readable storage medium. Based on such understanding, all or part of the flow of the method according to the embodiments of the present invention may also be implemented by a computer program, which may be stored in a computer-readable storage medium, and when the computer program is executed by a processor, the steps of the method embodiments may be implemented. Wherein the computer program comprises computer program code, which may be in the form of source code, object code, an executable file or some intermediate form, etc. The computer-readable medium may include: any entity or device capable of carrying the computer program code, recording medium, usb disk, removable hard disk, magnetic disk, optical disk, computer Memory, Read-Only Memory (ROM), Random Access Memory (RAM), electrical carrier wave signals, telecommunications signals, software distribution medium, and the like. It should be noted that the computer readable medium may contain content that is subject to appropriate increase or decrease as required by legislation and patent practice in jurisdictions, for example, in some jurisdictions, computer readable media does not include electrical carrier signals and telecommunications signals as is required by legislation and patent practice.

The above-mentioned embodiments are only used for illustrating the technical solutions of the present invention, and not for limiting the same; although the present invention has been described in detail with reference to the foregoing embodiments, it will be understood by those of ordinary skill in the art that: the technical solutions described in the foregoing embodiments may still be modified, or some technical features may be equivalently replaced; such modifications and substitutions do not substantially depart from the spirit and scope of the embodiments of the present invention, and are intended to be included within the scope of the present invention.