Automatic vending machine and vending system
阅读说明:本技术 一种自动售货机及售货系统 (Automatic vending machine and vending system ) 是由 黄屹峰 韩雪峰 王渊 刘坤 于 2020-05-28 设计创作,主要内容包括:本申请提供了一种自动售货机及售货系统,通过语音识别模块从用户的语音信息中识别出语音指令,并将语音指令发送至提示信息生成模块以及第一订单生成模块;提示信息生成模块可以根据接收到的语音指令生成相应的提示信息,并将生成的提示信息反馈给用户;第一订单生成模块根据接收到的语音指令生成用户的物品订单;最后,订单执行模块根据第一面部识别模块确定出的用户的第一面部特征信息以及第一订单生成模块生成的物品订单,对用户的订购信息进行支付验证,并在确定用户完成对物品订单的支付后,将物品订单中的物品提供给用户,从而可以降低用户选购物品的复杂程度,有助于降低自动售货机的损坏概率,因而,可以避免不必要的经济损失。(The application provides a vending machine and a vending system, wherein a voice instruction is recognized from voice information of a user through a voice recognition module, and the voice instruction is sent to a prompt information generation module and a first order generation module; the prompt information generation module can generate corresponding prompt information according to the received voice instruction and feed the generated prompt information back to the user; the first order generation module generates an article order of the user according to the received voice instruction; finally, the order execution module performs payment verification on the order information of the user according to the first face characteristic information of the user determined by the first face identification module and the article order generated by the first order generation module, and provides the article in the article order to the user after determining that the user completes payment of the article order, so that the complexity of purchasing the article by the user can be reduced, the damage probability of the vending machine is reduced, and unnecessary economic loss can be avoided.)
1. The vending machine is characterized by comprising a voice recognition module, a first face recognition module, a prompt message generation module, a first order generation module and an order execution module;
the voice recognition module is used for converting the collected voice information of the user into a corresponding voice instruction and sending the voice instruction to the prompt information generation module and the first order generation module;
the first face identification module is used for converting the acquired first face image of the user into corresponding first face characteristic information and sending the first face characteristic information to the order execution module;
the prompt information generation module is used for determining prompt information fed back to the user based on the received voice instruction and feeding the prompt information back to the user;
the first order generation module is used for identifying order information from the received voice instruction, generating an article order corresponding to the user based on the order information, feeding the article order back to the user, and sending the article order to the order execution module;
the order execution module is configured to perform payment verification on the user based on the first facial feature information and the item order, and provide a corresponding item in the item order to the user after determining that the payment of the user is completed.
2. The vending machine of claim 1, further comprising a fingerprint identification module;
the fingerprint identification module is used for collecting fingerprint information of the user and sending the fingerprint information to the order execution module;
the order execution module is further configured to perform payment verification on the user based on the fingerprint information and the item order or based on the first facial feature information, the fingerprint information, and the item order, and provide a corresponding item in the item order to the user after it is determined that the payment of the user is completed.
3. The vending machine of claim 1, further comprising a sign recognition module and a recommendation generation module;
the sign recognition module is used for acquiring a whole-body image of the user, determining sign information corresponding to the user based on the whole-body image, and sending the sign information to the suggestion generation module;
and the suggestion generation module is used for determining suggestion information corresponding to the user based on the sign information and a preset sign reference table and feeding back the suggestion information to the user.
4. The vending machine of claim 1, further comprising a gesture recognition module;
the gesture recognition module is used for acquiring a gesture image of the user, generating a corresponding order instruction based on the gesture image, and sending the order instruction to the first order generation module;
the first order generation module is further configured to identify order information from the received order instruction, generate an article order corresponding to the user based on the order information, and send the article order to the order execution module.
5. The vending machine of claim 3, further comprising a display module;
and the vending machine feeds the prompt information, the article orders and the suggestion information back to the user through the display module.
6. The vending machine of claim 1, further comprising an audible cue module;
and the vending machine feeds the prompt information and the article order back to the user through the sound prompt module.
7. The vending machine of claim 1, further comprising a wake-up module;
and the awakening module is used for determining an awakening instruction from the voice instruction, awakening the vending machine in response to the awakening instruction, and feeding back prompt information corresponding to the awakening instruction to the user.
8. The vending machine of claim 1, further comprising an end of operation module;
and the operation ending module is used for determining an operation ending instruction from the voice instruction, responding to the operation ending instruction to terminate the interactive operation between the vending machine and the user, and feeding back prompt information corresponding to the operation ending instruction to the user.
9. A vending system comprising a vending machine according to any one of claims 1-8, a terminal device, said vending machine being communicatively connected to said terminal device;
the terminal equipment comprises a second face identification module and a second order generation module;
the second face identification module is configured to acquire a second face image of the user, convert the second face image into corresponding second face feature information, and send the second face feature information to the second order generation module;
the second order generation module is configured to determine order information from the ordering operation of the user, generate an article order corresponding to the user based on the second facial feature information and the order information, and send the article order to an order execution module in the vending machine.
10. The vending system of claim 9, further comprising a virtual reality device communicatively coupled to the vending machine;
the virtual reality equipment is worn on the head of the user and used for generating corresponding order information according to the selection operation of the user and sending the order information to a first order generation module in the vending machine.
Technical Field
The application relates to the technical field of human-computer interaction, in particular to an automatic vending machine and a vending system.
Background
With the development of science and technology, the vending machine gradually enters the life of people, is applied to more and more public places, and when people need to order goods, the needed goods can be ordered at the vending machine, so that the vending machine brings convenience to the life of people.
At present, vending machine sets up mostly in the public place, and people usually select the article that oneself wanted through button or the display screen that sets up on vending machine when acquireing article, and operation process is too complicated, and along with the increase of the number of times of use of vending machine, button or display screen on the vending machine can become sensitive inadequately, and the frequency of damage of vending machine is too high, and then has caused unnecessary economic loss.
Disclosure of Invention
In view of this, an object of the present application is to provide a vending machine and a vending system, which can provide a user with required articles according to the voice information of the user, reduce the complexity of purchasing articles by the user, and help to reduce the damage probability of the vending machine, thereby avoiding unnecessary economic loss.
The embodiment of the application provides a vending machine, which comprises a voice recognition module, a first face recognition module, a prompt information generation module, a first order generation module and an order execution module;
the voice recognition module is used for converting the collected voice information of the user into a corresponding voice instruction and sending the voice instruction to the prompt information generation module and the first order generation module;
the first face identification module is used for converting the acquired first face image of the user into corresponding first face characteristic information and sending the first face characteristic information to the order execution module;
the prompt information generation module is used for determining prompt information fed back to the user based on the received voice instruction and feeding the prompt information back to the user;
the first order generation module is used for identifying order information from the received voice instruction, generating an article order corresponding to the user based on the order information, feeding the article order back to the user, and sending the article order to the order execution module;
the order execution module is configured to perform payment verification on the user based on the first facial feature information and the item order, and provide a corresponding item in the item order to the user after determining that the payment of the user is completed.
In some embodiments, the vending machine further comprises a fingerprint identification module;
the fingerprint identification module is used for collecting fingerprint information of the user and sending the fingerprint information to the order execution module.
The order execution module is further configured to perform payment verification on the user based on the fingerprint information and the item order or based on the first facial feature information, the fingerprint information, and the item order, and provide a corresponding item in the item order to the user after it is determined that the payment of the user is completed.
In some embodiments, the vending machine further comprises a sign recognition module and a recommendation generation module;
the sign recognition module is used for acquiring a whole-body image of the user, determining sign information corresponding to the user based on the whole-body image, and sending the sign information to the suggestion generation module;
and the suggestion generation module is used for determining suggestion information corresponding to the user based on the sign information and a preset sign reference table and feeding back the suggestion information to the user.
In some embodiments, the vending machine further comprises a gesture recognition module;
the gesture recognition module is used for acquiring a gesture image of the user, generating a corresponding order instruction based on the gesture image, and sending the order instruction to the first order generation module;
the first order generation module is further configured to identify order information from the received order instruction, generate an article order corresponding to the user based on the order information, and send the article order to the order execution module.
In some embodiments, the vending machine further comprises a display module;
and the vending machine feeds the prompt information, the article orders and the suggestion information back to the user through the display module.
In some embodiments, the vending machine further comprises an audible cue module;
and the vending machine feeds the prompt information and the article order back to the user through the sound prompt module.
In some embodiments, the vending machine further comprises a wake-up module;
and the awakening module is used for determining an awakening instruction from the voice instruction, awakening the vending machine in response to the awakening instruction, and feeding back prompt information corresponding to the awakening instruction to the user.
In some embodiments, the vending machine further comprises an end of operation module;
and the operation ending module is used for determining an operation ending instruction from the voice instruction, responding to the operation ending instruction to terminate the interactive operation between the vending machine and the user, and feeding back prompt information corresponding to the operation ending instruction to the user.
The embodiment of the application also provides a vending system, which comprises the vending machine and the terminal equipment, wherein the vending machine is in communication connection with the terminal equipment;
the terminal equipment comprises a second face identification module and a second order generation module;
the second face identification module is configured to acquire a second face image of the user, convert the second face image into corresponding second face feature information, and send the second face feature information to the second order generation module;
the second order generation module is configured to determine order information from the ordering operation of the user, generate an article order corresponding to the user based on the second facial feature information and the order information, and send the article order to an order execution module in the vending machine.
In some embodiments, the vending system further comprises a virtual reality device communicatively coupled to the vending machine;
the virtual reality equipment is worn on the head of the user and used for generating corresponding order information according to the selection operation of the user and sending the order information to a first order generation module in the vending machine.
The vending machine and the vending system provided by the embodiment of the application comprise a voice recognition module, a first face recognition module, a prompt information generation module, a first order generation module and an order execution module; the voice recognition module is used for converting the collected voice information of the user into a corresponding voice instruction and sending the voice instruction to the prompt information generation module and the first order generation module; the first face identification module is used for converting the acquired first face image of the user into corresponding first face characteristic information and sending the first face characteristic information to the order execution module; the prompt information generation module is used for determining prompt information fed back to the user based on the received voice instruction and feeding the prompt information back to the user; the first order generation module is used for identifying order information from the received voice instruction, generating an article order corresponding to the user based on the order information, feeding the article order back to the user, and sending the article order to the order execution module; the order execution module is configured to perform payment verification on the user based on the first facial feature information and the item order, and provide a corresponding item in the item order to the user after determining that the payment of the user is completed.
Therefore, the voice instruction can be recognized from the voice information of the user, the corresponding article order of the user is generated according to the voice instruction, the payment verification is carried out on the order information of the user through the first face characteristic information determined from the collected first face image of the user and the generated article order, and after the user is determined to complete the payment of the article order, the article in the article order is provided for the user, so that the needed article can be provided for the user only according to the voice information of the user, the complexity of purchasing the article by the user can be reduced, the damage probability of the vending machine is favorably reduced, and further unnecessary economic loss can be avoided.
In order to make the aforementioned objects, features and advantages of the present application more comprehensible, preferred embodiments accompanied with figures are described in detail below.
Drawings
In order to more clearly illustrate the technical solutions of the embodiments of the present application, the drawings that are required to be used in the embodiments will be briefly described below, it should be understood that the following drawings only illustrate some embodiments of the present application and therefore should not be considered as limiting the scope, and for those skilled in the art, other related drawings can be obtained from the drawings without inventive effort.
Fig. 1 is a schematic structural diagram of a vending system according to an embodiment of the present disclosure;
FIG. 2 is one of the schematic structural views of the vending machine shown in FIG. 1;
FIG. 3 is a second schematic structural view of the vending machine shown in FIG. 1;
fig. 4 is a schematic structural diagram of the terminal device shown in fig. 1.
Icon: 100-a vending system; 110-vending machines; 1101-a speech recognition module; 1102-a first facial identification module; 1103-prompt message generation module; 1104-a first order generation module; 1105-order execution module; 1106-fingerprint identification module; 1107-sign recognition module; 1108-suggestion generation module; 1109-gesture recognition module; 1110-a display module; 1111-sound prompt module; 1112-a wake-up module; 1113-operation end module; 120-a terminal device; 1201-a second face recognition module; 1202-a second order generation module; 130-virtual reality devices.
Detailed Description
In order to make the objects, technical solutions and advantages of the embodiments of the present application clearer, the technical solutions in the embodiments of the present application will be clearly and completely described below with reference to the drawings in the embodiments of the present application, and it is obvious that the described embodiments are only a part of the embodiments of the present application, and not all the embodiments. The components of the embodiments of the present application, generally described and illustrated in the figures herein, can be arranged and designed in a wide variety of different configurations. Thus, the following detailed description of the embodiments of the present application, presented in the accompanying drawings, is not intended to limit the scope of the claimed application, but is merely representative of selected embodiments of the application. Every other embodiment that can be obtained by a person skilled in the art without making creative efforts based on the embodiments of the present application falls within the protection scope of the present application.
Through research discovery, at present, vending machine sets up mostly in the public place, and people usually select the article that oneself wanted through button or the display screen that sets up on vending machine when acquireing article, and operation process is too complicated, and along with the increase of the number of times of use of vending machine, button or display screen on the vending machine can become sensitive inadequately, and the frequency of damage of vending machine is too high, and then has caused unnecessary economic loss.
Based on this, this application embodiment provides an automatic vending machine and system of selling goods, can provide the article that needs for the user according to user's speech information, can reduce the complexity that the user purchased article, help reducing automatic vending machine's damage probability, and then, can avoid unnecessary economic loss.
First, a
Referring to fig. 1, fig. 1 is a schematic structural diagram of a
The
Referring to fig. 2, fig. 2 is a schematic structural diagram of the
The
The
The first
The first
The prompt
The first
Illustratively, when the user says "buy hamburger and cola", the first
The
Specifically, based on the first facial feature information and the item order, corresponding consumption resources are obtained from a corresponding payment account of the user and are used for paying the ordering operation of the user, and after the fact that the user completes the payment operation is determined, the items in the item order are provided for the user.
Further, referring to fig. 3, fig. 3 is a second schematic structural diagram of a
The
Specifically, a fingerprint scanner may be provided on the
When the
Specifically, based on the fingerprint information and the item order, the corresponding consumption resource is obtained from the corresponding payment account of the user and is used for paying the ordering operation of the user, and after the fact that the user completes the payment operation is determined, the item in the item order is provided for the user.
In addition, when the
Specifically, based on the first face feature information, the fingerprint information and the item order, corresponding consumption resources are obtained from a corresponding payment account of the user and are used for paying the user for the ordering operation, and after the user is determined to complete the payment operation, the items in the item order are provided for the user.
Further, as shown in fig. 3, the
The
Wherein, the physical sign information includes height, weight, posture and the like.
The
Specifically, the articles suitable for the user can be determined according to the physical sign information of the user, and for example, when the weight of the user is heavier, the user is advised not to eat high-calorie foods such as hamburgers and cola, low-sugar and low-calorie foods are provided for the user, and reference is provided for the user.
Further, as shown in FIG. 3, the
The
After the first
Further, as shown in FIG. 3, the
The
The
For example, names of commodities, categories, and the like that the user has selected may be displayed on the display screen; the suggested information provided to the user may also be displayed at a particular location in the screen for viewing by the user, etc.
Further, as shown in fig. 3, the vending machine further includes an
The
The
For example, the user may be asked for the name, kind, etc. of the item selected for purchase; it is also possible to check with the user whether the article in the article order information is correct, or the like.
Further, as shown in FIG. 3, the
The wake-up module 1112 may recognize a wake-up command from the received voice command, wake up the
Illustratively, the
Further, as shown in FIG. 3, the
The operation ending module 1113 may recognize an operation ending instruction from the received voice instruction, terminate the interactive operation between the
Illustratively, the interactive operation between the
The vending machine provided by the embodiment of the application comprises a voice recognition module, a first face recognition module, a prompt information generation module, a first order generation module and an order execution module; the voice recognition module is used for converting the collected voice information of the user into a corresponding voice instruction and sending the voice instruction to the prompt information generation module and the first order generation module; the first face identification module is used for converting the acquired first face image of the user into corresponding first face characteristic information and sending the first face characteristic information to the order execution module; the prompt information generation module is used for determining prompt information fed back to the user based on the received voice instruction and feeding the prompt information back to the user; the first order generation module is used for identifying order information from the received voice instruction, generating an article order corresponding to the user based on the order information, feeding the article order back to the user, and sending the article order to the order execution module; the order execution module is configured to perform payment verification on the user based on the first facial feature information and the item order, and provide a corresponding item in the item order to the user after determining that the payment of the user is completed.
Therefore, the voice instruction can be recognized from the voice information of the user, the corresponding article order of the user is generated according to the voice instruction, the payment verification is carried out on the order information of the user through the first face characteristic information determined from the collected first face image of the user and the generated article order, and after the user is determined to complete the payment of the article order, the article in the article order is provided for the user, so that the needed article can be provided for the user only according to the voice information of the user, the complexity of purchasing the article by the user can be reduced, the damage probability of the vending machine is favorably reduced, and further unnecessary economic loss can be avoided.
In addition, as shown in fig. 4, fig. 4 is a schematic structural diagram of the
The
The second
The second
Specifically, the user may determine a desired product by performing an ordering operation such as a selection operation or an input operation on the
At this time, before performing payment verification on the user based on the first facial feature information and the article order, the
Further, as shown in fig. 1, the
At this time, the first
The
It is clear to those skilled in the art that, for convenience and brevity of description, the specific working processes of the above-described systems, apparatuses and units may refer to the corresponding processes in the foregoing method embodiments, and are not described herein again.
In the several embodiments provided in the present application, it should be understood that the disclosed system, apparatus and method may be implemented in other ways. The above-described embodiments of the apparatus are merely illustrative, and for example, the division of the units is only one logical division, and there may be other divisions when actually implemented, and for example, a plurality of units or components may be combined or integrated into another system, or some features may be omitted, or not executed. In addition, the shown or discussed mutual coupling or direct coupling or communication connection may be an indirect coupling or communication connection of devices or units through some communication interfaces, and may be in an electrical, mechanical or other form.
The units described as separate parts may or may not be physically separate, and parts displayed as units may or may not be physical units, may be located in one place, or may be distributed on a plurality of network units. Some or all of the units can be selected according to actual needs to achieve the purpose of the solution of the embodiment.
In addition, functional units in the embodiments of the present application may be integrated into one processing unit, or each unit may exist alone physically, or two or more units are integrated into one unit.
The functions, if implemented in the form of software functional units and sold or used as a stand-alone product, may be stored in a non-volatile computer-readable storage medium executable by a processor. Based on such understanding, the technical solution of the present application or portions thereof that substantially contribute to the prior art may be embodied in the form of a software product stored in a storage medium and including instructions for causing a computer device (which may be a personal computer, a server, or a network device) to execute all or part of the steps of the method according to the embodiments of the present application. And the aforementioned storage medium includes: various media capable of storing program codes, such as a usb disk, a removable hard disk, a Read-only Memory (ROM), a Random Access Memory (RAM), a magnetic disk, or an optical disk.
Finally, it should be noted that: the above-mentioned embodiments are only specific embodiments of the present application, and are used for illustrating the technical solutions of the present application, but not limiting the same, and the scope of the present application is not limited thereto, and although the present application is described in detail with reference to the foregoing embodiments, those skilled in the art should understand that: any person skilled in the art can modify or easily conceive the technical solutions described in the foregoing embodiments or equivalent substitutes for some technical features within the technical scope disclosed in the present application; such modifications, changes or substitutions do not depart from the spirit and scope of the exemplary embodiments of the present application, and are intended to be covered by the scope of the present application. Therefore, the protection scope of the present application shall be subject to the protection scope of the claims.
- 上一篇:一种医用注射器针头装配设备
- 下一篇:一种防爆售货加油一体机及其布置方法