阅读说明：本技术 Ar智能点菜系统 (AR intelligent dish ordering system ) 是由 林彤 邢艺 于 2018-08-08 设计创作，主要内容包括：一种能过完成手势操作即可进行展示和点餐的AR智能点菜系统。由一台主机服务器连接4个摄像头和1个投影仪构成整体装置。该装置安装于桌子正上方,并由提前设置好识别图(菜单图像)进行触发。将识别图放到摄像头采集范围内,摄像头将图像信息实时发送至服务器,由服务器判断处理后做出指令运行相关多媒体文件,由投影仪进行播放。以达到菜单展示、手势遮挡操作而进行菜品选择、下单的功能目的。(An AR intelligent ordering system capable of displaying and ordering food by completing gesture operation. A host server is connected with 4 cameras and 1 projector to form an integral device. The device is installed right above a desk and is triggered by a recognition picture (menu image) which is set in advance. And (4) placing the identification picture in a camera acquisition range, sending image information to a server in real time by the camera, judging and processing by the server, making an instruction to run a related multimedia file, and playing by a projector. So as to achieve the function of menu display and gesture shielding operation to select dishes and place orders.)

1. An intelligent ordering system based on AR technology comprises a monitoring module, an information management server, a projector and a server management end, wherein the monitoring module is connected with the information management server, the information management server is connected with the projector, and the information management server is connected with the server menu management end;

the monitoring module consists of one or more cameras, and the cameras are connected with the information management server and used for monitoring whether the marking menu enters the identification area or not;

and the information management server is used for operating the associated multimedia file and program according to the judgment whether the marking menu enters the identification area. The display area of the multimedia file is a specific identification area;

the projector is used for displaying the multimedia files and programs.

The multimedia file is in a format of dish related information including but not limited to video, audio, image, text and the like.

2. The system of claim 1, wherein the monitoring module is further configured to monitor whether a marking menu enters a specific identification area;

the information management server is used for judging whether the marking menu enters a specific identification area or not and controlling the operation of the associated multimedia file and program;

the multimedia file is in a format of dish related information including but not limited to video, audio, image, text and the like.

3. The system of claim 2, wherein the marking menu is comprised of one or more specific images, including but not limited to any one or more of: color, shape, LOGO, pattern;

the monitoring module is also used for monitoring the marking menu to enter a specific identification area, and when the pattern on the marking menu is shielded, a command is sent to the information management server;

when the shielded pattern appears again on the marking menu, the monitoring module collects the image information again and sends the image information to the information management server;

if different patterns on the marking menu are shielded, different instructions are sent to the information management server;

and the information management server controls the operation of the AR program according to the image information sent by the monitoring module.

4. The system of claim 3, wherein:

and the monitoring module acquires that the specific image enters the specific identification area and is lost, and when the loss time reaches a certain value. Sending an instruction to the information management server once every certain seconds, wherein the interval time can be set;

and the information management server controls the operation of the AR program according to the image information sent by the monitoring module.

5. A system according to claim 3, characterized in that:

the information management server is also used for storing and receiving each time of information sent by the monitoring module;

the information management server is also used for sending the stored information data to the server management terminal.

Technical Field

The invention relates to the technical field of AR, in particular to the field of an intelligent ordering system.

Background art:

at present, augmented reality is a new technology for seamlessly integrating real world information and virtual world information, and is to superimpose entity information (visual information, sound, taste, touch and the like) which is difficult to experience in a certain time space range of the real world originally through scientific technologies such as computers after simulation, apply virtual information to the real world and enable the virtual information to be perceived by human senses, so that the sensory experience beyond reality is achieved. The real environment and the virtual object are superimposed on the same picture or space in real time and exist simultaneously.

The dish ordering is one of the indispensable links of the restaurant, and the dish ordering of the restaurant is generally accompanied by a paper menu, pictures, characters and price descriptions of dishes at present and is introduced and ordered by a waiter. Certain labor cost is needed, and the user also needs to wait for the service of the waiter to ensure that the dish ordering is successful. In the aspect of dish display, the traditional menu cannot display information such as appearance, materials and taste of each dish in all directions due to the fact that the types of the dishes are more and the bearing content is limited.

Disclosure of Invention

The menu aims to overcome the defects that the traditional menu has limited bearing content, long ordering time and large labor cost consumption. The invention provides an intelligent ordering system based on an augmented reality technology, which is displayed in a projection mode. And gesture interaction is added on the basis of display, so that the functions of displaying, selecting, ordering and calling a waiter of the dishes can be realized by shielding the marked menu card with a designated design by using a gesture.

The invention provides an intelligent ordering system solution based on AR technology, which comprises the following specific steps:

the utility model provides a system of ordering dishes based on AR, includes that monitoring module, information management server, projecting apparatus, waiter manage the end and constitute, monitoring module links to each other with information management server, information management server links to each other with the projecting apparatus, information management server links to each other with waiter's management end.

The monitoring module consists of a single or a plurality of cameras, and the cameras are connected with the information management server.

The camera is used for collecting a marked menu image appearing in the identification area, and the identification area is the surface of the dining table.

The marking menu is composed of one or more specific images.

The monitoring module is used for monitoring whether the marking menu enters the identification area or not and the position of the marking menu in the identification area. And sending the image information to the information management server.

And the information management server is used for identifying the image information acquired by the camera, judging whether the marking menu enters an identification area according to an identification result, and obtaining relevant information of the marking menu.

The information management server is also used for operating the multimedia file associated with the marking menu according to the collected image information of the marking menu.

The projector is used for displaying the multimedia files operated by the information management server, and the displaying range of the projector is the surface of the dining table.

The multimedia file includes one or more of the following forms: video, audio, text, AR rendering program.

The multimedia presentation area is the extent of a particular identification area.

The monitoring module is also used for monitoring whether the marking menu enters a specific identification area or not, and sending the image information to the information management server.

The range size of the specific identification area can be adjusted, but the specific identification area outline range is smaller than the identification area outline range.

Meanwhile, the outline range of the specific identification area should be larger than that of the marking menu.

And the information management server is also used for operating the multimedia file associated with the dish according to the collected image information of the marking menu.

The projector is used for displaying the multimedia files operated by the information management server, and the displaying range of the projector is the surface of the dining table.

The monitoring module, after monitoring whether the marking menu enters a specific identification area, and acquiring the relevant information on the identification menu includes:

collecting image information of the specific identification area;

and acquiring each identification and lost information of the image in the specific identification area.

The monitoring module is further configured to monitor whether there is information about image loss when the marking menu is on the specific identification area on the dining table, and transmit the loss information to the information service manager.

When the marking menu enters a specific identification area, a specific image on the marking menu is shielded by hands, and the specific image on the marking menu is considered to be lost.

When the marking menu enters a specific identification area, the specific image on the marking menu is shielded by a hand, the hand is moved away, and the specific image reappears, so that the identification is regarded as one-time identification.

And the monitoring module sends an instruction to the information management server once every time the monitoring module acquires that the specific image of the marking menu is lost.

And the information management server controls the operation of the AR program according to the image information sent by the monitoring module.

The AR program controls the operation of the multimedia files.

The multimedia files include, but are not limited to, one or more of text, video, audio;

and the monitoring module acquires that the specific image enters the specific identification area and is lost, and sends an instruction to the information management server once every certain seconds when the loss time reaches a certain value, wherein the interval time is set.

And the information management server controls the operation of the AR program according to the image information sent by the monitoring module.

The information management server is also used for storing and receiving each time of information sent by the monitoring module.

The information management server is also used for sending the stored information data to the server management terminal

Compared with the prior art, the method has the following advantages:

the application provides an intelligence solution of ordering dishes based on AR technique, and the user shelters from several images on the mark menu at the desktop with the hand, can appear the effect such as picture, video, animation that correspond the vegetable on the dining table to the function of vegetable is browsed, selection vegetable to the reality. More can get off an order through user's operation, the data that the restaurant service personnel can directly receive the user and order on cell-phone APP, not only bring interactive enjoyment for the user's order, reduced the abstract description of service personnel head-to-head to the dish article. The satisfaction degree of the user is improved while the dish ordering efficiency is improved.

Drawings

Fig. 1 is a schematic structural diagram of an embodiment of an AR intelligent ordering system of the present application;

FIG. 2 is a schematic diagram of a desktop order in an embodiment of the present application;

fig. 3 is a schematic diagram of an embodiment of a marking menu in the AR intelligent ordering process provided by the present application.

Detailed Description

The present application will be further explained with reference to the accompanying drawings.

Fig. 1 is a schematic structural diagram of an embodiment of the AR intelligent ordering system of the present application.

As shown in fig. 1, in this embodiment, the AR intelligent ordering system is composed of a monitoring module a1, an information management server a2, a projector A3, and a server administrator a 4. In addition, a marking menu is also needed to be used as an auxiliary kit.

As shown in fig. 1, in this embodiment, the monitoring module a1 is connected to the information management server a2, the information management server a2 is connected to the projector A3, and the information management server a2 is connected to the attendant manager a 4.

The information management server A2 and the server administrator A4 are connected in a wireless manner.

And a monitoring module A1 for monitoring whether the identification menu enters the desktop identification area and the specific identification area. Acquiring relevant information of the image on the identification menu;

and the information management server A2 is used for judging whether to activate the ordering system, namely, running an ordering program and controlling to run the associated multimedia files according to the relevant information on the identified dishes.

The information management server a2 is also used to store the identification and loss data of the image on the marking menu at each time.

And the projector A3 is used for displaying the multimedia file in a playing mode.

In the embodiment of the present application, as shown in fig. 2, B1 is the marking menu, and the image information on the marking menu is composed of one or more of the following: color, shape, LOGO, pattern. A specific pattern needs to be set in the information management server a2 in advance. When the marking menu B1 is dropped onto the identification area B2 on the desktop. The information management server A2 compares and judges according to the collected image information, judges whether the marking menu enters the identification area B2 according to the identification result, and controls the running of the corresponding multimedia file. Meanwhile, the played multimedia file is a ring rendering effect, the outline range of the multimedia file is slightly larger than that of the marking menu, and the dining table area displayed by the multimedia file is the specific identification area B3.

Similarly, when the marking menu is moved into the specific identification, the information management server a2 compares, judges and compares according to the collected information, judges whether the marking menu enters the specific identification area according to the identification result, and operates the ordering program, and the program controls the playing of the associated multimedia file.

Correspondingly, the files are displayed and played by the projector A3, the projector A3 is positioned right above the dining table top, the playing area is the dining table top B4, but the playing area is not limited, and the size can be adjusted according to the effect.

Similarly, in this embodiment, the dining table is equally divided into four parts with the same length and width, and the identification area corresponding to each camera is a quarter of the dining table area. And setting the specific identification area to be consistent with the shape of the marking menu, wherein the area of the specific identification area is slightly larger than the range of the marking menu and smaller than the range of the identification area.

In actual use. The identification area and the specific identification area of the desktop can be adjusted according to actual effects without limitation.

In practical application, when the marking menu is subjected to specific identification area and identification. The user can preview the dishes, select the dishes, place orders and the like by shielding the patterns on the marked menu with hands.

Fig. 3 is an embodiment of the marking menu in the AR intelligent ordering system provided by the present application. In this embodiment, the marking menu is composed of 3 specific patterns. The specific patterns are pattern one C1, picture two C2 and pattern three C3 from left to right, respectively, and correspond to "return", "confirm" and "next" functions, respectively.

The multimedia file associated with the specific pattern may be preset and stored. When the marking menu is located within a specific identification area. The user manually occludes one of the patterns at a time. When the pattern is lost, the information management server a2 performs a comparison determination process based on the lost image information to control a corresponding function in the program, that is, to run a multimedia file associated with the function.

In this embodiment, if the user manually occludes the third pattern C3, the "next" function is triggered. The multimedia file is switched to the next file and is played through the projector, so that the function effect of browsing dishes is achieved.

Similarly, if the user manually occludes other patterns, the associated function is triggered. The presentation is switched to the associated multimedia file, and the multimedia file is displayed and played through the projector, and meanwhile, the information is stored.

Further, in order to increase the experience effect of the client, the multimedia file can be set as a picture, a text description, a video of a production process, a dynamic rendering effect and the like related to the dish, and the picture, the text description, the video of the production process, the dynamic rendering effect and the like can be displayed in the desktop area.

Further, when the user selects the dishes in a hand shielding mode, and finally orders are placed. The information management server a2 performs program control according to the collected information, and transmits the accumulated data to the server administrator.

And the server management terminal is an APP operated under the android system.

Furthermore, restaurant workers obtain dishes selected by the user and make and serve the dishes by looking up the waiter management terminal. Thereby achieving the effects of ordering dishes by self and improving the satisfaction degree of the service.

The present invention has been described above by way of illustration in the drawings, and it will be understood by those skilled in the art that the present disclosure is not limited to the embodiments described above, and various changes, modifications and substitutions may be made without departing from the scope of the present invention.