阅读说明：本技术 智能棋牌信息提示方法 (Intelligent chess and card information prompting method ) 是由 青衡 于 2021-01-08 设计创作，主要内容包括：本申请实施例提供一种智能棋牌信息提示方法,通过对棋牌区域的视频流信息进行视频图像分析以获得棋牌区域的实时棋牌局面信息,从而根据实时棋牌局面信息和智能棋牌机对应的各个棋牌玩家的移动电子终端所对应的入场配置信息对每个棋牌玩家进行自动信息提示,无需棋牌玩家主动提示,进而提高信息提示精度和效率,同时也避免由于玩家个人因素的影响对所打出棋牌的信息提示准确性降低,造成其他玩家误判的问题。(The embodiment of the application provides an intelligent chess and card information prompting method, video image analysis is carried out through video stream information to a chess and card area so as to obtain real-time chess and card situation information of the chess and card area, automatic information prompting is carried out on each chess and card player according to the real-time chess and card situation information and admission configuration information corresponding to a mobile electronic terminal of each chess and card player corresponding to an intelligent chess and card machine, active prompting of the chess and card players is not needed, information prompting precision and efficiency are improved, meanwhile, the problem that the accuracy of information prompting of played chess and cards is reduced due to the influence of personal factors of the players, and misjudgment of other players is caused is avoided.)

1. The utility model provides an intelligence chess and card information prompt method, its characterized in that is applied to chess and card system, chess and card system includes intelligent chess and card machine, first video acquisition device, information suggestion device, mobile electronic terminal, first video acquisition device is located the chess and card region top of intelligence chess and card machine, information suggestion device with first video acquisition device communicates, the method includes:

the information prompting device acquires video stream information of the chess and card area acquired by the first video acquisition device;

the information prompting device carries out video image analysis on the video stream information of the chess and card area to obtain real-time chess and card situation information of the chess and card area;

the information prompting device carries out information prompting on each chess and card player according to the real-time chess and card situation information and the admission configuration information corresponding to the mobile electronic terminals of the chess and card players corresponding to the intelligent chess and card machine, wherein the admission configuration information corresponding to the mobile electronic terminals of the chess and card players comprises chess and card rule configuration information, chess and card direction information and player identification information.

2. The intelligent board information prompting method of claim 1, wherein the board system further comprises a second video acquisition device respectively located at each board orientation of the intelligent board machine, the second video acquisition device at each board orientation being used for acquiring video stream information corresponding to the board orientation, the information prompting device comprising an information prompting unit for each board orientation, the method further comprising:

the information prompting device obtains player card game progress information of the chess and card players in the current chess and card game according to the video stream information of the chess and card directions and the real-time chess and card game situation information;

and generating corresponding chess and card prompting information based on the player card game progress information of the chess and card players in the current chess and card game and the currently configured chess and card activity rule, and prompting information through an information prompting unit of the chess and card direction of the chess and card players.

3. The intelligent chess and card information prompting method according to claim 2, wherein the step of generating corresponding chess and card prompting information and prompting information through the information prompting unit of the chess and card orientation of the chess and card player based on the player-card-game progress information of the chess and card player in the current chess and card game and the currently configured chess and card activity rules comprises the following steps:

carrying out chess and card change analysis on the progress information of the player's chess and card in the current chess and card game of the chess and card player, and judging whether the current real-time chess and card game information of the chess and card player meets at least one preset condition of a currently configured chess and card activity rule;

and when any preset condition is judged to be met, generating prompt information corresponding to the preset condition and carrying out information prompt through an information prompt unit of the chess and card direction of the chess and card player.

4. The method of claim 1, wherein the step of presenting information to each player according to the real-time game situation information and the entry configuration information corresponding to the mobile electronic terminal of each player comprises:

carrying out chess and card change analysis on the real-time chess and card situation information to obtain chess and card change analysis information;

carrying out player matching on the chess and card change analysis information according to the admission configuration information corresponding to the mobile electronic terminal of each chess and card player to obtain the chess and card change analysis information of each chess and card player;

and carrying out information prompt on each chess and card player according to the chess and card change analysis information of each chess and card player.

5. The intelligent board information prompting method of claim 1, wherein the board system further comprises a server, the method further comprising:

the information prompting device sends the real-time chess and card situation information to the server, so that the server counts the chess and card process records of each chess and card player in each chess and card situation according to the real-time chess and card situation information, and the mobile electronic terminal conducts data calling on the chess and card process records.

6. The intelligent chess and card information prompting method according to any one of claims 1-5, wherein the step of performing video image analysis on the video stream information of the chess and card area to obtain real-time chess and card situation information of the chess and card area comprises the following steps:

acquiring a video frame boundary marking area sequence corresponding to the video stream information of the chess area;

acquiring chess feature matching vector information between a video frame feature information sequence corresponding to a plurality of video frame boundary labeling area sequences and a plurality of preset chess feature objects, wherein the chess feature matching vector information comprises chess feature matching vectors corresponding to the video frame feature information sequences and the preset chess feature objects and chess feature change information of the chess feature matching vectors;

classifying and predicting chess feature matching vector information between a video frame feature information sequence corresponding to a plurality of video frame boundary labeling area sequences and a plurality of preset chess feature objects according to a deep learning network to generate a corresponding target prediction information sequence, and performing chess and card situation display of prompt information corresponding to a prediction information object on each prediction information object appointed in the target prediction information sequence based on the target prediction information sequence to obtain real-time chess and card situation information.

7. The intelligent chess and card information prompting method according to claim 6, wherein the step of performing classification prediction on chess and card feature matching vector information between a video frame feature information sequence corresponding to a plurality of video frame boundary labeling area sequences and a plurality of preset chess and card feature objects according to a deep learning network to generate a corresponding target prediction information sequence comprises the following steps:

determining matching characteristic values between the video frame characteristic information sequences and preset chess characteristic objects respectively based on the chess characteristic matching vector information, obtaining chess situation display characteristic vectors of each video frame characteristic information sequence and chess situation display characteristic vectors of each preset chess characteristic object based on the matching characteristic values, determining similar video frame characteristic information sequences of each video frame characteristic information sequence according to a first deep learning network based on the chess situation display characteristic vectors of each video frame characteristic information sequence, determining similar prediction information sequences corresponding to each video frame characteristic information sequence according to a second deep learning network based on the chess situation display characteristic vectors of each preset chess characteristic object;

the target prediction information sequence comprises a preset chess characteristic object of a chess characteristic matching vector corresponding to each video frame characteristic information sequence, a preset chess characteristic object of a chess characteristic matching vector corresponding to the similar video frame characteristic information sequence and the similar prediction information sequence of each video frame characteristic information sequence;

the deep learning network respectively comprises a first deep learning network and a second deep learning network, the first deep learning network is obtained by training based on first training samples and video frame characteristic information sequence labels corresponding to the first training samples, and the second deep learning network is obtained by training based on second training samples and prediction information sequence labels corresponding to the second training samples.

8. The intelligent chess and card information prompting method according to claim 7, wherein before the step of determining the matching feature values between the video frame feature information sequence and the preset chess and card feature objects respectively based on the chess and card feature matching vector information, further comprising:

deleting the chess and card feature matching vectors to be processed in the chess and card feature matching vectors based on the chess and card feature change information to obtain processed chess and card feature matching vector information, wherein the chess and card feature matching vectors specify chess and card feature change information in the chess and card feature matching vectors of a prediction information sequence which does not meet the chess and card rule trigger information, and the specified prediction information sequence is a preset chess and card feature object of which the corresponding video frame feature information sequence quantity is greater than a video frame feature information sequence threshold value in the preset chess and card feature objects;

the determining of the matching characteristic values between the video frame characteristic information sequence and the preset chess characteristic objects respectively based on the chess characteristic matching vector information comprises the following steps:

and determining matching characteristic values between the video frame characteristic information sequence and the preset chess characteristic objects respectively based on the processed chess characteristic matching vector information.

9. The intelligent chess and card information prompting method according to claim 7 or 8, wherein the determining matching feature values between the video frame feature information sequence and the preset chess and card feature objects respectively based on the chess and card feature matching vector information comprises:

acquiring the similarity proportion of each chess and card characteristic matching vector between a video frame characteristic information sequence which is currently subjected to matching characteristic value calculation and a preset chess and card characteristic object which is currently subjected to matching characteristic value calculation;

and adding the similarity proportion of each chess and card feature matching vector to obtain a matching feature value between the video frame feature information sequence subjected to matching feature value calculation at present and the preset chess and card feature object subjected to matching feature value calculation at present.

10. The intelligent chess and card information prompting method according to claim 7 or 8, wherein the step of obtaining the chess and card situation display feature vector of each video frame feature information sequence and the chess and card situation display feature vector of each preset chess and card feature object based on the matching feature value comprises the steps of:

acquiring an initial chess and card situation display characteristic vector of each video frame characteristic information sequence and an initial chess and card situation display characteristic vector of each preset chess and card characteristic object;

acquiring prediction reference parameters of any video frame characteristic information sequence and any prediction information sequence based on an initial chess and card situation display characteristic vector of any video frame characteristic information sequence in the video frame characteristic information sequences and any preset chess and card characteristic object in the preset chess and card characteristic objects in sequence to obtain integral prediction reference parameter distribution;

sequentially acquiring chess and card situation generating elements of any video frame characteristic information sequence and any prediction information sequence based on a matching characteristic value of any video frame characteristic information sequence in the video frame characteristic information sequences and any prediction information sequence in the preset chess and card characteristic objects and a first chess and card situation generating element rule to obtain a first integral chess and card situation generating element;

acquiring the difference between the overall prediction reference parameter distribution and the first overall chess and card situation generating element, and updating the initial chess and card situation display characteristic vector based on the difference to obtain a first chess and card situation display characteristic vector to be spliced;

obtaining the correlation between any video frame characteristic information sequence and any prediction information sequence based on the initial chess and card situation display characteristic vector of any video frame characteristic information sequence in the video frame characteristic information sequences and any prediction information sequence in the preset chess and card characteristic objects in sequence to obtain overall correlation distribution;

sequentially acquiring chess and card situation generating elements of any video frame characteristic information sequence and any prediction information sequence based on a matching characteristic value of any video frame characteristic information sequence in the video frame characteristic information sequences and any prediction information sequence in the preset chess and card characteristic objects and a second chess and card situation generating element rule to obtain a second integral chess and card situation generating element;

acquiring the difference between the overall correlation distribution and the second overall chess and card situation generating elements, and updating the initial chess and card situation display feature vector based on the difference to obtain a second chess and card situation display feature vector to be spliced;

and splicing the first chess and card situation display characteristic vector to be spliced with the second chess and card situation display characteristic vector to be spliced to obtain each video frame characteristic information sequence and each chess and card situation display characteristic vector corresponding to the preset chess and card characteristic object.

Technical Field

The application relates to the technical field of intelligent equipment, in particular to an intelligent chess and card information prompting method.

Background

Chess and cards (such as mahjong) belong to a game played by multiple persons at the same time, and frequent language communication is needed among persons. Particularly, in the card-playing link, the card player needs to speak the information of the chess and card at the same time to prompt other players, so that the judgment of the other players is facilitated. However, considering the number of the points and the suits of the mahjong, the accent, the dialect and other personal factors of each player influence the accuracy of the pronunciation of the played chess, and even the phenomenon that the pronunciation mouth of the player is not mixed by heart or intention is not excluded, which may cause the misjudgment of other players. Once this phenomenon occurs, other players may dispute the player, which may affect the smooth progress of the mahjong game. Particularly in chess and card games, it is important for players to accurately declare played chess and cards simultaneously.

With the rapid development of the current information technology, the possibility of solving the problem of accurate information prompt when the chess and card players play cards is provided.

Disclosure of Invention

Based on the not enough of current design, the application provides a chess and card system, through carrying out the video image analysis with the regional real-time chess and card situation information of acquisition chess and card to the regional video stream information of chess and card, thereby carry out automatic information suggestion to every chess and card player according to the configuration information of registering that the mobile electronic terminal that each chess and card player that real-time chess and card situation information and intelligent chess and card machine correspond corresponds carries out automatic information, need not chess and card player initiative suggestion, and then improve information prompt precision and efficiency, also avoid simultaneously because the influence of player personal factor reduces the information prompt accuracy of the chess and card of being played, cause the problem of other players erroneous judgement.

According to the first aspect of the application, an intelligent chess and card information prompting method is provided and applied to a chess and card system, the chess and card system comprises an intelligent chess and card machine, a first video acquisition device, an information prompting device and a mobile electronic terminal, the first video acquisition device is located above a chess and card area of the intelligent chess and card machine, the information prompting device is communicated with the first video acquisition device, and the method comprises the following steps:

the information prompting device acquires video stream information of the chess and card area acquired by the first video acquisition device;

the information prompting device carries out video image analysis on the video stream information of the chess and card area to obtain real-time chess and card situation information of the chess and card area;

the information prompting device carries out information prompting on each chess and card player according to the real-time chess and card situation information and the admission configuration information corresponding to the mobile electronic terminals of the chess and card players corresponding to the intelligent chess and card machine, wherein the admission configuration information corresponding to the mobile electronic terminals of the chess and card players comprises chess and card rule configuration information, chess and card direction information and player identification information.

In one possible implementation of the first aspect, the chess and card system further includes a second video capture device respectively located at each chess and card orientation of the intelligent chess and card machine, the second video capture device at each chess and card orientation being configured to capture video stream information corresponding to the chess and card orientation, the information presentation device including an information presentation unit for each chess and card orientation, the method further comprising:

the information prompting device obtains player card game progress information of the chess and card players in the current chess and card game according to the video stream information of the chess and card directions and the real-time chess and card game situation information;

and generating corresponding chess and card prompting information based on the player card game progress information of the chess and card players in the current chess and card game and the currently configured chess and card activity rule, and prompting information through an information prompting unit of the chess and card direction of the chess and card players.

In a possible implementation manner of the first aspect, the step of generating corresponding chess and card prompt information based on the player-card-hand progress information of the chess and card player in the current chess and card-card hand and the currently configured chess and card activity rule, and performing information prompt through the information prompt unit of the chess and card orientation in which the chess and card player is located includes:

carrying out chess and card change analysis on the progress information of the player's chess and card in the current chess and card game of the chess and card player, and judging whether the current real-time chess and card game information of the chess and card player meets at least one preset condition of a currently configured chess and card activity rule;

and when any preset condition is judged to be met, generating prompt information corresponding to the preset condition and carrying out information prompt through an information prompt unit of the chess and card direction of the chess and card player.

In a possible implementation manner of the first aspect, the step of performing information prompt on each chess and card player according to the real-time chess and card situation information and entrance configuration information corresponding to a mobile electronic terminal of each chess and card player corresponding to the intelligent chess and card machine includes:

carrying out chess and card change analysis on the real-time chess and card situation information to obtain chess and card change analysis information;

carrying out player matching on the chess and card change analysis information according to the admission configuration information corresponding to the mobile electronic terminal of each chess and card player to obtain the chess and card change analysis information of each chess and card player;

and carrying out information prompt on each chess and card player according to the chess and card change analysis information of each chess and card player.

In one possible implementation of the first aspect, the chess and card system further comprises a server, and the method further comprises:

the information prompting device sends the real-time chess and card situation information to the server, so that the server counts the chess and card process records of each chess and card player in each chess and card situation according to the real-time chess and card situation information, and the mobile electronic terminal conducts data calling on the chess and card process records.

In a possible implementation manner of the first aspect, the step of performing video image analysis on the video stream information of the chess area to obtain real-time chess and card situation information of the chess and card area includes:

acquiring a video frame boundary marking area sequence corresponding to the video stream information of the chess area;

acquiring chess feature matching vector information between a video frame feature information sequence corresponding to a plurality of video frame boundary labeling area sequences and a plurality of preset chess feature objects, wherein the chess feature matching vector information comprises chess feature matching vectors corresponding to the video frame feature information sequences and the preset chess feature objects and chess feature change information of the chess feature matching vectors;

classifying and predicting chess feature matching vector information between a video frame feature information sequence corresponding to a plurality of video frame boundary labeling area sequences and a plurality of preset chess feature objects according to a deep learning network to generate a corresponding target prediction information sequence, and performing chess and card situation display of prompt information corresponding to a prediction information object on each prediction information object appointed in the target prediction information sequence based on the target prediction information sequence to obtain real-time chess and card situation information.

In a possible implementation manner of the first aspect, the step of performing classification prediction on chess feature matching vector information between a video frame feature information sequence corresponding to a plurality of video frame boundary labeling region sequences and a plurality of preset chess feature objects according to a deep learning network to generate a corresponding target prediction information sequence includes:

determining matching characteristic values between the video frame characteristic information sequences and preset chess characteristic objects respectively based on the chess characteristic matching vector information, obtaining chess situation display characteristic vectors of each video frame characteristic information sequence and chess situation display characteristic vectors of each preset chess characteristic object based on the matching characteristic values, determining similar video frame characteristic information sequences of each video frame characteristic information sequence according to a first deep learning network based on the chess situation display characteristic vectors of each video frame characteristic information sequence, determining similar prediction information sequences corresponding to each video frame characteristic information sequence according to a second deep learning network based on the chess situation display characteristic vectors of each preset chess characteristic object;

the target prediction information sequence comprises a preset chess characteristic object of a chess characteristic matching vector corresponding to each video frame characteristic information sequence, a preset chess characteristic object of a chess characteristic matching vector corresponding to the similar video frame characteristic information sequence and the similar prediction information sequence of each video frame characteristic information sequence;

the deep learning network respectively comprises a first deep learning network and a second deep learning network, the first deep learning network is obtained by training based on first training samples and video frame characteristic information sequence labels corresponding to the first training samples, and the second deep learning network is obtained by training based on second training samples and prediction information sequence labels corresponding to the second training samples.

In a possible implementation manner of the first aspect, before the step of determining matching feature values between the sequence of video frame feature information and the preset chess feature objects respectively based on the chess feature matching vector information, the method further includes:

deleting the chess and card feature matching vectors to be processed in the chess and card feature matching vectors based on the chess and card feature change information to obtain processed chess and card feature matching vector information, wherein the chess and card feature matching vectors specify chess and card feature change information in the chess and card feature matching vectors of a prediction information sequence which does not meet the chess and card rule trigger information, and the specified prediction information sequence is a preset chess and card feature object of which the corresponding video frame feature information sequence quantity is greater than a video frame feature information sequence threshold value in the preset chess and card feature objects;

the determining of the matching characteristic values between the video frame characteristic information sequence and the preset chess characteristic objects respectively based on the chess characteristic matching vector information comprises the following steps:

and determining matching characteristic values between the video frame characteristic information sequence and the preset chess characteristic objects respectively based on the processed chess characteristic matching vector information.

In a possible implementation manner of the first aspect, the determining, based on the chess feature matching vector information, matching feature values between the video frame feature information sequences and the preset chess feature objects respectively includes:

acquiring the similarity proportion of each chess and card characteristic matching vector between a video frame characteristic information sequence which is currently subjected to matching characteristic value calculation and a preset chess and card characteristic object which is currently subjected to matching characteristic value calculation;

and adding the similarity proportion of each chess and card feature matching vector to obtain a matching feature value between the video frame feature information sequence subjected to matching feature value calculation at present and the preset chess and card feature object subjected to matching feature value calculation at present.

In a possible implementation manner of the first aspect, the obtaining, based on the matching feature value, a chess and card situation display feature vector of each video frame feature information sequence and a chess and card situation display feature vector of each preset chess and card feature object includes:

acquiring an initial chess and card situation display characteristic vector of each video frame characteristic information sequence and an initial chess and card situation display characteristic vector of each preset chess and card characteristic object;

acquiring prediction reference parameters of any video frame characteristic information sequence and any prediction information sequence based on an initial chess and card situation display characteristic vector of any video frame characteristic information sequence in the video frame characteristic information sequences and any preset chess and card characteristic object in the preset chess and card characteristic objects in sequence to obtain integral prediction reference parameter distribution;

sequentially acquiring chess and card situation generating elements of any video frame characteristic information sequence and any prediction information sequence based on a matching characteristic value of any video frame characteristic information sequence in the video frame characteristic information sequences and any prediction information sequence in the preset chess and card characteristic objects and a first chess and card situation generating element rule to obtain a first integral chess and card situation generating element;

acquiring the difference between the overall prediction reference parameter distribution and the first overall chess and card situation generating element, and updating the initial chess and card situation display characteristic vector based on the difference to obtain a first chess and card situation display characteristic vector to be spliced;

obtaining the correlation between any video frame characteristic information sequence and any prediction information sequence based on the initial chess and card situation display characteristic vector of any video frame characteristic information sequence in the video frame characteristic information sequences and any prediction information sequence in the preset chess and card characteristic objects in sequence to obtain overall correlation distribution;

sequentially acquiring chess and card situation generating elements of any video frame characteristic information sequence and any prediction information sequence based on a matching characteristic value of any video frame characteristic information sequence in the video frame characteristic information sequences and any prediction information sequence in the preset chess and card characteristic objects and a second chess and card situation generating element rule to obtain a second integral chess and card situation generating element;

acquiring the difference between the overall correlation distribution and the second overall chess and card situation generating elements, and updating the initial chess and card situation display feature vector based on the difference to obtain a second chess and card situation display feature vector to be spliced;

and splicing the first chess and card situation display characteristic vector to be spliced with the second chess and card situation display characteristic vector to be spliced to obtain each video frame characteristic information sequence and each chess and card situation display characteristic vector corresponding to the preset chess and card characteristic object.

According to a second aspect of the application, a chess and card system is provided, which comprises an intelligent chess and card machine, a first video acquisition device, an information prompting device and a mobile electronic terminal, wherein the first video acquisition device is positioned above a chess and card area of the intelligent chess and card machine, and the information prompting device is communicated with the first video acquisition device;

the information prompting device is used for:

acquiring video stream information of the chess and card area acquired by the first video acquisition device;

the information prompting device carries out video image analysis on the video stream information of the chess and card area to obtain real-time chess and card situation information of the chess and card area;

the information prompting device carries out information prompting on each chess and card player according to the real-time chess and card situation information and the admission configuration information corresponding to the mobile electronic terminals of the chess and card players corresponding to the intelligent chess and card machine, wherein the admission configuration information corresponding to the mobile electronic terminals of the chess and card players comprises chess and card rule configuration information, chess and card direction information and player identification information.

According to the third aspect of the application, provide an intelligence chess and card information suggestion device, be applied to the information suggestion device in the chess and card system, the chess and card system includes intelligent chess and card machine, first video acquisition device, information suggestion device, mobile electronic terminal, first video acquisition device is located the regional top of chess and card of intelligence chess and card machine, information suggestion device with first video acquisition device communicates, the device includes:

the acquisition module is used for acquiring the video stream information of the chess and card area acquired by the first video acquisition device;

the analysis module is used for carrying out video image analysis on the video stream information of the chess and card area to obtain real-time chess and card situation information of the chess and card area;

and the prompting module is used for performing information prompting on each chess and card player according to the real-time chess and card situation information and the admission configuration information corresponding to the mobile electronic terminal of each chess and card player corresponding to the intelligent chess and card machine, wherein the admission configuration information corresponding to the mobile electronic terminal of each chess and card player comprises chess and card rule configuration information, chess and card direction information and player identification information.

Based on above-mentioned arbitrary aspect, this application carries out video image analysis in order to obtain the regional real-time chess and card situation information of chess and card through the video stream information to the chess and card region, thereby carry out automatic information suggestion to every chess and card player according to real-time chess and card situation information and the configuration information that the mobile electronic terminal that each chess and card player that intelligence chess and card machine corresponds, need not chess and card player initiative suggestion, and then improve information suggestion precision and efficiency, also avoid simultaneously because the influence of player personal factor reduces the information suggestion accuracy of the chess and card of beating out, cause the problem of other players erroneous judgement.

Drawings

In order to more clearly illustrate the technical solutions of the embodiments of the present application, the drawings that are required to be used in the embodiments will be briefly described below, it should be understood that the following drawings only illustrate some embodiments of the present application and therefore should not be considered as limiting the scope, and for those skilled in the art, other related drawings can be obtained from the drawings without inventive effort.

FIG. 1 is a schematic diagram illustrating a scenario of a chess and card system provided by an embodiment of the present application;

FIG. 2 is a flow chart of an intelligent chess and card information prompting method provided by an embodiment of the present application;

fig. 3 is a second schematic flow chart of an intelligent chess and card information prompting method provided in the embodiment of the present application;

FIG. 4 shows a flow diagram of the substeps of step S120 shown in FIG. 2;

FIG. 5 is a flow chart illustrating the sub-steps of step S130 shown in FIG. 2;

FIG. 6 is a schematic diagram illustrating functional modules of an intelligent chess and card information prompting device provided by an embodiment of the application;

fig. 7 is a block diagram illustrating a schematic structure of an information prompting device for implementing the above-described intelligent chess and card information prompting method according to an embodiment of the present application.

Detailed Description

In order to make the purpose, technical solutions and advantages of the embodiments of the present application clearer, the technical solutions in the embodiments of the present application will be clearly and completely described below with reference to the drawings in the embodiments of the present application, and it should be understood that the drawings in the present application are for illustrative and descriptive purposes only and are not used to limit the scope of protection of the present application. Additionally, it should be understood that the schematic drawings are not necessarily drawn to scale. The flowcharts used in this application illustrate operations implemented according to some of the embodiments of the present application.

It should be understood that the operations of the flow diagrams may be performed out of order, and steps without logical context may be performed in reverse order or simultaneously. One skilled in the art, under the guidance of this application, may add one or more other operations to, or remove one or more operations from, the flowchart.

Referring to fig. 1, fig. 1 is a schematic view illustrating a scene of a chess and card system 10 provided by an embodiment of the present application. For example, board system 10 may include information prompting device 100, intelligent board machine 200, first video capture device 300, second video capture device 400, mobile electronic terminal 500, and server 600. First video acquisition device 300 is located the chess and card region top of intelligence chess and card machine 200, and information prompt device 100 communicates with first video acquisition device 300. Second video acquisition device 400 is located every chess and card position of intelligent chess and card machine 200 respectively, and the second video acquisition device 400 in every chess and card position is used for gathering the video stream information that corresponds chess and card position, and information suggestion device 100 includes the information suggestion unit to every chess and card position. The server 600 is in communication connection with the information presentation device 100 and the mobile electronic terminal 500.

In one possible implementation, intelligent card machine 200 may include a card area for placing a plurality of cards, card positions located around the card area for individual players, and a card screen area for placing at least one card screen.

For example, taking a mahjong machine as an example, the intelligent chess and card machine 200 is also a mahjong machine body, if the mahjong machine is a four-player mahjong, the chess and card area of the chess and card machine body is also a mahjong placement area, and the periphery of the chess and card area can include four corresponding mahjong positions.

In one possible implementation, the mobile electronic terminal 500 may send or receive signals over a wired or wireless network, for example, or may process or store signals in a physical memory state, such as in a memory. Each mobile electronic terminal 500 may be an electronic device including hardware, software, or embedded logic elements, or a combination of two or more such elements, and capable of performing the appropriate functions implemented or supported by the mobile electronic terminal 500. Optionally, the mobile electronic terminal 500 may be a device with a wireless transceiving function, including an indoor or outdoor device, a handheld device, a wearable device, and the like, and the embodiment of the present application does not limit the application context. For example, the mobile electronic terminal 500 may be, but is not limited to, an electronic device such as a smart phone, a tablet computer, a smart wearable device, and the like, and is not limited thereto.

In one possible implementation, the mobile electronic terminal 500 may include: a processing device including an application processing section and a radio frequency/digital signal processor; a display screen; a keypad that may include physical keys, touch keys overlaid on a display, or a combination thereof; a subscriber identity module card; memory devices that may include ROM, RAM, flash memory, or any combination thereof; a Wi-Fi and/or Bluetooth interface; the NFC chip, the wireless power receiving coil used for wireless charging and the wireless telephone interface; a power management circuit with an associated battery; a USB interface and a connector; an audio management system with associated microphone, speaker and headphone jack; and various optional accessory components such as cameras, global positioning systems, accelerators, etc. In addition, various client applications may be installed on the mobile electronic terminal 500, which may be used to allow the mobile electronic terminal 500 to be used to communicate commands appropriate for operation with other devices. Such applications may be downloaded from the server 600 and installed into the memory of the mobile electronic terminal 500, or may have been previously installed on the mobile electronic terminal 500. In the embodiment of the present application, a chess management application (which may be an APP application, a wechat applet, a pay little applet, a WEB light application, etc.) may be installed on the mobile electronic terminal 500. The chess and card management application can prompt a user to realize functions of user registration, user login, chess and card activity rule configuration, chess and card scoring checking, user interaction, user invitation and the like.

In one possible embodiment, the server 600 may be a single physical server, or may be a server group consisting of a plurality of physical servers for performing different data processing functions. The set of servers can be centralized or distributed (e.g., server 600 can be a distributed system). In some possible embodiments, such as where server 600 employs a single physical server, different logical server components may be assigned to the physical server based on different video analytics functions.

In one possible implementation, the server 600 should be understood as a service point that provides processing, repository, communication facilities. By way of example, server 600 may refer to a single physical processor with associated communication and data storage and library facilities, or it may refer to a networked or clustered collection of processors, associated networks, and storage devices, and operates on software and one or more library systems and application software that support the services provided by server 600. The servers 600 may vary widely in configuration or performance, but the servers 600 may generally include one or more central processing units and memory units. The Server 600 may also include one or more large storage devices, one or more power supplies, one or more wired or wireless network components, one or more input/output components, or one or more operating systems, such as Windows Server, Mac OS X, Unix, Linux, FreeBSD.

In one possible embodiment, the first video capture device 300 and the second video capture device 400 obtain the video signal by converting the optical image signal into an electrical signal for storage or transmission, so that the light reflected by the photographed playing piece is collected by the camera lens and focused on the light receiving surface of the image pickup device (e.g., the target surface of the camera tube), and then the light is converted into electrical energy by the image pickup device.

It will be appreciated that the playing system 10 shown in FIG. 1 is merely one possible example, and that in other possible embodiments, the playing system 10 may include only some of the components shown in FIG. 1 or may include additional components.

Fig. 2 is a schematic flow chart of an intelligent chess and card information prompting method provided in an embodiment of the present application, which may be executed by the chess and card system 10 shown in fig. 1, specifically, by the information prompting device 100, or by other devices with any computing and processing capabilities, and it should be understood that, in other embodiments, the order of some steps in the intelligent chess and card information prompting method of the present embodiment may be interchanged according to actual needs, or some steps in the intelligent chess and card information prompting method may be omitted or deleted. The detailed steps of the intelligent chess and card information prompting method are introduced as follows.

In step S110, the information prompt apparatus 100 obtains the video stream information of the chess area acquired by the first video acquisition apparatus 300.

In this embodiment, the information prompting device 100 may obtain the video stream information of the chess area collected by the first video collecting device 300 in real time or at the beginning of each chess game.

Step S120, the information prompting device 100 performs video image analysis on the video stream information in the chess area to obtain real-time chess and card situation information in the chess area.

In step S130, the information presentation device 100 presents information to each of the players according to the real-time chess and card situation information and the entrance configuration information corresponding to the mobile electronic terminal 500 of each of the players corresponding to the intelligent chess and card machine 200.

In this embodiment, the real-time card game information may include the card face information and the posture change sequence of each of the chess and cards of the chess and card player, and the current real-time card game situation may be obtained by the card face information and the posture change sequence of each of the chess and cards. Therefore, the chess and card playing condition, the card surface condition of playing, the card surface condition in the hand and the like of each current chess and card player can be obtained based on the real-time card information, and therefore the real-time scoring information corresponding to the real-time card information can be calculated based on the currently configured chess and card activity rule.

In this embodiment, the entry configuration information corresponding to the mobile electronic terminal 500 of each chess player may include chess rule configuration information, chess orientation information, and player identification information. The chess and card rule configuration information may refer to playing rules in the process of playing the chess and card game (for example, for mahjong, the chess and card activity rules may include a picnic rule, a hit rule, a stroke rule, and the like), the chess and card orientation information may refer to orientation positions of each chess and card player in the intelligent chess and card machine 200, and the player identification information may refer to unique identification IDs of each chess and card player.

Based on the above steps, the embodiment analyzes the video image through the video stream information of the chess and card area to obtain the real-time chess and card situation information of the chess and card area, thereby automatically prompting the information of each chess and card player according to the real-time chess and card situation information and the entrance configuration information corresponding to the mobile electronic terminal 500 of each chess and card player corresponding to the intelligent chess and card machine 200, without the active prompting of the chess and card players, thereby improving the information prompting precision and efficiency, and simultaneously avoiding the problem of misjudgment of other players due to the reduction of the accuracy of the information prompting of the played chess and card by the influence of personal factors of the players.

In a possible implementation manner, referring to fig. 3, on the basis of the above embodiment, the method provided in the embodiment of the present application may further include the following steps S140 to S150, which are described in detail below.

Step S140, the information prompt device 100 obtains the player' S play progress information of the player in the current play according to the video stream information of the playing direction and the real-time playing face information.

In this embodiment, each second video capture device 400 may capture video stream information of the direction of each chess or card in real time or at the beginning of each chess or card game, and send the video stream information to the information prompting device 100, so that the information prompting device 100 can further obtain the video stream information of the direction of each chess or card player.

And S150, generating corresponding chess and card prompting information based on the progress information of the chess and card player in the current chess and card game and the currently configured chess and card activity rule, and prompting information through an information prompting unit of the chess and card direction of the chess and card player.

For example, in one possible implementation, the game change analysis may be performed on the progress information of the game of the player in the current game of the game player, whether the current real-time game information of the game player satisfies at least one preset condition of the currently configured game activity rule is determined, and when it is determined that any preset condition is satisfied, the prompt information corresponding to the preset condition is generated and the information prompt is performed through the information prompt unit of the game orientation of the game player.

The prompt information includes a chess and card recommendation strategy, and by taking mahjong as an example, whether the chess and card player currently meets a bar condition, a hit condition, a moustache condition and the like can be judged, and when the chess and card player meets the bar condition, corresponding prompt information is generated, and the player can be prompted according to a corresponding prompt mode, wherein the prompt mode can be set in an individualized manner according to actual player requirements, and the embodiment does not specifically limit the game.

In one possible implementation, referring further to fig. 4, step S120 may be implemented by the following exemplary sub-steps, which are described in detail below.

And a substep S121, obtaining a video frame boundary marking region sequence corresponding to the video stream information of the chess and card region.

And a substep S122 of obtaining chess and card feature matching vector information between the video frame feature information sequences corresponding to the video frame boundary labeling area sequences and the preset chess and card feature objects, wherein the chess and card feature matching vector information comprises chess and card feature matching vectors corresponding to the video frame feature information sequences and the preset chess and card feature matching objects and chess and card feature change information of the chess and card feature matching vectors.

And a substep S123 of classifying and predicting chess feature matching vector information between the video frame feature information sequences corresponding to the video frame boundary labeling area sequences and a plurality of preset chess feature objects according to a deep learning network to generate corresponding target prediction information sequences, and performing chess and card situation display of prompt information corresponding to the prediction information objects on each prediction information object appointed in the target prediction information sequences based on the target prediction information sequences to obtain real-time chess and card situation information.

For example, in sub-step S122, matching feature values between the video frame feature information sequences and preset chess feature objects respectively may be determined based on chess feature matching vector information, a chess/card situation display feature vector of each video frame feature information sequence and a chess/card situation display feature vector of each preset chess/card feature object are obtained based on the matching feature values, a similar video frame feature information sequence of each video frame feature information sequence is determined according to a first deep learning network based on the chess/card situation display feature vector of each video frame feature information sequence, a similar prediction information sequence corresponding to each video frame feature information sequence is determined according to a second deep learning network based on the chess/card situation display feature vector of each preset chess/card feature object.

It is worth to be noted that the target prediction information sequence includes a preset chess feature object of a chess feature matching vector corresponding to each video frame feature information sequence, a preset chess feature object of a chess feature matching vector corresponding to a similar video frame feature information sequence, and a similar prediction information sequence of each video frame feature information sequence.

It is worth to be noted that the deep learning network respectively includes a first deep learning network and a second deep learning network, the first deep learning network is obtained by training based on the first training samples and the video frame characteristic information sequence labels corresponding to each first training sample, and the second deep learning network is obtained by training based on the second training samples and the prediction information sequence labels corresponding to each second training sample.

In a possible implementation manner, before determining matching feature values between the video frame feature information sequence and preset chess feature objects respectively based on the chess feature matching vector information, the chess feature matching vectors to be processed in the chess feature matching vectors can be deleted based on the chess feature change information, and processed chess feature matching vector information is obtained.

The chess and card feature matching information in the chess and card feature matching vectors of the to-be-processed chess and card feature matching vector appointed prediction information sequence does not meet the chess and card feature matching vector of appointed chess and card rule trigger information, and the appointed prediction information sequence is a preset chess and card feature object of which the corresponding video frame feature information sequence quantity is greater than a video frame feature information sequence threshold value in a plurality of preset chess and card feature objects.

In this way, in the process of determining the matching feature values between the video frame feature information sequences and the preset chess feature objects respectively based on the chess feature matching vector information, the matching feature values between the video frame feature information sequences and the preset chess feature objects respectively can be determined based on the processed chess feature matching vector information.

In a possible implementation manner, in the process of determining matching feature values between the video frame feature information sequence and the preset chess feature objects respectively based on the chess feature matching vector information, the similarity proportion of each chess feature matching vector between the video frame feature information sequence currently subjected to matching feature value calculation and the preset chess feature objects currently subjected to matching feature value calculation can be obtained, and the similarity proportions of each chess feature matching vector are added to obtain the matching feature value between the video frame feature information sequence currently subjected to matching feature value calculation and the preset chess feature objects currently subjected to matching feature value calculation.

In a possible implementation manner, in the process of obtaining the chess and card situation display feature vector of each video frame feature information sequence and the chess and card situation display feature vector of each preset chess and card feature object based on the matching feature value, the initial chess and card situation display feature vector of each video frame feature information sequence and the initial chess and card situation display feature vector of each preset chess and card feature object may be obtained, and then prediction reference parameters of any video frame feature information sequence and any prediction information sequence are obtained in sequence based on any video frame feature information sequence in the plurality of video frame feature information sequences and the initial chess and card situation display feature vector of any preset chess and card feature object in the plurality of preset chess and card feature objects, so as to obtain the distribution of the overall prediction reference parameters.

On the basis, chess and card situation generating elements of any video frame characteristic information sequence and any prediction information sequence are obtained in sequence based on matching characteristic values of any video frame characteristic information sequence in a plurality of video frame characteristic information sequences and any prediction information sequence in a plurality of preset chess and card characteristic objects and a first chess and card situation generating element rule, and a first integral chess and card situation generating element is obtained.

Then, obtaining the difference between the overall prediction reference parameter distribution and a first overall chess and card situation generating element, updating an initial chess and card situation display characteristic vector based on the difference to obtain a first chess and card situation display characteristic vector to be spliced, and then sequentially obtaining the correlation between any video frame characteristic information sequence and any prediction information sequence based on any video frame characteristic information sequence in a plurality of video frame characteristic information sequences and the initial chess and card situation display characteristic vector of any prediction information sequence in a plurality of preset chess and card characteristic objects to obtain overall correlation distribution.

Then, chess and card situation generating elements of any video frame characteristic information sequence and any prediction information sequence are obtained sequentially based on a matching characteristic value of any video frame characteristic information sequence in the video frame characteristic information sequences and any prediction information sequence in the preset chess and card characteristic objects and a second chess and card situation generating element rule, a second integral chess and card situation generating element is obtained, then, the difference between integral correlation distribution and the second integral chess and card situation generating element is obtained, and the initial chess and card situation display characteristic vector is updated based on the difference to obtain a second chess and card situation display characteristic vector to be spliced.

Therefore, the first chess and card situation display characteristic vector to be spliced and the second chess and card situation display characteristic vector to be spliced can be spliced to obtain each video frame characteristic information sequence and the chess and card situation display characteristic vector corresponding to each preset chess and card characteristic object.

In one possible implementation, referring to fig. 5 in conjunction with step S130, the following exemplary sub-steps can be implemented, which are described in detail below.

And a substep S131 of analyzing the real-time chess and card situation information to obtain chess and card change analysis information.

In the substep S132, player matching is performed on the chess and card change analysis information according to the entry configuration information corresponding to the mobile electronic terminal 500 of each chess and card player, so as to obtain the chess and card change analysis information of each chess and card player.

And a substep S133 of performing information presentation on each of the players according to the board change analysis information of each of the players.

That is, the present embodiment determines the board variation analysis information for each board player, and then information presentation is performed on each board player in a targeted manner. For example, each player is prompted as to what the current deal was, who the next player was, which player appeared to have the card, etc.

In a possible implementation, the information prompting device 100 may further send the real-time chess and card scenario information to the server 600, so that the server 600 counts the chess and card process records of each chess and card player in each chess and card scenario according to the real-time chess and card scenario information, so as to facilitate the mobile electronic terminal 500 to perform data retrieval on the chess and card process records. For example, server 600 may aggregate the playing process records of the corresponding players at each play, and generate a playing performance report and a playing training strategy for the players. For example, still taking mah-jong as an example, the server 600 may perform a summary analysis on the tile record, the stroke raising record, and the card losing record of the corresponding player in each mah-jong game, generate a game performance report of the player, and generate a mah-jong training strategy for the game performance of the player, such as how to analyze which tile should be analyzed in a set of mah-jong tiles, how to judge the stroke probability of the current tile, and so on. Due to the design, the player, especially a novice player, can be helped to get on the hands more skillfully, and the player experience is improved.

Based on the same inventive concept, please refer to fig. 6, which shows a schematic diagram of functional modules of the intelligent chess and card information prompting device 110 provided in the embodiment of the present application, and the embodiment can divide the functional modules of the intelligent chess and card information prompting device 110 according to the above method embodiment. For example, the functional blocks may be divided for the respective functions, or two or more functions may be integrated into one processing block. The integrated module can be realized in a hardware mode, and can also be realized in a software functional module mode. It should be noted that, in the embodiment of the present application, the division of the module is schematic, and is only one logic function division, and there may be another division manner in actual implementation. For example, when the function modules are divided according to the functions, the intelligent chess and card information presentation device 110 shown in fig. 6 is only a schematic diagram of the device. The intelligent chess and card information prompting device 110 may include an analysis module 111, an analysis module 112 and a prompting module 113, and the functions of the functional modules of the intelligent chess and card information prompting device 110 are described in detail below.

The obtaining module 111 is configured to obtain video stream information of the chess area collected by the first video collecting device 300. It is understood that the analysis module 111 can be used to execute the step S110, and the detailed implementation of the analysis module 111 can refer to the content related to the step S110.

The analysis module 112 is configured to perform video image analysis on the video stream information in the chess area to obtain real-time chess and card situation information in the chess area. It is understood that the analysis module 112 can be used to execute the step S120, and the detailed implementation of the analysis module 112 can refer to the content related to the step S120.

The prompting module 113 is configured to perform information prompting on each chess and card player according to the real-time chess and card situation information and the admission configuration information corresponding to the mobile electronic terminal 500 of each chess and card player corresponding to the intelligent chess and card machine 200, where the admission configuration information corresponding to the mobile electronic terminal 500 of each chess and card player includes chess and card rule configuration information, chess and card orientation information, and player identification information. It is understood that the prompting module 113 can be used to execute the step S130, and for the detailed implementation of the prompting module 113, reference can be made to the content related to the step S130.

Based on the same inventive concept, please refer to fig. 7, which shows a schematic block diagram of an information prompting device 100 for executing the above-mentioned intelligent chess and card information prompting method according to an embodiment of the present application, where the information prompting device 100 may include an intelligent chess and card information prompting device 110, a machine-readable storage medium 120 and a processor 130.

In one possible implementation, the machine-readable storage medium 120 and the processor 130 are both located in the information prompting device 100 and are located separately. However, it should be understood that the machine-readable storage medium 120 may be separate from the information prompting device 100 and may be accessed by the processor 130 through a bus interface. Alternatively, the machine-readable storage medium 120 may be integrated into the processor 130, e.g., may be a cache and/or general purpose registers.

The processor 130 is a control center of the information presentation apparatus 100, connects various parts of the entire information presentation apparatus 100 by various interfaces and lines, and performs various functions of the information presentation apparatus 100 and processes data by running or executing software programs and/or modules stored in the machine-readable storage medium 120 and calling data stored in the machine-readable storage medium 120, thereby performing overall monitoring of the information presentation apparatus 100. Alternatively, processor 130 may include one or more processing cores; for example, the processor 130 may integrate an application processor, which primarily handles operating systems, user interfaces, applications, etc., and a modem processor, which primarily handles wireless communications. It will be appreciated that the modem processor described above may not be integrated into the processor.

The processor 130 may be a general-purpose Central Processing Unit (CPU), a microprocessor, an Application-Specific Integrated Circuit (ASIC), or one or more Integrated circuits for controlling the execution of the program of the intelligent chess and card information prompting method provided by the above-mentioned method embodiments.

The machine-readable storage medium 120 may be, but is not limited to, a ROM or other type of static storage device that can store static information and instructions, a RAM or other type of dynamic storage device that can store information and instructions, an Electrically Erasable programmable Read-Only MEMory (EEPROM), a compact disc Read-Only MEMory (CD-ROM) or other optical disk storage, optical disk storage (including compact disc, laser disk, optical disk, digital versatile disk, blu-ray disk, etc.), a magnetic disk storage medium or other magnetic storage device, or any other medium that can be used to carry or store desired program code in the form of instructions or data structures and that can be accessed by a computer. The machine-readable storage medium 120 may be self-contained and coupled to the processor 130 via a communication bus. The machine-readable storage medium 120 may also be integrated with the processor. The machine-readable storage medium 120 is used for storing machine-executable instructions for executing the scheme of the present application, and for example, may store machine-executable instructions of various software functional modules (such as the analysis module 111, the analysis module 112, and the prompt module 113 shown in fig. 6) in the intelligent chess and card information prompt device 110. Processor 130 is configured to execute machine-executable instructions stored in machine-readable storage medium 120 to implement the intelligent chess and card information prompting method provided by the foregoing method embodiments.

Since the information prompt apparatus 100 provided in the embodiment of the present application is another implementation form of the method embodiment executed by the information prompt apparatus 100, and the information prompt apparatus 100 can be used to execute the intelligent chess and card information prompt method provided in the method embodiment, the technical effects obtained by the method embodiment can be referred to by the method embodiment, and are not described herein again.

Further, the present application also provides a readable storage medium containing computer executable instructions, and the computer executable instructions can be used for implementing the intelligent chess and card information prompting method provided by the above method embodiments when executed.

Of course, the storage medium provided in the embodiments of the present application contains computer-executable instructions, and the computer-executable instructions are not limited to the above method operations, and may also perform related operations in the intelligent chess and card information prompting method provided in any embodiments of the present application.

Embodiments of the present application are described with reference to flowchart illustrations and/or block diagrams of methods, apparatus and computer program products according to embodiments of the application. It will be understood that each flow and/or block of the flow diagrams and/or block diagrams, and combinations of flows and/or blocks in the flow diagrams and/or block diagrams, can be implemented by computer program instructions. These computer program instructions may be provided to a processor of a general purpose computer, special purpose computer, embedded processor, or other programmable data processing apparatus to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable data processing apparatus, create means for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.

While the present application has been described in connection with various embodiments, other variations to the disclosed embodiments can be understood and effected by those skilled in the art in practicing the claimed application, from a review of the drawings, the disclosure, and the appended claims. In the claims, the word "comprising" does not exclude other elements or steps, and the word "a" or "an" does not exclude a plurality. A single processor or other unit may fulfill the functions of several items recited in the claims. The mere fact that certain measures are recited in mutually different dependent claims does not indicate that a combination of these measures cannot be used to advantage.

The embodiments described above are only a part of the embodiments of the present application, and not all of the embodiments. The components of the embodiments of the present application, as generally described and illustrated in the figures herein, may be arranged and designed in a wide variety of different configurations. Thus, the detailed description of the embodiments of the present application provided in the accompanying drawings is not intended to limit the scope of the application, but is merely representative of selected embodiments of the application. Therefore, the protection scope of the present application shall be subject to the protection scope of the claims. Moreover, all other embodiments that can be made available by a person skilled in the art without making any inventive step based on the embodiments of the present application shall fall within the scope of protection of the present application.