Chess and play game system based on AR equipment
阅读说明:本技术 一种棋和基于ar设备的下棋游戏系统 (Chess and play game system based on AR equipment ) 是由 房晓俊 张宇 于 2018-09-07 设计创作,主要内容包括:本发明提供一种棋和下棋游戏系统,其中所述棋包括棋盘和棋子,通过AR显示设备的视场,同时显现虚实拟合的棋盘,并且在所述显现虚实拟合的棋盘上显现真实所述棋子和虚拟棋子,棋包括围棋、象棋、国际象棋、军棋、跳棋或者飞行棋。所述下棋游戏系统包括所述棋和AR显示设备,以及网络设备,所述网络设备,用于将一个空间中的所述AR显示设备与另一空间中的所述平面显示设备、VR显示设备,或者,另一副所述AR显示设备进行网络链接。(The invention provides a chess and a chess playing game system, wherein the chess comprises a chessboard and chess pieces, the chessboard which is subjected to virtual-real fitting is displayed simultaneously through the visual field of AR display equipment, real chess pieces and virtual chess pieces are displayed on the chessboard which is subjected to virtual-real fitting, and the chess pieces comprise go, Chinese chess, military chess, Chinese checkers or flight chess. The chess game playing system comprises the chess, AR display equipment and network equipment, wherein the network equipment is used for carrying out network link on the AR display equipment in one space and the plane display equipment and the VR display equipment in the other space or on the other pair of AR display equipment.)
1. A chess, comprising a chessboard and chess pieces, characterized in that through the field of view of an AR display device, a real chessboard or a virtuality-reality fitted chessboard is visualized, and the real chess pieces and virtual chess pieces are visualized on the real chessboard or the virtuality-reality fitted chessboard.
2. The board game of claim 1, wherein the board game comprises a go, a chess, a military chess, a checkers, or a flight chess.
3. The board game of claim 1 or 2, wherein the virtual board game is formed by the AR display device acquiring the length, width and height information of the real board game and the board line on the real board game.
4. The chess according to claim 3, characterised in that the real chessboard is provided with altimeters, gyroscopes, identification barcodes for positioning, identification two-dimensional codes for positioning, or the bobbin threads with light positioning.
5. The chess according to claim 4, wherein said real chessboard is equipped with a microphone, or a pressure sensor or a pressure circuit switch for positioning the real chess pieces.
6. The chess of claim 3, wherein the base of the chess piece is provided with a magnet.
7. The chess according to claim 6, wherein the real chessboard is correspondingly provided with electromagnetic inductors or grid circuits.
8. The chess of claim 3, wherein the chess pieces are glass-shelled LED chess pieces or plastic-shelled LED chess pieces.
9. A chess game system as claimed in claim 1, further comprising said AR display device in the same space.
10. The chess gaming system of claim 9, further comprising a flat display device, a VR display device, or another pair of said chess and another pair of said AR display devices, in another space; the AR display equipment in one space is directly linked with the plane display equipment and the VR display equipment in the other space or the other pair of AR display equipment to form a master link and a slave link of the double-player.
11. The system of claim 10, wherein the AR display devices in a space assume the role of a back-end server for dual-machine interaction.
12. The chess gaming system of claim 10, further comprising a network device for network linking the AR display device in one space with the planar display device, VR display device, or another pair of the AR display devices in another space.
13. A chess gaming system according to claim 12, characterised in that the network link comprises a local area network link, a wide area network link or an internet of things link.
14. A chess gaming system according to claim 12, characterised in that said network device links at least two different spaces, at least one pair of said chess and one pair of said AR display devices being provided in each of said different spaces.
15. A chess game system according to claim 12, characterised in that said network device includes a background server for assuming interactive operation of the parties.
16. A chess game system according to claim 11 or 15, characterised in that said background server comprises a memory for storing a chess game database, board information and/or the path trajectories or the falling order of said pieces for each different party.
17. The chess gaming system of claim 16, wherein the backend server further comprises a determination module or a hosting module,
the judging module is used for judging the size of the chess pieces or judging the win-or-lose of the chess playing according to the chess playing rules in the chess playing game database;
and the escrow module is used for replacing an instruction-escrowing party with a chess-playing rule in the chess-playing game database to play virtual chess.
18. A chess gaming system according to claim 9 or 10 or 12 or 13 or 14, characterised in that a virtuality-reality fit chessboard is simultaneously visualized by means of said AR display device, planar display device or VR display device, and that said real and said virtual chess pieces are visualized on said virtuality-reality fit chessboard.
19. The chess gaming system of claim 18, wherein said AR display device in said one space visualizes said real chess board at view 1 or said real chess board and virtual chess board at view 1 simultaneously, and visualizes said real chess piece at view 1 and said virtual chess piece at the other party on said real chess board or on a virtual-to-real fit chess board.
20. The system of claim 18, wherein the virtual board is presented via the AR display device, VR display device, or flat display device of a non-direct player of the game logged onto the network device, and the virtual pieces of each player are presented on the virtual board.
21. The AR display device of a chess gaming system of claim 9, comprising an immersive helmet-mounted display device, an AR all-in-one machine, a digital glass mirror, a digital glass desktop, a display, a smart mobile device, or an AR helmet to which the smart mobile device may be connected.
22. The AR display device of a chess game system according to claim 21, characterised in that the immersive head-mounted display device comprises an image head-mounted display, a transmissive head-mounted display, or an image transmissive combined head-mounted display.
Technical Field
The present invention relates to an interactive system, and more particularly, to a chess and an AR device-based chess game system, wherein the chess game system is applied to a virtual-real interactive chess game, and real chess game is interacted with virtual images.
Background
Augmented Reality (AR) is a branch of virtual Reality technology, and is an important means for multimedia technology to be implemented in the three-dimensional field, and images, videos, 3D models and the like are projected to human eyes together with real environment light, so that people feel that virtual images are observed in the real world, and the technology aims to cover the virtual world on a screen in the real world and interact with the virtual world. The existing augmented reality technology is mainly applied to medical treatment, manufacture and maintenance, television virtual broadcasting and other aspects.
The chess game is popular with people since birth, can lead people to experience the pleasure of the game in the game process, can also enhance the mental power of people and improve the intelligence level of players. In addition, the chess game has entertainment and education functions and is an important means for people to communicate with each other in daily life, and friends or acquaintances communicate with each other through mutual communication in the process of the real-world game, so that the feelings of the friends are deepened. If the chess is played with strangers, the chess can be played by friends through communication in the chess playing process, and therefore new friends can be reached. The types of chess games are also various, such as weiqi, Chinese chess, military chess and the like, different people have different preferences, and each kind of chess game has different game rules, which is also the reason why people enjoy chess games.
The player can touch the chessboard and the chessmen in the actual playing process of the chess game, hear the sound of falling chessmen in the playing process and the sound communicated with the game player, and watch the moving process of the chessmen in real time, thereby giving a sense of reality and experience. Some players think about the strategy of playing chess by the gesture of holding chess with fingers in the chess playing process, which are the reasons for enhancing people's favor of playing chess games. The pure physical chess playing game can be played only by using the same chessboard when players are in the same place at the same time, but because the life rhythm is accelerated at present, two players can hardly play the game by drawing out the time at the same time. In particular, it is also largely impossible for friends in two different places to increase the friendship between two persons by playing a game of chess.
With the development of computer technology and the selection of people for life diversity, many games which can only be played in reality before are designed to be 'electronic games', and the electronic games are installed on electronic equipment terminals such as mobile phones, computers or PADs. People interact with man-machines through the terminal devices or "fight" friends or strange players in a network environment. With the gradual improvement of games, the electronic games bring great convenience to players, for example, game programs carried by terminal devices can help beginners to learn playing methods of playing chess, guide the steps of playing chess of the beginners, and the like.
In fact, people cannot realize the reality of chess playing real objects in the chess playing game played by a computer or other equipment, and people always play chess with a machine. If people fight through Artificial Intelligence (AI), such as an alpha dog, but because of the imbalance in difficulty, it is difficult for users to appreciate the enjoyment of the game, either win the game very easily or lose the game. In addition, the benefit of enhanced interpersonal communication of the chess game itself is lost in the face of "machine" chess playing. Secondly, the chess playing in the virtual world, no matter the game is man-machine interaction or the game is played by the player through the network space, when the player can not touch the real chess pieces in the game process, the player can not hear the real sound when the player and the opponent play the chess pieces, and the player gradually loses the interest of the game playing chess and the fun in the game process.
Further, it is also designed that players play a game by operating a robot arm, but the robot arm is difficult to be suitable for most players due to the high cost of mechanical manufacturing and processing.
The invention with application number 201810050821.4 provides a near-eye see-through head-display optical system, which includes a first lens, a second lens and a miniature image display, wherein the first lens and the second lens are both attached to the miniature image display, and the first lens and the second lens are both uniform-thickness free-form surface lenses. By the optical system structure of the near-eye perspective head display provided by the invention, the times of light refraction in the optical system structure can be reduced, and the aberration of light emitted by the miniature image display in each direction can be eliminated, so that the image can not be subjected to aberration when the miniature image display is seen in each direction and angle.
The utility model discloses an application No. 201821172477.8 provides an AR display device on the basis of above-mentioned optical system, wherein AR display device includes at least one show/projector and at least one optical device, and real image passes through optical device constitutes, and the virtual image passes through show/projector constitutes in optical device, real image and virtual image combine to appear in same visual field, wherein optical device includes at least one main lens and at least one free-form surface lens, the free-form surface lens is used for reflecting the image that show/projector throws; and the main lens is used for reflecting the image projected by the display/projector again. This AR equipment can accomplish big visual angle, small, light weight, wears the experience that the user can have immersive AR and feels.
The invention with application number 201810994555.0 further provides a head-mounted virtual-real interaction device and a virtual-real interaction method based on the aforementioned patent, wherein the head-mounted virtual-real interaction device comprises a head-mounted AR display device for displaying at least a 3D virtual image in a field of view of the head-mounted AR display device; and the virtual-real interaction device is used for acquiring the behavior action or the control instruction of the person wearing the head-mounted AR display equipment and changing or controlling the content of the 3D virtual image according to the behavior action or the control instruction.
Disclosure of Invention
One of the main advantages of the present invention is to provide a new chess and game playing system, which shows a real chessboard or a chessboard which can simultaneously show a virtual-real fit through the viewing field of the AR display device, and shows the real chess pieces and virtual chess pieces on the real chessboard or the chessboard which shows a virtual-real fit. Different (at least 2) users in different air experience the near play reality.
According to some embodiments of the invention, the chess includes, but is not limited to, go, chess, military chess, checkers, or flight chess, among others.
According to some embodiments of the present invention, a virtual chessboard is formed by the AR display device acquiring the length, width and height information of the real chessboard and the plate lines on the real chessboard. For example, the surface line refers to the longitude and latitude line and/or the surface contour line of the go board.
According to some embodiments of the invention, the real chessboard is provided with an altimeter, a gyroscope, an identification bar code for positioning, an identification two-dimensional code for positioning, or the plate line with light positioning. The dish surface line with the light positioning function is characterized in that lamps such as LEDs are arranged below the transparent or light-transmitting dish surface line, and light emitted by the lamps passes through the dish surface line of the chessboard to form the dish surface line with the light transmission effect. The chessboard is also provided with a power supply module for supplying power to various sensors or LED lamps and the like which need electricity.
According to some embodiments of the invention said real chess board is provided with a microphone or a pressure sensor or a pressure circuit switch for positioning the real chess pieces.
According to some embodiments of the invention the base of the pawn is provided with a magnet.
According to some embodiments of the present invention, the real chessboard is correspondingly provided with electromagnetic inductors or grid circuits. And the cross points of the grid circuit are provided with magnetosensitive sheets or contact points.
According to some embodiments of the invention, the pawn is a glass-shell LED pawn or a plastic-shell LED pawn. The LED emits light or does not emit light, and the LED emits light with different colors according to setting.
The invention further provides a (different-space interactive) chess playing game system, which comprises the AR display device in addition to the chessboard and the chess pieces in the same space. This is the simplest stand-alone mode, including players, boards, pawns and AR display devices.
According to some embodiments of the invention, further comprising ① a flat display device, ② VR display device, or ③ another said piece of chess and another said AR display device, in another space;
the method also comprises B (multiple connection modes of 3 Unet dual-machine modes) that the AR display device in one space is directly linked with the ① plane display device and the ② VR display device in the other space or ③ that the AR display device in the other space, but not limited to the playing of both sides.
According to some embodiments of the present invention, the AR display device in one space assumes a role of a background server for dual-machine interactive operation. The AR display device in any space is the processor of the own, and also takes charge of the background servers of both parties, that is, the relationship between the master and the slave, and the master AR display device takes charge of the background servers of both parties. Of course, the background SERVER of the third party can be used as the master, and the foreground processors of the first party and the second party can be used as the slaves.
According to some embodiments of the present invention, in network mode, the AR display device in one space is network-linked with the ① flat panel display device, the ② VR display device in another space, or the ③ another pair of the AR display devices.
According to some embodiments of the invention, the network link comprises a local area network link, a wide area network link, or an internet of things link.
According to some embodiments of the invention, the network device links at least two different spaces, and at least one pair of the chess pieces and one pair of the AR display devices are provided in each of the different spaces. It is suitable for special multi-side game mode-square military chess and hexagonal Chinese checkers, etc..
According to some embodiments of the present invention, the network device includes a background server for supporting interactive operations of the parties.
According to some embodiments of the invention the background server comprises a memory for storing a chess game database, chess board information, and/or a path trajectory or a falling order of the pieces for each different party. The chessboard information comprises length, width and height, chessboard surface information and the like.
According to some embodiments of the invention, the backend server further comprises a determining module or a hosting module,
the judging module is used for judging the size of the chess pieces or judging the win-or-lose of the chess playing according to the chess playing rules in the chess playing game database;
and the escrow module is used for replacing an instruction-escrowing party with a chess-playing rule in the chess-playing game database to play virtual chess. The images of the virtual pawns appear in the system and in the display devices of the parties.
According to some embodiments of the invention, a virtuality-reality fit chessboard is simultaneously visualized through the AR display device, the planar display device, or the VR display device, and the real chess pieces and the virtual chess pieces are visualized on the virtuality-reality fit chessboard.
According to some embodiments of the present invention, the AR display device in the one space visualizes the real chess board at the 1 st perspective (of the present party), or visualizes the real chess board at the 1 st perspective and the virtual chess board (of the other party) at the same time, and visualizes the real chess piece at the 1 st perspective and the virtual chess piece (at the 1 st perspective) (of the spatial position) at the other party on the real chess board or the virtual-real fitted chess board. Wherein, the 1 st visual angle is the viewing angle of the own party at playing, the 2 nd visual angle is the viewing angle of the other party at playing (a certain party), and the 3 rd visual angle is the viewing angle of the non-playing participant, or is called the view angle of the emperor and is regarded as the viewing angle of the bystander.
According to some embodiments of the invention, logging into the network device, presenting the virtual chess board through the ① AR display device, ② VR display device, or ③ flat display device of a non-chess game direct participant, and presenting the virtual chess pieces of each party on the virtual chess board.
Some embodiments according to the invention comprise an immersive head-mounted display device, an AR all-in-one machine, a digital glass mirror, a digital glass desktop, a display, a smart mobile device, or an AR helmet connectable to said smart mobile device.
According to some embodiments of the invention, the immersive head-mounted display device comprises an image-mounted display, a transmissive head-mounted display, or an image-transmissive combined head-mounted display.
With the help of the immersive head-mounted display device and the virtual-real interactor (see invention application No. 201810994555.0), the user can also perform virtual chess pieces in the virtual chessboard and interact with users in different spaces (either users fitting virtual-real or users playing virtual chess in the same virtual chessboard). The size of the virtual chessboard can be determined according to user settings.
The invention has at least one of the following beneficial effects:
1. the chessboard and the chessmen provided by the invention allow users to play games in different spaces by using the real chessmen, and the users can really experience the hand feeling of the real chessboard and the chessmen of the own party and the visual sensation and the sound sensation which are not affected when the two parties play games. Both parties play chess on a real chessboard, and the feeling and feedback can meet the visual, auditory and tactile feelings of players when playing chess to the maximum extent.
2. The chess provided by the invention can transmit the operation images of other game players in other spaces to the own space in real time through the AR equipment, so that the players in the own space can experience real game feeling.
3. The chess and chess playing game system provided by the invention can allow a player to play games in a plurality of game modes such as a stand-alone game, a player fighting game and the like by using real chess pieces in a own space, and can assist the user to play games through a hosting mode or a judgment module so as to give the player a game pleasure combining virtual and reality.
4. The invention provides a chess and a chess playing game system, which enables players to obtain virtual game images of game players in different spaces in the real space of the players and play virtual and real games with the players of the opposite side through game operation carried out on the players.
5. The chess and chess playing game system provided by the invention enables bystanders (non-participants of the game) to have an opportunity to acquire virtual and real combined game images at the visual angles of game players in different spaces. Namely, the game progress can be viewed from the 1 st view of a certain player, and the game progress can also be viewed from the god view (the 3 rd view).
6. AR go (game) is a better experience than VR go or PC go because vision, hearing and touch are fed back simultaneously. As long as both parties use the AR device/equipment provided by the invention, similar Song ● Zhao teacher-show poem Yougu (Youge passenger) yellow plum season family rain and green grass pond everywhere frogs can not appear. If the chess pieces are not about to fall in the middle of the night, the chess pieces are knocked down to fall off the flowers. The user does not have to pay during the process of tuning, centering, and paying.
Further objects and advantages of the invention will be fully apparent from the ensuing description and drawings. These and other objects, features and advantages of the present invention will become more fully apparent from the following detailed description, the accompanying drawings and the claims.
Drawings
FIG. 1 is a system block diagram of a chess game system according to a first preferred embodiment of the present invention.
FIG. 2 is a conceptual diagram of the chess playing game system according to the first preferred embodiment of the present invention.
FIG. 3A is a system block diagram of a chess game system according to a first preferred embodiment of the present invention.
FIG. 3B is a system diagram of a chess game system according to a first preferred embodiment of the present invention.
FIG. 4A is a system diagram of the man-machine interaction mode of the chess playing game system according to the first preferred embodiment of the present invention.
FIG. 4B is a system diagram of the player interaction mode of the chess game system according to the first preferred embodiment of the present invention.
FIG. 5 is a diagram of a player's usage scenario of the chess game playing system according to the first preferred embodiment of the present invention.
FIG. 6 is a first implementation of the board fitting of the chess gaming system according to the first preferred embodiment of the present invention.
FIG. 7 is a second implementation of the board fitting of the chess game system according to the first preferred embodiment of the present invention.
FIG. 8 is a third embodiment of the board fitting of the chess game system according to the first preferred embodiment of the present invention.
FIG. 9A is a fourth embodiment of the board fitting of the game system according to the first preferred embodiment of the present invention, wherein the current virtual board image and the actual board are not fitted.
FIG. 9B is a fourth embodiment of the board fitting of the chess game system according to the first preferred embodiment of the present invention, wherein the current virtual board image and the actual board are adjusted to fit each other.
FIG. 10 is a fifth implementation of the board fitting of the chess game system according to the first preferred embodiment of the present invention.
FIG. 11A is a schematic diagram of a display interface of a player of the chess game system according to the first preferred embodiment of the present invention.
Fig. 11B is a schematic view of a display interface of an opponent player of the chess game system according to the first preferred embodiment of the present invention.
FIG. 12 is a schematic diagram of a virtual space generated by the chess game playing system according to the first preferred embodiment of the present invention.
FIG. 13A is a diagram illustrating virtual chess piece image fitting of the chess game system according to the first preferred embodiment of the present invention, wherein the current perspective is the perspective of the player of the other party.
FIG. 13B is a schematic diagram of the virtual chess piece image fitting of the chess game system according to the first preferred embodiment of the present invention, wherein the current viewing angle is the viewing angle of the opponent player.
FIG. 14 is a diagram of another embodiment of virtual chess piece image fitting of the chess game system according to the first preferred embodiment of the present invention.
Fig. 15A is a schematic view of another game application of the chess game system according to the first preferred embodiment of the present invention, wherein the game is a Chinese checkers game.
Fig. 15B is a schematic view of another game application of the chess game system according to the first preferred embodiment of the present invention, wherein the game is a flight chess game.
Fig. 16A is a schematic view of an application of another game of the chess game system according to the first preferred embodiment of the present invention, wherein the game is a chinese chess game.
Fig. 16B is a schematic view of an application of another game of the chess game system according to the first preferred embodiment of the present invention, wherein the game is a chess game.
Fig. 17A is a schematic view of another game application of the chess game system according to the first preferred embodiment of the present invention, wherein the game is a virtual space diagram of a military chess game.
Fig. 17B is a schematic view of another game application of the chess game system according to the first preferred embodiment of the present invention, wherein the game is a schematic view of a perspective of a player of a military chess game.
Fig. 18 is a system block diagram of the chess game system according to the second preferred embodiment of the present invention.
FIG. 19 is a diagram illustrating a game scenario of the chess game playing system according to the second preferred embodiment of the present invention.
Fig. 20 is a system block diagram of the chess game system according to the third preferred embodiment of the present invention.
Fig. 21A is a schematic view of the chess game system according to the third preferred embodiment of the present invention.
Fig. 21B is a game scene diagram of the chess playing game system according to the third preferred embodiment of the present invention.
Fig. 22 is a game interaction method of the chess game playing system according to the first preferred embodiment of the present invention.
Detailed Description
The following description is presented to disclose the invention so as to enable any person skilled in the art to practice the invention. The preferred embodiments in the following description are given by way of example only, and other obvious variations will occur to those skilled in the art. The basic principles of the invention, as defined in the following description, may be applied to other embodiments, variations, modifications, equivalents, and other technical solutions without departing from the spirit and scope of the invention.
It will be understood by those skilled in the art that in the present disclosure, the terms "longitudinal," "lateral," "upper," "lower," "front," "rear," "left," "right," "vertical," "horizontal," "top," "bottom," "inner," "outer," and the like are used in an orientation or positional relationship indicated in the drawings for ease of description and simplicity of description, and do not indicate or imply that the referenced devices or components must be in a particular orientation, constructed and operated in a particular orientation, and thus the above terms are not to be construed as limiting the present invention.
It is understood that the terms "a" and "an" should be interpreted as meaning that a number of one element or element is one in one embodiment, while a number of other elements is one in another embodiment, and the terms "a" and "an" should not be interpreted as limiting the number.
Referring to fig. 1 to 10 of the drawings of the present invention, a chess game system according to the present invention is set forth in the following description, wherein said chess game system collects information on a real object actually existing in a real environment, and acquires image information of the collected real object of the real environment, and fits the image information of the real environment to the real object; the chess game playing system also receives virtual image information and projects the virtual image information to a real environment. In other words, the chess game system allows a user to operate interactively with a real object and a virtual image that are actually present in a real environment. Further, according to another aspect of the present invention, the chess game system of the present invention is applied to at least one chess game, allowing a user to play chess by manipulating chess pieces, a board, and a virtual chess piece board image. Particularly, the virtual-real interactive chess playing game allows at least two players to respectively operate the chess pieces of the own party in different spaces, play chess and the image information of the chess pieces, the chessboard and the like generated by the other players in the space of the own party. It will be appreciated that a user or player may simultaneously present a virtual-to-real fitted chess board through the field of view of the AR display device, and present real and virtual chess pieces on said appearing virtual-to-real fitted chess board. It is worth mentioning that the chess includes go, chess, military chess, checkers or flight chess. According to a first preferred embodiment of the present invention, the type of said chess is herein described by way of example only and not by way of limitation.
It will be appreciated that the chess game system allows different users to interact with the video information of other players in their respective physical operating spaces by manipulating their own physical objects or other items capable of being informative. The chess playing game system receives operation information of other users or players and projects a virtual image of the operation information into a real operation space of the own user; the chess playing game system collects response information made by a user of the own party after receiving virtual images of operation information of other players, wherein the response information can be sound information or action image information; the chess game system converts the corresponding information of the own user into image information to be projected to the real operation space of other players, so that other players can obtain the operation information of the own user and respond to the operation information of the own user.
In detail, the chess playing game system comprises at least one reality information acquisition module 10 (also called a virtual reality interactor, see the invention with application number 201810994555.0 for details), at least one
It is worth mentioning that, the so-called stand-alone mode is the
It is understood that the so-called dual mode is that the interactive
In the chess playing game system, the
Therefore, the network mode is a mode in which the
It should be noted that any one of the real
Correspondingly, the chess playing game system also comprises two or more
It will be understood by those skilled in the art that the real information of a real space acquired by any of the real
It should be noted that the chess game system converts the actual image information of different environmental spaces into a virtual image information through the interactive
As shown in fig. 1, the reality
Preferably, the image information collecting module 11 is implemented as a camera device, wherein the camera device is capable of collecting the entity image information in the current environment. More preferably, the received image information collecting module 11 is further configured to transmit the collected physical image information to the interactive
The sound information collecting module 12 of the reality
Preferably, the sound information collection module 12 of the reality
Referring to fig. 1 and 2 of the drawings, the
Accordingly, the
It should be noted that the image projection module 21 of the
The sound delivery module 22 of the
It should be noted that the image information and the sound information of an environmental space collected by the reality
It should be noted that the
As shown in fig. 1 and fig. 2 of the accompanying drawings, the interactive
It will be understood by those skilled in the art that the interactive
As shown in fig. 1, the interactive
The virtual image fitting module 32 of the interactive
Accordingly, the virtual-real fitting module 33 of the interactive
It should be noted that the virtual image information obtained by processing the actual image information in the current environmental space by the entity fitting module 31 of the interactive
It should be noted that the real
In accordance with another aspect of the present invention, there is further provided an interactive method of a chess game system, comprising the steps of:
acquiring virtual image information and projecting the virtual image information to an environment space;
acquiring response information of at least one article in the environment space based on the virtual image information; and
and fitting virtual image information based on the collected response information.
Referring to fig. 3A to 14 of the drawings, a first embodiment of a chess game system based on the chess game system according to a first preferred embodiment of the present invention will be described in the following description. The chess game system is applied to a go game, a gobang game, a Chinese checkers game or a game with a plurality of undifferentiated chessmen, such as a flight chess game. It will be appreciated that there are two or more of the above types of game pieces, each player operating one of the types of game pieces; both parties/multiple parties share the same chess playing system to operate game chess pieces, and the chess piece placement positions can be determined through the longitude and latitude lines or the square lines of the chess pieces placement in the chessboard. The virtual-real interactive game allows a user to operate a real game tool to interact with virtual game image information generated by the system based on the principle of the chess game system, wherein the virtual game image may be image information acquired by the real
It will be appreciated that the chess playing game system allows at least one player to operate a real game tool in a real environment space to play a "man-machine interaction game" mode with the game system, or play a "player battle game" mode with other players.
Fig. 3A to 5 show a chess game of the chess game system according to the first preferred embodiment of the present invention. FIG. 4A illustrates a user wearing an AR device to operate the board and pieces of the I-go game in an environmental space in human-machine engagement with the game play system. In other words, the user interacts with the virtual game image generated by the game playing system by wearing the AR device to operate the go board and the chess pieces. The AR device includes the reality
FIG. 4B illustrates at least two users respectively wearing an AR device to operate the playing boards and playing pieces of a I-go game in different environmental spaces to play a space-by-space game match between players. It is worth mentioning that in the player battle mode, the AR device worn by the user is the same as the AR device worn by the user in the interpersonal battle mode, but the difference is that the source of the virtual image information obtained by any user in the game process is different. Any user operates the weiqi pieces in the current real environment space to interactively fight with the image information of a virtual piece. In the player fighting mode, the virtual chess piece image information acquired by one player is the virtual chess piece image information generated by the real chess piece images acquired by the AR devices worn by other players. It will be appreciated that a user wearing the AR device is able to capture the virtual Weiqi piece image and respond accordingly based on the actual piece condition of his own chess. The reality
It should be noted that, according to the first preferred embodiment of the present invention, in the player match mode of the chess game system, the AR devices operated by the users may be configured to be the same AR devices, that is, the AR devices are identical in structure and function to the AR devices in the human-machine match module. It will be understood by those skilled in the art that the chess game system can also be configured as a main AR device, and at least one auxiliary AR device communicatively connected to the main AR device, wherein the main AR device comprises the reality
It will be appreciated by those skilled in the art that, with the UNET networking technology of Unity, two users who need to play games must be in the same WIFI network, and that, no matter which device first starts the program, the device that first starts the program can act as a (background) server, and when another device starts the program, it will automatically connect to the previous server.
When the two devices are successfully connected, the chess player can enter the position for selecting the chess side, and after the selection is finished, the two devices enter a chess playing interface
The grid coordinate in front of the left sides of the chessboard of the two parties is set to be (0,0) in the virtual chess, and when the coordinate positions of the virtual chess pieces are synchronized, the two parties are synchronized, and the coordinates are converted. The conversion mode is as follows:
suppose the coordinates of the chess pieces below the first square are (0,0), then (19,19) is displayed below the second square, and (1,0) is displayed below the first square, (18,19), then the conclusion is that the position of the chess pieces on the first square is (X, Y), then (19-X,19-Y) is displayed on the second square.
Similarly, the positions of the chess pieces on the second party (X, Y) are also (19-X,19-Y) displayed on the first party.
And (3) graphic display: generating and displaying (after edge finding and fitting) a weiqi board and chessmen of a second party in a superimposed manner in a first space by adopting an image rendering technology of Direct3D or OpenGL; in the second space, the first square generates and superposes the weiqi board and the first square chessman in the second space; and simultaneously, generating a virtual weiqi board in a third space (network space), and superposing and displaying virtual images of the chess pieces of the first party and the second party.
OpenCV technical description OpenCV is called openSource Computer Vision Library in its entirety, and is a cross-platform Computer Vision Library. OpenCV was initiated and developed by intel corporation and issued with BSD license authorization and is available for free use in business and research areas. OpenCV may be used to develop real-time image processing, computer vision, and pattern recognition programs. The program library can also use IPP of Intel company to process the technical description of Unet in an acceleration way, namely a network interaction module of a Unity game engine aiming at networking, 2 horizontal networking devices, wherein one processor of the Unity game engine is used as a processor of the party and also used as background servers of the two parties. I.e. master-slave relationship. Of course, a background SERVER (SERVER) of a third party may be used as a master, and foreground processors of both parties a and b may be used as slaves.
The
It should be noted that the server of the chess game system may be disposed in the
In accordance with the first preferred embodiment of the present invention, the
Fig. 5 to 10 of the drawings illustrate the interaction process between the user and the virtual chess piece image by operating the actual chess pieces in the chess game system according to the first preferred embodiment of the present invention. The chess game system comprises the chess game system, and further comprises a
It should be noted that the
The real
As will be appreciated by those skilled in the art, the
It should be noted that the image information of the chess pieces and the chessboard collected by the real
Figure 6 of the accompanying drawings shows a first embodiment of the entity fitting process of the interactive
Accordingly, the
Accordingly, the spatial positioning module 24 is used to position the
The length, width and height information of the real chessboard and the real disc line on the chessboard are obtained through the
The invention further provides several virtual-real fitting schemes, such as using a 2D/3D laser profile scanner to locate (e.g., go chessboard) edges, i.e., directly acquiring height, angle and imaging parameters. As will be appreciated by those skilled in the art, OpenCV is a cross-platform computer vision library issued based on BSD licenses (open sources) that can run on Linux, Windows, Android, and Mac OS operating systems. The method is light and efficient, is composed of a series of C functions and a small number of C + + classes, provides interfaces of languages such as Python, Ruby, MATLAB and the like, and realizes a plurality of general algorithms in the aspects of image processing and computer vision. The 'frame type graph' can be output by calling an edge searching function in OpenCV, and boundary searching and positioning can be carried out on the weiqi board, the longitude and latitude lines and the weiqi pieces.
OpenGL (Open Graphics Library) refers to a specialized graphical program interface that defines a cross-programming language, cross-platform programming interface specification. The method is used for three-dimensional images (two-dimensional images can also be used), and is a bottom layer graphic library which is powerful and convenient to call.
OpenGL is the most widely accepted 2D/3D graphics API in the industry, is windows or other operating systems independent, and is network transparent. OpenGL helps programmers achieve high-performance, highly-obtrusive visual representations on hardware devices such as PCs, workstations, supercomputers, etc., to address software development.
That is to say, the edge-finding fitting technology adopts the OpenCV technology to extract feature points of the chessboard through SIFT, then the feature points are input into a feature matching library, a camera of the device is used for shooting a visible picture of a visual field, then an original image is converted into a single-channel gray image, binarization processing is carried out, edge points are obtained through black-white pixel value difference, a proper area is found at the edge points, the relative distance and the coordinates of the head display and the chessboard are calculated through the combination of the processed 2D image and 3DOF, and the coordinates of the virtual chessboard of the head display are moved to be overlapped with the real chessboard.
Figure 7 of the drawings of the invention shows an alternative embodiment of the entity fitting process of the interactive
In this alternative embodiment, at least three board positioning devices 41A are disposed in the board 40A, wherein the board positioning devices 41A are disposed at least two corners of four corners of the board 40A, respectively, and the board positioning devices 41A are used for recording current height, angle and imaging parameter information of the board 40A. The entity fitting module 31 of the interactive
Accordingly, the
Figure 8 of the drawings of the invention shows an alternative embodiment of the entity fitting process of the interactive
As will be appreciated by those skilled in the art, the
Accordingly, the entity fitting module 31 of the interactive
FIGS. 9A and 9B of the drawings illustrate an alternative embodiment of the entity fitting process of the interactive
The entity fitting module 31 of the interactive
Accordingly, by adjusting the virtual image information of the playing
Accordingly, the spatial positioning module 24 is used to position the
Figure 10 of the drawings of the invention shows an alternative embodiment of the entity fitting process of the interactive
It should be noted that, in the present modified embodiment, the entity fitting module 31 obtains the image information of the
11A and 11B of the accompanying drawings illustrate the interactive fitting process of the game board of the chess playing game system of the present invention in different real spaces. It will be appreciated that two users interactively compete against the virtual chess piece that the user sees the other side by manipulating the actual chess piece in the own space in different spaces. The user acquires the position of the opposite user playing chess through the
FIGS. 11A and 11B of the drawings show the display interfaces of the players of the two-player chess game system of the present invention. In a real operation space, the real
It is worth mentioning that the user uses the position of the chessboard before the user's eyes as the starting point of the coordinates during the fighting process, that is, the coordinate position of the intersection set by the self chessboard and the coordinate position of the same intersection set by the opposite player are symmetrical about the center. In other words, the current position of the virtual white son image in the self player is (5,16), and then the position occupied by the physical white son in the opponent player's board is (14, 3). In short, the position of the physical chess piece in the self chessboard is (X, Y), and the position of the virtual chess piece image displayed in the opposite chessboard is (19-X, 19-Y).
SIFT (Scale Invariant Feature transform) -Invariant Feature transform, an efficient region detection algorithm proposed by David G.Lowe in 1999 (Object registration from Local Scale-Invariant Features), was perfected in 2004 (diagnostic Image Features from scales-Invariant Keypoints). The SIFT features are invariant to rotation, scale scaling, brightness change and the like, are very stable local features, and are widely applied at present.
Fig. 11A of the accompanying drawings shows an operation diagram of the player of the present invention, in which the game system collects image information of the
As shown in fig. 12, based on the real
FIGS. 13A and 13B of the drawings illustrate the interaction of the operation of the two parties of the chess game system of the present invention. The virtual-real fitting module 33 of the interactive
Accordingly, the virtual-real fitting module 33 of the interactive
Fig. 13A and 13B show an embodiment of the virtual pawn image of the chess game system fitted on a
It is worth mentioning that the virtual-real fitting module 33 of the interactive
In addition, the user can also obtain the gesture action of the opposite player in the process of operating the chess piece through the
Figure 14 shows another embodiment of the virtual pawn image of the chess game system of the invention fitted on a
It is worth mentioning that the
Accordingly, the game management module 60 further comprises a chess piece adjustment module 62, wherein the chess piece adjustment module 62 is used for adjusting the size, shape, filling color and other information of the virtual chess piece image generated corresponding to the
It should be noted that the virtual-real fitting module 33 of the interactive
It should be noted that, according to an aspect of the present invention, the virtual-real fitting module 33 of the interactive
Correspondingly, the game management module 60 further comprises a game interaction module 63, wherein the game interaction module 63 is configured to generate virtual chess piece image information and perform virtual-real interactive game engagement with the player. In other words, the game interaction module 63 of the game management module 60 is configured to play a game against a user. The game interaction module 63 generates a virtual chess piece image based on the image information of the chess pieces in the current real environment collected by the real
It will be appreciated by those skilled in the art that the game interaction module 63 of the game management module 60 generates a virtual chess piece image based on the position information of the player's chess pieces on the current game board and based on the difficulty level of the match-up game, wherein the virtual chess piece image is projected on the player's board so that the player can acquire the virtual chess piece image through the
The game interaction module 63 of the game management module 60 further includes a game guiding module 631 and a game switching module 632. The game guiding module 631 generates at least one prompt message based on the current position of the player, wherein the prompt message may be a virtual chess image message or a prompt voice message. It is understood that the virtual chess image information generated by the game guiding module 631 is guiding information for prompting the user to play chess or giving the user a chess position. It is understood that the game guide module 631 of the game interaction module 63 assists the player in learning the training.
The game switching module 632 is configured to switch the game view angle for the current user or switch different game scenes for the user. The chess game system is characterized in that a player obtains the current real environment information of the player and virtual image information fitting the current real environment through the
FIGS. 15A and 15B of the drawings illustrate several other applications of the chess game system of the present invention. The chess game system is applied to a Chinese checkers game, a gobang game, or a flight chess game and the like which are indiscriminate chess games. It will be appreciated by those skilled in the art that the chess pieces used by any one of the above-mentioned several types of chess game are identical or unique, and the positions of the chess pieces placed on the chessboard can be uniquely determined by the position coordinates of the cross points of the longitude and latitude lines or the lines. The game management module 60 of the chess game playing system sets the playing rules of different game programs based on different types of game types.
It is understood that the image information of the chessboard and the chessman in a real operation space collected by the real
Figures 16A and 16B of the drawings of the invention show two further applications of the chess game system of the present invention. The chess playing game system is applied to a Chinese chess or a chess game. For the game with different chessmen on the chessboard, the mutual relations among the chessmen with different types do not exist independently, but have the superposition relation according to the size sequence of the chessmen. It will be appreciated that for chess or Chinese chess, there is a size relationship between pieces, and small pieces will be "eaten" or removed after being overlaid by large pieces. The user can thus remove the pieces of his own board that have been "eaten" according to the mutual overlapping relationship between the pieces during the game.
It is worth mentioning that for the Chinese chess or the chess game, the types of the chess pieces in the chessboard are different, and the mutual relations among the chess pieces are different. Said coordinate defining module 61 of said game managing module 60 of said game playing system defines each piece of players of both parties of the game in addition to the coordinates defining the piece points in the board given to said
It will be appreciated that the game interaction module 63 of the game management module 60 of the chess playing game system sets the play rules for different game programs based on game type and sets the relation of game pieces to be eaten with respect to the size relation of the pieces in the game. It is understood that the image information of the chessboard and the chessman in a real operation space collected by the real
Correspondingly, the game interaction module 63 of the game management module 60 further includes a game prompt module 633, wherein the game prompt module 633 judges the relation between the eating and the eaten between the chess pieces of the two parties in the game process based on the game type of the current game and the correlation between the chess pieces in the game, and when the relation between the eating and the eaten occurs in the game chess pieces, the game prompt module 633 gives prompt information to the current user and the images of the virtual chess pieces hidden from the eating in the augmented reality modules of the two parties. When a player of one party plays a game while playing a game, he/she manipulates his/her own chess piece to eat the chess piece of the other party, hides the image of the virtual chess piece eaten by the physical chess piece by the game prompting module 633 of the game management module 60, and prompts the user of the other party to remove the eaten physical chess piece.
It is worth mentioning that the
The
FIGS. 17A and 17B of the drawings illustrate another application of the chess game system of the present invention. The chess playing game system is applied to a military chess game, wherein the game interaction module 63 of the game management module 60 of the chess playing game system sets playing rules of different game programs based on the current game thinking game type. It is understood that the image information of the chessboard and the chessman in a real operation space collected by the real
It is worth mentioning that for the game of military flags, both game pieces are defined by the coordinate definition module 61 of the game management module 60 with a unique ID. The game prompting module 633 of the game interaction module 63 judges the relation between the eating and the eaten of the chess pieces of the two parties in the game process based on the game type of the current game and the mutual relation between the chess pieces in the game, and when the relation between the eating and the eaten of the game chess pieces appears, the game prompting module 633 gives the current user prompting information and the images of the virtual chess pieces hidden from the augmented reality modules of the two parties. When a player of one party plays a game while playing a game, he/she manipulates his/her own chess piece to eat the chess piece of the other party, hides the image of the virtual chess piece eaten by the physical chess piece by the game prompting module 633 of the game management module 60, and prompts the user of the other party to remove the eaten physical chess piece.
It can be understood that the army flag game is different from the Chinese chess in that players of both army flags can know the arrangement of the chess pieces of the own player and the friend player under the condition that the arrangement of the chess pieces of the other player is not known, and in a third party, namely a virtual game space, the game chess pieces of both players or a plurality of players are simultaneously displayed in a virtual chessboard. Therefore, the virtual chess piece image of the enemy player acquired by the own augmented
It is understood that logging on to the
Referring to fig. 18 and 19 of the drawings, a second preferred embodiment of a chess gaming system according to the present invention is set forth in the following description. The chess playing game system is applied to a go game, a gobang game, a Chinese checkers game, or a game with various nondifferential chesses such as a flight chess game, and can also be applied to games with various types of differentiative chesses such as Chinese chess, military chess, and the like. The chess game system comprises the reality information acquisition module 10C, the augmented reality module 20C, the interactive fitting module 30C and the network equipment 200C of the chess game system. In other words, the chess playing game system also performs game interaction operation based on the fact that the chess playing game system collects the image information of the physical game board and the chess pieces in the real environment space and the virtual image displayed in the real environment space. Correspondingly, the chess game system further comprises a chessboard 40C and at least one chess piece 40C, it is understood that the chessboard 40C and the chess piece 40C can be ordinary chessboard, chess pieces, or special chessboard chess pieces adapted to the interactive fitting module 30C.
It is understood that the image information of the chessboard and the chessman in a real operation space collected by the real information collection module 10C is transmitted to the interactive fitting module 30C, wherein the interactive fitting module 30C generates a corresponding virtual chessboard, chessman image based on the chessboard and chessman image information of the current environment space collected by the real information collection module 10C, and fits the virtual chessboard, chessman image to the augmented reality module 20C of the current environment space by the entity fitting module 31C; generating a virtual chess piece image corresponding to the current chess piece, and fitting the chess piece image to a virtual game chessboard of a virtual game space; and the augmented reality module 20C generating a pair of virtual chess images corresponding to the chess pieces and fitting the virtual chess images to other environmental spaces by the virtual-real fitting module 33C. It is understood that the augmented reality module 20C cooperatively projects environment information of the current environment in combination with the fitted virtual image information to the eyes of the user based on the received virtual image information, so that the user views the virtual image information in the current real space and operates the real chess pieces in the real chess board to play against the virtual chess piece images.
Accordingly, in a second preferred embodiment of the chess game system of the present invention, the chess game system further comprises a game management module 60C, wherein the game management module 60C is used for managing and explaining the relationship between the virtual chess piece images generated by the interaction fitting module 30C in the chess game system and the physical chess pieces in the real environment space.
As shown in fig. 19, the AR chess game system is used on a flat panel display device, different from the first preferred embodiment of the present invention, in the second preferred embodiment of the present invention, wherein the real information collecting module 10C of the chess game system is implemented as a camera device, the real information collecting module 10C is used for collecting the actual image information of the user operating the chessboard 40C and the chessmen 50C in the current real environment space and collecting the gesture information of the current user, and transmitting the collected information of the environment space to the interactive fitting module 30C, and extracting the virtual image information related to the game by the interactive fitting module 30C.
Preferably, the real information collecting module 10C is set to the user, that is, the camera device collects the actual image information of the current environment space towards the user. It is understood that the video information of the user captured by the reality information capturing module 10C can be transmitted to the augmented reality module of the other player at the other end in real time, so that the user can communicate with the other player in the form of video chat during the game operation.
Accordingly, the real information collecting module 10C includes an image information collecting module 11C and a sound information collecting module 12C, wherein the image information collecting module 11C is used for collecting image information of a real object in a real environment, wherein the image information may be picture information, graphic information or movie animation information. The sound information collection module 12C is used for collecting sound information in the current real environment space and transmitting the sound information to the augmented reality module 20C of the environment space of other players via the network device, so as to realize synchronous interaction of voice information and image information. Preferably, the sound information collecting module 12C is implemented as a microphone device, and more preferably, the microphone is disposed at or around the chessboard 40C.
In addition to the function of the
The interactive fitting module 30C has substantially the same function as the interactive
It should be noted that, in the second preferred embodiment of the chess game system of the present invention, the user no longer needs to wear an AR device to operate the game, wherein the operation information of one player and the virtual image information of the chess pieces are fitted to the augmented reality module 20C of the other player through the interactive fitting module 30C, and the fitted virtual image is projected to the
Referring to fig. 20 and 21 of the drawings, a third preferred embodiment of a chess game system according to the present invention is set forth in the following description. The chess playing game system is applied to a go game, a gobang game, a Chinese checkers game, or a game with various nondifferential chesses such as a flight chess game, and can also be applied to games with various types of differentiative chesses such as Chinese chess, military chess, and the like. The chess game system comprises the reality
It is understood that the image information of the chessboard and the chessman in a real operation space collected by the real
As shown in fig. 20 and 21, the real
It is understood that the
Accordingly, the
It can be understood that the real
It should be noted that the chess playing game system in the third preferred embodiment of the present invention is different from the chess playing game system in the second preferred embodiment in that the chessboard 40D is fitted to the
Referring to FIG. 22 of the drawings, in accordance with another aspect of the present invention, there is provided a game interaction method for a virtual-real interaction game, comprising the steps of:
2201: acquiring virtual image information and projecting the virtual image information to an environment space;
2202: collecting response information of at least one piece in the environment space based on the virtual image information; and
2203: and extracting virtual image information corresponding to the chessmen based on the collected response information of the chessmen.
In the
Before the
In the
In
22031: receiving the extracted virtual chess piece image information and fitting to the
22032: receiving the extracted virtual chess piece image information and a virtual chessboard fitted to a virtual space based on the virtual chess piece image information; and
22033: receiving the extracted virtual pawn image information and fitting the
It will be appreciated by persons skilled in the art that the embodiments of the invention described above and shown in the drawings are given by way of example only and are not limiting of the invention. The objects of the invention have been fully and effectively accomplished. The functional and structural principles of the present invention have been shown and described in the examples, and any variations or modifications of the embodiments of the present invention may be made without departing from the principles.
- 上一篇:一种医用注射器针头装配设备
- 下一篇:一种交互方法、装置、介质和电子设备