阅读说明：本技术 一种保龄球互动投影系统 (Bowling interactive projection system ) 是由 张世斌 于 2019-09-05 设计创作，主要内容包括：本发明公开了一种本发明保龄球互动投影系统,包括：采集单元,用于实时采集保龄球道图像；识别单元,用于识别所述保龄球道图像中保龄球的运动轨迹；投影单元,用于根据所述保龄球的运动轨迹向球道投放动态三维图像,所述动态三维图像实时展示所述保龄球的运动轨迹。本发明保龄球互动投影系统通过球道与保龄球之间互动画面,实现了保龄球的运动轨迹的实时观测,同时添加了视觉效果,增强了用户的体验感。(The invention discloses a bowling interactive projection system, comprising: the acquisition unit is used for acquiring bowling lane images in real time; the identification unit is used for identifying the movement track of the bowling ball in the bowling lane image; and the projection unit is used for throwing a dynamic three-dimensional image to a lane according to the movement track of the bowling ball, and the dynamic three-dimensional image displays the movement track of the bowling ball in real time. The bowling interactive projection system realizes the real-time observation of the motion trail of the bowling through the interactive pictures between the lane and the bowling, and simultaneously adds the visual effect and enhances the experience of users.)

1. An interactive projection system for bowling balls, comprising:

The acquisition unit is used for acquiring bowling lane images in real time;

The identification unit is used for identifying the movement track of the bowling ball in the bowling lane image;

And the projection unit is used for throwing a dynamic three-dimensional image to a lane according to the movement track of the bowling ball, and the dynamic three-dimensional image displays the movement track of the bowling ball in real time.

2. the system of claim 1, further comprising:

And the supplementary lighting unit is used for projecting infrared light or laser light to the lane to supplement lighting for the bowling ball.

3. the system of claim 1, wherein the projection unit comprises:

The splicing module is used for splicing the projection pictures of the projectors according to the projection area;

and the picture generation module is used for converting the motion trail of the bowling ball into a virtual three-dimensional space and fusing the converted bowling ball and the three-dimensional image.

4. The system of claim 3, wherein the picture generation module is specifically configured to:

Mapping trajectory data of the bowling ball to a virtual three-dimensional space;

the three-dimensional pattern moves together with the bowling ball mapped to the virtual three-dimensional space.

5. The system of claim 3, wherein the picture generation module is specifically configured to:

Mapping trajectory data of the bowling ball to a virtual three-dimensional space;

The bowling ball mapped to the virtual three-dimensional space collides with the first three-dimensional image, and the three-dimensional image is converted into a second three-dimensional image.

6. the system of claim 3, wherein the picture generation module is specifically configured to:

Mapping trajectory data of the bowling ball to a virtual three-dimensional space;

The three-dimensional image is a trajectory of the bowling ball mapped to the virtual three-dimensional space.

7. The system of any of claims 4 to 6, wherein the projection unit further comprises:

And the picture switching module is used for switching the three-dimensional image after the track data of the bowling ball is not read.

8. the system of claim 7, wherein the projection unit further comprises:

And the bowling result display module is used for displaying the throwing results in a classified manner after the bowling is thrown.

Technical Field

the invention relates to the technical field of bowling equipment, in particular to a bowling interactive projection system.

background

bowling is gradually enjoyed by people as a leisure sport. Bowling is an indoor sport in which a bowling pin is dropped by placing a hit bowling pin at the end of a lane having a predetermined length and width and then rolling the bowling pin on the lane.

Disclosure of Invention

The present invention provides an interactive projection system for bowling balls, which overcomes the technical problems.

the present invention provides a bowling interactive projection system, including:

The acquisition unit is used for acquiring bowling lane images in real time;

The identification unit is used for identifying the movement track of the bowling ball in the bowling lane image;

And the projection unit is used for throwing a dynamic three-dimensional image to a lane according to the movement track of the bowling ball, and the dynamic three-dimensional image displays the movement track of the bowling ball in real time.

Further, still include:

and the supplementary lighting unit is used for projecting infrared light or laser light to the lane to supplement lighting for the bowling ball.

Further, the projection unit includes:

The splicing module is used for splicing the projection pictures of the projectors according to the projection area;

and the picture generation module is used for converting the motion trail of the bowling ball into a virtual three-dimensional space and fusing the converted bowling ball and the three-dimensional image.

Further, the screen generating module is specifically configured to:

Mapping trajectory data of the bowling ball to a virtual three-dimensional space;

The three-dimensional pattern moves together with the bowling ball mapped to the virtual three-dimensional space.

further, the screen generating module is specifically configured to:

Mapping trajectory data of the bowling ball to a virtual three-dimensional space;

The bowling ball mapped to the virtual three-dimensional space collides with the first three-dimensional image, and the three-dimensional image is converted into a second three-dimensional image.

further, the screen generating module is specifically configured to:

Mapping trajectory data of the bowling ball to a virtual three-dimensional space;

The three-dimensional image is a trajectory of the bowling ball mapped to the virtual three-dimensional space.

Further, the projection unit further includes:

and the picture switching module is used for switching the three-dimensional image after the track data of the bowling ball is not read.

Further, the projection unit further includes:

and the bowling result display module is used for displaying the throwing results in a classified manner after the bowling is thrown.

the bowling interactive projection system realizes the real-time observation of the motion trail of the bowling through the interactive pictures between the lane and the bowling, and simultaneously adds the visual effect and enhances the experience of users.

drawings

in order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings needed to be used in the description of the embodiments or the prior art will be briefly introduced below, and it is obvious that the drawings in the following description are some embodiments of the present invention, and for those skilled in the art, other drawings can be obtained according to these drawings without creative efforts.

FIG. 1 is a schematic diagram of an interactive bowling projection system in accordance with the present invention;

FIG. 2 is a schematic diagram of a bowling interactive projection system arrangement in accordance with the present invention;

FIG. 3 is a schematic diagram of another arrangement of the interactive bowling projection system of the present invention;

FIG. 4 is a schematic view of the conversion of a bowling ball of the present invention from a two-dimensional image to a three-dimensional image;

Fig. 5 is a schematic view of a small fish with a three-dimensional pattern of swimming in water according to the present invention.

Detailed Description

in order to make the objects, technical solutions and advantages of the embodiments of the present invention clearer, the technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are some, but not all, embodiments of the present invention. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.

Fig. 1 is a schematic structural diagram of a bowling interactive projection system of the present invention, as shown in fig. 1, the method system of the present embodiment includes:

the acquisition unit 101 is used for acquiring bowling lane images in real time;

specifically, the acquisition unit is divided into two modes: one is video acquisition (camera) and the other is radar acquisition.

as shown in fig. 2, when the bowling ball 1 moves on the lane 2, the fill light 3 or the laser 8 fills the bowling ball with light. The camera 4 collects the movement locus of the bowling ball. The host 7 controls the projector 5 to perform interactive projection on the lane 2 until the bowling ball 1 hits the pins 6, and the projection is finished.

as shown in fig. 3, the radar 3 collects the movement trace of the bowling ball while the bowling ball 1 moves on the lane 2. The host 6 controls the projector 4 to carry out interactive projection on the lane 2 until the bowling ball 1 hits the pins 5, and the projection is finished.

The collecting unit of the present embodiment is at least one infrared filtering camera, and the emission wavelength of the camera can be 850nm, 808nm, and 940 nm. The infrared filter camera collects images on the bowling lane in real time, and the images comprise the whole process of the movement of the bowling ball. One camera can cover two lanes, can set up the camera in the top between two lanes. The acquisition frequency is 60 frames per second. Two images collected by the two cameras need to be spliced. And acquiring the coordinates of the acquisition area of each camera, removing the repeated area, and taking the final maximum boundary coordinates of the two acquisition areas as the spliced acquisition areas.

the acquisition unit of the embodiment is at least one radar device, and infrared optical radars or sonar radars with scanning radiuses of 5 meters, 10 meters and 20 meters can be selected according to the length of the fairway. The radar collects the information data on the bowling alley in real time to form an image, and the image comprises the whole process of the movement of the bowling. One radar may cover both lanes and the radar may be located in the space between the two lanes. The acquisition frequency is more than 30 frames per second.

a recognition unit 102 for recognizing a movement trajectory of a bowling ball in the bowling lane image;

Specifically, the acquisition unit can directly convert point data acquired by the radar into coordinate data for the radar. The acquisition unit is an infrared camera, and the images of the bowling lanes corresponding to the areas covered among the multiple cameras are spliced to remove the overlapped areas. The method comprises the following steps of taking boundary points of a plurality of pictures as boundary points of spliced images, calibrating a bowling ball in one spliced image, carrying out preprocessing such as image matrix movement, rotation, scaling, beveling and the like, forming a two-dimensional matrix by the calibrated images, and correcting the images by operating the matrix, wherein the operations comprise:

The matrix shift formula is as follows:

(m, n) is the coordinate after the movement, (x, y) is the coordinate before the movement, tx, ty correspond to the offset of the x-axis and y-axis respectively;

the matrix rotation formula is as follows:

[x*,y*,1]＝[x,y,1]x[{cosa,sina,0},{-sina,cosa,0},{0,0,1}]＝[xcosa- ysinaxsina+ycosa1] (2)

wherein a is the angle of clockwise rotation of the two-dimensional graph around the origin;

the matrix scaling formula is as follows:

[x*y*1]＝[x y 1]x[{Sx,0,0},{0,Sy,0},{0,0,1}]＝[Sx*x Sy*y 1] (3)

x, y are scaled coordinates of x, y;

The matrix chamfer formula is as follows:

[x*,y*,1]＝[x,y,1]*[{1,d,0},{b,1,0},{0,0,1}]＝[x+by,dx+y,1] (4)

x, y are coordinates after beveling.

The calibrated image correction calculation can be realized by using the above formulas (1) to (4).

the feature points of the bowling ball are extracted from the corrected image, and the recognized data are converted into continuous coordinate points to form the bowling ball trajectory.

In the process of identifying the bowling, ambient light and interference need to be filtered, the camera uses a narrow-band filter to filter visible light, the characteristic points extracted after secondary filtering is carried out on the image by using a gray scale and binary difference method are clearer, and the identification rate of the bowling is improved.

and the projection unit 103 is used for throwing a dynamic three-dimensional image to a lane according to the movement track of the bowling ball, and the dynamic three-dimensional image shows the movement track of the bowling ball in real time.

the projection unit of the system can use a long-focus, short-focus and ultra-short-focus projector according to the actual situation of the bowling alley, and can use laser, DLP, LED and the like in optical imaging. As shown in fig. 2, the projection device installation may be installed above the fairway or obliquely above the fairway depending on the projection device and venue requirements. The camera is installed above the lane and the irradiation range can cover the entire lane. The technique of combining, splicing and fusing by 1 to a plurality of projector devices is adopted to cover the whole bowling lane by using projection images.

further, still include:

and the supplementary lighting unit is used for projecting infrared light or laser light to the lane to supplement lighting for the bowling ball.

specifically, the light supplement unit is added in the embodiment, and infrared light or laser light is projected to the ball track through the light supplement unit, so that the accuracy of detection and identification of the ball is enhanced.

Further, the projection unit includes:

The splicing module is used for splicing the projection pictures of the projectors according to the projection area;

and the picture generation module is used for converting the motion trail of the bowling ball into a virtual three-dimensional space and fusing the converted bowling ball and the three-dimensional image.

the bowling interactive projection system of the embodiment adopts transverse splicing, the picture resolution is single projection resolution N, and N is the number of projection devices. Firstly, screen crossing operation is carried out on a plurality of projections, and the screen crossing operation is a screen combination mode provided by a display card driving program. And then, adjusting the projection pictures by using fusion software, dragging corner points of each projection picture, covering each point on the bowling lane, enabling a splicing gap between the projection and the projection to be as small as possible, enabling the overlapped part to be overlapped completely as possible, and finally adjusting the fusion belt to enable the transition between the projection and the projection to be more natural and adjust the brightness of the fusion belt and the brightness of the two projections to be equal to each other as far as possible. And diluting and fusing the overlapping transition zone between the two projection devices, so that the overlapping transition of the two projection devices is more natural.

Further, the screen generating module is specifically configured to:

mapping trajectory data of the bowling ball to a virtual three-dimensional space;

The three-dimensional pattern moves together with the bowling ball mapped to the virtual three-dimensional space.

Specifically, the lane parameters in the projector were set, the lane width was 1066 mm, the lane spacing was 724 mm, and the length was 16871 mm. Calculating deviation between the projector and the lane after projection, and finely adjusting according to the deviation: and recording the lane parameters after the data adjustment. And reading the trajectory data of the bowling ball and mapping the trajectory data to the virtual three-dimensional world. The three-dimensional pattern of the embodiment is obtained by a three-dimensional camera, and the three-dimensional camera is divided into two types: the first is a non-see-through camera, and as shown in fig. 4, this camera without see-through has no see-through relationship and does not cause distortion of the screen in the near-far direction, and therefore, the thickness of the three-dimensional image is directly converted from the two-dimensional image to the third coordinate (z-axis coordinate) of the three-dimensional image of the bowling ball.

The second is a perspective camera, the camera belts have perspective relation, and the coordinate conversion of the bowling ball needs to be calculated according to the angle of the perspective camera. Assuming that the two-dimensional coordinates are (x, y) and the three-dimensional world ray receiving layer is T, a ray is emitted from the two-dimensional coordinates to the three-dimensional camera, the ray intersects with the ray receiving layer of the three-dimensional world, and a three-dimensional coordinate point (x ', y ', z ') is generated on the ray receiving layer, so that the coordinates are the three-dimensional world coordinates converted from the two-dimensional coordinates.

The three-dimensional pattern of the present embodiment moves together with the bowling ball, and as shown in fig. 5, the three-dimensional pattern is a small fish swimming in water. The swimming fish swims forward in the water as the bowling ball moves on the lane. Meanwhile, the small fish can also be subjected to animations such as overturning.

further, the screen generating module is specifically configured to:

mapping trajectory data of the bowling ball to a virtual three-dimensional space;

the bowling ball mapped to the virtual three-dimensional space collides with the first three-dimensional image, and the three-dimensional image is converted into a second three-dimensional image.

Specifically, the three-dimensional image of the present embodiment may have an effect such as blooming, deformation, movement, or explosion. Each bowling lane in the interactive explosion scene is provided with a dynamic background, two rows of characters with animation (the characters comprise monsters, bombs, cakes, flowers, balloons and the like) appear on the background, and the animation form comprises skeleton animation and the like. The animations are first three-dimensional images, interactive roles passed by a bowling ball after the user throws the bowling ball are subjected to collision detection with track points of the bowling ball, the bowling ball is overlapped with the first three-dimensional image area and then triggered, the collided roles can generate special explosion effects, and the images after explosion are second three-dimensional images. The picture becomes dazzling and colorful. The interactive material scene also provides rich background, particle roles (roles comprise metal balls, maple leaves, ice and snow and the like) are generated on the background layer by programs, physical collision effects are generated when the bowling ball passes through the particle roles, for example, the metal balls are knocked away, the maple leaves are blown away and the like. When the ball rolls over the monsters in turn, the monsters explode in turn, and the whole lane becomes vivid and interesting.

further, the screen generating module is specifically configured to:

mapping trajectory data of the bowling ball to a virtual three-dimensional space;

The three-dimensional image is a trajectory of the bowling ball mapped to the virtual three-dimensional space.

Specifically, the three-dimensional image of the embodiment is an interactive scene in which an interactive tailing effect is generated in a black background, and tailing contents include effects of fireworks, rainbow, colored whale, airplane and the like. In terms of a monster scene, monsters appear in pairs from bottom to top in sequence when the scene is loaded and refreshed, the monster background is colorful five-pointed star meteor rain, the monsters can twist animation when not serving, and all the monsters can float integrally according to the wave shape. The three-dimensional image is consistent with the track of the bowling ball and is kept on the lane until the bowling ball hits the bowling pin and disappears.

Further, the projection unit further includes:

And the picture switching module is used for switching the three-dimensional image after the track data of the bowling ball is not read.

in the picture switching module of the embodiment, the three-dimensional image is switched when the bowling ball is still not recognized after the impact reaches the preset threshold time. The screen switching mode may include: sequential switching, random switching, switching over time or switching over interaction times.

Further, the projection unit further includes:

And the bowling result display module is used for displaying the throwing results in a classified manner after the bowling is thrown.

scoring data collection, collecting scoring system data from a bowling ball, the data comprising: the state of all the pins, the obtained scores and other data. The image system generates specific image effects (bottle separation, full, complement, etc.) according to different score data. The track record records the track of the ball in the lane through the track data obtained by the recognition software, the track of each serve is stored in the computer system, and the user can play back the serve track on the lane together with the three-dimensional image.

the existing bowling equipment can only record the result of hitting pins of a bowling ball singly, the lane is single, monotonous and dead, no dynamic image effect exists, and the track of the bowling ball cannot be recorded.

The invention uses the projector to combine with the 3D/2D image making technology and the image recognition technology to display rich dynamic image content on the fairway, and can record the track of the ball body in the fairway. Before hitting the bowling pin, a user can experience interactive projection contents of the bowling ball on the lane and can play back the trajectory of the ball. Provides a teaching means for bowling, provides technical analysis data for the bowlers or users, and enhances the experience effect of the users. The present invention may be used in bowling teaching, training and bowling recreation.

Finally, it should be noted that: the above embodiments are only used to illustrate the technical solution of the present invention, and not to limit the same; while the invention has been described in detail and with reference to the foregoing embodiments, it will be understood by those skilled in the art that: the technical solutions described in the foregoing embodiments may still be modified, or some or all of the technical features may be equivalently replaced; and the modifications or the substitutions do not make the essence of the corresponding technical solutions depart from the scope of the technical solutions of the embodiments of the present invention.