阅读说明：本技术 一种沉浸式观影装置及方法 (Immersive film watching device and method ) 是由 彭雪薇 于 2021-05-28 设计创作，主要内容包括：本发明公开了一种沉浸式观影装置及方法,所述装置包括实景模块、模型建立模块、视角转换模块以及图像分割模块；实景模块包括相互拼接的多个投影幕布、与多个投影幕布一一对应的多个投影设备,实景模块用于根据多个投影幕布和多个投影设备搭建实景；模型建立模块用于采集实景和预设最佳观影点的位置,并根据实景和预设最佳观影点的位置建立三维虚拟模型；视角转换模块用于基于三维虚拟模型将从预设最佳观影点看向多个投影幕布的视角转化成视觉平面图；图像分割模块用于基于视觉平面图将待投影影片分割成与多个投影幕布一一对应的多个投影图像；多个投影设备用于将与之对应的多个投影图像投影至多个投影幕布上。本发明实现了肉眼3D观影。(The invention discloses an immersive film watching device and a method thereof, wherein the device comprises a live-action module, a model establishing module, a visual angle conversion module and an image segmentation module; the live-action module comprises a plurality of mutually spliced projection curtains and a plurality of projection devices in one-to-one correspondence with the projection curtains, and is used for building a live action according to the projection curtains and the projection devices; the model building module is used for collecting the positions of the real scenes and the preset optimal viewing points and building a three-dimensional virtual model according to the positions of the real scenes and the preset optimal viewing points; the visual angle conversion module is used for converting visual angles of the plurality of projection curtains from a preset optimal viewing point into a visual plane diagram based on the three-dimensional virtual model; the image segmentation module is used for segmenting a film to be projected into a plurality of projection images which are in one-to-one correspondence with the plurality of projection curtains based on the visual plane map; the plurality of projection devices are used for projecting a plurality of projection images corresponding to the projection devices onto a plurality of projection curtains. The invention realizes the 3D film watching by naked eyes.)

1. An immersive viewing apparatus, comprising: the system comprises a live-action module, a model building module, a visual angle conversion module and an image segmentation module;

the real scene module comprises a plurality of mutually spliced projection curtains and a plurality of projection devices in one-to-one correspondence with the projection curtains, and is used for building a real scene according to the projection curtains and the projection devices;

the model establishing module is used for acquiring the positions of the real scene and the preset optimal viewing point and establishing a three-dimensional virtual model according to the positions of the real scene and the preset optimal viewing point;

the visual angle conversion module is used for converting visual angles from the preset optimal viewing point to the plurality of projection curtains into visual plane diagrams based on the three-dimensional virtual model;

the image segmentation module is used for segmenting a film to be projected into a plurality of projection images which are in one-to-one correspondence with the plurality of projection curtains based on the visual plane map;

the plurality of projection devices are used for projecting the plurality of projection images corresponding to the plurality of projection devices onto the plurality of projection curtains.

2. The immersive viewing device of claim 1, wherein the image segmentation module comprises a preprocessing unit, a corner alignment unit, and a segmentation unit;

the preprocessing unit is used for performing transparentization processing on the visual plan to generate a semitransparent plan;

the corner aligning unit is used for aligning the edge of the film to be projected with the edge of the semi-transparent plane graph;

the segmentation unit is used for segmenting the film to be projected into the plurality of projection images based on the semi-transparent plane map.

3. The immersive viewing device of claim 2, wherein the segmentation unit comprises a preliminary segmentation subunit and a discard unit;

the preliminary segmentation subunit is used for segmenting the film to be projected into N +1 projection images, wherein N is the number of the projection curtains;

the discarding unit is used for identifying the projection images corresponding to the plurality of projection curtains and discarding the projection images not corresponding to the plurality of projection curtains.

4. The immersive viewing device of claim 2, wherein the transparency of the semi-transparent plan view is greater than or equal to 60%.

5. The immersive viewing device of claim 1, wherein the ratio of the three-dimensional virtual model to the real world scene is 1: 1.

6. The immersive viewing apparatus of claim 1 further comprising an image rectification module for grid rectifying the plurality of projected images such that corners of the projected images coincide with corners of the projection screens before the plurality of projection devices project the plurality of projected images onto the plurality of projection screens.

7. The immersive viewing apparatus of claim 1, further comprising a manipulation module, wherein the plurality of projection devices comprise a video unit and an audio unit, and wherein the manipulation module is configured to control the video unit and the audio unit to turn on and off.

8. The immersive viewing device of claim 1, further comprising a position adjustment module configured to find a visual vanishing point based on the three-dimensional virtual model and adjust a position of the preset optimal viewing point according to the position of the visual vanishing point.

9. The immersive viewing device of claim 1, wherein the plurality of projection screens comprise a bottom projection screen, a left projection screen, a right projection screen, and a front projection screen that are perpendicular to each other, wherein the joints of the bottom projection screen, the left projection screen, the right projection screen, and the front projection screen are completely overlapped; the plurality of projection devices are arranged above the plurality of projection curtains; the preset optimal viewing point is located on the symmetry axis of the left side projection curtain and the right side projection curtain.

10. An immersive viewing method applied to the immersive viewing apparatus of any one of claims 1 to 9, comprising:

building a real scene according to the plurality of projection curtains and the plurality of projection devices;

collecting the positions of the real scenes and the preset optimal viewing points, and establishing a three-dimensional virtual model according to the positions of the real scenes and the preset optimal viewing points;

converting, based on the three-dimensional virtual model, the viewing angles from the preset optimal viewing points to the plurality of projection curtains into visual plane diagrams;

dividing a film to be projected into a plurality of projection images which correspond to the plurality of projection curtains one by one on the basis of the visual plane map;

and projecting the plurality of projection images corresponding to the plurality of projection devices onto the plurality of projection screens through the plurality of projection devices.

Technical Field

The invention relates to the technical field of 3D (three-dimensional) cinema, in particular to an immersive film watching device and method.

Background

Compared with the common 2D picture, the 3D technology can make the picture become three-dimensional and vivid, the image is not limited to the screen plane any more, and the image seems to be capable of going out of the screen, so that the audience has a feeling of being personally on the scene.

The 3D display technology of the existing cinema realizes the stereoscopic effect of a film by wearing professional 3D glasses or VR glasses, the operation and the use are not convenient, especially, a person wearing a myopia glasses frame needs to wear a pair of 3D glasses or VR glasses again when going to a traditional cinema to watch a 3D film, so that the encumbrance is formed, and the fatigue of a viewer for appreciating the 3D film is increased due to the weight of the 3D glasses or VR glasses.

Disclosure of Invention

The invention provides an immersive film watching device and method, and aims to solve the technical problem that in the prior art, a film viewer can see the stereoscopic effect of a film only by wearing professional 3D glasses or VR glasses, so that the operation and the use of the film viewer are inconvenient.

The invention provides an immersive film watching device, which comprises: the system comprises a live-action module, a model building module, a visual angle conversion module and an image segmentation module;

the real scene module comprises a plurality of mutually spliced projection curtains and a plurality of projection devices in one-to-one correspondence with the projection curtains, and is used for building a real scene according to the projection curtains and the projection devices;

the model establishing module is used for acquiring the positions of the real scene and the preset optimal viewing point and establishing a three-dimensional virtual model according to the positions of the real scene and the preset optimal viewing point;

the visual angle conversion module is used for converting visual angles from the preset optimal viewing point to the plurality of projection curtains into visual plane diagrams based on the three-dimensional virtual model;

the image segmentation module is used for segmenting a film to be projected into a plurality of projection images which are in one-to-one correspondence with the plurality of projection curtains based on the visual plane map;

the plurality of projection devices are used for projecting the plurality of projection images corresponding to the plurality of projection devices onto the plurality of projection curtains.

In some possible implementations of the invention, the image segmentation module includes a preprocessing unit, a corner alignment unit, and a segmentation unit;

the preprocessing unit is used for performing transparentization processing on the visual plan to generate a semitransparent plan;

the corner aligning unit is used for aligning the edge of the film to be projected with the edge of the semi-transparent plane graph;

the segmentation unit is used for segmenting the film to be projected into the plurality of projection images based on the semi-transparent plane map.

In some possible implementations of the invention, the segmentation unit includes a preliminary segmentation subunit and a discard unit;

the preliminary segmentation subunit is used for segmenting the film to be projected into N +1 projection images, wherein N is the number of the projection curtains;

the discarding unit is used for identifying the projection images corresponding to the plurality of projection curtains and discarding the projection images not corresponding to the plurality of projection curtains.

In some possible implementations of the invention, the semi-transparent plan view has a transparency greater than or equal to 60%.

In some possible implementations of the invention, the ratio of the three-dimensional virtual model to the real world is 1: 1.

In some possible implementations of the invention, the immersive viewing apparatus further includes an image proofreading module, and the image proofreading module is configured to perform a mesh proofreading on the plurality of projection images before the plurality of projection devices project the plurality of projection images onto the plurality of projection screens, so that corners of the projection images coincide with corners of the projection screens.

In some possible implementations of the invention, the immersive viewing apparatus further includes a manipulation module, and the plurality of projection devices include a video unit and an audio unit, and the manipulation module is configured to control on and off of the video unit and the audio unit.

In some possible implementation manners of the present invention, the immersive viewing apparatus further includes a position adjusting module, and the position adjusting module is configured to find a visual vanishing point according to the three-dimensional virtual model, and adjust a position of the preset optimal viewing point according to the position of the visual vanishing point.

In some possible implementations of the invention, the plurality of projection screens include a bottom projection screen, a left projection screen, a right projection screen, and a front projection screen that are perpendicular to each other, and the splicing positions of the bottom projection screen, the left projection screen, the right projection screen, and the front projection screen are completely overlapped; the plurality of projection devices are arranged above the plurality of projection curtains; the preset optimal viewing point is located on the symmetry axis of the left side projection curtain and the right side projection curtain.

In another aspect, the present invention further provides an immersive viewing method, which is suitable for any one of the immersive viewing apparatuses described above, and the immersive viewing method includes:

building a real scene according to the plurality of projection curtains and the plurality of projection devices;

collecting the positions of the real scenes and the preset optimal viewing points, and establishing a three-dimensional virtual model according to the positions of the real scenes and the preset optimal viewing points;

converting, based on the three-dimensional virtual model, the viewing angles from the preset optimal viewing points to the plurality of projection curtains into visual plane diagrams;

dividing a film to be projected into a plurality of projection images which correspond to the plurality of projection curtains one by one on the basis of the visual plane map;

and projecting the plurality of projection images corresponding to the plurality of projection devices onto the plurality of projection screens through the plurality of projection devices.

The invention sets up the live-action through setting up the live-action module, set up the three-dimensional virtual model according to the live-action and presetting the best point of seeing through the model establishment module, and change the visual angle that looks at to a plurality of projection curtains from presetting the best point of seeing into the visual plane map according to the three-dimensional virtual model of visual angle conversion module, cut apart into a plurality of projection images through the film that waits to project through the visual plane map through the image segmentation module, project a plurality of projection images on a plurality of projection curtains through a plurality of projection equipments finally, realize that the viewer can see the stereoscopic image of the film to be projected through the naked eye at presetting the best point of seeing, and can see the stereoscopic effect through not needing to wear 3D glasses or VR glasses, improve the sense of immersion, meanwhile, has got rid of the constraint of 3D glasses or VR glasses when the cinema watches, have improved the viewer's experience sense.

Drawings

In order to more clearly illustrate the technical solutions in the embodiments of the present invention, the drawings needed to be used in the description of the embodiments will be briefly introduced below, and it is obvious that the drawings in the following description are only some embodiments of the present invention, and it is obvious for those skilled in the art to obtain other drawings based on these drawings without creative efforts.

FIG. 1 is a schematic structural diagram of an embodiment of an immersive viewing apparatus provided by embodiments of the present invention;

FIG. 2 is a schematic diagram of an arrangement of multiple projection screens and multiple projection devices provided by an embodiment of the present invention;

FIG. 3 is a flow chart of an embodiment of an immersive viewing method provided by an embodiment of the invention.

Detailed Description

The technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are only a part of the embodiments of the present invention, and not all of the embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.

The following description is presented to enable any person skilled in the art to make and use the invention. In the following description, details are set forth for the purpose of explanation. It will be apparent to one of ordinary skill in the art that the present invention may be practiced without these specific details. In other instances, well-known structures and processes are not shown in detail to avoid obscuring the description of the invention with unnecessary detail. Thus, the present invention is not intended to be limited to the embodiments shown, but is to be accorded the widest scope consistent with the principles and features disclosed herein.

In the description of the present invention, "a plurality" means four or more unless specifically defined otherwise.

Embodiments of the present invention provide an immersive viewing apparatus and method, which are described in detail below.

Fig. 1 is a schematic structural diagram of an embodiment of an immersive viewing apparatus according to an embodiment of the present invention, and as shown in fig. 1, an immersive viewing apparatus 10 includes a real-scene module 100, a model building module 200, a view angle conversion module 300, and an image segmentation module 400;

the real-scene module 100 includes a plurality of projection curtains 110 spliced with each other and a plurality of projection devices 120 corresponding to the plurality of projection curtains 110 one by one, and the real-scene module 100 is configured to build a real scene according to the plurality of projection curtains 110 and the plurality of projection devices 120;

the model establishing module 200 is used for acquiring the positions of the real scenes and the preset optimal viewing points and establishing a three-dimensional virtual model according to the positions of the real scenes and the preset optimal viewing points;

the visual angle conversion module 300 is configured to convert visual angles of the plurality of projection screens from a preset optimal viewing point into a visual plan based on the three-dimensional virtual model;

the image segmentation module 400 is configured to segment a movie to be projected into a plurality of projection images corresponding to a plurality of projection curtains one to one based on a visual plane map;

the plurality of projection devices 120 are configured to project a plurality of projection images corresponding thereto onto the plurality of projection screens 110.

The embodiment of the invention builds the real scene by setting the real scene module 100, builds the three-dimensional virtual model by the model building module 200 according to the real scene and the preset optimal viewing point, and converts the viewing angles from the preset optimal viewing points to the plurality of projection screens into visual plane diagrams based on the three-dimensional virtual model according to the viewing angle conversion module 300, after the film to be projected is divided into a plurality of projection images by the image dividing module 400 based on the visual plane map, and finally the plurality of projection images are projected onto the plurality of projection curtains 110 by the plurality of projection devices 120, the viewer can see the stereoscopic image of the film to be projected by naked eyes at the preset optimal viewing point, the stereoscopic effect can be seen without wearing 3D glasses or VR glasses, the immersion feeling is improved, simultaneously, get rid of the constraint of 3D glasses or VR glasses when having watched in the cinema, improved viewer's experience sense.

Further, as shown in fig. 1, the image segmentation module 400 includes a preprocessing unit 410, a corner alignment unit 420, and a segmentation unit 430;

the preprocessing unit 410 is configured to perform a transparentization process on the visual plan to generate a semitransparent plan;

the corner aligning unit 420 is used for aligning the edge of the film to be projected with the edge of the semi-transparent plan view;

specifically, the method comprises the following steps: the corner aligning unit 420 is used for overlaying the semi-transparent plane map on the film to be projected and aligning the edge of the film to be projected with the edge of the semi-transparent plane map;

the segmentation unit 430 is configured to segment the movie to be projected into a plurality of projection images based on the semi-transparent plane maps.

By arranging the preprocessing unit 410, it can be realized that when the semi-transparent plane graph is overlaid on the film to be projected, the edge of the film to be projected and the edge of the semi-transparent plane graph can still be observed, so as to ensure that the edge of the film to be projected is aligned with the edge of the semi-transparent plane graph.

Through setting up corner alignment unit 420, when can guaranteeing to project a plurality of projection images to a plurality of projection curtains on, the projection image that shows on a plurality of projection curtains does not have the deformation, avoids causing the vision distortion to avoid making the sight shadow person produce and break away from the sense, improve and immerse the sense.

Further, as shown in fig. 1, the segmentation unit 430 includes a preliminary segmentation subunit 431 and a discard unit 432;

the preliminary segmentation subunit 431 is configured to segment the movie to be projected into N +1 projection images, where N is the number of the plurality of projection curtains 110;

specifically, the preliminary segmentation subunit 431 performs segmentation along the joints of the plurality of projection curtains 110 during the segmentation.

The discarding unit 432 is configured to identify the projection images corresponding to the plurality of projection screens and discard the projection images not corresponding to the plurality of projection screens 110.

Further, in order to ensure that the edges of the film to be projected and the edges of the semi-transparent plan view are still observable when the semi-transparent plan view is overlaid on the film to be projected, in some embodiments of the invention, the transparency of the semi-transparent plan view is greater than or equal to 60%.

Further, to ensure the viewing effect, in some embodiments of the present invention, the ratio of the three-dimensional virtual model to the real scene is 1: 1.

In order to further avoid distortion of the film to be projected during projection, in some embodiments of the present invention, as shown in fig. 1, the immersive viewing apparatus 10 further includes an image rectification module 500, and the image rectification module 500 is configured to perform a grid rectification on the plurality of projection images before the plurality of projection devices 120 project the plurality of projection images onto the plurality of projection curtains 110, so that corners of the projection images coincide with corners of the projection curtains 110.

Through the arrangement, the joints of the plurality of projection curtains 110 can be smoothly communicated without violation, so that the technical effect of improving the film watching and immersing feeling of film viewers is realized.

In order to further avoid the technical problem that gaps exist among the projection curtains 110 when the projection device 120 projects the projection image, which causes the viewer to feel the separation, in some embodiments of the present invention, the immersive viewing device 10 further includes a position adjusting module 600, and the position adjusting module 600 is configured to find a visual vanishing point according to the three-dimensional virtual model, and adjust the position of the preset optimal viewing point according to the position of the visual vanishing point.

After the preset optimal film watching point is adjusted by the position adjusting module 600, the film watching effect of the film watching person can be further improved.

Further, in order to improve controllability and interactivity of immersive viewing apparatus 10, in some embodiments of the present invention, as shown in fig. 1, immersive viewing apparatus 10 further includes a manipulation module 700, and the plurality of projection devices 120 include a video unit 121 and an audio unit 122, and manipulation module 700 is configured to control on and off of video unit 121 and audio unit 122.

Specifically, controlling the video unit 121 and the audio unit 122 to turn on and off, playing, stopping, pausing, content switching, sound control, and the like of the projection device 120 can be achieved.

Specifically, the control module 700 may be interactively connected to a plurality of projection devices 120 via a communication protocol.

In some embodiments of the present invention, the control module 700 may be an APP integrated on a mobile phone, a computer, or other hardware devices carried by the viewer.

Further, as shown in fig. 2, the plurality of projection curtains 110 include a bottom projection curtain 111, a left projection curtain 112, a right projection curtain 113, and a front projection curtain 114 that are perpendicular to each other, and the splicing positions of the bottom projection curtain 111, the left projection curtain 112, the right projection curtain 113, and the front projection curtain 114 are completely overlapped; the plurality of projection devices 120 are disposed above the plurality of projection curtains 110; the default optimal viewing point is located on the axis of symmetry of the left projection screen 112 and the right projection screen 113.

Specifically, the method comprises the following steps: the bottom projection curtain 111, the left projection curtain 112, the right projection curtain 113, and the front projection curtain 114 are all rectangular, and the opposite surface of the front projection curtain 114 is a viewing surface.

The projection direction of the projection device 120 is the inner side of the projection curtain 110.

Further, the method for finding the visual vanishing point of the three-dimensional virtual model comprises the following steps: the extended lines with intersection trend are formed after the bottom projection curtain 111, the left projection curtain 112, the right projection curtain 113 and the front projection curtain 114 are connected, and the intersection points of the four extended lines are the visual vanishing points of the three-dimensional virtual model.

On the other hand, an embodiment of the present invention further provides an immersive viewing method, which is suitable for the immersive viewing apparatus 10 described in any of the above embodiments, as shown in fig. 3, the immersive viewing method includes:

s301, building a real scene according to the plurality of projection curtains 110 and the plurality of projection devices 120;

s302, collecting the positions of the real scenes and the preset optimal viewing points, and establishing a three-dimensional virtual model according to the positions of the real scenes and the preset optimal viewing points;

s303, converting the visual angles from the preset optimal viewing points to the plurality of projection curtains into visual plane diagrams based on the three-dimensional virtual model;

s304, dividing the film to be projected into a plurality of projection images corresponding to the plurality of projection curtains 110 one by one based on the visual plane map;

specifically, S304 includes: performing transparentization treatment on the visual plan to generate a semitransparent plan; aligning the edge of the film to be projected with the edge of the semitransparent plane graph; and dividing the film to be projected into a plurality of projection images based on the semi-transparent plane maps.

S305, projecting a plurality of projection images corresponding to the plurality of projection devices 120 onto a plurality of projection curtains 110.

Before the plurality of projection images corresponding to the plurality of projection devices 120 are projected onto the plurality of projection curtains 110, the method further includes: the plurality of projected images are grid collated so that the corners of the projected images coincide with the corners of the projection screen 110. The connection parts of the plurality of projection curtains 110 are smoothly communicated without causing a sense of incongruity, so that the technical effect of improving the film watching and immersing senses of film viewers is realized.

Through above-mentioned step, when the sight shadow person is located and predetermines best sight shadow point, can see the stereoscopic image of treating the projection film through the naked eye, and need not to see the stereoeffect through wearing 3D glasses or VR glasses, improve and immerse the sense, simultaneously, have broken away from the constraint of 3D glasses or VR glasses when the cinema watches.

In some embodiments of the present invention, in order to further improve the viewing experience of the viewer, a visual vanishing point may be found based on the three-dimensional virtual model, and the position of the preset optimal viewing point may be adjusted according to the position of the visual vanishing point.

The embodiment of the invention builds the real scene by setting the real scene module 100, builds the three-dimensional virtual model by the model building module 200 according to the real scene and the preset optimal viewing point, converts the viewing angles from the preset optimal viewing point to a plurality of projection screens into the visual plane map based on the three-dimensional virtual model according to the viewing angle conversion module 300, segments the film to be projected into a plurality of projection images by the image segmentation module 400 based on the visual plane map, and finally projects the plurality of projection images onto the plurality of projection screens 110 by the plurality of projection devices 120, so that a viewer can see the stereoscopic image of the film to be projected by naked eyes at the preset optimal viewing point without wearing 3D glasses or VR glasses to see the stereoscopic effect, the immersion feeling is improved, and the constraint of 3D glasses or VR glasses during movie theater viewing is eliminated.

Further, in the embodiment of the present invention, the edge of the film to be projected is aligned with the edge of the semitransparent plane view by the corner aligning unit 420, and the image proofreading module 500 is arranged to perform grid proofreading on the plurality of projection images before the plurality of projection devices 120 project the plurality of projection images onto the plurality of projection curtains 110, so that the corners of the projection images are overlapped with the corners of the projection curtains 110, so that when a viewer views a film, the connection positions of the respective projection curtains 110 are smoothly connected without creating a sense of incongruity, thereby achieving the technical effect of improving the immersion sense of the viewer in viewing the film.

The above detailed description is provided for the immersive viewing device and method provided by the embodiments of the present invention, and specific examples are applied in this text to explain the principles and embodiments of the present invention, and the description of the above embodiments is only used to help understand the method and the core idea of the present invention; meanwhile, for those skilled in the art, according to the idea of the present invention, there may be variations in the specific embodiments and the application scope, and in summary, the content of the present specification should not be construed as a limitation to the present invention.