阅读说明：本技术 一种信息处理方法、装置和电子设备 (Information processing method and device and electronic equipment ) 是由 龚江涛 张柳新 张晓平 于 2021-09-24 设计创作，主要内容包括：本申请提供了一种信息处理方法、装置和电子设备,本方案中,在拍摄的目标人物和图像采集装置之间设置全息屏幕,在该全息屏幕中显示虚拟内容,图像采集装置对于目标人物和全息屏幕中显示的虚拟内容进行拍摄,并对于拍摄的视频信息中满足预设条件的目标区域进行处理,以减少由于全息屏幕半透明对于视频中各个影像的影响,提高视频质量,提高观看视频的用户体验。(The application provides an information processing method, an information processing device and electronic equipment, in the scheme, a holographic screen is arranged between a shot target character and an image acquisition device, virtual content is displayed in the holographic screen, the image acquisition device shoots the target character and the virtual content displayed in the holographic screen, and a target area meeting preset conditions in shot video information is processed, so that the influence of the semi-transparency of the holographic screen on each image in a video is reduced, the video quality is improved, and the user experience of watching the video is improved.)

1. An information processing method comprising:

the method comprises the steps that video information is obtained, at least two frames of images of the video information comprise a target figure image and a virtual content image, the virtual content image is obtained by collecting virtual content displayed in a holographic screen through an image collecting device, the holographic screen is arranged between a target figure and the image collecting device, the target figure image is obtained by collecting the image collecting device through the holographic screen, and the light transmittance of the holographic screen is smaller than a preset value;

analyzing whether a target area in at least two frames of images of the video information meets a preset condition or not;

and processing the target parameters of the target area based on the target area in the at least two frames of images meeting the preset condition.

2. The method of claim 1, analyzing whether a target area exists in at least two frames of images of the video information and satisfying a preset condition, comprising:

sequentially selecting any frame image of the at least two frame images as a target image;

and determining that the area surrounded by the preset contour is a target area and the target area meets the preset condition based on the preset contour existing in the target image and the preset parameter values of the areas on two sides of the preset contour meeting the preset distinguishing condition, wherein the target area is the area where the holographic screen is located.

3. The method of claim 1, analyzing whether a target area exists in at least two frames of images of the video information and satisfying a preset condition, comprising:

taking each frame of the at least two frames of images as a target image in sequence;

analyzing the target image based on a pre-trained neural network model to obtain a target area meeting preset conditions in the target image, wherein the target area is the area where the holographic screen is located.

4. The method according to any one of claims 2-3, wherein said processing target parameters of said target region comprises:

analyzing based on a preset holographic screen image to obtain optical parameters of the holographic screen;

adjusting pixel values of the target area in the target image based on optical parameters of the holographic screen.

5. The method according to any one of claims 2-3, wherein said processing target parameters of said target region comprises:

determining that a first region meeting a preset figure outline exists in the target region, and the first region contains a target figure image;

analyzing the angle of the target character image in the first area, wherein the angles of the target character image in any two frames of images are the same or different;

selecting a target image with the same angle as the angle in a preset three-dimensional character image of a target character;

and processing the first area based on the target image.

6. The method of claim 5, further comprising, prior to obtaining the video information:

acquiring at least two first images containing target character images from at least two shooting angles;

and synthesizing the three-dimensional character image of the target character based on at least two first images and the shooting angles corresponding to the first images.

7. The method according to any one of claims 2-3, wherein said processing target parameters of said target region comprises:

analyzing the target area to obtain an image of virtual content, wherein the virtual content in any two frames of images is the same or different;

acquiring an original virtual content image corresponding to the virtual content;

and processing a second area where the virtual content image is located based on the original virtual content image.

8. An information processing apparatus comprising:

the system comprises an acquisition module, a display module and a control module, wherein the acquisition module is used for acquiring video information, at least two frames of images of the video information comprise a target character image and a virtual content image, the virtual content image is acquired by an image acquisition device for acquiring virtual content displayed in a holographic screen, the holographic screen is arranged between a target character and the image acquisition device, the target character image is acquired by the image acquisition device through the holographic screen, and the light transmittance of the holographic screen is smaller than a preset value;

the analysis module is used for analyzing whether a target area in at least two frames of images of the video information meets a preset condition or not;

and the processing module is used for processing the target parameters of the target area on the basis that the target area in the at least two frames of images meets a preset condition.

9. An electronic device, comprising: a memory, a processor;

wherein, the memorizer stores the information processing program;

the processor is configured to load and execute the information processing program stored in the memory to realize the steps of the information processing method according to any one of claims 1 to 7.

10. A readable storage medium having stored thereon a computer program, which is called and executed by a processor, implementing the steps of the information processing method according to any one of claims 1 to 7.

Technical Field

The present application relates to the field of information technologies, and in particular, to an information processing method and apparatus, and an electronic device.

Background

The existing interactive lecture video is recorded in a shooting site. Generally, there are audiences and speeches in the shooting scene, and in order to improve the scene effect, a holographic screen is also arranged in the scene to display the virtual special effect content, so that the speeches can be carried out by the speeches according to the virtual special effect content.

However, the holographic screen is generally semi-transparent, and in the recorded video, the presenter or the virtual special effect content displayed in the holographic screen is easily affected by the holographic screen, so that the recorded video is poor in effect.

Disclosure of Invention

In view of the above, the present application provides an information processing method, comprising:

an information processing method comprising:

the method comprises the steps that video information is obtained, at least two frames of images of the video information comprise a target figure image and a virtual content image, the virtual content image is obtained by collecting virtual content displayed in a holographic screen through an image collecting device, the holographic screen is arranged between a target figure and the image collecting device, the target figure image is obtained by collecting the image collecting device through the holographic screen, and the light transmittance of the holographic screen is smaller than a preset value;

analyzing whether a target area in at least two frames of images of the video information meets a preset condition or not;

and processing the target parameters of the target area based on the target area in the at least two frames of images meeting the preset condition.

Optionally, the analyzing whether the target area exists in at least two frames of images of the video information and meets a preset condition includes:

sequentially selecting any frame image of the at least two frame images as a target image;

and determining that the area surrounded by the preset contour is a target area and the target area meets the preset condition based on the preset contour existing in the target image and the preset parameter values of the areas on two sides of the preset contour meeting the preset distinguishing condition, wherein the target area is the area where the holographic screen is located.

Optionally, the analyzing whether the target area exists in at least two frames of images of the video information and meets a preset condition includes:

taking each frame of the at least two frames of images as a target image in sequence;

analyzing the target image based on a pre-trained neural network model to obtain a target area meeting preset conditions in the target image, wherein the target area is the area where the holographic screen is located.

Optionally, in the method, the processing the target parameter of the target region includes:

analyzing based on a preset holographic screen image to obtain optical parameters of the holographic screen;

adjusting pixel values of the target area in the target image based on optical parameters of the holographic screen.

Optionally, in the method, the processing the target parameter of the target region includes:

determining that a first region meeting a preset figure outline exists in the target region, and the first region contains a target figure image;

analyzing the angle of the target character image in the first area, wherein the angles of the target character image in any two frames of images are the same or different;

selecting a target image with the same angle as the angle in a preset three-dimensional character image of a target character;

and processing the first area based on the target image.

Optionally, before acquiring the video information, the method further includes:

acquiring at least two first images containing target character images from at least two shooting angles;

and synthesizing the three-dimensional character image of the target character based on at least two first images and the shooting angles corresponding to the first images.

Optionally, in the method, the processing the target parameter of the target region includes:

analyzing the target area to obtain an image of virtual content, wherein the virtual content in any two frames of images is the same or different;

acquiring an original virtual content image corresponding to the virtual content;

and processing a second area where the virtual content image is located based on the original virtual content image.

An information processing apparatus comprising:

the system comprises an acquisition module, a display module and a control module, wherein the acquisition module is used for acquiring video information, at least two frames of images of the video information comprise a target character image and a virtual content image, the virtual content image is acquired by an image acquisition device for acquiring virtual content displayed in a holographic screen, the holographic screen is arranged between a target character and the image acquisition device, the target character image is acquired by the image acquisition device through the holographic screen, and the light transmittance of the holographic screen is smaller than a preset value;

the analysis module is used for analyzing whether a target area in at least two frames of images of the video information meets a preset condition or not;

and the processing module is used for processing the target parameters of the target area on the basis that the target area in the at least two frames of images meets a preset condition.

An electronic device, comprising: a memory, a processor;

wherein, the memorizer stores the information processing program;

the processor is configured to load and execute the information processing program stored in the memory to implement the steps of the information processing method according to any one of the above.

A readable storage medium having stored thereon a computer program to be called and executed by a processor for implementing the steps of the information processing method according to any one of the above.

As can be seen from the above technical solutions, compared with the prior art, the present application provides an information processing method, including: the method comprises the steps that video information is obtained, at least two frames of images of the video information comprise a target figure image and a virtual content image, the virtual content image is obtained by collecting virtual content displayed in a holographic screen through an image collecting device, the holographic screen is arranged between a target figure and the image collecting device, the target figure image is obtained by collecting the image collecting device through the holographic screen, and the light transmittance of the holographic screen is smaller than a preset value; analyzing whether a target area in at least two frames of images of the video information meets a preset condition or not; and processing the target parameters of the target area based on the target area in the at least two frames of images meeting the preset condition. According to the scheme, the holographic screen is arranged between the shot target character and the image acquisition device, virtual content is displayed in the holographic screen, the image acquisition device shoots the target character and the virtual content displayed in the holographic screen, and the target area meeting preset conditions in shot video information is processed, so that the influence of the semi-transparency of the holographic screen on each image in the video is reduced, the video quality is improved, and the user experience of watching the video is improved.

Drawings

In order to more clearly illustrate the technical solutions in the embodiments of the present application, the drawings needed to be used in the description of the embodiments are briefly introduced below, and it is obvious that the drawings in the following description are only embodiments of the present application, and it is obvious for those skilled in the art to obtain other drawings based on the provided drawings without creative efforts.

Fig. 1 is a flowchart of an information processing method embodiment 1 provided in the present application;

fig. 2 is a schematic view of an application scenario of an embodiment 1 of an information processing method provided in the present application;

fig. 3 is a flowchart of an information processing method embodiment 2 provided by the present application;

FIG. 4 is a schematic diagram of a target image before processing in embodiment 2 of an information processing method provided by the present application;

fig. 5 is a flowchart of an information processing method embodiment 3 provided in the present application;

fig. 6 is a flowchart of an information processing method embodiment 4 provided in the present application;

fig. 7 is a flowchart of an information processing method embodiment 5 provided by the present application;

FIG. 8 is a diagram of a target image before processing in embodiment 5 of an information processing method provided by the present application;

fig. 9 is a flowchart of an embodiment 6 of an information processing method provided in the present application;

fig. 10 is a flowchart of embodiment 7 of an information processing method provided in the present application;

FIG. 11 is a diagram illustrating a pre-processing target image in embodiment 7 of an information processing method according to the present application;

fig. 12 is a schematic structural diagram of an embodiment of an information processing apparatus provided in the present application.

Detailed Description

The technical solutions in the embodiments of the present application will be clearly and completely described below with reference to the drawings in the embodiments of the present application, and it is obvious that the described embodiments are only a part of the embodiments of the present application, and not all of the embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present application.

As shown in fig. 1, it is a flowchart of embodiment 1 of an information processing method provided in the present application, where the method is applied to an electronic device, and the method includes the following steps:

step S101: acquiring video information, wherein at least two frames of images of the video information comprise a target character image and a virtual content image;

the virtual content image is acquired by the image acquisition device through acquiring virtual content displayed in the holographic screen, the holographic screen is arranged between a target character and the image acquisition device, and the target character image is acquired by the image acquisition device through the holographic screen.

And the light transmittance of the holographic screen is smaller than a preset value.

Specifically, the hologram screen is not completely transparent but semi-transparent, and has a light transmittance smaller than that of the completely transparent screen, and the preset value is a completely transparent light transmittance.

For example, the light transmittance of the hologram screen is 100% and the light transmittance of the hologram screen is a numerical value less than 100%, but the content of one side thereof can be visually perceived through the hologram screen by the other side.

The electronic equipment executing the scheme can be the electronic equipment connected with the image acquisition device, and the electronic equipment can process the video information in real time in the acquisition process (namely the video recording process) of the image acquisition device or process the video information after the video acquisition is finished (namely the video recording is finished).

Fig. 2 is a schematic diagram of an application scenario of the information processing method, where the scenario includes: a target person 201 to be photographed, a holographic screen 202, and a camera 203. The holographic screen is semi-transparent, the image of the target person can be collected through the holographic screen, the camera collects the image of the target person and the image of the holographic screen, virtual content can be displayed in the holographic screen, a frame of image obtained through shooting forms a video, and the image comprises the image of the target person and the image of the virtual object.

In a specific implementation, the application scenario may be a teaching scenario, such as a video recording in a classroom, in which a teacher gives a lecture in the classroom, the lecture is performed after a holographic screen, virtual content is displayed in the holographic screen to match teaching content, a plurality of students are further in the scenario, and a camera is further used for video recording. The student can directly watch the virtual content displayed in the holographic screen and combines with the explanation learning of the teacher, and people who are not on the spot can also see the virtual content displayed in the display screen and the explanation content of the teacher through the video recorded by the camera.

In a specific implementation, one of the images of the video information may only include the image of the target person, may also only include the virtual content, or includes the target person and the virtual content, or is blank (only the image of the holographic screen).

Step S102: analyzing whether a target area in at least two frames of images of the video information meets a preset condition or not;

the target area meeting the preset condition is that the image of the holographic screen exists in the image, and the holographic screen corresponds to the target area.

Specifically, the judgment can be performed according to the edge of the holographic screen, and the analysis and judgment can also be performed based on a preset neural network model.

Step S103: and processing the target parameters of the target area based on the target area in the at least two frames of images meeting the preset condition.

And representing that the corresponding area of the holographic screen exists in the at least two frames of images based on that the target area exists in the at least two frames of images and meets the preset condition.

And because the holographic screen is influenced by translucency, the color and saturation of the parameter image of the area where the holographic screen is located are influenced, and the color saturation is low, so that the target parameters of the target area are processed.

Specifically, the processing may be performed on the target area, on virtual content displayed in the target area, or on a target person image captured through the target area.

In one embodiment, the target parameter of the target region may be a red-green-blue (RGB) value of a pixel in the target region, and the influence of the translucency of the holographic screen is reduced by adjusting the RGB of the pixel.

In specific implementation, in order to reduce the semitransparent influence of the holographic screen, light can be arranged on one side of the target person to enhance the shot image of the target person.

In summary, an information processing method provided in this embodiment includes: the method comprises the steps that video information is obtained, at least two frames of images of the video information comprise a target figure image and a virtual content image, the virtual content image is obtained by collecting virtual content displayed in a holographic screen through an image collecting device, the holographic screen is arranged between a target figure and the image collecting device, the target figure image is obtained by collecting the image collecting device through the holographic screen, and the light transmittance of the holographic screen is smaller than a preset value; analyzing whether a target area in at least two frames of images of the video information meets a preset condition or not; and processing the target parameters of the target area based on the target area in the at least two frames of images meeting the preset condition. According to the scheme, the holographic screen is arranged between the shot target character and the image acquisition device, virtual content is displayed in the holographic screen, the image acquisition device shoots the target character and the virtual content displayed in the holographic screen, and the target area meeting preset conditions in shot video information is processed, so that the influence of the semi-transparency of the holographic screen on each image in the video is reduced, the video quality is improved, and the user experience of watching the video is improved.

As shown in fig. 3, a flowchart of embodiment 2 of an information processing method provided by the present application includes the following steps:

step S301: acquiring video information, wherein at least two frames of images of the video information comprise a target character image and a virtual content image;

step S301 is the same as step S101 in embodiment 1, and details are not described in this embodiment.

Step S302: sequentially selecting any frame image of the at least two frame images as a target image;

step S303: determining that the region surrounded by the preset contour is a target region and the target region meets the preset condition based on the preset contour existing in the target image and the preset parameter values of the regions on two sides of the preset contour meeting the preset distinguishing condition;

wherein the target area is an area where the holographic screen is located.

In particular, in a scene of recording a video, since the image capture angle range of the image capture module and the size of the holographic screen are generally fixed, and the relative position between the image capture module and the holographic screen can be changed, when the distance between the image capture module and the holographic screen is relatively long, the holographic screen may be in the image capture angle range, so that the holographic screen occupies a partial area in the target image in the recorded video.

In the present embodiment, the hologram screen occupies a partial area in the target image.

Because the holographic screen is semi-transparent, when the image of the holographic screen exists in the target image, a specific outline exists between the area where the holographic screen is located and other areas, and the images on two sides of the outline are different.

Specifically, whether a specific contour exists in the target image or not is analyzed, and areas on two sides of the contour are different.

Wherein the difference may be that the two regions differ in color, saturation, etc.

Specifically, the preset contour is a contour of the holographic screen, for example, a contour of the holographic screen exists in the target image, and the contour may be a region composed of three sides and image edges in the image or a rectangle composed of four sides, a region composed of two sides and image edges in the image or a contour of one line.

Fig. 4 is a schematic diagram of an object image before processing, and the outline in fig. 4 is shown by a dotted line, wherein (a) the object image has an object region 401, the outline in the diagram is four sides, and the object region is a rectangle formed by the four sides; (b) the middle target image is provided with a target area 402, the outline in the figure is three sides, and the target area is a rectangle formed by the three sides and the image edge; (c) the middle target image has a target area 403, the outline in the image is two edges, and the target area is an area formed by the two edges and two edges of the image; (d) the target image has a target area 404, the contour in the figure is a line, and the target area is an area formed by the line and three edges of the image. Wherein the target image in (e) of fig. 4 is processed, wherein the target area has been processed, which is no longer subjected to the semi-transparent image of the holographic screen.

It should be noted that, when the contour of one line is adopted for judgment, the judgment can be further performed based on the preset parameter to determine that the area meeting the specific condition is the target area. For example, the side with lower saturation is the target region.

Step S304: and processing the target parameters of the target area.

Step S304 is the same as step S103 in embodiment 1, and details are not described in this embodiment.

In summary, in an information processing method provided in this embodiment, analyzing whether a target area exists in at least two frames of images of the video information and meets a preset condition includes: sequentially selecting any frame image of the at least two frame images as a target image; and determining that the area surrounded by the preset contour is a target area and the target area meets the preset condition based on the preset contour existing in the target image and the preset parameter values of the areas on two sides of the preset contour meeting the preset distinguishing condition, wherein the target area is the area where the holographic screen is located. According to the scheme, the target image is analyzed based on the edge profile of the holographic screen, when the preset profile exists in the target image and the preset parameter values of the two side regions of the profile meet the preset distinguishing conditions, the region surrounded by the preset profile is determined to be the target region, so that the target region can be processed in the subsequent steps, and the judgment mode is simple and easy.

As shown in fig. 5, a flowchart of embodiment 3 of an information processing method provided by the present application includes the following steps:

step S501: acquiring video information, wherein at least two frames of images of the video information comprise a target character image and a virtual content image;

step S501 is the same as step S101 in embodiment 1, and details are not described in this embodiment.

Step S502: taking each frame of the at least two frames of images as a target image in sequence;

step S503: analyzing the target image based on a pre-trained neural network model to obtain a target area meeting preset conditions in the target image;

wherein the target area is an area where the holographic screen is located.

Specifically, in a scene of recording a video, since the image acquisition angle range of the image acquisition module and the size of the holographic screen are generally fixed, and the relative position between the image acquisition module and the holographic screen can be changed, when the distance between the image acquisition module and the holographic screen is short, the holographic screen is larger than the image acquisition range, so that the holographic screen is fully distributed in a target image in the recorded video.

The neural network model is trained in advance based on the image of the area where the marked holographic screen is located, and the trained neural network model is obtained.

And taking each frame image in the video information as a target image, and inputting the target image into the trained neural network model so that the neural network model analyzes and identifies the target image to obtain a target area meeting preset conditions in the target image, namely determining the area of the holographic screen in the target image.

It should be noted that the pre-trained neural network model may be distributed over all or occupy a part of the area of the holographic screen in the target image.

The holographic screen is full of the target image, the image acquisition range of the image acquisition module is in the holographic screen, and the holographic screen occupies part of the target image, and the holographic screen can be partially overlapped with the image acquisition range of the image acquisition module or the area of the holographic screen is smaller than the image acquisition range of the image acquisition module.

Fig. 4 is a schematic diagram of a partial area of the holographic screen occupying the target image, which is not described in detail in this embodiment.

Step S504: and processing the target parameters of the target area.

Step 5304 is the same as step S103 in embodiment 1, and details are not repeated in this embodiment.

In summary, in an information processing method provided in this embodiment, analyzing whether a target area exists in at least two frames of images of the video information and meets a preset condition includes: taking each frame of the at least two frames of images as a target image in sequence; analyzing the target image based on a pre-trained neural network model to obtain a target area meeting preset conditions in the target image, wherein the target area is the area where the holographic screen is located. In the scheme, the target area in each frame of image is analyzed and determined based on the pre-trained neural network model, and the accuracy of analysis and determination is high.

As shown in fig. 6, a flowchart of embodiment 4 of an information processing method provided by the present application includes the following steps:

step S601: acquiring video information, wherein at least two frames of images of the video information comprise a target character image and a virtual content image;

step S602: taking each frame of the at least two frames of images as a target image in sequence;

step S603: analyzing the target image based on a pre-trained neural network model to obtain a target area meeting preset conditions in the target image;

steps S601 to 603 are the same as steps S501 to 503 in embodiment 3, and are not described in detail in this embodiment.

Step S604: analyzing based on a preset holographic screen image to obtain optical parameters of the holographic screen;

the preset holographic screen image is an image acquired in the same shooting environment when no content is displayed in the holographic screen and no target person exists behind the holographic screen.

The same shooting environment includes parameters related to each shooting environment, such as a shooting angle, an ambient light brightness, and the like.

The preset holographic screen analyzes to obtain optical parameters of the holographic screen, the optical parameters are parameters representing the transparency degree of the holographic screen, the value of the transparent parameters determines the direction and the amplitude value for adjusting each pixel value in the target area of the target image, and the amplitude value is a specific value for adjusting the pixel value.

Step S605: adjusting pixel values of the target area in the target image based on optical parameters of the holographic screen.

Specifically, the pixel value of the target area is adjusted based on the optical parameter of the holographic screen, and if the optical parameter is a transparency parameter of the holographic screen, the pixel value (RGB) of the target area may be correspondingly adjusted based on the transparency parameter, so that the color influence of the holographic screen on the target area is removed, and the saturation of the target area after adjustment is higher.

The recorded video information includes multiple frames of images, and the processing procedures of the steps S604 to S605 are performed on the target area of each frame of image, so that the semitransparent effect of the holographic screen is eliminated in the whole video.

In summary, in the information processing method provided in this embodiment, the processing the target parameter of the target area includes: analyzing based on a preset holographic screen image to obtain optical parameters of the holographic screen; adjusting pixel values of the target area in the target image based on optical parameters of the holographic screen. According to the scheme, the holographic screen image is shot in advance and analyzed to obtain the optical parameters of the holographic screen, the target area pixel value in the target image is adjusted based on the optical parameters, so that the influence of the holographic screen on the whole recorded video is reduced, the saturation of the adjusted target image is better, and the visual effect of the finally obtained video is better.

As shown in fig. 7, a flowchart of embodiment 5 of an information processing method provided by the present application includes the following steps:

step S701: acquiring video information, wherein at least two frames of images of the video information comprise a target character image and a virtual content image;

step S702: taking each frame of the at least two frames of images as a target image in sequence;

step S703: analyzing the target image based on a pre-trained neural network model to obtain a target area meeting preset conditions in the target image;

steps S701 to 703 are the same as steps S501 to 503 in embodiment 3, and are not described in detail in this embodiment.

Step S704: determining that a first region meeting a preset figure outline exists in the target region, and the first region contains a target figure image;

and judging whether the image of the person exists in the target area or not based on whether the area meeting the preset person outline exists in the target area or not.

When the target area has an area meeting the preset character outline, the area is determined to be a first area, and the first area contains the target character image.

The human images existing in the target area are all target human images.

Fig. 8 is a schematic diagram of a target image before processing, in which the target area 801 is full of the target image, and the target area includes a first area 802 containing a human image.

Step S705: analyzing the angle of the target character image in the first area, wherein the angles of the target character image in any two frames of images are the same or different;

and analyzing the character image in the target area to obtain the angles of the target character image, such as leftward, rightward and forward.

Specifically, during the process of capturing the video, the target person may have a motion change, and therefore, the angle of the target person image may change, and the angle of the target person image may be the same or different in any two images of the video.

Step S706: selecting a target image with the same angle as the angle in a preset three-dimensional character image of a target character;

the method comprises the steps of presetting a three-dimensional figure image for a target figure, and selecting a target image with the same angle as the target figure image from the preset three-dimensional figure image.

Wherein the angle includes the pose and orientation of the target person image.

Specifically, the three-dimensional character image is adjusted to a corresponding posture and direction based on the posture and direction of the target character image, a two-dimensional image corresponding to the posture and direction is determined, and the two-dimensional image is taken as the target image.

The selected target image is matched with the target character image, and the similarity of the selected target image and the target character image is high.

Step S707: and processing the first area based on the target image.

The processing mode includes superposition or replacement, and the like.

Specifically, the target image is superimposed to the first area in a way of adding a layer; or the target image replaces the content in the first area.

It should be noted that, because the target image is not subjected to the image of the semi-transparent holographic screen, the saturation degree is higher, and the first area is processed based on the target image, so that the display effect of the image of the target person in the first area is better.

It should be noted that, in the present application, because the recorded video information includes multiple frames of images, each frame of the image included in the recorded video information is analyzed, specifically, when there is a target person image in the frame of image, step 704 and step 707 in this embodiment are performed, so that the semitransparent influence of the holographic screen on the target person image is eliminated in the whole video.

In summary, in the information processing method provided in this embodiment, the processing the target parameter of the target area includes: determining that a first region meeting a preset figure outline exists in the target region, and the first region contains a target figure image; analyzing the angle of the target character image in the first area, wherein the angles of the target character image in any two frames of images are the same or different; selecting a target image with the same angle as the angle in a preset three-dimensional character image of a target character; and processing the first area based on the target image. According to the scheme, the three-dimensional figure image of the target figure is preset, the target image with the same angle as that of the target figure image in the first area is selected, and the first area is processed, so that the picture in the first area is not influenced by the semi-transparent image of the holographic screen, the influence of the holographic screen on the recorded target figure image in the video is reduced, and the display effect of the target figure in the first area is improved.

As shown in fig. 9, a flowchart of embodiment 6 of an information processing method provided by the present application includes the following steps:

step S901: acquiring at least two first images containing target character images from at least two shooting angles;

the method comprises the steps of shooting images of a target person from a plurality of shooting angles to obtain first images of the target person from all angles.

In a specific implementation, images of different motions or postures of the target person can be captured for each angle, so as to obtain images of different motions or postures adopted by the user at the angle.

Step S902: synthesizing a three-dimensional character image of the target character based on at least two first images and shooting angles corresponding to the first images;

and synthesizing the three-dimensional character image based on the shot images at all angles and corresponding shooting angles.

Specifically, the plurality of first images may be synthesized based on three-dimensional synthesis software to obtain a three-dimensional character image.

Since the three-dimensional character image corresponds to the target character, two-dimensional images of the target character can be acquired from various angles with respect to the three-dimensional character image.

The established three-dimensional character image can provide a basis for processing the first area corresponding to the target character image in the subsequent step.

Step S903: acquiring video information, wherein at least two frames of images of the video information comprise a target character image and a virtual content image;

step S904: taking each frame of the at least two frames of images as a target image in sequence;

step S905: analyzing the target image based on a pre-trained neural network model to obtain a target area meeting preset conditions in the target image;

step S906: determining that a first region meeting a preset figure outline exists in the target region, and the first region contains a target figure image;

step S907: analyzing the angle of the target character image in the first area, wherein the angles of the target character image in any two frames of images are the same or different;

step S908: selecting a target image with the same angle as the angle in a preset three-dimensional character image of a target character;

step S909: and processing the first area based on the target image.

Steps S903 to 909 are the same as steps S701 to 707 in embodiment 5, and are not described in detail in this embodiment.

In summary, the information processing method provided in this embodiment further includes: acquiring at least two first images containing target character images from at least two shooting angles; and synthesizing the three-dimensional character image of the target character based on at least two first images and the shooting angles corresponding to the first images. In the scheme, the three-dimensional figure image is established in advance, so that a plane image with any angle is selected from the three-dimensional figure image, and a basis is provided for processing the first area based on the target image.

As shown in fig. 10, a flowchart of embodiment 7 of an information processing method provided by the present application includes the following steps:

step S1001: acquiring video information, wherein at least two frames of images of the video information comprise a target character image and a virtual content image;

step S1002: taking each frame of the at least two frames of images as a target image in sequence;

step S1003: analyzing the target image based on a pre-trained neural network model to obtain a target area meeting preset conditions in the target image;

steps S1001 to 1003 are the same as steps S501 to 503 in embodiment 3, and details are not described in this embodiment.

Step S1004: analyzing the target area to obtain an image of virtual content, wherein the virtual content in any two frames of images is the same or different;

and analyzing each frame of image comprising the target area to determine whether the image comprises a virtual content image, wherein the area where the virtual content is located is a second area.

Specifically, the content in the target area of the target image may be analyzed to determine whether there is an image of non-real content or an image of content that does not satisfy real physical laws.

For example, the image is an animated character, or the image is an object floating in the air.

Specifically, it may also be determined whether the holographic screen displays content at the same time as the acquisition of the target image, if so, comparing the original virtual content image at the same time with the target image, determining whether the original virtual content image and the target image are the same or similar, and if so, determining that the corresponding content in the target area is an image of the virtual content.

It should be noted that in the present application, the analysis processing is performed for each frame of the image included in the video information, specifically, when the frame of the image has the virtual content, the steps S1004 to S1006 in the present embodiment are performed.

Step S1005: acquiring an original virtual content image corresponding to the virtual content;

wherein an original virtual content image corresponding to the virtual content is acquired from a processor controlling the playback of the holographic screen.

When the virtual content is an image, the image can be directly acquired; if the virtual content is a video or dynamic content, the virtual content playing time corresponding to the time can be selected based on the time of acquiring the target image in the video, and the original virtual content image output at the playing time is determined from the original virtual content data.

The original virtual content image is matched with the virtual content image, and the similarity of the original virtual content image and the virtual content image is higher.

Step S1006: and processing a second area where the virtual content image is located based on the original virtual content image.

The processing mode includes superposition or replacement, and the like.

Specifically, the original virtual content image is superimposed to the second area in a way of adding an image layer; or the original virtual content image replaces the content in the second area.

It should be noted that, because the original virtual content image is not subjected to the semi-transparent image of the holographic screen, and the saturation degree is higher, the second area is processed based on the original virtual content image, so that the display effect of the image of the virtual content in the second area is better.

Fig. 11 is a schematic diagram of a target image before processing, in which the target area 1101 is full of the target image, the target area includes a second area 1102, the second area includes virtual content, and the virtual content is represented by an apple in fig. 11.

It should be noted that, in the present application, because the recorded video information includes multiple frames of images, each frame of the image included in the recorded video information is analyzed, specifically, when there is a virtual content image in the frame of image, step 704 and step 707 in this embodiment are performed, so that the semitransparent influence of the holographic screen on the virtual content image is eliminated in the whole video.

In summary, in the information processing method provided in this embodiment, the processing the target parameter of the target area includes: analyzing the target area to obtain an image of virtual content, wherein the virtual content in any two frames of images is the same or different; acquiring an original virtual content image corresponding to the virtual content; and processing a second area where the virtual content image is located based on the original virtual content image. In the scheme, the original virtual content image is acquired, and the second area where the virtual content image in the target area is located is processed by the original virtual content image, so that the picture in the second area is not influenced by the semi-transparent image of the holographic screen, the influence of the holographic screen on the recorded virtual content image in the video due to the recording site is reduced, and the display effect of the virtual content is improved.

Corresponding to the embodiment of the information processing method provided by the application, the application also provides an embodiment of a device applying the information processing method.

As shown in fig. 12, which is a schematic structural diagram of an embodiment of an information processing apparatus provided in the present application, the electronic device includes the following structures: an acquisition module 1201, an analysis module 1202 and a processing module 1203;

the acquisition module 1201 is configured to acquire video information, where at least two frames of images of the video information include a target character image and a virtual content image, the virtual content image is acquired by an image acquisition device for virtual content displayed in a holographic screen, the holographic screen is disposed between a target character and the image acquisition device, the target character image is acquired by the image acquisition device through the holographic screen, and a light transmittance of the holographic screen is smaller than a preset value;

the analysis module 1202 is configured to analyze whether a target area exists in at least two frames of images of the video information and meets a preset condition;

the processing module 1203 is configured to process a target parameter of a target area based on that the target area in the at least two frames of images meets a preset condition.

Optionally, the analysis module is configured to:

sequentially selecting any frame image of the at least two frame images as a target image;

and determining that the area surrounded by the preset contour is a target area and the target area meets the preset condition based on the preset contour existing in the target image and the preset parameter values of the areas on two sides of the preset contour meeting the preset distinguishing condition, wherein the target area is the area where the holographic screen is located.

Optionally, the analysis module is configured to:

taking each frame of the at least two frames of images as a target image in sequence;

analyzing the target image based on a pre-trained neural network model to obtain a target area meeting preset conditions in the target image, wherein the target area is the area where the holographic screen is located.

Optionally, the processing module is configured to:

analyzing based on a preset holographic screen image to obtain optical parameters of the holographic screen;

adjusting pixel values of the target area in the target image based on optical parameters of the holographic screen.

Optionally, the processing module is configured to:

determining that a first region meeting a preset figure outline exists in the target region, and the first region contains a target figure image;

analyzing the angle of the target character image in the first area, wherein the angles of the target character image in any two frames of images are the same or different;

selecting a target image with the same angle as the angle in a preset three-dimensional character image of a target character;

and processing the first area based on the target image.

Optionally, the apparatus further comprises:

the system comprises a synthesis module, a first image acquisition module and a second image acquisition module, wherein the synthesis module is used for acquiring at least two first images containing target character images from at least two shooting angles; and synthesizing the three-dimensional character image of the target character based on at least two first images and the shooting angles corresponding to the first images.

Optionally, the processing module is configured to:

analyzing the target area to obtain an image of virtual content, wherein the virtual content in any two frames of images is the same or different;

acquiring an original virtual content image corresponding to the virtual content;

and processing a second area where the virtual content image is located based on the original virtual content image.

The functional explanation of each structure in the information processing apparatus in this embodiment refers to the explanation in the method embodiment, and is not described in detail in this embodiment.

In summary, the information processing apparatus provided in this embodiment includes: the system comprises an acquisition module, a display module and a control module, wherein the acquisition module is used for acquiring video information, at least two frames of images of the video information comprise a target character image and a virtual content image, the virtual content image is acquired by an image acquisition device for acquiring virtual content displayed in a holographic screen, the holographic screen is arranged between a target character and the image acquisition device, the target character image is acquired by the image acquisition device through the holographic screen, and the light transmittance of the holographic screen is smaller than a preset value; the analysis module is used for analyzing whether a target area in at least two frames of images of the video information meets a preset condition or not; and the processing module is used for processing the target parameters of the target area on the basis that the target area in the at least two frames of images meets a preset condition. According to the scheme, the holographic screen is arranged between the shot target character and the image acquisition device, virtual content is displayed in the holographic screen, the image acquisition device shoots the target character and the virtual content displayed in the holographic screen, and the target area meeting preset conditions in shot video information is processed, so that the influence of the semi-transparency of the holographic screen on each image in the video is reduced, the video quality is improved, and the user experience of watching the video is improved.

Corresponding to the embodiment of the information processing method provided by the application, the application also provides the electronic equipment and the readable storage medium corresponding to the information processing method.

Wherein, this electronic equipment includes: a memory, a processor;

wherein, the memorizer stores the information processing program;

the processor is configured to load and execute the information processing program stored in the memory to implement the steps of the information processing method according to any one of the above.

Specifically, the implementation control method of the electronic device may refer to the embodiment of the information processing method.

Wherein the readable storage medium has stored thereon a computer program, which is called and executed by a processor, implementing the steps of the information processing method according to any one of the preceding claims.

Specifically, the computer program stored in the readable storage medium executes the information processing method, and the information processing method embodiments described above may be referred to.

The embodiments in the present description are described in a progressive manner, each embodiment focuses on differences from other embodiments, and the same and similar parts among the embodiments are referred to each other. For the device provided by the embodiment, the description is relatively simple because the device corresponds to the method provided by the embodiment, and the relevant points can be referred to the method part for description.

The previous description of the provided embodiments is provided to enable any person skilled in the art to make or use the present application. Various modifications to these embodiments will be readily apparent to those skilled in the art, and the generic principles defined herein may be applied to other embodiments without departing from the spirit or scope of the application. Thus, the present application is not intended to be limited to the embodiments shown herein but is to be accorded the widest scope consistent with the principles and novel features provided herein.