阅读说明：本技术 基于汽车a柱的车载显示装置、方法、系统及存储介质 (Vehicle-mounted display device, method and system based on automobile A column and storage medium ) 是由 刘哲铭 张良诰 于 2020-04-26 设计创作，主要内容包括：本发明提供一种基于汽车A柱的车载显示装置,包括：第一显示屏与第二显示屏、第一摄像头与第二摄像头、第三摄像头与第四摄像头及数据处理设备,第三摄像头与第四摄像头用于采集驾驶员的人脸影像；数据处理设备用于根据人脸影像计算驾驶员头部扭动数据与人眼视野数据,并调整第三摄像头与第四摄像头的第一拍摄角度,以及调整第一摄像头与第二摄像头的第二拍摄角度；第一摄像头与第二摄像头用于采集车外景象；第一显示屏与第二显示屏用于显示车外景象。本发明还提供一种基于汽车A柱的车载显示方法、系统及存储介质。利用本发明,能够提高车载显示的能力。(The invention provides a vehicle-mounted display device based on an automobile A column, which comprises: the system comprises a first display screen, a second display screen, a first camera, a second camera, a third camera, a fourth camera and data processing equipment, wherein the third camera and the fourth camera are used for collecting face images of a driver; the data processing equipment is used for calculating head twisting data and human eye vision data of a driver according to the human face image, adjusting a first shooting angle of the third camera and the fourth camera, and adjusting a second shooting angle of the first camera and the second camera; the first camera and the second camera are used for collecting images outside the vehicle; the first display screen and the second display screen are used for displaying outside scenes. The invention also provides a vehicle-mounted display method, a vehicle-mounted display system and a storage medium based on the automobile A column. By using the invention, the vehicle-mounted display capability can be improved.)

1. An automobile A-pillar-based on-board display device, comprising: data processing equipment, a first display screen and a second display screen which are arranged on the inclined planes of the A columns at the two sides in the vehicle, a first camera and a second camera which are arranged on the A columns at the two sides outside the vehicle, the first camera and the second camera are used for collecting the outside scenes, the first display screen and the second display screen are used for displaying the outside scenes, it is characterized in that the vehicle-mounted display device also comprises a third camera and a fourth camera which are arranged on the inclined planes of the A columns at two sides in the vehicle and positioned at the tops of the first display screen and the second display screen, the first display screen and the second display screen, the first camera and the second camera, and the third camera and the fourth camera are all electrically connected with the data processing equipment, and the third camera and the fourth camera are used for collecting a face image of a driver; the data processing equipment is used for calculating head twisting data and human eye visual field data of a driver according to the human face image, adjusting a first shooting angle of the third camera and the fourth camera according to the head twisting data, and adjusting a second shooting angle of the first camera and the second camera according to the human eye visual field data.

2. The vehicle A-column-based vehicle-mounted display device as claimed in claim 1, wherein the first camera acquires a first vehicle exterior scene according to the human eye visual field data corresponding to the third camera, and displays the first vehicle exterior scene on the first display screen; and the second camera acquires a second vehicle exterior scene according to the human eye visual field data corresponding to the fourth camera, and displays the second vehicle exterior scene on the second display screen.

3. The method for displaying on the vehicle based on the vehicle A-pillar display device of any one of the claims 1 to 2, wherein the method for displaying on the vehicle based on the vehicle A-pillar display comprises:

when the data processing equipment receives a starting instruction, controlling the third camera and the fourth camera to collect the face image of the driver;

calculating head wiggling data of the driver according to the face image;

adjusting a first shooting angle of the third camera and the fourth camera according to the head twisting data so as to acquire a target face image of the driver;

determining the eye position in the target face image, and calculating the eye vision data of the driver according to the eye position;

adjusting a second shooting angle of the first camera and the second camera according to the human eye vision data so as to acquire a first vehicle exterior scene and a second vehicle exterior scene;

and respectively displaying the first outside scene and the second outside scene on the first display screen and the second display screen.

4. The vehicle-mounted display method based on the automobile A column as claimed in claim 3, wherein the determining the human eye position in the target human face image and calculating the human eye vision data of the driver according to the human eye position comprises:

calling a preset face detection algorithm to detect the face position of each frame of image in the target face image to obtain a face region image;

positioning the positions of human eyes in the human face area image;

acquiring pupil positions of the human eyes according to the human eye positions, and calculating eye movement track parameters corresponding to the pupil positions of each frame;

and calculating the visual field data of the driver according to the eye movement track parameters.

5. The vehicle A-pillar based display method of claim 4, wherein after obtaining the face area image, the method further comprises:

traversing a preset human face image database according to the human face area image to determine target driving data;

and adjusting the display angle of the column A of the automobile according to the target driving data.

6. The vehicle-mounted display method based on the automobile A column as claimed in claim 3, wherein the adjusting the first shooting angle of the third camera and the fourth camera according to the head wiggling data to collect the target face image of the driver comprises:

acquiring the current shooting angle of the third camera and the fourth camera;

determining preset head wiggling data corresponding to the current shooting angle according to a mapping relation between the preset shooting angle and the head wiggling data;

detecting whether the head wriggling data exceeds preset head wriggling data;

when the detection result is that the head twisting data exceed the preset head twisting data, calculating a head twisting difference value of the head twisting data and the preset head twisting data;

and adjusting a first shooting angle of the third camera and the fourth camera according to the head twisting difference value.

7. The vehicle a-pillar based on-board display method of claim 3, wherein before displaying the first off-board view and the second off-board view on the first display screen and the second display screen, respectively, the method further comprises:

acquiring the human eye visual field data;

determining the data of the blind area outside the vehicle caused by the column A in the vehicle according to the human eye visual field data;

determining a third shooting angle according to the vehicle outer blind area data;

respectively acquiring a first target vehicle exterior scene and a second target vehicle exterior scene corresponding to the third shooting angle in the first vehicle exterior scene and the second vehicle exterior scene;

and respectively displaying the first target vehicle exterior scene and the second target vehicle exterior scene on the first display screen and the second display screen.

8. The vehicle-mounted display method based on the automobile A column is characterized in that after the third camera and the fourth camera are controlled to collect the face image of the driver, the method further comprises the following steps:

calling a preset face detection algorithm to detect whether a face image has a face region image;

when the detection result is that the face image has a face region image, acquiring the face region image;

detecting whether the human eye position is contained in the human face area image;

when the detection result is that the human eye position is not contained in the human face region image, determining a target camera group corresponding to the human face image not containing the human eye position;

and calling the target camera group to acquire the scene of the current shooting angle.

9. An automobile A-pillar based vehicle-mounted display system, which is characterized by comprising:

the human face image acquisition module is used for controlling the third camera and the fourth camera to acquire the human face image of the driver when the data processing equipment receives a starting instruction;

the head data calculation module is used for calculating the head wiggling data of the driver according to the face image;

the target face acquisition module is used for adjusting a first shooting angle of the third camera and the fourth camera according to the head twisting data so as to acquire a target face image of the driver;

the visual field data calculation module is used for determining the positions of human eyes in the target human face image and calculating the human eye visual field data of the driver according to the positions of the human eyes;

the vehicle exterior scene acquisition module is used for adjusting a second shooting angle of the first camera and the second camera according to the human eye visual field data so as to acquire a first vehicle exterior scene and a second vehicle exterior scene;

and the vehicle exterior scene display module is used for respectively displaying the first vehicle exterior scene and the second vehicle exterior scene on the first display screen and the second display screen.

10. A computer-readable storage medium, on which a computer program is stored, which, when being executed by a processor, carries out the steps of the method for displaying on-board a-pillar based on a vehicle as claimed in any one of claims 3 to 8.

Technical Field

The invention relates to the technical field of automobile safety, in particular to an automobile A-pillar-based vehicle-mounted display device, method, system and storage medium.

Background

Due to the limitation of the automobile structure, the automobile has a plurality of blind areas. Due to the existence of the blind area, the driver cannot see pedestrians, other vehicles, obstacles or other animals in the blind area, and accidents and dangerous cases are caused. Particularly, the automobile A column is positioned in front of the automobile, and relatively more accidents and dangerous cases are caused by blind areas formed by the automobile A column; on the other hand, based on the consideration of safety, the strength of the A column is very high, the corresponding volume is also large, the blocking of the sight is more serious, and the driving safety is seriously influenced.

The existing perspective A column technology mainly adopts a mode of embedding a screen in an automobile A column and combining an outer camera, the outer camera mainly adopts a camera with a fixed angle to shoot images outside the automobile, and the images outside the automobile are displayed on the embedded screen. However, the blind area of the visual field caused by the column A of the automobile is different because the head of the driver is twisted differently in the actual driving process. If the camera of fixed angle can't satisfy the outer scene of car of different field of vision blind areas and shoot to reduce on-vehicle display ability.

Disclosure of Invention

In view of the above, it is necessary to provide an on-vehicle display device based on an automobile a-pillar, an on-vehicle display method based on an automobile a-pillar, an on-vehicle display system based on an automobile a-pillar, and a storage medium, aiming at solving the technical problem of low on-vehicle display capability based on an automobile a-pillar.

The embodiment of the invention provides a vehicle-mounted display device based on an A column of an automobile, which comprises: data processing equipment, a first display screen and a second display screen which are arranged on the inclined planes of the A columns at the two sides in the vehicle, a first camera and a second camera which are arranged on the A columns at the two sides outside the vehicle, the first camera and the second camera are used for collecting the outside scenes, the first display screen and the second display screen are used for displaying the outside scenes, the vehicle-mounted display device also comprises a third camera and a fourth camera which are arranged on the inclined planes of the A columns at two sides in the vehicle and positioned at the tops of the first display screen and the second display screen, the first display screen and the second display screen, the first camera and the second camera, and the third camera and the fourth camera are all electrically connected with the data processing equipment, and the third camera and the fourth camera are used for collecting a face image of a driver; the data processing equipment is used for calculating head twisting data and human eye visual field data of a driver according to the human face image, adjusting a first shooting angle of the third camera and the fourth camera according to the head twisting data, and adjusting a second shooting angle of the first camera and the second camera according to the human eye visual field data.

Further, in the vehicle-mounted display device based on the a pillar of the automobile provided in the embodiment of the present invention, the first camera acquires a first vehicle exterior scene according to the human eye visual field data corresponding to the third camera, and displays the first vehicle exterior scene on the first display screen; and the second camera acquires a second vehicle exterior scene according to the human eye visual field data corresponding to the fourth camera, and displays the second vehicle exterior scene on the second display screen.

A second aspect of the embodiments of the present invention provides a method for vehicle-mounted display based on the vehicle-mounted display device based on the vehicle pillar a of any one of the above, where the method for vehicle-mounted display based on the vehicle pillar a includes:

when the data processing equipment receives a starting instruction, controlling the third camera and the fourth camera to collect the face image of the driver;

calculating head wiggling data of the driver according to the face image;

adjusting a first shooting angle of the third camera and the fourth camera according to the head twisting data so as to acquire a target face image of the driver;

determining the eye position in the target face image, and calculating the eye vision data of the driver according to the eye position;

adjusting a second shooting angle of the first camera and the second camera according to the human eye vision data so as to acquire a first vehicle exterior scene and a second vehicle exterior scene;

and respectively displaying the first outside scene and the second outside scene on the first display screen and the second display screen.

Further, in the vehicle-mounted display method based on the automobile a-pillar provided in the embodiment of the present invention, the determining the eye position in the target face image, and calculating the eye field data of the driver according to the eye position includes:

calling a preset face detection algorithm to detect the face position of each frame of image in the target face image to obtain a face region image;

positioning the positions of human eyes in the human face area image;

acquiring pupil positions of the human eyes according to the human eye positions, and calculating eye movement track parameters corresponding to the pupil positions of each frame;

and calculating the visual field data of the driver according to the eye movement track parameters.

Further, in the above vehicle-mounted display method based on the a pillar of the automobile provided in the embodiment of the present invention, after the obtaining of the face area image, the method further includes:

traversing a preset human face image database according to the human face area image to determine target driving data;

and adjusting the display angle of the column A of the automobile according to the target driving data.

Further, in the above vehicle-mounted display method based on the a pillar of the vehicle provided in the embodiment of the present invention, the adjusting the first shooting angle of the third camera and the fourth camera according to the head twisting data to acquire the target face image of the driver includes:

acquiring the current shooting angle of the third camera and the fourth camera;

determining preset head wiggling data corresponding to the current shooting angle according to a mapping relation between the preset shooting angle and the head wiggling data;

detecting whether the head wriggling data exceeds preset head wriggling data;

when the detection result is that the head twisting data exceed the preset head twisting data, calculating a head twisting difference value of the head twisting data and the preset head twisting data;

and adjusting a first shooting angle of the third camera and the fourth camera according to the head twisting difference value.

Further, in the above vehicle-mounted display method based on a pillar of an automobile according to an embodiment of the present invention, before the displaying the first exterior view and the second exterior view on the first display screen and the second display screen, respectively, the method further includes:

acquiring the human eye visual field data;

determining the data of the blind area outside the vehicle caused by the column A in the vehicle according to the human eye visual field data;

determining a third shooting angle according to the vehicle outer blind area data;

respectively acquiring a first target vehicle exterior scene and a second target vehicle exterior scene corresponding to the third shooting angle in the first vehicle exterior scene and the second vehicle exterior scene;

and respectively displaying the first target vehicle exterior scene and the second target vehicle exterior scene on the first display screen and the second display screen.

Further, in the above vehicle-mounted display method based on the a pillar of the automobile provided in the embodiment of the present invention, after the controlling the third camera and the fourth camera to collect the face image of the driver, the method further includes:

calling a preset face detection algorithm to detect whether a face image has a face region image;

when the detection result is that the face image has a face region image, acquiring the face region image;

detecting whether the human eye position is contained in the human face area image;

when the detection result is that the human eye position is not contained in the human face region image, determining a target camera group corresponding to the human face image not containing the human eye position;

and calling the target camera group to acquire the scene of the current shooting angle.

The third aspect of the embodiments of the present invention further provides an automobile a-pillar based vehicle-mounted display system, where the automobile a-pillar based vehicle-mounted display system includes:

the human face image acquisition module is used for controlling the third camera and the fourth camera to acquire the human face image of the driver when the data processing equipment receives a starting instruction;

the head data calculation module is used for calculating the head wiggling data of the driver according to the face image;

the target face acquisition module is used for adjusting a first shooting angle of the third camera and the fourth camera according to the head twisting data so as to acquire a target face image of the driver;

the visual field data calculation module is used for determining the positions of human eyes in the target human face image and calculating the human eye visual field data of the driver according to the positions of the human eyes;

the vehicle exterior scene acquisition module is used for adjusting a second shooting angle of the first camera and the second camera according to the human eye visual field data so as to acquire a first vehicle exterior scene and a second vehicle exterior scene;

and the vehicle exterior scene display module is used for respectively displaying the first vehicle exterior scene and the second vehicle exterior scene on the first display screen and the second display screen.

The fourth aspect of the embodiments of the present invention also provides a computer-readable storage medium, on which a computer program is stored, where the computer program, when executed by a processor, implements the steps of any one of the above-mentioned automobile a-pillar based on-board display methods.

The embodiment of the invention provides a vehicle-mounted display device based on an automobile A column, a vehicle-mounted display method based on the automobile A column, a vehicle-mounted display system based on the automobile A column and a computer readable storage medium, and by using the vehicle-mounted display device and the vehicle-mounted display system, the shooting angle of a camera in a vehicle is adjusted according to the head twisting condition of a driver in the driving process, so that the face image acquisition accuracy can be improved; the positions of human eyes are determined according to the human face images, so that the accuracy of identifying the positions of the human eyes can be improved, and the accuracy of calculating the visual field data of the human eyes is improved; in addition, the shooting angle of the camera outside the vehicle is adjusted according to the human eye vision data, and the most appropriate shooting angle can be selected for different human eye blind areas, so that the vehicle-mounted display capability is improved.

Drawings

Fig. 1 is a schematic diagram of an on-board display device based on an a-pillar of an automobile according to an embodiment of the present invention.

Fig. 2 is a flowchart of an automobile a-pillar-based on-board display method according to an embodiment of the present invention.

Fig. 3 is a schematic structural diagram of a computer device according to an embodiment of the present invention.

FIG. 4 is an exemplary functional block diagram of the computer device shown in FIG. 3.

The following detailed description will further illustrate the invention in conjunction with the above-described figures.

Description of the main elements

Detailed Description

In order that the above objects, features and advantages of the present invention can be more clearly understood, a detailed description of the present invention will be given below with reference to the accompanying drawings and specific embodiments. It should be noted that the embodiments and features of the embodiments of the present application may be combined with each other without conflict.

In the following description, numerous specific details are set forth to provide a thorough understanding of the present invention, and the described embodiments are a part, but not all, of the present invention. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.

Unless defined otherwise, all technical and scientific terms used herein have the same meaning as commonly understood by one of ordinary skill in the art to which this invention belongs. The terminology used in the description of the invention herein is for the purpose of describing particular embodiments only and is not intended to be limiting of the invention.

Referring to fig. 1, an embodiment of the present invention provides an on-vehicle display device based on an a pillar of an automobile, including: the data processing device (not shown), the first display screen 202 and the second display screen (not shown) installed on the inclined plane of the automobile A-pillar 204 on the two sides in the automobile, and the first camera 201 and the second camera (not shown) installed on the automobile A-pillar 204 on the two sides outside the automobile. The vehicle-mounted display device 200 based on the automobile A column further comprises a third camera 203 and a fourth camera (not shown in the figure), wherein the third camera 203 and the fourth camera are arranged on the inclined plane of the A column on two sides in the automobile and are positioned at the tops of the first display screen and the second display screen. The first display screen 202 and the second display screen, the first camera 201 and the second camera, and the third camera 203 and the fourth camera are all electrically connected with the data processing device, the data processing device stores an algorithm corresponding to the device, and the data processing device executes data processing through an algorithm program. The first camera 201 and the second camera may also be disposed on the rearview mirrors on two sides of the automobile, and their positions are not particularly limited.

Specifically, the data processing device is configured to calculate head wiggling data, human eye vision data, and driving data of the driver according to the face images acquired by the third camera 203 and the fourth camera; the data processing device may be configured to adjust a first shooting angle of the third camera 203 and the fourth camera according to the head wiggling data; the data processing device can be used for adjusting a second shooting angle of the first camera 201 and the second camera according to the human eye vision field data; the data processing device may also be used to adjust the display angle of the automobile a-pillar 204 based on the driving data. Wherein, first camera 201, second camera, third camera 203, fourth camera, first display screen 202 and second display screen homoenergetic can rotate at the arbitrary angle in space, and the clear image of arbitrary angle can all be observed to different drivers to this design, has strengthened the suitability of this set of device.

In at least one embodiment of the present invention, the third camera 203 and the fourth camera are used for acquiring a face image of a driver, and the first camera 201 and the second camera are used for acquiring a scene outside a vehicle; the first display screen 202 and the second display screen are used for displaying the scene outside the vehicle. Specifically, the first camera 201 acquires a first vehicle exterior scene according to the human eye visual field data corresponding to the third camera 203, and displays the first vehicle exterior scene on the first display screen 202; and the second camera acquires a second vehicle exterior scene according to the human eye visual field data corresponding to the fourth camera, and displays the second vehicle exterior scene on the second display screen.

The embodiment of the invention provides a vehicle-mounted display device 200 based on an automobile A column, which can adjust the shooting angle of a camera in an automobile according to the head twisting condition of a driver in the driving process, and can improve the acquisition accuracy of the acquired face image; the positions of human eyes are determined according to the human face images, so that the accuracy of identifying the positions of the human eyes can be improved, and the accuracy of calculating the visual field data of the human eyes is improved; in addition, the shooting angle of the camera outside the vehicle is adjusted according to the human eye vision data, and the most appropriate shooting angle can be selected for different human eye blind areas, so that the vehicle-mounted display capability is improved; finally, the display angle of the automobile A column 204 is adjusted according to the driving data, and the display angle can be adjusted according to the heights and body types of different drivers and the positions of human eyes when the automobile is normally opened, so that the drivers can observe clear pictures and master road conditions at any time, and the universality of the device is improved.

Fig. 2 is a flowchart of an automobile a-pillar-based on-board display method according to an embodiment of the present invention. The vehicle-mounted display method based on the automobile A column is based on the vehicle-mounted display device 200 based on the automobile A column, the vehicle-mounted display method based on the automobile A column is applied to data processing equipment, and as shown in fig. 2, the vehicle-mounted display method based on the automobile A column comprises the following steps:

and S21, when the data processing equipment receives a starting instruction, controlling the third camera and the fourth camera to collect the face image of the driver.

In at least one embodiment of the present invention, the opening instruction may include an instruction output by a driver (e.g., a voice input, a touch input, etc.), a driving instruction of a vehicle (i.e., a starting instruction of the vehicle), and the like, which are not limited herein. When the data processing device receives a start instruction, the third camera 203 and the fourth camera can be controlled to simultaneously acquire the face image of the driver.

In at least one embodiment of the present invention, after the controlling the third camera 203 and the fourth camera to capture the facial image of the driver, the method further includes: calling a preset face detection algorithm to detect whether a face image has a face region image; when the detection result is that the face image has a face region image, acquiring the face region image; detecting whether the human eye position is contained in the human face area image; when the detection result is that the human eye position is not contained in the human face region image, determining a target camera group corresponding to the human face image not containing the human eye position; and calling the target camera group to acquire the scene of the current shooting angle. It can be understood that when the detection result is that the human eye position is not included in the human face region image, the driver observation sight cannot be detected, that is, the driver sight is not blocked by an obstacle, at this time, the corresponding target camera group can acquire images at a fixed angle, and the corresponding display screen also displays the vehicle exterior environment information at the fixed angle.

In at least one embodiment of the present invention, a preset face detection algorithm is called to detect a face region image in the face image and detect a human eye position in the face region image. The preset face detection algorithm is pre-trained by a terminal, and may include a setaface detection algorithm, where the setaface detection algorithm is an automatic face recognition algorithm based on C + + language, and may include: a FaceDetection face detection module and a FaceAlignment feature point positioning module. Specifically, face detection is performed by FaceDetection to obtain a rectangular frame including the whole face, that is, a face region of interest of each frame. Then, two feature points of the centers of the two eyes of the human face are positioned by using FaceAlignment, and the coordinates of the centers of the two eyes of each frame are obtained.

In at least one embodiment of the present invention, after the obtaining the face region image, the method further includes: traversing a preset human face image database according to the human face area image to determine target driving data; and adjusting the display angle of the A column 204 of the automobile according to the target driving data. The preset face image database comprises a face area image and driving data corresponding to the face image, and the driving data can be the height and the body shape of a driver, the positions of eyes of the driver when the driver is normally on, and the like. The display angle of the automobile A column 204 is adjusted according to the driving data, and the adjustment can be performed according to the heights and body types of different drivers and the positions of human eyes when the automobile is normally opened, so that the drivers can observe clear pictures and master road conditions at any time, and the universality of the device is improved.

And S22, calculating the head wiggling data of the driver according to the face image.

In at least one embodiment of the present invention, the calculating the head twisting data of the driver according to the face image includes: acquiring first coordinate information of a preset face key point in a current video frame; acquiring second coordinate information of the same preset human face key point of the previous video frame; and calculating the head twisting data of the driver according to the first coordinate information and the second coordinate information.

Wherein the preset face key points may include one or a combination of more than one of the following: eyebrow key points, nose key points, eye key points, and mouth key points. In one embodiment, the number of the eyebrow key points is 10, and the corresponding numbers are 1-10 respectively; the number of the nose key points is 9, and the corresponding numbers are 11-19 respectively; the number of the eye key points is 12, and the corresponding serial numbers are 20-31 respectively; the number of the key points of the mouth is 20, and the corresponding numbers are respectively 32-51. The coordinate information includes 2D coordinate information and 3D coordinate information, the 2D coordinate information may be 2D coordinate information of a preset face key point in a video frame coordinate system, and the 3D coordinate information may be 3D coordinate information of the preset face key point in a camera coordinate system.

And S23, adjusting a first shooting angle of the third camera and the fourth camera according to the head twisting data so as to acquire a target face image of the driver.

In the actual driving process, the head of the driver can twist according to driving habits, current road conditions and other information, so that the driver can master the road condition information at any time. In the process of twisting the head of the driver, if the third camera 203 and the fourth camera always keep fixed shooting angles (each shooting angle corresponds to the optimal acquisition range of the camera) to acquire the face image, the problem that the acquired face image is not clear and the like may be caused, so that the visual field range of human eyes cannot be normally confirmed, and the vehicle-mounted display capability is reduced. Therefore, the vehicle-mounted display method based on the automobile A column can adjust the shooting angle according to the head twisting data, so that a camera for shooting the face image is in the optimal collection range.

In at least one embodiment of the present invention, the adjusting the first shooting angle of the third camera 203 and the fourth camera according to the head twisting data to acquire the target face image of the driver includes: acquiring the current shooting angle of the third camera 203 and the fourth camera; determining preset head wiggling data corresponding to the current shooting angle according to a mapping relation between the preset shooting angle and the head wiggling data; detecting whether the head wriggling data exceeds preset head wriggling data; when the detection result is that the head twisting data exceed the preset head twisting data, calculating a head twisting difference value of the head twisting data and the preset head twisting data; and adjusting a first shooting angle of the third camera 203 and the fourth camera according to the head twisting difference.

The mapping relation between the shooting angle and the head wiggling data is preset, when the detection result is that the head wiggling data exceeds the preset head wiggling data, the face image of the part exceeding the preset head wiggling data cannot be shot clearly by the camera at the current shooting angle, and therefore the shooting angle of the camera needs to be adjusted to improve the definition of the face image.

And S24, determining the positions of the human eyes in the target human face image, and calculating the human eye visual field data of the driver according to the positions of the human eyes.

In at least one embodiment of the present invention, the determining the eye position in the target face image and calculating the eye vision data of the driver according to the eye position includes: calling a preset face detection algorithm to detect the face position of each frame of image in the target face image to obtain a face region image; positioning the positions of human eyes in the human face area image; acquiring pupil positions of the human eyes according to the human eye positions, and calculating eye movement track parameters corresponding to the pupil positions of each frame; and calculating the visual field data of the driver according to the eye movement track parameters.

In at least one embodiment of the present invention, the method for locating positions of human eyes in the face region image may include: and determining the position of the human eye by adopting gray scale integral projection or by adopting a template matching method. The method comprises the steps that the position of human eyes is determined by adopting gray scale integral projection, after a human face area is accurately positioned, according to the distribution of facial organs of a human face, the human eyes are positioned at the upper half part of the face, and the upper half part of the human face area is firstly intercepted for processing; the gray value of the eye part in the image of the human face area is usually smaller than that of the surrounding area, and the feature is used for positioning the eyes by using an integral projection method. Determining the position of human eyes by adopting a template matching method, wherein the size of an image S to be searched is defined as W in width and H in height, the size of a template T is defined as M in width and N in height, a subgraph which has similar size, square and image with the template T is searched in the image S to be searched through a template matching algorithm, and the coordinate position of the subgraph is determined.

S25, adjusting a second shooting angle of the first camera and the second camera according to the human eye vision field data to acquire a first vehicle exterior scene and a second vehicle exterior scene.

In at least one embodiment of the present invention, the first off-board view and the second off-board view include off-board views of the line-of-sight blind to the driver by the automobile a-pillar 204, as well as other views. It can be understood that the shooting angle of the camera outside the vehicle is adjusted according to the human eye visual field data, the most appropriate shooting angle can be selected according to different human eye blind areas, and therefore the vehicle-mounted display capacity is improved.

S26, displaying the first outside scene and the second outside scene on the first display screen and the second display screen respectively.

In at least one embodiment of the present invention, the first display screen 202 and the second display screen are respectively used for displaying the outside scenes shot by the first camera 201 and the second camera, and preferably, the first display screen 202 and the second display screen only display the outside scenes corresponding to the sight blind zone of the a-pillar 204 of the automobile to the driver, so as to ensure that the road condition information watched by the driver through the front windshield and the road condition information displayed by the first display screen 202 and the second display screen are continuous and have no overlapping part, thereby ensuring that the images observed by the driver through the front windshield, the first display screen 202 and the second display screen are real road condition information.

Specifically, before the displaying the first off-board view and the second off-board view on the first display screen 202 and the second display screen, respectively, the method further comprises: acquiring the human eye visual field data; determining the data of the blind area outside the vehicle caused by the column A204 in the vehicle according to the human eye vision data; determining a third shooting angle according to the vehicle outer blind area data; respectively acquiring a first target vehicle exterior scene and a second target vehicle exterior scene corresponding to the third shooting angle in the first vehicle exterior scene and the second vehicle exterior scene; displaying the first target vehicle-exterior view and the second target vehicle-exterior view on the first display screen 202 and the second display screen, respectively. And the third shooting angle is a shooting angle corresponding to the blind area data outside the vehicle.

The embodiment of the invention provides a vehicle-mounted display method based on an automobile A column, which comprises the following steps: when the data processing equipment receives a starting instruction, controlling the third camera 203 and the fourth camera to collect a face image of a driver; calculating head wiggling data of the driver according to the face image; adjusting a first shooting angle of the third camera 203 and the fourth camera according to the head twisting data to acquire a target face image of the driver; determining the eye position in the target face image, and calculating the eye vision data of the driver according to the eye position; adjusting a second shooting angle of the first camera 201 and the second camera according to the human eye vision data to acquire a first vehicle exterior scene and a second vehicle exterior scene; displaying the first exterior view and the second exterior view on the first display 202 and the second display, respectively. By utilizing the method and the device, the shooting angle of the camera in the vehicle is adjusted according to the head twisting condition of the driver in the driving process, so that the acquisition accuracy of the acquired face image can be improved; the positions of human eyes are determined according to the human face images, so that the accuracy of identifying the positions of the human eyes can be improved, and the accuracy of calculating the visual field data of the human eyes is improved; in addition, the shooting angle of the camera outside the vehicle is adjusted according to the human eye vision data, and the most appropriate shooting angle can be selected for different human eye blind areas, so that the vehicle-mounted display capability is improved.

The above is a detailed description of the method provided by the embodiments of the present invention. The order of execution of the blocks in the flowcharts shown may be changed, and some blocks may be omitted, according to various needs. The following describes a computer device 1 provided by an embodiment of the present invention.

Fig. 3 is a schematic structural diagram of a computer device according to an embodiment of the present invention, and as shown in fig. 3, the computer device 1 includes a memory 10, and the in-vehicle display system 100 based on the a pillar of the automobile is stored in the memory 10. The computer device 1 may be an electronic device having functions of data processing, analysis, program execution, display, and the like, such as a computer, a tablet computer, and a personal digital assistant. The vehicle-mounted display system 100 based on the automobile a pillar can control the third camera 203 and the fourth camera to collect the face image of the driver when the data processing device receives a starting instruction; calculating head wiggling data of the driver according to the face image; adjusting a first shooting angle of the third camera 203 and the fourth camera according to the head twisting data to acquire a target face image of the driver; determining the eye position in the target face image, and calculating the eye vision data of the driver according to the eye position; adjusting a second shooting angle of the first camera 201 and the second camera according to the human eye vision data to acquire a first vehicle exterior scene and a second vehicle exterior scene; displaying the first exterior view and the second exterior view on the first display 202 and the second display, respectively. By utilizing the method and the device, the shooting angle of the camera in the vehicle is adjusted according to the head twisting condition of the driver in the driving process, so that the acquisition accuracy of the acquired face image can be improved; the positions of human eyes are determined according to the human face images, so that the accuracy of identifying the positions of the human eyes can be improved, and the accuracy of calculating the visual field data of the human eyes is improved; in addition, the shooting angle of the camera outside the vehicle is adjusted according to the human eye vision data, and the most appropriate shooting angle can be selected for different human eye blind areas, so that the vehicle-mounted display capability is improved.

In this embodiment, the computer device 1 may further include a display screen 20 and a processor 30. The memory 10 and the display screen 20 can be electrically connected with the processor 30 respectively.

The memory 10 may be of different types of memory devices for storing various types of data. For example, the memory and the internal memory of the computer device 1 may be used, and the memory Card may be a memory Card that is externally connected to the computer device 1, such as a flash memory, an SM Card (Smart Media Card), an SD Card (Secure Digital Card), and the like. Further, the memory 10 may include a non-volatile memory, such as a hard disk, a memory, a plug-in hard disk, a Smart Media Card (SMC), a Secure Digital (SD) Card, a Flash memory Card (Flash Card), at least one magnetic disk storage device, a Flash memory device, or other non-volatile solid state storage device. The memory 10 is used to store various types of data, for example, various types of application programs (Applications) installed in the computer device 1, data set and acquired by applying the above-described in-vehicle display method based on the a pillar of the automobile, and the like.

A display screen 20 is mounted to the computer apparatus 1 for displaying information.

The processor 30 is used for executing the vehicle-mounted display method based on the automobile A-pillar and various types of software installed in the computer device 1, such as an operating system, application display software and the like. The processor 30 includes, but is not limited to, a Central Processing Unit (CPU), a Micro Controller Unit (MCU), and other devices for interpreting computer instructions and Processing data in computer software.

The automotive a-pillar based in-vehicle display system 100 may include one or more modules stored in the memory 10 of the computer device 1 and configured to be executed by one or more processors (in this embodiment, one processor 30) to implement the embodiment of the present invention. For example, referring to fig. 4, the vehicle-mounted display system 100 based on the a-pillar of the automobile may include a face image acquisition module 101, a head data calculation module 102, a target face acquisition module 103, a visual field data calculation module 104, a vehicle exterior scene acquisition module 105, and a vehicle exterior scene display module 106. The modules referred to in the embodiments of the present invention may be program segments that perform a specific function, and are more suitable than programs for describing the execution process of software in the processor 30.

It is understood that, corresponding to the embodiments of the above-mentioned vehicle a-pillar based on-board display method, the vehicle a-pillar based on-board display system 100 may include some or all of the functional modules shown in fig. 4, and the functions of the modules will be described in detail below. It should be noted that the same noun and its specific explanation in the above embodiments of the vehicle-mounted display method based on the a pillar of the automobile can also be applied to the following functional description of each module. For brevity and to avoid repetition, further description is omitted.

The face image collection module 101 may be configured to control the third camera 203 and the fourth camera to collect a face image of the driver when the data processing device receives a start instruction.

The head data calculation module 102 may be configured to calculate head wiggling data of the driver according to the facial image.

The target face acquisition module 103 may be configured to adjust a first shooting angle of the third camera 203 and the fourth camera according to the head twisting data, so as to acquire a target face image of the driver.

The visual field data calculation module 104 may be configured to determine a position of human eyes in the target face image, and calculate human eye visual field data of the driver according to the position of human eyes.

The vehicle exterior scene acquisition module 105 may be configured to adjust a second shooting angle of the first camera 201 and the second camera according to the human eye field of view data, so as to acquire a first vehicle exterior scene and a second vehicle exterior scene.

The off-board-view display module 106 may be configured to display the first off-board view and the second off-board view on the first display screen 202 and the second display screen, respectively.

The embodiment of the present invention further provides a computer-readable storage medium, on which a computer program is stored, where the computer program, when executed by the processor 30, implements the steps of the vehicle-mounted display method based on the a pillar of the automobile in any one of the above embodiments.

The vehicle a-pillar based on-board display system 100/computer device 1/computer device integrated module/unit may be stored in a computer readable storage medium if it is implemented in the form of a software functional unit and sold or used as a separate product. Based on such understanding, all or part of the flow in the method according to the above embodiments may be implemented by a computer program, which may be stored in a computer readable storage medium and used by the processor 30 to implement the steps of the above method embodiments. Wherein the computer program comprises computer program code, which may be in the form of source code, object code, an executable file or some intermediate form, etc. The computer-readable storage medium may include: any entity or device capable of carrying the computer program code, recording medium, U disk, removable hard disk, magnetic disk, optical disk, computer Memory, Read-Only Memory (ROM), or the like.

The Processor 30 may be a Central Processing Unit (CPU), other general purpose Processor, a Digital Signal Processor (DSP), an Application Specific Integrated Circuit (ASIC), a Field Programmable Gate Array (FPGA) or other Programmable logic device, discrete Gate or transistor logic device, discrete hardware component, or the like. The general-purpose processor may be a microprocessor or the processor may be any conventional processor, etc., and the processor 30 is a control center of the vehicle a-pillar based on-board display system 100/computer device 1, and various interfaces and lines are used to connect various parts of the whole vehicle a-pillar based on-board display system 100/computer device 1.

The memory 10 is used for storing the computer programs and/or modules, and the processor 30 implements various functions of the vehicle a-pillar based on-board display system 100/computer device 1 by operating or executing the computer programs and/or modules stored in the memory 10 and calling data stored in the memory 10. The memory 10 may mainly include a storage program area and a storage data area, wherein the storage program area may store an operating system, an application program required by at least one function (such as a sound playing function, an image playing function, etc.), and the like; the storage data area may store data (such as audio data) created according to the use of the computer apparatus 1, and the like.

In the several embodiments provided in the present invention, it should be understood that the disclosed computer apparatus and method may be implemented in other ways. For example, the system embodiments described above are merely illustrative, and for example, the division of the modules is only one logical functional division, and other divisions may be realized in practice.

It will be evident to those skilled in the art that the embodiments of the present invention are not limited to the details of the foregoing illustrative embodiments, and that the embodiments of the present invention are capable of being embodied in other specific forms without departing from the spirit or essential attributes thereof. The present embodiments are therefore to be considered in all respects as illustrative and not restrictive, the scope of the embodiments being indicated by the appended claims rather than by the foregoing description, and all changes which come within the meaning and range of equivalency of the claims are therefore intended to be embraced therein. Any reference sign in a claim should not be construed as limiting the claim concerned. Several of the units, modules or means recited in the system, apparatus or computer device claims may also be implemented by one and the same unit, module or means in software or hardware.

Although the embodiments of the present invention have been described in detail with reference to the preferred embodiments, it should be understood by those skilled in the art that various changes may be made and equivalents may be substituted without departing from the spirit and scope of the embodiments of the present invention.