阅读说明：本技术 控制装置及拍摄系统 (Control device and imaging system ) 是由 今井聪 津田隆太 平原英人 于 2020-02-13 设计创作，主要内容包括：包括：预先拍摄部(521),其通过拍摄装置(1)进行预先拍摄,该拍摄装置(1)对包含车辆的驾驶员的面部的规定范围进行拍摄,该预先拍摄是进行用于拍摄驾驶员的驾驶状况的正式拍摄之前的阶段中的拍摄；以及点亮控制部(522),其在进行由预先拍摄部(521)进行的预先拍摄的情况下,使被安装于拍摄装置(1)或拍摄装置(1)周围的用于发光的点亮装置(2)点亮。控制装置(5)也可以包括输出部(523),其在进行由预先拍摄部(521)进行的预先拍摄的情况下,输出指示驾驶员观察点亮装置的消息。(The method comprises the following steps: a pre-imaging unit (521) that performs pre-imaging by means of an imaging device (1), the imaging device (1) imaging a predetermined range that includes the face of a driver of a vehicle, the pre-imaging being imaging performed at a stage prior to the main imaging for imaging the driving situation of the driver; and a lighting control unit (522) that, when the pre-imaging unit (521) performs the pre-imaging, lights a lighting device (2) for emitting light that is mounted on the imaging device (1) or around the imaging device (1). The control device (5) may also include an output unit (523) that outputs a message instructing the driver to view the lighting device when the pre-imaging unit (521) performs the pre-imaging.)

1. A control device, comprising:

a pre-imaging unit that performs pre-imaging by an imaging device that images a predetermined range including a face of a driver of a vehicle, the pre-imaging being imaging in a stage before main imaging for imaging a driving situation of the driver is performed, and

and a lighting control unit configured to light a lighting device that is attached to the imaging device or the periphery of the imaging device and emits light when the pre-imaging unit performs the pre-imaging.

2. The control device according to claim 1,

the lighting device includes an output unit that outputs a message instructing a driver to observe the lighting device when the pre-photographing by the pre-photographing unit is performed.

3. A photographing system, comprising:

an imaging device which is disposed diagonally forward of a driver's seat of the vehicle and which images a predetermined range including a face of the driver of the vehicle,

a lighting device installed at the photographing device or around the photographing device to emit light,

a pre-photographing unit that performs pre-photographing by the photographing device, the pre-photographing being photographing in a stage before a main photographing for photographing a driving condition of a driver is performed, and

and a lighting control unit configured to light the lighting device when the pre-imaging unit performs the pre-imaging.

4. The camera system of claim 3, wherein,

the imaging device and the lighting device are mounted on a pillar on a driver's seat side.

5. The photographing system of claim 3 or 4, wherein,

the lighting control unit detects the presence or absence of an obstacle existing in a blind spot area seen from the driver, and lights the lighting device when the obstacle is detected.

Technical Field

The present disclosure relates to a control device and a photographing system for photographing by a photographing device.

Background

There has been proposed a technique in which a camera provided in a vehicle captures an image of a face of a driver, and the driver's inattentive driving is detected from the captured image of the face of the driver (see, for example, patent document 1).

Prior art documents

Patent document

Patent document 1: japanese laid-open patent application No. 2005-242428

Disclosure of Invention

Technical problem to be solved by the invention

In order to detect careless driving, it is necessary to capture an image of the face of the driver in advance with the driver facing the camera and acquire the feature of the face of the driver. However, when the driver is photographed in advance, the driver may not face the camera, and the feature of the face of the driver may not be obtained.

In addition, a camera used for photographing for detecting careless driving is generally checked before shipment of a vehicle, whether or not the camera is mounted on the vehicle in a correct orientation in a vehicle manufacturing plant. In order to perform this inspection, the operator needs to sit on the driver's seat while facing the camera, and the camera needs to photograph the face of the operator in advance. This check may fail because the operator is not facing the camera when shooting the face.

The present disclosure has been made in view of the above circumstances, and an object thereof is to provide a control device and an imaging system that can direct a driver or the like toward an imaging device when imaging is performed in advance.

Means for solving the problems

The control device of claim 1 of the present disclosure includes: a pre-imaging unit that performs pre-imaging by an imaging device that images a predetermined range including a face of a driver of a vehicle, the pre-imaging being imaging performed at a stage before main imaging for imaging a driving situation of the driver is performed; and a lighting control unit that lights a lighting device for emitting light, which is attached to the imaging device or the periphery of the imaging device, when the pre-imaging is performed by the pre-imaging unit. The control device may further include an output unit that outputs a message instructing a driver to observe the lighting device when the pre-photographing by the pre-photographing unit is performed.

The photographing system of claim 2 of the present disclosure includes: an imaging device that is disposed diagonally forward of a driver's seat of a vehicle and that images a predetermined range including a face of the driver of the vehicle; a lighting device that is attached to the imaging device or the periphery of the imaging device and emits light; a pre-imaging unit that performs pre-imaging by the imaging device, the pre-imaging being imaging performed in a stage prior to a main imaging for imaging a driving situation of a driver; and a lighting control unit configured to light the lighting device when the pre-imaging unit performs the pre-imaging.

The imaging device and the lighting device may be mounted on a pillar on the driver's seat side. The lighting control unit may detect the presence or absence of an obstacle existing in a blind spot area seen from the driver, and may light the lighting device when the obstacle is detected.

Effects of the invention

According to the present disclosure, when the driver of the vehicle or the like is photographed in advance, the driver or the like can be directed toward the photographing device.

Drawings

Fig. 1 is a diagram for explaining an outline of an imaging system according to an embodiment.

Fig. 2 is a diagram showing a configuration of an imaging system.

Fig. 3 is a flowchart showing a processing procedure of photographing by the photographing system.

Detailed Description

[ overview of imaging System ]

Fig. 1 is a diagram for explaining an outline of the imaging system S according to the present embodiment. The imaging system S includes an imaging device 1 and a lighting device 2 mounted on a vehicle. The imaging device 1 is a camera for imaging a predetermined range including the face of the driver of the vehicle. The imaging device 1 may be disposed obliquely in front of a driver's seat of the vehicle or in the front direction of the driver's seat. For example, the designer or the like sets the orientation and the angle of view of the imaging device 1 for imaging the average face or upper body of the driver, and thereby determines a predetermined range in advance. The imaging device 1 images the driver in order to detect a driving state such as inattentive driving of the driver in the imaging system S.

The imaging device 1 performs a formal imaging for imaging the driving condition of the driver. The imaging device 1 performs pre-imaging, which is imaging in a stage before the main imaging. The image is captured in advance, for example, to acquire feature information indicating a feature of a face used to determine the orientation of the face of a driver in detection of inattentive driving. The feature of the face is, for example, the outline of the face, the positional relationship of the eyes or the nose.

The lighting device 2 is a light source that emits light. The lighting device 2 is mounted around the imaging device 1. In the example of fig. 1, the lighting device 2 is mounted to a pillar on the driver's seat side of the vehicle together with the imaging device 1. In addition, the lighting device 2 may be formed integrally with the imaging device 1.

The lighting device 2 lights when the imaging device 1 performs the preliminary imaging. With such a configuration, the driver is guided to observe the lighting device 2 that is lit. Therefore, the imaging system S can direct the driver toward the imaging device 1 in the preliminary imaging. Since the imaging device 1 generates a captured image of the face of the driver in a state where the driver faces the imaging device 1, a feature serving as a reference for determining the orientation of the face can be acquired from the captured image.

[ configuration of imaging System ]

Fig. 2 is a diagram showing the configuration of the imaging system S. The imaging system S includes an imaging device 1, a lighting device 2, a millimeter wave radar 3, a display unit 4, and a control device 5. The millimeter wave radar 3 detects the presence or absence of an obstacle in a region lateral and rearward of the vehicle which becomes a blind spot from the driver's view, using an electromagnetic wave having a wavelength of a millimeter wave band of about 1cm or less. The obstacle is, for example, a car or a pedestrian. The display unit 4 is a display for displaying messages.

The control device 5 includes a storage unit 51 and a control unit 52. The storage unit 51 is configured by, for example, a ROM (Read Only Memory) and a RAM (Random Access Memory). The storage unit 51 stores various programs and various data for causing the control unit 52 to function.

The Control Unit 52 is, for example, an ECU (Electronic Control Unit). The control unit 52 functions as a pre-imaging unit 521, a lighting control unit 522, an output unit 523, and a state detection unit 524 by executing various programs stored in the storage unit 51.

The preliminary imaging unit 521 performs preliminary imaging, which is imaging in a stage before the main imaging is performed, by the imaging device 1. For example, the preliminary imaging unit 521 determines whether or not the key-on operation of the ignition key is accepted, and performs preliminary imaging when it is determined that the key-on operation is accepted. The pre-imaging unit 521 analyzes the captured image captured in advance, and acquires feature information indicating the feature of the face for determining the orientation of the face of the driver. The preliminary imaging unit 521 may perform preliminary imaging in order to check whether or not the imaging device 1 is mounted on the vehicle in the correct orientation in the vehicle manufacturing plant. In this inspection, the pre-imaging unit 521 images the operator sitting in the driver seat of the vehicle instead of the driver.

The lighting control unit 522 lights the lighting device 2 when the preliminary imaging unit 521 performs the preliminary imaging. For example, the lighting control unit 522 blinks the lighting device 2 before the preliminary photographing. The lighting control unit 522 can guide the driver to face the direction of the imaging device 1 by lighting the lighting device 2 during the pre-imaging. On the other hand, the pre-imaging unit 521 does not turn on the lighting device 2 during the main imaging by the imaging device 1.

The lighting control unit 522 detects the presence or absence of an obstacle existing in a blind spot area seen from the driver, based on the detection result of the millimeter wave radar 3. When determining that an obstacle existing in an area that is a blind spot from the driver's view is detected, lighting control unit 522 lights lighting device 2 to thereby warn the driver of the detection of the obstacle.

The output unit 523 outputs a message instructing the driver to observe the lighting device 2 when the pre-imaging unit 521 performs the pre-imaging. For example, the output unit 523 outputs the message to the display unit 4 simultaneously with the lighting of the lighting device 2. The output unit 523 may output a sound including the message through a speaker (not shown).

After the pre-imaging unit 521 acquires the feature information, the state detection unit 524 performs main imaging by the imaging device 1 at predetermined time intervals. The predetermined time is, for example, 0.1 second. The state detection unit 524 detects a driving state of the driver, such as inattentive driving, based on the captured image generated by the main imaging.

More specifically, the state detection unit 524 specifies the orientation of the face of the driver in the captured image generated by the main imaging, using the feature information acquired by the pre-imaging unit 521. The state detection unit 524 determines that inattentive driving by the driver is detected when the angle formed by the determined face orientation and the direction of travel of the vehicle is equal to or greater than an allowable value. The allowable value is, for example, 45 °.

[ processing procedure for photographing ]

Fig. 3 is a flowchart showing the processing procedure of the imaging performed by the imaging system S. This processing step is started when the pre-imaging unit 521 detects that the ignition key is turned on, for example.

First, the lighting control unit 522 lights the lighting device 2 before the preliminary imaging (S101). Simultaneously with the lighting of the lighting device 2, the output unit 523 outputs a message instructing the driver to observe the lighting device 2 to the display unit 4 (S102). The preliminary imaging unit 521 performs preliminary imaging by the imaging device 1 (S103). The state detection unit 524 starts the main shooting by the imaging device 1 (S104) and ends the process.

In general, a driver visually confirms a traveling direction while driving a vehicle. Therefore, if a camera is mounted near the steering wheel, the driver can be photographed from the front by the camera. However, in such a vehicle, since it is necessary to secure a space for the imaging device in the vicinity of the steering wheel, there is a problem that layout restrictions increase in designing the instrument panel.

In contrast, according to the present embodiment, the lighting control unit 522 lights the lighting device 2 when the preliminary imaging unit 521 performs the preliminary imaging. Therefore, the preliminary imaging unit 521 can perform preliminary imaging after guiding the driver to face the direction of the imaging device 1. The pre-imaging unit 521 generates an image of the face of the driver while knowing the orientation of the face of the driver during pre-imaging, and can acquire feature information serving as a reference for determining the orientation of the face of the driver from the image. In addition, the pre-imaging unit 521 can suppress restrictions on the layout in designing the instrument panel.

The preliminary imaging unit 521 generates an image of the face of a worker sitting in the driver's seat in place of the driver during preliminary imaging when checking whether the imaging device 1 is attached to the vehicle in the correct orientation in the vehicle manufacturing plant. When the position of the face of the operator is near the center of the captured image, the pre-imaging unit 521 determines that the imaging device 1 is attached to the vehicle in the correct orientation. In the present embodiment, the preliminary imaging unit 521 can perform preliminary imaging after guiding the driver to face the direction of the imaging device 1, and therefore the position of the face of the operator can be accurately determined in the captured image. Therefore, the preliminary imaging unit 521 can improve the accuracy of determining whether or not the imaging device 1 is correctly attached.

The present disclosure has been described above with reference to the embodiments, but the technical scope of the present disclosure is not limited to the scope described in the above embodiments, and various modifications and changes can be made within the scope of the present disclosure. For example, all or a part of the apparatus may be configured to be functionally or physically distributed and integrated in arbitrary units. In addition, a new embodiment generated by arbitrary combination of the plurality of embodiments is also included in the embodiments of the present invention. The effect of the new embodiment by the combination has the effect of the original embodiment.

The application is based on the Japanese patent application (Japanese application 2019-031708), which is applied for 25.2.2019, and the content of which is incorporated herein by reference.

Industrial applicability

The imaging device 1 of the present disclosure can face a driver or the like of a vehicle toward the imaging device when imaging the driver or the like in advance.

Description of the reference numerals

1 imaging device

2 lighting device

3 millimeter wave radar

4 display part

5 control device

51 storage part

52 control part

521 pre-imaging unit

522 lighting control unit

523 output unit

524 State detection part

S shooting system