Stay status display system and stay status display method
阅读说明:本技术 停留状况显示系统以及停留状况显示方法 (Stay status display system and stay status display method ) 是由 平泽园子 藤松健 于 2019-02-07 设计创作,主要内容包括:能够向用户呈现访问对象的人物是否停留在对象区域,并且能够向用户呈现访问对象的人物是否为无法接待来访者的状态。基于摄像机(1)的影像来探测对象区域中是否有人物停留,并探测停留在对象区域的人物是否为无法接待来访者的状态,生成显示信息,所述显示信息显示与对象区域中是否有人物停留有关的停留信息,并一同显示与人物是否为无法接待来访者的状态有关的状态信息。(The user can be presented with whether the character of the access object stays in the object area and can be presented with a state whether the character of the access object is unavailable to the visitor. Whether a person stays in the target area is detected based on the image of the camera (1), whether the person staying in the target area is in a state that the visitor cannot be received is detected, and display information is generated, wherein the display information displays stay information related to whether the person stays in the target area and displays state information related to whether the person is in a state that the visitor cannot be received.)
1. A stay condition display system that performs, with a processor: a stay situation display system for acquiring a video image captured by a camera installed in a target area in real time and generating display information on a current stay situation of a person in the target area,
the processor detects whether a person stays in the object region based on the image of the camera,
the processor detects whether a person staying in the object area is in a state of being unable to receive a visitor,
the processor generates the display information, and the display information displays stay information related to whether a person stays in the target area and displays status information related to whether the person is in a state that the person cannot receive visitors.
2. The stay condition display system according to claim 1,
the processor transmits a notification indicating that the stay information is updated with respect to the person set as the notification target to the user terminal, in response to an operation by the user who selects the person and sets the person as the notification target.
3. The stay condition display system according to claim 1 or 2,
the processor generates a person list screen in which person images are displayed in an aligned manner,
the processor displays a status icon indicating whether or not the person is in a status in which the visitor cannot be received as the status information on the person list screen.
4. The stay condition display system according to claim 1 or 2,
the processor generates a map screen in which a status icon as the status information indicating whether the person is in a status of being unable to receive a visitor is superimposed on a position of a corresponding person on a map image representing the object area,
the processor displays a person image of the selected person on the map screen according to an operation of a user who selects the person.
5. The stay condition display system according to any one of claims 1 to 4,
the state information represents at least any one state of a call state, a talk state, and a stress state.
6. The stay condition display system according to any one of claims 1 to 5,
the processor determines whether a person staying in the object area is talking based on the image of the camera.
7. The stay condition display system according to any one of claims 1 to 6,
the processor determines whether a person staying in the object area is in a stressed state based on the image of the camera.
8. A stay status display method for executing, with a processor, the following processes: a stay status display method for acquiring a video captured by a camera installed in a target area in real time and generating display information on a current stay status of a person in the target area,
detecting whether a person stays in the object region based on the image of the camera,
detecting whether a person staying in the subject area is in a state of being unable to receive a visitor,
and generating the display information, wherein the display information displays the stay information related to whether the person stays in the target area, and displays the state information related to the state of whether the person is a person who cannot receive the visitor.
Technical Field
The present invention relates to a stay situation display system and a stay situation display method for generating display information on a stay situation of a person in a target area based on a video captured by a camera installed in the target area in a facility.
Background
In facilities such as office buildings, monitoring systems are widely used which are provided with a camera for taking an image of the inside of the facility and which monitor the state of the inside of the facility by an image of the camera. If information on the stay status of a person in a facility is acquired using the image of such a camera and presented to the user, it is possible to easily confirm whether or not the person who wants to meet is in his or her seat, and the convenience of the user is improved.
As a technique for presenting a staying state of a person to a user, the following system is known: an image of a person sitting on a seat and an image of a telephone captured by a camera installed in an office or the like are subjected to image processing in real time to determine whether the person is sitting or not sitting on the seat, and whether a call is being made or not is determined when the person is sitting on the seat (see patent document 1).
Disclosure of Invention
Problems to be solved by the invention
If it is assumed that whether or not a person is talking is detected and the talking status of the person is presented to the user as in the above-described prior art, the following problems can be eliminated: the person to be accessed is on the seat and is accessed, but the person is talking, so the talking cannot be carried out.
On the other hand, even if the person to be accessed is not in a call, the person may not be able to make a call. For example, when the person to be accessed is talking to another person or is busy due to an emergency, the person cannot make a call. Therefore, a technique of detecting whether or not a person including a person who is on a call cannot take over the status of a visitor and presenting the status to the user is desired.
However, the above-described conventional techniques have the following problems: since the technique is related to the telephone call, it is needless to say that only the call status of the person is presented to the user, and whether or not the person is in a state of being unable to receive a visitor cannot be presented to the user for reasons other than the call being made.
Therefore, a main object of the present invention is to provide a staying state display system and a staying state display method, including: the user can be presented with whether the character of the access object stays in the object area and can be presented with a state whether the character of the access object is unavailable to the visitor.
Means for solving the problems
The stay status display system of the present invention is configured to execute the following processing by a processor: the method includes acquiring images captured by a camera provided in a target area in real time to generate display information regarding a current stay situation of a person in the target area, wherein the processor detects whether the person stays in the target area based on the images of the camera, detects whether the person staying in the target area is in a state in which the person cannot receive a visitor, and generates the display information displaying stay information regarding whether the person stays in the target area and displaying state information regarding whether the person is in a state in which the person cannot receive the visitor.
In addition, the stay status display method of the present invention is configured to execute the following processing by a processor: in the stay situation display method, whether a person stays in a target area is detected based on an image of a camera, whether the person staying in the target area is in a state in which the person cannot receive a visitor is detected, and the display information is generated, which displays stay information about whether the person stays in the target area and displays state information about whether the person is in a state in which the person cannot receive the visitor.
ADVANTAGEOUS EFFECTS OF INVENTION
According to the present invention, it is possible to present to the user whether or not the character of the access target stays in the target area, and to present to the user whether or not the character of the access target is in a state of being unable to receive a visitor.
Drawings
Fig. 1 is an overall configuration diagram of a stay situation display system according to the present embodiment.
Fig. 2 is an explanatory diagram showing the layout of rooms in the facility, the installation state of the
Fig. 3 is a block diagram showing the schematic configuration of the
Fig. 4 is an explanatory diagram showing a person list screen displayed on the
Fig. 5 is an explanatory diagram showing a map screen displayed on the
Fig. 6 is a flowchart showing a procedure of setting processing regarding presence information and status information performed by the
Fig. 7 is a flowchart showing an operation procedure of the notification control performed by the
Detailed Description
A first invention made to solve the above problem is a staying state display system configured to execute, by a processor, the following processing: the method includes acquiring images captured by a camera provided in a target area in real time to generate display information regarding a current stay situation of a person in the target area, wherein the processor detects whether the person stays in the target area based on the images of the camera, detects whether the person staying in the target area is in a state in which the person cannot receive a visitor, and generates the display information displaying stay information regarding whether the person stays in the target area and displaying state information regarding whether the person is in a state in which the person cannot receive the visitor.
In this way, it is possible to present to the user whether or not the person to be accessed stays in the target area, and to present to the user whether or not the person to be accessed is in a state in which it is not possible to receive a visitor.
In addition, the second invention is configured such that: the processor transmits a notification indicating that the stay information is updated with respect to the person set as the notification target to the user terminal, in response to an operation by the user who selects the person and sets the person as the notification target.
Thus, the user can know the opportunity of appropriate access. When the status information is updated, a notification indicating that the status information is updated may be transmitted to the user terminal.
In addition, the third invention is configured such that: the processor generates a person list screen on which person images are displayed in a line, and displays a status icon indicating whether or not the person is in a status in which the visitor cannot be received as the status information on the person list screen.
This makes it possible to confirm the staying status of the persons in the target area at once and to immediately recognize whether or not each person is in a state in which the visitor cannot be received.
In addition, the fourth aspect of the present invention is configured such that: the processor generates a map screen in which a status icon as the status information indicating whether or not the person is in a status of being unable to receive a visitor is superimposed on a position of a corresponding person on a map image representing the target area, and displays a person image of the selected person on the map screen in accordance with an operation of a user who selects the person.
This makes it possible to confirm the staying status of the persons in the target area at once and to immediately recognize whether or not each person is in a state in which the visitor cannot be received.
In addition, the fifth invention is configured such that: the state information represents at least any one state of a call state, a talk state, and a stress state.
This makes it possible to immediately grasp the call state, the conversation state, and the stress state as the state in which the person cannot attend the visitor.
In addition, according to a sixth aspect of the present invention, the processor determines whether or not a person staying in the target area is talking based on the image of the camera.
Thereby, the state information indicating that the person is talking can be acquired.
In addition, the seventh aspect of the present invention is configured such that: the processor determines whether a person staying in the object area is in a stressed state based on the image of the camera.
This enables the acquisition of state information indicating that the person is in a stressed state.
In addition, an eighth aspect of the present invention relates to a staying state display method configured to execute, by a processor, the following processing: in the stay situation display method, whether a person stays in a target area is detected based on an image of a camera, whether the person staying in the target area is in a state in which the person cannot receive a visitor is detected, and the display information is generated, which displays stay information about whether the person stays in the target area and displays state information about whether the person is in a state in which the person cannot receive the visitor.
Thus, as in the first invention, it is possible to present to the user whether or not the person to be accessed stays in the target area, and to present to the user whether or not the person to be accessed is in a state in which the person cannot receive a visitor.
Embodiments of the present invention will be described below with reference to the drawings.
Fig. 1 is an overall configuration diagram of a stay situation display system according to the present embodiment.
The stay situation display system is provided with a
The
The
The
Next, the layout of the rooms in the facility, the installation state of the
In a room (office), tables and seats (chairs) are arranged in a row, and each person is assigned one seat, and each person sits on his or her own seat to perform an office work.
A
In the present embodiment, a detection area (a rectangular area of a broken line) for each seat is set in advance in the image of the
The detection area is set to a position where the body of the person sitting on the seat is assumed to exist, and the detection area is set based on the size of the body of the person so that one detection area corresponds to one person. Further, the detection area may be set by an operation of designating the range of the detection area on the screen displaying the image of the
In the present embodiment, the image of the
In the present embodiment, it is assumed that whether or not each person is in the own seat is detected in a room to which each person is assigned one seat in advance, but it may be assumed that who stays in a room to which each person is not assigned one seat in advance, such as an office, a conference room, and a talk room that use the free address system. In this case, it is sufficient to recognize a person from the image of the
Next, the schematic configuration of the
The
The
The
The
The
In the presence detection process, whether a person is present in each seat is detected in real time based on the image of the
In the present embodiment, since some change occurs in the image when a person stays, whether or not a person is present in the seat is detected based on the change state of the image in the detection area. Specifically, first, the image of the detection region at each time is cut out from the images at each time spaced by a predetermined sampling period (for example, 1 minute). Then, the image change rate is acquired for the image of the detection area at each time. At this time, the rate of change of the image with respect to the image at the previous time is acquired by comparing the rate of change with the image at the previous time spaced by the sampling period. Then, the presence or absence of a human being staying in the detection area is determined based on the image change rate at each time. Then, dwell information indicating whether or not a human being dwells at each time spaced by the sampling period is generated based on the result of the determination. In the presence detection process, a discriminator can be used which does not depend on the image change rate as described above, and learns 2 classes of the presence state and the absence state in advance by deep learning. In the presence detection processing, the likelihood (probability) as the presence state and the likelihood as the absence state are obtained for the image of the detection region by the recognizer, and the two likelihoods are compared, whereby it is possible to determine which of the presence state and the absence state is present.
In the state detection process, in the case where a person is seated in the in-position detection process, whether the person is in a state in which the visitor cannot be received is detected based on the image of the
In the call determination, if a device attached to the ear when a call is made by telephone, that is, a mobile phone (including a smartphone), a handset of a fixed-line telephone, an earphone, or the like is detected in the vicinity of the head of a person from the image of the detection area, it is determined that the call is being made.
In the conversation determination, if other persons are detected in the vicinity of the person as the object from the image of the periphery of the detection area, it is determined that the conversation is in progress. In this case, in order to exclude a person passing nearby, it is preferable to determine that conversation is being performed when the state in which another person is detected continues for a predetermined time. In addition, speech determination may be performed by collecting utterances of other persons with a microphone in the vicinity of the target person. Furthermore, the person detection by the image and the utterance detection by the microphone can be combined, thereby further improving the conversation determination accuracy.
In the pressure determination, the number of heartbeats of the person is estimated by non-contact life sensing based on the image of the
Here, when the heart rate is equal to or more than a predetermined first threshold value, it is determined that the state is stressed. When the number of heartbeats is less than a predetermined second threshold value, it is determined that the state is relaxed. When the number of heartbeats is less than a predetermined first threshold value and equal to or more than a second threshold value, the state is determined as the standard state.
In the present embodiment, the pressure state of the person is determined by estimating the number of heartbeats of the person based on the non-contact life sensing of the video image of the
In the screen control process, display information of the presence status presentation screen to be displayed on the
In the process of the notification control, when presence information (stay information) on whether or not a person is present in a seat is updated, that is, when a person who is not present returns to the seat of the person and is in a state where the person is present, the user is notified of the fact by an email.
The user browses the presence status presentation screen (see fig. 4 and 5), and gives up access when the person to be accessed is absent or when the person is in a state of being on a call, being on a conversation, or being in a state of tension even if the person is in a seat. In this case, the user sets the person to be accessed as the notification target, and when the person returns to his seat, the user transmits an email to the
In the present embodiment, the electronic mail is transmitted to the
In the present embodiment, the notification is performed at the time when the presence information is updated, but the notification may be performed at the time when the status information is updated together with the presence information. Specifically, when the state of the person to be accessed, in which the visitor cannot be accommodated, is completely eliminated and the person becomes a state suitable for access, that is, when the person returns to the seat and becomes in the on-seat state and does not conform to any one of the on-call state, the on-talk state, and the stressed state, the notification indicating the time suitable for access is performed, taking the call state, the on-talk state, and the stressed state into consideration.
In addition, regardless of whether or not the person to be accessed is in a state suitable for access, the updated content may be notified to the user only when the presence information or the state information is updated.
The
The
When the
Next, a person list screen displayed on the
The person list screen is provided with a department selection unit 41 and a
A person-by-
In the present embodiment, the image of the face of a person (a photographed image obtained by photographing the face of a person in advance) is displayed as a person image for identifying each person, but the person image may be an image (portrait or avatar) in which the appearance of a person is schematically depicted.
In addition, in the case where the person is talking, the
Further, when the person is in a stressed state, the
Further, an
Next, a map screen displayed on the
On this map screen, a
The display mode of the
In addition, in this map screen, when a person is talking, the talking
In addition, when the person's stress state is a stressed state, an
In addition, in this map screen, when an operation to set a person as a notification target, for example, an operation to select a notification in a menu frame displayed by operating the
In addition, on the map screen, when the operation of hovering the mouse over the
Next, a setting process related to the presence information (stay information) and the status information performed by the
In the
On the other hand, if the target person is on the seat (yes in ST101), the presence information of the target person is set to be present (ST 103). Subsequently, it is determined whether or not the person to be called is talking (ST 104).
Here, when the person to be called is on the call (yes in ST104), the status information on the person status of the person to be called is set to on the call (ST105), and the process proceeds to ST 109.
On the other hand, if the person to be called is not in the call (no in ST104), then it is determined whether the person to be called is talking (ST 106).
Here, in the case where the person as the subject is talking (yes in ST106), the status information on the state of the person as the subject is set to be talking (ST107), and the process proceeds to ST 109.
On the other hand, if the subject person is not talking (no in ST106), the status information on the state of the subject person is set to NULL (ST108), and the process proceeds to ST 109.
Next, the pressure state of the subject person is determined (ST 109). If the degree of stress is high, the state information on the stress state of the target person is set to the tension state (ST 110). When the degree of stress is standard, the state information on the stress state of the subject person is set to the standard state (ST 111). When the degree of stress is low, the state information on the stress state of the subject person is set to the relaxed state (ST 112).
The above processing is periodically executed at a fixed cycle.
Next, the notification control performed by the
First, it is determined whether or not a person set as a notification target exists (ST 201). Here, if there is a person set as the notification target (yes in ST201), the notification determination process is performed for all persons set as the notification targets (ST202 to ST 206).
In the notification determination process, first, it is determined whether or not the subject person is seated (ST 203). Here, when the subject person is seated (yes in ST203), an email is transmitted to the
The above processing is periodically executed at a fixed cycle.
Note that, although the notification control has been described by taking the notification function implemented by the electronic mail as an example, the notification can be made timely by an application push notification function implemented by an application program related to the presentation of the stay status installed in the
As described above, the embodiments have been described as an example of the technique disclosed in the present application. However, the technique in the present disclosure is not limited to this, and can be applied to an embodiment in which a change, a replacement, an addition, an omission, or the like is made. In addition, each component described in the above embodiments may be combined as a new embodiment.
Industrial applicability
The stay situation display system and the stay situation display method according to the present invention are useful as a stay situation display system and a stay situation display method, etc., as follows: the display information relating to the stay status of the person in the target area is generated based on the video captured by the camera of the target area provided in the facility, which has the effect of presenting to the user whether or not the person to be accessed stays in the target area and the state of whether or not the person to be accessed is unable to receive the visitor.
Description of the reference numerals
1: a camera; 2: a facility management device; 3: a user terminal; 21: a communication unit; 22: a processor; 23: a storage unit; 24: a display unit; 25: an input section; 45: face images (person images); 51: an icon in conversation (status icon); 52: an icon (status icon) in the call; 53: an icon of a tension state (state icon); 54: an icon of a standard state (state icon); 55: an icon of a relaxed state (state icon); 56: an icon of an email; 61: an in-place map; 62: seat icons (status icons); 63: a map of the area; 65: images of a stressed state; 66: an image of a standard state; 67: an image in a relaxed state; 68: an icon of an email; 71: and (5) an information display frame.
- 上一篇:一种医用注射器针头装配设备
- 下一篇:用于数字资产管理的系统和方法