阅读说明：本技术 一种控制方法、装置及存储介质 (Control method, control device and storage medium ) 是由 程福萍 于 2019-08-26 设计创作，主要内容包括：本发明实施例公开了一种控制方法、装置及存储介质；其中,所述方法应用于电子设备,所述方法包括：采集至少一种传感数据,对所述至少一种传感数据进行识别,得到识别结果；其中,所述识别结果包括所述电子设备所处空间中是否包含至少一个目标对象；基于所述识别结果,确定是否控制所述电子设备进入静音模式。(The embodiment of the invention discloses a control method, a control device and a storage medium; the method is applied to the electronic equipment and comprises the following steps: collecting at least one sensing data, and identifying the at least one sensing data to obtain an identification result; wherein the identification result comprises whether the space where the electronic equipment is located contains at least one target object; and determining whether to control the electronic equipment to enter a mute mode or not based on the identification result.)

1. A control method applied to electronic equipment is characterized by comprising the following steps:

collecting at least one sensing data, and identifying the at least one sensing data to obtain an identification result; wherein the identification result comprises whether the space where the electronic equipment is located contains at least one target object;

and determining whether to control the electronic equipment to enter a mute mode or not based on the identification result.

2. The method according to claim 1, wherein the recognition result further comprises whether the at least one target object is in at least one of a preset space and a preset state; wherein the preset state comprises a state of sending voice data.

3. The method of claim 2, wherein the identifying the at least one sensing datum to obtain an identification result comprises:

and identifying the at least one sensing data based on the voice characteristics of the at least one target object, and determining whether the at least one target object is in a state of sending out voice data.

4. The method of claim 2, wherein the identifying the at least one sensing datum to obtain an identification result further comprises:

identifying the at least one sensing data based on the corresponding appearance characteristics of the household objects of different types, and determining the type of the household objects contained in the space where the electronic equipment is located;

and determining whether the space where the at least one target object is located is a preset space or not based on the category of the household object.

5. The method of claim 2, wherein the determining whether to control the electronic device to enter a mute mode based on the recognition result comprises at least one of:

determining that the space where the electronic equipment is located contains at least one target object, generating a control instruction, and controlling the electronic equipment to enter a mute mode based on the control instruction;

determining that the at least one target object is in a state of sending voice data, generating a control instruction, and controlling the electronic equipment to enter a mute mode based on the control instruction;

and determining that the at least one target object is in a preset space, generating a control instruction, and controlling the electronic equipment to enter a mute mode based on the control instruction.

6. A control device applied to electronic equipment is characterized by comprising: an identification unit and a determination unit; wherein the content of the first and second substances,

the identification unit is used for acquiring at least one sensing data and identifying the at least one sensing data to obtain an identification result; wherein the identification result comprises whether the space where the electronic equipment is located contains at least one target object;

the determining unit is used for determining whether to control the electronic equipment to enter a mute mode or not based on the identification result.

7. The apparatus of claim 6,

the recognition result further includes: whether the at least one target object is in at least one of a preset space and a preset state; wherein the preset state comprises: a state of uttering voice data.

8. The apparatus of claim 7,

the recognition unit is further configured to recognize the at least one sensing data based on a voice feature of the at least one target object, and determine whether the at least one target object is in a state of sending out voice data.

9. The apparatus of claim 7,

the identification unit is further configured to identify the at least one sensing data based on the corresponding appearance features of the home objects of different categories, and determine the category of the home object included in the space where the electronic device is located; and determining whether the space where the at least one target object is located is a preset space or not based on the category of the household object.

10. The apparatus of claim 7, wherein the determining unit is further configured to perform at least one of:

determining that the space where the electronic equipment is located contains at least one target object, generating a control instruction, and controlling the electronic equipment to enter a mute mode based on the control instruction;

determining that the at least one target object is in a state of sending voice data, generating a control instruction, and controlling the electronic equipment to enter a mute mode based on the control instruction;

and determining that the at least one target object is in a preset space, generating a control instruction, and controlling the electronic equipment to enter a mute mode based on the control instruction.

11. A computer-readable storage medium, on which a computer program is stored, which, when being executed by a processor, carries out the steps of the method of any one of claims 1 to 5.

12. A control device, comprising: a processor and a memory for storing a computer program operable on the processor, wherein the processor is operable to perform the steps of the method of any of claims 1 to 5 when the computer program is run.

Technical Field

The invention relates to the field of intelligent household appliances, in particular to a control method, a control device and a storage medium.

Background

At present, the intelligent sweeping robot enters thousands of households, but the intelligent sweeping robot still has high noise during working. In the aspect of processing the working noise of the intelligent sweeping robot, most manufacturers reduce the noise of the sweeping machine by means of reducing the power of a fan and the like, and the mode requires a user to use an application program in a remote controller or a mobile phone for control, so that troubles are caused to the use of the user.

Disclosure of Invention

In view of this, embodiments of the present invention are expected to provide a control method, an apparatus, and a storage medium, which can enable an intelligent floor sweeping robot to automatically enter a silent mode, so as to achieve the purpose of not disturbing a user and improve the use satisfaction of the user.

In order to achieve the purpose, the technical scheme of the invention is realized as follows:

the embodiment of the invention provides a control method, which is applied to electronic equipment and comprises the following steps:

collecting at least one sensing data, and identifying the at least one sensing data to obtain an identification result; wherein the identification result comprises whether the space where the electronic equipment is located contains at least one target object;

and determining whether to control the electronic equipment to enter a mute mode or not based on the identification result.

In the above scheme, the recognition result further includes whether the at least one target object is in at least one of a preset space and a preset state; wherein the preset state comprises a state of sending voice data.

In the foregoing scheme, the identifying the at least one sensing data to obtain an identification result includes:

and identifying the at least one sensing data based on the voice characteristics of the at least one target object, and determining whether the at least one target object is in a state of sending out voice data.

In the foregoing scheme, the identifying the at least one sensing data to obtain an identification result further includes:

identifying the at least one sensing data based on the corresponding appearance characteristics of the household objects of different types, and determining the type of the household objects contained in the space where the electronic equipment is located;

and determining whether the space where the at least one target object is located is a preset space or not based on the category of the household object.

In the above solution, the determining whether to control the electronic device to enter the mute mode based on the recognition result includes at least one of:

determining that the space where the electronic equipment is located contains at least one target object, generating a control instruction, and controlling the electronic equipment to enter a mute mode based on the control instruction;

determining that the at least one target object is in a state of sending voice data, generating a control instruction, and controlling the electronic equipment to enter a mute mode based on the control instruction;

and determining that the at least one target object is in a preset space, generating a control instruction, and controlling the electronic equipment to enter a mute mode based on the control instruction.

An embodiment of the present invention further provides a control device, which is applied to an electronic device, and the control device includes: an identification unit and a determination unit; wherein the content of the first and second substances,

the identification unit is used for acquiring at least one sensing data and identifying the at least one sensing data to obtain an identification result; wherein the identification result comprises whether the space where the electronic equipment is located contains at least one target object;

the determining unit is used for determining whether to control the electronic equipment to enter a mute mode or not based on the identification result.

In the above scheme, the identification result further includes: whether the at least one target object is in at least one of a preset space and a preset state; wherein the preset state comprises: a state of uttering voice data.

In the foregoing solution, the recognition unit is further configured to recognize the at least one sensing data based on a voice feature of the at least one target object, and determine whether the at least one target object is in a state of sending out voice data.

In the above scheme, the identification unit is further configured to identify the at least one sensing data based on the corresponding appearance features of the home furnishing objects of different categories, and determine the category of the home furnishing object included in the space where the electronic device is located; and determining whether the space where the at least one target object is located is a preset space or not based on the category of the household object.

In the foregoing solution, the determining unit is further configured to perform at least one of:

determining that the space where the electronic equipment is located contains at least one target object, generating a control instruction, and controlling the electronic equipment to enter a mute mode based on the control instruction;

determining that the at least one target object is in a state of sending voice data, generating a control instruction, and controlling the electronic equipment to enter a mute mode based on the control instruction;

and determining that the at least one target object is in a preset space, generating a control instruction, and controlling the electronic equipment to enter a mute mode based on the control instruction.

Embodiments of the present invention further provide a computer-readable storage medium, on which a computer program is stored, where the computer program, when executed by a processor, implements any of the steps of the above-mentioned method.

An embodiment of the present invention further provides a control apparatus, including: a processor and a memory for storing a computer program operable on the processor, wherein the processor is operable to perform any of the steps of the above method when executing the computer program.

The control method, the control device and the storage medium provided by the embodiment of the invention judge whether the space of the electronic equipment contains the target object by collecting at least one sensing data for identification so as to determine whether to control the electronic equipment to enter the mute mode. Therefore, the current space scene is automatically judged by automatically collecting various data of the space where the user is located, and the user can automatically enter a mute mode, so that the purpose of not disturbing the user is achieved.

Drawings

Fig. 1 is a first schematic flow chart illustrating an implementation of a control method according to an embodiment of the present invention;

fig. 2 is a schematic diagram of an implementation scenario of a control method according to an embodiment of the present invention;

fig. 3 is a schematic diagram illustrating an implementation flow of a control method according to an embodiment of the present invention;

fig. 4 is a schematic structural diagram of a control device according to an embodiment of the present invention;

fig. 5 is a schematic diagram of a specific hardware structure of a control device according to an embodiment of the present invention.

Detailed Description

In order to make the objects, technical solutions and advantages of the embodiments of the present invention clearer, the technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are some, but not all, embodiments of the present invention.

All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.

The embodiment of the invention provides a control method, which is applied to electronic equipment; fig. 1 is a schematic flow chart illustrating an implementation process of a control method according to an embodiment of the present invention, as shown in fig. 1, the method includes:

step 101, collecting at least one sensing data, and identifying the at least one sensing data to obtain an identification result; wherein the identification result comprises whether the space where the electronic equipment is located contains at least one target object;

and 102, determining whether to control the electronic equipment to enter a mute mode or not based on the identification result.

It should be noted that the electronic device is an intelligent home electronic device, which may be an air conditioner, an intelligent floor sweeping robot, or the like, and the target object is a person.

The sensing data is acquired by being provided with at least one sensor on the intelligent sweeping robot, and the at least one sensor can be used for acquiring image data, audio data, infrared data, position data and the like. The sensor used for collecting the image data can be a visual sensor such as a camera, a camera and the like; the sensor for collecting audio data may be a microphone or the like; the sensor used for collecting the infrared data can be an infrared sensor and the like; the sensor for collecting the position data may be a locator for determining the position information of the electronic device, and the locator may be a positioning device such as a GPS.

In order to better describe the embodiment of the present invention, the following description will be made by taking the electronic device as an intelligent sweeping robot as an example.

In the process of cleaning by the autonomous navigation of the intelligent sweeping robot, the intelligent sweeping robot is controlled to enter a silent mode when certain conditions are met; in order to better realize the function, a home environment map of the space where the intelligent sweeping robot is located can be established while cleaning is carried out, and autonomous positioning and navigation can be carried out based on the home environment map of the space where the intelligent sweeping robot is located during cleaning, so that cleaning work is realized.

The household environment map is composed of household objects and spaces where the household objects are located, and the household objects are a series of objects related to rooms, such as furniture configuration and electric appliance placement.

Here, the home environment map may be created by a Simultaneous Localization And Mapping (SLAM) technique, And after the home environment map is obtained, autonomous Localization And navigation may be subsequently performed by using the home environment map.

The SLAM technology refers to the fact that an intelligent sweeping robot starts to move from an unknown position in an unknown environment, self-positioning is carried out according to position estimation and sensing data in the moving process, meanwhile, a map is built, and autonomous positioning and navigation are carried out through the map.

It should be noted that there are two main types of SLAM technologies according to different hardware devices: SLAM technology based on laser radar, And SLAM (Visual Simultaneous Localization And Mapping, VSLAM) technology based on vision. The SLAM technology based on the laser radar provides distance information and angle information between the intelligent sweeping robot and surrounding obstacles through the laser radar, so that the functions of obstacle avoidance and the like are conveniently realized; the VSLAM technology mainly collects data through a vision sensor, and then synchronous positioning and map construction are carried out according to the collected data.

In this case, the image information collected by the vision sensor is richer than the information obtained by the laser radar, so that the later-stage processing is facilitated. Moreover, for the embodiment of the invention, because whether the space contains the target object needs to be determined, the VSLAM technology can better realize map construction and identification of various objects. Based on this, the embodiment of the present invention implements processing using the VSLAM technique.

For VSLAM technology, the vision sensors are largely divided into three types: monocular camera, binocular camera and degree of depth camera. The monocular camera can calculate the change of the camera pose through adjacent image matching, and perform triangular distance measurement on two visual angles to obtain the depth information of corresponding points; the binocular camera can calculate the depth information through a triangulation method; the depth camera can directly obtain the image and the depth information corresponding to the image. For the embodiments of the present invention, the above-described vision sensor may be used.

Therefore, the intelligent sweeping robot in the embodiment of the invention can be provided with the visual sensor, and in the cleaning process based on the cleaning instruction, the image data of the space where the intelligent sweeping robot is located is obtained through the visual sensor, so that the depth information of the home object or the person in the image data is determined, and the home environment map is obtained by matching the position information of the intelligent sweeping robot determined by the positioner.

Here, the space where the intelligent floor sweeping robot is located may be a space divided according to functions on a home environment map, for example, a bedroom, a kitchen, a living room, and the like are all spaces, and when the intelligent floor sweeping robot moves to the bedroom, the space where the intelligent floor sweeping robot is located is the bedroom.

It should be noted that, when the cleaning process is performed, noise generated by the intelligent sweeping robot mainly affects people, specifically, affects life, work, and leisure of people, so that whether people exist in a space can be determined, and whether the electronic device is controlled to enter the silent mode can be determined. For example, when the data of the space is collected and recognized, people exist in the space, and the intelligent sweeping robot is controlled to enter a mute mode.

Here, the step 101 may implement the identification of whether people are included in the space by constructing a character recognition model; the identified object can be image data of the space, namely the image data of the space is collected through a vision sensor on the intelligent sweeping robot, and the image data is identified to determine whether the space contains people.

The character recognition model may be constructed by extracting common attribute features of at least one target object and constructing the character recognition model based on the common attribute features of the at least one target object. For example, attribute features common to people may include facial features, height and body shape features, limb features, and the like.

After the figure recognition model is obtained, the image data of the space where the intelligent sweeping robot is located in the at least one sensing data can be recognized according to the figure recognition model, and a recognition result about whether the space where the intelligent sweeping robot is located contains at least one target object or not is obtained. The recognition result may be represented by "yes/no", "1/0", or the like; a "1" means "yes" and a "0" means "no". If the identification result is yes/1, the fact that the space where the electronic equipment is located contains at least one target object is indicated, and if the identification result is no/0, the fact that the space where the electronic equipment is located does not contain at least one target object is indicated.

It should be noted that the determination of whether the space where the intelligent sweeping robot is located contains at least one target object may also be determined by matching a visual sensor with an infrared sensor. The infrared sensor can detect the heat of a certain position in the space, so that whether the space contains the target object or not is judged through the heat of the certain position detected by the infrared sensor and the image data obtained by the vision sensor.

It should be further noted that the creation of the home environment map can also be realized by installing a locator, a distance detector and a camera on the intelligent sweeping robot. The distance detector is used for determining the distance between the intelligent sweeping robot and a household object in the space where the intelligent sweeping robot is located, and the distance detector can be a distance meter, a laser radar and the like; the distance detector determines the distance between the intelligent sweeping robot and the household object by measuring the time required by the electric wave to go back and forth from the intelligent sweeping robot to the household object.

Then, the category of the household object in the space can be determined through the image information of the space acquired by the camera, the position information of the intelligent sweeping robot is determined through the positioner, and the distance between the intelligent sweeping robot and the household object is determined through the distance detector; based on the category of the household object, the position information of the intelligent sweeping robot and the distance between the intelligent sweeping robot and the household object, the household environment map of the space where the intelligent sweeping robot is located can be determined.

The position information can be represented by establishing an absolute distance coordinate system by using a charging pile of the intelligent sweeping robot as a coordinate origin. Of course, the relative position coordinate system may also be established by means of the relative position, and the position information is represented by the relative position, which is not limited herein. Here, the origin of coordinates may also be a gate, a master bedroom, or the like; the purpose of establishing the coordinate system is to more intuitively represent the position information of various household objects in the space where the coordinate system is located.

However, it should be noted that the method for determining the home environment map based on the locator, the distance detector, and the camera may be more complex in subsequent processing compared to the above VSLAM-based technique due to the cooperation of various hardware, and the map construction and the identification of various objects based on the VSLAM technique are easier in subsequent processing due to the home object location directly implemented based on the visual sensor, but higher in the cost of purchase in the early period. Here, the implementation may be selected based on actual needs, and is not limited herein.

In the embodiment of the present invention, the following description is made in terms of map construction and identification of various objects implemented based on the VSLAM technique.

Further, the method further comprises:

the identification result further comprises whether the at least one target object is in at least one of a preset space and a preset state; wherein the preset state comprises a state of sending voice data.

The at least one target object being in a state of uttering voice data means that the at least one target object is speaking. When at least one target object is in a state of sending out voice data, it can be considered that the at least one target object is talking, etc., and it is desired that the at least one target object is not disturbed, it is necessary to control the electronic device to enter a mute mode.

Here, in order to detect whether at least one target object is in a state of uttering voice data, the recognizing the at least one sensing data to obtain a recognition result may include:

and identifying the at least one sensing data based on the voice characteristics of the at least one target object, and determining whether the at least one target object is in a state of sending out voice data.

In practical applications, the above-mentioned identifying the at least one sensing data based on the voice feature of the at least one target object may be performed by extracting a voice waveform of the at least one target object, extracting a voice feature from the voice waveform, constructing a voice recognition model based on the voice feature, identifying the voice data in the at least one sensing data according to the voice recognition model to obtain a recognition result about whether the voice data of the at least one target object exists in the located space, and determining whether the at least one target object is in a state of sending out voice data according to the recognition result.

As described above, the recognition result here may be represented by "yes/no", "1/0", or the like. When the voice data of at least one target object exists in the space, the at least one target object is considered to be in a state of sending out the voice data.

It should be noted that the speech feature may be determined by using one or more parameters including, but not limited to, a sound wave envelope, a pitch period, a relative amplitude, a mel-frequency cepstrum coefficient, etc., and after determining the parameters, a corresponding threshold may be set for each parameter to implement extraction of the speech feature. Common methods for extracting speech features include: linear Predictive Coding (LPC), Mel-frequency Cepstrum coefficients (MC), and the like.

Because the voice characteristics of people are different from those of other species or other objects, and the tone of different people are different; then, when the collected voice data conforms to the voice characteristics of at least one target object, it is determined that the at least one target object is in a state of uttering voice data.

Further, whether only one target object is sounding can be judged according to the tone, the tone and the like of the collected voice data; when only one person is judged to be speaking according to the collected voice data, the target object is considered to be making a call, and at the moment, the intelligent sweeping robot is expected not to be disturbed, and needs to be controlled to be in a mute state. When judging that at least two persons are speaking according to the collected voice data, the at least two target objects are thought to be talking, and at the moment, the intelligent sweeping robot is expected not to be disturbed, and needs to be controlled to carry out a mute state.

It should be noted that when it is determined that only one person is speaking according to the collected voice data, the behavior information of the target object can be further determined according to the collected image data, and when it is determined that the behavior information of the target object is that the hand of the target object is placed under the ear of the face and kept for more than a preset time, the target object is considered to be calling; the preset time can be set according to actual conditions, for example, set to be within 1 minute.

It should be further noted that the preset state may further include a working state, a sleeping state, and the like; the at least one target object being in the preset state may be indicative that the at least one target object is expected not to be disturbed. And when the at least one sensing data is identified and the space containing at least one target object is obtained, further judging the state of the at least one target object, and when the state of the at least one target object is in a preset state, controlling the electronic equipment to enter a mute mode.

Here, when it is required to determine whether the state of the at least one target object is in the preset state through the at least one sensing data, the identifying the at least one sensing data to obtain an identification result includes: based on the character recognition model, recognizing the at least one sensing data, and judging whether the space where the electronic equipment is located contains at least one target object; determining at least one target object, and acquiring state information of the target object; and judging whether the target object is in a preset state or not based on the state information of the target object.

Here, the obtaining of the state information of the target object in the above steps may be implemented by constructing a state recognition model. Specifically, a state recognition model is constructed based on the state characteristics of the target object, and the image data acquired by the visual sensor is processed based on the state recognition model to determine the state information of the target object.

After the state information of the target object is obtained, whether the target object is in a preset state or not is determined by comparing the state information with the preset state, and when the target object is in the preset state, the electronic equipment is controlled to enter a mute mode.

It should be noted that, in practical applications, if an image is acquired by a video sensor alone, and then a state recognition model is used to recognize a state of a target object, there may be a problem that the model accuracy is not high, which results in inaccurate recognition. For this, identifying whether the target object is in the preset state may also be determined by a visual sensor in cooperation with an infrared sensor, as described above.

As an example, an image of a person on a sofa is acquired through a video sensor, the image data can be recognized through a state recognition model, and an approximate result can be obtained, namely that a person is detected to be on the sofa and a television is located in the space, and then an infrared sensor is used for detecting that the television has heat and the sofa has heat, so that the television is recognized to be in a power-on state, and the sofa has the person; in combination, the person can be considered to be watching television at that time.

As another example, the image of the person in bed is collected by the video sensor, the image data can be recognized by the state recognition model, and a general result can be obtained, that is, the person in bed in bedroom is detected, and then the infrared sensor is used to detect the heat in bed, and the combination of the above can be considered that the person is sitting or lying on bed.

As another example, an image of a person working is captured by a video sensor, the image data can be recognized by a state recognition model to obtain a general result that the person is detected to be sitting, and then an infrared sensor is used for detecting the heat in front of a desk, so that the combination of the general result and the general result can be considered that the person is working or studying.

The preset space comprises a bedroom, a study room and the like; the target object may be considered to be at rest when the target object is in the bedroom and at work when the target object is in the study. The at least one target object is in a preset space, and may also represent that the at least one target object is not expected to be disturbed.

And when the at least one sensing data is identified and processed to obtain that the space contains at least one target object, further judging whether the at least one target object is in a preset space, and when the at least one target object is in the preset space, controlling the electronic equipment to enter a mute mode.

Here, when it is required to determine whether at least one target object is in a preset space through the at least one sensing data, the identifying the at least one sensing data to obtain an identification result includes:

identifying the at least one sensing data based on the corresponding appearance characteristics of the household objects of different types, and determining the type of the household objects contained in the space where the electronic equipment is located;

and determining whether the space where the at least one target object is located is a preset space or not based on the category of the household object.

Here, the category of the household object in the space where the electronic device is located may be determined by identifying the at least one sensing data; and determining the type of the space where the electronic equipment is located based on the type of the household object, and further judging whether the space where the electronic equipment is located is a preset space.

The category of the space is characterized by the function of the space, and the category of the space comprises a bedroom, a living room, a kitchen and the like.

It should be noted that, in the identifying of the at least one sensing data based on the appearance features corresponding to the different types of home furnishing objects, determining the type of the home furnishing object included in the space where the electronic device is located may be to construct a home furnishing object identification model by extracting the appearance features corresponding to the different home furnishing objects, and identifying the image data of the space where the electronic device is located in the at least one sensing data based on the home furnishing object identification model to obtain an identification result about the type of the home furnishing object included in the space where the electronic device is located. The categories of the household objects may include: beds, sofas, refrigerators, chairs, etc.

As an example, if it is determined that the household object in the space is a bed, the category of the space in which the electronic device is located may be considered as a bedroom. Here, since the bedroom belongs to the preset space, the electronic device needs to be controlled to perform the mute mode.

Here, when the at least one target object is in both the preset space and the preset state, it is also required to control the electronic device to enter the mute mode. The specific implementation is as described above and will not be described herein.

It should be noted that, after determining the category of the located space, the method may further include:

acquiring current time and current space;

judging whether the current time is within a preset time period or not, and judging whether the current space is a bedroom or not;

and determining that the current time is in a preset time period and the current space is a bedroom, and controlling the electronic equipment to enter a mute mode.

Here, the preset time period refers to a time period during which a person is resting, and may refer to 23: 00-6: 00. 13: 00-15: 00. when a person is in a bedroom and is in a preset time period, the person is in a sleeping state to a large extent, and the person is not expected to be disturbed at the time, the electronic device can be controlled to enter a mute mode.

Based on the above, the determining whether to control the electronic device to enter the mute mode based on the recognition result in step 102 may include at least one of:

determining that the space where the electronic equipment is located contains at least one target object, generating a control instruction, and controlling the electronic equipment to enter a mute mode based on the control instruction;

determining that the at least one target object is in a state of sending voice data, generating a control instruction, and controlling the electronic equipment to enter a mute mode based on the control instruction;

and determining that the at least one target object is in a preset space, generating a control instruction, and controlling the electronic equipment to enter a mute mode based on the control instruction.

The following summarizes several situations in which it is desirable to control an electronic device to enter a mute state:

when the fact that people are contained in the space is determined, the electronic equipment is controlled to enter a mute state;

when the fact that the space contains the person and the person is in the preset state is determined, the electronic equipment is controlled to enter the mute state; the preset state comprises: a state of uttering voice data, a working state, a learning state, a television watching state, a state in bed, and the like; the sound production state comprises: a call state, a talk state, etc.

When the fact that the space contains people is determined, and the space is a preset space, controlling the electronic equipment to enter a mute state; the preset space includes: bedrooms, study rooms, etc.

And when the fact that the space contains the person is determined, the space is a preset space, and the person is in a preset state, controlling the electronic equipment to enter a mute state.

When the fact that the space contains people is determined, the space is a bedroom, and the current time is in a preset time period, the electronic equipment is controlled to enter a mute state; the preset time period refers to a time period for a person to rest, and may refer to 23: 00-6: 00. 13: 00-15: 00.

it should be noted that, before acquiring at least one sensing data, the method further includes:

detecting whether the electronic equipment starts an automatic mute function or not;

determining to start an automatic mute function, and setting an acquisition period;

and determining the arrival of an acquisition period, and acquiring at least one sensing data.

Here, an option of an automatic mute function may be set in the smart phone, and if it is detected that the user selects the option of the automatic mute function, the automatic mute function of the present invention is applied; and detecting that the user does not select the option of the automatic mute function, not running the automatic mute function, and still performing according to a normal working mode.

And when detecting that the user selects the option of the automatic mute function, setting a collection period, and collecting data of the intelligent floor sweeping robot according to the set collection period in the working process. For example, if the acquisition cycle is set to be 10 minutes, data acquisition is performed every 10 minutes, when the acquired data determine that the space contains at least one target object, the intelligent sweeping robot is controlled to perform a silent mode, and when the acquired data determine that the space does not contain at least one target object, the intelligent sweeping robot is controlled to keep a default mode for cleaning.

And after entering a mute mode or a default mode, continuously working until an acquisition period is met, acquiring various data of the space once again, judging the various data, if the space contains at least one target object, continuously working in the mute mode, and if the space does not contain the at least one target object, jumping out of the mute mode and recovering to the default mode.

Here, the default mode is a cleaning mode set in advance, and is a non-silent mode.

It should be noted that, in order not to affect the normal work rest of the target object, the method further includes:

and controlling the electronic equipment to move to other spaces in response to the recognition result.

Here, the moving to the other space may be navigating to a nearest space nearby, and after the moving to the nearest space, if the space is found to also contain at least one target object when the acquisition period is satisfied for acquisition, the electronic device is controlled to move to the other space.

It should be noted that, when the user needs to move again after reaching all the rooms in this way, the user can select to move to the space where the target object is detected at the beginning.

As an example, when the intelligent floor sweeping robot moves to a bedroom and finds that there is a person in the bedroom when the acquisition period is met, the intelligent floor sweeping robot may be controlled to move to a space closest to the bedroom, for example, to a living room, and when the intelligent floor sweeping robot moves to the living room and finds that there is a person in the living room when the acquisition period is met after the intelligent floor sweeping robot moves to the living room, the intelligent floor sweeping robot is controlled to move to a space which is close to the living room and is different from the previous bedroom, for example, a kitchen. By analogy, the aim of not disturbing the work and rest of people is achieved in the cleaning process.

In order to clearly express the content of the embodiment of the invention, the description is made in conjunction with the specific application:

fig. 2 is a schematic diagram of an implementation scenario of a control method according to an embodiment of the present invention; as shown in fig. 2, fig. 2 shows a distribution map of household objects, from which the distribution of household objects in various areas, such as main bed, sub bed, kitchen, toilet, living room, dining room, balcony, etc., can be seen, wherein the living room has a sofa and a television; a cooking table is arranged in the kitchen; dining tables and dining chairs are arranged in the dining room; the secondary lying bed and the cabinet are arranged; a toilet and a wash platform are arranged in the toilet; the main bed is provided with a bed and a cabinet, and the target object on the bed is lying.

In fig. 2, the intelligent sweeping robot in the master position is performing cleaning processing based on the control instruction; in the process of executing cleaning treatment, the intelligent sweeping robot acquires image data of a main lying position through a visual sensor and an infrared sensor. In fig. 2, a target object is in a bed lying on the main bed, and the infrared sensor is matched to detect that heat exists on the bed, so that the target object is considered to be in a rest state, the condition of entering a silent mode is met, and the intelligent sweeping robot is controlled to carry out the silent mode.

The control method provided by the embodiment of the invention judges whether the space of the electronic equipment contains the target object by collecting at least one sensing data for identification so as to determine whether to control the electronic equipment to enter the mute mode. Therefore, the current space scene is automatically judged by automatically collecting various data of the space where the user is located, the user can automatically enter a mute mode, and the purpose of not disturbing the user can be achieved.

An embodiment of the present invention provides a control method, and fig. 3 is a schematic diagram illustrating an implementation flow of the control method provided in the embodiment of the present invention, as shown in fig. 3, the method mainly includes the following steps:

step 301, the electronic device receives a control command and starts cleaning.

It should be noted that the electronic device is an intelligent home electronic device, and may be an intelligent sweeping robot or the like. The intelligent floor sweeping robot is provided with at least one sensor, and the at least one sensor can be used for collecting image data, audio data, infrared data, position data and the like. Whether the space where the intelligent sweeping robot is located contains the target object or not is judged through the collected data.

The control command refers to a cleaning command. When cleaning is carried out, autonomous positioning and navigation can be carried out based on a home environment map of a space where the intelligent sweeping robot is located, and cleaning work is achieved.

Step 302, judging whether the automatic mute function is selected; if yes, go to step 303; if not, go to step 304.

It should be noted that, an option of an automatic mute function is set in the smart phone, and when it is detected that the user selects the option of the automatic mute function, the automatic mute function of the present invention is applied.

Step 303, judging whether the condition for entering the mute mode is met; if yes, go to step 305; if not, go to step 306.

It should be noted that, when it is detected that the user selects the option of the automatic muting function, an acquisition cycle is set, and the intelligent floor sweeping robot performs data acquisition according to the set acquisition cycle in the working process. For example, if the acquisition period is set to 10 minutes, data acquisition is performed every 10 minutes.

It should be further noted that the condition for entering the mute mode includes at least one of the following:

when the fact that people are contained in the space is determined, the electronic equipment is controlled to enter a mute state;

when the fact that the space contains the person and the person is in the preset state is determined, the electronic equipment is controlled to enter the mute state; the preset state comprises: a state of uttering voice data, a working state, a learning state, a television watching state, a state in bed, and the like; the sound production state comprises: a call state, a talk state, etc.

When the fact that the space contains people is determined, and the space is a preset space, controlling the electronic equipment to enter a mute state; the preset space includes: bedrooms, study rooms, etc.

And when the fact that the space contains the person is determined, the space is a preset space, and the person is in a preset state, controlling the electronic equipment to enter a mute state.

When the fact that the space contains people is determined, the space is a bedroom, and the current time is in a preset time period, the electronic equipment is controlled to enter a mute state; the preset time period refers to a time period for a person to rest, and may refer to 23: 00-6: 00. 13: 00-15: 00.

and step 304, in a default mode, normally executing cleaning work, and not executing condition judgment whether the mute mode is met or not.

It should be noted that, when it is detected that the user does not select the option of the automatic mute function, the automatic mute function is not operated, and the operation is still performed according to the normal operation mode. After the cleaning is completed, the flow is ended.

Step 305, entering a mute mode; proceed to step 307.

Step 306, default mode, cleaning is performed normally.

It should be noted that the collected data is used to determine that the space where the intelligent sweeping robot is located does not meet the condition of entering the silent mode, the intelligent sweeping robot is not controlled to enter the silent mode, and is still in the default mode, and cleaning work is normally performed.

307, working until an acquisition period is met; proceed to step 303.

It should be noted that, due to the arrangement of the collection period, the intelligent floor sweeping robot needs to collect data according to the set collection period in the working process. And when the acquisition period is met, data acquisition is carried out, and whether the space where the intelligent sweeping robot is located meets the condition of entering a silent mode or not is judged according to the acquired data.

When the space where the intelligent sweeping robot is located meets the condition of entering a silent mode, controlling the intelligent sweeping robot to keep working in the silent mode; and when the space where the intelligent sweeping robot is located is judged not to meet the condition of entering a silent mode, controlling the intelligent sweeping robot to work in a default mode before the intelligent sweeping robot is recovered.

And (5) circularly judging until the cleaning treatment is finished, and ending the flow.

The control method provided by the embodiment of the invention judges whether the space of the electronic equipment contains the target object by collecting at least one sensing data for identification so as to determine whether to control the electronic equipment to enter the mute mode. Therefore, the current space scene is automatically judged by automatically collecting various data of the space where the user is located, the user can automatically enter a mute mode, and the purpose of not disturbing the user can be achieved.

Based on the same inventive concept of the above embodiments, an embodiment of the present invention provides a control apparatus 400, and fig. 4 is a schematic structural diagram of the control apparatus 400 according to the embodiment of the present invention, and as shown in fig. 4, the control apparatus 400 is applied to an electronic device, and includes: an identification unit 401 and a determination unit 402; the identification unit 401 is configured to collect at least one sensing data, and identify the at least one sensing data to obtain an identification result; wherein the identification result comprises whether the space where the electronic equipment is located contains at least one target object;

the determining unit 402 is configured to determine whether to control the electronic device to enter a mute mode based on the identification result.

It should be noted that the identification result further includes: whether the at least one target object is in at least one of a preset space and a preset state; wherein the preset state comprises: a state of uttering voice data.

It should be further noted that the recognition unit 401 is further configured to recognize the at least one sensing data based on the voice feature of the at least one target object, and determine whether the at least one target object is in a state of sending out voice data.

It should be further noted that the identification unit 401 is further configured to identify the at least one sensing data based on the corresponding appearance features of the home furnishing objects of different categories, and determine the category of the home furnishing object included in the space where the electronic device is located; and determining whether the space where the at least one target object is located is a preset space or not based on the category of the household object.

The determining unit 402 further includes: an instruction generating unit 4021 and a control subunit 4022; the instruction generating unit 4021 and the control subunit 4022 are configured to execute at least one of the following:

the instruction generating unit 4021 is configured to determine that a space where the electronic device is located includes at least one target object, and generate a control instruction; the control subunit 4022 is configured to control the electronic device to enter a mute mode based on the control instruction;

the instruction generating unit 4021 is configured to determine that the at least one target object is in a state of sending voice data, and generate a control instruction; the control subunit 4022 is configured to control the electronic device to enter a mute mode based on the control instruction;

the instruction generating unit 4021 is configured to determine that the at least one target object is located in a preset space, and generate a control instruction; the control subunit 4022 is configured to control the electronic device to enter a mute mode based on the control instruction.

It should be noted that, because the principle of the control device 400 for solving the problem is similar to the control method applied to the electronic device, the specific implementation process and implementation principle of the control device 400 can be referred to the method and implementation process, and repeated details are not repeated.

The control device provided by the embodiment of the invention judges whether the space of the electronic equipment contains the target object or not by collecting at least one sensing data for identification so as to determine whether to control the electronic equipment to enter the mute mode or not. Therefore, the current space scene is automatically judged by automatically collecting various data of the space where the user is located, the user can automatically enter a mute mode, and the purpose of not disturbing the user can be achieved.

The components in the embodiments of the present invention may be integrated into one processing unit, or each unit may exist alone physically, or two or more units are integrated into one unit. The integrated unit can be realized in a form of hardware or a form of a software functional module.

Based on the understanding that the technical solution of the embodiments of the present invention essentially or a part of the technical solution contributing to the prior art, or all or part of the technical solution may be embodied in the form of a software product stored in a storage medium, and include several instructions for causing a computer device (which may be a personal computer, a server, or a network device, etc.) or a processor (processor) to execute all or part of the steps of the method of the embodiments of the present invention. And the aforementioned storage medium includes: a U-disk, a removable hard disk, a Read Only Memory (ROM), a Random Access Memory (RAM), a magnetic disk or an optical disk, and other various media capable of storing program codes.

Accordingly, embodiments of the present invention provide a computer storage medium storing a computer program that, when executed by at least one processor, performs the steps of the above-described embodiments.

Referring to fig. 5, a specific hardware structure of a control device 500 according to an embodiment of the present invention is shown, including: a network interface 501, a memory 502, and a processor 503; the various devices are coupled together by a bus system 504. It is understood that the bus system 504 is used to enable communications among the connections of these devices. The bus system 504 includes a power bus, a control bus, and a status signal bus in addition to a data bus. For clarity of illustration, however, the various buses are labeled as bus system 504 in fig. 5.

In the several embodiments provided in the present application, it should be understood that the disclosed apparatus and method may be implemented in other ways. The above-described device embodiments are merely illustrative, for example, the division of the unit is only a logical functional division, and there may be other division ways in actual implementation, such as: multiple units or devices may be combined, or may be integrated into another system, or some features may be omitted, or not implemented. In addition, the coupling, direct coupling or communication connection between the components shown or discussed may be through some interfaces, and the indirect coupling or communication connection between the devices or units may be electrical, mechanical or other forms.

The units described as separate parts may or may not be physically separate, and parts displayed as units may or may not be physical units, that is, may be located in one place, or may be distributed on a plurality of network units; some or all of the units can be selected according to actual needs to achieve the purpose of the solution of the embodiment.

The methods disclosed in the several method embodiments provided in the present application may be combined arbitrarily without conflict to obtain new method embodiments.

Features disclosed in several of the product embodiments provided in the present application may be combined in any combination to yield new product embodiments without conflict.

The features disclosed in the several method or apparatus embodiments provided in the present application may be combined arbitrarily, without conflict, to arrive at new method embodiments or apparatus embodiments.

The above description is only for the specific embodiments of the present invention, but the scope of the present invention is not limited thereto, and any person skilled in the art can easily conceive of the changes or substitutions within the technical scope of the present invention, and all the changes or substitutions should be covered within the scope of the present invention. Therefore, the protection scope of the present invention shall be subject to the protection scope of the appended claims.