阅读说明：本技术 烹饪器具及其控制方法和控制装置、可读存储介质 (Cooking appliance, control method and control device thereof, and readable storage medium ) 是由 潘海军 于 2021-09-27 设计创作，主要内容包括：本发明提出了一种烹饪器具及其控制方法和控制装置、可读存储介质,烹饪器具的控制方法可用于烹饪器具,烹饪器具包括门体,烹饪器具设置有至少一个图像采集装置,控制方法包括：获取门体的门体状态；根据门体状态,选择对至少一个图像采集装置获取的图像信息进行识别,得到识别信息；以及根据门体状态和识别信息,控制是否改变门体状态。本发明可实现烹饪器具的自动开关门操作,解放了用户的双手,极大程度上提升烹饪器具的自动化程度,并且方便用户使用。(The invention provides a cooking appliance, a control method and a control device thereof, and a readable storage medium, wherein the control method of the cooking appliance can be used for the cooking appliance, the cooking appliance comprises a door body, the cooking appliance is provided with at least one image acquisition device, and the control method comprises the following steps: acquiring the door body state of a door body; according to the state of the door body, selecting to identify the image information acquired by at least one image acquisition device to obtain identification information; and controlling whether to change the door body state or not according to the door body state and the identification information. The invention can realize the automatic door opening and closing operation of the cooking appliance, liberates the hands of a user, greatly improves the automation degree of the cooking appliance and is convenient for the user to use.)

1. A control method of a cooking appliance, which can be used for the cooking appliance, is characterized in that the cooking appliance comprises a door body, the cooking appliance is provided with at least one image acquisition device, and the control method comprises the following steps:

acquiring the door body state of the door body;

according to the door body state, selecting to identify the image information acquired by at least one image acquisition device to obtain identification information; and

and controlling whether the door body state is changed or not according to the door body state and the identification information.

2. The control method of the cooking appliance according to claim 1, wherein at least one of the image capturing devices comprises a first image capturing device, and when the door is closed, the control method specifically comprises:

selecting to identify first image information acquired by the first image acquisition device to obtain first identification information; and

and when the first identification information meets the opening condition, controlling the door body to be opened.

3. The control method of the cooking appliance according to claim 1, wherein at least one of the image capturing devices comprises a first image capturing device, and when the door is opened, the control method specifically comprises:

selecting to identify first image information acquired by the first image acquisition device to obtain first identification information; and

and when the first identification information meets a first closing condition, controlling the door body to be closed.

4. The control method of the cooking appliance according to claim 1, wherein at least one image acquisition device comprises a first image acquisition device and a second image acquisition device, and when the door body is opened, the control method specifically comprises the following steps:

selecting to identify first image information acquired by the first image acquisition device to obtain first identification information;

selecting to identify second image information acquired by the second image acquisition device to obtain second identification information; and

and when the first identification information meets a first closing condition and the second identification information meets a second closing condition, controlling the door body to be closed.

5. The control method of the cooking appliance according to any one of claims 1 to 4, further comprising:

acquiring a cooking state of the cooking appliance; and

and selecting to identify the image information acquired by at least one image acquisition device before the cooking is started or after the cooking is finished based on the cooking state to obtain the identification information.

6. The control method of a cooking appliance according to claim 2,

the starting conditions are as follows: the target object exists in the preset area.

7. The control method of a cooking appliance according to claim 3 or 4,

the first closing condition is as follows: the target object does not exist in the preset area.

8. The control method of a cooking appliance according to claim 6,

the preset area comprises a quadrangle, a first side and a second side of the quadrangle are parallel, the length of the first side is smaller than that of the second side, and the first side is overlapped with the wall surface where the door body is located;

a first included angle between a third side of the quadrangle and the first side is equal to a second included angle between a fourth side of the quadrangle and the first side.

9. The control method of a cooking appliance according to claim 4,

the second closing condition is as follows: no food material is present in the cooking cavity of the cooking appliance.

10. A cooking utensil's controlling means can be used to cooking utensil, its characterized in that, cooking utensil includes the door body, cooking utensil is provided with image acquisition device, controlling means includes:

the acquisition unit is used for acquiring the door body state of the door body;

the control unit is used for selectively identifying the image information acquired by at least one image acquisition device according to the state of the door body to obtain identification information; and controlling whether to change the door body state or not according to the door body state and the identification information.

11. A cooking appliance, comprising:

the cooking device comprises a body, wherein a cooking cavity is arranged in the body;

the door body is arranged on the body in an openable and closable manner;

the driving device is connected with the door body and used for driving the door body to open and close;

the at least one image acquisition device is arranged on the body;

the control device of the cooking appliance according to claim 10, wherein the control device of the cooking appliance is electrically connected to at least one of the image capturing device and the driving device.

12. The cooking appliance of claim 11, wherein the image capture device comprises:

the first image acquisition device is arranged on the body and faces to the door opening side of the body;

the second image acquisition device is arranged on the body and faces the inside of the cooking cavity.

13. A readable storage medium on which a program is stored, characterized in that the program, when executed by a processor, implements the steps of the control method of the cooking appliance according to any one of claims 1 to 9.

Technical Field

The invention relates to the technical field of kitchen appliances, in particular to a cooking appliance, a control method and a control device thereof and a readable storage medium.

Background

In the related art, a user needs to manually close the door body during the use of the cooking appliance. When a user needs to open or close the door body, the user often holds food materials in hands, and the door body is not convenient to close manually.

Disclosure of Invention

The present invention is directed to solving at least one of the problems of the prior art.

To this end, the invention provides a control method of a cooking appliance in a first aspect.

A second aspect of the present invention provides a control apparatus of a cooking appliance.

A third aspect of the invention provides a cooking appliance.

A fourth aspect of the invention provides a readable storage medium.

The invention provides a control method of a cooking appliance, which can be used for the cooking appliance, wherein the cooking appliance comprises a door body, the cooking appliance is provided with at least one image acquisition device, and the control method comprises the following steps: acquiring the door body state of a door body; according to the state of the door body, selecting to identify the image information acquired by at least one image acquisition device to obtain identification information; and controlling whether to change the door body state or not according to the door body state and the identification information.

The control method of the cooking appliance provided by the invention can realize automatic opening and closing of the door body of the cooking appliance, greatly improves the use convenience of the cooking appliance, particularly automatically opens and closes the door body when a user places and takes out food materials, and overcomes the defect that the user cannot conveniently open and close the door body manually.

Specifically, the cooking utensil includes a door body and an image acquisition device. Wherein, a cooking cavity is arranged in the cooking appliance and can be used for placing food materials to be cooked; the door body is arranged on the body of the cooking appliance in an openable and closable manner so as to open or close the cooking cavity. In addition, at least one image acquisition device is arranged on the body, and the image acquisition device can acquire image information during working. Specifically, the image acquisition device can acquire image information inside the cooking cavity and also can acquire image information outside the cooking cavity and around the body. Specifically, the cooking appliance may be provided with one image capturing device, or may be provided with a plurality of image capturing devices.

The control method of the cooking utensil provided by the invention comprises the steps of firstly obtaining the door body state of a door body, and selectively identifying image information obtained by at least one image acquisition device according to the door body state of the door body to obtain identification information; and then, determining whether the state of the door body needs to be changed according to the state of the door body and the recognized identification information so as to automatically open or close the door.

Specifically, when the door body is in a closed state, whether the door body needs to be opened or not can be determined according to the identified identification information; when the door body is in an opening state, the invention can determine whether the door body needs to be closed according to the identified identification information. Therefore, the cooking appliance applying the control method of the cooking appliance provided by the invention can realize the automatic opening and closing control of the door body, liberate the hands of a user, greatly improve the automation degree of the cooking appliance and facilitate the use of the user.

In some possible designs, at least one image acquisition device comprises a first image acquisition device, and when the door body is closed, the control method specifically comprises the following steps: selecting to identify first image information acquired by a first image acquisition device to obtain first identification information; and controlling the door body to be opened when the first identification information meets the opening condition.

In this design, the at least one image capture device comprises a first image capture device. The first image acquisition device is arranged on the door opening side of the cooking appliance and can be used for acquiring first image information of the door opening side of the cooking appliance.

When the door body is in a closed state, the first image information of the opening side of the cooking utensil, which is acquired by the first image acquisition device, is identified, and first identification information is obtained. Then, the invention judges whether the first identification information meets the opening condition; under the condition that the first identification information meets the opening condition, the door opening requirement is judged to exist at the moment, the door body is controlled to be changed from the closing state to the opening state, and then the door body is automatically opened; and under the condition that the first identification information does not meet the opening condition, judging that no door opening requirement exists at the moment, and controlling the door body to continuously keep a closed state.

That is, in this design, the present invention can use the first image information on the door-opening side of the cooking appliance as a determination condition for controlling the automatic opening of the door body.

In some possible designs, at least one image acquisition device comprises a first image acquisition device, and when the door body is opened, the control method specifically comprises the following steps: selecting to identify first image information acquired by a first image acquisition device to obtain first identification information; and controlling the door body to be closed when the first identification information meets the first closing condition.

In this design, the at least one image capture device comprises a first image capture device. The first image acquisition device is arranged on the door opening side of the cooking appliance and can be used for acquiring first image information of the door opening side of the cooking appliance.

When the door body is in an opening state, the first image information of the opening side of the cooking utensil, which is acquired by the first image acquisition device, is identified, and first identification information is obtained. Then, the invention judges whether the first identification information meets the first closing condition; under the condition that the first identification information meets the first closing condition, the door closing requirement is judged, the door body is controlled to be changed from the opening state to the closing state, and the door body is automatically closed; under the condition that the first identification information does not meet the first closing condition, the door closing requirement is judged not to exist at the moment, and the door body is controlled to continuously keep the opening state.

That is, in this design, the present invention can use the first image information on the opening side of the cooking appliance as the determination condition for controlling the automatic closing of the door.

In some possible designs, at least one image acquisition device comprises a first image acquisition device and a second image acquisition device, and when the door body is opened, the control method specifically comprises the following steps: selecting to identify first image information acquired by a first image acquisition device to obtain first identification information; selecting to identify second image information acquired by a second image acquisition device to obtain second identification information; and controlling the door body to be closed when the first identification information meets the first closing condition and the second identification information meets the second closing condition.

In this design, the at least one image capture device includes a first image capture device and a second image capture device. The first image acquisition device is arranged on the door opening side of the cooking appliance and can be used for acquiring first image information of the door opening side of the cooking appliance; the second image device is arranged in the cooking cavity of the cooking appliance and can be used for acquiring second image information in the cooking cavity.

When the door body is in an opening state, the cooking utensil opening side image recognition system can recognize first image information of the cooking utensil opening side collected by the first image collecting device and obtain first recognition information, and can also recognize second image information of the cooking cavity collected by the second image collecting device and obtain second recognition information. Then, the invention judges whether the first identification information meets the first closing condition, judges whether the second identification information meets the second closing condition; under the condition that the first identification information meets the first closing condition and the second identification information also meets the second closing condition, the door closing requirement is judged, the door body is controlled to be changed from the opening state to the closing state, and the door body is automatically closed; and under the condition that the first identification information does not meet the first closing condition or the second identification information does not meet the second closing condition, judging that no door closing requirement exists at the moment, and controlling the door body to continuously keep an opening state.

That is, in this design, the present invention can use the first image information on the opening side of the cooking appliance and the second image information in the cooking cavity as the determination conditions for controlling the automatic opening of the door.

In some possible designs, the control method of the cooking appliance further includes: acquiring a cooking state of the cooking appliance; and before the cooking is started or after the cooking is finished based on the cooking state, selecting to identify the image information acquired by at least one image acquisition device to obtain identification information.

In this configuration, the cooking state of the cooking appliance is first acquired before the selection of the identification of the image information acquired by the at least one image acquisition device. If the cooking appliance is positioned before the cooking starts, the user needs to put the food to be cooked into the cooking cavity, and the door needs to be closed after the food to be cooked is put into the cooking cavity. After the cooking appliance finishes cooking, it is described that the user needs to take the cooked food out of the cooking cavity, and the door needs to be closed after the food is taken out.

Therefore, when the cooking state of the cooking appliance is acquired before the cooking is started or after the cooking is finished, the method and the device can select to identify the image information acquired by the at least one image acquisition device, and control whether to change the state of the door body according to the acquired identification information and the state of the door body.

In some possible designs, the turn-on condition is: the target object exists in the preset area.

In this design, the start condition is that a target object exists within a preset area. If the target user is within the preset area, the user is indicated to be in the vicinity of the cooking appliance at the moment. Therefore, the door body is controlled to be opened under the condition that the door body is in a closed state and the target object exists in the preset area.

Specifically, the preset area may be set according to actual conditions, but it should be ensured that the preset area is set on the door opening side of the cooking appliance, and the area of the preset area is appropriate, so that when the user is in the preset area, it can be determined that the user is near the cooking appliance.

In some possible designs, the first shut down condition is: the target object does not exist in the preset area.

In this design, the first shut down condition is: the target object does not exist in the preset area. If the target user is within the preset area, it indicates that the user is away from the cooking appliance at this time. Therefore, the door body is controlled to be closed under the condition that the door body is in an opening state and no target object exists in the preset area.

In some possible designs, the preset area comprises a quadrangle, a first side and a second side of the quadrangle are parallel, the length of the first side is smaller than that of the second side, and the first side is coincided with the wall surface where the door body is located; a first angle between the third side and the first side of the quadrilateral is equal to a second angle between the fourth side and the first side of the quadrilateral.

In this design, the predetermined area includes a quadrilateral area. The first side of the quadrangle is superposed with a wall surface of the body provided with the door body, and the length of the first side is smaller than that of the second side. The second side of the quadrilateral is parallel to the first side. In addition, a first angle between a third side and a first side of the quadrangle is equal to a second angle between a fourth side and the first side of the quadrangle. Therefore, a certain offset between the user and a wall surface of the cooking appliance provided with the door body is ensured. That is, the user does not have to stand right in front of the cooking appliance (here, the side of the cooking appliance where the door is provided is the front side), and the user may have a certain offset to the left or the right, which can be regarded as the user being in the preset area.

More specifically, the distance between the first edge and the second edge is less than 1 meter or equal to 1 meter; the first included angle is greater than 90 ° and less than or equal to 120 °; the second included angle is greater than 90 ° and less than or equal to 120 °.

In some possible designs, the second shut down condition is: no food material is present in the cooking cavity of the cooking appliance.

In this design, the second shut down condition is: no food material is present in the cooking cavity of the cooking appliance. If no food exists in the cooking cavity of the cooking appliance, the user is indicated to take out the cooked food, and at the moment, the second identification information is judged to meet the second closing condition. Therefore, the door body is controlled to be automatically closed under the conditions that the door body is in an open state, no target object exists in the preset area, and no food material exists in the cooking cavity of the cooking appliance.

The second aspect of the present invention provides a control device for a cooking appliance, which can be used for the cooking appliance, wherein the cooking appliance includes a door body, the cooking appliance is provided with an image acquisition device, and the control device includes: the acquisition unit is used for acquiring the door body state of the door body; the control unit is used for selectively identifying the image information acquired by the at least one image acquisition device according to the state of the door body to obtain identification information; and controlling whether to change the door body state or not according to the door body state and the identification information.

The control device of the cooking appliance provided by the invention can realize automatic opening and closing of the door body of the cooking appliance, greatly improves the use convenience of the cooking appliance, particularly automatically opens and closes the door body when a user places and takes out food materials, and overcomes the defect that the user cannot conveniently open and close the door body manually.

Specifically, the cooking utensil includes a door body and an image acquisition device. Wherein, a cooking cavity is arranged in the cooking appliance and can be used for placing food materials to be cooked; the door body is arranged on the body of the cooking appliance in an openable and closable manner so as to open or close the cooking cavity. In addition, at least one image acquisition device is arranged on the body, and the image acquisition device can acquire image information during working. Specifically, the image acquisition device can acquire image information inside the cooking cavity and also can acquire image information outside the cooking cavity and around the body. Specifically, the cooking appliance may be provided with one image capturing device, or may be provided with a plurality of image capturing devices.

The control device of the cooking appliance comprises an acquisition unit and a control unit. The acquisition unit acquires the door body state of the door body, and selectively identifies the image information acquired by at least one image acquisition device according to the door body state of the door body to obtain identification information; and then, the control unit determines whether the state of the door body needs to be changed according to the state of the door body and the recognized identification information so as to automatically open or close the door.

Specifically, when the door body is in a closed state, whether the door body needs to be opened or not can be determined according to the identified identification information; when the door body is in an opening state, the invention can determine whether the door body needs to be closed according to the identified identification information. Therefore, the cooking appliance using the control device of the cooking appliance provided by the invention can realize automatic opening and closing control of the door body, liberate the hands of a user, greatly improve the automation degree of the cooking appliance and facilitate the use of the user.

A third aspect of the present invention provides a cooking appliance comprising: a body, wherein a cooking cavity is arranged in the body; the door body is arranged on the body in an openable manner; the driving device is connected with the door body and is used for driving the door body to open and close; at least one image acquisition device arranged on the body; in the control device of the cooking appliance designed as above, the control device of the cooking appliance is electrically connected to the at least one image capturing device and the driving device.

The cooking appliance provided by the invention comprises the control device of the cooking appliance designed as above. Therefore, the overall beneficial effects of the control device with the cooking appliance described above will not be discussed in detail herein.

Further, the cooking utensil further comprises a body, a door body, a driving device and at least one image acquisition device. Wherein, a cooking cavity is arranged in the body and can be used for placing food materials to be cooked; the door body is arranged on the body and can be arranged on the body in an opening and closing mode so as to open or close the cooking cavity, the driving device is connected with the door body, and the driving device is electrically connected with the control device of the cooking appliance and drives the door body to open or close under the control of the control device of the cooking appliance. In addition, at least one image acquisition device is arranged on the body and is electrically connected with the control device of the cooking utensil; at least one image acquisition device can acquire image information when working. Specifically, at least one image acquisition device can acquire image information inside the cooking cavity and also can acquire image information outside the cooking cavity and around the body. Specifically, the cooking appliance may be provided with one image capturing device, or may be provided with a plurality of image capturing devices.

In some possible designs, the image capture device includes: the first image acquisition device is arranged on the body and faces the door opening side of the body; the second image acquisition device is arranged on the body and faces the inside of the cooking cavity.

In the design, the image acquisition device comprises a first image acquisition device facing the door opening side of the door body; the door opening side refers to a side where a user needs to open or close the door body, namely the side where the door body is located, and is also the front side of the cooking appliance. When the door body of the cooking appliance is in an opening state, the first image acquisition device is controlled to acquire first image information outside the cooking cavity and on the door opening side of the body.

In this design, the image acquisition device further comprises a second image acquisition device facing the inside of the cooking cavity. The invention can control the second image acquisition device to acquire the second image information in the cooking cavity. And then whether the opening requirement is needed or not is judged according to the second image information of the position, and whether the first image information outside the cooking cavity needs to be further identified or not is judged.

In the above design, the cooking utensil proposed by the present invention can be the following products: microwave oven, steam ager, little steaming and baking all-in-one.

A fourth aspect of the present invention proposes a readable storage medium having stored thereon a program which, when executed by a processor, implements the steps of the control method of the cooking appliance as designed above.

The readable storage medium of the present invention, when the stored program is executed, can realize the steps of the control method of the cooking appliance designed as above. Therefore, all the advantages of the control method of the cooking appliance are provided, and are not discussed in detail herein.

Additional aspects and advantages of the invention will be set forth in part in the description which follows, and in part will be obvious from the description, or may be learned by practice of the invention.

Drawings

The above and/or additional aspects and advantages of the present invention will become apparent and readily appreciated from the following description of the embodiments, taken in conjunction with the accompanying drawings of which:

fig. 1 is a flowchart of a control method of a cooking appliance according to an embodiment of the present invention;

fig. 2 is a block diagram of a control apparatus of a cooking appliance according to an embodiment of the present invention;

fig. 3 is a flowchart of a control method of a cooking appliance according to an embodiment of the present invention;

fig. 4 is a schematic view showing the connection relationship of the components in the cooking appliance according to the embodiment of the present invention;

FIG. 5 is a simplified structural diagram of a cooking appliance in accordance with an embodiment of the present invention;

fig. 6 is a top view of a cooking appliance according to an embodiment of the present invention.

Wherein, the correspondence between the reference numbers and the part names in fig. 4 to 6 is:

the cooking system comprises a body 402, a cooking cavity 404, a door body 406, an image acquisition device 408, a first image acquisition device 410, a second image acquisition device 412 and a driving device 414.

Detailed Description

In order that the above objects, features and advantages of the present invention can be more clearly understood, a more particular description of the invention will be rendered by reference to the appended drawings. It should be noted that the embodiments and features of the embodiments of the present application may be combined with each other without conflict.

In the following description, numerous specific details are set forth in order to provide a thorough understanding of the present invention, however, the present invention may be practiced otherwise than as specifically described herein, and thus the scope of the present invention is not limited by the specific embodiments disclosed below.

A cooking appliance, a control method and a control apparatus thereof, and a readable storage medium thereof provided according to some embodiments of the present invention are described below with reference to fig. 1 to 6.

The first embodiment of the invention provides a control method of a cooking appliance, which can realize automatic opening and closing of a door body of the cooking appliance, greatly improves the use convenience of the cooking appliance, particularly automatically opens and closes the door body when a user places and takes out food materials, and overcomes the defect that the user is inconvenient to manually open and close the door body at the moment.

As shown in fig. 4, the cooking appliance includes a door 406 and an image capturing device 408. Wherein, a cooking cavity 404 is arranged in the cooking appliance, and the cooking cavity 404 can be used for placing food materials to be cooked; the door 406 is openably and closably disposed on the body 402 of the cooking appliance to open or close the cooking cavity 404. In addition, at least one image capturing device 408 is disposed on the body 402, and the image capturing device 408 is operable to capture image information. Specifically, the image capturing device 408 may capture image information of the inside of the cooking cavity 404, or image information of the outside of the cooking cavity 404 and the periphery of the main body 402. Specifically, the cooking appliance may be provided with one image pickup device 408, or may be provided with a plurality of image pickup devices 408.

As shown in fig. 1, a method for controlling a cooking appliance according to a first embodiment of the present invention includes:

step 102, acquiring the door body state of a door body;

104, according to the state of the door body, selectively identifying the image information acquired by at least one image acquisition device to obtain identification information;

and step 106, controlling whether to change the door body state or not according to the door body state and the identification information.

According to the control method of the cooking utensil, firstly, the door body state of the door body is obtained, and the image information obtained by at least one image acquisition device is selected to be identified according to the door body state of the door body, so that the identification information is obtained; and then, determining whether the state of the door body needs to be changed according to the state of the door body and the recognized identification information so as to automatically open or close the door.

Specifically, when the door body is in a closed state, whether the door body needs to be opened or not can be determined according to the identified identification information; when the door body is in an opening state, the invention can determine whether the door body needs to be closed according to the identified identification information. Therefore, the cooking appliance applying the control method of the cooking appliance provided by the invention can realize the automatic opening and closing control of the door body, liberate the hands of a user, greatly improve the automation degree of the cooking appliance and facilitate the use of the user.

A second embodiment of the present invention provides a method for controlling a cooking appliance, which further includes, based on the first embodiment:

the at least one image capture device 408 includes a first image capture device 410. The first image capturing device 410 is disposed on the door opening side of the cooking appliance and can be used to obtain first image information of the door opening side of the cooking appliance.

When the door body is in a closed state, the first image information of the opening side of the cooking utensil, which is acquired by the first image acquisition device, is identified, and first identification information is obtained. Then, the invention judges whether the first identification information meets the opening condition; under the condition that the first identification information meets the opening condition, the door opening requirement is judged to exist at the moment, the door body is controlled to be changed from the closing state to the opening state, and then the door body is automatically opened; and under the condition that the first identification information does not meet the opening condition, judging that no door opening requirement exists at the moment, and controlling the door body to continuously keep a closed state.

That is, in this embodiment, the present invention may use the first image information of the opening side of the cooking appliance as the determination condition for controlling the automatic opening of the door body.

A third embodiment of the present invention provides a method for controlling a cooking appliance, which further includes, based on the first embodiment:

the at least one image capture device 408 includes a first image capture device 410. The first image capturing device 410 is disposed on the door opening side of the cooking appliance and can be used to obtain first image information of the door opening side of the cooking appliance.

When the door body is in an opening state, the first image information of the opening side of the cooking utensil, which is acquired by the first image acquisition device, is identified, and first identification information is obtained. Then, the invention judges whether the first identification information meets the first closing condition; under the condition that the first identification information meets the first closing condition, the door closing requirement is judged, the door body is controlled to be changed from the opening state to the closing state, and the door body is automatically closed; under the condition that the first identification information does not meet the first closing condition, the door closing requirement is judged not to exist at the moment, and the door body is controlled to continuously keep the opening state.

That is, in this embodiment, the present invention can use the first image information on the opening side of the cooking appliance as the determination condition for controlling the automatic closing of the door.

A fourth embodiment of the present invention provides a method for controlling a cooking appliance, which further includes, based on the first embodiment:

the at least one image capture device 408 includes a first image capture device 410 and a second image capture device 412. The first image acquisition device 410 is arranged on the door opening side of the cooking appliance and can be used for acquiring first image information of the door opening side of the cooking appliance; the second imaging device is disposed within the cooking cavity 404 of the cooking appliance and is operable to obtain second image information within the cooking cavity 404.

When the door body is in an opening state, the cooking utensil opening side image recognition system can recognize first image information of the cooking utensil opening side collected by the first image collecting device and obtain first recognition information, and can also recognize second image information of the cooking cavity collected by the second image collecting device and obtain second recognition information. Then, the invention judges whether the first identification information meets the first closing condition, judges whether the second identification information meets the second closing condition; under the condition that the first identification information meets the first closing condition and the second identification information also meets the second closing condition, the door closing requirement is judged, the door body is controlled to be changed from the opening state to the closing state, and the door body is automatically closed; and under the condition that the first identification information does not meet the first closing condition or the second identification information does not meet the second closing condition, judging that no door closing requirement exists at the moment, and controlling the door body to continuously keep an opening state.

That is, in this embodiment, the present invention may use the first image information of the opening side of the cooking appliance and the second image information of the cooking cavity as the determination conditions for controlling the automatic opening of the door.

On the basis of the first to fourth embodiments, further, before the image information acquired by the at least one image acquisition device is selected to be identified, the cooking state of the cooking appliance is acquired first. If the cooking appliance is positioned before the cooking starts, the user needs to put the food to be cooked into the cooking cavity, and the door needs to be closed after the food to be cooked is put into the cooking cavity. After the cooking appliance finishes cooking, it is described that the user needs to take the cooked food out of the cooking cavity, and the door needs to be closed after the food is taken out.

Therefore, when the cooking state of the cooking appliance is acquired before the cooking is started or after the cooking is finished, the method and the device can select to identify the image information acquired by the at least one image acquisition device, and control whether to change the state of the door body according to the acquired identification information and the state of the door body.

On the basis of the second embodiment, the starting condition is that the target object exists in the preset area a. If the target user is within the preset area A, the user is indicated to be in the vicinity of the cooking appliance at the moment. Therefore, when the door body is in a closed state and the target object exists in the preset area a, the door body is controlled to be opened.

Specifically, the preset area a may be set according to actual conditions, but it should be ensured that the preset area a is set on the door opening side of the cooking appliance, and the area of the preset area a is appropriate, so that when the user is in the preset area a, it can be determined that the user is near the cooking appliance.

On the basis of the third and fourth embodiments, further, as shown in fig. 6, the first closing condition is: the target object does not exist in the preset area a. If the target user is within the preset area a, it indicates that the user is away from the cooking appliance at this time. Therefore, the door body is controlled to be closed under the condition that the door body is in an opening state and no target object exists in the preset area A.

Specifically, as shown in fig. 6, the preset area a includes a quadrangular area. The first side L1 of the quadrangle is parallel to the second side L2, the first side L1 is overlapped with a wall surface of the main body provided with the door body, and the length of one side L1 is smaller than that of the second side L2. Furthermore, a first angle α 1 between the third side L3 and the first side L1 of the quadrilateral is equal to a second angle α 2 between the fourth side L4 and the first side L1 of the quadrilateral.

More specifically, as shown in fig. 6, the distance H between the first side L1 and the second side L2 is less than 1 meter or equal to 1 meter, the first included angle α 1 is greater than 90 ° and less than or equal to 120 °, and the second included angle α 2 is greater than 90 ° and less than or equal to 120 °.

In addition, as shown in fig. 6, the limitation that H is less than or equal to 1 meter ensures that the distance between the user and the cooking appliance is close enough, so that whether the user is near the cooking appliance can be accurately judged. The first included angle alpha 1 and the second included angle alpha 2 are limited to be larger than 90 degrees and smaller than or equal to 120 degrees, and certain offset between a user and a wall surface of the cooking appliance provided with the door body is guaranteed. That is, the user does not have to stand right in front of the cooking appliance (here, the side of the cooking appliance where the door is disposed is the front side), and the user may have a certain offset to the left or the right, which can be regarded as the user being in the preset area a.

In an embodiment, the quadrilateral is an isosceles trapezoid. The isosceles trapezoid has a first side L1 at its upper base, a second side L2 at its lower base, and a third side L3 and a fourth side L4 at its two waists.

In a specific embodiment, the distance H between the first side L1 and the second side L2 may be 0.2 meter, 0.5 meter, 0.8 meter, 1.0 meter, etc., and is not limited thereto, as will be understood by those skilled in the art.

In a specific embodiment, the first included angle α 1 may be 90 °, 95 °, 100 °, 105 °, 110 °, 115 °, 120 °, etc., and is not particularly limited, and can be understood by those skilled in the art.

In a specific embodiment, the second included angle α 2 may be 90 °, 95 °, 100 °, 105 °, 110 °, 115 °, 120 °, etc., and is not particularly limited, and can be understood by those skilled in the art. On the basis of the fourth embodiment, further, the second closing condition is: no food material is present in the cooking cavity of the cooking appliance. If no food exists in the cooking cavity of the cooking appliance, the user is indicated to take out the cooked food, and at the moment, the second identification information is judged to meet the second closing condition. Therefore, when the door body is in an open state, and no target object exists in the preset area A and no food material exists in the cooking cavity of the cooking appliance, the door body is controlled to be automatically closed.

As shown in fig. 2, a fifth embodiment of the present invention provides a control device 200 for a cooking appliance, which can realize automatic opening and closing of a door of the cooking appliance, greatly improves convenience of use of the cooking appliance, and particularly, automatically opens and closes the door when a user places and takes out food, thereby solving a drawback that the user is not convenient to manually open and close the door at this time.

As shown in fig. 4, the cooking appliance includes a door 406 and an image capturing device 408. Wherein, a cooking cavity 404 is arranged in the cooking appliance, and the cooking cavity 404 can be used for placing food materials to be cooked; the door 406 is openably and closably disposed on the body 402 of the cooking appliance to open or close the cooking cavity 404. In addition, at least one image capturing device 408 is disposed on the body 402, and the image capturing device 408 is operable to capture image information. Specifically, the image capturing device 408 may capture image information of the inside of the cooking cavity 404, or image information of the outside of the cooking cavity 404 and the periphery of the main body 402. Specifically, the cooking appliance may be provided with one image pickup device 408, or may be provided with a plurality of image pickup devices 408.

As shown in fig. 2, the control device 200 of the cooking appliance according to the present invention includes an acquisition unit 202 and a control unit 204. The obtaining unit 202 obtains a door body state of a door body, and selectively identifies image information obtained by at least one image acquisition device according to the door body state of the door body to obtain identification information; then, the control unit 204 determines whether the state of the door body needs to be changed according to the state of the door body and the recognized identification information, so as to automatically open or close the door.

Specifically, when the door body is in a closed state, whether the door body needs to be opened or not can be determined according to the identified identification information; when the door body is in an opening state, the invention can determine whether the door body needs to be closed according to the identified identification information. Therefore, the cooking appliance using the control device 200 of the cooking appliance provided by the invention can realize automatic opening and closing control of the door body, liberate the hands of a user, greatly improve the automation degree of the cooking appliance and facilitate the use of the user.

A sixth embodiment of the present invention provides a control device 200 for a cooking appliance, further comprising, in addition to the fifth embodiment:

the at least one image capture device includes a first image capture device. The first image acquisition device is arranged on the door opening side of the cooking appliance and can be used for acquiring first image information of the door opening side of the cooking appliance.

When the door body is in a closed state, the control unit 204 may identify the first image information of the cooking appliance on the door opening side, which is acquired by the first image acquisition device, and obtain first identification information. Then, the control unit 204 determines whether the first identification information satisfies the activation condition; under the condition that the first identification information meets the opening condition, the door opening requirement is judged to exist at the moment, and the control unit 204 controls the door body to be changed from the closing state to the opening state, so that the door body is automatically opened; under the condition that the first identification information does not meet the opening condition, it is judged that no door opening requirement exists at the moment, and the control unit 204 controls the door body to continuously keep the closing state.

That is, in this embodiment, the present invention may use the first image information of the opening side of the cooking appliance as the determination condition for controlling the automatic opening of the door body.

A seventh embodiment of the present invention provides a control device 200 for a cooking appliance, further comprising:

the at least one image capture device 408 includes a first image capture device 410. The first image capturing device 410 is disposed on the door opening side of the cooking appliance and can be used to obtain first image information of the door opening side of the cooking appliance.

When the door body is in the open state, the control unit 204 may identify the first image information of the cooking appliance on the open side acquired by the first image acquisition device, and obtain the first identification information. Then, the control unit 204 determines whether the first identification information satisfies a first closing condition; under the condition that the first identification information meets the first closing condition, it is judged that a door closing requirement exists at the moment, and the control unit 204 controls the door body to be changed from an opening state to a closing state, so that the door body is automatically closed; under the condition that the first identification information does not meet the first closing condition, it is determined that no door closing requirement exists at the moment, and the control unit 204 controls the door body to continuously keep the opening state.

That is, in this embodiment, the present invention can use the first image information on the opening side of the cooking appliance as the determination condition for controlling the automatic closing of the door.

An eighth embodiment of the present invention provides a control device 200 for a cooking appliance, further comprising, in addition to the fifth embodiment:

the at least one image capture device 408 includes a first image capture device 410 and a second image capture device 412. The first image acquisition device 410 is arranged on the door opening side of the cooking appliance and can be used for acquiring first image information of the door opening side of the cooking appliance; the second imaging device is disposed within the cooking cavity 404 of the cooking appliance and is operable to obtain second image information within the cooking cavity 404.

When the door body is in an open state, the control unit 204 can identify first image information of the opening side of the cooking appliance, which is acquired by the first image acquisition device, and obtain first identification information, and the control unit 204 can also identify second image information in the cooking cavity, which is acquired by the second image acquisition device, and obtain second identification information. Then, the control unit 204 determines whether the first identification information satisfies a first closing condition, and determines whether the second identification information satisfies a second closing condition; under the condition that the first identification information meets the first closing condition and the second identification information also meets the second closing condition, it is judged that a door closing requirement exists at the moment, and the control unit 204 controls the door body to be changed from an opening state to a closing state, so that the door body is automatically closed; under the condition that the first identification information does not satisfy the first closing condition or the second identification information does not satisfy the second closing condition, it is determined that no door closing requirement exists at the moment, and the control unit 204 controls the door body to continuously keep the opening state.

That is, in this embodiment, the present invention may use the first image information of the opening side of the cooking appliance and the second image information of the cooking cavity as the determination conditions for controlling the automatic opening of the door.

On the basis of the fifth to eighth embodiments, further, the obtaining unit 202 first obtains the cooking state of the cooking appliance before selecting to identify the image information obtained by the at least one image pickup device. If the cooking appliance is positioned before the cooking starts, the user needs to put the food to be cooked into the cooking cavity, and the door needs to be closed after the food to be cooked is put into the cooking cavity. After the cooking appliance finishes cooking, it is described that the user needs to take the cooked food out of the cooking cavity, and the door needs to be closed after the food is taken out.

Therefore, when the cooking state of the cooking appliance is acquired before the cooking is started or after the cooking is finished, the method and the device can select to identify the image information acquired by the at least one image acquisition device, and control whether to change the state of the door body according to the acquired identification information and the state of the door body.

On the basis of the sixth embodiment, further, the starting condition is that the target object exists in the preset area a. If the target user is within the preset area A, the user is indicated to be in the vicinity of the cooking appliance at the moment. Therefore, when the door body is in a closed state and the target object exists in the preset area a, the door body is controlled to be opened.

Specifically, the preset area a may be set according to actual conditions, but it should be ensured that the preset area a is set on the door opening side of the cooking appliance, and the area of the preset area a is appropriate, so that when the user is in the preset area a, it can be determined that the user is near the cooking appliance.

On the basis of the sixth and seventh embodiments, further, as shown in fig. 6, the first closing condition is: the target object does not exist in the preset area a. If the target user is within the preset area a, it indicates that the user is away from the cooking appliance at this time. Therefore, the door body is controlled to be closed under the condition that the door body is in an opening state and no target object exists in the preset area A.

Specifically, as shown in fig. 6, the preset area a includes a quadrangular area. The first side L1 of the quadrangle is parallel to the second side L2, the first side L1 is overlapped with a wall surface provided with the door body, and the length of one side L1 is smaller than that of the second side L2. Furthermore, a first angle α 1 between the third side L3 and the first side L1 of the quadrilateral is equal to a second angle α 2 between the fourth side L4 and the first side L1 of the quadrilateral.

More specifically, as shown in fig. 6, the distance H between the first side L1 and the second side L2 is less than 1 meter or equal to 1 meter, the first included angle α 1 is greater than 90 ° and less than or equal to 120 °, and the second included angle α 2 is greater than 90 ° and less than or equal to 120 °.

In addition, as shown in fig. 6, the limitation that H is less than or equal to 1 meter ensures that the distance between the user and the cooking appliance is close enough, so that whether the user is near the cooking appliance can be accurately judged. The first included angle alpha 1 and the second included angle alpha 2 are limited to be larger than 90 degrees and smaller than or equal to 120 degrees, and certain offset between a user and a wall surface of the cooking appliance provided with the door body is guaranteed. That is, the user does not have to stand right in front of the cooking appliance (here, the side of the cooking appliance where the door is disposed is the front side), and the user may have a certain offset to the left or the right, which can be regarded as the user being in the preset area a.

In an embodiment, the quadrilateral is an isosceles trapezoid. The isosceles trapezoid has a first side L1 at its upper base, a second side L2 at its lower base, and a third side L3 and a fourth side L4 at its two waists.

In a specific embodiment, the distance H between the first side L1 and the second side L2 may be 0.2 meter, 0.5 meter, 0.8 meter, 1.0 meter, etc., and is not limited thereto, as will be understood by those skilled in the art.

In a specific embodiment, the first included angle α 1 may be 90 °, 95 °, 100 °, 105 °, 110 °, 115 °, 120 °, etc., and is not particularly limited, and can be understood by those skilled in the art.

In a specific embodiment, the second included angle α 2 may be 90 °, 95 °, 100 °, 105 °, 110 °, 115 °, 120 °, etc., and is not particularly limited, and can be understood by those skilled in the art.

On the basis of the eighth embodiment, further, the second closing condition is: no food material is present in the cooking cavity of the cooking appliance. If no food exists in the cooking cavity of the cooking appliance, the user is indicated to take out the cooked food, and at the moment, the second identification information is judged to meet the second closing condition. Therefore, when the door body is in an open state, and no target object exists in the preset area A and no food material exists in the cooking cavity of the cooking appliance, the door body is controlled to be automatically closed.

As shown in fig. 4, 5 and 6, a ninth embodiment of the present invention proposes a cooking appliance including a control device of the cooking appliance as in the above embodiments. Therefore, the overall beneficial effects of the control device with the cooking appliance described above will not be discussed in detail herein.

Further, as shown in fig. 4, the cooking appliance further includes a body 402, a door 406, a driving device 414, and at least one image capturing device 408. Wherein, a cooking cavity 404 is arranged inside the body 402, and the cooking cavity 404 can be used for placing food materials to be cooked; the door 406 is disposed on the body 402 and openably and closably disposed on the body 402 to open or close the cooking cavity 404, the driving device 414 is connected to the door 406, and the driving device 414 is electrically connected to the control device of the cooking appliance and drives the door 406 to open or close under the control of the control device of the cooking appliance. In addition, at least one image acquisition device 408 is arranged on the body 402 and is electrically connected with the control device of the cooking appliance; at least one image capture device 408 is operable to capture image information.

Specifically, as shown in fig. 4, at least one image capturing device 408 may capture image information of both the inside of the cooking cavity 404 and the outside of the cooking cavity 404 and the periphery of the body 402. Specifically, the cooking appliance may be provided with one image pickup device 408, or may be provided with a plurality of image pickup devices 408.

In this embodiment, further, as shown in fig. 4, the image capturing device 408 includes a first image capturing device 410 facing the door opening side of the door body 406; the above-mentioned door opening side refers to a side where the user needs to open or close the door 406, that is, the side where the door 406 is located, and is also the front side of the cooking appliance. When the door 406 of the cooking appliance is in an open state, the invention controls the first image acquisition device 410 to acquire the first image information outside the cooking cavity 404 and on the open side of the body 402.

In this embodiment, further, as shown in fig. 4, the image capturing device 408 further comprises a second image capturing device 412 facing the inside of the cooking chamber 404. The present invention controls the second image pickup device 412 to pick up the second image information inside the cooking chamber 404. And then, whether the opening is needed or not is judged according to the second image information of the position, and whether the first image information outside the cooking cavity 404 needs to be further identified or not is judged.

In this embodiment, further, the cooking appliance proposed by the present invention may be the following product: a microwave oven, an oven, a steam box or a micro-steaming and baking integrated machine.

In this embodiment, further, the driving device 414 may be driven by a combination of a motor and a gear, or by a combination of a motor and a lead screw. The driving of the door 406 can be realized, and the driving will not be discussed herein, which will be understood by those skilled in the art.

In this embodiment, further, the door body 406 may be rotatably connected to the body 402, or may be slidably mounted on the body 402, which is not limited herein.

A tenth embodiment of the present invention proposes a readable storage medium (not shown in the drawings) which stores a program that, when executed, realizes the steps of the control method of the cooking appliance as in the above-described embodiments.

Accordingly, the readable storage medium has all the advantageous effects of the above-described control method of the cooking appliance, and will not be discussed in detail herein.

In the related art, after the food is cooked, a person is required to pull open the oven door or click a button on the equipment to open the oven door, and then the food is taken out. Correspondingly, after the food material is taken out, the user needs to manually close the door body. The above process is not convenient for the user to operate.

The invention provides a cooking utensil and a control method thereof, which can realize that when a user stands in front of a door body, the door body is automatically opened; when the user leaves the cooking appliance, the door body is automatically closed.

As shown in fig. 4, 5 and 6, the cooking appliance of the present invention at least includes the following components:

the first image capturing device 410: is disposed towards the outside of the cooking chamber 404 and is used to collect and analyze first image information outside the cooking chamber 404 (in particular to collect a user outside the cooking chamber 404). The first image capturing device 410 may be a camera.

The second image capturing device 412: towards the interior of the cooking chamber 404 and is used to collect and analyze second image information within the cooking chamber 404 (in particular to collect whether food material is present within the cooking chamber 404). The second image capturing device 412 may be a camera.

The driving device 414: the door body 406 can be controlled to be automatically opened and closed.

Control device of cooking utensil: can be used for controlling the cooking utensil to cook and sending control information of closing or opening to the driving device 414 to control the opening and closing of the door body 406.

In a specific embodiment, the control flow of the cooking appliance provided by the invention is as follows:

the first step is as follows: after the food material is cooked, the user walks to the front of the cooking appliance.

The second step is that: the first image pickup device 410 always picks up image information outside the cooking chamber 404. When the user stands in front of the cooking appliance, the first image acquisition device 410 acquires the third image information and identifies the third image information, so that the angle between the user and the cooking appliance can be identified, the body of the user can deviate from the cooking appliance by a certain angle, the user can be considered to want to open the door body 406, the deviation of the angle range is not necessarily plus or minus 20 degrees, and the adjustment can be carried out according to the actual situation.

The third step: when the first image acquisition device 410 detects that a user is present and the user is in the preset area a, it is determined that the user needs to open the door body 406; a notification is sent to the control device of the cooking device, the control device of the cooking device sends a command for opening the door 406 to the driving device 414 of the door 406, and the door 406 is controlled to be automatically opened.

The fourth step: after the door body 406 is automatically opened, the user takes away the food materials and leaves.

The fifth step: the second image capturing device 412 has been capturing second image information in the cooking cavity 404 and recognizing the food material in the second image information. When the food material is removed, the second image capturing device 412 recognizes that the cooking cavity 404 is empty and feeds back the result that the cooking cavity 404 is empty to the control device of the cooking apparatus.

And a sixth step: meanwhile, the first image capturing device 410 always captures first image information in front of the cooking appliance and performs person identification on the first image information; when the user leaves, the first image capturing device 410 may recognize that there is no user outside the cooking appliance, and feed back the result that the user is not in front of the cooking appliance to the control device of the cooking appliance.

The seventh step: a decision is made according to the results of the fifth step and the sixth step, and if the following two conditions are simultaneously met (the food in the cooking cavity 404 is empty and no user is in front of the cooking appliance), the user is considered to leave holding the food, and the driving device 414 is notified to close the door 406.

Eighth step: after receiving the command of closing the door 406, the driving device 414 controls the door 406 to automatically close.

The following describes a control method of the cooking appliance according to the present invention with reference to fig. 3. As shown in fig. 3, the method for controlling a cooking appliance includes:

step 302, finishing cooking of food materials;

step 304, the user walks to the front of the cooking appliance;

step 306, a first image acquisition device acquires first image information outside the cooking cavity;

step 308, identifying the first image information and judging whether the first image information meets the starting condition, if so, executing step 310, otherwise, ending;

step 310, the first image acquisition device informs a control device of the cooking appliance to open a door body;

step 312, the control device of the cooking appliance sends a door opening signal to the driving device;

step 314, automatically opening the door body, and enabling the user to leave after taking away food materials;

step 316, the second image capturing device captures second image information in the cooking cavity

Step 318, identifying the second image information and determining whether the second closing condition is satisfied, if so, executing step 320, otherwise, ending;

step 320, a first image acquisition device acquires first image information outside the cooking cavity;

step 322, identifying the first image information and determining whether the first closing condition is satisfied, if so, executing step 324, otherwise, ending;

step 324, the first image acquisition device informs a control device of the cooking appliance to close the door body;

step 326, the control device of the cooking appliance sends a door closing signal to the driving device;

and step 328, automatically closing the door body.

Specifically, in step 308, the target user in the third image information is identified, and it is determined whether the target user is in the preset area a. If the target user is not in the preset area A, judging that the third image information does not meet the starting condition; and if the target user is in the preset area A, judging that the third image information does not meet the starting condition.

Specifically, in step 318, the food in the second image information is identified, and it is determined whether there is a food in the second image information. If no food material exists in the second image information, judging that the second image information meets a second closing condition; and if the second image information contains the food material, judging that the second image information does not meet the second closing condition.

Specifically, in step 318, the user in the first image information is identified, and it is determined whether the user is in the preset area a. If the user is not in the preset area A, judging that the first image information meets a first closing condition; and if the target user is still in the preset area A, judging that the first image information does not meet the first closing condition.

Therefore, the automatic opening device can realize the automatic opening of the door body of the cooking appliance, greatly improves the use convenience of the cooking appliance, particularly automatically opens the door body before a user needs to take out food materials after cooking is finished, and overcomes the defect that the user cannot conveniently and manually open the door body of the cooking appliance.

In addition, the automatic closing device can also realize the automatic closing of the door body of the cooking appliance, greatly improves the use convenience of the cooking appliance, particularly automatically closes the door body after a user takes out food materials after cooking is finished, and overcomes the defect that the user cannot conveniently close the door body of the cooking appliance at the moment.

Furthermore, in the process of controlling the door body to be automatically closed, whether food exists in the cooking cavity or not is detected, whether a user is far away from a cooking appliance or not is detected, and the time node for controlling the door to be automatically closed is more accurate.

In a specific embodiment, the cooking utensil provided by the invention can be the following products: a microwave oven, an oven, a steam box or a micro-steaming and baking integrated machine.

In the description of the present invention, the terms "plurality" or "a plurality" refer to two or more, and unless otherwise specifically limited, the terms "upper", "lower", and the like indicate orientations or positional relationships based on the orientations or positional relationships shown in the drawings, and are merely for convenience in describing the present invention and simplifying the description, but do not indicate or imply that the referred device or element must have a specific orientation, be constructed in a specific orientation, and be operated, and thus should not be construed as limiting the present invention; the terms "connected," "mounted," "secured," and the like are to be construed broadly and include, for example, fixed connections, removable connections, or integral connections; may be directly connected or indirectly connected through an intermediate. The specific meanings of the above terms in the present invention can be understood by those skilled in the art according to specific situations.

In the description herein, the description of the terms "one embodiment," "some embodiments," "specific embodiments," etc., means that a particular feature, structure, material, or characteristic described in connection with the embodiment or example is included in at least one embodiment or example of the invention. In this specification, the schematic representations of the terms used above do not necessarily refer to the same embodiment or example. Furthermore, the particular features, structures, materials, or characteristics described may be combined in any suitable manner in any one or more embodiments or examples.

The above is only a preferred embodiment of the present invention, and is not intended to limit the present invention, and various modifications and changes will occur to those skilled in the art. Any modification, equivalent replacement, or improvement made within the spirit and principle of the present invention should be included in the protection scope of the present invention.