阅读说明：本技术 一种实现家电协同工作的智能手机 (Smart phone for realizing cooperative work of household appliances ) 是由 林庆华 于 2021-08-17 设计创作，主要内容包括：本发明提供了一种实现家电协同工作的智能手机包括：采集模块,用于获取用户的任务指令,控制模块,用于基于任务指令,生成子操作命令,切换模块,用于基于子操作命令,切换子家电的工作状态,使得住宅内家电和家电互联组成系统,增强协同工作能力,实现智能家居功能。(The invention provides a smart phone for realizing household appliance cooperative work, which comprises: the system comprises a collection module, a control module and a switching module, wherein the collection module is used for obtaining a task instruction of a user, the control module is used for generating a sub-operation command based on the task instruction, and the switching module is used for switching the working state of sub-household appliances based on the sub-operation command, so that the household appliances and the household appliances in a house are interconnected to form a system, the cooperative working capacity is enhanced, and the intelligent home function is realized.)

1. A smart phone for realizing cooperative work of smart appliances is characterized by comprising:

the acquisition module is used for acquiring a task instruction of a user;

the control module is used for generating a sub-operation command based on the task instruction;

and the switching module is used for switching the working state of the sub-household appliance based on the sub-operation command.

2. The smart phone of claim 1, wherein the sub-appliances comprise: any one or combination of a plurality of intelligent cameras, a face recognition access control system, an intelligent warm air system, an intelligent curtain and an intelligent switch.

3. The smart phone of claim 1, wherein the sub-operation command comprises: a single command to a single sub-appliance, a comprehensive command to a single sub-appliance, or a linkage command to a plurality of sub-appliances.

4. The smart phone of claim 1, wherein the control module comprises:

a positioning unit: the position information of the smart phone is acquired;

a control unit: the intelligent equipment is used for capturing the moving track of the intelligent mobile phone when the distance between the intelligent mobile phone and the residence, which is acquired based on the position information, is smaller than a preset value, acquiring the action track of the user, estimating the destination of the user based on the road information and the action track, and controlling the relevant intelligent equipment to start working when the estimated destination of the user is the residence.

5. The smart phone of claim 1, wherein the collection module comprises:

a state acquisition unit: the system comprises a sub-household appliance, a plurality of sub-state information acquisition units, a sub-code acquisition unit, a sub-working state acquisition unit, a sub-code generation unit and a sub-working state acquisition unit, wherein the sub-household appliance is used for periodically inquiring the state of the sub-household appliance, acquiring a plurality of sub-state information, identifying the sub-state information, acquiring the sub-code of the sub-state information, and determining the sub-household appliance corresponding to the sub-state information based on the sub-code, so as to acquire the sub-working state of the sub-household appliance;

a state updating unit: and the method is used for updating the state of the sub-working state of the sub-household appliance based on the smart phone.

6. The smart phone of claim 1, wherein the collection module further comprises:

a verification unit: the voice recognition system comprises a task password receiving module, a voice recognition module and a voice recognition module, wherein the task password receiving module is used for receiving a task password sent by a user, obtaining first voice information of the user, carrying out voiceprint quantization on the first voice information, obtaining a first voiceprint sequence of the first voice information, comparing the first voiceprint sequence with a voiceprint sequence of historical voice information based on a sliding window function, and obtaining the similarity between the first voice information and the historical voice information;

the verification unit: the task password processing method is also used for acquiring a generated character sequence in the process of processing the task password, and carrying out segmentation processing on the character sequence to construct a processing event set;

the verification unit: the task password processing system is also used for carrying out password analysis on the task password to obtain a password identifier, extracting a preset event set from a password event database, comparing the processing event set with the preset event set to obtain an event overlapping degree, and adjusting the event overlapping degree according to the overlapping sequence of events to obtain an event qualification degree;

when the similarity is greater than a preset similarity and the event qualification degree is greater than a preset qualification degree, judging that the first voice information passes the authority verification;

an instruction acquisition unit: acquiring first voice information based on a storage unit, performing feature extraction on the first voice information passing the authority verification to acquire first voice features, processing the first voice features to acquire first phoneme information, inputting the first phoneme information into a preset acoustic model to acquire a first voice recognition result, and determining first audio content corresponding to the first voice information;

determining the association degree of first audio content corresponding to the first voice and sub-standard instructions in a standard command library based on a preset standard command library, obtaining a plurality of sub-association degrees, judging whether the first maximum sub-association degree is greater than the preset association degree, and if so, taking the sub-standard instructions corresponding to the first maximum sub-association degree as sub-task instructions of a user;

otherwise, extracting keywords from the first audio content to obtain keywords of the first audio content, performing statement reconstruction on the keywords based on the time sequence of the keywords in the first audio content to obtain second audio content, determining the association degree of the first audio content corresponding to the first voice and the sub-standard instruction in the standard command library, obtaining a plurality of sub-association degrees, judging whether the second maximum sub-association degree is greater than the preset association degree, if so, taking the sub-standard instruction corresponding to the second maximum sub-association degree as the sub-task instruction of the user, and if not, reminding the user that the voice recognition is failed;

and transmitting the subtask instruction to the storage unit for storage.

7. The smart phone of claim 1, wherein the collection module further comprises:

a position acquisition unit: the system is used for inquiring the geographical position of the address according to the home address information, collecting weather forecast information of the geographical position from a cloud network according to the geographical position, asking a user whether to close a window, inquiring community information of the address according to the home address information, collecting hydropower supply bulletins of the community from the cloud network according to the community information, analyzing and determining the time information of hydropower outage and restoration, and reminding the user of the time of hydropower outage and restoration.

8. The smart phone of claim 1, wherein the control module further comprises:

an analysis unit: the system comprises a task instruction, a power control unit, a power calculation unit and a power calculation unit, wherein the task instruction is used for analyzing the task instruction, determining pre-started sub household appliances and pre-closed sub household appliances in the task instruction, and meanwhile, performing accumulation calculation on the power of the sub household appliances before the analysis moment and in the running state to obtain first total power of the household appliances in the residence;

the analysis unit: the household electrical appliance control system is also used for updating the first total power based on the pre-started sub household electrical appliances and the first pre-closed sub household electrical appliances to obtain a second total power, comparing the second total power with a preset maximum allowable power, and acquiring sub-work contents corresponding to the sub household electrical appliances working simultaneously in the residence when the second total power is greater than the maximum allowable power of the residence;

sequencing all the sub-working contents based on the priority level corresponding to the preset working contents to obtain a sequencing result;

and determining a second pre-closed sub-household appliance sequence based on the sequencing result, the maximum residence allowed power and the information of the pre-started sub-household appliances, sending the pre-closed sub-household appliance sequence to the user, asking the user whether to close the pre-closed household appliances, closing the pre-closed household appliances if the user agrees, and requesting the user to change the task instruction if the user disagrees.

9. The smart phone of claim 1, wherein the switching module comprises:

a detection unit: the method comprises the steps that a face recognition access control system collects face images of pre-entrants to obtain face video data of the pre-entrants, gray level detection is conducted on each sub-image in the face video data to obtain gray level values of pixel points in the sub-images, and face outlines of the pre-entrants are extracted based on the gray level values of the pixel points in the sub-images to obtain face image areas of the pre-entrants;

a pretreatment unit: determining a brightness adjustment proportion value of a face image area based on the difference between the average brightness value of the face image area and a preset target brightness value, setting a brightness adjustment weight value of the face image area based on the brightness value of the face image area, adjusting the brightness of the face image area based on the brightness adjustment weight value of the face image area to obtain a standard brightness image, performing face detection on the standard brightness image to obtain key points of a face, positioning the key points to obtain positioning information, performing feature extraction on the key points based on the positioning information to obtain feature vectors corresponding to the key points, and establishing a corresponding relationship between the feature vectors and the positioning information corresponding to the key points to obtain the facial features of the face in the standard brightness image;

an identification unit: retrieving the facial features of the human face in the standard brightness image in a preset authority library, determining the access authority of the pre-entry personnel, if the pre-entry personnel have the access authority, opening the access control system, and if the pre-entry personnel do not have the access authority, sending the facial video data of the pre-entry personnel to the user and asking whether the access control system needs to be opened.

10. The smart phone of claim 1, wherein the control module further comprises:

a collecting unit: the method comprises the steps that real-time monitoring is conducted on the sub-household appliances, when the sub-household appliances start to work, acquisition instructions are obtained, and preset equipment respectively conducts sound acquisition on the sub-household appliances which are working according to the acquisition instructions to obtain a plurality of sub-sound data;

a processing unit: preprocessing the collected sub-sound data to obtain real-time sound data, decomposing the real-time sound data into product function components of several orders of instantaneous frequency, and taking the ratio of the energy of the product function components to the total energy of the real-time sound data as a sound feature vector;

a detection unit: the real-time voice data processing device is used for taking the voice feature vector as a voice feature and judging whether the real-time voice data is abnormal or not based on the voice feature;

when the real-time sound data are abnormal, determining that the sub-household appliance has a fault, and alarming;

and when the real-time sound data is not abnormal, determining that the target household appliance has no fault.

Technical Field

The invention relates to the field of household appliance cooperative work, in particular to a smart phone for realizing household appliance cooperative work.

Background

In recent years, under the gradual change of electronic technology, smart homes are concerned by vast internet friends, various smart household appliances come into the lives of people, such as refrigerators, disinfection cabinets and the like, and the smart household appliances greatly facilitate the lives of people. With the rise of 5G technology, the concept of interconnection of everything is proposed, the interconnection of smart homes also starts to come into the sight of vast net friends, the change from single smart home to integral smart home is changed, a household appliance product formed by introducing a microprocessor, a sensor technology and a network communication technology into household appliance equipment has the advantages of automatically sensing the space state of a house, the self state of the household appliance and the service state of the household appliance, and being capable of automatically controlling and receiving the control instruction of a house user in the house or in a remote place; meanwhile, the intelligent household appliance is used as a component of the intelligent home, and can be interconnected with other household appliances, homes and facilities in a house to form a system, so that the function of the intelligent home is realized.

However, the traditional smart home still utilizes an independent control terminal to roughly control a large number of smart home appliances, and the division of the smart home system is not clearly detailed enough, so that the smart home appliances cannot work more efficiently.

Disclosure of Invention

The invention provides a smart phone for realizing cooperative work of household appliances, which aims to solve the problems in the background technology, so that the household appliances can be controlled more conveniently and intelligently.

In order to achieve the purpose, the invention provides the following technical scheme: a smart phone for realizing cooperative work of smart appliances is characterized by comprising:

the acquisition module is used for acquiring a task instruction of a user;

the control module is used for generating a sub-operation command based on the task instruction;

and the switching module is used for switching the working state of the sub-household appliance based on the sub-operation command.

Further, the sub-appliance includes: any one or combination of a plurality of intelligent cameras, a face recognition access control system, an intelligent warm air system, an intelligent curtain and an intelligent switch.

Further, the sub-operation command includes: a single command to a single sub-appliance, a comprehensive command to a single sub-appliance, or a linkage command to a plurality of sub-appliances.

Further, the control module in the smart phone for implementing the cooperative work of the household appliances further includes:

a positioning unit: the position information of the smart phone is acquired;

a control unit: the intelligent equipment is used for capturing the moving track of the intelligent mobile phone when the distance between the intelligent mobile phone and the residence, which is acquired based on the position information, is smaller than a preset value, acquiring the action track of the user, estimating the destination of the user based on the road information and the action track, and controlling the relevant intelligent equipment to start working when the estimated destination of the user is the residence.

Further, the collection module in the smart phone for realizing the cooperative work of the household appliances comprises:

a state acquisition unit: the system comprises a sub-household appliance, a plurality of sub-state information acquisition units, a sub-code acquisition unit, a sub-working state acquisition unit, a sub-code generation unit and a sub-working state acquisition unit, wherein the sub-household appliance is used for periodically inquiring the state of the sub-household appliance, acquiring a plurality of sub-state information, identifying the sub-state information, acquiring the sub-code of the sub-state information, and determining the sub-household appliance corresponding to the sub-state information based on the sub-code, so as to acquire the sub-working state of the sub-household appliance;

a state updating unit: and the method is used for updating the state of the sub-working state of the sub-household appliance based on the smart phone.

Further, the collection module in the smart phone for realizing the cooperative work of the household appliances further comprises:

a verification unit: the voice recognition system comprises a task password receiving module, a voice recognition module and a voice recognition module, wherein the task password receiving module is used for receiving a task password sent by a user, obtaining first voice information of the user, carrying out voiceprint quantization on the first voice information, obtaining a first voiceprint sequence of the first voice information, comparing the first voiceprint sequence with a voiceprint sequence of historical voice information based on a sliding window function, and obtaining the similarity between the first voice information and the historical voice information;

the verification unit: the task password processing method is also used for acquiring a generated character sequence in the process of processing the task password, and carrying out segmentation processing on the character sequence to construct a processing event set;

the verification unit: the task password processing system is also used for carrying out password analysis on the task password to obtain a password identifier, extracting a preset event set from a password event database, comparing the processing event set with the preset event set to obtain an event overlapping degree, and adjusting the event overlapping degree according to the overlapping sequence of events to obtain an event qualification degree;

when the similarity is greater than a preset similarity and the event qualification degree is greater than a preset qualification degree, judging that the first voice information passes the authority verification;

an instruction acquisition unit: acquiring first voice information based on a storage unit, performing feature extraction on the first voice information passing the authority verification to acquire first voice features, processing the first voice features to acquire first phoneme information, inputting the first phoneme information into a preset acoustic model to acquire a first voice recognition result, and determining first audio content corresponding to the first voice information;

determining the association degree of first audio content corresponding to the first voice and sub-standard instructions in a standard command library based on a preset standard command library, obtaining a plurality of sub-association degrees, judging whether the first maximum sub-association degree is greater than the preset association degree, and if so, taking the sub-standard instructions corresponding to the first maximum sub-association degree as sub-task instructions of a user;

otherwise, extracting keywords from the first audio content to obtain keywords of the first audio content, performing statement reconstruction on the keywords based on the time sequence of the keywords in the first audio content to obtain second audio content, determining the association degree of the first audio content corresponding to the first voice and the sub-standard instruction in the standard command library, obtaining a plurality of sub-association degrees, judging whether the second maximum sub-association degree is greater than the preset association degree, if so, taking the sub-standard instruction corresponding to the second maximum sub-association degree as the sub-task instruction of the user, and if not, reminding the user that the voice recognition is failed;

and transmitting the subtask instruction to the storage unit for storage.

Further, the acquisition module in the smart phone for realizing the cooperative work of the household appliances further performs the following operations:

a position acquisition unit: the system is used for inquiring the geographical position of the address according to the home address information, collecting weather forecast information of the geographical position from a cloud network according to the geographical position, asking a user whether to close a window, inquiring community information of the address according to the home address information, collecting hydropower supply bulletins of the community from the cloud network according to the community information, analyzing and determining the time information of hydropower outage and restoration, and reminding the user of the time of hydropower outage and restoration.

Further, the control module in the smart phone for implementing the cooperative work of the household appliances further includes:

an analysis unit: the system comprises a task instruction, a power control unit, a power calculation unit and a power calculation unit, wherein the task instruction is used for analyzing the task instruction, determining pre-started sub household appliances and pre-closed sub household appliances in the task instruction, and meanwhile, performing accumulation calculation on the power of the sub household appliances before the analysis moment and in the running state to obtain first total power of the household appliances in the residence;

the analysis unit: the household electrical appliance control system is also used for updating the first total power based on the pre-started sub household electrical appliances and the first pre-closed sub household electrical appliances to obtain a second total power, comparing the second total power with a preset maximum allowable power, and acquiring sub-work contents corresponding to the sub household electrical appliances working simultaneously in the residence when the second total power is greater than the maximum allowable power of the residence;

sequencing all the sub-working contents based on the priority level corresponding to the preset working contents to obtain a sequencing result;

and determining a second pre-closed sub-household appliance sequence based on the sequencing result, the maximum residence allowed power and the information of the pre-started sub-household appliances, sending the pre-closed sub-household appliance sequence to the user, asking the user whether to close the pre-closed household appliances, closing the pre-closed household appliances if the user agrees, and requesting the user to change the task instruction if the user disagrees.

Further, the module for switching among smart phones for realizing cooperative work of household appliances further includes:

a detection unit: the method comprises the steps that a face recognition access control system collects face images of pre-entrants to obtain face video data of the pre-entrants, gray level detection is conducted on each sub-image in the face video data to obtain gray level values of pixel points in the sub-images, and face outlines of the pre-entrants are extracted based on the gray level values of the pixel points in the sub-images to obtain face image areas of the pre-entrants;

a pretreatment unit: determining a brightness adjustment proportion value of a face image area based on the difference between the average brightness value of the face image area and a preset target brightness value, setting a brightness adjustment weight value of the face image area based on the brightness value of the face image area, adjusting the brightness of the face image area based on the brightness adjustment weight value of the face image area to obtain a standard brightness image, performing face detection on the standard brightness image to obtain key points of a face, positioning the key points to obtain positioning information, performing feature extraction on the key points based on the positioning information to obtain feature vectors corresponding to the key points, and establishing a corresponding relationship between the feature vectors and the positioning information corresponding to the key points to obtain the facial features of the face in the standard brightness image;

an identification unit: retrieving the facial features of the human face in the standard brightness image in a preset authority library, determining the access authority of the pre-entry personnel, if the pre-entry personnel have the access authority, opening the access control system, and if the pre-entry personnel do not have the access authority, sending the facial video data of the pre-entry personnel to the user and asking whether the access control system needs to be opened.

Further, the control module in the smart phone for implementing the cooperative work of the household appliances further includes:

a collecting unit: the method comprises the steps that real-time monitoring is conducted on the sub-household appliances, when the sub-household appliances start to work, acquisition instructions are obtained, and preset equipment respectively conducts sound acquisition on the sub-household appliances which are working according to the acquisition instructions to obtain a plurality of sub-sound data;

a processing unit: preprocessing the collected sub-sound data to obtain real-time sound data, decomposing the real-time sound data into product function components of several orders of instantaneous frequency, and taking the ratio of the energy of the product function components to the total energy of the real-time sound data as a sound feature vector;

a detection unit: the real-time voice data processing device is used for taking the voice feature vector as a voice feature and judging whether the real-time voice data is abnormal or not based on the voice feature;

when the real-time sound data are abnormal, determining that the sub-household appliance has a fault, and alarming;

and when the real-time sound data is not abnormal, determining that the target household appliance has no fault.

Additional features and advantages of the invention will be set forth in the description which follows, and in part will be obvious from the description, or may be learned by practice of the invention. The objectives and other advantages of the invention will be realized and attained by the structure particularly pointed out in the written description and claims hereof as well as the appended drawings.

The technical solution of the present invention is further described in detail by the accompanying drawings and embodiments.

Drawings

The accompanying drawings, which are included to provide a further understanding of the invention and are incorporated in and constitute a part of this specification, illustrate embodiments of the invention and together with the description serve to explain the principles of the invention and not to limit the invention. In the drawings:

fig. 1 is a block diagram of a smart phone according to the present invention;

FIG. 2 is a block diagram of the acquisition module of the present invention;

FIG. 3 is a block diagram of the control module of the present invention;

fig. 4 is a structural diagram of a switching module according to the present invention.

Detailed Description

The preferred embodiments of the present invention will be described in conjunction with the accompanying drawings, and it will be understood that they are described herein for the purpose of illustration and explanation and not limitation.

Example 1

A smart phone for implementing cooperative work of home appliances, as shown in fig. 1, includes:

the acquisition module is used for acquiring a task instruction of a user;

the control module is used for generating a sub-operation command based on the task instruction;

and the switching module is used for switching the working state of the sub-household appliance based on the sub-operation command.

The beneficial effect of above-mentioned scheme does: the voice information of the user is collected, the voice content of the user is analyzed and determined, the task instruction is generated based on the voice content, the sub-operation command is respectively issued to the sub-household appliances based on the task instruction, the running state of the household appliances is controlled, the household appliances and the household appliances in the house are interconnected to form a system, the cooperative working capacity is enhanced, and the intelligent home function is realized.

Example 2

Based on embodiment 1, the sub-appliance includes: any one or combination of a plurality of intelligent cameras, a face recognition access control system, an intelligent warm air system, an intelligent curtain and an intelligent switch.

Example 3

Based on embodiment 1, the sub-operation command includes: a single command to a single sub-appliance, a comprehensive command to a single sub-appliance, or a linkage command to a plurality of sub-appliances.

Example 4

Based on embodiment 1, as shown in fig. 1, the control module further includes:

a positioning unit: the position information of the smart phone is acquired;

a control unit: the intelligent equipment is used for capturing the moving track of the intelligent mobile phone when the distance between the intelligent mobile phone and the residence, which is acquired based on the position information, is smaller than a preset value, acquiring the action track of the user, estimating the destination of the user based on the road information and the action track, and controlling the relevant intelligent equipment to start working when the estimated destination of the user is the residence.

In the embodiment, the predicted destination is a destination which is determined to be possible for a plurality of users according to the action track of the users and the road information;

the beneficial effect of above-mentioned scheme does: by predicting the destination of the user, when the user is on the way to go home, ventilation is performed, so that when the user goes back to the residence, the residence is completely ventilated, dirty blocks in the room are discharged, the user can breathe fresh air when going home, and the comfort degree of the residence is improved.

Example 5

Based on the embodiment 1, as shown in fig. 2, the acquisition module includes:

a state acquisition unit: the system comprises a sub-household appliance, a plurality of sub-state information acquisition units, a sub-code acquisition unit, a sub-working state acquisition unit, a sub-code generation unit and a sub-working state acquisition unit, wherein the sub-household appliance is used for periodically inquiring the state of the sub-household appliance, acquiring a plurality of sub-state information, identifying the sub-state information, acquiring the sub-code of the sub-state information, and determining the sub-household appliance corresponding to the sub-state information based on the sub-code, so as to acquire the sub-working state of the sub-household appliance;

a state updating unit: and the method is used for updating the state of the sub-working state of the sub-household appliance based on the smart phone.

In this embodiment, the sub-status information includes an identification code of the sub-appliance, and information of the on/off status, the operated duration, and the power consumption of the sub-appliance.

The beneficial effect of above-mentioned scheme does: the state of the sub-household appliances is periodically inquired, the sub-states of the household appliances are updated at the mobile phone end, so that a user can master the working condition of the household appliances in a residence outdoors, each sub-state information contains a sub-address code, data among the sub-household appliances cannot be disordered, and the reliability of the sub-states of the household appliances is guaranteed.

Example 6

Based on embodiment 1, as shown in fig. 2, the acquisition module further includes:

a verification unit: the voice recognition system comprises a task password receiving module, a voice recognition module and a voice recognition module, wherein the task password receiving module is used for receiving a task password sent by a user, obtaining first voice information of the user, carrying out voiceprint quantization on the first voice information, obtaining a first voiceprint sequence of the first voice information, comparing the first voiceprint sequence with a voiceprint sequence of historical voice information based on a sliding window function, and obtaining the similarity between the first voice information and the historical voice information;

the verification unit: the task password processing method is also used for acquiring a generated character sequence in the process of processing the task password, and carrying out segmentation processing on the character sequence to construct a processing event set;

the verification unit: the task password processing system is also used for carrying out password analysis on the task password to obtain a password identifier, extracting a preset event set from a password event database, comparing the processing event set with the preset event set to obtain an event overlapping degree, and adjusting the event overlapping degree according to the overlapping sequence of events to obtain an event qualification degree;

when the similarity is greater than a preset similarity and the event qualification degree is greater than a preset qualification degree, judging that the first voice information passes the authority verification;

an instruction acquisition unit: acquiring first voice information based on a storage unit, performing feature extraction on the first voice information passing the authority verification to acquire first voice features, processing the first voice features to acquire first phoneme information, inputting the first phoneme information into a preset acoustic model to acquire a first voice recognition result, and determining first audio content corresponding to the first voice information;

determining the association degree of first audio content corresponding to the first voice and sub-standard instructions in a standard command library based on a preset standard command library, obtaining a plurality of sub-association degrees, judging whether the first maximum sub-association degree is greater than the preset association degree, and if so, taking the sub-standard instructions corresponding to the first maximum sub-association degree as sub-task instructions of a user;

otherwise, extracting keywords from the first audio content to obtain keywords of the first audio content, performing statement reconstruction on the keywords based on the time sequence of the keywords in the first audio content to obtain second audio content, determining the association degree of the first audio content corresponding to the first voice and the sub-standard instruction in the standard command library, obtaining a plurality of sub-association degrees, judging whether the second maximum sub-association degree is greater than the preset association degree, if so, taking the sub-standard instruction corresponding to the second maximum sub-association degree as the sub-task instruction of the user, and if not, reminding the user that the voice recognition is failed;

and transmitting the subtask instruction to the storage unit for storage.

In this embodiment, the similarity is a similarity between the audio content and the preset content.

In this embodiment, the acoustic model trained in advance is a GMM-HMM speech recognition model.

In this embodiment, the first voiceprint sequence is a frequent sequence in which the voiceprint data is obtained by calculating the sound wave spectrum of the first voice message through a spade algorithm.

In this embodiment, the voiceprint sequence of the historical voice information is a frequent sequence corresponding to the voice information verified in the history, and by comparing the voiceprint sequence of the historical voice information with the first voiceprint sequence, it can be determined whether the user corresponding to the first voiceprint sequence is consistent with the user corresponding to the past voice information.

In this embodiment, the character sequence is data generated in the process of processing the task password, and includes the time of the task password and the voiceprint sequence corresponding to the task password.

In this embodiment, the processing event set is obtained by segmenting a character sequence to obtain data generated in the task password processing process, including the time of the task password and the voiceprint sequence corresponding to the task password, and recording the processing process of the task password based on the time of the task password.

In this embodiment, the task password is a password issued by the user.

In this embodiment, the password is identified as a keyword in the task password, such as on, off, television, air conditioner, etc.

In this embodiment, the preset event set is an event generated according to the password identifier, for example, a preset event for opening a refrigerator is generated according to two keywords of open and tv.

In this embodiment, the event overlap degree is a matching degree between the event in the processing event set and the event in the preset event set.

In this embodiment, the event qualification is a qualification of an event included in the first speech information.

In this embodiment, the overlapping order of the events is an order in which the events in the processing event set and the events in the preset event set overlap with each other.

In this embodiment, the plurality of sub-relevancy degrees are relevancy degrees between the first audio content corresponding to the first voice and each sub-standard instruction in the standard command library.

In this embodiment, the sliding window function is a python sliding window function.

In this embodiment, the first phoneme information is obtained by extracting the frequency, strength, and phoneme characteristics of the first speech information and then separating the phonemes.

The beneficial effect of above-mentioned scheme does: by collecting the voice of the user, the user is identified for authority verification, when the user has the authority, the household appliance can be controlled, the harm to the personal health and property safety of the user by lawless persons through the intelligent household appliance is prevented, after the user passes the verification, the voice content is identified, when the voice is a standard instruction, the instruction is directly issued, when the voice content is not the standard instruction, the keyword is extracted for identification, the instruction is conveniently issued by the user,

example 7

Based on embodiment 1, as shown in fig. 2, the acquisition module further performs the following operations:

a position acquisition unit: the system is used for inquiring the geographical position of the address according to the home address information, collecting weather forecast information of the geographical position from a cloud network according to the geographical position, asking a user whether to close a window, inquiring community information of the address according to the home address information, collecting hydropower supply bulletins of the community from the cloud network according to the community information, analyzing and determining the time information of hydropower outage and restoration, and reminding the user of the time of hydropower outage and restoration.

The beneficial effect of above-mentioned scheme does: weather forecast information of the position of a user community and water and electricity supply interruption time information of the community are acquired through the cloud data acquisition module, and the electric control center module is convenient to conduct more effective management and control on the intelligent household appliances.

Example 8

Based on embodiment 1, as shown in fig. 1, an embodiment of the present invention provides a smart phone for implementing a collaborative work of a home appliance, including:

when the intelligent access control system carries out authority verification on the pre-entry personnel, firstly, image information of the pre-entry personnel is obtained; then, analyzing the image information of the user to obtain the facial features of the person who enters the system in advance; then, whether the pre-entrant has the access authority is judged based on the facial features of the pre-entrant and the following formula:

y in the above formula_k1Maximum value of judgment values, Y, representing the facial features of the person to be admitted and the facial features of the persons in the admission authority library_k2Minimum value, Y, of judgment values representing the facial features of the person to be admitted and the facial features of the persons in the admission authority library_kThe method comprises the steps of representing the average judgment value of the facial features of people to be accessed and the facial features of people in an access permission library, min { } represents a minimum function, max { } represents the minimum function, and S_iMean characteristic value, f, of the ith face characteristic representing all users having admission authority_iA value, n, representing the ith one of the facial features of the pre-entrant person_ikThe value of the ith characteristic of the kth user in the access permission library is represented, p represents a constant, and k represents the number of all users with the access permission library;

in the passing of formulaSequentially judging the ith characteristic in the facial characteristics of the pre-entered personnel and all personnel in the access permission library, therebyObtaining m data, Y_k1Is to obtain the minimum data in m data, for example, Y obtained when the value of m is 5_k1Min { -0.12, 0.56, 0, -0.14, 0.13}, then Y_k1Is-0.14, Y_k2Is to obtain the largest data of the m data, e.g. Y_k2Max { -0.12, 0.56, 0, -0.14, 0.13}, then Y_k2Is 0.56, then Y_kExpressed as 0.21, when Y_kWhen the access authority of the pre-entry personnel is less than 0.5, the access authority of the pre-entry personnel is continuously verified, and the method comprises the following steps: allocating identification times to the pre-entry personnel needing continuous verification, wherein the identification times are realized according to the following formula:

wherein h represents the final identification number, and a1, a2 and a3 represent the distributed identification numbers corresponding to different average judgment values;

and identifying and verifying the pre-entry personnel for the corresponding times according to the final identification times, and if the average judgment values corresponding to all identification and verification results are less than 0.5, alarming and reminding are carried out, and the pre-entry personnel is judged not to have the permission to enter.

In this embodiment, the access control system is intelligent recognition software provided on a smart phone.

The beneficial effect of above-mentioned scheme does: the entrance guard system obtains the facial features of the pre-entry personnel through analysis, compares the facial features with the facial features in the quasi-entry warehouse, judges whether the pre-entry personnel have the entry authority, provides safety guarantee while providing intelligent service for users, effectively ensures effective identification of the personnel through distribution of identification times, and further enriches the functionality of the smart phone.

Example 9

Based on embodiment 1, as shown in fig. 3, the control module further includes:

an analysis unit: the system comprises a task instruction, a power control unit, a power calculation unit and a power calculation unit, wherein the task instruction is used for analyzing the task instruction, determining pre-started sub household appliances and pre-closed sub household appliances in the task instruction, and meanwhile, performing accumulation calculation on the power of the sub household appliances before the analysis moment and in the running state to obtain first total power of the household appliances in the residence;

the analysis unit: the household electrical appliance control system is also used for updating the first total power based on the pre-started sub household electrical appliances and the first pre-closed sub household electrical appliances to obtain a second total power, comparing the second total power with a preset maximum allowable power, and acquiring sub-work contents corresponding to the sub household electrical appliances working simultaneously in the residence when the second total power is greater than the maximum allowable power of the residence;

sequencing all the sub-working contents based on the priority level corresponding to the preset working contents to obtain a sequencing result;

and determining a second pre-closed sub-household appliance sequence based on the sequencing result, the maximum residence allowed power and the information of the pre-started sub-household appliances, sending the pre-closed sub-household appliance sequence to the user, asking the user whether to close the pre-closed household appliances, closing the pre-closed household appliances if the user agrees, and requesting the user to change the task instruction if the user disagrees.

The beneficial effect of above-mentioned scheme does: after a user issues an instruction, the total power of the running intelligent household appliances is obtained, whether the total power exceeds an allowable range after the instruction is executed is judged, when the total power exceeds the allowable range, the working contents are sequenced to obtain a sequencing result according to the current working contents of the plurality of intelligent household appliances working simultaneously on the branch and based on the priority level corresponding to the preset working contents, and according to the sequencing result, the intelligent household appliances with the maximum number are operated simultaneously on the premise of ensuring the maximum allowable range of the total power of the plurality of intelligent household appliances corresponding to the arranged plurality of working contents and the total power of the residence. And the work task can be rapidly completed. The working efficiency of intelligent household electrical appliances is improved, and meanwhile, the potential safety hazard is reduced.

Example 10

Based on embodiment 1, as shown in fig. 4, the switching module further includes:

an analysis unit: the system comprises a task instruction, a power control unit, a power calculation unit and a power calculation unit, wherein the task instruction is used for analyzing the task instruction, determining pre-started sub household appliances and pre-closed sub household appliances in the task instruction, and meanwhile, performing accumulation calculation on the power of the sub household appliances before the analysis moment and in the running state to obtain first total power of the household appliances in the residence;

the analysis unit: the household electrical appliance control system is also used for updating the first total power based on the pre-started sub household electrical appliances and the first pre-closed sub household electrical appliances to obtain a second total power, comparing the second total power with a preset maximum allowable power, and acquiring sub-work contents corresponding to the sub household electrical appliances working simultaneously in the residence when the second total power is greater than the maximum allowable power of the residence;

sequencing all the sub-working contents based on the priority level corresponding to the preset working contents to obtain a sequencing result;

and determining a second pre-closed sub-household appliance sequence based on the sequencing result, the maximum residence allowed power and the information of the pre-started sub-household appliances, sending the pre-closed sub-household appliance sequence to the user, asking the user whether to close the pre-closed household appliances, closing the pre-closed household appliances if the user agrees, and requesting the user to change the task instruction if the user disagrees.

In the present embodiment, the eigenvector is an eigenvector whose direction is not changed in the linear transformation of the keypoint.

In this embodiment, the corresponding relationship is a one-to-one correspondence relationship between the positioning information of the key point and the feature vector of the key point.

In the present embodiment, the key points are edge points of the face and edge points of the eyes, mouth, and nose.

In this embodiment, the positioning information is coordinates of each sub-key point in a coordinate system with the center point of the second key image as the origin.

In this embodiment, the correspondence relationship is an indivisible relationship between the position of the same feature point and the feature vector.

In this embodiment, the sub preset point is a preset point in the sub mark frame image.

The beneficial effects of the above technical scheme are: the access control system acquires facial images of the pre-entry personnel through the facial images of the pre-entry personnel, the facial features of the pre-entry personnel are obtained after processing and analyzing, the pre-entry personnel are compared with the facial features in the quasi-storage, whether the pre-entry personnel have the access authority or not is judged, no access authority exists in the pre-entry personnel, the facial video data of the pre-entry personnel are sent to a user, whether the user needs to open the access control system or not is requested, whether the user can remotely control the pre-entry personnel to enter a house or not is allowed, and when intelligent service is provided for the user, safety guarantee is provided.

Example 11

Based on embodiment 1, as shown in fig. 2, the control module further includes:

a collecting unit: the method comprises the steps that real-time monitoring is conducted on the sub-household appliances, when the sub-household appliances start to work, acquisition instructions are obtained, and preset equipment respectively conducts sound acquisition on the sub-household appliances which are working according to the acquisition instructions to obtain a plurality of sub-sound data;

a processing unit: preprocessing the collected sub-sound data to obtain real-time sound data, decomposing the real-time sound data into product function components of several orders of instantaneous frequency, and taking the ratio of the energy of the product function components to the total energy of the real-time sound data as a sound feature vector;

a detection unit: the real-time voice data processing device is used for taking the voice feature vector as a voice feature and judging whether the real-time voice data is abnormal or not based on the voice feature;

when the real-time sound data are abnormal, determining that the sub-household appliance has a fault, and alarming;

and when the real-time sound data is not abnormal, determining that the target household appliance has no fault.

In this embodiment, the instantaneous frequency is such that the real-time sound data is divided into a number of full bands, and then the instantaneous phase of each full band is defined by a set of increasing arcsine functions, resulting in the instantaneous phase.

In this embodiment, the product function component is a product function component in a local mean decomposition of the instantaneous phase.

The beneficial effect of above-mentioned scheme does: the method comprises the steps of obtaining a first audio signal of an execution device during operation, carrying out transformation, calculation, extraction and identification, judging whether the household appliance has a fault, and if the household appliance has the fault, carrying out fault alarm so that a user can master the condition of the household appliance in real time and repair the household appliance in time.

It will be apparent to those skilled in the art that various changes and modifications may be made in the present invention without departing from the spirit and scope of the invention. Thus, if such modifications and variations of the present invention fall within the scope of the claims of the present invention and their equivalents, the present invention is also intended to include such modifications and variations.