阅读说明：本技术 基于卷积网络和长短期记忆网络的二便预警系统及方法 (Portable early warning system and method based on convolutional network and long-short term memory network ) 是由 李琳 柯煜威 张铁 于 2021-11-17 设计创作，主要内容包括：本发明公开了一种基于卷积网络和长短期记忆网络的二便预警系统及方法。所述方法包括以下步骤：采集人体生理参数数据；进行数据增强构建数据集；对数据集进行划分；构建卷积神经网络和长短期记忆网络组合模型并利用划分的数据集对其进行训练,得到训练完成的组合模型；将训练完成的组合模型部署到嵌入式开发平台上；在嵌入式开发平台上利用传感设备构建人体生理参数实时监测部分；在嵌入式开发平台上获取人体实时生理参数数据并利用训练完成的组合模型判断是否产生二便预警信号,若否则返回持续获取生理参数,若是则驱动报警器进行报警。本发明实现对生理参数数据的实时分析,二便预警信号检测的准确率高,能够实时、鲁棒地实现大小便预警。(The invention discloses a binary early warning system and a binary early warning method based on a convolutional network and a long-short term memory network. The method comprises the following steps: collecting human physiological parameter data; carrying out data enhancement to construct a data set; dividing the data set; constructing a convolution neural network and long-short term memory network combined model and training the combined model by using the divided data set to obtain a trained combined model; deploying the trained combined model to an embedded development platform; constructing a human body physiological parameter real-time monitoring part by using sensing equipment on an embedded development platform; and acquiring real-time physiological parameter data of the human body on the embedded development platform, judging whether a defecation early warning signal is generated or not by using the trained combined model, if not, returning to continuously acquire the physiological parameter, and if so, driving an alarm to give an alarm. The invention realizes the real-time analysis of physiological parameter data, has high accuracy of the detection of the excrement and urine early warning signal and can realize excrement and urine early warning in real time and robustness.)

1. The stool early warning system based on the convolutional network and the long-short term memory network is characterized by comprising a human body physiological parameter real-time monitoring module, a combined model training module and an embedded development platform;

the human body physiological parameter real-time monitoring module collects human body physiological parameter data, performs data enhancement to construct a data set and divides the data set; the combined model training module constructs a combined model of the convolutional neural network and the long and short term memory network and trains the combined model by using the divided data sets to obtain a trained combined model of the convolutional neural network and the long and short term memory network; and a trained convolutional neural network and long and short term memory network combined model is deployed on the embedded development platform, so that human physiological parameter data acquired by the human physiological parameter real-time monitoring module in real time is acquired and early warning judgment is carried out conveniently.

2. The stool warning system based on the convolutional network and the long-and-short term memory network as claimed in claim 1, wherein the human physiological parameter data comprises electroencephalogram signals, gastric electrical signals, electrocardio signals and borborygmus signals.

3. The stool early warning system based on the convolutional network and the long and short term memory network as claimed in claim 2, wherein the human physiological parameter real-time monitoring module comprises an electroencephalogram sensor, a gastric electrosensor, an electrocardio sensor and a stethoscope for bowel sounds, which are respectively used for acquiring electroencephalogram signals, gastric electrosignals, electrocardio signals and bowel sound signals of a human body, and the detailed description is as follows:

the tested person collects data in a lying posture, a plurality of time lengths are collected each time, and a convenient or inconvenient label is added to the data according to the fact that whether the tested person is real or inconvenient;

zero-phase filtering acquired human physiological parameter data with a band-pass filter, the magnitude square response of whichSatisfies the following conditions:

wherein the content of the first and second substances,in order to be the frequency of the radio,is a unit of a plurality of numbers,in order to cut-off the frequency of the frequency,Nin order of the steps,Aconstant to remove baseline drift and noise;

and dividing each kind of filtered human physiological parameter data into a plurality of sample segments, wherein the continuity of the time sequence in each sample segment is reserved.

4. The portable prewarning system based on the convolutional network and the long-short term memory network as claimed in claim 3, wherein the human physiological parameter real-time monitoring module performs data enhancement on a plurality of human physiological parameter data sample segments after the sample segments are divided based on a data enhancement theory to construct a human physiological parameter information data set, and specifically comprises the following steps:

s1, using z transformation, and using the randomly determined mean value and standard deviation to renormalize the plurality of human physiological parameter data sample sections after the sample sections are segmented, wherein the formula is as follows:

wherein the content of the first and second substances,for the original data value of the sample segment,is the average of the original data of the sample segment,is the standard deviation of the original data of the sample segment,is a normalized sample segment data value;

s2, generating a sinusoidal signal with a start phase from-180 degrees to-90 degrees at random and an end phase from 90 degrees to 180 degrees at randomThe amplitude of the sinusoidal signal is randomly set between the normalized values + -2, where t is time,in order to be the initial phase position,Kin order to be the amplitude of the vibration,is the angular velocity;

s3, generating a random Gaussian noise signal p (x) with probability density functionSatisfies the following conditions:

wherein the content of the first and second substances,is taken as the mean value of the average value,is the standard deviation;

s4, normalizing the signalSinusoidal signalAnd random Gaussian noise signalAnd combining to generate new signals to complete data enhancement, wherein all the generated new signals form a human body physiological parameter information data set.

5. The convolution network and long-short term memory network based binary early warning system as claimed in claim 4, wherein in the human physiological parameter real-time monitoring module, 80% of data in the human physiological parameter information data set is used as a training set for training, verifying and optimizing the convolution neural network and long-short term memory network combined model, and 20% of data is used as a test set for evaluating the trained convolution neural network and long-short term memory network combined model;

the data recorded in the training set and the test set are unique, namely the data recorded in the test set is not included in the training process of the convolutional neural network and long-short term memory network combined model.

6. The convolution network and long-short term memory network based stool early warning system as claimed in claim 5, wherein in the combined model training module, the convolution neural network and long-short term memory network combined model comprises an input layer, a plurality of one-dimensional convolution layers, a plurality of long-short term memory network layers, a combination loss layer and a dense layer which are connected in sequence;

wherein zero padding is adopted to enable the input layer and the one-dimensional convolutional layer to keep the same dimension; the missing layer is used for avoiding the over-fitting problem in the model training process; the dense layer configures the long-short term memory network layer for sequence prediction, and comprises 2 hidden units;

using a logistic regression function as the activation function, the samples of the input signal are assigned a value between 0 and 1.

7. The convolutional network and long-short term memory network based binary early warning system as claimed in claim 6, wherein in the combined model training module, a cross entropy loss function is used as a loss function when training the convolutional neural network and long-short term memory network combined model:

wherein the content of the first and second substances,is the true label for the ith sample,is the prediction tag of the ith sample,Mis the total number of samples, i is the serial number of the sample;

when the convolution neural network and the long-short term memory network combined model are evaluated, the F fraction is used as an evaluation standard:

wherein P is the precision rate, R is the recall rate,βto balance the weight of accuracy and recall.

8. The convolution network and long-short term memory network based stool early warning system as claimed in claim 7, wherein in the combined model training module, parameters of the convolution neural network and long-short term memory network combined model are optimized by using an Adam optimization method, and a specific formula is as follows:

wherein the content of the first and second substances,，the exponential decay rate estimated for the first moment,the exponential decay rate estimated for the first moment at the kth iteration,is the exponential decay rate of the second moment estimate,the exponential decay rate estimated for the second moment at the kth iteration,for the value of the current gradient,in order to estimate the first moment of the image,for the correction of the first moment estimate,in order to estimate the second-order moment,for the correction of the second-order moment estimate,for learning rate,For the parameter values before the optimization for the k-th iteration,is a constant other than 0.

9. The convolutional network and long-short term memory network based binary early warning system as claimed in claim 8, wherein the embedded development platform is an intavain Jetson TX2 embedded development platform.

10. The stool early warning method based on the convolutional network and the long-short term memory network by using the stool early warning system as claimed in any one of claims 1 to 9, comprising the following steps:

s1, collecting human physiological parameter data; carrying out data enhancement to construct a data set;

s2, dividing the data set;

s3, constructing a convolutional neural network and long and short term memory network combined model and training the convolutional neural network and long and short term memory network combined model by using the divided data set to obtain a trained convolutional neural network and long and short term memory network combined model;

s4, deploying the trained convolutional neural network and long-short term memory network combined model to an embedded development platform;

and S5, acquiring real-time physiological parameter data of the human body on the embedded development platform, judging whether a binary early warning signal is generated or not by utilizing the trained convolutional neural network and long-short term memory network combined model, and if not, returning to the step S5, and if so, driving an alarm to give an alarm.

Technical Field

The invention relates to the field of signal detection and early warning, in particular to a binary early warning system and method based on a convolutional network and a long-short term memory network.

Background

With the aggravation of aging in China, the elderly population is more and more. Many old people need to lie in bed for a long time for rest due to the decline of physical function, are difficult to defecate by oneself, and some disabled old people such as dementia, paralysed patient can't perceive the defecation and urination by oneself even, if look after well, if the filth of defecation does not clear up in time, various complications appear easily, seriously influence the quality of life and the life-span of old people.

A wearable toilet bowl and a nursing bed with the toilet bowl are provided in the patent of 'a wearable toilet bowl and a nursing bed with the toilet bowl'. The wearable excrement and urine toilet bowl tightly wraps the toilet bowl and the urinal through the wrapping belt, so that a closed space is formed inside the toilet bowl main body, and when a user urinates and defecates, the excrement and urine are discharged in the closed space. However, the defecation nursing mode is the post-defecation treatment, and the long-term wearing is not breathable and uncomfortable, and is not favorable for blood circulation.

Therefore, there is an urgent need for a defecation treatment system that can achieve pre-defecation warning and does not require long-term wearing.

Disclosure of Invention

The invention provides a lightweight defecation early warning system and a lightweight defecation early warning method based on real-time monitoring of physiological information data of a human body, a convolutional neural network and long-short term memory network (CNN-LSTM) combined model and a Jetson TX2 embedded development platform, and aims to solve the technical problem that defecation and urination of old people are inconvenient to care.

The purpose of the invention is realized by at least one of the following technical solutions.

The stool and urine early warning system based on the convolutional network and the long and short term memory network comprises a human body physiological parameter real-time monitoring module, a combined model training module and an embedded development platform;

the human body physiological parameter real-time monitoring module collects human body physiological parameter data, performs data enhancement to construct a data set and divides the data set; the combined model training module constructs a combined model of the convolutional neural network and the long and short term memory network and trains the combined model by using the divided data sets to obtain a trained combined model of the convolutional neural network and the long and short term memory network; and a trained convolutional neural network and long and short term memory network combined model is deployed on the embedded development platform, so that human physiological parameter data acquired by the human physiological parameter real-time monitoring module in real time is acquired and early warning judgment is carried out conveniently.

Further, the human physiological parameter data comprises an electroencephalogram signal, a stomach electrical signal, an electrocardio signal and a borygmus signal.

Further, the human body physiological parameter real-time monitoring module comprises an electroencephalogram sensor, a gastric electricity sensor, an electrocardio sensor and a bowel sound stethoscope, and is respectively used for collecting electroencephalogram signals, gastric electricity signals, electrocardio signals and bowel sound signals of a human body, and specifically comprises the following steps:

the tested person collects data in a lying posture, a plurality of time lengths are collected each time, and a convenient or inconvenient label is added to the data according to the fact that whether the tested person is real or inconvenient;

performing zero-phase filtering on the acquired human physiological parameter data by using a band-pass filter, wherein the amplitude square response of the zero-phase filteringIt should satisfy:

wherein the content of the first and second substances,in order to be the frequency of the radio,is a unit of a plurality of numbers,in order to cut-off the frequency of the frequency,Nin order of the steps,Aconstant to remove baseline drift and noise;

and dividing each kind of filtered human physiological parameter data into a plurality of sample segments, wherein the continuity of the time sequence in each sample segment is reserved.

Further, in the real-time monitoring module for human physiological parameters, based on a data enhancement theory, data enhancement is performed on a plurality of human physiological parameter data sample segments after the sample segments are divided, and a human physiological parameter information data set is constructed, specifically comprising the following steps:

s1, using z transformation, and using the randomly determined mean value and standard deviation to renormalize the plurality of human physiological parameter data sample sections after the sample sections are segmented, wherein the formula is as follows:

wherein the content of the first and second substances,for the original data value of the sample segment,is the average of the original data of the sample segment,is the standard deviation of the original data of the sample segment,is a normalized sample segment data value;

s2, generating a sinusoidal signal with a start phase from-180 degrees to-90 degrees at random and an end phase from 90 degrees to 180 degrees at randomAmplitude of the sinusoidal signal is randomly set at normalizationA value of + -2, where t is time,in order to be the initial phase position,Kin order to be the amplitude of the vibration,is the angular velocity;

s3, generating a random Gaussian noise signal p (x) with probability density functionSatisfies the following conditions:

wherein the content of the first and second substances,is taken as the mean value of the average value,is the standard deviation;

s4, normalizing the signalSinusoidal signalAnd random Gaussian noise signalAnd combining to generate new signals to complete data enhancement, wherein all the generated new signals form a human body physiological parameter information data set.

Furthermore, in the human physiological parameter real-time monitoring module, 80% of data in the human physiological parameter information data set is used as a training set for training, verifying and optimizing the convolutional neural network and long and short term memory network combined model, and 20% of data is used as a test set for evaluating the trained convolutional neural network and long and short term memory network combined model;

the data recorded in the training set and the test set are unique, namely the data recorded in the test set is not included in the training process of the convolutional neural network and long-short term memory network combined model.

Further, in the combined model training module, the convolutional neural network and long-short term memory network combined model comprises an input layer, a plurality of one-dimensional convolutional layers, a plurality of long-short term memory network layers, a combination loss layer and a dense layer which are sequentially connected;

wherein zero padding is adopted to enable the input layer and the one-dimensional convolutional layer to keep the same dimension; the missing layer is used for avoiding the over-fitting problem in the model training process; the dense layer configures the long-short term memory network layer for sequence prediction, and comprises 2 hidden units;

using a logistic regression function as the activation function, the samples of the input signal are assigned a value between 0 and 1.

Further, in the combined model training module, a cross entropy loss function is used as a loss function when the convolutional neural network and long-short term memory network combined model is trained:

wherein the content of the first and second substances,is the true label for the ith sample,the prediction label is the prediction label of the ith sample, M is the total number of the samples, and i is the serial number of the samples;

when the convolution neural network and the long-short term memory network combined model are evaluated, the F fraction is used as an evaluation standard:

where P is precision, R is recall, and β is the weight that balances precision and recall.

Further, in the combined model training module, parameters of the convolutional neural network and long-short term memory network combined model are optimized by using an Adam optimization method, and the specific formula is as follows:

wherein the content of the first and second substances,，the exponential decay rate estimated for the first moment,the exponential decay rate estimated for the first moment at the kth iteration,is the exponential decay rate of the second moment estimate,the exponential decay rate estimated for the second moment at the kth iteration,for the value of the current gradient,in order to estimate the first moment of the image,for the correction of the first moment estimate,in order to estimate the second-order moment,for the correction of the second-order moment estimate,for learning rate,For the parameter values before the optimization for the k-th iteration,is a constant other than 0.

Further, the embedded development platform adopts an English Jutson TX2 embedded development platform.

The stool early warning method based on the convolutional network and the long-short term memory network comprises the following steps:

s1, collecting human physiological parameter data; carrying out data enhancement to construct a data set;

s2, dividing the data set;

s3, constructing a convolutional neural network and long and short term memory network combined model and training the convolutional neural network and long and short term memory network combined model by using the divided data set to obtain a trained convolutional neural network and long and short term memory network combined model;

s4, deploying the trained convolutional neural network and long-short term memory network combined model to an embedded development platform;

and S5, acquiring real-time physiological parameter data of the human body on the embedded development platform, judging whether a binary early warning signal is generated or not by utilizing the trained convolutional neural network and long-short term memory network combined model, and if not, returning to the step S5, and if so, driving an alarm to give an alarm.

Compared with the prior art, the invention has the beneficial effects that:

(1) the invention can be effectively applied to hospitals, nursing institutions, families and other multi-scene applications, can solve the problem that disabled old people are difficult to provide convenient care in time, and has great practical value and social benefit; (2) the invention utilizes deep learning technology to establish physiological parameters of the nursed person and a neural network for prewarning the urination and defecation; (3) the light-weight type portable early warning system is formed based on the Jetson TX2 embedded development board, and the equipment is simple and portable in arrangement; (4) the invention is used as a detection method of the excrement pre-warning signal, and the physiological parameter data is analyzed in real time, so that the accuracy of the excrement pre-warning signal detection is high.

Drawings

Fig. 1 is an overall flow chart of the binary early warning system based on the convolutional network and the long-short term memory network.

Fig. 2 is a schematic diagram of a binary early warning system based on a convolutional network and a long-short term memory network in the embodiment of the present invention.

FIG. 3 is a diagram of a convolutional neural network and long-short term memory network (CNN-LSTM) combined model in an embodiment of the present invention.

Detailed Description

The present invention will be described in further detail below with reference to the accompanying drawings, but the embodiments of the invention are not limited thereto.

Example (b):

a stool early warning system based on a convolutional network and a long-short term memory network is shown in figures 1 and 2 and comprises a human physiological parameter real-time monitoring module, a combined model training module and an embedded development platform;

the human body physiological parameter real-time monitoring module collects human body physiological parameter data, performs data enhancement to construct a data set and divides the data set; the combined model training module constructs a combined model of the convolutional neural network and the long and short term memory network and trains the combined model by using the divided data sets to obtain a trained combined model of the convolutional neural network and the long and short term memory network; and a trained convolutional neural network and long and short term memory network combined model is deployed on the embedded development platform, so that human physiological parameter data acquired by the human physiological parameter real-time monitoring module in real time is acquired and early warning judgment is carried out conveniently.

The human body physiological parameter data comprises an electroencephalogram signal, a stomach electric signal, an electrocardio signal and a bowel sound signal.

In the embodiment, the human physiological parameter real-time monitoring module comprises an electroencephalogram sensor, a gastric electrical sensor, an electrocardio sensor and a 3M Littmann3200 type electronic stethoscope which are configured by a Biosignals series 4-channel physiological recording monitor, and are respectively used for acquiring electroencephalogram signals, gastric electrical signals, electrocardio signals and bowel sound signals of a human body, and the gastric electrical sensor can record the electrical activity of the stomach and is used for evaluating the intestinal movement and the whole stomach activity; the correlation degree of the electrocardiosignals and the defecation function reaches 65-70 percent; the bowel sounding signal is a gas passing underwater sound generated between gas and liquid in an intestinal tube during intestinal peristalsis, and can be used as an important index of intestinal tract movement, and the sound passing underwater sound is as follows:

the tested person collects data in a lying posture, a plurality of time lengths are collected each time, and a convenient or inconvenient label is added to the data according to the fact that whether the tested person is real or inconvenient;

the band-pass filter is used for carrying out zero-phase filtering on the acquired human physiological parameter data, and the amplitude square response of the zero-phase filtering meets the following requirements:

wherein the content of the first and second substances,is the cut-off frequency, N is the order, A is the constant, in order to remove the base line drift and noise;

and dividing each kind of filtered human physiological parameter data into a plurality of sample segments, wherein the continuity of the time sequence in each sample segment is reserved.

In the real-time monitoring module for human physiological parameters, based on a data enhancement theory, data enhancement is performed on a plurality of human physiological parameter data sample sections after the sample sections are divided, and a human physiological parameter information data set is constructed, and the real-time monitoring module for human physiological parameters specifically comprises the following steps:

s1, using z transformation, and using the randomly determined mean value and standard deviation to renormalize the plurality of human physiological parameter data sample sections after the sample sections are segmented, wherein the formula is as follows:

wherein the content of the first and second substances,for the original data value of the sample segment,is the average of the original data of the sample segment,is the standard deviation of the original data of the sample segment,is a normalized sample segment data value;

s2, generating a sinusoidal signal with a start phase from-180 degrees to-90 degrees at random and an end phase from 90 degrees to 180 degrees at randomThe amplitude of the sinusoidal signal is randomly set between the normalized values + -2, where t is time,for the initial phase, K is the amplitude,is the angular velocity;

s3, generating a random Gaussian noise signal p (x) with probability density functionSatisfies the following conditions:

wherein the content of the first and second substances,is taken as the mean value of the average value,is the standard deviation;

s4, normalizing the signalSinusoidal signalAnd random Gaussian noise signalAnd combining to generate new signals to complete data enhancement, wherein all the generated new signals form a human body physiological parameter information data set.

In the human physiological parameter real-time monitoring module, 80% of data in a human physiological parameter information data set is used as a training set for training, verifying and optimizing a convolutional neural network and long and short term memory network combined model, and 20% of data is used as a test set for evaluating the trained convolutional neural network and long and short term memory network combined model;

the data recorded in the training set and the test set are unique, namely the data recorded in the test set is not included in the training process of the convolutional neural network and long-short term memory network combined model.

As shown in fig. 3, in the combined model training module, the convolutional neural network and long-short term memory network combined model includes an input layer, a plurality of one-dimensional convolutional layers (CNN), a plurality of long-short term memory network Layers (LSTM), a combining loss layer (dropout), and a dense layer (dense) which are connected in sequence;

in this example, a kernel size of M = 3 is used for three one-dimensional convolutional layers (CNN), and 32, 64, and 128 filters (nfilters) are used for the corresponding three convolutional layers, respectively. To maintain the same dimensions in the input layer and the convolutional layer, zero padding is used. The first two-way long-short term memory network layer (BilSTM) has 250 hidden units, with the output of the last convolutional layer as input. The second bidirectional long short term memory network layer (BilSTM) has 125 hidden units. The loss probability of the loss layer (dropout) is set to 0.2.

Wherein zero padding is adopted to enable the input layer and the one-dimensional convolutional layer to keep the same dimension; the missing layer is used for avoiding the over-fitting problem in the model training process; the dense layer configures the long-short term memory network layer for sequence prediction, and comprises 2 hidden units;

using a logistic regression function (softmax) as the activation function, the samples of the input signal are assigned a value between 0 and 1.

Further, in the combined model training module, a cross entropy loss function is used as a loss function when the convolutional neural network and long-short term memory network combined model is trained:

wherein the content of the first and second substances,is the true label for the ith sample,the prediction label is the prediction label of the ith sample, M is the total number of the samples, and i is the serial number of the samples;

when the convolution neural network and the long-short term memory network combined model are evaluated, the F fraction is used as an evaluation standard:

where P is precision, R is recall, and β is the weight that balances precision and recall.

In the combined model training module, parameters of the combined model of the convolutional neural network and the long-short term memory network are optimized by using an Adam optimization method, and the specific formula is as follows:

wherein the content of the first and second substances,，the exponential decay rate estimated for the first moment,the exponential decay rate estimated for the first moment at the kth iteration,is the exponential decay rate of the second moment estimate,the exponential decay rate estimated for the second moment at the kth iteration,for the value of the current gradient,in order to estimate the first moment of the image,for the correction of the first moment estimate,in order to estimate the second-order moment,for the correction of the second-order moment estimate,for learning rate,Parameters before optimization for kth iterationThe value of the one or more of the one,is a constant other than 0.

In this embodiment, the embedded development platform is an invida Jetson TX2 embedded development platform.

The stool early warning method based on the convolutional network and the long-short term memory network comprises the following steps:

s1, collecting human physiological parameter data; carrying out data enhancement to construct a data set;

s2, dividing the data set;

s3, constructing a convolutional neural network and long and short term memory network combined model and training the convolutional neural network and long and short term memory network combined model by using the divided data set to obtain a trained convolutional neural network and long and short term memory network combined model;

s4, deploying the trained convolutional neural network and long-short term memory network combined model to an embedded development platform;

and S5, acquiring real-time physiological parameter data of the human body on the embedded development platform, judging whether a binary early warning signal is generated or not by utilizing the trained convolutional neural network and long-short term memory network combined model, and if not, returning to the step S5, and if so, driving an alarm to give an alarm.