阅读说明：本技术 一种案件相关性确定方法、装置、计算机设备和存储介质 (Case correlation determination method and device, computer equipment and storage medium ) 是由 庄东哲 杨锦璈 于 2019-10-17 设计创作，主要内容包括：本发明适用于计算机技术领域,提供了一种案件相关性确定方法、装置、计算机设备和存储介质,所述案件相关性确定方法包括：获取被测试对象在看到预设的多张图像时的眼动数据；根据所述眼动数据以及预设的相关性分析模型确定被测试对象与预设的多张图像之间的相关概率；根据所述相关概率以及预设的多张图像与案件之间的相关性,确定被测试对象与案件之间的相关性。本发明实施例提供的一种案件相关性确定方法,采用眼动数据进行案件相关性分析,对测试人员的专业技能要求低,便于推广,结合后续的基于深度神经网络算法训练生成的相关性分析模型的处理,能够更加准确的确定出被测试对象与所述案件之间的相关性。(The invention is suitable for the technical field of computers, and provides a case correlation determination method, a case correlation determination device, computer equipment and a storage medium, wherein the case correlation determination method comprises the following steps: acquiring eye movement data of a tested object when the tested object sees a plurality of preset images; determining the correlation probability between the tested object and a plurality of preset images according to the eye movement data and a preset correlation analysis model; and determining the correlation between the tested object and the case according to the correlation probability and the correlation between the preset multiple images and the case. According to the case correlation determination method provided by the embodiment of the invention, the case correlation analysis is carried out by adopting the eye movement data, the requirement on the professional skill of a tester is low, the popularization is convenient, and the correlation between the tested object and the case can be more accurately determined by combining the subsequent processing of the correlation analysis model generated based on the deep neural network algorithm training.)

1. A case correlation determination method, comprising the steps of:

the method comprises the steps that eye movement data of a tested object when the tested object sees a plurality of preset images are obtained, the plurality of preset images comprise case related images and comparison images, and the eye movement data comprise pupil diameters, annotations and eye jump data;

respectively determining the correlation probability between the tested object and a plurality of preset images according to the eye movement data of the tested object when the tested object sees the plurality of preset images and a preset correlation analysis model generated based on deep neural network algorithm training;

and determining the correlation between the tested object and the case according to a preset case correlation determination rule according to the respectively determined correlation probability between the tested object and the preset multiple images and the correlation between the preset multiple images and the case.

2. The case correlation determination method according to claim 1, further comprising, after said step of acquiring eye movement data of the subject while seeing a plurality of preset images:

and acquiring eye movement data of a tested object when the tested object sees a preset combined image, wherein the preset combined image is obtained by combining a plurality of preset images.

3. The case correlation determination method according to claim 1, wherein the step of determining the correlation between the tested object and the case according to a preset case correlation determination rule based on the respectively determined correlation probability between the tested object and the preset multiple images and the correlation between the preset multiple images and the case specifically comprises:

determining the correlation degree of the tested object and each case related image according to the correlation probability between the tested object and each case related image;

calculating the correlation degree of the tested object and the related image of each case to obtain the correlation degree of the tested object and the case;

determining a correction coefficient according to the correlation probability between the tested object and each comparative image;

correcting the correlation degree of the tested object and the case according to the correction coefficient to obtain the corrected correlation degree of the tested object and the case;

and determining the correlation between the tested object and the case according to the correction correlation of the tested object and the case.

4. The case correlation determination method according to claim 1, wherein the step of training and generating the preset correlation analysis model trained and generated based on the deep neural network algorithm specifically comprises:

acquiring historical eye movement data of a plurality of groups of known correlation results;

establishing an initialized correlation analysis model containing variable parameters;

determining the response correlation probability of each historical eye movement data according to the historical eye movement data of each known correlation result and the correlation analysis model;

calculating a loss value between the response correlation probability of each historical eye movement data and the known correlation result of each historical eye movement data;

judging whether the loss value meets a preset condition or not;

when the loss value is judged not to meet the preset condition, adjusting variable parameters in the correlation analysis model based on a gradient descent algorithm and according to the loss value, and returning to the step of determining the response correlation probability of each historical eye movement data according to the historical eye movement data of each known correlation result and the correlation analysis model;

and when the loss value is judged to meet the preset condition, determining the current correlation analysis model as a correlation analysis model generated in advance based on deep neural network algorithm training.

5. A case correlation determination apparatus, comprising:

the system comprises an eye movement data acquisition unit, a comparison unit and a comparison unit, wherein the eye movement data acquisition unit is used for acquiring eye movement data of a tested object when the tested object sees a plurality of preset images, the preset images comprise case related images and comparison images, and the eye movement data comprise pupil diameter, fixation and eye jump data;

the image correlation probability analysis unit is used for respectively determining the correlation probability between the tested object and a plurality of preset images according to the eye movement data of the tested object when the tested object sees the plurality of preset images and a preset correlation analysis model generated based on deep neural network algorithm training;

and the case correlation analysis unit is used for determining the correlation between the tested object and the case according to preset case correlation determination rules according to the respectively determined correlation probability between the tested object and the preset multiple images and the correlation between the preset multiple images and the case.

6. The case correlation determination apparatus according to claim 5, further comprising:

the combined image eye movement data acquisition unit is used for acquiring eye movement data of a tested object when the tested object sees a preset combined image, and the preset combined image is obtained by combining a plurality of preset images.

7. The case correlation determination device according to claim 5, wherein said case correlation analysis unit specifically comprises:

the case related image correlation degree calculation module is used for determining the correlation degree of the tested object and each case related image according to the correlation probability between the tested object and each case related image;

the case correlation degree calculating module is used for calculating the correlation degree of the tested object and the related image of each case to obtain the correlation degree of the tested object and the case;

the correction coefficient calculation module is used for determining a correction coefficient according to the correlation probability between the tested object and each comparative image;

the correction correlation degree calculation module is used for correcting the correlation degree of the tested object and the case according to the correction coefficient to obtain the correction correlation degree of the tested object and the case;

and the correlation determination module is used for determining the correlation between the tested object and the case according to the correction correlation of the tested object and the case.

8. The case correlation determination device according to claim 5, further comprising a correlation analysis model training unit for training and generating the correlation analysis model generated by the pre-training based on the deep neural network algorithm; the correlation analysis model training unit specifically comprises:

the historical eye movement data acquisition module is used for acquiring multiple groups of historical eye movement data of known correlation results;

the initialization correlation analysis model establishing module is used for establishing an initialization correlation analysis model containing variable parameters;

the response correlation probability calculation module is used for determining the response correlation probability of each historical eye movement data according to the historical eye movement data of each known correlation result and the correlation analysis model;

the loss value calculation module is used for calculating the loss value between the response correlation probability of each historical eye movement data and the known correlation result of each historical eye movement data;

the judging module is used for judging whether the loss value meets a preset condition or not;

the correlation analysis model adjusting module is used for adjusting variable parameters in the correlation analysis model based on a gradient descent algorithm and according to the loss value when the loss value is judged not to meet the preset condition, and returning to the step of determining the response correlation probability of each historical eye movement data according to the historical eye movement data of each known correlation result and the correlation analysis model;

and the correlation analysis model determining module is used for determining the current correlation analysis model as a correlation analysis model generated in advance based on deep neural network algorithm training when the loss value is judged to meet the preset condition.

9. A computer arrangement, characterized by comprising a memory and a processor, the memory having stored therein a computer program which, when executed by the processor, causes the processor to carry out the steps of the case correlation determination method as claimed in any one of claims 1 to 4.

10. A computer-readable storage medium, having stored thereon a computer program which, when executed by a processor, causes the processor to carry out the steps of the case relevance determination method according to any of claims 1 to 4.

Technical Field

The invention belongs to the technical field of computers, and particularly relates to a case correlation determination method and device, computer equipment and a storage medium.

Background

In the investigation process of criminal investigation cases, a plurality of questions are generally required to be put forward to suspects in a question-and-answer mode, and whether a lie behavior exists is judged according to collected evidences; or various physiological characteristics of the body of the suspect, such as respiration, pulse, frequency, blood pressure, skin electricity and the like, are recorded by the traditional multi-conductor instrument, so that whether the suspect has a lie behavior or not is judged, and the relevance between the suspect and the case is further determined.

However, in the case informed or related investigation and testing process, on one hand, in some cases, because evidence is lack, whether the investigated object lies or not cannot be determined, whether the investigated object involves a case or is informed or not cannot be determined, and only can be determined by subjective experience of case handling personnel, so that reliability is difficult to guarantee; on the other hand, the principle of conventional testing instruments such as a multi-lead instrument is to detect physiological changes caused by emotional changes, but the emotion causing the physiological changes is not specific, and it cannot be confirmed whether the physiological indexes change due to emotional changes caused by behaviors such as lying, concealing, and the like. Moreover, the use of the multi-guide instrument has very high technical requirements on the questions of the testers, and the questions used for the tests must be capable of accurately causing emotional reactions of the testees on the specific matters to be investigated. The requirement on the professional skills of the testers is very high, and the popularization is inconvenient.

Therefore, in the conventional criminal investigation case investigation and criminal suspect interrogation processes, the technical problems of high requirements on professional skills of office workers and testers and low accuracy rate exist when determining the relevance of criminal suspects and cases and the knowledge conditions of witnesses, victims and the like.

Disclosure of Invention

The embodiment of the invention aims to provide a case correlation determination method, and aims to solve the technical problems of high requirements on professional skills of case handling personnel and testing personnel and low accuracy rate in determining the correlation between criminal suspects and cases and the situations of witnesses and victims and the like in the conventional criminal investigation case investigation and investigation inquiry processes.

The embodiment of the invention is realized in such a way that a case correlation determination method comprises the following steps:

the method comprises the steps of obtaining eye movement data of a tested object when the tested object sees a plurality of preset images, wherein the plurality of preset images comprise case related images and comparison images, and the eye movement data comprise pupil diameter, fixation and eye jump data;

respectively determining the correlation probability between the tested object and a plurality of preset images according to the eye movement data of the tested object when the tested object sees the plurality of preset images and a preset correlation analysis model generated based on deep neural network algorithm training;

and determining the correlation between the tested object and the case according to a preset case correlation determination rule according to the respectively determined correlation probability between the tested object and the preset multiple images and the correlation between the preset multiple images and the case.

Another object of an embodiment of the present invention is to provide a case correlation analysis apparatus, including:

the system comprises an eye movement data acquisition unit, a comparison unit and a comparison unit, wherein the eye movement data acquisition unit is used for acquiring eye movement data of a tested object when the tested object sees a plurality of preset images, the preset images comprise case related images and comparison images, and the eye movement data comprise pupil diameter, fixation and eye jump data;

the image correlation probability analysis unit is used for respectively determining the correlation probability between the tested object and a plurality of preset images according to the eye movement data of the tested object when the tested object sees the plurality of preset images and a preset correlation analysis model generated based on deep neural network algorithm training;

and the case correlation analysis unit is used for determining the correlation between the tested object and the case according to preset case correlation determination rules according to the respectively determined correlation probability between the tested object and the preset multiple images and the correlation between the preset multiple images and the case.

It is a further object of embodiments of the present invention to provide a computer apparatus, comprising a memory and a processor, wherein the memory stores a computer program, and the computer program, when executed by the processor, causes the processor to execute the steps of the case correlation determination method as described above.

It is a further object of embodiments of the present invention to provide a computer-readable storage medium, on which a computer program is stored, which, when executed by a processor, causes the processor to perform the steps of the case correlation determination method as described above.

The case correlation determination method provided by the embodiment of the invention comprises the steps of obtaining eye movement data of a tested object after seeing a plurality of preset case correlation images and comparison images, wherein the eye movement data comprises pupil diameter, fixation and eye jump data; and processing each eye movement data according to a preset correlation analysis model generated based on deep neural network algorithm training, respectively determining the correlation probability between the tested object and each case related image and the comparison image, and further determining the correlation between the tested object and the case by combining the correlation probability between the tested object and each case related image and the comparison image and the correlation between each image and the case. The case correlation determination method provided by the embodiment of the invention is based on the principle that people suddenly see familiar/thought-to-avoid things and can involuntarily show specific eye movement information, and compared with the technical scheme that in the prior art, by recording various physiological characteristics of the body of a suspect, such as respiration, pulse, frequency, blood pressure and galvanic skin lie detection, a tester does not need to ask questions according to actual case design and talk with the suspect, only needs to play a plurality of preset images according to a preset mode, has low requirements on the professional skills of the tester, and is convenient to popularize. In addition, the eye movement characteristic analysis is generated based on the cognitive psychology principle, compared with the emotional psychophysiology characteristics, the eye movement detection has higher stability and specificity, the eye movement detection is also more targeted and more concealed, a suspect cannot absolutely control the brain cognitive processing process of the suspect, and the control behavior of the suspect can be expressed on the eye movement characteristics. The correlation analysis model generated by training based on the deep neural network algorithm and subsequent processing are combined, the correlation between the tested object and the case can be more accurately determined, and a more accurate case correlation result is provided by outputting a related or unrelated probability value instead of only providing a related or unrelated result.

Drawings

FIG. 1 is a flowchart illustrating steps of a method for determining case relevance according to an embodiment of the present invention;

FIG. 2 is a flowchart illustrating steps of another case relevance determination method according to an embodiment of the present invention;

FIG. 3 is a flowchart of a step of determining the correlation between a tested object and a case based on the correlation probability according to an embodiment of the present invention;

FIG. 4 is a flowchart illustrating steps of a method for training a generated correlation analysis model according to an embodiment of the present invention;

fig. 5 is a schematic structural diagram of a case correlation determination apparatus according to an embodiment of the present invention;

FIG. 6 is a schematic structural diagram of another case correlation determination apparatus according to an embodiment of the present invention;

FIG. 7 is a schematic structural diagram of a case correlation analysis unit according to an embodiment of the present invention;

fig. 8 is a schematic structural diagram of a correlation analysis model training unit according to an embodiment of the present invention.

Detailed Description

In order to make the objects, technical solutions and advantages of the present invention more apparent, the present invention is described in further detail below with reference to the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are merely illustrative of the invention and are not intended to limit the invention.

As shown in fig. 1, in an embodiment, a flow chart of steps of a case correlation determination method is provided, which specifically includes the following steps:

step S102, eye movement data of the tested object when the tested object sees a plurality of preset images is obtained.

In the embodiment of the invention, the preset multiple images comprise case-related images and comparison images, wherein the case-related images refer to character images, article images or location images related to cases, for example, the character images can be other involved characters such as victims, witnesses, partners and the like, the article images can be other involved articles such as case tools and dirt, the location images can be other involved places such as case sites and related places, and the comparison images refer to images which are unrelated to the cases and have the same type as the case-related images.

In the embodiment of the present invention, the eye movement data includes pupil diameter, gaze, and eye jump data, where the eye jump data includes eye jump frequency, eye jump duration, eye jump speed, eye jump latency, eye jump amplitude, and the like, and the gaze data includes gaze times/total duration, first gaze duration, review times, saccade path length, gaze duration mean and maximum/minimum, gaze dispersion, and the like.

In the embodiment of the present invention, further, the eye movement data further includes blink times/frequency and the like.

In the embodiment of the present invention, only the process of analyzing and processing the collected eye movement data to determine the case correlation is limited, but the process of collecting the eye movement data is not specifically limited, and those skilled in the art can know that the collection of the eye movement data can be realized by an eye movement instrument sold in the market, for example, an SMI desktop 250Hz eye movement instrument may be selected, and the collected data is further imported into the eye movement data analyzing and processing device in a wired, wireless or manual input manner.

In the embodiment of the present invention, for convenience of understanding, a feasible data acquisition overall process is provided, which is specifically as follows: the method comprises the steps of sequentially displaying 1 preset case-related image and 8 preset contrast images with the same specification and similar main body colors in front of a tested object according to a random sequence (the first case-related image is prevented from appearing as much as possible), displaying each image for 4000ms, acquiring high-dimensional data at a sampling rate of 140Hz, and directly transmitting eye movement data to data analysis equipment through a USB interface, wherein the data analysis equipment realizes the acquisition of the eye movement data. It should be understood that, in the above process, the number of case-related images, the number of contrast images, the display duration of each image, the frequency of data acquisition, and the like may be set according to actual needs, and do not represent the limitation on the data acquisition process.

Step S104, respectively determining the correlation probability between the tested object and a plurality of preset images according to the eye movement data of the tested object when the tested object sees the plurality of preset images and a preset correlation analysis model generated based on deep neural network algorithm training.

In the embodiment of the invention, the eye movement data can laterally represent the correlation between the tested object and the preset multiple images, for the image with high correlation, the tested object often shows subtle phenomena of deliberate avoidance and multiple jumps of sight lines, and the subtle phenomena are all recorded in the eye movement data, so that the relation between the eye movement data and the correlation is hidden. The preset correlation analysis model generated by training based on the deep neural network algorithm is trained in advance based on a large number of known samples and is used for describing a model of an implicit relation between the eye movement data and the correlation probability.

In the embodiment of the invention, the correlation analysis model generated based on deep neural network algorithm training is composed of an input layer, a hidden layer and an output layer, wherein the hidden layer is preferably provided with 3 layers, a cross entropy loss function is selected as a loss function, the training speed of the correlation analysis model can be effectively improved, an S-shaped function (Sigmoid function) is used as an activation function, the output value of the Sigmoid function is (0,1), so that the correlation probability between a tested object and each preset image can be represented, and the output value is closer to 1, which indicates that the correlation between the tested object and the image is higher.

In the embodiment of the present invention, please specifically refer to fig. 4 and its explanation for the step of training and generating the preset correlation analysis model based on the deep neural network algorithm training.

Step S106, determining the correlation between the tested object and the case according to the preset case correlation determination rule according to the respectively determined correlation probability between the tested object and the preset multiple images and the correlation between the preset multiple images and the case.

In the embodiment of the present invention, there are various specific forms of the preset case correlation determination rule, and refer to the following explanations.

In the embodiment of the present invention, it can be known that, in the preset multiple images, the case-related image is related to the case, that is, the related probability is 1, and the comparison case is not related to the case, the related probability should be 0, it is conceivable that, when the related probability of the object to be tested and each case-related image is generally higher, it indicates that the correlation between the object to be tested and the case is higher, therefore, the correlation between the object to be tested and the case can be simply represented by calculating the product or the sum of the related probabilities of the object to be tested and each case-related image, and the larger the product or the sum of the related probabilities of the object to be tested and each case-related image is, the higher the correlation is indicated.

In the embodiment of the present invention, it is further understood that, in consideration of autonomous control of the tested object and other error factors, obviously, the closer the related probability of the tested object to the image related to each case is to 1 or 0, the higher the confidence is indicated, the closer the related probability is to the median value of 0.5, the interference from external factors is indicated in the data acquisition process, the related probability fails to indicate correlation or irrelevance explicitly, the lower the confidence is, in order to further reduce the above-mentioned error interference, a tangent-like function is used to process the related probability, and the specific function expression is that

When the correlation probability x is 0.5, the value of f (x) is 0 at this time, namely, the correlation between the tested object and the case is not influenced, when the correlation probability is more than 0.5, the value of f (x) is positive, the correlation between the tested object and the case is influenced positively, namely, the correlation is inclined, and the closer the correlation probability is to 1, the larger the value of f (x), the more positive the positive shadow isThe larger the response is, and conversely, when the correlation probability is less than 0.5, the f (x) value is negative, the negative influence is generated on the correlation between the tested object and the case, namely, the correlation tends to be irrelevant, and the closer the correlation probability is to 0, the smaller the f (x) value is, the larger the negative influence is, the f (x) value between the tested object and the related image of each case is calculated, and the value after calculation represents the correlation between the tested object and the case, and the positive value and the larger the positive value indicate that the correlation is larger, the negative value and the smaller the negative value indicate that the independence is larger. At this time, the degree of correlation

Wherein x_iRepresenting the correlation probability between the tested object and the ith case correlation image. It should be understood that there are many variations on the function for processing the correlation probability, and the above-mentioned f (x) function expression is only a feasible function, and should not be construed as a limitation to the present invention, and any function that can achieve the same processing effect as the above-mentioned f (x) function expression on the correlation probability should be within the scope of the claimed invention, where the processing effect refers to: the closer the correlation probability is to the median value of 0.5, the lower the contribution to the correlation, and the closer to the two side values of 0 or 1, the higher the contribution to the correlation or the irrelevance.

In the embodiment of the invention, further, the comparison image has the effects of hiding case related images and reducing the alertness of the tested object, and the simultaneous calculation of the correlation probability between the tested object and the comparison image also has the effects of verifying the stability of the correlation analysis model and adjusting errors. It is conceivable that, for the comparison image, regardless of whether the subject to be tested is related to the case or not, it should be unrelated to the comparison image, and therefore the correlation probability between the subject to be tested and the comparison image should theoretically be 0, the difference between the true value of the correlation probability between the tested object and the comparison image and 0 indicates an error, and obviously, when the error is more significant, that is, when there is a significant difference between the true value of the correlation probability between the tested object and each comparison image and 0, the stability of the correlation analysis model should be checked, otherwise, can be regarded as an error in the normal range, and then a corresponding correction coefficient mu can be determined according to the magnitude of the error, multiplied by the obtained correlation S, the corrected correlation degree S' is obtained as μ S, and the accuracy of the determination of the case correlation is further improved. At this time, please refer to fig. 3 and the explanation of the specific process of step S106.

The case correlation determination method provided by the embodiment of the invention comprises the steps of obtaining eye movement data of a tested object after seeing a plurality of preset case correlation images and comparison images, wherein the eye movement data comprises pupil diameter, fixation and eye jump data; and processing each eye movement data according to a preset correlation analysis model generated based on deep neural network algorithm training, respectively determining the correlation probability between the tested object and each case related image and the comparison image, and further determining the correlation between the tested object and the case by combining the correlation probability between the tested object and each case related image and the comparison image and the correlation between each image and the case. The case correlation determination method provided by the embodiment of the invention is based on the principle that people suddenly see familiar/thought-to-avoid things and can involuntarily show specific eye movement information, and compared with the technical scheme that in the prior art, by recording various physiological characteristics of the body of a suspect, such as respiration, pulse, frequency, blood pressure and galvanic skin lie detection, a tester does not need to ask questions according to actual case design and talk with the suspect, only needs to play a plurality of preset images according to a preset mode, has low requirements on the professional skills of the tester, and is convenient to popularize. In addition, the eye movement characteristic analysis is generated based on the cognitive psychology principle, compared with the emotional psychophysiology characteristics, the eye movement detection has higher stability and specificity, the eye movement detection is also more targeted and more concealed, a suspect cannot absolutely control the brain cognitive processing process of the suspect, and the control behavior of the suspect can be expressed on the eye movement characteristics. The correlation analysis model generated by training based on the deep neural network algorithm and subsequent processing are combined, the correlation between the tested object and the case can be more accurately determined, and a more accurate case correlation result is provided by outputting a related or unrelated probability value instead of only providing a related or unrelated result.

In another embodiment, as shown in FIG. 2, a flow chart of the steps of another case relevance determination method is presented, as detailed below.

In the embodiment of the present invention, the difference from the step flowchart of a case relevance determination method shown in fig. 1 is that after the eye movement data of the tested object when the tested object sees a plurality of preset images is acquired in step S102. Further comprising:

step S202, eye movement data of the tested object when the tested object sees the preset combined image is obtained.

In an embodiment of the present invention, the preset combined image is obtained by combining a plurality of preset images.

In the embodiment of the invention, the preset images are arranged on the same image according to the grid, and the eye movement data of the tested object when the tested object sees the preset combined image is obtained, and the obtained eye movement data of the combined image and the obtained eye movement data respectively can reflect the related probability between the tested object and each preset image together.

As shown in fig. 3, in an embodiment, a flowchart of specific steps for determining a correlation between a tested object and a case based on a correlation probability is provided, which specifically includes the following steps:

step S302, determining the correlation degree of the tested object and each case related image according to the correlation probability between the tested object and each case related image.

In the embodiment of the invention, the functional relation expression between the correlation degree f (x) of the tested object and the related image of each case and the related probability x is as follows

For a detailed explanation of the function, refer to the explanation of step S106.

Step S304, calculating the correlation degree of the tested object and the relevant image of each case to obtain the correlation degree of the tested object and the case.

In the embodiment of the invention, the correlation f (x) of the tested object and the related image of each case is calculated to obtain the correlation S of the tested object and the case, namely the correlation SSimilarly, please refer to the explanation of step S106 for the specific explanation of the function.

Step S306, determining a correction coefficient according to the correlation probability between the tested object and each comparative image.

In the embodiment of the present invention, there are various ways to determine the correction coefficient, for example, the correction coefficient may be 0.8 to 0.9 in a proportion of the total number of the number of images having correlation probabilities with the comparison image satisfying a predetermined condition.

And S308, correcting the correlation between the tested object and the case according to the correction coefficient to obtain the corrected correlation between the tested object and the case.

In the embodiment of the invention, the correction correlation degree S' of the tested object and the case is equal to mu S.

Step S310, determining the correlation between the tested object and the case according to the correction correlation between the tested object and the case.

In the embodiment of the present invention, as can be seen from the foregoing discussion, if the correction correlation degree between the tested object and the case is positive, the higher the correlation possibility is, and if the correction correlation degree is negative, the lower the correlation possibility is, whether there is correlation may be determined by determining that the correction correlation degree is sufficiently greater than a preset correlation threshold, when the correlation degree is greater than the correlation threshold, it may be determined that the tested object is related to the case, and when the correlation degree is lower than the correlation threshold, it may be determined that the tested object is not related to the case.

As shown in fig. 4, in an embodiment, a flowchart of steps of a method for training a generated correlation analysis model is provided, which specifically includes:

in step S402, historical eye movement data of a plurality of sets of known correlation results are obtained.

In the embodiment of the present invention, the historical eye movement data is eye movement data of a tested object collected in a historical manner and a plurality of preset images, the plurality of preset images also include case-related images and contrast images, and the eye movement data also includes pupil diameter change data and pupil position change data.

In the embodiment of the present invention, the correlation probability between the tested object and the preset multiple images is known, specifically, the correlation result between the tested object and the case correlation image is 1, and the correlation result between the tested object and the comparison image is 0.

Step S404, an initialized correlation analysis model containing variable parameters is established.

In an embodiment of the present invention, the correlation analysis model includes an input layer, a hidden layer and an output layer, the hidden layer includes three layers, and each hidden layer includes two variable parameter weight matrices and a bias vector.

Step S406, determining the response correlation probability of each historical eye movement data according to the historical eye movement data of each known correlation result and the correlation analysis model.

In the embodiment of the invention, the activation function is a sigmoid function, and the output of the sigmoid function is passed through, and the value range of the response correlation probability of the output at this time is (0, 1).

And step S408, calculating a loss value between the response correlation probability of each historical eye movement data and the known correlation result of each historical eye movement data.

In the embodiment of the invention, the loss value is solved by adopting a cross entropy loss function.

Step S410, determining whether the loss value satisfies a preset condition. When it is determined that the loss value does not satisfy the preset condition, performing step S412; when it is determined that the loss value satisfies the preset condition, step S414 is performed.

In the embodiment of the present invention, the preset condition is usually set to be smaller than a preset threshold, and when the loss value is not smaller than the preset threshold, it indicates that the response correlation probability is greatly different from the known correlation result, and at this time, the parameter in the correlation analysis model is wrong and needs to be adjusted. And when the loss value is smaller than a preset threshold value, the difference between the response correlation probability and the known correlation result is small, and at the moment, the current correlation analysis model is determined to be a correlation analysis model generated in advance based on deep neural network algorithm training.

Step S412, adjusting variable parameters in the correlation analysis model based on a gradient descent algorithm and according to the loss value, and returning to the step S406.

And step S414, determining the current correlation analysis model as a correlation analysis model generated in advance based on deep neural network algorithm training.

Fig. 5 is a schematic structural diagram of a case correlation determination apparatus according to an embodiment of the present invention, which is described in detail below.

In the embodiment of the present invention, the case correlation determination device specifically includes:

an eye movement data acquiring unit 510, configured to acquire eye movement data of a subject when the subject sees a plurality of preset images.

In the embodiment of the invention, the preset multiple images comprise case-related images and comparison images, wherein the case-related images refer to character images, article images or location images related to cases, for example, the character images can be other involved characters such as victims, witnesses, partners and the like, the article images can be other involved articles such as case tools and dirt, the location images can be other involved places such as case sites and related places, and the comparison images refer to images which are unrelated to the cases and have the same type as the case-related images.

In the embodiment of the present invention, the eye movement data includes pupil diameter, gaze, and eye jump data, where the eye jump data includes eye jump frequency, eye jump duration, eye jump speed, eye jump latency, eye jump amplitude, and the like, and the gaze data includes gaze times/total duration, first gaze duration, review times, saccade path length, gaze duration mean and maximum/minimum, gaze dispersion, and the like.

In the embodiment of the present invention, further, the eye movement data further includes blink times/frequency and the like.

In the embodiment of the present invention, only the process of analyzing and processing the collected eye movement data to determine the case correlation is limited, but the process of collecting the eye movement data is not specifically limited, and those skilled in the art can know that the collection of the eye movement data can be realized by an eye movement instrument sold in the market, for example, an SMI desktop 250Hz eye movement instrument may be selected, and the collected data is further imported into the eye movement data analyzing and processing device in a wired, wireless or manual input manner.

In the embodiment of the present invention, for convenience of understanding, a feasible data acquisition overall process is provided, which is specifically as follows: the method comprises the steps of sequentially displaying 1 preset case-related image and 8 preset contrast images with the same specification and similar main body colors in front of a tested object according to a random sequence (the first case-related image is prevented from appearing as much as possible), displaying each image for 4000ms, acquiring high-dimensional data at a sampling rate of 140Hz, and directly transmitting eye movement data to data analysis equipment through a USB interface, wherein the data analysis equipment realizes the acquisition of the eye movement data. It should be understood that, in the above process, the number of case-related images, the number of contrast images, the display duration of each image, the frequency of data acquisition, and the like may be set according to actual needs, and do not represent the limitation on the data acquisition process.

An image correlation probability analysis unit 520, configured to determine correlation probabilities between the test object and the preset multiple images according to the eye movement data of the test object when the test object sees the preset multiple images and a preset correlation analysis model generated based on deep neural network algorithm training.

In the embodiment of the invention, the eye movement data can laterally represent the correlation between the tested object and the preset multiple images, for the image with high correlation, the tested object often shows subtle phenomena of deliberate avoidance and multiple jumps of sight lines, and the subtle phenomena are all recorded in the eye movement data, so that the relation between the eye movement data and the correlation is hidden. The preset correlation analysis model generated by training based on the deep neural network algorithm is trained in advance based on a large number of known samples and is used for describing a model of an implicit relation between the eye movement data and the correlation probability.

In the embodiment of the invention, the correlation analysis model generated based on deep neural network algorithm training is composed of an input layer, a hidden layer and an output layer, wherein the hidden layer is preferably provided with 3 layers, a cross entropy loss function is selected as a loss function, the training speed of the correlation analysis model can be effectively improved, an S-shaped function (Sigmoid function) is used as an activation function, the output value of the Sigmoid function is (0,1), so that the correlation probability between a tested object and each preset image can be represented, and the output value is closer to 1, which indicates that the correlation between the tested object and the image is higher.

A case correlation analysis unit 530, configured to determine, according to preset case correlation determination rules, a correlation between the tested object and the case according to the separately determined correlation probabilities between the tested object and the preset multiple images and the correlations between the preset multiple images and the case.

In the embodiment of the present invention, the case correlation analysis unit 530 has various specific structures, and refer to the following explanations.

In the embodiment of the present invention, it can be known that, in the preset multiple images, the case-related image is related to the case, that is, the related probability is 1, and the comparison case is not related to the case, the related probability should be 0, it is conceivable that, when the related probability of the object to be tested and each case-related image is generally higher, it indicates that the correlation between the object to be tested and the case is higher, therefore, the correlation between the object to be tested and the case can be simply represented by calculating the product or the sum of the related probabilities of the object to be tested and each case-related image, and the larger the product or the sum of the related probabilities of the object to be tested and each case-related image is, the higher the correlation is indicated.

In the embodiment of the invention, furthermore, the invention can be processedThe method comprises the steps of solving, considering autonomous control of a tested object and other error factors, obviously, the closer the related probability of the tested object and a related image of each case is to 1 or 0, the higher the confidence coefficient is, the closer the related probability is to a middle value of 0.5, the interference of external factors is shown in the data acquisition process, the related probability cannot clearly indicate the correlation or the independence, the confidence coefficient is lower, and in order to further reduce the error interference caused by the fact, the related probability is processed by adopting a tangent-like function, wherein the specific function expression is that

When the correlation probability x is 0.5, f (x) is 0, namely the correlation between the tested object and the case is not influenced, when the correlation probability is more than 0.5, f (x) is positive, the positive influence is exerted on the correlation between the tested object and the case, namely the correlation is inclined, the closer the correlation probability is to 1, the larger the f (x) value is, the positive influence is, conversely, when the correlation probability is less than 0.5, f (x) is negative, the negative influence is exerted on the correlation between the tested object and the case, namely the correlation is inclined to be irrelevant, the closer the correlation probability is to 0, the smaller the f (x) value is, the negative influence is, the f (x) value between the tested object and each case related image is calculated, when the calculated value characterizes the correlation between the tested object and the case, the value is positive, and the larger the value is, the correlation is indicated, values are negative and smaller indicates greater independence. At this time, the degree of correlation

Wherein x_iRepresenting the correlation probability between the tested object and the ith case correlation image. It should be understood that there are many variations on the function for processing the correlation probability, and the above-mentioned f (x) function expression is only a feasible function, and should not be construed as a limitation to the present invention, and any function that can achieve the same processing effect as the above-mentioned f (x) function expression on the correlation probability should be within the scope of the claimed invention, where the processing effect refers to: the closer the correlation probability is to the median 0.5, the more the correlation isThe lower the contribution, the closer to the two-sided value 0 or 1, the higher the contribution to the correlation or irrelevance.

In the embodiment of the invention, further, the comparison image has the effects of hiding case related images and reducing the alertness of the tested object, and the simultaneous calculation of the correlation probability between the tested object and the comparison image also has the effects of verifying the stability of the correlation analysis model and adjusting errors. It is conceivable that, for the comparison image, regardless of whether the subject to be tested is related to the case or not, it should be unrelated to the comparison image, and therefore the correlation probability between the subject to be tested and the comparison image should theoretically be 0, the difference between the true value of the correlation probability between the tested object and the comparison image and 0 indicates an error, and obviously, when the error is more significant, that is, when there is a significant difference between the true value of the correlation probability between the tested object and each comparison image and 0, the stability of the correlation analysis model should be checked, otherwise, can be regarded as an error in the normal range, and then a corresponding correction coefficient mu can be determined according to the magnitude of the error, multiplied by the obtained correlation S, the corrected correlation degree S' is obtained as μ S, and the accuracy of the determination of the case correlation is further improved. At this time, please refer to fig. 7 and the explanation of the structure of the case correlation analysis unit 530.

The case correlation determination device provided by the embodiment of the invention is used for acquiring the eye movement data of a tested object, which comprises pupil diameter, fixation and eye jump data, after the tested object sees a plurality of preset case images and comparison images; and processing each eye movement data according to a preset correlation analysis model generated based on deep neural network algorithm training, respectively determining the correlation probability between the tested object and each case image and the comparison image, and further determining the correlation between the tested object and the case by combining the correlation probability between the tested object and each case image and the comparison image and the correlation between each image and the case. The case correlation determination device provided by the embodiment of the invention is based on the principle that people suddenly see familiar/thought-to-avoid things and can involuntarily show specific eye movement information, and compared with the technical scheme that in the prior art, the physical characteristics of a suspect such as respiration, pulse, frequency, blood pressure and skin humidity lie detection are recorded, a tester does not need to ask questions according to actual case design and talk with the suspect, only needs to play a plurality of preset images according to a preset mode, the requirement on the professional skill of the tester is low, and the case correlation determination device is convenient to popularize. In addition, the eye movement characteristic analysis is based on the cognitive psychology principle, and compared with other physiological characteristics, the eye movement characteristic analysis has higher stability and specificity, eye movement detection is also more targeted and more concealed, a suspect cannot absolutely control the brain cognitive processing process, and the control behavior of the suspect can also be expressed on the eye movement characteristic. The correlation analysis model generated by training based on the deep neural network algorithm and subsequent processing are combined, the correlation between the tested object and the case can be more accurately determined, and a more accurate case correlation result is provided by outputting a related or unrelated probability value instead of only providing a related or unrelated result.

Fig. 6 is a schematic structural diagram of a case correlation determination apparatus according to another embodiment of the present invention, which is described in detail below.

In the embodiment of the present invention, the difference from the schematic structural diagram of a case correlation determination apparatus shown in fig. 5 is that the apparatus further includes:

the combined image eye movement data acquiring unit 610 is used for acquiring eye movement data of the tested object when the tested object sees a preset combined image.

In an embodiment of the present invention, the preset combined image is obtained by combining a plurality of preset images.

In the embodiment of the invention, the preset images are arranged on the same image according to the grid, and the eye movement data of the tested object when the tested object sees the preset combined image is obtained, and the obtained eye movement data of the combined image and the obtained eye movement data respectively can reflect the related probability between the tested object and each preset image together.

Fig. 7 is a schematic structural diagram of a case correlation analysis unit according to an embodiment of the present invention, which is described in detail below.

In the embodiment of the present invention, the case correlation analysis unit specifically includes:

a case related image correlation degree calculating module 701, configured to determine the correlation degree between the tested object and each case related image according to the correlation probability between the tested object and each case related image.

In the embodiment of the invention, the functional relation expression between the correlation degree f (x) of the tested object and the related image of each case and the related probability x is as follows

For a detailed explanation of the function, refer to the explanation of the case correlation analysis unit 530.

A case correlation degree calculating module 702, configured to calculate a correlation degree between the object to be tested and each case related image to obtain a correlation degree between the object to be tested and the case.

In the embodiment of the invention, the correlation f (x) of the tested object and the related image of each case is calculated to obtain the correlation S of the tested object and the case, namely the correlation S

Similarly, please refer to the explanation of the case correlation analysis unit 530 for the detailed explanation of the function.

And a correction coefficient calculating module 703 for determining a correction coefficient according to the correlation probability between the tested object and each comparative image.

In the embodiment of the present invention, there are various ways to determine the correction coefficient, for example, the correction coefficient may be 0.8 to 0.9 in a proportion of the total number of the number of images having correlation probabilities with the comparison image satisfying a predetermined condition.

And a correction correlation degree calculation module 704, configured to correct the correlation degree between the test object and the case according to the correction coefficient to obtain a correction correlation degree between the test object and the case.

In the embodiment of the invention, the correction correlation degree S' of the tested object and the case is equal to mu S.

A correlation determination module 705, configured to determine a correlation between the tested object and the case according to the corrected correlation between the tested object and the case.

In the embodiment of the present invention, as can be seen from the foregoing discussion, if the correction correlation degree between the tested object and the case is positive, the higher the correlation possibility is, and if the correction correlation degree is negative, the lower the correlation possibility is, whether there is correlation may be determined by determining that the correction correlation degree is sufficiently greater than a preset correlation threshold, when the correlation degree is greater than the correlation threshold, it may be determined that the tested object is related to the case, and when the correlation degree is lower than the correlation threshold, it may be determined that the tested object is not related to the case.

Fig. 8 is a schematic structural diagram of a correlation analysis model training unit according to an embodiment of the present invention, which is described in detail below.

In an embodiment of the present invention, the correlation analysis model training unit is configured to generate the correlation analysis model generated by training based on the deep neural network algorithm in advance, and specifically includes:

a historical eye movement data acquiring module 801, configured to acquire historical eye movement data of a plurality of known correlation results.

In the embodiment of the present invention, the historical eye movement data is eye movement data of a tested object collected in a historical manner and a plurality of preset images, the plurality of preset images also include case-related images and contrast images, and the eye movement data also includes pupil diameter change data and pupil position change data.

In the embodiment of the present invention, the correlation probability between the tested object and the preset multiple images is known, specifically, the correlation result between the tested object and the case correlation image is 1, and the correlation result between the tested object and the comparison image is 0.

An initialized correlation analysis model building module 802 for building an initialized correlation analysis model with variable parameters.

In an embodiment of the present invention, the correlation analysis model includes an input layer, a hidden layer and an output layer, the hidden layer includes three layers, and each hidden layer includes two variable parameter weight matrices and a bias vector.

And a response correlation probability calculation module 803, configured to determine a response correlation probability of each historical eye movement data according to the historical eye movement data of each known correlation result and the correlation analysis model.

In the embodiment of the invention, the activation function is a sigmoid function, and the output of the sigmoid function is passed through, and the value range of the response correlation probability of the output at this time is (0, 1).

A loss value calculating module 804, configured to calculate a loss value between the response correlation probability of each historical eye movement data and the known correlation result of each historical eye movement data.

In the embodiment of the invention, the loss value is solved by adopting a cross entropy loss function.

The determining module 805 is configured to determine whether the loss value meets a preset condition.

And a correlation analysis model adjusting module 806, configured to, when it is determined that the loss value does not meet the preset condition, adjust a variable parameter in the correlation analysis model according to the loss value based on a gradient descent algorithm, and return to the response correlation probability calculating module 803.

A correlation analysis model determining module 807, configured to determine, when it is determined that the loss value satisfies the preset condition, a current correlation analysis model as a correlation analysis model generated in advance based on deep neural network algorithm training.

In the embodiment of the present invention, the preset condition is usually set to be smaller than a preset threshold, and when the loss value is not smaller than the preset threshold, it indicates that the response correlation probability is greatly different from the known correlation result, and at this time, the parameter in the correlation analysis model is wrong and needs to be adjusted. And when the loss value is smaller than a preset threshold value, the difference between the response correlation probability and the known correlation result is small, and at the moment, the current correlation analysis model is determined to be a correlation analysis model generated in advance based on deep neural network algorithm training.

In one embodiment, a computer device is proposed, the computer device comprising a memory, a processor and a computer program stored on the memory and executable on the processor, the processor implementing the following steps when executing the computer program:

the method comprises the steps that eye movement data of a tested object when the tested object sees a plurality of preset images are obtained, the plurality of preset images comprise case related images and comparison images, and the eye movement data comprise pupil diameter change data and pupil position change data;

respectively determining the correlation probability between the tested object and a plurality of preset images according to the eye movement data of the tested object when the tested object sees the plurality of preset images and a preset correlation analysis model generated based on deep neural network algorithm training;

and determining the correlation between the tested object and the case according to the respectively determined correlation probability between the tested object and the preset multiple images and the correlation between the preset multiple images and the case.

In one embodiment, a computer readable storage medium is provided, having a computer program stored thereon, which, when executed by a processor, causes the processor to perform the steps of:

the method comprises the steps that eye movement data of a tested object when the tested object sees a plurality of preset images are obtained, the plurality of preset images comprise case related images and comparison images, and the eye movement data comprise pupil diameter change data and pupil position change data;

respectively determining the correlation probability between the tested object and a plurality of preset images according to the eye movement data of the tested object when the tested object sees the plurality of preset images and a preset correlation analysis model generated based on deep neural network algorithm training;

and determining the correlation between the tested object and the case according to the respectively determined correlation probability between the tested object and the preset multiple images and the correlation between the preset multiple images and the case.

It should be understood that, although the steps in the flowcharts of the embodiments of the present invention are shown in sequence as indicated by the arrows, the steps are not necessarily performed in sequence as indicated by the arrows. The steps are not performed in the exact order shown and described, and may be performed in other orders, unless explicitly stated otherwise. Moreover, at least a portion of the steps in various embodiments may include multiple sub-steps or multiple stages that are not necessarily performed at the same time, but may be performed at different times, and the order of performance of the sub-steps or stages is not necessarily sequential, but may be performed in turn or alternately with other steps or at least a portion of the sub-steps or stages of other steps.

It will be understood by those skilled in the art that all or part of the processes of the methods of the embodiments described above can be implemented by a computer program, which can be stored in a non-volatile computer-readable storage medium, and can include the processes of the embodiments of the methods described above when the program is executed. Any reference to memory, storage, database, or other medium used in the embodiments provided herein may include non-volatile and/or volatile memory, among others. Non-volatile memory can include read-only memory (ROM), Programmable ROM (PROM), Electrically Programmable ROM (EPROM), Electrically Erasable Programmable ROM (EEPROM), or flash memory. Volatile memory can include Random Access Memory (RAM) or external cache memory. By way of illustration and not limitation, RAM is available in a variety of forms such as Static RAM (SRAM), Dynamic RAM (DRAM), Synchronous DRAM (SDRAM), Double Data Rate SDRAM (DDRSDRAM), Enhanced SDRAM (ESDRAM), Synchronous Link DRAM (SLDRAM), Rambus Direct RAM (RDRAM), direct bus dynamic RAM (DRDRAM), and memory bus dynamic RAM (RDRAM).

The technical features of the embodiments described above may be arbitrarily combined, and for the sake of brevity, all possible combinations of the technical features in the embodiments described above are not described, but should be considered as being within the scope of the present specification as long as there is no contradiction between the combinations of the technical features.

The above-mentioned embodiments only express several embodiments of the present invention, and the description thereof is more specific and detailed, but not construed as limiting the scope of the present invention. It should be noted that, for a person skilled in the art, several variations and modifications can be made without departing from the inventive concept, which falls within the scope of the present invention. Therefore, the protection scope of the present patent shall be subject to the appended claims.

The above description is only for the purpose of illustrating the preferred embodiments of the present invention and is not to be construed as limiting the invention, and any modifications, equivalents and improvements made within the spirit and principle of the present invention are intended to be included within the scope of the present invention.