阅读说明：本技术 一种精神状态筛查系统、精神状态筛查方法及存储介质 (Mental state screening system, mental state screening method and storage medium ) 是由 周雯娟 郭科 邓文与 罗军飞 白寅 于 2020-12-02 设计创作，主要内容包括：一种精神状态筛查系统、精神状态筛查方法及存储介质,精神状态筛查系统包括：显控组件,用于显示语言功能测试视频、显示语言功能测试问题、显示引导图、输入接触轨迹；语音装置,用于接收语音和进行语音播报；影像采集装置,用于采集用户的影像信息；处理器,分别与显控组件、语音装置、影像采集装置连接,其内设置有依照MMSE进行精神状态检测的多个功能模块；显控组件和语音装置用于辅助多个功能模块完成精神状态检测；服务器,与处理器连接,用于存储多个功能模块产生的数据并与处理器进行数据交互。本发明实施例可以实现人机交互,并且便于进行数据存储,且通过多个功能模块分别进行部分检测,也便于更有针对性的完成相应的检测过程。(A mental state screening system, a mental state screening method and a storage medium, the mental state screening system includes: the display control component is used for displaying a language function test video, displaying a language function test problem, displaying a guide picture and inputting a contact track; the voice device is used for receiving voice and broadcasting the voice; the image acquisition device is used for acquiring image information of a user; the processor is respectively connected with the display control assembly, the voice device and the image acquisition device, and is internally provided with a plurality of functional modules for detecting mental states according to MMSE; the display control assembly and the voice device are used for assisting the plurality of functional modules to complete mental state detection; and the server is connected with the processor and used for storing the data generated by the plurality of functional modules and performing data interaction with the processor. The embodiment of the invention can realize human-computer interaction, is convenient for data storage, and is convenient for completing corresponding detection processes in a more targeted manner by respectively performing partial detection through the plurality of functional modules.)

1. A mental state screening system, comprising:

the display control component is used for displaying a language function test video, displaying a language function test problem, displaying a guide picture and inputting a contact track;

the voice device is used for receiving voice and broadcasting the voice;

the image acquisition device is used for acquiring image information of a user;

the processor is respectively connected with the display control assembly, the voice device and the image acquisition device, and is internally provided with a plurality of functional modules for mental state detection according to MMSE; the display control assembly and the voice device are used for assisting the functional modules to complete mental state detection;

and the server is connected with the processor and is used for storing the data generated by the plurality of functional modules and performing data interaction with the processor.

2. A mental state screening system as recited in claim 1, wherein a plurality of the functional modules are built into the processor:

the directional force testing module is used for displaying a plurality of directional force testing questions through the display control assembly and judging whether the user answers correctly or not;

the real-time memory testing module is used for displaying a plurality of memory materials through the display control assembly, playing memory testing voices corresponding to the memory materials one by one through a voice device, guiding a user to read the memory testing voices sequentially through the voice device and judging whether the reading is correct or not;

the attention and calculation testing module is used for displaying a plurality of groups of operation questions through the display control assembly and judging whether the user answers correctly;

the language ability testing module is used for displaying various images with different properties through the display and control assembly and guiding a user to finish naming, displaying language ability testing sentences through the display and control assembly and guiding the user to finish reading, and judging whether naming is correct or not and whether reading is correct or not;

the reading capability testing module is used for displaying the action indicative characters through the display control assembly, guiding a user to complete corresponding actions and judging whether the actions are completed correctly;

the action capability testing module is used for displaying an action capability material through the display control component, guiding a user to follow and complete the action in the action capability material, and judging whether the action is completed;

and the result evaluation module integrates the judgment results of all the modules and displays a cognitive impairment evaluation result table in the display and control assembly.

3. A mental state screening method, comprising the steps of:

pre-judging and detecting: displaying a language function test video and proposing a language function test question at a visual terminal, acquiring voice information of a user and judging whether the voice information is correct or not, if the voice information is correct, assigning a built-in first judgment parameter to be 1, otherwise, assigning the first judgment parameter to be 0; displaying a guide diagram on the visual terminal, detecting a contact track of a hand of a user on the visual terminal, and if the contact track is consistent with the guide diagram, assigning a built-in second judgment parameter as 1, otherwise, assigning the second judgment parameter as 0;

generating a cognitive disorder evaluation result table: if the first judgment parameter and the second judgment parameter are both 1, setting a plurality of single tests according to MMSE, and completing the mental state detection of the plurality of single tests through the visual terminal; generating a cognitive impairment assessment results table and marking the pass status of a plurality of said individual tests.

4. A mental state screening method as recited in claim 3, wherein the plurality of single tests in accordance with an MMSE setting are:

and (3) testing the directional force: displaying a plurality of directional force test questions in the visual terminal, and marking that the directional force test is passed if the answer is correct;

real-time memory testing: sequentially displaying a plurality of memory materials and memory test voices corresponding to the memory materials one by one in the visual terminal, guiding a user to sequentially read the memory test voices, marking that an instant memory test is passed in the cognitive disorder evaluation result table if the reading is correct, and accumulating the number of instant memory test errors in the cognitive disorder evaluation result table if the reading is wrong;

attention and computational power testing: sequentially displaying a plurality of groups of operation questions in the visual terminal, and marking attention and calculation power test passing in the cognitive disorder assessment result table if the operation is correct;

language ability test: displaying various images with different properties in the visual terminal, and guiding a user to finish naming; displaying a sentence needing language ability testing in the visual terminal, and guiding a user to finish reading; if the naming is correct and the reading is correct, marking that the language ability test passes in the cognitive disorder assessment result table;

reading ability test: displaying action indicative characters in the visual terminal, and marking that the reading capability test passes in the cognitive impairment evaluation result table if the user finishes the action indicated by the action indicative characters;

and (3) testing the action capacity: displaying an action capacity material in the visual terminal, guiding a user to follow and complete actions in the action capacity material, and marking that the action capacity test is passed in the cognitive impairment evaluation result table if the action capacity material is completed;

and (4) evaluating the result: and integrating all the marking states in the cognitive disorder evaluation result table, and displaying the cognitive disorder evaluation result table in the visualization terminal.

5. A mental state screening method as recited in claim 4, wherein the plurality of single tests in accordance with an MMSE setting further comprises:

a memory ability test, namely skipping the memory ability test if the error times of the instant memory ability test are larger than a preset threshold value; and guiding a user to draw a plurality of memory materials and to repeat the corresponding memory test voices, and marking the number of successful memories in the visual terminal.

6. Mental state screening method according to claim 4 or 5, characterized in that said plurality of said single tests according to an MMSE setting further comprises:

testing the writing ability: guiding a user to write complete sentences in the visual terminal, and marking that the writing capability test is passed in the cognitive impairment evaluation result table if the sentences are written without errors;

and (3) testing the structural capability: and displaying structural ability materials in the visual terminal, guiding a user to finish copying, and marking that the structural ability test passes in the cognitive impairment assessment result table if the copying is correct.

7. The mental state screening method of claim 4, wherein the generating the cognitive impairment assessment results table further comprises the steps of:

if the first judgment parameter is 0 and the second judgment parameter is 1, the mental state detection is completed by collecting hand motion information;

and if the first judgment parameter is 1 and the second judgment parameter is 0, completing the mental state detection by collecting the voice information.

8. A mental state screening method as recited in claim 7, wherein the mental state detection by collecting hand motion information comprises the steps of:

language barrier directional force test: displaying a plurality of directional force test questions in the visual terminal, guiding a user to write answers in the visual terminal, and marking that the directional force test is passed if the answers are correct in the cognitive impairment assessment result table;

language disorder immediate memory test: sequentially displaying a plurality of memory materials and memory test voices corresponding to the memory materials one to one in the visual terminal, guiding a user to sequentially input characters in the visual terminal, marking that the language disorder directional strength test passes if the input is correct in the cognitive disorder evaluation result table, and accumulating the number of times of the language disorder instant memory strength test errors in the cognitive disorder evaluation result table if the input is wrong;

language disorder attention and computational power test: sequentially displaying a plurality of groups of operation questions in the visual terminal, and marking language disorder attention and calculation power in the cognitive disorder evaluation result table to pass if the operation is correct;

language disorder language ability test: displaying various images with different properties in the visual terminal, guiding a user to finish naming, and marking that the language disorder language ability test passes in the cognitive disorder evaluation result table if the naming is correct;

language disorder reading ability test: displaying action indicative characters in the visual terminal, and marking that the language disorder reading capability test is passed in the cognitive disorder evaluation result table if the user finishes the action indicated by the action indicative characters;

language disorder motor ability test: displaying an action capacity material in the visual terminal, guiding a user to follow and complete actions in the action capacity material, and marking that the language disorder action capacity test is passed in the cognitive disorder evaluation result table if the action capacity material is completed;

language barrier result evaluation: and integrating all the marking states in the cognitive disorder evaluation result table, and displaying the cognitive disorder evaluation result table in the visualization terminal.

9. A mental state screening method as recited in claim 7, wherein the mental state detection by collecting voice information comprises the steps of:

dyskinesia memory test: playing a plurality of vocabularies in the visual terminal in a voice mode, guiding a user to read along in sequence, and marking that the dyskinesia instant memory test passes if the reading along is correct in the cognitive disorder assessment result table; guiding a user to repeat a plurality of words played by voice at intervals of preset recall force detection time, and recording the number of successful repeat;

dyskinesia orientation force test: displaying a plurality of directional force test questions in the visual terminal, and marking that the directional force test of the dyskinesia passes in the cognitive impairment evaluation result table if the answer is correct;

language fluency test: displaying a language fluency material in the visual terminal, guiding a user to complete speed tracing according to the language fluency material, and recording a speed tracing result;

and (4) evaluating the result: and integrating all the marking states in the cognitive disorder evaluation result table, and displaying the cognitive disorder evaluation result table in the visualization terminal.

10. A computer-readable storage medium characterized by: the computer-readable storage medium stores computer-executable instructions for causing a computer to perform a mental state screening method as recited in any one of claims 3 to 9.

Technical Field

The invention belongs to the technical field of medical information, and particularly relates to a mental state screening system, a mental state screening method and a storage medium.

Background

Cognition is the process of acquiring relevant knowledge or applying relevant knowledge by converting information from the outside received by a human brain into intrinsic psychological activities through processing treatment. It includes aspects of memory, language, visual space, execution, calculation, and understanding judgment. Cognitive impairment is the impairment of one or more of the cognitive functions mentioned above and affects the daily or social abilities of an individual, and can be diagnosed as dementia. Screening for cognitive function is widely used in clinical diagnosis of diseases, such as alzheimer's disease, and in epidemiological studies.

Currently, in clinical practice, doctors usually adopt paper questionnaires, such as the Minimum Mean Square Error (MMSE), to evaluate the mental state of patients. In this case, the doctor usually needs to touch the patient one-to-one to complete the mental state detection, which takes much time and effort. On the other hand, because the judgment is manual, the subjective factors of the operator can influence the judgment result, and the quantitative monitoring and the comparison before and after the illness state of the patient are not facilitated.

Disclosure of Invention

The present invention is directed to solving at least one of the problems of the prior art. To this end, the invention provides a mental state screening system which solves the problems that mental judgment is high in dependence on human and easy to be wrong in manual judgment. The invention also provides a mental state screening method and a storage medium for storing computer executable instructions of the mental state screening method.

A mental state screening system according to an embodiment of a first aspect of the present invention includes: the display control component is used for displaying a language function test video, displaying a language function test problem, displaying a guide picture and inputting a contact track; the voice device is used for receiving voice and broadcasting the voice; the image acquisition device is used for acquiring image information of a user; the processor is respectively connected with the display control assembly, the voice device and the image acquisition device, and is internally provided with a plurality of functional modules for mental state detection according to MMSE; the display control assembly and the voice device are used for assisting the functional modules to complete mental state detection; and the server is connected with the processor and is used for storing the data generated by the plurality of functional modules and performing data interaction with the processor.

The mental state screening system according to the embodiment of the invention has at least the following technical effects: the mental state screening system provided by the embodiment of the invention can realize man-machine interaction with the user, and can effectively realize intuitive cognition on the physical state of the user. In addition, the mental state screening system of the embodiment of the invention is used for detecting, so that the data storage is convenient, partial detection is respectively carried out through a plurality of functional modules, and the corresponding detection process is conveniently and pertinently completed, thereby further ensuring the detection accuracy.

According to some embodiments of the invention, the plurality of functional modules built in the processor include:

the directional force testing module is used for displaying a plurality of directional force testing questions through the display control assembly and judging whether the user answers correctly or not;

the real-time memory testing module is used for displaying a plurality of memory materials through the display control assembly, playing memory testing voices corresponding to the memory materials one by one through a voice device, guiding a user to read the memory testing voices sequentially through the voice device and judging whether the reading is correct or not;

the attention and calculation testing module is used for displaying a plurality of groups of operation questions through the display control assembly and judging whether the user answers correctly;

the language ability testing module is used for displaying various images with different properties through the display and control assembly and guiding a user to finish naming, displaying language ability testing sentences through the display and control assembly and guiding the user to finish reading, and judging whether naming is correct or not and whether reading is correct or not;

the reading capability testing module is used for displaying the action indicative characters through the display control assembly, guiding a user to complete corresponding actions and judging whether the actions are completed correctly;

the action capability testing module is used for displaying an action capability material through the display control component, guiding a user to follow and complete the action in the action capability material, and judging whether the action is completed;

and the result evaluation module integrates the judgment results of all the modules and displays a cognitive impairment evaluation result table in the display and control assembly.

A mental state screening method according to an embodiment of a second aspect of the present invention includes the steps of:

pre-judging and detecting: displaying a language function test video and proposing a language function test question at a visual terminal, acquiring voice information of a user and judging whether the voice information is correct or not, if the voice information is correct, assigning a built-in first judgment parameter to be 1, otherwise, assigning the first judgment parameter to be 0; displaying a guide diagram on the visual terminal, detecting a contact track of a hand of a user on the visual terminal, and if the contact track is consistent with the guide diagram, assigning a built-in second judgment parameter as 1, otherwise, assigning the second judgment parameter as 0;

generating a cognitive disorder evaluation result table: if the first judgment parameter and the second judgment parameter are both 1, setting a plurality of single tests according to MMSE, and completing the mental state detection of the plurality of single tests through the visual terminal; generating a cognitive impairment assessment results table and marking the pass status of a plurality of said individual tests.

The mental state screening method provided by the embodiment of the invention at least has the following technical effects: by judging the language ability and the hand movement ability of the user in advance, the testing mode can be effectively selected according to the body state of the user, all the users are prevented from being directly tested according to the same flow, and therefore the trouble of the users with the capability disorder to the body is avoided. Meanwhile, the interaction of the answer and the action of the simple voice question is carried out through the visual terminal, so that which test mode the user is suitable for can be judged, and the reasonability and the accuracy of the test can be further ensured. The test result is conveniently quantized by dividing the test result into a plurality of single tests according to MMSE and completing mental state detection through a visual terminal; finally, the cognitive impairment evaluation result table is displayed, and quantitative results can be visually seen, so that quantitative analysis is facilitated.

According to some embodiments of the invention, the plurality of single tests according to an MMSE setting are:

and (3) testing the directional force: displaying a plurality of directional force test questions in the visual terminal, and marking that the directional force test is passed if the answer is correct;

real-time memory testing: sequentially displaying a plurality of memory materials and memory test voices corresponding to the memory materials one by one in the visual terminal, guiding a user to sequentially read the memory test voices, marking that an instant memory test is passed in the cognitive disorder evaluation result table if the reading is correct, and accumulating the number of instant memory test errors in the cognitive disorder evaluation result table if the reading is wrong;

attention and computational power testing: sequentially displaying a plurality of groups of operation questions in the visual terminal, and marking attention and calculation power test passing in the cognitive disorder assessment result table if the operation is correct;

language ability test: displaying various images with different properties in the visual terminal, and guiding a user to finish naming; displaying a sentence needing language ability testing in the visual terminal, and guiding a user to finish reading; if the naming is correct and the reading is correct, marking that the language ability test passes in the cognitive disorder assessment result table;

reading ability test: displaying action indicative characters in the visual terminal, and marking that the reading capability test passes in the cognitive impairment evaluation result table if the user finishes the action indicated by the action indicative characters;

and (3) testing the action capacity: displaying an action capacity material in the visual terminal, guiding a user to follow and complete actions in the action capacity material, and marking that the action capacity test is passed in the cognitive impairment evaluation result table if the action capacity material is completed;

and (4) evaluating the result: and integrating all the marking states in the cognitive disorder evaluation result table, and displaying the cognitive disorder evaluation result table in the visualization terminal.

According to some embodiments of the invention, the plurality of single tests according to an MMSE setting further comprises: a memory ability test, namely skipping the memory ability test if the error times of the instant memory ability test are larger than a preset threshold value; and guiding a user to draw a plurality of memory materials and to repeat the corresponding memory test voices, and marking the number of successful memories in the visual terminal.

According to some embodiments of the invention, the plurality of single tests according to an MMSE setting further comprises:

testing the writing ability: guiding a user to write complete sentences in the visual terminal, and marking that the writing capability test is passed in the cognitive impairment evaluation result table if the sentences are written without errors;

and (3) testing the structural capability: and displaying structural ability materials in the visual terminal, guiding a user to finish copying, and marking that the structural ability test passes in the cognitive impairment assessment result table if the copying is correct.

According to some embodiments of the invention, the generating the cognitive impairment assessment results table further comprises the steps of:

if the first judgment parameter is 0 and the second judgment parameter is 1, the mental state detection is completed by collecting hand motion information;

and if the first judgment parameter is 1 and the second judgment parameter is 0, completing the mental state detection by collecting the voice information.

According to some embodiments of the invention, the mental state detection by collecting hand motion information comprises the steps of:

language barrier directional force test: displaying a plurality of directional force test questions in the visual terminal, guiding a user to write answers in the visual terminal, and marking that the directional force test is passed if the answers are correct in the cognitive impairment assessment result table;

language disorder immediate memory test: sequentially displaying a plurality of memory materials and memory test voices corresponding to the memory materials one to one in the visual terminal, guiding a user to sequentially input characters in the visual terminal, marking that the language disorder directional strength test passes if the input is correct in the cognitive disorder evaluation result table, and accumulating the number of times of the language disorder instant memory strength test errors in the cognitive disorder evaluation result table if the input is wrong;

language disorder attention and computational power test: sequentially displaying a plurality of groups of operation questions in the visual terminal, and marking language disorder attention and calculation power in the cognitive disorder evaluation result table to pass if the operation is correct;

language disorder language ability test: displaying various images with different properties in the visual terminal, guiding a user to finish naming, and marking that the language disorder language ability test passes in the cognitive disorder evaluation result table if the naming is correct;

language disorder reading ability test: displaying action indicative characters in the visual terminal, and marking that the language disorder reading capability test is passed in the cognitive disorder evaluation result table if the user finishes the action indicated by the action indicative characters;

language disorder motor ability test: displaying an action capacity material in the visual terminal, guiding a user to follow and complete actions in the action capacity material, and marking that the language disorder action capacity test is passed in the cognitive disorder evaluation result table if the action capacity material is completed;

language barrier result evaluation: and integrating all the marking states in the cognitive disorder evaluation result table, and displaying the cognitive disorder evaluation result table in the visualization terminal.

According to some embodiments of the invention, the mental state detection by collecting voice information comprises the following steps:

dyskinesia memory test: playing a plurality of vocabularies in the visual terminal in a voice mode, guiding a user to read along in sequence, and marking that the dyskinesia instant memory test passes if the reading along is correct in the cognitive disorder assessment result table; guiding a user to repeat a plurality of words played by voice at intervals of preset recall force detection time, and recording the number of successful repeat;

dyskinesia orientation force test: displaying a plurality of directional force test questions in the visual terminal, and marking that the directional force test of the dyskinesia passes in the cognitive impairment evaluation result table if the answer is correct;

language fluency test: displaying a language fluency material in the visual terminal, guiding a user to complete speed tracing according to the language fluency material, and recording a speed tracing result;

and (4) evaluating the result: and integrating all the marking states in the cognitive disorder evaluation result table, and displaying the cognitive disorder evaluation result table in the visualization terminal.

A computer-readable storage medium according to an embodiment of the third aspect of the invention stores computer-executable instructions for causing a computer to perform the above mental state screening method.

The computer-readable storage medium according to the embodiment of the invention has at least the following advantages: storage and transfer of computer-executable instructions may be facilitated by a storage medium.

Additional aspects and advantages of the invention will be set forth in part in the description which follows and, in part, will be obvious from the description, or may be learned by practice of the invention.

Drawings

The above and additional aspects and advantages of the present invention will become apparent and readily appreciated from the following description of the embodiments, taken in conjunction with the accompanying drawings of which:

FIG. 1 is a simplified functional structure diagram of a plurality of single tests of a mental state screening method according to an embodiment of the present invention;

fig. 2 is a block diagram of a mental state screening system according to an embodiment of the present invention.

Reference numerals:

display control assembly 100, speech device 200, image acquisition device 300, processor 400, server 500.

Detailed Description

Reference will now be made in detail to embodiments of the present invention, examples of which are illustrated in the accompanying drawings, wherein like or similar reference numerals refer to the same or similar elements or elements having the same or similar function throughout. The embodiments described below with reference to the accompanying drawings are illustrative only for the purpose of explaining the present invention, and are not to be construed as limiting the present invention.

In the description of the present invention, if there are first, second, third, fourth, etc. described only for the purpose of distinguishing technical features, they are not to be interpreted as indicating or implying relative importance or implying number of indicated technical features or implying precedence of indicated technical features.

In the description of the present invention, unless otherwise explicitly defined, terms such as arrangement, connection and the like should be broadly construed, and those skilled in the art can reasonably determine the specific meanings of the above terms in the present invention in combination with the detailed contents of the technical solutions.

A mental state screening system according to an embodiment of the first aspect of the present invention is described below with reference to fig. 1 to 2.

A mental state screening system according to an embodiment of a first aspect of the invention includes: display control assembly 100, speech device 200, image acquisition device 300, processor 400, server 500. The display control component 100 is used for displaying a language function test video, displaying a language function test problem, displaying a guide diagram and inputting a contact track; the voice device 200 is used for receiving voice and performing voice broadcast; the image acquisition device 300 is used for acquiring image information of a user; the processor 400 is respectively connected with the display control assembly 100, the voice device 200 and the image acquisition device 300, and is internally provided with a plurality of functional modules for mental state detection according to MMSE; the display control assembly 100 and the voice device 200 are used for assisting a plurality of functional modules to complete mental state detection; and the server 500 is connected with the processor 400 and is used for storing data generated by the plurality of functional modules and performing data interaction with the processor 400.

Referring to fig. 1 and 2, the display and control assembly 100 is mainly used for displaying an image, completing text interaction with a user, and acquiring a touch track of the user on the display and control assembly, and the display and control assembly 100 may directly adopt a liquid crystal touch screen. The voice device 200 can perform voice broadcasting and voice signal collection, and can directly use a combination of a speaker and a microphone. The image acquisition device 300 can acquire the influence of a user and is required to be used in some tests which need to detect the action of the user; the image capturing device 300 may use a camera, a monitoring console, or a camera directly. Through the display control assembly 100, the voice device 200 and the image acquisition device 300, a platform for interacting with a user can be provided, so that the platform has a foundation for guiding the user to make operations, and also has a foundation for acquiring audio data, video data, specific gesture data and action data of the user.

The processor 400 is mainly used for analyzing data, and meanwhile, data stored in the server 500 can be called so as to complete the whole test, and the data collected in the test can be transmitted to the server 500 through the processor 400 for storage, so that the burden of the processor 400 is reduced; in addition, the processor 400 can transfer part of the operation with the image processing to the server 500 for execution, so that the operation load of the processor 400 can be greatly reduced, and the operation efficiency of the processor 400 is improved. In addition, in some embodiments of the present invention, the number of pictures and videos used in the test may be large, so that the pictures and videos may be directly stored in the server 500 and only called up by the processor 400 when they are needed. The processor 400 calls the display control assembly 100, the voice device 200, and the image acquisition device 300 through a plurality of built-in functional modules, so as to complete the acquisition of user data, and finally generate a cognitive impairment evaluation result table.

According to the mental state screening system provided by the embodiment of the invention, man-machine interaction with a user can be realized through the mental state screening system provided by the embodiment of the invention, and the physical state of the user can be effectively and intuitively known. In addition, the mental state screening system of the embodiment of the invention is used for detecting, so that the data storage is convenient, partial detection is respectively carried out through a plurality of functional modules, and the corresponding detection process is conveniently and pertinently completed, thereby further ensuring the detection accuracy.

In some embodiments of the present invention, the processor 400 includes a plurality of built-in functional modules including: the device comprises a directional force testing module, an instant memory testing module, an attention and calculation testing module, a language ability testing module, a reading ability testing module, an action ability testing module and a result evaluation module.

And the directional force testing module displays a plurality of directional force testing questions through the display and control assembly 100 and judges whether the user answers correctly. The directional force testing module calls a plurality of directional force testing questions stored in the server 500 to be displayed on the display and control assembly 100, and then judges whether the answer input by the user through the display and control assembly 100 is correct.

The real-time memory testing module displays a plurality of memory materials through the display control component 100, plays memory testing voices corresponding to the memory materials one by one through the voice device 200, guides a user to read the memory testing voices sequentially through the voice device 200, and judges whether the reading is correct. The instant memory test module displays the plurality of memory materials stored in the server 500 on the display control assembly 100 and calls a plurality of memory test voices to be played in a matched manner, and then judges whether the voices input by the user through the voice device 200 are consistent with the played memory test voices.

The attention and calculation power testing module displays a plurality of groups of operation questions through the display and control assembly 100 and judges whether the user answers correctly. The plurality of sets of operation questions may be stored directly in the processor 400 or may be stored in the server 500.

The language ability testing module is used for displaying the language ability testing sentences through the display control assembly 100 and guiding the user to finish the naming, and judging whether the naming is correct or not and whether the reading is correct or not. The language ability testing module calls a plurality of images with different properties stored in the server 500 to be displayed on the display and control assembly 100, guides a user to complete the input of naming by using the display and control assembly 100 or the voice device 200, and then judges whether the naming of the user is correct or not; the user is guided to finish the reading input by using the voice device 200 and judge whether the reading is correct or not by calling the language capability test stored in the server 500 and displaying on the display and control component 100.

The reading ability testing module displays the action indicative characters through the display control component 100, guides the user to complete the corresponding action, and judges whether the action is completed correctly. The indicative characters can be directly stored in the server 500, the image acquisition is completed by the image acquisition device 300, the image processing process is completed by the server 500, and the final result is output to the display and control assembly 100 through the processor 400 for display.

And the action capability testing module displays the action capability material through the display control component 100, guides the user to follow and complete the action in the action capability material, and judges whether the action is completed. The action ability material can be directly stored in the server 500, displayed through the display and control assembly 100, image acquisition is completed through the image acquisition device 300, image processing is completed in the server 500, and the final result is output to the display and control assembly 100 through the processor 400 to be displayed.

And a result evaluation module for integrating the judgment results of the modules and displaying the cognitive impairment evaluation result table in the display control component 100. The result evaluation module calls the cognitive impairment evaluation result table marked to be ended to be displayed in the display and control component 100.

In some embodiments of the present invention, the plurality of functional modules built in the processor 400 further include: the device comprises a recall capability test module, a writing capability test module and a structural capability test module.

And the memory ability testing module is used for displaying a memory ability detection interface through the display control assembly 100, guiding a user to draw a plurality of memory materials and repeat corresponding memory testing voices through the voice device 200, and acquiring gestures and voices of the user through the display control assembly 100 and the voice device 200 so as to judge the completion condition. The final result is output to the display and control assembly 100 through the processor 400 for display.

Writing ability test module: the display and control assembly 100 and the voice device 200 guide a user to write a complete sentence in the display and control assembly 100, and if the sentence is written without errors, the sentence is output to the display and control assembly 100 through the processor 400 to be displayed.

Structural capability test module: the structural ability material is displayed on the display control component 100, the display control component 100 and the voice device 200 guide a user to finish copying in the display control component 100, and if the copying is correct, the structural ability material is output to the display control component 100 through the processor 400 to be displayed.

A mental state screening method according to an embodiment of a second aspect of the present invention includes the steps of:

pre-judging and detecting: displaying a language function test video and proposing a language function test question at a visual terminal, acquiring voice information of a user and judging whether the voice information is correct or not, if the voice information is correct, assigning a built-in first judgment parameter to be 1, otherwise, assigning the first judgment parameter to be 0; displaying a guide diagram on the visual terminal, detecting a contact track of the hand of the user on the visual terminal, and if the contact track is consistent with the guide diagram, assigning a built-in second judgment parameter as 1, otherwise, assigning the second judgment parameter as 0;

generating a cognitive disorder evaluation result table: if the first judgment parameter and the second judgment parameter are both 1, setting a plurality of single tests according to MMSE, and completing the mental state detection of the plurality of single tests through a visual terminal; a cognitive impairment assessment results table is generated and the pass status of a plurality of individual tests is flagged.

In order to generate the accuracy and the applicability of the cognitive impairment evaluation result table, before testing the user, the physical state of the user needs to be confirmed, so that a specific testing mode suitable for the user can be judged, and the situation that a person with mobility impairment is allowed to finish some complex actions or a person with language impairment is allowed to read aloud or narrate with language is avoided.

Referring to fig. 1 and 2, interaction with a user can be realized through a visualization terminal, and therefore the visualization terminal has the capability of evaluating language capability and hand motion and the capability of automatically detecting mental states.

Here, a brief description of the preliminary judgment detection is given.

The language ability is detected mainly by showing a language function test video, proposing a function test question and enabling a user to answer, whether the answer of the user is correct or not is judged to ensure that the user has enough language ability, the user needs to communicate with a visual terminal through voice during the language ability test, the test of character input is avoided as much as possible, and the pertinence is improved.

The hand motion capability detection mainly comprises the steps of displaying a guide diagram through a visual terminal, drawing a contact track which is the same as the guide diagram on the visual terminal by a user, judging that the action capability is normal if the contact track is consistent with the guide diagram, and normally finishing the test. For example: displaying three small icons at different positions on the visual terminal, wherein the user needs to move a finger and click the three small icons, and if the three operations are successful, the user passes the functional test of the fortune; a bent line may be displayed and judged by tracing the trajectory of the line.

After judging that the user has the corresponding language ability and hand movement ability, generating a cognitive impairment evaluation result table. The generation of the cognitive impairment assessment results table is dependent on a visualization terminal, which typically comprises: the display and control device comprises a display and control assembly 100, a voice device 200, an image acquisition device 300 and a processor 400. The flow set according to the MMSE table is displayed in the visual terminal, and interaction is gradually completed with the user, so that data of a plurality of single tests such as an instant memory test and a directional strength test of the user can be acquired, the acquired data can be stored in the server 500, the tests can be marked in the cognitive impairment evaluation result table, and the cognitive impairment evaluation result table is displayed in the visual terminal after the test is finished. The user can also call the cognitive disorder evaluation result table in the visual terminal by himself. The intelligent detection mode completely replaces manual detection, and can quantify the test result to the greatest extent, such as: in the memory test, if a plurality of names need to be recalled, one score can be added when one is repeated, finally, the total score is counted, and the total score is recorded in a cognitive disorder evaluation result table. Therefore, the result after quantification can be checked in the cognitive disorder evaluation result table, and the quantification result contains the score and the total score of a single test, so that the doctor can conveniently perform subsequent disease analysis. If necessary, the device can also be used as the basis for the doctor to carry out manual reinspection.

According to the mental state screening method provided by the embodiment of the invention, the language ability and the hand movement ability of the user are judged in advance, so that the testing mode can be effectively selected according to the body state of the user, all users are prevented from directly testing according to the same flow, and the trouble of the user with the physical ability disorder is avoided. Meanwhile, the interaction of the answer and the action of the simple voice question is carried out through the visual terminal, so that which test mode the user is suitable for can be judged, and the reasonability and the accuracy of the test can be further ensured. The test result is conveniently quantized by dividing the test result into a plurality of single tests according to MMSE and completing mental state detection through a visual terminal; finally, the cognitive impairment evaluation result table is displayed, and quantitative results can be visually seen, so that quantitative analysis is facilitated.

In some embodiments of the invention, the plurality of single tests according to the MMSE setting are: the method comprises the following steps of directional force testing, instant memory testing, attention and calculation force testing, language ability testing, reading ability testing, action ability testing and result evaluation.

And (3) testing the directional force: and displaying a plurality of directional force test questions in a visual terminal, and marking that the directional force test is passed if the answer is correct in a cognitive impairment assessment result table. The directional force test needs to play the guide animation first, so that the user can know the operation flow conveniently, and then the user performs the test. In some embodiments of the present invention, the user is mainly enabled to answer the questions by setting a plurality of directional forces, and whether the directional capability meets the standard is judged by judging whether the answer is correct or not. For example: the user needs to answer five questions about the time-oriented force through the speech device 200 or at the display and control assembly 100: "which year this year is", "what season is now? "," now months? "," several numbers are today? "," today is the day of the week? ", and five questions about site-directed forces: "which province you are in now? "," which county and district you are now? "," which rural street you are now on? "," which community is a member of the list? "," a few stories are now in the floor of the few stories? ", location-directed force detection may use GPS positioning as a basis for the determination. In the whole test process, a user needs to finish the previous question to enter the next question, if all the questions are correct, the test is passed, and recording is carried out, if the test is not passed in the preset longest test time, the test failure can be judged, recording is carried out in the same way, and other test items are entered.

Real-time memory testing: the method comprises the steps of sequentially displaying a plurality of memory materials and memory test voices corresponding to the memory materials one to one in a visual terminal, guiding a user to sequentially read the memory test voices, marking that an instant memory test is passed if the reading is correct in a cognitive disorder assessment result table, and accumulating the number of instant memory test errors in the cognitive disorder assessment result table if the reading is wrong. In some embodiments of the invention, three images with different material properties are presented in a visual terminal during the instant memory test, and the user is guided to follow and read and memorize, then whether the first answer of the user is correct is judged and recorded, and if yes, the user passes the mark in the cognitive impairment evaluation result table; if not, guiding the user to continue to follow reading and memorizing, and recording the times of follow reading and memorizing errors in the cognitive disorder evaluation result table. Usually, the memory ability test is carried out only when the error times do not reach the preset threshold value, and if the error times exceed the preset threshold value, the memory ability is poor, and the memory ability test is not required.

Attention and computational power testing: and sequentially displaying a plurality of groups of operation questions in a visual terminal, and marking attention and computing power in a cognitive disorder assessment result table if the operation is correct to pass the test. In some embodiments of the present invention, five groups of addition and subtraction within 100 are randomly presented in the visualization terminal, and the user may choose to fill in the corresponding answer or skip, and may accumulate one point and mark the number in the cognitive impairment evaluation result table once per answer pair, and may directly mark the number in the cognitive impairment evaluation result table if all the answers are correct.

Language ability test: displaying various images with different properties in a visual terminal to guide a user to finish naming; displaying a sentence needing language ability testing in a visual terminal, and guiding a user to finish reading; and if the name is correct and the reading is correct, marking that the language ability test passes in the cognitive disorder assessment result table. Language capabilities typically include naming capabilities and recitations capabilities. In some embodiments of the present invention, the naming ability test is performed by displaying three images of different natures on the visualization terminal, and the user needs the speech apparatus 200 or names or describes the images on the visualization terminal, and if all are correct, the user can mark the images as passing, and if there is an error, the user can mark the images as correct. In some embodiments of the present invention, a language ability test sentence with a length of about 5 to 10 characters is displayed on the visual terminal, the user needs to read the language ability test sentence with voice, the read voice is collected by the voice device 200, and then it needs to judge whether the reading is correct, and if the reading is correct, the user can mark the language ability test sentence to pass through the cognitive impairment assessment result table.

Reading ability test: and displaying the action indicative characters in the visual terminal, and marking that the reading capability test is passed in the cognitive impairment assessment result table if the user finishes the action indicated by the action indicative characters. By presenting action indicative words in the visualization terminal, for example: "please close your eyes", the user needs to complete the eye closing action according to the guidance, capture the user's action through the image capturing device 300, and judge whether the eye closing operation is completed, if so, it indicates that there is no problem in reading ability, and then mark the user's action as passing in the cognitive impairment assessment result table.

And (3) testing the action capacity: and displaying the action capacity material in the visual terminal, guiding the user to follow and complete the action in the action capacity material, and marking that the action capacity test is passed in the cognitive impairment evaluation result table if the action capacity material is completed. In some embodiments of the invention, action capability material containing three simple actions may be presented in a visualization terminal, which the user needs to do as guided, for example: the user holds a piece of paper with the right hand, folds the paper with the two hands, places the paper on the left leg of the user, captures the movement of the user through the image acquisition device 300, judges whether the movement of the user is completed correctly, and if the movement is completed correctly, marks the movement to pass in the cognitive impairment assessment result table.

And (4) evaluating the result: and integrating all the marking states in the cognitive disorder evaluation result table, and displaying the cognitive disorder evaluation result table in a visualization terminal. And finally, recording whether all the single tests pass or not, the number information and the score information of the single test marks in the cognitive disorder evaluation result table, and finally generating a total conclusion display area in the cognitive disorder evaluation result table.

In some embodiments of the invention, the plurality of single tests according to the MMSE setting are also: a memory ability test, namely skipping the memory ability test if the error times of the instant memory ability test are larger than a preset threshold value; and guiding a user to draw a plurality of memory materials and to repeat the corresponding memory test voices, and marking the number of successful memories in the visual terminal. Only when the instant memory test is passed and the error times are less than or equal to the preset threshold value, the memory ability test is carried out, so that unnecessary detection time can be avoided being wasted. The memory ability test is simple, a user is guided to repeat a plurality of memory test voices read in the instant memory test through the visual terminal, and in order to guarantee the accuracy and the qualification of the memory ability test, the memory ability test cannot be directly arranged after the instant memory ability test, the memory ability test is carried out after a certain time interval, and the memory ability test is usually carried out after a certain time interval. For example: after the instant memory test, attention and calculation power tests are performed first, and then a memory ability test is performed.

In some embodiments of the invention, the plurality of single tests according to the MMSE setting are also: writing ability test and structural ability test.

Testing the writing ability: and guiding a user to write a complete sentence in the visual terminal, and marking that the writing capability test is passed in the cognitive impairment evaluation result table if the sentence is wrongly written. In some embodiments of the invention, the writing ability test displays several lines of field lattices for writing Chinese characters in the visual terminal, the size of the lattices is moderate, a user needs to use fingers to spontaneously write a complete sentence on the visual terminal, and judge whether the sentence has subject, verb and meaning, if all the sentences have subject, verb and meaning, the errors of grammar and punctuation can be ignored through the test.

And (3) testing the structural capability: and displaying the structural capacity material in the visual terminal, guiding the user to finish copying, and marking that the structural capacity test passes in the cognitive impairment evaluation result table if the copying is correct. In some embodiments of the invention, structural capability materials are presented above the visualization terminal, and a user drawing area is below the visualization terminal for the user to complete testing; specifically, two crossed hexagonal icons or other simple graphics can be presented above, a user needs to copy the upper graphics in the lower user drawing area to judge whether the corners of the user image are clear, if so, the user can mark the upper graphics, and the shaking of lines and the rotation of the graphics can be generally ignored.

In some embodiments of the present invention, it is further determined whether there is an unexecuted test after the last test is ended, and if not, result evaluation is performed; if so, executing the remaining unexecuted tests.

In some embodiments of the invention, generating the cognitive impairment assessment results table further comprises the steps of: if the first judgment parameter is 0 and the second judgment parameter is 1, the mental state detection is completed by collecting hand motion information; and if the first judgment parameter is 1 and the second judgment parameter is 0, completing the mental state detection by collecting the voice information.

Because it is only for the users with cognitive impairment, it is necessary to take into account that some patients have language or mobility impairment, and intelligent testing is also required for these users. And the handicaps in language and mobility require manual work. If the language ability is in trouble, the test is finished through the hand action, and then the tests such as reading are avoided as much as possible; if the exercise ability is defective, the test can be performed through voice, and the action test is avoided.

In some embodiments of the invention, the mental state detection by collecting hand motion information comprises the steps of: the method comprises the following steps of language disorder directional power test, language disorder instant memory test, language disorder attention and calculation power test, language disorder language ability test, language disorder reading ability test, language disorder action ability test and language disorder result evaluation.

Language barrier directional force test: displaying a plurality of directional force test questions in the visual terminal, guiding a user to write answers in the visual terminal, and marking that the directional force test is passed if the answers are correct in the cognitive impairment assessment result table. The test of the directional force by the user with language ability disorder can be completed by writing on a visual terminal or directly by means of keyboard input. The problem of language barrier directional force testing may be consistent with normal users.

Language disorder immediate memory test: the method comprises the steps of sequentially displaying a plurality of memory materials and memory test voices corresponding to the memory materials one by one in a visual terminal, guiding a user to input characters in the visual terminal in sequence, marking that the language disorder directional strength test passes if the input is correct in a cognitive disorder evaluation result table, and accumulating the number of language disorder instant memory test errors in the cognitive disorder evaluation result table if the input is wrong. The users with language disabilities can not complete the repeat by reading aloud, so the users can directly use characters for interaction and also can complete the instant memory test, but the longest test time of the users with language disabilities is longer than that of normal users.

Language disorder attention and computational power test: and sequentially displaying a plurality of groups of operation questions in a visual terminal, and marking language disorder attention and calculation power in a cognitive disorder evaluation result table if the operation is correct. For language handicapped attention and computing power testing, a user with language handicapped may be tested as a normal user.

Language disorder language ability test: displaying various images with different properties in a visual terminal, guiding a user to finish naming, and marking language disorder language ability test passing in a cognitive disorder evaluation result table if naming is correct. The users with language ability disorder can only carry out the naming ability test because of the no reading ability, and the naming ability test also needs to be carried out through literal communication.

Language disorder reading ability test: and displaying the action indicative characters in the visual terminal, and marking that the language disorder reading capability test is passed in the cognitive disorder evaluation result table if the user finishes the action indicated by the action indicative characters. The language handicap reading ability test may be performed as a normal user.

Language disorder motor ability test: and displaying the action capacity material in the visual terminal, guiding the user to follow and complete the action in the action capacity material, and marking that the language barrier action capacity test is passed in the cognitive barrier evaluation result table if the action capacity material is completed. The language barrier performance test may be performed as a normal user.

Language barrier result evaluation: and integrating all the marking states in the cognitive disorder evaluation result table, and displaying the cognitive disorder evaluation result table in a visualization terminal. Language impairment results evaluation will mark the user as having language impairment in the cognitive impairment evaluation results table to distinguish from normal users.

In some embodiments of the present invention, the mental state detection by collecting voice information comprises the following steps: dyskinesia memory test, dyskinesia orientation force test and language fluency test. For users with mobility impairment, the test is difficult, and here, the test related to mobility can be directly cancelled, or the test fails by default, and only the test that can pass the language communication is performed.

Dyskinesia memory test: playing a plurality of vocabularies in a visual terminal in a voice manner, guiding a user to read along in sequence, and marking that the dyskinesia instant memory test passes in a cognitive disorder assessment result table if the reading along is correct; and guiding the user to repeat a plurality of words played by the voice at preset recall detection time intervals, and recording the number of successful repeat. The mobility-impaired memory test can be directly performed by voice communication, and thus the memory test of the mobility-impaired user can be performed as in a normal user.

Dyskinesia orientation force test: and displaying a plurality of directional force test questions in a visual terminal, and marking that the directional force test of the dyskinesia passes in a cognitive impairment evaluation result table if the answer is correct. The directional force test for mobility-impaired users can be performed directly by voice communication, and thus the directional force test for mobility-impaired users can be performed as well as normal users.

Language fluency test: and displaying the language fluency material in the visual terminal, guiding a user to complete the speed tracing according to the language fluency material, and recording the result of the speed tracing. A language fluency test can be added for a user with dyskinesia so as to more accurately test the language ability of the user, thereby facilitating the evaluation without causing great influence on the normal life of the patient.

And (4) evaluating the result: and integrating all the marking states in the cognitive disorder evaluation result table, and displaying the cognitive disorder evaluation result table in a visualization terminal. For users with mobility impairment, the cognitive impairment evaluation result table is marked with mobility impairment.

According to a third aspect of the present invention, there is provided a computer-readable storage medium having stored thereon computer-executable instructions for causing a computer to perform the above mental state screening method.

Computer-readable storage media according to embodiments of the present invention may facilitate storage and transfer of computer-executable instructions by the storage media.

In the description herein, references to the description of the term "one embodiment," "some embodiments," "an illustrative embodiment," "an example," "a specific example," or "some examples" or the like mean that a particular feature, structure, material, or characteristic described in connection with the embodiment or example is included in at least one embodiment or example of the invention. In this specification, the schematic representations of the terms used above do not necessarily refer to the same embodiment or example. Furthermore, the particular features, structures, materials, or characteristics described may be combined in any suitable manner in any one or more embodiments or examples.

Although the embodiments of the present invention have been described in detail with reference to the accompanying drawings, the present invention is not limited to the embodiments, and those skilled in the art will understand that: various changes, modifications, substitutions and alterations can be made to the embodiments without departing from the principles and spirit of the invention, the scope of which is defined by the claims and their equivalents.