阅读说明：本技术 一种基于vr技术的自助操作系统、方法及介质 (Self-service operating system, method and medium based on VR technology ) 是由 胡焱 田云芳 安静 于 2021-07-02 设计创作，主要内容包括：本发明公开了一种基于VR技术的自助操作系统、方法及介质,所述系统包括：模式匹配模块、模式准备模块、自助处理模块、VR辅助处理模块、VR交互设备和VR操作设备；模式匹配模块用于根据检测时间段和使用区域识别第一用户,并获取第一用户的语音数据；模式匹配模块基于语音数据向模式准备模块发送第一反馈信号或第二反馈信号；模式准备模块用于根据第一反馈信号或第二反馈信号启动自助处理模块或VR辅助处理模块；自助处理模块用于启动交互界面,并执行自助交互操作；VR辅助处理模块用于将VR交互设备和VR操作设备传送至第一用户；本发明能够匹配多种不同的人群进行业务处理,设计周全,操作难度低,可接受度强。(The invention discloses a self-service operation system, a method and a medium based on VR technology, the system comprises: the system comprises a mode matching module, a mode preparation module, a self-service processing module, a VR auxiliary processing module, VR interactive equipment and VR operating equipment; the mode matching module is used for identifying the first user according to the detection time period and the use area and acquiring the voice data of the first user; the mode matching module sends a first feedback signal or a second feedback signal to the mode preparation module based on the voice data; the mode preparation module is used for starting the self-service processing module or the VR auxiliary processing module according to the first feedback signal or the second feedback signal; the self-service processing module is used for starting the interactive interface and executing self-service interactive operation; the VR auxiliary processing module is used for transmitting the VR interaction equipment and the VR operation equipment to a first user; the invention can be matched with various different crowds to carry out business processing, and has the advantages of comprehensive design, low operation difficulty and strong acceptability.)

1. A self-service operating system based on VR technology, comprising: the system comprises a mode matching module, a mode preparation module, a self-service processing module, a VR auxiliary processing module, VR interactive equipment and VR operating equipment; the pattern matching module is provided with a detection time period and a use area; an interactive interface is configured in the self-service processing module;

the pattern matching module is used for identifying a first user according to the detection time period and the use area and acquiring voice data of the first user; the pattern matching module sends a first feedback signal or a second feedback signal to the pattern preparation module based on the voice data;

the mode preparation module is used for starting the self-service processing module or the VR auxiliary processing module according to the first feedback signal or the second feedback signal;

the self-service processing module is used for starting the interactive interface and capturing a touch action of the first user on the interactive interface; the self-service processing module executes self-service interaction operation based on the touch action;

the VR auxiliary processing module is used for transmitting the VR interaction equipment and the VR operation equipment to the first user;

the VR interaction equipment is used for outputting a VR interaction image according to the wearing integrity of the first user on the VR interaction equipment;

and the VR operating equipment is used for prompting the first user to carry out VR interactive operation according to the holding attaching degree of the first user to the VR operating equipment.

2. The VR technology based self-service operating system of claim 1, wherein: the pattern matching module includes: the system comprises a user on-site detection module, a first voice broadcast module and a feedback signal sending module, wherein the first voice broadcast module is internally provided with power amplifier equipment, a sound pick-up and a voice analysis chip;

the user presence detection module is used for detecting whether the first user exists in the use area or not every detection time period; if the first voice broadcast module exists, the user on-site detection module sends a broadcast signal to the first voice broadcast module;

the first voice broadcasting module is used for controlling the power amplifier equipment to prompt the first user to select a self-service mode or a VR auxiliary operation mode through voice according to the broadcasting signal; the first voice broadcasting module acquires the voice data through the sound pick-up, and the first voice broadcasting module identifies key words in the voice data through the voice analysis chip; the first voice broadcasting module generates the first feedback signal or the second feedback signal respectively corresponding to the self-service mode or the VR auxiliary operation mode based on the keyword;

the feedback signal sending module is configured to send the first feedback signal or the second feedback signal to the mode preparation module.

3. The VR technology based self-service operating system of claim 1, wherein: the mode preparation module includes: the self-service mode preparation module and the VR auxiliary mode preparation module are connected with the sound box through a power amplifier circuit;

the self-service mode preparation module is used for starting the self-service processing module according to the first feedback signal and controlling the sound box to broadcast the use instruction of the self-service processing module to the first user through the power amplifier circuit;

and the VR auxiliary mode preparation module is used for starting the VR auxiliary processing module according to the second feedback signal and controlling the sound equipment to broadcast the use instruction of the VR auxiliary processing module to the first user through the power amplification circuit.

4. The VR technology based self-service operating system of any of claims 1-3, wherein: the VR auxiliary processing module includes: the system comprises user positioning equipment, a VR interactive equipment transmission module, a VR operating equipment transmission module and a second voice broadcast module; the VR interactive equipment transmission module and the VR operating equipment transmission module are arranged corresponding to the use area, a lifting mechanism is arranged on the VR interactive equipment transmission module, and a first electric manipulator and a first tray are arranged on the lifting mechanism; a conveying rail surrounding the use area is arranged on the VR operating equipment conveying module, a conveying mechanism is arranged on the conveying rail, and a second electric manipulator and a second tray are arranged on the conveying mechanism; the lifting mechanism and the first electric manipulator are in communication connection with the VR interactive equipment transmission module; the transmission mechanism and the second electric manipulator are in communication connection with the VR operating equipment transmission module;

the user positioning device is used for capturing head position information and hand position information of the first user in the use area;

the VR interactive equipment transmission module is used for controlling the first electric manipulator to grab the VR interactive equipment into the first tray, controlling the lifting mechanism to convey the VR interactive equipment to a position corresponding to the head of the first user according to the head position information, and sending a first in-place signal to the second voice broadcasting module;

the VR operating equipment conveying module is used for controlling the second electric manipulator to grab the VR operating equipment into the second tray, controlling the conveying mechanism to move to a position corresponding to the hand of the first user along the conveying track according to the hand position information, and sending a second in-place signal to the second voice broadcasting module;

the second voice broadcast module is used for respectively prompting the first user to wear the VR interactive equipment and the VR operating equipment according to the first in-place signal and the second in-place signal.

5. The VR technology-based self-service operating system of claim 4, wherein: a first sensor and a second sensor are respectively arranged on the VR interaction equipment and the VR operation equipment, a integrity threshold value is arranged on the first sensor, and a fit threshold value is arranged on the second sensor;

the first sensor is used for detecting the wearing integrity of the first user on the VR interaction equipment and comparing the wearing integrity with the integrity threshold; if the wearing integrity is not smaller than the integrity threshold value, the first sensor controls the VR interactive equipment to output the VR interactive image;

the second sensor is used for detecting the holding attaching degree of the first user to the VR operating equipment and comparing the holding attaching degree with the attaching degree threshold; if the degree of laminating grips not less than the degree of laminating threshold value, then the second sensor control VR operating equipment shakes, the second sensor control the second voice broadcast module suggestion first user vibrations are VR interactive operation's start signal.

6. The VR technology based self-service operating system of any of claims 1-3, wherein: the self-service processing module comprises: the device comprises an interactive interface control module, a touch control action capture module and an interactive feedback module, wherein a card inserting port and a banknote placing port are configured in the interactive feedback module;

the interactive interface control module is used for starting the interactive interface and outputting operation options in the interactive interface;

the touch action capturing module is used for capturing the touch action of the first user on the operation option on the interactive interface and identifying a touch area corresponding to the touch action; the touch action capturing module sends an interaction signal to the interaction feedback module according to the touch area;

the interaction feedback module is used for executing the self-service interaction operation according to the interaction signal, and the self-service interaction operation comprises the following steps: opening the card insertion port or the bill placement port.

7. The VR technology-based self-service operating system of claim 5, wherein: the VR auxiliary processing module further includes: the image monitoring module is arranged above the using area and is provided with a wide-angle camera; the image monitoring module monitors abnormal use conditions of the first user for the VR interaction equipment and the VR operating equipment through the wide-angle camera, and the image monitoring module controls the help calling module to send help seeking signals to a background end of a mechanism where the VR auxiliary processing module is located according to the abnormal use conditions.

8. The VR technology based self-service operating system of claim 7, wherein: the abnormal use condition comprises: the user reversely wears the VR interaction equipment, the VR interaction equipment or the VR operating equipment to drop.

9. A self-service operation method based on VR technology is characterized by comprising the following steps:

setting a detection time period and a use area; configuring a self-service processing module, a VR auxiliary processing module, an interactive interface, VR interactive equipment and VR operating equipment;

detecting a first user based on the detection time period and the use area, acquiring voice data of the first user, and starting the self-service processing module or the VR auxiliary processing module based on the voice data;

when the self-service processing module is started, the self-service processing module starts the interactive interface and captures a touch action of the first user on the interactive interface, and the self-service processing module executes self-service interactive operation based on the touch action;

when the VR auxiliary processing module is started, the VR auxiliary processing module transmits the VR interaction device and the VR operating device to the first user; the VR interactive equipment outputs a VR interactive image according to the wearing integrity of the first user on the VR interactive equipment; and the VR operating equipment prompts the first user to carry out VR interactive operation according to the holding attaching degree of the first user to the VR operating equipment.

10. A computer-readable storage medium, characterized in that the computer-readable storage medium has stored thereon a computer program which, when being executed by a processor, carries out the steps of the VR technology based self-service operation method as claimed in claim 9.

Technical Field

The invention relates to the technical field of intelligent configuration of self-service terminals, in particular to a self-service operating system, a self-service operating method and a self-service operating medium based on VR technology.

Background

A large number of self-service devices are commonly configured in financial institutions, and the self-service devices are commonly used for processing common services; in the network era, users who usually go to financial institutions to process common services are mostly the elderly population; the reason why the self-service equipment cannot be selected for service handling of the elderly is that the self-service equipment has low acceptance and relatively high use difficulty for the elderly; this ultimately leads to wasted resources and poor universality of the self-service terminal device.

Disclosure of Invention

The invention mainly solves the problems that the self-service terminal equipment in the current financial institution has low acceptance to the elderly and relatively high use difficulty, and finally causes resource waste and poor universality of the self-service terminal equipment.

In order to solve the technical problems, the invention adopts a technical scheme that: provided is a self-service operating system based on VR technique, including:

the system comprises a mode matching module, a mode preparation module, a self-service processing module, a VR auxiliary processing module, VR interactive equipment and VR operating equipment; the pattern matching module is provided with a detection time period and a use area; an interactive interface is configured in the self-service processing module;

the pattern matching module is used for identifying a first user according to the detection time period and the use area and acquiring voice data of the first user; the pattern matching module sends a first feedback signal or a second feedback signal to the pattern preparation module based on the voice data;

the mode preparation module is used for starting the self-service processing module or the VR auxiliary processing module according to the first feedback signal or the second feedback signal;

the self-service processing module is used for starting the interactive interface and capturing a touch action of the first user on the interactive interface; the self-service processing module executes self-service interaction operation based on the touch action;

the VR auxiliary processing module is used for transmitting the VR interaction equipment and the VR operation equipment to the first user;

the VR interaction equipment is used for outputting a VR interaction image according to the wearing integrity of the first user on the VR interaction equipment;

and the VR operating equipment is used for prompting the first user to carry out VR interactive operation according to the holding attaching degree of the first user to the VR operating equipment.

As an improvement, the pattern matching module includes: the system comprises a user on-site detection module, a first voice broadcast module and a feedback signal sending module, wherein a sound pick-up, a voice analysis chip and power amplifier equipment are arranged in the first voice broadcast module;

the user presence detection module is used for detecting whether the first user exists in the use area or not every detection time period; if the first voice broadcast module exists, the user on-site detection module sends a broadcast signal to the first voice broadcast module;

the first voice broadcasting module is used for controlling the power amplifier equipment to prompt the first user to select a self-service mode or a VR auxiliary operation mode through voice according to the broadcasting signal; the first voice broadcasting module acquires the voice data through the sound pick-up, and the first voice broadcasting module identifies key words in the voice data through the voice analysis chip; the first voice broadcasting module generates the first feedback signal or the second feedback signal respectively corresponding to the self-service mode or the VR auxiliary operation mode based on the keyword;

the feedback signal sending module is configured to send the first feedback signal or the second feedback signal to the mode preparation module.

As an improvement, the mode preparation module includes: the self-service mode preparation module and the VR auxiliary mode preparation module are connected with the sound box through a power amplifier circuit;

the self-service mode preparation module is used for starting the self-service processing module according to the first feedback signal and controlling the sound box to broadcast the use instruction of the self-service processing module to the first user through the power amplifier circuit;

and the VR auxiliary mode preparation module is used for starting the VR auxiliary processing module according to the second feedback signal and controlling the sound equipment to broadcast the use instruction of the VR auxiliary processing module to the first user through the power amplification circuit.

As an improvement, the VR auxiliary processing module includes: the system comprises user positioning equipment, a VR interactive equipment transmission module, a VR operating equipment transmission module and a second voice broadcast module; the VR interactive equipment transmission module and the VR operating equipment transmission module are arranged corresponding to the use area, a lifting mechanism is arranged on the VR interactive equipment transmission module, and a first electric manipulator and a first tray are arranged on the lifting mechanism; a conveying rail surrounding the use area is arranged on the VR operating equipment conveying module, a conveying mechanism is arranged on the conveying rail, and a second electric manipulator and a second tray are arranged on the conveying mechanism; the lifting mechanism and the first electric manipulator are in communication connection with the VR interactive equipment transmission module; the transmission mechanism and the second electric manipulator are in communication connection with the VR operating equipment transmission module;

the user positioning device is used for capturing head position information and hand position information of the first user in the use area;

the VR interactive equipment transmission module is used for controlling the first electric manipulator to grab the VR interactive equipment into the first tray, controlling the lifting mechanism to convey the VR interactive equipment to a position corresponding to the head of the first user according to the head position information, and sending a first in-place signal to the second voice broadcasting module;

the VR operating equipment conveying module is used for controlling the second electric manipulator to grab the VR operating equipment into the second tray, controlling the conveying mechanism to move to a position corresponding to the hand of the first user along the conveying track according to the hand position information, and sending a second in-place signal to the second voice broadcasting module;

the second voice broadcast module is used for respectively prompting the first user to wear the VR interactive equipment and the VR operating equipment according to the first in-place signal and the second in-place signal.

As an improved scheme, a first sensor and a second sensor are respectively configured on the VR interaction device and the VR operation device, the first sensor is provided with a integrity threshold, and the second sensor is provided with a fit threshold;

the first sensor is used for detecting the wearing integrity of the first user on the VR interaction equipment and comparing the wearing integrity with the integrity threshold; if the wearing integrity is not smaller than the integrity threshold value, the first sensor controls the VR interactive equipment to output the VR interactive image;

the second sensor is used for detecting the holding attaching degree of the first user to the VR operating equipment and comparing the holding attaching degree with the attaching degree threshold; if the degree of laminating grips not less than the degree of laminating threshold value, then the second sensor control VR operating equipment shakes, the second sensor control the second voice broadcast module suggestion first user vibrations are VR interactive operation's start signal.

As an improved solution, the self-service processing module comprises: the device comprises an interactive interface control module, a touch control action capture module and an interactive feedback module, wherein a card inserting port and a banknote placing port are configured in the interactive feedback module;

the interactive interface control module is used for starting the interactive interface and outputting operation options in the interactive interface;

the touch action capturing module is used for capturing the touch action of the first user on the operation option on the interactive interface and identifying a touch area corresponding to the touch action; the touch action capturing module sends an interaction signal to the interaction feedback module according to the touch area;

the interaction feedback module is used for executing the self-service interaction operation according to the interaction signal, and the self-service interaction operation comprises the following steps: opening the card insertion port or the bill placement port.

As an improvement, the VR auxiliary processing module further includes: the image monitoring module is arranged above the using area and is provided with a wide-angle camera; the image monitoring module monitors abnormal use conditions of the first user for the VR interaction equipment and the VR operating equipment through the wide-angle camera, and the image monitoring module controls the help calling module to send help seeking signals to a background end of a mechanism where the VR auxiliary processing module is located according to the abnormal use conditions.

As an improvement, the abnormal use condition includes: the user reversely wears the VR interaction equipment, the VR interaction equipment or the VR operating equipment to drop.

The invention also provides a self-service operation method based on the VR technology, which comprises the following steps:

setting a detection time period and a use area; configuring a self-service processing module, a VR auxiliary processing module, an interactive interface, VR interactive equipment and VR operating equipment;

detecting a first user based on the detection time period and the use area, acquiring voice data of the first user, and starting the self-service processing module or the VR auxiliary processing module based on the voice data;

when the self-service processing module is started, the self-service processing module starts the interactive interface and captures a touch action of the first user on the interactive interface, and the self-service processing module executes self-service interactive operation based on the touch action;

when the VR auxiliary processing module is started, the VR auxiliary processing module transmits the VR interaction device and the VR operating device to the first user; the VR interactive equipment outputs a VR interactive image according to the wearing integrity of the first user on the VR interactive equipment; and the VR operating equipment prompts the first user to carry out VR interactive operation according to the holding attaching degree of the first user to the VR operating equipment.

The invention also provides a computer-readable storage medium, on which a computer program is stored, which, when being executed by a processor, carries out the steps of the VR technology-based self-service operation method.

The invention has the beneficial effects that:

1. the self-service operating system based on the VR technology can match various different people for service processing through the mutual matching of the mode matching module, the mode preparing module, the self-service processing module, the VR auxiliary processing module, the VR interactive device and the VR operating device, and is comprehensive in design, high in universality, high in safety and processing efficiency, low in operation difficulty and high in acceptability.

2. The self-service operation method based on the VR technology can realize matching with various different crowds to perform business processing, and is comprehensive in design; the method has the advantages of high universality, safety and processing efficiency, low operation difficulty and strong acceptability.

3. The computer-readable storage medium can realize the cooperation of the guide mode matching module, the mode preparation module, the self-service processing module, the VR auxiliary processing module, the VR interactive device and the VR operating device, so as to realize the matching of various different crowds for business processing, and has the advantages of comprehensive design, universality, high safety and processing efficiency, low operation difficulty and strong acceptability, and the operability of the self-service operating method based on the VR technology is effectively improved.

Drawings

In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings used in the description of the embodiments or the prior art will be briefly described below, and it is obvious that the drawings in the following description are some embodiments of the present invention, and other drawings can be obtained by those skilled in the art without creative efforts.

Fig. 1 is an architecture diagram of a self-service operating system based on VR technology according to embodiment 1 of the present invention;

FIG. 2 is an architecture diagram of a pattern matching module according to embodiment 1 of the present invention;

FIG. 3 is an architecture diagram of a mode preparation module according to embodiment 1 of the present invention;

FIG. 4 is a block diagram of a VR auxiliary processing module in accordance with embodiment 1 of the present invention;

FIG. 5 is an architecture diagram of a self-service processing module according to embodiment 1 of the present invention;

fig. 6 is a flowchart of a self-service operation method based on VR technology according to embodiment 2 of the present invention.

Detailed Description

The following detailed description of the preferred embodiments of the present invention, taken in conjunction with the accompanying drawings, will make the advantages and features of the invention easier to understand by those skilled in the art, and thus will clearly and clearly define the scope of the invention.

In the description of the present invention, it should be noted that the described embodiments of the present invention are a part of the embodiments of the present invention, and not all embodiments; all other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.

In the description of the present invention, it should be noted that the terms "first" and "second" are used for descriptive purposes only and are not to be construed as indicating or implying relative importance.

In the description of the present invention, it should be noted that, unless otherwise explicitly specified or limited, the terms "pattern matching module", "pattern preparation module", "self-service processing module", "VR auxiliary processing module", "VR interaction device", "VR operation device", "detection time period", "use area", "interaction interface", "voice data", "feedback signal", "touch action", "self-service interaction operation", "wearing integrity", "VR interaction image", "holding attachment degree", "VR interaction operation", "user presence detection module", "voice broadcast module", "feedback signal transmission module", "broadcast signal", "self-service mode", "VR auxiliary operation mode", "self-service mode preparation module", "VR auxiliary mode preparation module", "user positioning device", "VR interaction device transmission module"), The terms "VR operator transmission module", "head position information", "hand position information", "integrity threshold", "fit threshold", "start signal", "operation option", "touch area", "card insertion port", "banknote placement port", "interactive interface control module", "touch motion capture module", "interactive feedback module", "image monitoring module", "help call module", "reverse wear" are to be understood in a broad sense. The specific meanings of the above terms in the present invention can be understood in specific cases to those skilled in the art.

In the description of the present invention, it is to be noted that: vr (virtual reality) is a virtual reality technology.

Example 1

The present embodiment provides a self-service operating system based on VR technology, as shown in fig. 1 to 5, including: the system comprises a mode matching module, a mode preparation module, a self-service processing module, a VR auxiliary processing module, VR interactive equipment and VR operating equipment; the pattern matching module is provided with a use area and a detection time period; an interactive interface is configured in the self-service processing module; correspondingly, the mode matching module, the mode preparation module, the self-service processing module, the VR auxiliary processing module, the VR interactive equipment and the VR operating equipment are all loaded on the self-service terminal equipment; and the self-service terminal equipment and the periphery of the use area are provided with closed glass protection bins, and bin doors capable of being opened and closed are arranged on the glass protection bins.

Specifically, the pattern matching module is configured to detect a first user according to the detection time period and the usage area, and acquire voice data of the first user; the pattern matching module sends a first feedback signal or a second feedback signal to the pattern preparation module based on the voice data; the pattern matching module includes: the system comprises a user on-site detection module, a first voice broadcast module and a feedback signal sending module, wherein a sound pick-up, a voice analysis chip and power amplifier equipment are arranged in the first voice broadcast module; the user presence detection module is used for detecting whether the first user exists in the use area or not every detection time period; if the first voice broadcast module exists, the user on-site detection module sends a broadcast signal to the first voice broadcast module; the first voice broadcasting module is used for controlling the power amplifier equipment to prompt the first user to select a self-service mode or a VR auxiliary operation mode through voice according to the broadcasting signal; the first voice broadcasting module acquires the voice data through the sound pick-up, and the first voice broadcasting module identifies key words in the voice data through the voice analysis chip; the first voice broadcasting module generates the first feedback signal or the second feedback signal respectively corresponding to the self-service mode or the VR auxiliary operation mode based on the keyword; the feedback signal sending module is used for sending the first feedback signal or the second feedback signal to the mode preparing module; in this embodiment, the detection time period is not particularly limited, and the smaller the detection time period is, the more real-time performance of the device can be reflected; correspondingly, the mode matching module is designed by considering all types of terminal equipment using users, and is provided with some middle aged people with autonomous learning ability and proficient in mastering interactive operation, so that self-service modes, self-service operations and other self-service sentences can be called, the first voice broadcasting module can identify that the users need to carry out self-service operation, and a first feedback signal is generated; correspondingly, the elderly people can say that the 'auxiliary operation' or 'VR auxiliary' and other sentences containing 'auxiliary', the first voice broadcasting module can identify that the user needs to perform VR auxiliary operation, and therefore a second feedback signal is generated; in this embodiment, the keywords in the voice data, i.e., "self-help" or "assistance", may be modified and configured to satisfy more types of users.

Specifically, the mode preparation module includes: the self-service mode preparation module and the VR auxiliary mode preparation module are connected with the sound box through a power amplifier circuit; the self-service mode preparation module is used for starting the self-service processing module according to the first feedback signal and controlling the sound box to broadcast the use instruction of the self-service processing module to the first user through the power amplifier circuit; the VR auxiliary mode preparation module is used for starting the VR auxiliary processing module according to the second feedback signal and controlling the sound equipment to broadcast the use instruction of the VR auxiliary processing module to the first user through the power amplification circuit; correspondingly, in the present embodiment, the first feedback signal and the second feedback signal are not limited to any form of pulse signal or wireless transmission signal; the corresponding service instruction broadcast is played through the self-service mode preparation module and the power amplifier equipment arranged on the VR auxiliary mode preparation module, and the user is informed of the specific operation steps; for example: the instructions for the self-service processing module may be: "please the user to pay attention to the information displayed on the interactive screen below, and perform following operation by touch on the interactive screen according to the information"; the instructions for use of the VR auxiliary processing module may be: "please pay attention to the lifting equipment and the conveying equipment around you, please keep standing and do not move, and after the lifting equipment and the conveying equipment are completely operated, follow-up operation is performed according to voice feedback or physical feedback"; in this embodiment, the first user generally refers to a user going to a financial institution to use the self-service terminal device, and is not limited herein.

Specifically, the self-service processing module is configured to start the interactive interface and capture a touch action of the first user on the interactive interface; the self-service processing module executes self-service interaction operation based on the touch action; the self-service processing module comprises: the device comprises an interactive interface control module, a touch control action capture module and an interactive feedback module, wherein the interactive feedback module is provided with a card insertion port, an induction port and a banknote placing port; the interactive interface control module is used for starting the interactive interface and outputting operation options in the interactive interface; the touch action capturing module is used for capturing the touch action for the operation option on the interactive interface and identifying a touch area of the touch action; the touch action capturing module sends an interaction signal to the interaction feedback module according to the touch area; the interaction feedback module is used for executing the self-service interaction operation according to the interaction signal, and the self-service interaction operation comprises the following steps: opening the card insertion port, the sensing port or the banknote placement port; in this embodiment, the self-service processing module is a terminal host made of a common display screen, a processor and an interaction port, and a user performs touch operation on the display screen, and the touch operation is identified through screen sensing, so that a touch area of the user is determined according to matching of the screen and the interaction interface; finally, identifying the options touched by the user, and controlling each port to perform interactive feedback through an interactive feedback module; for example: when the user selects the deposit option, the screen can prompt the deposit without the card or the deposit with the card; when the user selects deposit without a card, the screen prompts the card number, after the user inputs the card number and checks the information, the interactive feedback module controls the opening of the banknote placing port and broadcasts the banknote placing request by voice; when the user selects the card deposit, the screen prompts to insert the card or place the card in the sensing area; at the moment, the interactive feedback module can control the annular prompt lamps around the card insertion port and the induction port to flicker so as to prompt a user to carry out interactive operation; the self-service processing module is mainly used for meeting the requirement of self-service operation crowds, and under the premise of VR operation, the self-service operation crowds are also considered, and the applicability of the system and the equipment is improved.

Specifically, the VR auxiliary processing module is configured to transmit the VR interaction device and the VR operation device to the first user; the VR auxiliary processing module includes: the system comprises user positioning equipment, a VR interactive equipment transmission module, a VR operating equipment transmission module and a second voice broadcast module; the VR interactive equipment transmission module and the VR operating equipment transmission module are arranged corresponding to the use area, a lifting mechanism is arranged on the VR interactive equipment transmission module, and a first electric manipulator and a first tray are arranged on the lifting mechanism; a conveying rail surrounding the use area is arranged on the VR operating equipment conveying module, a conveying mechanism is arranged on the conveying rail, and a second electric manipulator and a second tray are arranged on the conveying mechanism; the lifting mechanism and the first electric manipulator are in communication connection with the VR interactive equipment transmission module; the transmission mechanism and the second electric manipulator are in communication connection with the VR operating equipment transmission module; in this embodiment, the communication connections all use wireless transmission technologies, such as bluetooth transmission and network transmission; the user positioning device is used for capturing head position information and hand position information of the first user in the use area; the VR interactive equipment transmission module is used for controlling the first electric manipulator to grab the VR interactive equipment into the first tray, controlling the lifting mechanism to convey the VR interactive equipment to a position corresponding to the head of the first user according to the head position information, and sending a first in-place signal to the second voice broadcasting module; the VR operating equipment conveying module is used for controlling the second electric manipulator to grab the VR operating equipment into the second tray, controlling the conveying mechanism to move to a position corresponding to the hand of the first user along the conveying track according to the hand position information, and sending a second in-place signal to the second voice broadcasting module; the second voice broadcast module is used for respectively prompting the first user to wear the VR interactive equipment and the VR operating equipment according to the first in-place signal and the second in-place signal; in this embodiment, a panoramic image capturing device is disposed in the user positioning device, and is configured to capture a whole body image of the user in the use area, so as to analyze head position information and hand position information of the user; correspondingly, the VR interactive equipment is a VR helmet, and the VR operating equipment is a VR operating rod; correspondingly, the VR interactive equipment transmission module and the VR operating equipment transmission module can be specifically provided with placement areas according to the specification and the architecture design of the carried self-service terminal equipment; the VR interactive equipment transmission module and the VR operating equipment transmission module are designed into transmission modules capable of realizing transmission around the user; for example: a retractable rotary gripper, etc.; through the guide of VR mutual equipment transfer module and VR operating device transfer module, further improved the adaptation to the old crowd, do not need old crowd's study and thinking, directly convey VR mutual equipment and VR operating device to the human end that bears: the head and the hands are more in line with the human engineering; correspondingly, after the second voice broadcast module targets in place at VR mutual equipment and VR operating equipment, carry out voice prompt once more, more briefly let the user know the step of using, better guide user goes to use equipment, very big promotion user's use experience.

Specifically, the VR interaction device is configured to output a VR interaction image according to the wearing integrity of the first user on the VR interaction device; the VR operating equipment is used for prompting the first user to carry out VR interactive operation according to the holding attaching degree of the first user to the VR operating equipment; a first sensor and a second sensor are respectively arranged on the VR interaction equipment and the VR operation equipment, a integrity threshold value is arranged on the first sensor, and a fit threshold value is arranged on the second sensor; the first sensor is used for detecting the wearing integrity of the first user on the VR interaction equipment and comparing the wearing integrity with the integrity threshold; if the wearing integrity is not smaller than the integrity threshold, the first sensor controls the VR interactive equipment to output a VR interactive image; the second sensor is used for detecting the holding attaching degree of the first user to the VR operating equipment and comparing the holding attaching degree with the attaching degree threshold; if the holding attaching degree is not smaller than the attaching degree threshold value, the second sensor controls the VR operating equipment to vibrate and controls the second voice broadcasting module to prompt the first user that the vibration is the VR interactive operation starting signal; in this embodiment, the first sensor and the second sensor are both touch sensors, and the first sensor is disposed at several fixed positions inside the VR helmet, such as the hindbrain, temple, crown of the head, and forehead; therefore, as long as the wearing integrity obtained by the first sensors at the positions is not less than the integrity threshold value, the wearing integrity of the user is indicated, and at the moment, a VR image is output from the interior of the VR helmet and the user is prompted to start VR adaptation; correspondingly, the second sensor is arranged at the ergonomic holding position on the VR operating lever; when the holding attaching degree detected by the second sensor is not smaller than the attaching degree threshold value, the fact that the user holds the VR operating lever tightly is indicated, the VR operating lever vibrates at the moment, the second voice broadcasting module informs that the VR interactive operation can be started if the VR operating lever vibrates, and the user can wave the VR operating lever to interact with a trigger scene in a VR image; then, the user processing business and other operations are handled through a client program pre-placed in the VR image, so that the client is guided to operate correctly, and wrong operation is avoided; through VR interactive equipment and VR operating equipment, service handling based on VR technology is carried out on elderly people, and users do not need to learn, namely wearing and using are carried out; on the one hand, the freshness of the user is improved, on the other hand, the applicability of the product is improved, meanwhile, the waiting of the elder in a manual window is avoided, and the resource waste of the self-service terminal equipment is avoided.

Specifically, the VR auxiliary processing module further includes: the image monitoring module is arranged above the using area and is provided with a wide-angle camera; the image monitoring module monitors abnormal use conditions of the first user for the VR interaction device and the VR operation device through the wide-angle camera, and the image monitoring module controls the help calling module to send help signals to a background end of a mechanism where the VR auxiliary processing module is located according to the abnormal use conditions; the abnormal use condition comprises: the user reversely wears the VR interaction equipment, falls the VR interaction equipment and falls the VR operation equipment; correspondingly, in the present embodiment, the abnormal use case is not limited to the above, and any operation that violates the normal use program is taken into account in the abnormal use case; at the moment, the image monitoring module can judge the events such as user misoperation, user falling, user emergency and the like; the image monitoring module can control the help calling module to send a help seeking signal to a background end of the mechanism where the VR auxiliary processing module is located, and then the help seeking signal is sent to the staff of the mechanism; by the aid of the self-service operating system based on the VR technology, people with different requirements can be flexibly matched with service processing modes, operation difficulty of the type of user on equipment is reduced compared with the elderly people, and operation convenience and experience of the type of user are improved; the system has extremely high humanized design, comprehensive consideration on safety and practicability, extremely strong product competitiveness and capability of making up the vacancy of the prior art.

Example 2

The embodiment provides a self-service operation method based on a VR technology, as shown in fig. 6, including the following steps:

s100, setting a detection time period and a use area; configuring a self-service processing module, a VR auxiliary processing module, an interactive interface, VR interactive equipment and VR operating equipment;

specifically, in this embodiment, a self-service operation method based on the VR technology is applied to a self-service terminal device; the smaller the detection time period is, the more real-time performance can be embodied; the using area is an area around the self-service terminal equipment; VR mutual equipment and VR operating equipment are VR helmet and VR action bars respectively.

S200, detecting a first user based on the detection time period and the use area, and acquiring voice data of the first user; starting the self-service processing module or the VR auxiliary processing module based on the voice data;

step S200 specifically includes:

s210, detecting whether the first user exists in the use area every other detection time period; if the first user voice is in the self-service mode, prompting the first user to select the self-service mode or the VR auxiliary operation mode;

s220, acquiring the voice data, identifying key words in the voice data, and starting the self-service processing module or the VR auxiliary processing module based on the key words.

S300, when the self-service processing module is started, the self-service processing module starts the interactive interface and captures a touch action of the first user on the interactive interface, and the self-service processing module executes self-service interactive operation based on the touch action;

step S300 specifically includes:

s310, the self-service processing module starts the interactive interface and outputs operation options in the interactive interface;

s320, the self-service processing module captures the touch action of the first user on the operation option on the interactive interface and identifies a touch area corresponding to the touch action;

s330, the self-service processing module executes the self-service interaction operation based on the touch area, and the self-service interaction operation comprises the following steps: opening the card insertion port or the bill placement port.

S400, when the VR auxiliary processing module is started, the VR auxiliary processing module transmits the VR interaction equipment and the VR operation equipment to the first user; the VR interactive equipment outputs a VR interactive image according to the wearing integrity of the first user on the VR interactive equipment; the VR operating equipment prompts the first user to carry out VR interactive operation according to the holding attaching degree of the first user to the VR operating equipment;

step S400 specifically includes:

s410, the VR auxiliary processing module captures head position information and hand position information of the first user in the use area;

s420, the VR auxiliary processing module transmits the VR interaction equipment to the first user according to the head position information and generates a first in-place signal;

s430, the VR auxiliary processing module transmits the VR operating equipment to the first user according to the hand position information and generates a second in-place signal;

s440, the VR auxiliary processing module prompts the first user to wear the VR interactive equipment and the VR operating equipment according to the first in-place signal and the second in-place signal respectively;

s450, a completeness threshold value is set on the VR interactive equipment, and the VR interactive equipment detects the wearing completeness of the first user on the VR interactive equipment and compares the wearing completeness with the completeness threshold value; if the wearing integrity is not smaller than the integrity threshold, the VR interactive equipment controls the VR interactive equipment to output the VR interactive image;

s460, setting a fitting degree threshold value on the VR operating equipment, detecting the holding fitting degree of the first user to the VR operating equipment by the VR operating equipment, and comparing the holding fitting degree with the fitting degree threshold value; if the holding attaching degree is not smaller than the attaching degree threshold value, the VR operating equipment controls the VR operating equipment to vibrate, and the VR operating equipment controls the second voice broadcast module to prompt the first user that the vibration is a starting signal of VR interactive operation;

correspondingly, step S400 further includes: monitoring abnormal use conditions of the first user for the VR interaction equipment and the VR operation equipment, and sending a help seeking signal to a background end according to the abnormal use conditions; the abnormal use condition comprises: the user reversely wears the VR interaction equipment, the VR interaction equipment or the VR operating equipment to drop.

Example 3

The present embodiments provide a computer-readable storage medium comprising:

the storage medium is used for storing computer software instructions for implementing the self-service operation method based on VR technology in embodiment 2, and the computer software instructions comprise a program for executing the self-service operation method based on VR technology; specifically, the executable program may be embedded in the self-service operating system based on the VR technology described in embodiment 1, so that the self-service operating system based on the VR technology may implement the self-service operating method based on the VR technology described in embodiment 2 by executing the embedded executable program.

Furthermore, the computer-readable storage medium of the present embodiments may take any combination of one or more readable storage media, where a readable storage medium includes an electronic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any combination thereof.

Different from the prior art, the self-service operating system, the method and the medium based on the VR technology can be matched with various different people through the system for business processing, and the method provides an effective design idea for the system and is thorough in design; the system has high universality, safety and processing efficiency, low operation difficulty and strong acceptability; the user experience is promoted, and the vacancy of the prior art is made up.

The numbers of the embodiments disclosed in the embodiments of the present invention are merely for description, and do not represent the merits of the embodiments.

It will be understood by those skilled in the art that all or part of the steps of implementing the above embodiments may be implemented by hardware, and a program that can be implemented by the hardware and can be instructed by the program to be executed by the relevant hardware may be stored in a computer readable storage medium, where the storage medium may be a read-only memory, a magnetic or optical disk, and the like.

The above description is only an embodiment of the present invention, and not intended to limit the scope of the present invention, and all modifications of equivalent structures and equivalent processes performed by the present specification and drawings, or directly or indirectly applied to other related technical fields, are included in the scope of the present invention.