阅读说明：本技术 一种适用于盲人与常人公平射箭竞技的系统及其实现方法 (System suitable for fair archery competition between blind people and ordinary people and implementation method thereof ) 是由 王昀 朱吉虹 程炎 罗珊 方瀚翔 罗丽萍 周龙飞 林璐 于 2021-05-14 设计创作，主要内容包括：本发明提供一种适用于盲人与常人公平射箭竞技的系统,所述该系统包括场景模拟单元、运算处理单元、弓箭手柄单元和体感反馈单元；所述场景模拟单元包括红外LED、红外摄像设备、红外发射设备；所述运算处理单元包括信号传输装置和计算机；所述模拟弓箭单元包括弓体,所述弓体上设有红外发射装置,弓弦与滑动变阻器相连,通过弓弦的开合来实现滑动变阻。本发明还提供一种适用于盲人与常人公平射箭竞技的实现方法通过提供所述的方法解决视觉功能有所缺失的特殊人群不能体验类似活动的问题,从而让视觉功能存在障碍的特殊人群也能够参与进来,体验射击。(The invention provides a system suitable for fair archery competition between blind people and ordinary people, which comprises a scene simulation unit, an arithmetic processing unit, an archery handle unit and a somatosensory feedback unit, wherein the scene simulation unit is used for simulating the scene of a blind person; the scene simulation unit comprises an infrared LED, an infrared camera device and an infrared emission device; the operation processing unit comprises a signal transmission device and a computer; the simulated bow and arrow unit comprises a bow body, an infrared emitting device is arranged on the bow body, a bow string is connected with the sliding rheostat, and sliding rheostat is achieved through opening and closing of the bow string. The invention also provides a realization method suitable for fair archery competition between the blind and the ordinary people, and the method solves the problem that special crowds with lost visual functions cannot experience similar activities, so that the special crowds with visual function obstacles can participate in shooting and experience shooting.)

1. The system is characterized by comprising a scene simulation unit, an arithmetic processing unit, an arrow handle unit and a somatosensory feedback unit: the scene simulation unit comprises an infrared LED, an infrared camera device and an infrared emission device; the operation processing unit comprises a signal transmission device and a computer;

the bow and arrow handle unit comprises a bow body, and the infrared emitting device and the body sensing feedback unit are arranged on the bow body.

2. The system and the implementation method thereof as claimed in claim 1, wherein the somatosensory feedback unit comprises a simulated 4-sense generating device except vision, including a sound generating device, a vibration device, and a smell generating device.

3. The system and the realization method thereof suitable for the blind and the ordinary fair archery competition according to the claim 1 are characterized in that the realization method is realized by the following steps:

step 1, arranging an infrared LED for enclosing an interaction area on a projection surface;

step 2, arranging infrared camera equipment in front of the projection surface to ensure that the shooting capture range of the infrared camera equipment covers the interaction area;

step 3, establishing data connection between the infrared camera equipment and the computer, and establishing communication between the infrared camera equipment and the computer to realize data sending and receiving;

step 4, reading an infrared LED signal captured by the current infrared camera equipment by the computer;

step 5, carrying out binarization processing on the captured image on a computer to ensure that the image with gray level only has black and white, and filtering out invalid information;

step 6, calculating the outline of an interaction area surrounded by an infrared LED signal source in the binary image, and calculating a central coordinate point of the surrounded area and corresponding coordinates of four vertexes, wherein the surrounded area is the range of the interaction area;

step 7, sequencing the interactive areas with the determined range, and carrying out image correction on the identification area;

step 8, carrying out target seeking track motion in the interaction area through an infrared emission device arranged on the handle unit of the bow and arrow;

step 9, the computer captures the position of the point aimed by the current infrared transmitting device in real time, converts the position into a coordinate, compares the coordinate with a preset target coordinate, calculates the distance between the two coordinates and sends an instruction to the somatosensory feedback unit;

and step 10, judging whether a mark flag is met or not by the bow and arrow handle unit through the voltage change driven by the opening and closing of the bowstring, calculating the current coordinate and the coordinate of the target when the condition is met, and judging whether the target hits the target.

4. The system and method as claimed in claim 3, wherein the OpenCV in the step 4 computer captures infrared LED signals by reading the current infrared camera, the step 7 sequences the recognized regions including recognizing the four region vertices, then sequences the positioning points according to the sequence of upper left, upper right, lower right, and lower left, and after obtaining the four sequenced coordinate points, image-corrects the recognized regions by the perspective matrix and the homogeneous coordinates, and obtains the regular geometric recognition regions after correction.

5. The system and method as claimed in claim 3, wherein the step 6 is to calculate the outline of the area projected by the infrared emitter and the center point of the outline in the image of the interaction range corrected to be rectangular.

6. The system and the implementation method thereof suitable for the blind and the ordinary fair archery competition of the claim 3 are characterized in that in the implementation method, the step 8 of triggering the infrared emission device through the opening and closing of bowstrings is carried out.

7. The system and the implementation method thereof as claimed in claim 3, wherein in the implementation method, the computer in step 9 sends different commands to the somatosensory feedback unit according to the captured aiming point coordinates and the distance between the preset bull's-eye coordinates.

8. The system and the implementation method thereof as claimed in claim 3, wherein in the implementation method, in the step 10, an Arduino single chip microcomputer is disposed in the arrow handle unit, a storage unit in the Arduino single chip microcomputer is provided with a voltage determination threshold, and the Arduino single chip microcomputer controls the variable state of the flag by reading the voltage value of the sliding rheostat connected to the bow string in real time and further affects the somatosensory feedback unit, and the specific determination steps are as follows:

s1 reading the chute voltage value;

s2, when the voltage is 0, whether a transmitting flag is set or not is judged, if so, a transmitting signal is transmitted to the middle layer, and if not, the step returns to S1;

s3, when the voltage value is not 0, judging whether the current voltage is larger than the threshold value, if not, returning to S1;

s4, when the voltage is larger than the threshold value, infrared rays are turned on, and the larger the value is, the stronger the vibration of the somatosensory feedback unit is;

s5, judging whether the current voltage is larger than the emission voltage, if not, returning to S1;

s6 the current voltage is greater than the transmission voltage, transmitting flag.

Technical Field

The invention relates to archery competition, in particular to a system suitable for the fair archery competition of blind people and ordinary people and an implementation method thereof.

Background

The existing electronic virtual shooting experience is single, aiming point positions of shooters are captured by means of related technologies such as infrared and the like and fed back to the shooters in an image simulation mode, information is shot completely by means of vision (for example, the positions of a target center and an aiming point are judged), the shooters judge shooting accuracy by comparing the aiming point positions and the target center positions on a screen, and although the presenting effects of different electronic virtual shooting are different from the electronic virtual environment formed, the shooting mode is not changed in the visual capturing mode. And thus is monotonous in the overall shooting experience.

In addition, the capture technology used in the existing electronic virtual shooting activities has limitations, the shooting process needs one electronic imaging device, and has related requirements on environment (ensuring imaging effect) and personnel (ensuring normal vision), for example, the ambient light is weak, the imaging effect is poor, and the visual requirement on shooters is normal. In order to solve the problems, (mainly solving the problem that special people with lost visual functions cannot experience similar activities) the invention designs a new shooting experience, which does not have requirements on the use environment on hardware (because the imaging equipment and the light environment are not necessary conditions because of the dependence on sound), and expands the experience mode and increases the pleasure because of experience with hearing in the experience dimension, and expands the special people with visual function disorder and enables the special people to participate in the experience.

Disclosure of Invention

In order to solve the problems in the background art, the invention provides a system suitable for fair archery competition between blind people and ordinary people and an implementation method thereof.

The invention adopts the following technical scheme: a system suitable for blind persons and ordinary persons to fairly shoot an arrow and compete and an implementation method thereof are disclosed, wherein the system comprises a scene simulation unit, an arithmetic processing unit, an arrow handle unit and a somatosensory feedback unit; the scene simulation unit comprises an infrared LED, an infrared camera device and an infrared emission device; the operation processing unit comprises a signal transmission device and a computer;

the simulated bow and arrow unit comprises a bow body, an infrared emitting device is arranged on the bow body, a bow string is connected with the sliding rheostat, and sliding rheostat is achieved through opening and closing of the bow string.

Further, the somatosensory feedback unit comprises a simulation 4-sense generating device except vision, and the simulation 4-sense generating device comprises a sound generating device, a vibrating device and a smell generating device.

A realization method suitable for fair archery competition between blind people and ordinary people is realized by the following steps: step 1, arranging an infrared LED for enclosing an interaction area on a projection surface;

step 2, arranging infrared camera equipment in front of the projection surface to ensure that the imaging range of the infrared camera equipment covers the interaction area, wherein the infrared camera equipment is narrow-band infrared camera equipment and can only receive infrared signals and not receive visible light signals, so that light interference generated by overlapping projection graphs in an area can be eliminated, and the range of the interaction area surrounded by the infrared LED is ensured;

step 3, establishing data connection between the infrared camera equipment and the computer, and establishing communication between the infrared camera equipment and the computer to realize data sending and receiving;

step 4, the OpenCV in the computer captures infrared LED signals by reading the current infrared camera;

step 5, carrying out binarization processing on the captured image on a computer to ensure that the image with gray level only has black and white, filtering out invalid information, wherein the image is the captured video frame image;

step 6, calculating the outline of an interaction area surrounded by an infrared LED serving as a signal source in the binary image, and calculating a central coordinate point of the surrounded area and corresponding coordinates of four vertexes, wherein the surrounded area is the range of the interaction area;

step 7, sequencing the interacted areas, carrying out image correction on the identification areas, determining vertexes through the arranged infrared LEDs, sequencing the vertexes from the upper left vertex in a clockwise sequence, obtaining a transformation matrix according to the vertexes in the same sequence of the standard rectangular shape through a perspective transformation algorithm, and obtaining an interaction area range image between the simulated bow and arrow corrected to be rectangular and the projection through the transformation matrix;

step 8, simulating the bow and arrow unit to perform target seeking track movement in the interaction area through an infrared emission device arranged on the bow;

step 9, the computer captures the position of the point aimed by the current infrared transmitting device in real time, converts the position into a coordinate, compares the coordinate with the coordinate of the prefabricated target center, calculates the distance between the two coordinates and sends an instruction to the somatosensory feedback unit according to the distance;

and step 10, judging whether a mark flag is met or not by the bow and arrow handle unit through the voltage change driven by the opening and closing of the bowstring, wherein the current voltage of the slide rheostat is 0, and when the condition meets the mark, calculating the current coordinate and the coordinate of the target and judging whether the target hits the target.

Further, the OpenCV in the computer in step 4 captures an infrared LED signal by reading a current infrared camera, and the step 7 sequences the identified regions including identifying four region vertices, then sequences the positioning points according to an order of top left, top right, bottom right, and bottom left, and after obtaining the four sequenced coordinate points, performs image correction on the identified regions through a perspective matrix and homogeneous coordinates, and obtains a regular geometric identification region after correction.

Further, step 8, the infrared emitting device is triggered by opening and closing of the bowstring.

Further, step 9, the computer sends different instructions to the somatosensory feedback unit according to the captured aiming point coordinates and the distance between the preset bulls-eye coordinates. The somatosensory feedback unit makes a response according to the instruction.

Further, be provided with the Arduino singlechip in the arrow handle unit of step 10, storage unit is equipped with the voltage and judges the threshold value in the Arduino singlechip, and the variable state of flag and further influence body sense feedback unit are controlled through reading the slide rheostat voltage value of connecting on the bowstring in real time to the Arduino singlechip, and concrete judgement step is as follows:

s1 reading the chute voltage value;

s2, when the voltage is 0, whether a transmitting flag is set or not is judged, if so, a transmitting signal is transmitted to the middle layer, and if not, the step returns to S1;

s3, when the voltage value is not 0, judging whether the current voltage is larger than the threshold value, if not, returning to S1;

s4, when the voltage is larger than the threshold value, infrared rays are turned on, and the larger the value is, the stronger the vibration of the somatosensory feedback unit is;

s5, judging whether the current voltage is larger than the emission voltage, if not, returning to S1;

s6 the current voltage is greater than the transmission voltage, transmitting flag.

The invention provides a system suitable for fair archery competition between blind people and ordinary people and an implementation method thereof. When a shooter picks up a shooting tool to aim at a designed target, the shooter can rely on corresponding sound feedback, and when the aiming point of the shooter is closer to the shooting target, the obtained sound feedback is stronger and more urgent, and the shooter needs to judge whether the own shooting hits the target by distinguishing the sound. Compared with the existing electronic virtual shooting, the electronic virtual shooting method based on the ear aiming is mainly used by eyes, so that the aim by ears is widened, the sensory dimension is improved, the experience is better, and the novelty is higher. Meanwhile, special crowds with visual function obstacles can participate in the shooting experience.

Drawings

FIG. 1 is a schematic diagram of the system of the present invention;

FIG. 2 is a schematic view of an infrared LED image captured by the infrared camera of the present invention;

FIG. 3 is a schematic diagram showing a comparison of the present invention before and after correction using a perspective transformation algorithm;

FIG. 4 is a schematic diagram of an infrared camera of the present invention capturing infrared emission points;

FIG. 5 is a schematic diagram illustrating a comparison of coordinates of IR-emitting points and IR-free points according to the present invention;

FIG. 6 is a schematic diagram illustrating the conversion of the distance between the infrared emission point and the target center according to the present invention;

FIG. 7 is a schematic view of the operating logic of the handle unit of the bow and arrow of the present invention;

FIG. 8 is a schematic diagram of infrared aiming point capture of the system of the present invention;

FIG. 9 is a diagram of an abstract layered model according to the present invention.

The reference numerals in the drawings denote: 1-an infrared LED; 2-an infrared camera device; 3-a signal transmission device; 4-a computer; 5-bow body; 5-1-an infrared emitting device; 5-2-Arduino singlechip; 5-3-somatosensory feedback unit.

Detailed Description

Example 1

The present invention will be described in further detail with reference to the accompanying drawings and specific embodiments.

A system suitable for blind and ordinary fair archery competition and a realization method thereof are disclosed, wherein the method comprises the following steps:

the infrared LEDs 1 for enclosing the interaction area are arranged on the projection surface as shown in fig. 1;

the infrared camera device 2 is arranged in front of the projection surface, so that the imaging range of the infrared camera device 2 is ensured to cover the interaction area, the infrared camera device 2 is a narrow-band infrared camera device 2, only can receive infrared signals and does not receive visible light signals, light interference generated by overlapping projection graphs in an area can be eliminated, and the range of the interaction area surrounded by the infrared LED1 is ensured;

establishing data connection between the infrared camera device 2 and the computer 4, establishing communication between the two devices to realize data sending and receiving, matching the infrared transmitting device 5-1 with the computer 4 through the Arduino single chip microcomputer 5-2, and performing data interaction through mutually identified IP addresses, wherein the Arduino single chip microcomputer 5-2 and the computer 4 are positioned in the same local area network;

the OpenCV in the computer 4 captures infrared LED1 signals by reading the current infrared camera, and obtains ABCD4 coordinate points as shown in FIG. 2;

carrying out binarization processing on the captured image on a computer 4 to ensure that the image with gray level only has black and white, filtering out invalid information, wherein the image is a captured video frame image;

calculating the outline of an interaction area surrounded by an infrared LED1 serving as a signal source in a binary image, calculating the center coordinate point of the obtained structure, sequencing the obtained 4 random fixed point coordinates, sequencing according to the principle that the small value of an X value is close to the left and the large value of a Y value is close to the upper part, and obtaining four vertex coordinates A (45, 55), B (680, 51), C (699,457) and D (15,460) which are sequenced from the upper left corner in a clockwise manner, wherein the region of the structure is the range of the interaction area;

sequencing the interacted areas and correcting the images of the identified areas as shown in FIG. 3, defining vertexes by an arranged infrared LED1, sequencing clockwise from the top left vertex, obtaining a transformation matrix by a perspective transformation algorithm according to the vertexes in the same sequence of the standard rectangular shape, and obtaining an interaction area range image between a simulated bow and an arrow corrected to be rectangular and projection by the transformation matrix, wherein the current range is (768 x 480);

calculating the central point of the interactive area in the interactive area after the image correction;

as shown in fig. 4, the infrared emission device 5-1 arranged on the bow body is opened by pulling the bow string, and the infrared aiming point moves in the interaction area in a target seeking track; e is the aiming point of the current infrared emitting device, the current coordinate of E is (320,180), the current data packet is True when the aiming point exists in the currently identified interaction region as shown in fig. 5, the X-axis coordinate and the Y-axis coordinate of the current aiming point are sent to the computer 4, if the aiming point does not exist in the currently identified interaction region, that is, the aiming point exceeds the interaction region, the current data packet is False, no coordinate information is sent to the computer 4, and the computer retains the coordinate information containing Trus in the previous frame.

As shown in fig. 6, the computer 4 captures the position of the current point aimed by the infrared emitting device 5-1 in real time and converts the position into coordinates, the current projection generates an interactive region with 1920 × 1080 resolution, and generates a bull's-eye coordinate T (the bull's-eye is not actually displayed on the projection and is stored in a memory of the computer) within a display range, during the aiming process, the computer 4 detects the distance between the current aiming point and the bull's-eye in real time, and simultaneously sends different instructions to the somatosensory feedback unit 5-3 synchronously according to the change of the distance, the somatosensory feedback unit 5-3 in the embodiment is set as an earphone, the closer the distance between the aiming point and the bull's-eye is, the more urgent the prompt sound is, the opening and closing of the bow string on the bow-bow handle unit is finished by one time, that the flag emission is finished, after the emission, the computer 4 reads E ' (0.416667,0.375000) if the activation value in the data packet is Ture, and comparing the target with the prefabricated target center coordinates, setting the hit distance to be 10, wherein D >10 is not hit, sending a non-hit instruction to the somatosensory feedback unit 5-3 by the computer 4, and otherwise, sending a hit instruction to the somatosensory feedback unit 5-3 by the computer 4 when D <10 is hit.

Example 2

The utility model provides a system suitable for blind person and fair archery competition of ordinary person, this system includes scene analog unit, arithmetic processing unit, arrow handle unit and body sense feedback unit: the scene simulation unit comprises an infrared LED1, an infrared camera device 2 and an infrared emission device 5-1; the arithmetic processing unit comprises a signal transmission device 3 and a computer 4;

the simulation bow and arrow unit includes bow 5, as shown in fig. 7 be equipped with infrared emission device 5-1 on the bow 5, the bowstring links to each other with Arduino singlechip through slide rheostat, can obtain spout voltage value through opening and shutting of bowstring, Arduino singlechip links to each other with infrared emission device 5-1, sets up voltage threshold at Arduino singlechip to read spout voltage value in real time and discern voltage and judge the transmission signal. The chute voltage increases or decreases as the shooter opens and closes the bowstring. The method comprises the following steps that an Arduino single chip microcomputer in a circuit reads the chute voltage in real time, and when the chute voltage is smaller than a judgment threshold value, the chute voltage is read again in a circulating mode; when the chute voltage is larger than the judgment threshold value, the infrared ray equipment is started to emit infrared rays, and at the moment, the shooter is judged to be in the aiming state. When the shooter finishes the launching action, the chute part of the access circuit is reduced, the chute voltage is increased, when the voltage is greater than the mapping voltage, the shooting is judged, the launching flag is set, and if not, the operation is circulated to the first step to read the chute section voltage again. There are two cases when the voltage is equal to 0, case one: the transmitting device has not been triggered; case two: the launching device is set to launch the flag, and the sliding chute is in the homing process. Therefore, when the voltage is read as 0, it is identified whether or not the transmission flag has been set by the determination system. If not, whether the chute voltage is larger than a judgment threshold value is carried out (case one); if the flag is set, the transmission flag is cancelled (case two), and the process returns to the first step. The physical sensation feedback unit in the embodiment further comprises a vibration generator arranged in the bow body, the vibration generator adjusts the vibration frequency according to the stretching of the bowstring, and the tighter the bowstring is stretched, the larger the vibration frequency is.

The above-mentioned embodiments are intended to illustrate the present invention, but not to limit the present invention, and any modifications, equivalents, improvements, etc. made within the spirit of the present invention and the scope of the claims are included in the present invention.