阅读说明：本技术 操控乐器时操纵杆张力随行程可变的的输入装置及其使用方法 (Input device with variable control lever tension with stroke during musical instrument manipulation and use method thereof ) 是由 乔纳森·巴罗 海姆·凯莉 波阿斯·里恩施里伯 奥伦·加布里埃尔·阿尔斯海奇 于 2019-04-30 设计创作，主要内容包括：本发明公开了一种用于操作具有弦乐器演奏行为的乐器的输入设备,其包括：键盘单元,其包含一组将由演奏者按下的输入键,以便产生第一组电输入信号,其模拟乐器中按下的键的组合或按下的弦的组合；张力随位移可变的杆单元,包括由演奏者在预定的离散位置之间移动的杆,其模仿乐器弹奏的弦的组合,以及一组电触头,每个电触头对应于不同的离散位置,用于传输杆的位置信号；处理单元,其又包括用于设置音乐参数的输入按钮,用于接收操纵杆位置信号的第一组接口输入,用于接收第一组电输入信号的第二组接口输入,用于存储处理软件的存储器,以及连接到存储器的处理器,用于使用处理软件共同处理操纵杆位置信号和第一组电输入信号,并输出表示音符代码的电输出信号,该信号对应于输入键在按下和松开位置之间的移动以及杆在离散位置之间的移动；接口连接,用于将表示音符代码的电输出信号从处理单元传输到将电输出信号转换为声音的、计算机化的乐音生成单元。(The invention discloses an input device for operating a musical instrument having a playing behavior of a stringed instrument, comprising: a keyboard unit comprising a set of input keys to be depressed by a player so as to generate a first set of electrical input signals simulating a combination of depressed keys or a combination of depressed strings in a musical instrument; a lever unit variable in tension with displacement, comprising a lever moved by a player between predetermined discrete positions, which imitate the combination of strings played by the instrument, and a set of electrical contacts, each corresponding to a different discrete position, for transmitting a position signal of the lever; a processing unit, in turn comprising input buttons for setting musical parameters, a first set of interface inputs for receiving the joystick position signal, a second set of interface inputs for receiving the first set of electrical input signals, a memory for storing processing software, and a processor coupled to the memory for collectively processing the joystick position signal and the first set of electrical input signals using the processing software and outputting an electrical output signal representing a note code corresponding to movement of the input keys between depressed and released positions and movement of the lever between discrete positions; an interface connection for transmitting the electrical output signals representing the note codes from the processing unit to a computerized musical tone generating unit which converts the electrical output signals to sound.)

1. An input device for operating a musical instrument having a musical behavior of a stringed instrument, comprising:

a) a keyboard unit comprising a set of input keys to be depressed by a player so as to generate a first set of electrical input signals simulating a combination of depressed keys or a combination of depressed strings in a musical instrument;

b) a rod unit having a tension variable with displacement, comprising:

b.1) a bar moved by the player between predetermined discrete positions, which imitates the combination of strings played by the instrument;

b.2) a set of electrical contacts, each electrical contact corresponding to a different discrete position, for transmitting a signal relating to the position of the rod;

c) a processing unit comprising:

c.1) input buttons for setting music parameters;

c.2) a first set of interface inputs for receiving position signals of the shaft;

c.3) a second set of interface inputs for receiving said first set of electrical input signals;

c.4) a memory for storing processing software;

c.5) at least one processor connected to said memory for jointly processing said lever position signal and said first set of electrical input signals using said processing software and outputting electrical output signals representing the note codes corresponding to the movement of said input keys between depressed and released positions and the movement of said lever between said discrete positions;

d) one or more interface connections for transmitting electrical output signals representing the note codes from the processing unit to a computerized tone generating unit which converts the electrical output signals into sounds.

2. The input device of claim 1, further comprising a set of motion sensors attached to at least a portion of said input keys and/or to said shaft for detecting data representative of a parameter of motion of said keys or said shaft and providing the data to said processing unit.

3. The input device of claim 2, wherein the processing unit is adapted to:

a) collectively processing the position signal of the shaft, the first set of electrical input signals, and the motion parameter using the processing software; and

b) using the characteristic movement of the input keys between depressed and released positions and the characteristic movement of the lever between the discrete positions, an electrical output signal is output representing the note code corresponding to a particular player.

4. The input device of claim 3, wherein the motion parameters include one or more of:

a) a displacement speed;

b) the force applied to any key;

c) a force exerted on the joystick.

5. The input device of claim 1, wherein the signal is transmitted using wired or wireless transmission.

6. The input apparatus of claim 1, wherein the tone generating unit is selected from the group consisting of:

a synthesizer;

a computer;

a smart phone;

an internal sound generator;

a tablet computer.

7. The input device of claim 1, further comprising an electrical outlet for receiving a cable or wire connected to the tone generating unit to transmit the generated signal.

8. The input device of claim 1, further comprising a short-range wireless connection connected to the tone generating unit for transmitting the generated signals.

9. The input device as in claim 1, wherein certain sockets/connectors also enable additional external input devices to be connected to the processing unit, the external input devices being selected from the group consisting of:

a head switch;

a foot switch;

a large push button switch;

an eye tracking sensor;

a proximity sensor.

10. The input device as recited in claim 1 wherein all components are attached to each other to form a unitary assembly.

11. The input device of claim 1, implemented as a single unitary body.

12. The input device as claimed in claim 1, wherein each of the sections is adapted to be rotated, and the inclination angle of each of the sections is changeable according to the player's desire.

13. The input device of claim 1, which is a modular component, each part being disconnectable from the other and still able to maintain communication with them by wired or wireless communication means.

14. The input device of claim 1, wherein the orientation is adjusted by rotating or tilting the keyboard unit and the joystick unit with respect to the processing unit.

15. The input device as in claim 1, wherein said keyboard unit and said wand unit are directly connected to each other to form a unified body and said processing unit is remote.

16. The input device of claim 1, wherein the tension variable lever unit comprises:

a) a chord having a plurality of spaced semi-tubular recesses, each recess forming a different angle corresponding to a different discrete position of the bar;

b) a lever consisting of a replaceable modular handle, which pivots a pivot lever about a fixed pivot in response to player movement and applied force; and

c) a stop limiting movement of the pivot shaft at discrete positions when aligned with one of the semi-tubular recesses.

17. The input device as in claim 1, wherein said stop comprises:

a) a ball-containing tubular body that employs a distal end of a spring to push a push pin and a fixed mount permanently mounted on the inside wall of a cylinder within the tubular body;

b) a spring adjuster, which is a screw inserted into a corresponding thread formed at the fixing bracket;

c) a tubular flange for urging the proximal end of the spring;

d) a push pin for pushing the ball toward the chord with a force determined by the spring adjuster;

e) a proximity sensor array for providing electrical signals to a processing unit for generating a visual indication of the current discrete position of the wand;

wherein each time a player pushes the handle, the tubular body rotates causing the ball to travel along an arcuate path on the slotted surface of the chord so that

Whenever the center of the ball coincides with the center of the groove in the chord, the ball is pushed into the groove to prevent rotation at that location.

18. The input device of claim 1, wherein the musical parameter is selected from the group consisting of:

a tone duration;

selecting a gentle scale;

and a sound/melody performance mode.

19. The input device of claim 1, wherein two side recesses in the chord correspond to two inactive positions for allowing the player to be out of the plucking sequence when the lever exceeds the rearmost position in each direction.

Technical Field

The present invention relates to the field of musical instruments; more particularly, the present invention relates to an input device that is variable in lever tension with stroke when manipulating a musical instrument for use by a disabled player.

Background

Music is the most comprehensive communication means, and players around the world are connected through the music. In the long days of the years developed by human beings, people invented various musical instruments. However, to date, no standard musical instrument has been adapted for use by physically handicapped players.

Learning to play music is a complex task, particularly for players with limbs and movement disorders (e.g., cerebral palsy). Most musical instruments, such as guitars or pianos, require adequate control and coordination of both hands, which is complicated and difficult even for a sound player. Moreover, when playing the instrument, each hand needs to perform different types of movements simultaneously. For example, in playing a guitar, a player plucks with one hand and presses a string with the other hand to produce the desired chord. One hand of the player is responsible for completing the chord finger positions on the guitar neck so that the player's fingers press the guitar strings at different string positions (fixed positions on the neck) to produce different tones, while the other hand plays the guitar strings to produce musical chords. To avoid producing tones outside the expected harmonic range when the hand is moved from one chord position to another, the player typically stops certain unwanted strings from continuing to vibrate and producing no more sound by changing finger positions, covering the strings with fingers, or limiting the vibration of the strings.

Musical performance is a controlled physical activity over a period of time. Each song lasts approximately three and a half minutes on average. In a musical activity, whether class, solo or band played, players typically play at controlled speeds over a fixed period of time. In contrast to professional musicians, the "time" or tempo played by novices is often less accurate, the range of speeds is wider, and the range of speeds cannot be precisely controlled. When a player attempts to control a conventional musical instrument, such as a piano or guitar, their involuntary movements, such as twitching and muscle spasms, can result in the inability to continue playing the instrument, which can be very frustrating. Therefore, such involuntary actions should be detected and filtered.

With a conventional musical instrument such as a piano or guitar, the player immediately hears the sound produced by the instrument when the strings or keys are activated. For example, when plucking a guitar's strings, the sound and sound effects of the vibrating strings travel to the player's ears at sonic speed (less than a millisecond), providing the musician with immediate feedback of plucking the strings.

For digital musical instruments, there is an inherent feedback delay due to the need to do the following additional digital processing: reading input- > processing and analyzing data- > generating sound. This delay is called the "Latency" (Latency).

Delays in latency longer than 10 milliseconds result in the musician not being able to play the instrument;

human ears are rarely able to detect latency below 6 milliseconds;

the latency between-6 and 10 milliseconds causes a failure in accurate performance and causes fatigue even in a short-time performance.

Therefore, such latency should be minimized.

It is therefore an object of the present invention to provide an input device incorporating a joystick with a variable tension stroke for manipulating the instrument.

It is another object of the present invention to provide an input device incorporating a variable tension stroke joystick and a set of key combinations for manipulating a musical instrument; the input device is suitable for the disabled.

It is another object of the present invention to provide an input device incorporating a variable tension stroke joystick and a set of key combinations for manipulating a musical instrument; the input device is adapted to produce a plurality of tones and chords with minimal action.

It is a further object of the present invention to provide an input device incorporating a variable tension stroke joystick and a set of key combinations for manipulating the instrument to allow each player to develop a unique style of performance or a unique musical expression.

Other objects and advantages of the present invention will appear as the invention is further described below.

Disclosure of Invention

Definitions of some terms

Monophonic music-this term refers to music having a single melody (or "tune").

Polyphonic music-music that contains multiple parts of sound refers to multiple tones at the same time.

Chord-in music, a "chord" is any harmonious tone composed of two or more (usually three or more) tones (also called "pitches") that sound as if multiple sounds were made simultaneously. In a stringed musical instrument, a finger is moved up and down while plucking all strings for "freestyle" (freestyle) play, or for "arpeggio" (arpeggio) play in which chords are resolved in ascending or descending order.

Dynamics-sound in music means the sound level of the music. In a stringed musical instrument, the strength is affected by the strength of the hand playing the string.

Lingering (Legato) -playing music makes the tones smooth and coherent. In string instruments, technically, this is done by pressing a sound with a first finger at rest, and then pressing the sound with another finger after the first finger has performed a static pressure on the other sound.

Melody-listener perception is an integral string of linear tones.

Harmony (Harmony) -a combination of two or more tones is simultaneously played in addition to the melody.

Octave-the separation between one pitch and another at half or twice its frequency. The interval is equal to six tones or twelve semitones.

Chromatic scale-is a scale with chromatic intervals. The chromatic scale includes all western tones (twelve tones).

The term "player" generally refers to a person playing a musical instrument, such as a student or a musician. It may sometimes refer to a teacher or instrumental care giver who handles or adapts the equipment.

The term "key" refers to the switches and triggers that are depressed by the player to play the instrument, such as the "key" in a "piano key" or "keyboard".

The term "pluck lever" (Strum Stick) refers to a joystick with a joystick controller.

The term "tone map" refers to what tones should be emitted when different combinations of controllers are activated. For example, pressing key #1 and key #2 simultaneously produces a "C" chord.

The term "velocity" is how fast and how strong the player is when first pressing a key. The velocity measurements are intended to simulate the behavior of a piano work. If the key is struck harder, the sound produced by the piano is greater.

The present invention provides an input device for manipulating a musical instrument having the musical behavior of a stringed instrument, comprising:

a) a keyboard unit comprising a set of input keys to be depressed by a player so as to generate a first set of electrical input signals simulating a combination of depressed keys or a combination of depressed strings in a musical instrument;

b) a rod unit having a tension variable with displacement, comprising:

b.1) a lever moved by the player between predetermined discrete positions which mimics the combination of strings played by the instrument;

b.1) a set of electrical contacts, each electrical contact corresponding to a different discrete position, for transmitting a position signal of the rod;

c) a processing unit comprising:

c.1) input buttons for setting music parameters (e.g. duration, gentle scale selection, harmony/melody performance mode, etc.);

c.2) a first set of interface inputs for receiving the stem position signal;

c.3) a second set of interface inputs for receiving a first set of electrical input signals;

c.4) a memory for storing processing software;

c.5) at least one processor connected to the memory for jointly processing the stick position signal and the first set of electrical input signals using the processing software and for outputting an electrical output signal representative of the note code corresponding to the movement of the input keys between the depressed and released positions and the movement of the stick between the discrete positions;

d) one or more interface connections for transmitting electrical output signals representing the note codes from the processing unit to a computerized musical tone generating unit (e.g., synthesizer, computer, smartphone, internal sound generator, or tablet computer) for converting the electrical output signals to sound.

The input device of the present invention may further comprise a set of motion sensors attached to at least a portion of the input keys and/or rods for sensing data representative of a parameter of motion of the keys or rods (e.g., speed of displacement, degree of force applied on any key or joystick, etc.) and providing the data to the processing unit.

In an embodiment, the processing unit is adapted to:

a) collectively processing the joystick position signal, the first set of electrical input signals, and the motion parameter using processing software; and

b) the characteristic movement of the input keys between depressed and released positions and the characteristic movement of the lever between discrete positions are used to output electrical output signals representing the note codes corresponding to a particular player.

The signal may be transmitted using wired or wireless transmission.

The input device of the present invention may further include: a power outlet for receiving a cable or wire to be connected to the tone generating unit for transmitting the generated signal; and a short-range wireless connection connected to the tone generating unit for transmitting the generated signal.

Some sockets/connectors may also connect other external input devices (e.g., headswitches, footswitches, large pushbutton switches, eye tracking sensors, and proximity sensors) to the processing unit.

In one aspect, all of the components are attached to one another to form a single body assembly. Also, the input devices may be a single unitary body.

Each section may be adapted to rotate, and the inclination angle of each section may be changed according to the player's needs.

The input device of the present invention may be a modular assembly in which each part may be disconnected from the other parts, but may still communicate with them via wired or wireless communication.

The orientation of the keyboard unit and the joystick unit may be adjusted by rotating or tilting the keyboard unit and the joystick unit with respect to the processing unit.

The keyboard unit and the wand unit may be attached directly to each other to form a unified body, while the processing unit is remote.

The variable tension bar unit may include:

a) a chord with a plurality of spaced semi-tubular recesses, each recess forming a different angle corresponding to the possible discrete positions of the bar;

b) a lever including a replaceable modular handle, the lever being responsive to player motion and applied force to pivot a pivot lever about a fixed pivot axis; and

c) a stop limiting movement of the pivot at the discrete position when aligned with one of the tubular recesses.

The stopper may include:

a) a tubular body into which a ball is inserted, and a spring for pushing the push pin with its end and a fixing bracket permanently mounted on the inner cylindrical wall of the tubular body;

b) a spring adjuster, which is a screw inserted into a corresponding thread in the fixing bracket;

c) a tubular flange for urging the proximal end of the spring;

d) a push pin for pushing the ball toward the string board with a force determined by the spring adjuster;

e) a proximity sensor array for providing electrical signals to the processing unit to produce a visual indication of the current discrete position of the bar,

whenever the player depresses the handle, the tubular body rotates and causes the ball to follow an arcuate path on the surface of the groove in the chord, so that as long as the center of the ball coincides with the center of the groove in the chord, the ball is pushed into the groove to resist rotation at that location.

In one aspect, the two side edge recesses in the chord correspond to two inactive positions so that the player can be placed out of the plucking sequence as long as the bar is beyond the final position in each direction.

Drawings

FIG. 1 illustrates an exemplary modular instrument of an input device in an embodiment of the invention;

FIG. 2 shows the back of an input device including a power receptacle for receiving a cable or cord;

FIG. 3A illustrates an arrangement in which the overall length of the input device is adjustable;

FIG. 3B illustrates an arrangement for adjusting the orientation of an input device by rotating the angle of a horizontal plane;

FIG. 3C shows an arrangement for adjusting the orientation of an input device by tilting;

FIG. 3D shows an arrangement in which the keyboard or joystick unit's disks include an angular rotation mechanism for rotating them clockwise or counterclockwise about their vertical central axis;

FIG. 4A illustrates an embodiment of the present invention in which input units are attached directly to one another to form a unified body;

FIG. 4B illustrates an embodiment of the invention in which the processing unit includes function buttons and sliders;

FIG. 5A illustrates the mechanism of the joystick unit with variable displacement tension of the joystick and its main operation in an embodiment of the present invention;

FIG. 5B shows possible angles that may be obtained;

5C-5E illustrate three different chords that vary in extent and spacing between the boundaries of adjacent grooves;

FIG. 5F shows the orientation of the joystick, placing the joystick at a position near the maximum angle;

FIG. 5G shows a top cross-sectional view of a joystick unit in an embodiment of the present invention;

FIG. 5H shows an alternative reed switch plate to provide an electrical signal corresponding to the position visually indicated by the joystick in relation to the current discrete position of the joystick;

FIG. 5I illustrates a mechanism for controlling an array of reed switches, in an embodiment of the present invention;

FIG. 6 illustrates an embodiment of a set of combinations of activating input keys when plucking, in accordance with an embodiment of the present invention;

FIG. 7 illustrates another embodiment of activating a set of combinations of two pairs of input keys when plucked in accordance with an embodiment of the present invention;

FIG. 8A shows another embodiment of a layout of an input device in which a processing unit is equipped with eight input buttons for settings;

FIG. 8B shows the back side of the layout of FIG. 8A;

FIG. 8C illustrates another embodiment of an ergonomic design of a key;

FIG. 9 illustrates an ergonomically designed arrangement in which the overall length of the input device is adjusted;

FIG. 10 illustrates an ergonomically designed arrangement in which the orientation of the input device is adjusted by rotating an angle in a horizontal plane;

FIG. 11 shows an arrangement for adjusting the orientation of an input device by tilting the unit;

fig. 12 shows an arrangement in which the disk of the key unit and/or the disk of the joystick unit include a rotation mechanism for rotating them clockwise or counterclockwise about their vertical central axes;

FIG. 13 is a schematic diagram of one embodiment of the present invention in which the units are attached directly to each other to form a unified body, while the processing units are remote;

fig. 14 shows an example of eight input buttons for setting;

FIG. 15 shows an arrangement of keys having unique indicia thereon;

FIG. 16 shows an arrangement with LED light indicators for each possible discrete position of the joystick;

FIG. 17 illustrates an arrangement in which the overall length of the input device is adjusted by the mobile unit while still maintaining an electrical connection via a wired or wireless connection; and

FIG. 18 is a block diagram of a processing unit according to an embodiment of the invention.

Detailed Description

The present invention relates to an input device for manipulating a musical instrument. The input device is suitable for players with physical disabilities and dyskinesia. The musical instrument has the musical behavior of a stringed instrument and can adapt to the musical behavior of any musical instrument such as percussion, brass, etc.

The input device of the present invention can be adjusted (manually or automatically) to form a wide range of instruments (2.5 octaves) that can be taught, learned and played by disabled players who cannot play common instruments such as pianos or guitars. Even with physical limitations, the player can use the input device without abandoning the ability to use the instrument for musical expression, and the input device provided by the present invention mimics a standard string input device (such as a guitar, violin, etc.).

In one embodiment of the present invention, as shown in FIG. 1, the input device 100 is a modular instrument comprising three main parts:

a. a keyboard unit 101 including a set of input keys 102 a-10;

b. a processing unit 103; and

c. a joystick unit 104 in which the displacement tension of the joystick 105 is variable.

The fingers of one hand of the player press the input keys 102a-102e of the keyboard unit 101, which imitate a combination of pressed keys of a musical instrument (such as keys of a piano), or a combination of pressed strings, to receive an input. To receive the input, the other hand of the player moves the joystick 105, which simulates playing or depressing a combination of keys of the instrument (such as keys of a piano). The processing unit 103 includes input buttons for setting such as a tone duration, a gentle scale selection, a harmony/melody performance mode, and the like.

The processing unit 103 receives input signals from each input device, processes the received signals, and generates electrical signals reflecting the player's activation attributes (e.g., displacement velocity and degree of force exerted on each key and joystick 105). These signals are transmitted (using wired or wireless transmission) to a tone generation unit 110, such as a synthesizer or a computer or a smartphone/tablet, with appropriate software. The tone generating unit 110 converts the received signal into a composite signal, which is fed to a speaker 111 to generate a sound signal.

Fig. 2 shows the rear side of the input apparatus 100, which includes an electric outlet 201 for receiving a cable or wire, the electric outlet 201 being connected to the tone generating unit 110 to transmit the generated signal. Alternatively, the generated signal may be transmitted to the tone generation unit 110 via a short-range wireless connection. Some sockets/connectors may also connect other external input devices to the brain, such as headswitches, footswitches, large push-button switches, eye tracking sensors, proximity sensors, and the like.

In input device 100, all components are typically attached to each other to form a single body assembly. However, the respective portions may be adapted to be rotatable, and the inclination angles of the respective portions may be changed according to the player's needs, as shown in fig. 3B to 3C below.

In another embodiment, the input device 100 is a modular instrument, and each part can be disconnected from the other parts and still communicate with them through wired or wireless communication means, as shown in fig. 3A and 4B.

Fig. 3A shows an arrangement in which the overall length of input device 100 is adjusted by moving units 101 and 104 away from unit 103 while still maintaining electrical and mechanical connection via movable contact assemblies 30a and 30 b.

Fig. 3B shows an arrangement in which the orientation of input device 100 is adjusted by rotating units 101 and 104 relative to unit 103, while still maintaining electrical and mechanical connection via movable contact assemblies 30c and 30 d. By horizontal rotational adjustment of the angle, the direction of movement of the lever is aligned and the keys are aligned with the hand's pose and movement.

Fig. 3C shows an arrangement in which the orientation of the input device 100 is adjusted by tilting the units 101 and 104 relative to the unit 103, while still maintaining the electrical and mechanical connection via the movable contact assemblies 30e and 30 f.

In one embodiment of the invention, the key unit 101 and/or the disks of the unit 104 include adjustable angular rotation mechanisms for rotating them clockwise or counterclockwise, almost 360 degrees, to provide adjustment for left and right handed players, and as shown in fig. 3D, to best suit player preferences or limitations.

Fig. 4A shows an embodiment of the invention in which units 101 and 104 are attached directly to each other to form a unified body, while processing unit 103 is remote. In this case, data from units 101 and 104 is sent to processing unit 103 via wireless communication (each unit may include a short-range transceiver, e.g., bluetooth, etc.).

Fig. 4B shows an embodiment of the invention in which the processing unit 103 includes on/off buttons, sliding potentiometers 41a-41e, selector menu buttons 44a-44c, a display screen, and other selectable connections 42, such as USB connections, RJ45, RCA, DIN5, etc.

Fig. 5A shows the mechanism and main operation of the lever unit 104 of the lever 105 whose tension is variable with displacement in the embodiment of the present invention. The joystick unit 104 includes a chord 50 having a plurality of spaced apart semi-tubular recesses 51, each forming a different angle, which corresponds to the possible discrete positions of the joystick 105. The joystick 105 includes a replaceable modular handle 52 that rotates a pivot rod 53 (which acts as a lever) about a fixed pivot in response to motion and force applied by the player. The pivot rod 53 includes a stop 54, the stop 54 limiting movement of the pivot rod 53 in the discrete position when aligned with one of the tubular grooves 51. To move to another possible discrete position, the player should increase the applied rotational force until the stopper 54 is pulled out of the present groove and into the next groove (thus switching from one angle to another). In this way, the player can move the joystick 105 between different discrete positions corresponding to different switching angles.

The two side edge notches 510 and 511 correspond to two inactive positions so that the player can be out of the plucking sequence whenever the lever 105 exceeds the last position in each direction.

The force exerted by stop 54 on chord 50 and each groove 51 can be manually adjusted to provide the desired variable tension for movement of joystick 105. The plate is made of plastic and/or resilient rubber material to minimize and attenuate noise generated during ejection.

Fig. 5B shows possible angles that may be obtained. In this example, the maximum range is ± 30 °, and the angular spacing between the boundaries of adjacent grooves is 9.6 °.

Fig. 5C-5E show three different chords 50a-50C, with different extents and spacings of the chords between the boundaries of adjacent recesses. Each chord is mounted by four nuts 55 and is thus reproducible. This function allows one to change the type of string while retaining the same mechanism, and thus potentially provide different tactile feedback.

Fig. 5F shows the orientation of the joystick 105, which is placed at a position near the maximum angle. Beyond this point, the joystick 105 is provided with a free edge, so that the first and last strings can be moved in and out of the neutral position.

Fig. 5G shows a top cross-sectional view of the joystick unit 104 in an embodiment of the present invention. The stopper 54 includes: a tubular body 55, into which tubular body 55 a ball 56 is inserted; a spring 57 which pushes the push pin 58 with the tip; a fixed bracket 59, permanently mounted inside the tubular body 55, is fixed to the inner cylindrical wall thereof. Spring adjuster 60 is a screw that is inserted into a corresponding thread 61 in fixed holder 59 and pushes the proximal end of spring 57 through a tubular flange 62. The push pins 58 apply a force determined by the pushing force 58 to push the balls 56 toward the chord 50. The spring tension adjuster 60 determines the degree of contraction of the spring 57. When the player pushes the handle 52, the tubular body rotates and moves the ball 56 in an arcuate path on the slotted surface of the chord 50. Whenever the line in the center of the ball, fig. 56, coincides with the center of the groove in the chord 50, the ball 56 is pushed into the groove to limit/block rotation in that position. Since the surface of the chord 50 is serrated, the player must increase the force applied to the handle 52 to pull the ball 56 from the current groove and force the ball to continue to move over the serrated surface of the chord 50 until it coincides with the center of the next groove. In this way, the movement of the joystick 105 is divided into several discrete positions that are tactile to the player.

To provide an electrical signal to processing unit 103 and a visual indication of the current discrete position of joystick 105, joystick unit 104 includes an array of proximity sensors, such as reed switches (a switch with two flexible lugs that are actuated by a magnetic field that is sensed by a permanent magnet, the lugs bending to adhere to each other when the magnetic field is sufficiently close to the switch to form a short circuit; the lugs being spaced apart from each other to form an open circuit when the magnetic field is relatively far away from the switch), which are deployed on (replaceable) reed switch plate 63 (as shown in fig. 5H) along an arc 64 that corresponds to the arcuate travel path of stop 54. The switch plate 63 is a position sensor that provides an electrical signal corresponding to the position of the joystick 105. Of course, other position sensors may be used.

Further, the spacing between adjacent reed switches 64 on the reed switch plate 63 corresponds to the angular spacing between the boundaries of adjacent recesses in the chord 50. These reed switches are adapted to generate a signal to the processing unit 103 and turn on the corresponding individual LED each time the ball is pushed into one of the possible discrete positions (i.e. when the ball 56 enters one of the semi-tubular grooves 51).

Figure 5I shows a mechanism for controlling a reed switch array in an embodiment of the present invention. The handle 52 of the operating lever 105 rotates the pivot rod 71, and the pivot rod 71 is located behind the chord 50 and rotates around the above-mentioned fixed pivot in parallel with the pivot rod 53 in accordance with the motion and force applied by the player. The reed switch plate 63 is vertically installed behind the chord 50. The permanent magnet 65 is supported by a magnet holder 66 with a recess 67 into which a rod 68 is inserted. A width adjustment member 69 is threaded onto the rod 68, followed by a spring 70. The cap 72 is inserted into the groove 73 of the pivot rod 71 and is also screwed onto the rod 68. The distance adjustment member 69 and the spring 70 are inserted into a groove 74 in the pivot rod 71, so that the (adjustable) distance adjustment member 69 can adjust the degree of contraction of the spring 70. In this way, the adjustment angle of the magnet 65 with respect to the reed switch plate 63 is α, so that a desired distance between the magnet and the reed switch can be obtained. When the joystick 105 is pushed to one of the possible discrete positions, the magnet 65 and the corresponding reed switch 64 will be completely coincident. Thus, this particular reed switch will generate an electrical signal to the processing unit 103 and turn on the corresponding Light Emitting Diode (LED). When the joystick 105 is pushed to another possible discrete position, the magnet 65 will completely coincide with another corresponding reed switch 64. This reed switch will thus generate another discrete electrical signal to the processing unit 103 and turn on another corresponding LED.

Fig. 6 shows an example of a combination of input keys activated at the time of plucking according to an embodiment of the present invention. In this example, any combination of input keys 102 (which may be of different colors) represents a key of a certain instrument (e.g., a piano), and a plucking effect may be obtained by moving the joystick 105 between six possible discrete positions (1, …, 6).

Fig. 7 shows another example of activating a combination of two pairs of input keys 80a and 80b, thereby making the key area and the pop-up space larger and easier to press, according to an embodiment of the present invention. This combination will provide different chords between the discrete positions 1-6 while playing.

Fig. 8A shows another example of the layout of the input apparatus 100, in which the processing unit 103 has eight input buttons 81a-81h for setting such as the tone duration, the scale selection, and the sound/melody playing mode. When the player presses the input buttons, each of the input buttons is marked with a corresponding symbol to obtain a predetermined effect.

Fig. 8B shows the back side of the layout of fig. 8A. In this embodiment, the HDMI cable is connected to the HDMI receptacle 82 so as to transmit the generated signal to the tone generating unit 110. In this configuration, the MIDI unit is internal and wirelessly transmitted to the tone generation unit 110. HDMI provides a path from additional input switches/devices to the processing unit 103, enabling a wide range of adjustments for the player.

FIG. 8C illustrates another example of an ergonomic design of the keys 102a-102 e.

Fig. 9 shows an ergonomically designed arrangement in which the overall length of the input device 100 is adjusted by removing the units 101 and 104 from the unit 103, while still maintaining the electrical and mechanical connection via the movable contact assemblies 30a and 30 b.

Fig. 10 shows an ergonomically designed arrangement in which the orientation of the input device 100 is adjusted by rotating the units 101 and 104 relative to the unit 103 while still maintaining the electrical and mechanical connection via the movable contact assemblies 30c and 30 d. Angular rotation adjustment is performed in the horizontal plane to align key direction and joystick movement with hand movement.

Fig. 11 shows an arrangement in which the orientation of the input device 100 is adjusted by tilting the units 101 and 104 relative to the unit 103, while still maintaining the electrical and mechanical connection via the movable contact assemblies 30e and 30 f.

In one embodiment of the invention, the disks of the key unit 101 and/or the disks of the unit 104 include adjustable angular rotation mechanisms (in a horizontal plane) for rotating the keys clockwise or counterclockwise about their vertical central axes, thereby enabling almost 360 degree rotation to provide adjustment for left and right-handed players, and optimally to suit player preferences or limitations, as shown in figure 12,

fig. 13 shows an embodiment of the invention in which units 101 and 104 are attached directly to each other to form an integral component, while processing unit 103 is remote. In this case, data from units 101 and 104 is sent to processing unit 103 (each of which may include a short-range transceiver, such as bluetooth) via wired or wireless communication.

Fig. 14 shows an example of eight input buttons 81a-81h for setting. When the player presses the input buttons, each of the input buttons is marked with a corresponding symbol to obtain a predetermined effect. In this example, the notation is:

81 a: harmony (default) -melody

81 b: note mapping 1/on-off

81 c: note mapping 2

81 d: home/reset/switch button

81 e: hold-on (default) -mute

81 f: flatly (reduced Bemol)

81 g: increasing number (Diez)

81 h: seven-tone scale (Septachord)

FIG. 15 illustrates one arrangement with a unique mark on each key, which in a specific embodiment may be a colored symbol and tactile elements.

Figure 16 shows an arrangement in which an LED indicator light is fitted for each possible discrete position of the joystick 105.

FIG. 17 shows an arrangement in which individual units of input device 100 may be adjusted by removing units 101 and 104 from unit 103, while still maintaining an electrical connection via a wired or wireless connection.

Fig. 18 is a block diagram of the processing unit 103. The processing unit 103 comprises an input, an output and a set of four analog-to-digital converters 180, said four analog-to-digital converters 180 receiving the analog signals from the input and converting them into a digital format required for the processing. The processing unit 103 further comprises a processor comprising: a chord selection module 181 (for running a chord selection algorithm); and a force calculation module 182 (for running an algorithm that calculates the force exerted by the player); a chord/note selection module 183 (for running a chord/note selection algorithm); a note module 184 selected by the user (for selecting a note option); a user-selected tone module 185 (for defining tone attributes); a note mapping module 186 (for determining the chord and magnitude (magnitude) desired by the player), a Musical Instrument Digital Interface (MIDI-a technical standard representing a communication protocol, Digital Interface and electrical connector for connecting various electronic Musical instruments, computers and related audio equipment to play, edit and record music), a data composing module 187 (for converting the data generated by the note mapping module 186 into a MIDI protocol and transmitting the data to the tone generating unit 110), and a string LED indicator 188 for providing a visual indication (light) about the current position of the joystick 105.

The string selection module 181 receives an input regarding the simulated playing operation by reading the position of the stick 105 and the force applied to the stick 105 to each position. This module detects the strings played by the player and sends the relevant data to the note mapping module 186 and string LED indicators 188 to turn on the appropriate LEDs (showing the current stem position).

The force calculation module 182 receives data from the force sensors connected to the keys 102a-102e and the joystick 105, calculates the force applied by the player, and forwards data relating to the applied force to the data composition module 187.

The chord/note selection module 183 receives data on the depressed keys and the position of the plucked lever from all inputs, including external input switches (typically used by players with severely limited motion using their heads or legs), processes the received data and determines which chord has been selected by the player. Data regarding the selection is also forwarded to the note mapping module 186. For a disabled player who cannot use all the keys or joysticks 105, external input may be required. In this case, an external input may be used. For example, if the player uses a wheelchair (for controlling the wheelchair) having inherent operation buttons and a joystick, the same inherent operation buttons and joystick may be used in place of the keyboard unit 101 or the joystick unit 104 to provide the input.

The user selected notes module 184 receives the selected pitch and note attributes from the configuration buttons 81a-81h and forwards them to the note mapping module 186, which the note mapping module 186 processes together all the received data to decide when which notes should be played and what magnitude should be used. Then, the data is forwarded to the MIDI data synthesis module 187, which converts it into a MIDI protocol and transmits the data to the tone generation unit 110. The string LED indicator 188 receives data from the joystick 105 regarding string selection and turns on the corresponding light 188 in the LED indicator. In this way, the processing unit 103 generates characteristic signals suitable for the individual rendition style of each player.

In one embodiment of the invention, each key (102 a.,. 102e) is attached to a switch and a force sensor in such a way that it is able to sense not only the pressure of the player on the key, but also the exact location of the pressure on the key. This function can give the player a greater musical expression by making the sound very soft. For example, this function may be equivalent to vibrating strings of a violin. The disks of the keys 101 are easily removable and replaceable in several configurations to accommodate the individual needs of different players.

The height of each key can be adjusted vertically to accommodate a variety of different finger lengths and positions. Vertical adjustment can be achieved by adding or removing modular spacers to each key.

Operation of the processing unit 103

In one embodiment of the invention, the processing unit 103 automatically detects the skill level of the player and adjusts the musical complexity of the instrument accordingly (e.g., from beginner level to high level). It is necessary to set this function because there are many attributes that can distinguish the performance of a novice player from a professional musician (e.g., a teacher).

According to one embodiment of the invention, the various attributes are monitored in real-time at a rate of 10,000 times per second (10KHz), and the collected data is then analyzed and processed (e.g., by a computer or external processor) and the behavior of the input device is adjusted accordingly.

The monitored attributes may include one or more of:

- (performance in rhythm at constant tempo, i.e. at the speed or tempo of a given piece of music) -performance in "time" ("in time")

Incoordination between two parties

Constant control speed

Continuous "on-the-fly" performance at various tempos

The processing unit 103 may be adapted to automatically detect the physical reach of the player in order to adjust the mapping of the tones and activate the corresponding ranges of the keys and the plucking lever. All movable controls of the input device 100, such as poke bars, buttons, sliders, knobs and buttons, are equipped with electronic motion sensors for measuring their precise position. The input device 100 is first factory calibrated to a maximum range. When the player begins to play the input device, the motion sensors and appropriate software modules will measure the maximum physical activation range of each controller and then adjust the range of the key and plunging lever tone maps accordingly.

The processing unit 103 may also be adapted to automatically detect the range of strength of the player's body (referred to as "sensitivity") and adjust the sensitivity ranges of the keys and other buttons accordingly so that each player can realize the maximum range of musical expression based on his or her own abilities.

The processing unit 103 may be further configured to:

1. detecting and filtering involuntary movements

2. Muting anharmonic tones (e.g., via simulated guitar muting techniques)

3. Predicting speed to minimize delay

In one embodiment of the present invention, all depressible controls of the input device, such as the keys and the flip lever handle, are covered by and connected to an electronic force sensor (Touch), thereby enabling uninterrupted measurement of the force exerted by the player. The input device 100 is initially calibrated at the factory to obtain the maximum force range. When the player starts to play the input device, the electronic device and software measure the range sensitivity of the applied force and set the playing speed range of the keys and the plucking lever accordingly.

The input apparatus 100 scans all keys and controllers at a rate of 10Kz, thereby sampling the player's performance. The result of the scan is a profile of the skill level of the player and the attributes of the song (tempo, dynamics, harmony).

Any performance triggers or keystrokes outside the acceptable range of pitch and force variations within the song profile and player skill range are rejected and filtered out.

The processing unit 103 may also be adapted to automatically mute the inharmonious tones (since the player may not have the physical ability to perform the task), and to apply the software code to simulate the muting of the inharmonious tones when different chords are played in sequence.

The processing unit 103 may also be adapted to automatically perform a speed prediction to minimize delay. Predictive software code is used to narrow the "gaps" of the physical delay attribute. For example, the time from touching the button plane to the point where the button moves to its mechanical stop takes approximately 10 milliseconds to press a key. Covering the keys with embedded electronic force sensors makes it possible to measure the force of finger tissue on the keys (pressing, squeezing) even before the keys actually move. Analyzing and processing these initial measurements enables us to "predict the future" and trigger the sound playback at the player's intended speed without significant delay (4-5 milliseconds) after the system has completed all necessary data processing.

Since the key will start to physically move after about 10 milliseconds, there is 5 milliseconds to play/sound the tone to prevent detection of a delay. Input device 100 provides a 10ms pre-press measurement period to predict how hard a key will be pressed after moving to a physical stop.

This 10 millisecond "advance" enables the player to perform auxiliary functions without a delay in human perception, thereby providing a realistic playing experience.

Operation of the tension variable lever unit 104

The following description will take the guitar as an example. However, when the instrument is connected to the input device, the instrument may emulate any other instrument, such as a percussion instrument, brass instrument, etc.

The tension variable lever 105 is a special lever whose movement is discontinuous. The joystick 105 is movable in three axes and is switchable between six states (or 8 states, including inactive positions), each of which simulates a string, allowing the player to perceive the musical behavior of a real instrument. The joystick 105 can also be switched between four states by simply disabling both states, and thus simulate a stringed musical instrument with only four strings.

The motion tension of the joystick is adjusted to be suitable for players with different motion forces, and the joystick can be used by players with soft motion force to players with very strong motion force. This function is very significant because sometimes disabled players can use only a part of their body, and thus lack the sensitivity necessary to play music using conventional musical instruments. For example: a player who can only move the legs will have a very strong ability to move the joystick by using the legs.

The input device 100 is ergonomic and can accommodate the range of personal motor-cognitive abilities of the player. The input device enables a handicapped player (or any other player) to experience and enjoy music and to learn music like an ordinary player.

The input device 100 of the present invention has the following advantages:

1. various sounds can be produced using a small range of motion: the input device 100 can move the playing part by 60 ° at minimum and can play and memorize various sounds by pressing only 5 keys.

2. The input device 100 can accommodate a variety of body parts. The player may control only one hand and head, or one leg and head, one hand and one leg, and the like. The input device 100 may also communicate with external accessories and existing interfaces so that any player capable of both actions may play music.

3. The input device is suitable for various dyskinesias. By adjusting the force required for the operation lever 105 and adjusting the height of the keys or changing the surface area of the keys, the input device can be adapted to each player and the player-specific disability condition. The input device 103 can also be adapted to different requirements of the player by changing its size and holding different parts, etc.

4. The input device 100 may be adapted to accommodate different ages of use and various cognitive abilities. The musical content may be modified according to software, the mechanical principles of the input device, and the number of elements required for performance.

5. The input device 100 enables a user to develop "muscle memory". The poke bar 105 has a "tactile feel".

6. The input device 100 is capable of playing both monophonic music and polyphonic music.

The input device 100 can be operated in several usage modes suitable for different types of players with different disabilities.

Presetting: guitar and harmony full mode

The preset "full" mode is suitable for players who are not mobile but have no impaired cognitive ability. In this mode, two fingers or three body parts need to be operated simultaneously by the external accessory.

The pitch range in the preset "full" mode is from low-octave Mi to high-octave La (two half-octaves-Do Re Me Fa sol..) where each key or key combination changes the position of the pitch to a setting of chord pitch equal to the position of the guitar's chords in the "on" mode and the principle of sound transmission and type of play is the same as for a guitar.

Harmony chart: each pressing force simultaneously changes the arrangement of the keys and plucking rods in six different plucking rod modes, similar to the strings of a guitar and fretted fingerboard.

Presetting: guitar and Sound (harmony) mode

The preset harmonic patterns are suitable for players with limited motor ability and impaired cognitive ability, or players who operate the input devices using the head or legs, or very young players (5-8 years old). In this mode, the input device is reduced to three keys and the plucking lever is reduced to four states, thereby increasing the surface area of the keys and reducing the plucking action.

In this preset mode, the tones range from low "Mi" to high "Sol" (two and a half octaves), where each key or combination of keys changes the tone arrangement to be one position of the chord. In the "on" mode and the four-string mode, the tone arrangement is equal to the position of the guitar's chords, the principle of sound transmission and the type of playing being the same as for the guitar. However, in this mode, the software is used to fill a larger space of music tracks and strives to make it easier for the player to play music.

Presetting: melody semitone mode (melody chromatic mode)

The preset melodic chromatic scale pattern is suitable for players with restricted motor abilities, whose cognitive abilities are not restricted or impaired. In this mode, they need to operate two fingers or three body parts simultaneously with the aid of some auxiliary means. This pattern can play solo and melody line similar to a guitar, and the arrangement and visual shape of the tones is the same as the respective position of the guitar.

As in a guitar, the pitch spacing between the keys is a semitone, and each state in the pluck lever represents a string of the guitar. In each state, five tones can be generated at intervals of 2.5 tones.

This mode allows playing different scales, similar in location to that of the classical musical and visual methods of guitar.

Presetting: melody (melody) mode

The preset melody pattern is suitable for players with limited mobility and impaired cognitive ability, or players who use head or leg manipulation input devices, or very young players (5-8 years old). In this mode, the input device is reduced to three keys and the plucking lever is reduced to four states, thereby increasing the surface area of the keys and reducing the plucking action. This mode can play solo and melody lines similar to a guitar.

Under the control of the player (switches in the processing unit of the input device), the tone arrangement in this mode will be in a changing state and include a pentatonic, a blue key, a major key and a minor key, up to two octaves.

This mode allows playing different scales, similar in location to that of the classical musical and visual methods of guitar.

Presetting: bass mode

This mode is generally suitable for disabled players, allowing players to choose between a wide variety of stringed instruments and their different characteristics.

Just like a bass guitar, the pitch distance between the keys is half-toned, and each state in the pluck lever represents a guitar string. In each state, five sounds can be produced at a distance of 2.5 tones.

This mode allows for the playing of different scales in a similar location as in the music and visual method of a bass guitar.

In addition, there are two other modes: a preset ukulele mode and a preset string mode.

Of course, the foregoing examples and description are by way of illustration only and are not intended to limit the present invention in any way. It will be appreciated by those of ordinary skill in the art that the invention may be practiced in a variety of ways, including more than one of the ways described above, without departing from the scope of the invention.