阅读说明：本技术 时空触觉刺激系统和方法 (Spatiotemporal haptic stimulation systems and methods ) 是由 刘菲 徐俊 黄韬 于 2019-04-30 设计创作，主要内容包括：本发明涉及触觉刺激技术。一种触觉界面设备包括阵列,所述阵列包括用于生成刺激图案的触觉刺激元素。所述触觉界面设备包括控制器,用于在用户的皮肤上连续传播刺激图案,包括重复消除所述刺激图案的第一端的一部分,并在所述刺激图案的第二端用新的部分替换所述消除的部分。(The present invention relates to tactile stimulation techniques. A tactile interface device includes an array including tactile stimulation elements for generating a stimulation pattern. The haptic interface device includes a controller for continuously propagating a stimulation pattern on a user's skin, including repeatedly eliminating a portion of a first end of the stimulation pattern and replacing the eliminated portion with a new portion at a second end of the stimulation pattern.)

1. A haptic interface device, comprising:

an array comprising tactile stimulation elements for generating a stimulation pattern;

a controller for continuously propagating a stimulation pattern on a user's skin, including repeatedly eliminating a portion of a first end of the stimulation pattern and replacing the eliminated portion with a new portion at a second end of the stimulation pattern.

2. A haptic interface device as recited in claim 1 wherein said controller is configured to broadcast said stimulation pattern on the skin of said user at a constant rate.

3. A haptic interface device as recited in claim 2 wherein said array includes rows and columns of said haptic stimulation elements, said controller to propagate said stimulation pattern for each row at the same rate.

4. A haptic interface device as recited in claim 2 wherein said array includes rows and columns of said haptic stimulation elements, said controller to propagate said stimulation pattern for different rows at different rates.

5. A haptic interface device as recited in any one of claims 1-4 wherein said controller is configured to present two partial information elements simultaneously in said stimulation pattern.

6. A haptic interface device as recited in any one of claims 1-5 wherein said controller is configured to present a portion of a first character and a portion of a second character simultaneously in said stimulus pattern.

7. A haptic interface device as recited in any one of claims 1-6 wherein said controller is configured to present a portion of a first word and a portion of a second word simultaneously in said stimulation pattern.

8. A haptic interface device as recited in any one of claims 1-7 wherein said controller is configured to move said array across the skin of said user so as to propagate said stimulation pattern across the skin of said user.

9. A haptic interface device as recited in any one of claims 1-8 wherein said array comprising haptic stimulation elements comprises a haptic stimulator ring, wherein said controller is to rotate said array on the user's skin so as to propagate said stimulation pattern on the user's skin.

10. A haptic interface device as recited in any one of claims 1-9 wherein said array comprising haptic stimulation elements comprises a haptic stimulation element line, wherein said controller is to move said haptic stimulation element line across the user's skin to propagate said stimulation pattern across the user's skin.

11. A haptic interface device as recited in any one of claims 1-10 wherein said controller is configured to modify said stimulation pattern over time based on a long-short term memory model.

12. A haptic interface device as recited in any one of claims 1-11 wherein said controller is configured to attenuate portions of said stimulation pattern over time.

13. A haptic interface device as recited in any one of claims 1-12 wherein said controller is to represent a three-dimensional object in said array comprising haptic stimulus elements.

14. A haptic interface device as recited in any one of claims 1-12 wherein said controller is configured to spatially represent a first dimension and a second dimension of three-dimensional objects in said array and to temporally represent a third dimension of three-dimensional objects in said array.

15. A haptic interface device as recited in claim 14 wherein said controller is configured to control a rate at which said stimulation pattern propagates in different regions of said array so as to represent a third dimension of said three-dimensional object in time.

16. A haptic interface device as recited in any one of claims 1-15 wherein said controller is to represent a velocity of an object in said array comprising haptic stimulation elements by a rate of propagation of said stimulation pattern.

17. A method of providing a tactile stimulation interface, the method comprising:

generating a stimulation pattern having an array comprising tactile stimulation elements;

continuously propagating the stimulation pattern over the user's skin, including repeatedly eliminating a portion of a first end of the stimulation pattern and replacing the eliminated portion with a new portion at a second end of the stimulation pattern.

18. The method of claim 17, wherein the continuously propagating the stimulation pattern comprises:

the stimulation pattern is propagated on the user's skin at a constant rate.

19. The method of claim 17, wherein the continuously propagating the stimulation pattern comprises:

propagating the stimulation pattern at the same rate for each row in the array.

20. The method of claim 17, wherein the continuously propagating the stimulation pattern comprises:

propagating the stimulation pattern at different rates for different rows in the array.

21. The method according to any one of claims 16 to 20, wherein said continuously propagating the stimulation pattern comprises:

two partial information elements are presented simultaneously in the stimulus pattern.

22. The method according to any one of claims 16 to 21, wherein said continuously propagating the stimulation pattern comprises:

a portion of the first character and a portion of the second character are presented simultaneously in the stimulus pattern.

23. The method according to any one of claims 16 to 22, wherein said continuously propagating the stimulation pattern comprises:

a portion of the first word and a portion of the second word are presented simultaneously in the stimulus pattern.

24. The method of any one of claims 16 to 23, further comprising:

moving the array comprising tactile stimulation elements over the user's skin so as to propagate the stimulation pattern over the user's skin.

25. The method of any one of claims 16 to 23, further comprising:

rotating the array comprising tactile stimulation elements on the user's skin so as to propagate the stimulation pattern on the user's skin.

26. The method of any one of claims 16 to 25, further comprising: the stimulation pattern is modified over time based on a long-short term memory model.

27. The method of any one of claims 16 to 26, further comprising:

attenuating portions of the stimulation pattern over time.

28. The method according to any one of claims 16 to 27, wherein said continuously propagating the stimulation pattern comprises:

representing a three-dimensional object in the stimulation pattern.

29. The method according to any one of claims 16 to 27, wherein said continuously propagating the stimulation pattern comprises:

spatially representing a first dimension and a second dimension of three-dimensional objects in the array;

a third dimension representing three-dimensional objects in the array in time.

30. The method of claim 29, further comprising:

controlling the rate at which the stimulation pattern propagates in different regions of the array so as to represent a third dimension of the three-dimensional object in time.

31. The method according to any one of claims 16 to 30, wherein said continuously propagating the stimulation pattern comprises:

representing a velocity of an object in the array comprising tactile stimulation elements by a rate of propagation of the stimulation pattern.

32. A tactile stimulation apparatus, comprising:

a tactile stimulation interface comprising an array of tactile pixels for stimulating receptors in the skin of a user by a stimulation pattern;

a receiver for receiving information to be presented in the tactile stimulation interface;

a processor for continuously propagating the stimulation pattern on the user's skin for presenting the information, including eliminating a portion of a first end of the stimulation pattern and replacing the eliminated portion with a new portion at a second end of the stimulation pattern.

33. A tactile stimulation apparatus according to claim 32, wherein the processor is configured to broadcast the stimulation pattern on the user's skin at a constant rate.

34. A tactile stimulation apparatus according to claim 33, wherein the array comprises rows and columns of the tactile pixels, the processor being configured to propagate the stimulation pattern for each row at the same rate.

35. A tactile stimulation apparatus according to claim 33, wherein the array comprises rows and columns of the tactile pixels, the processor being configured to propagate the stimulation pattern for different rows at different rates.

36. A tactile stimulation apparatus according to any of the claims 30 to 35, wherein the processor is configured to present two partial information elements simultaneously in the stimulation pattern.

37. A tactile stimulation apparatus according to any of the claims 30 to 36, wherein the processor is configured to present a part of a first character and a part of a second character simultaneously in the stimulation pattern.

38. A tactile stimulation apparatus according to any of the claims 30 to 37, wherein the processor is configured to present a part of a first word and a part of a second word simultaneously in the stimulation pattern.

39. A tactile stimulation apparatus according to any of the claims 30 to 38, wherein the processor is configured to move the array of tactile pixels over the user's skin so as to continuously propagate the stimulation pattern over the user's skin.

40. A tactile stimulation apparatus according to any of the claims 30 to 39, characterized in that the tactile pixel array comprises a tactile pixel ring, wherein the processor is configured to rotate the tactile pixel ring on the user's skin so as to continuously propagate the stimulation pattern on the user's skin.

41. A tactile stimulation apparatus according to any of the claims 30 to 40, wherein the tactile pixel array comprises tactile pixel lines, wherein the processor is configured to move the tactile pixel lines over the user's skin so as to continuously propagate the stimulation pattern over the user's skin.

42. A tactile stimulation apparatus according to any of the claims 30 to 41, wherein the processor is configured to modify the stimulation pattern over time based on a long and short term memory model.

43. A tactile stimulation apparatus according to any of the claims 30 to 42, wherein the processor is configured to attenuate portions of the stimulation pattern over time.

44. A tactile stimulation apparatus according to any of claims 30 to 43, wherein the processor is configured to represent a three-dimensional object in the tactile pixel array.

45. A tactile stimulation apparatus according to any of the claims 30-44, wherein the processor is configured to spatially represent a first dimension and a second dimension of three-dimensional objects in the array and to temporally represent a third dimension of three-dimensional objects in the array.

46. A tactile stimulation apparatus according to claim 45, wherein the processor is configured to control the rate at which the stimulation pattern propagates in different regions of the array so as to temporally represent a third dimension of the three-dimensional object.

47. A tactile stimulation apparatus according to any of the claims 30 to 46, wherein the processor is configured to represent the velocity of an object in the tactile pixel array by the rate of propagation of the stimulation pattern.

Technical Field

The present invention relates generally to tactile stimulation techniques.

Background

One type of tactile stimulation, which may be referred to as tactile stimulation, stimulates receptors in human skin. Human skin has many different types of receptors that are adapted to different tactile sensations. Meissner corpuscles (Meissner corpuscle) in the skin are used to sense low frequency vibrations. Meikel cells (Merkel cells) in the skin are used to sense pressure. A Judge in the skin (Ruffini ending) is used to sense shear deformation. Pacinian corpuscles (Pacinian corpuscle) in the skin are used to sense high frequency vibrations.

Disclosure of Invention

According to an aspect of the present invention, there is provided a tactile stimulation apparatus comprising a tactile interface apparatus. The haptic interface device includes an array including haptic stimulation elements for generating a stimulation pattern. The haptic interface device includes a controller for continuously propagating a stimulation pattern on a user's skin, including repeatedly eliminating a portion of a first end of the stimulation pattern and replacing the eliminated portion with a new portion at a second end of the stimulation pattern. Continuously propagating the stimulation pattern on the user's skin may increase the rate at which the user acquires information presented on the haptic interface device.

Optionally, in any aspect above, the controller is configured to broadcast the stimulation pattern on the user's skin at a constant rate.

Optionally, in any aspect above, the array comprises rows and columns of the tactile stimulation elements. The controller is for propagating the stimulation pattern for each row at the same rate.

Optionally, in any aspect above, the array comprises rows and columns of the tactile stimulation elements. The controller is configured to propagate the stimulation pattern for different rows at different rates.

Optionally, in any one of the above aspects, the controller is configured to present two partial information elements simultaneously in the stimulation pattern.

Optionally, in any one of the above aspects, the controller is to present a portion of the first character and a portion of the second character simultaneously in the stimulus pattern.

Optionally, in any one of the above aspects, the controller is to present a portion of the first word and a portion of the second word simultaneously in the stimulation pattern.

Optionally, in any one of the above aspects, the controller is to move the array comprising tactile stimulation elements over the user's skin so as to propagate the stimulation pattern over the user's skin.

Optionally, in any aspect above, the array comprising tactile stimulation elements comprises tactile stimulator rings. The controller is to rotate the array comprising tactile stimulation elements on the user's skin to propagate the stimulation pattern on the user's skin.

Optionally, in any aspect above, the array comprising tactile stimulation elements comprises lines of tactile stimulation elements. The controller is to move the straight line of tactile stimulation elements over the user's skin to propagate the stimulation pattern over the user's skin.

Optionally, in any aspect above, the controller is configured to modify the stimulation pattern over time based on a long-short term memory model.

Optionally, in any aspect above, the controller is to decay portions of the stimulation pattern over time.

Optionally, in any aspect above, the controller is to represent a three-dimensional object in the array comprising tactile stimulation elements.

Optionally, in any one of the above aspects, the controller is configured to spatially represent a first dimension and a second dimension of the three-dimensional objects in the array, and to temporally represent a third dimension of the three-dimensional objects in the array.

Optionally, in any of the above aspects, the controller is configured to control the rate at which the stimulation pattern propagates in different regions of the array so as to represent a third dimension of the three-dimensional object in time.

Optionally, in any aspect above, the controller is to represent a velocity of an object in the array comprising tactile stimulation elements by a rate of propagation of the stimulation pattern.

According to another aspect of the invention, a method of providing a tactile stimulation interface is provided. The method comprises the following steps: generating a stimulation pattern having an array comprising tactile stimulation elements, the stimulation pattern comprising a first end and a second end. The method further comprises the following steps: continuously propagating the stimulation pattern over the user's skin, including repeatedly eliminating a portion of a first end of the stimulation pattern and replacing the eliminated portion with a new portion at a second end of the stimulation pattern.

According to yet another aspect of the invention, there is provided a tactile stimulation apparatus comprising a tactile stimulation interface comprising an array of tactile pixels for stimulating receptors in the skin of a user by a stimulation pattern. The stimulation pattern includes a first end and a second end. The tactile stimulation apparatus comprises a receiver for receiving information to be presented in the tactile stimulation interface. The tactile stimulation apparatus comprises a processor for continuously propagating the stimulation pattern on the skin of the user for presenting the information, including eliminating a portion of a first end of the stimulation pattern and replacing the eliminated portion with a new portion at a second end of the stimulation pattern.

This summary is provided to introduce a selection of concepts in a simplified form that are further described below in the detailed description. This summary is not intended to identify key features or essential features of the claimed subject matter, nor is it intended to be used as an aid in determining the scope of the claimed subject matter. The claimed subject matter is not limited to implementations that solve any or all disadvantages noted in the background.

Drawings

Various aspects of the present invention are illustrated by way of example and not by way of limitation in the figures of the accompanying drawings in which like references indicate similar elements.

FIG. 1 illustrates a wireless network for data communication;

FIG. 2 illustrates one embodiment of a tactile stimulation system;

FIG. 3 illustrates an exemplary base station;

FIG. 4 illustrates one embodiment of a tactile stimulation apparatus;

FIG. 5 illustrates an embodiment of presenting information in a presentation mode called "alphabetical notation" on a tactile stimulation interface;

FIG. 6 illustrates an embodiment of presenting information in a presentation mode called "symbolic representation of words" on a tactile stimulation interface;

fig. 7A-7C show a tactile stimulation interface at three points in time to illustrate an embodiment of a propagating stimulation pattern;

8A-8C illustrate an embodiment of a tactile stimulation interface having eight tactile stimulation elements (or tactile pixels);

FIG. 9 is a flow diagram of an embodiment of a process of providing a tactile stimulation interface;

FIG. 10 is a flow chart of an embodiment of a process of continuously propagating a stimulation pattern;

11A-11C show a tactile stimulation interface at three points in time to illustrate an embodiment of a propagating stimulation pattern;

FIG. 12 is a flow chart of an embodiment of a process of continuously propagating a stimulation pattern;

FIG. 13 illustrates another embodiment of a process of continuously propagating a stimulation pattern;

14A-14F show an embodiment of a tactile stimulation interface at six time points to illustrate an embodiment of a propagating stimulation pattern;

FIG. 15 is a flow chart of an embodiment of a process of continuously propagating a stimulation pattern;

16A-16E illustrate one embodiment of displaying messages in a tactile stimulation interface;

FIG. 17 is a flow diagram of one embodiment of a process for data attenuation in a stimulation pattern;

FIG. 18 illustrates one embodiment of how a three-dimensional object is represented;

FIG. 19 is a flow diagram of one embodiment of a process for representing a three-dimensional object in a tactile stimulation interface;

FIG. 20 is a flow diagram of one embodiment of a process for representing a third dimension of objects in an array over time.

Detailed Description

The present invention will now be described with reference to the accompanying drawings, which generally relate to tactile stimulation systems and methods. One technical challenge in providing a tactile stimulation system and method is that the stimulation patterns that are typically generated can only present a very limited amount of information at a time. This is due, in part, to the relatively small number of tactile stimulation elements that the tactile stimulation apparatus has. Each tactile stimulus element may be referred to as a "tactile pixel" (or pixel). A limited number of tactile pixels are in contrast to interfaces such as electronic visual displays, which may include a large number of visual display elements (e.g., pixels). Thus, electronic visual displays may be used to present a large number of words or complex images simultaneously. Instead, the tactile stimulation device may display one character (e.g., a letter of the alphabet) at the same time, or may display several characters at the same time. Thus, the user takes longer to obtain information presented on the tactile stimulation device than information presented on the electronic visual display. The techniques disclosed herein increase the rate at which a user acquires information presented on a tactile stimulation device. Not only saves the time of the user, but also reduces the power consumption. If the tactile stimulation device is battery powered, the techniques disclosed herein may extend battery life. Thus, the tactile stimulation apparatus can operate more efficiently regardless of which power is used.

In some embodiments, the tactile stimulation device has an array comprising tactile stimulation elements for generating the stimulation pattern. In some embodiments, the tactile interface device has a controller for continuously propagating the stimulation pattern on the skin of the user. The term "continuous" as used herein means uninterrupted or repeated at fixed intervals. The phrase "continuously propagating a stimulus pattern" as used herein refers to repeatedly propagating a stimulus pattern without interruption or at fixed intervals. The continuous propagation of the stimulus pattern over the user's skin may speed up the rate at which the user acquires information. For example, a user can read braille or alphabetic characters faster due to the continuous transmission of stimulation patterns. In some embodiments, rather than displaying one character at a time, the controller propagates (or scrolls) the characters such that when a portion of one character leaves the stimulus pattern, a new character enters the stimulus pattern. Thus, the stimulus pattern may simultaneously include portions of two different characters. The "partial information" itself may be difficult to understand. However, when the second character begins to be presented, the user has already acquired the first character. The user can remember the first character even if it is only partially displayed (or not displayed at all). In addition, the user can predict the next character. Thus, the user can start to determine what the next character is, even if there is only partial information of the next character. The speed at which the user can recognize the next character is increased, which increases the overall speed of obtaining information.

In some embodiments, the controller uses spatial and temporal variations to convey information in the stimulation pattern as the controller propagates the stimulation pattern. In one embodiment, the controller describes a three-dimensional (3D) object in the stimulation pattern. For example, the array comprising tactile stimulation elements may be a two-dimensional array of a first dimension and a second dimension for rendering a 3D object. In one embodiment, a third dimension of the 3D object is described using temporal variation. For example, the rate at which the controller propagates different regions of the stimulation pattern may be used to deliver the third dimension.

It should be understood that embodiments of the invention may be embodied in many different forms and that the scope of the claims should not be construed as limited to the embodiments set forth herein. Rather, these embodiments are provided so that this disclosure will be thorough and complete, and will fully convey the concept of the embodiments of the invention to those skilled in the art. Indeed, the invention is intended to cover alternatives, modifications and equivalents of these embodiments, which may be included within the spirit and scope of the invention as defined by the appended claims. Furthermore, in the following detailed description of embodiments of the invention, numerous specific details are set forth in order to provide a thorough understanding. It will be apparent, however, to one skilled in the art that the present embodiments of the invention may be practiced without these specific details.

Fig. 1 illustrates a wireless network for data communication. The communication system 100 includes a user equipment 110A, a user equipment 110B, a user equipment 110C, a Radio Access Network (RAN) 120A, RAN 120B, a core network 130, a Public Switched Telephone Network (PSTN) 140, the internet 150, and other networks 160, and the like. Other or alternative networks include private and public data packet networks, including corporate intranets. Although fig. 1 shows a certain number of these components or elements, any number of these components or elements may be included in system 100.

In one embodiment, the wireless network may be a fifth generation (5G) network, the 5G network including at least one 5G base station. The 5G base station communicates with the communication device using Orthogonal Frequency Division Multiplexing (OFDM) and/or non-OFDM and a Transmission Time Interval (TTI) of less than 1 millisecond (e.g., 100 microseconds or 200 microseconds). In general, a base station may also refer to any one of an eNB and a 5G BS (gNB). The wireless network can further include a network server for processing information received from the communication device via at least one eNB or gNB.

Communication system 100 enables multiple wireless users to transmit and receive data and other content. Communication system 100 may perform one or more channel access methods including, but not limited to, Code Division Multiple Access (CDMA), Time Division Multiple Access (TDMA), Frequency Division Multiple Access (FDMA), Orthogonal FDMA (OFDMA), or single-carrier FDMA (SC-FDMA).

User Equipment (UE) 110A, UE 110B and UE 110C may each be referred to as a UE 110 or collectively as a plurality of UEs 110 for operation and/or communication in system 100. For example, UE 110 may be used to transmit and/or receive wireless signals or wired signals. Each UE 110 represents any suitable end user equipment and may include the following (or may be referred to as): user Equipment (UE), a wireless transmit/receive unit, a mobile station, a fixed or mobile subscriber unit, a pager, a cellular telephone, a Personal Digital Assistant (PDA), a smartphone, a laptop, a computer, a touchpad, a wireless sensor, a wearable device, or a consumer electronic device, among others.

In an embodiment, the RAN 120A and the RAN 120B include one or more Base Stations (BSs) 170A and 170B, respectively. The RAN 120A and the RAN 120B may each be referred to as one RAN 120 or collectively as a plurality of RANs 120. Similarly, the Base Station (BS) 170A and the BS 170B may be referred to as one Base Station (BS) 170 or collectively as a plurality of Base Stations (BS) 170, respectively. Each BS 170 is configured to wirelessly connect with one or more UEs 110 of the plurality of UEs 110, respectively, to enable access to core network 130, PSTN 140, internet 150, and/or other networks 160. For example, the plurality of Base Stations (BSs) 170 may include one or more of several well-known devices, such as a Base Transceiver Station (BTS), a node b (NodeB), an evolved node b (eNB), a next generation (fifth generation) (fine generation, 5G) NodeB (gnb), a Home node b (Home NodeB/Home eNodeB), a site controller, an Access Point (AP), or a wireless router, or a server, a router, a switch, or other processing entity having a wired network or a wireless network.

In one embodiment, the BS 170A is part of the RAN 120A, and the RAN 120A may include one or more other BSs 170, one or more elements, and/or one or more devices. Similarly, the BS 170B is part of the RAN 120B, and the RAN 120B may include one or more other BSs 170, one or more elements, and/or one or more devices. Each BS 170 operates separately to transmit and/or receive wireless signals within a particular geographic area (sometimes referred to as a "cell"). In some embodiments, multiple-input multiple-output (MIMO) technology may be employed such that each cell has multiple transceivers.

BS 170 communicates with one or more UEs 110 of the plurality of UEs 110 over one or more air gaps (not shown) using a wireless communication link. These air ports may employ any suitable wireless access technology.

The system 100 may use multi-channel access functionality including, for example, multiple schemes for implementing Long Term Evolution wireless communication standards (LTE), LTE (LTE-Advanced, LTE-a), and/or LTE Multimedia Broadcast Multicast Service (MBMS) by the BS 170 and the UE 110. In other embodiments, the base station 170, user equipment 110A to user equipment 110C are used to implement UMTS, HSPA or HSPA + standards and protocols. Of course, other multiple access schemes and wireless protocols may be used.

RAN 120 communicates with core network 130 to provide Voice, data, applications, Voice over IP (VoIP), or other services to UE 110. It is to be appreciated that the RAN 120 and/or the core network 130 can be in direct or indirect communication with one or more other RANs (not shown). Core network 130 may also serve as a gateway access for other networks, such as PSTN 140, internet 150, and other networks 160. Additionally, some or all of the plurality of UEs 110 may be capable of communicating with different wireless networks over different wireless links using different wireless technologies and/or protocols.

The plurality of RANs 120 may also include millimeter wave and/or microwave Access Points (APs). These APs may be part of multiple BSs 170 or may be remote from multiple BSs 170. These APs may include, but are not limited to, a connection point (mmwave CP) or BS 170 (e.g., mmwave base station) capable of mmwave communication. The millimeter wave AP may transmit and receive signals in the frequency range of 24GHz to 100GHz, etc., but is not required to operate in this entire range. The term "base station" as used herein refers to a base station and/or a wireless access point.

Although fig. 1 shows one example of a communication system, various changes may be made to fig. 1. For example, communication system 100 may include any number of user devices, base stations, networks, or other components in any suitable configuration. It should also be understood that the term "user equipment" may refer to any type of wireless device that communicates with a radio network node in a cellular or mobile communication system. Non-limiting examples of user equipment include target equipment, device-to-device (D2D) user equipment, machine class user equipment, or machine-to-machine (M2M) enabled user equipment, laptop, PDA, iPad, tablet, mobile terminal, smartphone, Laptop Embedded Equipment (LEE), Laptop Mounted Equipment (LME), and USB dongle.

In one embodiment, UE 110 has a wireless connection to tactile stimulation device 240. In one embodiment, UE 110 sends information (e.g., digital data) to tactile stimulation device 240 over a wireless connection. This information is presented on the tactile stimulation interface 250. In one embodiment, the tactile stimulation system includes the tactile stimulation device 240, but not the UE 110.

Fig. 2 illustrates one embodiment of a tactile stimulation system. In this embodiment, the tactile stimulation system includes a tactile stimulation device 240 and the UE 110. In another embodiment, the tactile stimulation system includes the tactile stimulation device 240, but not the UE 110. The UE 110 may be a mobile phone or the like, but in other examples may be other devices, such as a desktop computer, laptop computer, tablet computer, handheld computing device, automotive computing device, and/or other computing devices. As shown, the illustrated exemplary UE 110 includes at least one transmitter 202, at least one receiver 204, memory 206, at least one processor 208, and at least one input/output device 212. The processor 208 may implement various processing operations for the UE 110. For example, the processor 208 may perform signal coding, data processing, power control, input/output processing, or any other functionality that enables the UE 110 to operate in the system 100 (e.g., the system 100 of fig. 1). The processor 208 may include any suitable processing or computing device for performing one or more operations. For example, the processor 208 may include a microprocessor, microcontroller, digital signal processor, field programmable gate array, or application specific integrated circuit. In one embodiment, the memory 206 is a non-transitory memory. In one embodiment, the memory 206 is a non-transitory computer-readable medium.

The transmitter 202 is used to modulate data or other content for transmission via at least one antenna 210. The transmitter 202 may also be used to amplify, filter, and frequency convert RF signals before providing them to the antenna 210 for transmission. The transmitter 202 may include any suitable structure for generating signals for wireless transmission.

The receiver 204 may be used to demodulate data or other content received by at least one antenna 210. The receiver 204 may also be used to amplify, filter, and frequency convert RF signals received via the antenna 210. In some embodiments, the receiver 204 is an RF signal receiver. The receiver 204 may include any suitable structure for processing wirelessly received signals. The antenna 210 includes any suitable structure for transmitting and/or receiving wireless signals. The same antenna 210 may be used for transmitting and receiving RF signals, or alternatively, different antennas 210 may be used for transmitting and receiving signals.

It is to be appreciated that one or more transmitters 202 can be employed in the UE 110, one or more receivers 204 can be employed in the UE 110, and one or more antennas 210 can be employed in the UE 110. Although shown as separate blocks or components, the at least one transmitter 202 and the at least one receiver 204 may be combined into a transceiver. Thus, rather than showing a separate block for the transmitter 202 and a separate block for the receiver 204 in fig. 2, a single block for a transceiver is shown. In one embodiment, at least one of the transmitters 202 is used to communicate with the tactile stimulation device 240. In one embodiment, at least one of the receivers 204 is used to communicate with the tactile stimulation device 240. In one embodiment, the transmitter and/or the receiver comprise a wireless communication interface for communicating with the tactile stimulation device 240.

The UE 110 also includes one or more input/output devices 212. The input/output devices 212 facilitate interaction with a user. Each input/output device 212 includes any suitable structure for providing information to or receiving information from a user, such as a speaker, microphone, keypad, keyboard, display, or touch screen. It should be noted that some users may have difficulty receiving information using one or more structures. For example, some users may have difficulty seeing or reading visual displays on UE 110. In another example, it may be difficult for some users to hear the speaker on UE 110. Embodiments of the tactile stimulation device 240 allow the user to obtain such information from the UE 110.

Further, the UE 110 includes at least one memory 206. Memory 206 stores instructions and data used, generated, or collected by UE 110. For example, the memory 206 may store software or firmware instructions executed by the one or more processors 208 and data for reducing or eliminating interference in the incoming signal. Each memory 206 includes one or more of any suitable volatile and/or non-volatile storage and retrieval devices. Any suitable type of memory may be used, such as Random Access Memory (RAM), Read Only Memory (ROM), hard disk, optical disk, Subscriber Identity Module (SIM) card, memory stick, Secure Digital (SD) memory card, and so forth.

The UE 110 has a wireless connection to the tactile stimulation device 240. The tactile stimulation device 240 has a tactile stimulation interface 250 (also referred to simply as a "stimulation interface"), a receiver 260, a controller 270, and a digital-to-analog (D/a) converter 275. The receiver 260 may include a wireless receiver for wireless communication with the UE 110. The receiver 260 may be used to communicate via various wireless communication protocols, including but not limited to the IEEE (Institute of Electrical and Electronics Engineers) 802.11 protocol or the IEEE 802.15 protocol. In one embodiment, the receiver 260 is configured to communicate using bluetooth. Optionally, the tactile stimulation device 240 may have a transmitter for communicating via various wireless communication protocols. In one embodiment, the user may select information to be transmitted from UE 110 to the tactile stimulation device 240. After the user is accustomed to using the tactile stimulation device 240, the user may request more detailed information to be sent. For example, the user may select a notification of receipt of an email, a keyword in an email, an entire email, and so forth.

The stimulation interface 250 is used to generate a tactile stimulation pattern. In one embodiment, the tactile stimulation pattern stimulates receptors in the user's skin when the user's skin is in contact with the stimulation interface 250. The receptors may include, but are not limited to, meissner's corpuscles, merkel's cells, fibrani's terminal parts, and pacinian corpuscles. The stimulation interface 250 need not stimulate all types of receptors. In one embodiment, the stimulation interface 250 stimulates a subset of one or more types of receptors (e.g., meissner corpuscles, meckel cells, feimsonian distal tips, and/or pacinian corpuscles). In one embodiment, the stimulation interface 250 has a set (e.g., a pattern, an array, etc.) of stimulation elements. In some embodiments, the stimulation interface 250 stimulates receptors in human skin through mechanical motion (e.g., mechanical vibration). In one embodiment, each of the stimulation elements comprises an electroacoustic transducer for generating acoustic waves.

The controller 270 is used to control the operation of the tactile stimulation apparatus 240. In one embodiment, the controller 270 is configured to control data transmission from the UE 110 through the receiver 260. In one embodiment, the data transmission from UE 110 to the tactile stimulation device 240 is unidirectional. In one embodiment, the data transfer is bidirectional. Thus, the tactile stimulation device 240 may report configuration information, status, etc. to the UE 110.

In one embodiment, the controller 270 is configured to control the presentation of data on the stimulation interface 250. In one embodiment, the controller 270 is configured to continuously propagate the stimulation pattern across the skin of the user. The D/a converter 275 is used to convert the digital signal to an analog signal. In one embodiment, the controller 270 processes a first digital signal from the UE 110 and provides a second digital signal to a D/a converter 275. Based on the second digital signal from the controller 270, the D/A converter 275 outputs an analog signal to drive the stimulation interface 250. Because the controller 270 may process functions, such as generating digital signals suitable for the configuration of the stimulation interface 250, the first digital signal and the second digital signal may be different. In one embodiment, the UE 110 handles these functions, wherein the first digital signal and the second digital signal may be the same.

The controller 270 may be implemented in hardware, software, or a combination of hardware and software. Hardware control circuit components for implementing the controller 270 may include, but are not limited to, a field-programmable gate array (FPGA), an application-specific integrated circuit (ASIC), an application-specific standard product (ASSP), a system-on-a-chip (SOC), a Complex Programmable Logic Device (CPLD), a special purpose computer, and the like. In one embodiment, the controller 270 is implemented as software (stored on a storage device) for programming one or more processors. Accordingly, the controller 270 may include a storage device and a processor.

In one embodiment, the controller 270 works with the UE 110 to present information on the stimulation interface 250. For example, by executing instructions stored by the memory 206 on the processor 208, the UE 110 may transmit digital data to the receiver 260. Thus, in one embodiment, the combination of the controller 270, the processor 208, and the memory 206 may be referred to as control circuitry for presenting information on the tactile stimulation interface 250.

Fig. 3 illustrates an exemplary BS 170 in which the methods and descriptions provided by the present invention may be implemented. As shown, the BS 170 includes at least one processor 308, at least one transmitter 302, at least one receiver 304, one or more antennas 310, and at least one memory 306. The processor 308 performs various processing operations of the BS 170, such as signal encoding, data processing, power control, input/output processing, or any other function. Each processor 308 includes any suitable processing or computing device for performing one or more operations. For example, each processor 308 may include a microprocessor, microcontroller, digital signal processor, field programmable gate array, or application specific integrated circuit. In one embodiment, the memory 306 is a non-transitory memory.

Each transmitter 302 includes any suitable structure for generating signals for wireless transmission to one or more UEs 110 or other devices. Each receiver 304 includes any suitable structure for processing signals wirelessly received from one or more UEs 110 or other devices. Although shown as separate blocks or components, the at least one transmitter 302 and the at least one receiver 304 may be combined into a transceiver. Each antenna 310 includes any suitable structure for transmitting and/or receiving wireless signals. Although a common antenna 310 is shown coupled to both the transmitter 302 and the receiver 304, one or more antennas 310 may be coupled to one or more of the transmitter 302 and one or more separate antennas 310 may be coupled to one or more of the receiver 304. Each memory 306 includes one or more of any suitable volatile and/or non-volatile storage and retrieval devices.

Fig. 4 shows one embodiment of a tactile stimulation device 240. The stimulation interface 250 has an array including tactile stimulation elements 410 (also referred to simply as "stimulation elements"). Each tactile stimulation element 410 may also be referred to as a "tactile pixel" (or pixel). In one embodiment, the array of stimulating elements 410 is used to stimulate receptors in human skin (e.g., meissner corpuscles, merkel cells, feimsonian endings, and/or pacinian corpuscles). In one embodiment, each stimulation element 410 may be independently controlled. The arrangement in fig. 4 is merely an example, and the stimulation element 410 may have a number of other configurations. In this example, there are 6 × 6 groups of 36 stimulus elements 410 in total. The number of stimulation elements 410 may vary depending on the implementation. In the example of fig. 4, there are 6 rows of stimulation elements 410 and 6 columns of stimulation elements 410. It is not required that the number of rows be equal to the number of columns. In the example of fig. 4, the stimulation elements 410 are equally spaced. However, equal spacing is not required. The pattern is not required to be arranged in rows and columns. In one embodiment, the set includes an array of stimulation elements 410. The term "array" refers to a systematic arrangement of similar objects, such as stimulus elements 410.

The cross-sectional shape of each stimulation element 410 is square in fig. 4, but stimulation elements 410 may have other cross-sectional shapes.

In one embodiment, each stimulation element 410 includes an electrode that can be biased to a desired voltage. Thus, in one embodiment, the stimulation interface 250 includes an array of electrodes for stimulating receptors in the skin of the user. In one embodiment, some of the stimulation elements 410 are referred to as active electrodes, while other stimulation elements 410 are referred to as ground electrodes. In one embodiment, there are one or more ground electrodes. By biasing the active electrode to an appropriate voltage, and placing the one or more ground electrodes at a common voltage, current may be passed through the skin of the user from the active electrode to the one or more ground electrodes. The current flowing through the skin of the user may be an ionic current. In one embodiment, if it is desired not to activate that particular active electrode, the active electrode may be biased to a common voltage.

In one embodiment, each stimulation element 410 includes an electromechanical transducer. Thus, in one embodiment, the stimulation interface 250 includes an electromechanical transducer array for stimulating receptors in the skin of the user. Electromechanical transducers are capable of converting electrical energy into mechanical energy. The mechanical energy may be in the form of mechanical vibrations. For example, the electromechanical transducer may be controlled by an electrical signal (e.g., current or voltage) to cause mechanical vibration of the stimulating element 410. In one embodiment, the pattern of stimulation elements 410 comprising an electromechanical transducer is used to stimulate receptors in human skin by mechanical vibrations of the electromechanical transducer.

In one embodiment, each stimulation element 410 includes an electroacoustic transducer. Thus, in one embodiment, the stimulation interface 250 includes an array of electro-acoustic transducers for stimulating receptors in the skin of the user. An electroacoustic transducer is capable of converting electrical energy into acoustic energy. The acoustic energy may be in the form of sound waves. For example, an electroacoustic transducer may be controlled by an electrical signal (e.g., current or voltage) to generate an acoustic wave. In one embodiment, each electro-acoustic transducer comprises an audio speaker. In one embodiment, the array of stimulating elements 410 comprising an electroacoustic transducer is used to stimulate receptors in human skin by mechanical vibration of the electroacoustic transducer.

The diameter of the electroacoustic transducer may be between about 0.5mm and 2 mm. However, electro-acoustic transducers smaller than 0.5mm or larger than 2mm are also suitable for the stimulating element 410. In some embodiments, the electroacoustic transducer is driven to generate sound waves that are inaudible to the human ear. In one embodiment, the electro-acoustic transducer is driven to generate acoustic waves having a frequency below 20 Hz. In some embodiments, the electro-acoustic transducer is driven to produce acoustic waves in the frequency range of 10Hz to 10 kHz. However, the electroacoustic transducer may be driven to generate sound waves below 10Hz or above 10 kHz.

In one embodiment, the electro-acoustic transducer is driven to produce sound pressure level sound waves of less than 40dB at a distance of 250 meters from the stimulation interface. However, in some embodiments, the electro-acoustic transducer may be driven to produce sound pressure level sound waves greater than 40dB at a distance of 250 meters from the stimulation interface. In one embodiment, the electro-acoustic transducer is driven to produce acoustic waves having an amplitude between 0dB and 40dB at a distance of 250 meters from the stimulation interface.

In one embodiment, each stimulation element 410 includes an electrothermal transducer. Thus, in one embodiment, the stimulation interface 250 includes an array of electrothermal transducers for stimulating receptors in the skin of the user. The electrothermal transducer is capable of converting electrical energy into thermal energy. For example, the electrothermal transducer may be controlled by an electrical signal (e.g., current or voltage) to generate thermal energy. In one embodiment, each electrothermal transducer includes a resistor. In one embodiment, each electrothermal transducer includes a diode. In one embodiment, the array of stimulating elements 410 comprising an electrothermal transducer is used to stimulate receptors in human skin by the relative temperature of the electrothermal transducer.

In one embodiment, a single stimulating element 410 may itself stimulate receptors in human skin. For example, each stimulation element may include an electromechanical transducer controlled by an electrical signal (e.g., current or voltage) to produce mechanical vibrations. In one embodiment, two or more stimulating elements 410 work together to stimulate receptors in human skin. For example, each stimulation element may include an electrode such that current flows from the contact point of the user's skin with the active electrode, through the user's skin, and to the contact point of the user's skin with the ground electrode. It is noted that in one embodiment, the current in the skin of the user is an ionic current.

The format of the information provided by the UE 110 to the tactile stimulation device 240 may vary depending on implementation. For example, the information may be "raw data" such as text data or even image data. In this case, the tactile stimulation device 240 is used to determine how to map the "raw data" to the pattern of tactile stimulation elements 410. However, the information may be provided to the UE 110 in a more refined format. For example, the UE 110 may know the configuration of the pattern of the stimulation elements 410. In this case, the UE 110 may indicate what the tactile stimulation device 240 should present in each stimulation element 410.

Fig. 5 illustrates an embodiment of presenting information in a presentation mode called "symbolic representation of letters" on the tactile stimulation interface 250. The letter "a" of the english alphabet is represented on the tactile stimulation interface 250. In this example, the representation on the tactile stimulation interface 250 visually resembles the letter "a" of the english alphabet. This concept is applicable to alphabets of other languages.

Fig. 6 illustrates an embodiment of presenting information in a presentation mode called "symbolic representation of words" on the tactile stimulation interface 250. The word "love" of the english alphabet is represented on the tactile stimulation interface 250. In this example, the representation on the tactile stimulation interface 250 is visually heart-like. In this example, the symbol of heart is a symbolic representation of the word "love". It should be noted that the entire word is presented on the tactile stimulation interface 250, rather than a single letter, so that the tactile stimulation interface 250 is more efficient in presenting information to the user. For example, the time required to present an email to a user is greatly reduced. However, in some cases, the user cannot understand the more complex words. In other words, the user understands the letters of the alphabet more easily.

The concepts of fig. 5 and 6 may be applied to characters or symbols written in other languages. Accordingly, one embodiment includes a mode of representation referred to herein as "symbolic representation of characters for writing in a language". For example, in one embodiment, the representation mode is a symbolic representation of Chinese characters. Herein, kanji refers to any known chinese character that has been developed to be writable. In one embodiment, braille characters can be presented on the stimulus interface 250.

Fig. 7A-7C show a tactile stimulation interface 250 at three points in time to illustrate an embodiment of a propagating stimulation pattern. In some embodiments, the stimulation pattern is spread over the skin of the user. The user's skin is not explicitly shown in fig. 7A to 7C. Fig. 7A shows a tactile stimulation interface 250 having eight tactile stimulation elements (or tactile pixels) 702 a-702 h. Fig. 7A shows a first point in time. The tactile pixels 702a to 702h may be referred to as a tactile pixel array. An arrow is shown in this example. In some embodiments, the array has a plurality of rows. Figure 4 shows an example of an array with multiple rows. Referring again to FIG. 7A, tactile pixels 702a can be referred to as a first end of the array and tactile pixels 702h can be referred to as a second end of the array.

Tactile pixels 702a through 702h present signal elements S0 through S7, respectively. In summary, a signal element may be referred to as a stimulation pattern (or signal) presented on the tactile stimulation interface 250. For example, tactile pixel 702a presents signal element S0, tactile pixel 702b presents signal element S1, and so on. Each signal element is represented by an arrow. The length of the arrow may represent the amplitude of the signal element. In fig. 7A to 7C, the arrows show only two different lengths in this example to indicate that each tactile pixel may be in one of two states. However, the tactile pixels need not have a binary state. The pattern of signal elements may be referred to as a stimulus pattern. The pattern of time points may be referred to as the state of the stimulus pattern. When one or more signals change, the state of the stimulation pattern may change to a new (or next) state. In some embodiments, the status occurs continuously at regular intervals. At this point in time, the stimulation pattern has a first end indicated by S0 and a second end indicated by S7. As described below, the stimulation pattern varies over time.

Fig. 7B shows a second point in time after the first point in time. Fig. 7B illustrates a next state of the tactile stimulation interface 250 immediately following the state illustrated in fig. 7A in one embodiment. At this time, the tactile stimulation interface 250 displays signal elements S1-S8. Thus, the stimulation pattern at this time includes signal elements S1 through S8. It is noted that the signal element S0 (at the first end of the stimulation pattern) has been eliminated and a new portion of the stimulation pattern (S8) has been added to the second end of the stimulation pattern. The stimulus pattern shown propagates in the direction of tactile pixel 702h to tactile pixel 702a (as indicated by the arrow below the "stimulus pattern propagation").

Fig. 7C shows a third point in time after the second point in time. Fig. 7C illustrates a next state of the tactile stimulation interface 250 immediately following the state illustrated in fig. 7B in one embodiment. At this time, the tactile stimulation interface 250 displays signal elements S2-S9. Thus, the stimulation pattern at this time includes signal elements S2 through S9. It is noted that the signal element S1 (at the first end of the stimulation pattern) has been eliminated and a new portion of the stimulation pattern (S9) has been added to the second end of the stimulation pattern. The stimulus pattern shown propagates in the direction from tactile pixel 702h to tactile pixel 702a (as indicated by the arrow below the "stimulus pattern propagation").

As described above, the array may have multiple rows. In one embodiment, each row is processed as described for a single row in fig. 7A-7C. The content of the stimulus pattern for each row is not required to be the same.

Fig. 8A-8C show the tactile stimulation interface 250 at three points in time to illustrate an embodiment of a propagating stimulation pattern. In some embodiments, the stimulation pattern is spread over the skin of the user. The user's skin is not explicitly shown in fig. 8A to 8C. The exemplary signals and their propagation are similar to the examples of fig. 7A-7C. However, in contrast to the straight-line configuration of fig. 7A-7C, the tactile stimulation interface 250 has a circular configuration in fig. 8A-8C. Fig. 8A to 8C show three different states of the stimulation pattern. In some embodiments, these three states occur sequentially at fixed intervals.

Fig. 8A shows an embodiment of a tactile stimulation interface 250 having eight tactile stimulation elements (or tactile pixels) 802a to 802 h. Fig. 8A shows a first point in time. The tactile pixels 802a to 802h may be referred to as a tactile pixel array. In this example, the arrow has a circular configuration of one tactile pixel "ring". In some embodiments, the array has a circular configuration of a plurality of tactile pixel "rings". The rings need not have the same number of tactile pixels. Referring again to FIG. 8A, tactile pixels 802a can be referred to as a first end of the array and tactile pixels 802h can be referred to as a second end of the array.

The tactile pixels 802a to 802h present the same signal elements S0 to S7, respectively, as shown in the example of fig. 7A. For example, tactile pixel 802a presents signal element S0, tactile pixel 802b presents signal element S1, and so on. Each signal element is represented by an arrow. The length of the arrow may represent the amplitude of the signal element. In fig. 8A-8C, the arrows show only two different lengths in this example to indicate that each tactile pixel may be in one of two states. However, the tactile pixels need not have a binary state. The pattern of signal elements may be referred to as a stimulus pattern. At this point in time, the stimulation pattern has a first end indicated by S0 and a second end indicated by S7. As described below, the stimulation pattern varies over time.

Fig. 8B shows a second point in time after the first point in time. Fig. 8B illustrates a next state of the tactile stimulation interface 250 immediately following the state illustrated in fig. 8A in one embodiment. At this time, the tactile stimulation interface 250 displays signal elements S1-S8. Thus, the stimulation pattern at this time includes signal elements S1 through S8. It is noted that the signal element S0 (at the first end of the stimulation pattern) has been eliminated and a new portion of the stimulation pattern (S8) has been added to the second end of the stimulation pattern. The stimulus pattern is shown propagating in the direction of tactile pixel 802h to tactile pixel 802a (as indicated by the arrow below the "stimulus pattern propagation"). In other words, in this example, the stimulus pattern is propagated in a clockwise direction.

Fig. 8C shows a third point in time after the second point in time. Fig. 8C illustrates a next state of the tactile stimulation interface 250 immediately following the state illustrated in fig. 8B in one embodiment. At this time, the tactile stimulation interface 250 displays signal elements S2-S9. Thus, the stimulation pattern at this time includes signal elements S2 through S9. It is noted that the signal element S1 (at the first end of the stimulation pattern) has been eliminated and a new portion of the stimulation pattern (S9) has been added to the second end of the stimulation pattern. The stimulus pattern is shown propagating in a clockwise direction (as shown by the arrow below the "stimulus pattern propagation") from tactile pixel 802h to tactile pixel 802 a.

Fig. 9 is a flow diagram of an embodiment of a process 900 of providing a tactile stimulation interface. The process 900 is described with reference to fig. 7A-8C, but the invention is not limited thereto.

Step 902: a stimulation pattern is generated having an array including tactile stimulation elements. The stimulation pattern may be in contact with the user's skin such that the stimulation pattern is presented on the user's skin. The stimulus pattern presented includes a first end and a second end. For example, a stimulation pattern is generated as described in fig. 7A or fig. 8A. In FIG. 7A, the first end of the stimulation pattern is signal element S0, the signal element S0 being present in tactile pixel 702 a. In FIG. 8A, the first end of the stimulation pattern is signal element S0, the signal element S0 being present in tactile pixel 802 a.

Step 904: the stimulus pattern is continuously propagated over the skin of the user. Step 904 may include repeatedly eliminating a portion of a first end of the stimulation pattern and replacing the eliminated portion with a new portion at a second end of the stimulation pattern. In fig. 7B, the signal element S0 (at the first end of the stimulation pattern) has been eliminated, and a new portion of the stimulation pattern (S8) has been added to the second end of the stimulation pattern. In fig. 7C, signal element S1 (at the first end of the stimulation pattern) has been eliminated, and a new portion of stimulation pattern (S9) has been added to the second end of the stimulation pattern. Thus, the stimulus pattern is shown propagating in the direction of tactile pixel 702h to tactile pixel 702a (as indicated by the arrow below the "stimulus pattern propagation"). There is some time interval between the state of fig. 7A and the state of fig. 7B. Similarly, there is some time interval between the state of FIG. 7B and the state of FIG. 7C. In some embodiments, these different states occur at fixed intervals. Thus, the stimulus pattern is continuously spread over the skin of the user.

In some embodiments, the stimulation pattern propagates at a constant rate over the user's skin. Propagating the stimulus pattern at a constant rate means that the time interval between successive signal elements contacting the same point on the user's skin is constant. For example, referring to fig. 7A to 7C, at a time point t0, the signal element S0 is located at a specific point on the user' S skin; at time point t1, signal element S1 is located at a particular point on the user' S skin; at time point t2, signal element S2 is located at a particular point on the user' S skin. In some embodiments, the time interval between t0 and t1 is the same as the time interval between t1 and t2, and so on. Thus, the stimulation pattern propagates at a constant rate over the user's skin.

Step 904 is described in the examples of fig. 8B and 8C. In fig. 8B, the signal element S0 (at the first end of the stimulation pattern) has been eliminated, and a new portion of the stimulation pattern (S8) has been added to the second end of the stimulation pattern. In fig. 8C, signal element S1 (at the first end of the stimulation pattern) has been eliminated, and a new portion of stimulation pattern (S9) has been added to the second end of the stimulation pattern. Thus, the stimulus pattern is shown propagating in the direction of tactile pixel 802h to tactile pixel 802a (as indicated by the arrow below the "stimulus pattern propagation"). In other words, in this example, the stimulus pattern propagates continuously in a clockwise direction.

Fig. 10 is a flow diagram of an embodiment of a process 1000 of continuously propagating a stimulation pattern. The process 1000 provides further details of the process 900. For ease of description, the tactile stimulation interface has stimulation elements 0 through n (n +1 elements total). In connection with the examples of fig. 7A to 8C, n is 7. In connection with the examples of fig. 7A-7C, element 702a is element 0, element 702b is element 1, … …, and element 702n is element n. In connection with the examples of fig. 8A-8C, element 802a is element 0, element 802b is element 1, … …, and element 802n is element n.

Step 1002: the stimulation elements (or tactile pixels) are activated or deactivated to present a stimulation pattern. The stimulation pattern may be in contact with the user's skin such that the stimulation pattern is presented on the user's skin. Step 1004: determining whether to proceed to a next state of the stimulation pattern. In one embodiment, each state is presented for a predetermined time before entering the next state.

For ease of description, steps 1006 through 1010 are described in a particular order. These steps may occur simultaneously or in a different order. Step 1006: the data in element 0 is deleted from the stimulus pattern. That is, the signal element presented in element 0 for the pre-stimulus pattern state is no longer part of the stimulus pattern. For example, starting from the state of fig. 7A to 7B, signal element S0 no longer appears in the stimulation pattern.

Step 1008: for elements i-1 to n, the data in element i is moved to element i + 1. For example, starting from the state of fig. 7A-7B, signal element S1 moves from element 702B to 702a, signal element S2 moves from element 702c to 702B, and so on.

Step 1010: new data is added to the stimulus pattern of stimulus element n. For example, starting from the state of fig. 7A to 7B, signal element S8 is added to the stimulation pattern of stimulation element 702 h. The process 1000 then returns to step 1004, where, in one embodiment, the current state of the stimulation pattern is presented for a predetermined time. Thus, the process 1000 describes an embodiment in which the stimulus pattern propagates continuously.

Fig. 9 and 10 are described in connection with an example in which the array comprising tactile stimulation elements has a single row. In some embodiments, the array comprising tactile stimulation elements has rows and columns of tactile stimulation elements. In some embodiments, the process 900 and/or the process 1000 propagate stimulation patterns for each row at the same rate. In other embodiments, the stimulus pattern propagates at different rates for different rows. In the embodiments of fig. 18-20 described below, the stimulation patterns may be propagated at different rates for different rows to convey three-dimensional information.

Fig. 11A-11C show the tactile stimulation interface 250 at three points in time to illustrate an embodiment of a propagating stimulation pattern. In some embodiments, the stimulation pattern is spread over the skin of the user. The user's skin is not explicitly shown in fig. 11A to 11C. The exemplary stimulus pattern and its propagation are similar to the examples of fig. 8A-8C. However, the tactile stimulation interface 250 rotates in the embodiment shown in fig. 11A-11C. Fig. 11A to 11C show three different states of the stimulation pattern. In some embodiments, these three states occur sequentially at fixed intervals.

Fig. 11A shows an embodiment of a tactile stimulation interface 250 having eight tactile stimulation elements (or tactile pixels) 1102 a-1102 h. The tactile stimulation interface 250 has a similar shape and number of stimulation elements as the embodiment of fig. 8A. However, the tactile pixels 1102a to 1102h in fig. 11A use different reference numerals. Fig. 11A shows a first point in time. Tactile pixels 1102a can be referred to as a first end of the array and tactile pixels 1102h can be referred to as a second end of the array.

Tactile pixels 1102a through 1102h respectively exhibit the same signal elements S0 through S7 as in the example of fig. 8A. For example, tactile pixel 1102a presents signal element S0, tactile pixel 1102b presents signal element S1, and so on. Each signal element is represented by an arrow. The length of the arrow may represent the amplitude of the signal element. In fig. 11A-11C, in this example, the arrows show only two different lengths to illustrate that each tactile pixel may be in one of two states. However, the tactile pixels need not have a binary state. At this point in time, the stimulation pattern has a first end indicated by S0 and a second end indicated by S7. As described below, the stimulation pattern varies over time.

Fig. 11B shows a second point in time after the first point in time. FIG. 11B illustrates the next state of the tactile stimulation interface 250 immediately following the state illustrated in FIG. 11A in one embodiment. At this time, the tactile stimulation interface 250 displays signal elements S1-S8. Thus, the stimulation pattern at this time includes signal elements S1 through S8. It is noted that the signal element S0 (at the first end of the stimulation pattern) has been eliminated and a new portion of the stimulation pattern (S8) has been added to the second end of the stimulation pattern. The array is shown rotated in a clockwise direction. For example, tactile pixel 1102a is located at the 12 o 'clock position in FIG. 11B, and tactile pixel 1102h is located at the 12 o' clock position in FIG. 1, 11A.

Fig. 11C shows a third point in time after the second point in time. FIG. 11C illustrates the next state of the tactile stimulation interface 250 immediately following the state illustrated in FIG. 11B in one embodiment. At this time, the tactile stimulation interface 250 displays signal elements S2-S9. Thus, the stimulation pattern at this time includes signal elements S2 through S9. It is noted that the signal element S1 (at the first end of the stimulation pattern) has been eliminated and a new portion of the stimulation pattern (S9) has been added to the second end of the stimulation pattern. The array is shown rotated in a clockwise direction. Thus, the stimulation pattern also rotates in a clockwise direction. Furthermore, in the present example, the stimulation pattern is rotated over the user's skin.

Fig. 12 is a flow diagram of an embodiment of a process 1200 of continuously propagating a stimulation pattern. The process 1200 provides further details of the process 900. For ease of description, the tactile stimulation interface has stimulation elements 0 through n (n +1 elements total). In connection with the examples of fig. 11A to 11C, n is 7. In connection with the examples of fig. 11A-11C, element 1102a is element 0, element 1102b is element 1, … …, and element 1102n is element n.

Step 1202: the stimulation elements (or tactile pixels) are activated or deactivated to present a stimulation pattern. The stimulation pattern may be in contact with the user's skin such that the stimulation pattern is presented on the user's skin. Fig. 11A shows one example of step 1202. Step 1204: determining whether to proceed to a next state of the stimulation pattern. In one embodiment, each state is presented for a predetermined time before entering the next state.

For ease of description, steps 1206 through 1208 are described in a particular order. These steps may occur simultaneously or in a different order. Step 1206: the tactile stimulation interface 250 is rotated or moved by a stimulation element. For example, starting from the state of fig. 11A-11B, the tactile stimulation interface 250 is rotated clockwise by one stimulation element.

Step 1208: replace data in selected elements to delete old data and add new data to the stimulus pattern. For example, a comparison of fig. 11A and 11B shows signal element S0 replaced by signal element S8 in tactile pixel 1102 a. In another example, a comparison of fig. 11B and 11C shows signal element S1 replaced by signal element S9 in tactile pixel 1102B.

The process 1200 then returns to step 1204, where, in one embodiment, the current state of the stimulation pattern is presented for a predetermined time. Thus, the process 1200 describes an embodiment in which the stimulus pattern propagates continuously.

Fig. 13 illustrates another embodiment of a process 1300 of continuously propagating a stimulation pattern. The process 1300 provides further details of the process 900. The process 1300 is another process 1200 in which the array is continuously rotated. The term "continuous" or "continuously" as used herein means "without interruption". This is in contrast to embodiments of the process 1200 where the array "goes" from one state to the next in the process 1200.

Step 1302: the stimulation elements (or tactile pixels) are activated or deactivated to present a stimulation pattern. The stimulation pattern may be in contact with the user's skin such that the stimulation pattern is presented on the user's skin. FIG. 11A shows one example of step 1302. Step 1304: the array is continuously rotated. In one embodiment, the array is continuously rotated at a constant angular velocity.

Step 1306: it is determined whether it is time to change the state of the stimulation pattern. Step 1306 may be similar to step 1204, as the new state may be presented after a predetermined period of time.

Step 1308: replace data in selected elements to delete old data and add new data to the stimulus pattern. For example, a comparison of fig. 11A and 11B shows signal element S0 replaced by signal element S8 in tactile pixel 1102 a. In another example, a comparison of fig. 11B and 11C shows signal element S1 replaced by signal element S9 in tactile pixel 1102B.

The process 1300 then returns to step 1304. It should be noted that step 1304 may actually continue throughout the process. That is, it is not required that the rotation of the array be stopped during process 1300. Thus, process 1300 describes an embodiment in which the stimulus pattern propagates continuously.

Fig. 14A-14F show an embodiment of the tactile stimulation interface 250 at six time points to illustrate an embodiment of a propagating stimulation pattern. In this embodiment, the tactile stimulation interface 250 physically moves across the user's skin. The tactile stimulation interface 250 is similar to the interface of fig. 7A, and therefore the tactile pixels 702 a-702 h use the same reference numerals. Fig. 14A shows the same stimulation pattern as shown in fig. 7A. The dashed box labeled 1450 represents the user's skin in contact with tactile pixels 702a through 702 h.

Fig. 14B shows a second point in time after the first point in time in fig. 14A. FIG. 14B illustrates a next state of the tactile stimulation interface 250 immediately following the state illustrated in FIG. 14A in one embodiment. The tactile stimulation interface 250 moves as indicated by the arrow labeled "array move". Thus, the tactile stimulation interface 250 is moving across the user's skin 1450. At this time, the tactile stimulation interface 250 displays signal elements S1-S8. Thus, the stimulation pattern at this time includes signal elements S1 through S8. It is noted that the signal element S0 (at the first end of the stimulation pattern) has been eliminated and a new portion of the stimulation pattern (S8) has been added to the second end of the stimulation pattern. The stimulus pattern shown propagates in the direction of tactile pixel 702h to tactile pixel 702a (as indicated by the arrow below the "stimulus pattern propagation").

Fig. 14C shows a third point in time after the second point in time. Fig. 14C illustrates a next state of the tactile stimulation interface 250 immediately following the state illustrated in fig. 14B in one embodiment. The tactile stimulation interface 250 has moved further as indicated by the arrow labeled "array move". Thus, the tactile stimulation interface 250 is moving across the user's skin 1450. At this time, the tactile stimulation interface 250 displays signal elements S2-S9. Thus, the stimulation pattern at this time includes signal elements S2 through S9. It is noted that the signal element S1 (at the first end of the stimulation pattern) has been eliminated and a new portion of the stimulation pattern (S9) has been added to the second end of the stimulation pattern. The stimulus pattern shown propagates in the direction from tactile pixel 702h to tactile pixel 702a (as indicated by the arrow below the "stimulus pattern propagation").

Fig. 14D shows a point in time after the third point in time. However, fig. 14D does not show the next state of the tactile stimulation interface 250 immediately following the state shown in fig. 14C. In contrast, several intermediate states are not described. The tactile stimulation interface 250 has been moved further on the user skin 1450 as indicated by the arrow labeled "array move". At this time, the tactile stimulation interface 250 displays signal elements S8-S14. Thus, the stimulation pattern at this time includes signal elements S8 through S14. The stimulus pattern shown propagates in the direction from tactile pixel 702h to tactile pixel 702a (as indicated by the arrow below the "stimulus pattern propagation").

Fig. 14E shows a point of time after the point of time in fig. 14D. Fig. 14E illustrates the next state of the tactile stimulation interface 250 immediately following the state illustrated in fig. 14D in one embodiment. The tactile stimulation interface 250 has moved back to the position in fig. 14A. However, at this point the tactile stimulation interface 250 includes signal elements S15-S22. In this state transition, all signal elements shown in fig. 14D have been replaced.

Fig. 14F shows a point of time after the point of time in fig. 14E. FIG. 14F illustrates a next state of the tactile stimulation interface 250 immediately following the state illustrated in FIG. 14E in one embodiment. The tactile stimulation interface 250 moves as indicated by the arrow labeled "array move". Thus, the tactile stimulation interface 250 is moving across the user's skin 1450. At this time, the tactile stimulation interface 250 displays signal elements S16-S23.

Fig. 15 is a flow diagram of an embodiment of a process 1500 of continuously propagating a stimulation pattern. The process 1500 provides further details of the process 900. For ease of description, the tactile stimulation interface has stimulation elements 0 through n (n +1 elements total). In connection with the examples of fig. 14A to 14F, n is 7. In connection with the examples of fig. 14A to 14C, the element 702a is element 0, the element 702b is element 1, … …, and the element 702n is element n.

Step 1502: the stimulation elements (or tactile pixels) are activated or deactivated to present a stimulation pattern. The stimulation pattern may be in contact with the user's skin such that the stimulation pattern is presented on the user's skin. Step 1504: determining whether to proceed to a next state of the stimulation pattern. In one embodiment, each state is presented for a predetermined time before entering the next state. Step 1506: it is determined whether to return the array to a starting position. One example of return is described in the state transition from fig. 14D to fig. 14E. Assuming the array does not return to the starting position, steps 1508-1514 are performed.

For ease of description, steps 1508 through 1514 are described in a particular order. These steps may occur simultaneously or in a different order. Step 1508: the array is rotated or moved by a stimulating element. For example, referring to fig. 14A-14B, the tactile stimulation interface 250 may move one stimulation element to the right from fig. 14A-14B. In another example, the tactile stimulation interface 250 can be rotated as shown in fig. 11A-11C.

Step 1510: the data in element 0 is deleted from the stimulus pattern. That is, the signal element presented in element 0 for the pre-stimulus pattern state is no longer part of the stimulus pattern. For example, starting from the state of fig. 14A to 14B, the signal element S0 no longer appears in the stimulation pattern.

Step 1512: for elements i-1 to n, the data in element i is moved to element i + 1. For example, starting from the state of fig. 14A-14B, signal element S1 moves from element 702B to 702a, signal element S2 moves from element 702c to 702B, and so on.

Step 1514: new data is added to the stimulus pattern of stimulus element n. For example, starting from the state of fig. 14A to 14B, the signal element S8 is added to the stimulation pattern of the stimulation element 702 h.

The process 1500 then returns to step 1504 where, in one embodiment, the current state of the stimulation pattern is presented for a predetermined time. As described above, step 1506 is to determine whether to return the array to the starting position. In one embodiment, step 1516 is performed to return the array after it has moved to its furthest extent. Thus, the process 1500 depicts an embodiment in which the stimulation pattern is continuously propagated on the user's skin.

16A-16E illustrate one embodiment of displaying messages in a tactile stimulation interface; the "how are you" message will be presented over time. Fig. 16A to 16E show five different states of a stimulus pattern containing a message. Other intermediate states are not described. In fig. 16A, a "how" word is presented on the tactile stimulation interface 250. In fig. 16B, a portion of the letter "h" and the letter "o" have been deleted from the stimulus pattern. A portion of the letter "o" and the letter "h" remain in the stimulation pattern, but are located at different locations of the stimulation interface 250. In addition, the letter "a" has been added to the stimulus pattern. There may be multiple states between the states depicted in fig. 16A and 16B. The stimulation pattern is varied stepwise in fig. 16A and 16B. For example, the pattern may change one column at a time.

Fig. 16C shows a subsequent state in which the "are" word is presented in the stimulation interface 250. It is to be noted that the stimulus pattern is not directly from the state of fig. 16A to the state of fig. 16C in the present embodiment. Instead, in some states, only some of the letters of the "are" word are presented. In some states, a portion of the letters in the "are" word may be presented. Such techniques may allow a user to more quickly understand the content of the stimulus pattern. For example, the user may predict the words after the "how" word. Thus, even if the complete "are" word is not presented on the tactile stimulation interface 250, the user can predict which letters or words will appear next.

Fig. 16D and 16E show two subsequent states. Fig. 16E shows the word "you" on the tactile stimulation interface 250. FIG. 16D shows a state in which a portion of the "are" word and a portion of the "you" word are present. In this example, the user may predict that the word "you" follows the word "are". Therefore, even if only part of the information of the word "you" enters the pattern, the user can start to interpret the content.

It is noted that fig. 16B and 16D show examples of presenting two partial information elements simultaneously in the stimulation pattern. For example, in fig. 16B, the stimulus pattern simultaneously presents a portion of the word "how" (one information unit) and a portion of the word "are" (another information unit). In another example, in fig. 16D, the stimulus pattern simultaneously presents a portion of the "are" word (one information unit) and a portion of the "you" word (another information unit). Further, in fig. 16D, the stimulation pattern simultaneously presents a portion of the letter "R" (one information element) and a portion of the letter "O" (another information element). A "partial information unit" is defined herein as information that cannot express its intended meaning by itself because it is incomplete. Therefore, these partial information elements themselves may not be understood by the user. However, due to the continuous propagation of the stimulus pattern, the user may even recognize the meaning in the partial information unit. This applies both to the partial information elements that leave the stimulation pattern and to the partial information elements that enter the stimulation pattern.

In some embodiments, a long-short memory model (LSTM model) is used to control how the stimulation pattern is modified over time. As the stimulation pattern propagates, the signal elements may be modified (e.g., attenuated, enhanced, discarded, added, etc.) based on the LSTM model. The LSTM model may have an input gate, an output gate, and a forgetting gate. The three gates may calculate respective outputs based on the current time step (e.g., t) and the previous time step (e.g., t-1). In some embodiments, various weights may be applied to the gates, resulting in the final output of the LSTM model. In some embodiments, portions of the stimulation pattern decay over time. FIG. 17 is a flow diagram of one embodiment of a process 1700 for data attenuation in a stimulation pattern. In one embodiment, the process 1700 is based on the LSTM model. For ease of description, the tactile stimulation interface has stimulation elements 0 through n (n +1 elements total). In connection with the examples of fig. 7A to 8C, n is 7. In connection with the examples of fig. 7A-7C, element 702a is element 0, element 702b is element 1, … …, and element 702n is element n. In connection with the examples of fig. 8A-8C, element 802a is element 0, element 802b is element 1, … …, and element 802n is element n.

Step 1702: the stimulation elements (or tactile pixels) are activated or deactivated to present a stimulation pattern. The stimulation pattern may be in contact with the user's skin such that the stimulation pattern is presented on the user's skin. Step 1704: determining whether to proceed to a next state of the stimulation pattern. In one embodiment, each state is presented for a predetermined time before entering the next state.

Step 1706: the data in element 0 is deleted from the stimulus pattern. That is, the signal element presented in element 0 for the pre-stimulus pattern state is no longer part of the stimulus pattern. For example, starting from the state of fig. 7A to 7B, signal element S0 no longer appears in the stimulation pattern.

Step 1708: the element number is set to 1. Step 1710: it is checked whether the old element number is equal to n + 1. This check is used to determine if all elements in the array have been processed. If step 1710 is not true, the process 1700 continues with step 1712. Step 1712: the attenuation coefficient of the current element being processed is accessed. Each element has its own attenuation coefficient. In one embodiment, the attenuation coefficient is between 0 and 1 (inclusive). In one embodiment, the attenuation factor of 0 results in the loss of signal elements. In another embodiment, an enhancement factor is used instead of attenuation. That is, in one embodiment, the factor may be greater than 1 for certain elements.

Step 1714: attenuate and move the data in element i to element i + 1. For example, starting from the state of fig. 7A-7B, signal element S1 decays and moves from element 702B to element 702 a. Step 1716: the element number is increased. The process returns to step 1710. For example, through this process, signal element S2 may attenuate and move from element 702c to element 702 b. The attenuation coefficient applied to the signal S2 may be less than, equal to, or greater than the attenuation coefficient applied to the signal S1.

After all elements have been processed (yes at step 1710), the process continues at step 1718. Step 1718: new data is added to the stimulus pattern of the new element. For example, starting from the state of fig. 7A to 7B, a signal element S8 is added to the tactile pixel 702 h. It should be noted that a particular signal may decay multiple times over time as the signal propagates through the array.

In some embodiments, a three-dimensional object is represented in an array that includes the tactile stimulation interface 250. FIG. 18 illustrates one embodiment of how a three-dimensional object is represented. The tactile stimulation interface 250 includes a two-dimensional array of tactile pixels for presenting two dimensions of an object. In this example, two dimensions (e.g., x, y) of the heart are shown. In this embodiment, the third dimension (e.g., z) is represented by the propagation rate of the stimulus pattern. In particular, in one embodiment, the rate at which the stimulation pattern propagates in the x-direction defines depth (or z-dimension) information. The stimulation pattern may propagate at different rates in each row.

FIG. 19 is a flow diagram of one embodiment of a process 1900 for representing a three-dimensional object on a tactile stimulation interface 250. Step 1902: a first dimension and a second dimension spatially representing three-dimensional objects in the array. Referring to fig. 18, the x-and y-dimensions of the object are represented by tactile pixels. The first dimension and the second dimension may be part of a stimulation pattern. The stimulation pattern may be in contact with the user's skin such that the stimulation pattern is presented on the user's skin.

Step 1904: a third dimension representing the objects in the array in time. Referring to fig. 18, the propagation rate in each row of the array may be used to convey depth information. Thus, depth information may be conveyed using the propagation rates of the different regions.

Fig. 20 is a flow diagram of one embodiment of a process 2000 to temporally represent a third dimension of an object on a tactile stimulation interface 250. The process 2000 provides further details of one embodiment of step 1904. Step 2002: z-dimensional information for a row of the tactile stimulation interface 250 is accessed. In one embodiment, the z-dimension information is a constant value that may represent the average depth of the row. In one embodiment, the z-dimensional information is an array of values, each value representing a depth (or z-dimension) of a point of the object.

Step 2004: controlling a rate at which the stimulation pattern propagates in the rows according to the z-dimensional information. In one embodiment, the faster the propagation rate, the closer the object is to the user's reference point in the z-direction. In one embodiment, the constant propagation rate accounts for the average depth of the rows. In one embodiment, the change in propagation rate accounts for a change in depth of the row. In the latter embodiment, the propagation rate may be based on the above-described array of values, each value representing the depth (or z-dimension) of a point of the object. In the latter embodiment, each depth value in the array may be used once, or the depth values in the array may be cycled through repeatedly as long as a three-dimensional object is presented on the tactile stimulation interface 250. The process then returns to step 2002 to process the next row in the array. It is noted that for ease of description, the process 2000 describes processing each row separately. Multiple lines can be processed in parallel.

In some embodiments, the techniques described herein may be implemented using hardware, software, or a combination of both hardware and software. The software used is stored in the one or more processor readable storage devices to program the one or more processors to perform the functions described herein. The processor-readable storage device may include computer-readable media, such as volatile and non-volatile media, removable and removable media. By way of example, and not limitation, computer readable media may comprise computer readable storage media and communication media. Computer-readable storage media may be implemented in any method or technology for storage of information such as computer-readable instructions, data structures, program modules or other data. The computer readable storage medium is one example of a non-transitory computer readable medium. Computer-readable storage media include RAM, ROM, EEPROM, flash memory or other memory technology, CD-ROM, Digital Versatile Disks (DVD) or other optical disk storage, magnetic cassettes, magnetic tape, magnetic disk storage or other magnetic storage devices, or any other medium which can be used to store the desired information and which can be accessed by a computer. Computer-readable media do not include propagated, modulated, or transitory signals.

Communication media typically embodies computer readable instructions, data structures, program modules or other data in a propagated data signal, a modulated data signal, or a transitory data signal such as a carrier wave or other transport mechanism and includes any information delivery media. The term "modulated data signal" means a signal that has one or more of its characteristics set or changed in such a manner as to encode information in the signal. By way of example, and not limitation, communication media includes wired media such as a wired network or direct-wired connection, and wireless media such as RF and other wireless media. Combinations of the above are also included within the scope of computer-readable media.

In alternative embodiments, some or all of the software may be replaced by dedicated hardware logic components. Illustrative types of hardware Logic components that may be used include, but are not limited to, Field-Programmable Gate arrays (FPGAs), Application-specific Integrated circuits (ASICs), Application-specific Standard products (ASSPs), System-on-a-chips (SOCs), Complex Programmable Logic Devices (CPLDs), special purpose computers, and the like. In one embodiment, software (stored in a memory device) implementing one or more embodiments is used to program one or more processors. The one or more processors may communicate with one or more computer-readable media/storage devices, peripherals, and/or communication interfaces.

It should be understood that the inventive subject matter may be embodied in many different forms and should not be construed as limited to the embodiments set forth herein. Rather, these embodiments are provided so that this subject matter is thorough and will fully convey the invention to those skilled in the art. Indeed, the present subject matter is intended to cover alternatives, modifications, and equivalents of these embodiments, which may be included within the scope and spirit of the present subject matter as defined by the appended claims. Furthermore, in the following detailed description of the present subject matter, numerous specific details are set forth in order to provide a thorough understanding of the present subject matter. It will be apparent, however, to one skilled in the art that the present subject matter may be practiced without these specific details.

Aspects of the present invention are described herein in connection with flowchart illustrations and/or block diagrams of methods, apparatus (systems) and computer program products provided by embodiments of the invention. It will be understood that each block of the flowchart illustrations and/or block diagrams, and combinations of blocks in the flowchart illustrations and/or block diagrams, can be implemented by computer program instructions. These computer program instructions may be provided to a processor of a general purpose computer, special purpose computer, or other programmable data processing apparatus to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable instruction execution apparatus, create means for implementing the functions/acts specified in the flowchart and/or block diagram block or blocks.

The description of the present invention has been presented for purposes of illustration and description, and is not intended to be exhaustive or limited to the invention in any form disclosed. Many modifications and variations will be apparent to those of ordinary skill in the art without departing from the scope and spirit of the invention. The aspects of the invention were chosen and described in order to best explain the principles of the invention and the practical application, and to enable others of ordinary skill in the art to understand the invention for various modifications as are suited to the particular use contemplated.

For purposes herein, each flow associated with the disclosed technology may be performed continuously by one or more computing devices. Each step in the flow may be performed by the same or different computing device as used in the other steps, and each step need not be performed by a single computing device.

Although the subject matter has been described in language specific to structural features and/or methodological acts, it is to be understood that the subject matter defined in the claims is not necessarily limited to the specific features or acts described above. Rather, the specific features and acts described above are disclosed as example forms of implementing the claims.