阅读说明：本技术 用于分发头部相关传递函数滤波器的布置 (Arrangement for distributing head-related transfer function filters ) 是由 A·J·万涅 于 2019-08-12 设计创作，主要内容包括：本发明题为“用于分发头部相关传递函数滤波器的布置”。本公开涉及用于分发头部相关传递函数滤波器的布置。在该布置中，用户设备向正在使用的服务发送对头部相关传递函数滤波器的请求。该服务验证设备的用户在正在使用的服务中是否具有对头部相关传递函数滤波器的订阅，并检索滤波器作为对肯定验证结果的响应。该服务可过滤音频通道并进一步传输经过滤的音频。在一个另选的实施方案中，该服务将滤波器传输至用户设备以过滤音频。(The invention is entitled "arrangement for distributing head related transfer function filters". The present disclosure relates to an arrangement for distributing head-related transfer function filters. In this arrangement, the user equipment sends a request for a head-related transfer function filter to the service being used. The service verifies whether the user of the device has a subscription to the header-related transfer function filter in the service being used and retrieves the filter as a response to a positive verification result. The service may filter the audio channels and further transmit the filtered audio. In an alternative embodiment, the service transmits a filter to the user device to filter the audio.)

1. A method for distributing a head-related transfer function filter, the method comprising:

receiving a request for a service from a user equipment;

determining availability of a subscription for HRTF filters for the requested service;

sending a request for a filter to a filter server;

receiving a filter from a filter server;

characterized in that the method further comprises one of the following operations:

-filter the audio channels using the received filters and transmit the filtered audio channels to the requesting user equipment; or

-transmitting the received filter to the requesting user equipment for filtering the audio channels at the requesting device.

2. The method of claim 1, wherein the filtering comprises filtering a plurality of audio channels into a smaller number of audio channels.

3. The method of claim 2, wherein the smaller number of audio channels is two.

4. The method of claim 3, wherein the request for a filter comprises at least one of: user identification, application identification, audio format identification, and user equipment identification.

5. The method of claim 1, wherein the request for a filter comprises at least one of: user identification, application identification, audio format identification, and user equipment identification.

6. The method of claim 1, wherein the user device comprises a headset.

7. A computer readable medium comprising a stored program for execution by a server in distributing a header-dependent transfer function filter,

wherein the server:

receiving a request for a service from a user equipment;

determining availability of a subscription for the requested service;

sending a request for a filter to a filter server;

receiving a filter from the filter server; and

performing one of the following operations: i) filter audio channels using the received filter and transmit the filtered audio channels to a requesting user device, or ii) transmit the received filter to the requesting user device for filtering the audio channels at the requesting device.

8. The computer-readable medium of claim 7, wherein the filtering comprises filtering a plurality of audio channels into a smaller number of audio channels.

9. The computer-readable medium of claim 8, wherein the smaller number of audio channels is two.

10. The computer-readable medium of claim 9, wherein the request for a filter comprises at least one of: user identification, application identification, audio format identification, and user equipment identification.

11. The computer-readable medium of claim 7, wherein the request for a filter comprises at least one of: user identification, application identification, audio format identification, and user equipment identification.

12. The computer-readable medium of claim 7, wherein the user device comprises a headset.

13. An apparatus for distributing head-related transfer function filters, the apparatus comprising:

at least one processor (111) configured to execute a computer program;

at least one memory (112) configured to store a computer program and related data; and

at least one data communication interface (113) configured to communicate with an external data communication network;

wherein the at least one processor is configured by the computer program and associated data to

Receiving a request for a service from a user equipment;

determining availability of a subscription for the requested service;

sending a request for a filter to a filter server;

receiving a filter from the filter server; and

performing one of the following operations: i) filter audio channels using the received filter and transmit the filtered audio channels to a requesting user device, or ii) transmit the received filter to the requesting user device for filtering the audio channels at the requesting device.

14. The apparatus of claim 13, wherein the filtering comprises filtering a plurality of audio channels into a smaller number of audio channels.

15. The apparatus of claim 14, wherein the smaller number of audio channels is two.

16. The apparatus of claim 15, wherein the request for a filter comprises at least one of: user identification, application identification, audio format identification, and user equipment identification.

17. The apparatus of claim 13, wherein the request for a filter comprises at least one of: user identification, application identification, audio format identification, and user equipment identification.

18. The apparatus of claim 13, wherein the user equipment comprises a headset.

Background

Audio systems with multiple audio channels are generally known and used by the entertainment industry for example for movies or computer games. These systems are often referred to as surround sound systems or three-dimensional sound systems. Arrangements for achieving an even better three-dimensional sound experience have recently been introduced. These arrangements not only have multiple audio channels, but also provide object-based audio to improve the listening experience.

In a conventional approach, each of a plurality of audio channels is provided to a user of a sound system. The audio channels are typically received at an amplifier or similar device that distributes the audio channels to respective speakers that are connected to the amplifier. The amplifier may modify the received audio channels, thereby adjusting playback to the number and location of speakers.

More recently, arrangements have been developed that provide a similar experience using headphones. Typically in headphone listening, these arrangements are based on filtering the channels using so-called head-related transfer function filters. A three-dimensional experience is created by manipulating the sounds in the two audio channels of the earpiece so that they resemble directional sounds that reach the ear canal. By taking into account the effects of the pinna, head and torso on sound entering the ear canal, it is possible to achieve a three-dimensional sound experience. These filters are often referred to as HRTF (head related transfer function) filters. These filters are used to provide an effect similar to the human experience of sound from different directions and distances. When the anatomy of human body parts, such as ears, head and torso, is known, personal HRTF filters can be generated so that the sound experienced through headphones is as realistic as possible.

The field of providing realistic audio systems is constantly evolving. Thus, there is a need to improve both audio quality and the effective distribution of audio.

Disclosure of Invention

An arrangement for distributing head-related transfer function filters is disclosed herein. In this arrangement, the user equipment sends a request for a head-related transfer function filter to the service being used. The service verifies whether the user of the device has a subscription to the header-related transfer function filter in the service being used and retrieves the filter as a response to a positive verification result. The service may filter the audio channels and further transmit the filtered audio. In an alternative embodiment, the service transmits a filter to the user device to filter the audio.

In one aspect, a method for distributing a head-related transfer function filter is disclosed. In the method, a request for a service is first received from a user equipment. Then, availability of a subscription to the HRTF filters of the requested service is determined. If the service is available, the method further includes sending a request for a filter to a filter server. A filter is received from a filter server in response to the transmitted request. The filter is a head-related transfer function filter designed for the user and possibly also for the device, audio format or listening settings the user is using.

In one embodiment, the method further includes filtering the audio channels using the received filter and transmitting the filtered audio channels to the requesting user device. In another embodiment, the method further comprises transmitting the received filter to a requesting user device for filtering audio channels at the requesting device.

It is beneficial to implement the retrieval of the filter in the server or service that the user actually wishes to use. This enables the service to check whether the user has enabled the head-related transfer function filter in a particular service, and the correct filter can be retrieved based on the service information. Furthermore, when the service filters the audio channels, the original audio channels do not need to be transmitted, and thus transmission bandwidth can be saved.

In a particular implementation, filtering includes filtering a plurality of audio channels into a smaller number of audio channels. This is beneficial because it reduces bandwidth.

In a specific implementation, the smaller number of audio channels is two. This is beneficial especially when the user uses a headset with only two channels. This provides the possibility to use three-dimensional (possibly with multiple sound sources) audio channels with a bandwidth of two channels.

In a specific implementation, the request for the filter includes at least one of: a user identity, an application identity and a user equipment identity. Advantageously, the filter may be selected by using all parameters having an impact on the audio generation.

In a particular implementation, the user equipment includes a headset. Advantageously, the filters may be generated per a particular headphone model such that they account for differences in frequency response between different headphone models.

In one aspect, a computer program for a server is disclosed. The computer program comprises code adapted to cause the above-described method to be performed.

In another aspect, an apparatus is disclosed. The apparatus includes at least one processor configured to execute a computer program; at least one memory configured to store a computer program and related data; and at least one data communication interface (113) configured to communicate with an external data communication network. The apparatus is configured to perform the method as disclosed above. The method may be performed by a computer program as disclosed above.

Drawings

The accompanying drawings, which are included to provide a further understanding of the arrangement for distributing head related transfer function filters and are incorporated in and constitute a part of this specification, illustrate embodiments of the arrangement for distributing head related transfer function filters and together with the description help to explain the principles of the arrangement. In the drawings:

figure 1 is an example of an apparatus in an example system for distributing head-related transfer function filters,

FIG. 2 is an example of a method for distributing head-related transfer function filters, an

Fig. 3 is another example of a method for distributing a head-related transfer function filter.

Detailed Description

Reference will now be made in detail to the embodiments, examples of which are illustrated in the accompanying drawings.

In the following examples of fig. 1 to 3, the most common application of headphone listening is described. However, similar principles can be used to filter sound for different speaker arrangements.

In fig. 1, an example of a system includes an apparatus 100 configured to distribute a head-related transfer function filter, an apparatus 110 configured to provide streaming services, and an end-user apparatus 120 configured to receive and repeat streams.

The apparatus 100 is typically operated by a service provider and may be implemented in the form of a server, cloud computing resource, database, or similar to the request to retrieve a pre-stored header-related transfer function filter.

The apparatus 100 comprises at least one processor 101, at least one memory 102 and at least one network connection 103. The at least one memory may include volatile memory and non-volatile memory. Typically, it comprises at least one non-volatile memory to store head related transfer function filters belonging to different users. The at least one memory 102 may comprise a database and it is not physically necessary in the same device, but may take the form of several different computing units forming one logical service or computing resource.

The apparatus 100 is configured to receive a request over a network connection 103. The network connection may be any commonly known interface to a data communications network, such as the internet.

Requests received over the network connection 103 are processed by at least one processor 101. The request is processed to extract the identification of the head-related transfer function filter from the request and the corresponding head-related transfer function filter is retrieved using the at least one network connection 103 and provided as a response to the request.

The identification of the head-related transfer function filter may be unique for the user or even unique for different devices or device models that have been assigned to someone. Thus, one may have several head-related transfer function filters stored, and in addition to the user, the request also identifies the device on which the user is retrieving the head-related transfer function filters.

The apparatus 110 is configured to provide streaming services such as music or movie services or any other service including providing audio streams with or without other information. The apparatus 110 comprises at least one processor 111, at least one memory 112 and at least one network connection. The at least one memory 112 may comprise a database and it is not physically necessary in the same device, but may take the form of several different computing units forming one logical service or computing resource.

The device 110 receives service requests over the network connection 113 and processes these requests using at least one processor 111. Based on the request, the device 110 extracts an identification for the head-related transfer function filter from the service request and generates a request including the identification. The generated request is then sent to the device 110. In response to the request, the device 110 receives a head-related transfer function filter from the device 100 (the device 100 provides the head-related transfer function filter to the device 110 as a response to the request). The received head-related transfer function filters are stored in at least one memory 112.

After receiving the header-dependent transfer function filter, the device 110 provides the requested streaming service to the end-user device 120 that has requested the streaming service. The service stream is modified from the standard stream such that the device 110 processes the audio stream, possibly associated with additional information, using the at least one processor 111. For example, the audio stream may be a movie soundtrack played along with a video stream of a movie. When processing an audio stream, the apparatus 110 is configured to use the received head-related transfer function filters to form a filtered audio stream, typically comprising two channels. This reduces the need for data transmission bandwidth and also eliminates the need for an end-user device that is capable of modifying the audio stream according to the head-related transfer function. Furthermore, when the demanding computations are done on the service provider side, the need for computing power at the end-user device is reduced.

The end-user device 120 is typically a mobile phone to which a computer, tablet device such as an iPad, or headset 125 is attached. The end-user device comprises at least one processor 121, at least one memory 122, at least one network connection 123, and at least one audio device 124 capable of producing sound using headphones 125. The end user sends a request for streaming services to device 110 and, in response, receives the stream transmitted by device 120. At least one processor 121 processes the received stream, which typically requires decoding. The audio portion of the stream is then transmitted to the audio device 124, which provides the audio stream in the appropriate format to the headphones 125.

In the above arrangement, information regarding the availability of the head-related transfer function may be included in the subscription information typically stored at the device 110. The initial request received from the end-user device may have further information about which, if any, head-related transfer function filters were received. This facilitates the possibility of sharing subscriptions within a home, for example.

An example method is shown in fig. 2. The method of fig. 2 is implemented in a streaming service or the like. Typically, such streaming services are implemented using computing resources that include several servers that operate together to provide services to a large number of clients. In the following description, a service is referred to as a server, but it should be understood that this may be, and in many cases is, a virtual server that appears as a service to a client.

The method is initiated at a server (step 200) when the server (such as apparatus 110 of fig. 1) receives a request for a streaming service from an end-user device (such as apparatus 120). Initiation may include several tasks such as authentication of the user, determining the service level of the subscription, and selecting a stream to stream, such as a movie. Further, the request may include information about the level of service the user wishes to have, such as a preferred resolution or sound quality.

Determining the service level may involve checking the number of simultaneous streams allowed, image quality or audio quality. Determining the audio quality used comprises determining a subscription to a head-related transfer function filter service (step 201). This information may be stored in the user information at the streaming service, or may be requested from a server that provides the actual header-related transfer function filter, or both. Alternative methods for checking the availability of available subscriptions may also be implemented.

If the user has indicated that he wishes to use headphones with an audio track enhanced with a head-related transfer function filter, and the person has an appropriate subscription to the service, the streaming server sends a request for a head-related transfer function filter to a head-related transfer function filter service (step 202), such as the device 100 of fig. 1. The request may include, for example, an identification of a person who wishes to have a head-related transfer function filter and an identification of the headphones used. In addition to identifying the headphones used, similar identification is used to identify the type of application, the audio format used, and similar information. It should be noted that if multiple people wish to receive the same stream at the same time at the same location, the request may contain a request for several people. This situation occurs, for example, when two people are watching the same movie.

In response to the request, a head-related transfer function filter is received (step 203). The filter or filters are stored to the streaming service for later use. The filter is then used in processing the audio track of the stream (step 204). Modern movies may have a very large number of audio channels or sources. The streaming service processes the audio track into two channels of headphones using the received head-related transfer function (step 204). This reduces the bandwidth required to transmit the audio track. It should be noted that even if the streaming service generates a single audio track for multiple users, bandwidth can still be saved, as each person only needs two channels, instead of the typically large number of audio channels and audio sources available in modern movies.

Finally, the streaming server transmits the stream to one or more users (step 205). The user receives his customized audio track on his headphones. The sound produced at the headphones is realistic and provides a three-dimensional perception of the audio scene. This enhances the user experience by facilitating the experience of the generated audio, as it is generated by a large number of speakers or experienced in the field.

The examples disclosed in fig. 1 and 2 provide a streaming service that includes modifying the content of the transmitted signal in such a way that the physical signal sent to the end user is different from the arrangement in which the audio signal was not modified.

In fig. 3, another example of a method that may be used in an arrangement similar to that of fig. 1 is disclosed. The exemplary method is initiated by receiving a request for a game session (step 300). The game session is different from an application from a streaming service because it generally requires faster, preferably real-time, game events and user movement.

At step 301, the availability of an HRTF subscription may be determined, as this is determined for a streaming service. Based on the availability information, a request for a filter is generated (step 302). In this example, the request for the filter includes additional information. This additional information may be, for example, a description of the space in which the game user is currently located, so that the filter will be able to produce audio appropriate to that space. The request may be, and is typically formed from, a requesting application, which in this context is a game. Thus, the request includes information about the user for verifying the subscription and also for retrieving physical metrics useful in generating or selecting the requested filter.

The request is then sent to the filter service (step 303). The filter service may select an earlier generated filter for the user or generate a filter specifically matched to the request. The filter is then received at the requesting device (step 304). The filter is then further transmitted to the device being used by the user (step 305). This step may include additional steps such as switching the audio mode of the game to a particular mode that takes into account the filter at the user terminal.

Finally, the user receives the filter at the user device and begins applying it to the audio tracks belonging to the game (step 306). The user device and filters now produce an audio experience in the following manner employed by the game server: by modifying the audio track, the actual sound signal is modified and thus different when compared to the audio track without the filter.

The above examples focus on the space where a single person or other person using the headset is not disturbed. However, for a group of people where one or more devices use the same speaker arrangement, similar principles can be used using the speaker arrangement. For example, in a car, music may be played to all people, but the navigation instructions are filtered so that the music may be heard in the driver's seat, but in a manner so that the listening to the music does not interfere with others. In this case, the car is a user device and it is typically connected to a server, such as a server of the car manufacturer, and it may request one or more filters, e.g. based on the car's occupancy.

As mentioned above, components of the exemplary embodiments can include computer-readable media or memories for holding instructions programmed according to the teachings of the inventions and for holding data structures, tables, records, and/or other data described herein. Computer-readable media may include any suitable media that participates in providing instructions to a processor for execution. Common forms of computer-readable media may include, for example, a floppy disk, a flexible disk, hard disk, magnetic tape, any other suitable magnetic medium, a CD ROM, CD + -R, CD + -RW, DVD-RAM, DVD + -RW, DVD + -R, HD DVD-R, HD DVD-RW, HD DVD-RAM, Blu-ray disk, any other suitable optical medium, a RAM, a PROM, an EPROM, a FLASH-EPROM, any other suitable memory chip or cartridge, or any other suitable medium from which a computer can read.

It is obvious to a person skilled in the art that with the advancement of technology, the basic idea for distributing the arrangement of head-related transfer function filters can be implemented in various ways. The arrangement for distributing the head-related transfer function filters and the embodiments thereof are thus not limited to the above examples; rather, they may vary within the scope of the claims.