阅读说明：本技术 用于个性化声传递函数的动态确定的音频系统 (Audio system for dynamic determination of personalized acoustic transfer functions ) 是由 拉维什·迈赫拉 安东尼奥·约翰·米勒 弗拉迪米尔·图尔巴宾 于 2019-05-21 设计创作，主要内容包括：本发明涉及用于个性化声传递函数的动态确定的音频系统。一种眼镜装置包括音频系统。在一个实施方式中,音频系统包括麦克风阵列,该麦克风阵列包括多个声传感器。每个声传感器被配置为检测麦克风阵列周围的局部区域内的声音。针对多个检测到的声音,音频系统执行到达方向(DoA)估计。基于检测到的声音的参数和/或DoA估计,音频系统然后可以生成或更新对用户唯一的一个或多个声传递函数。音频系统可以使用一个或多个声传递函数来为用户生成音频内容。(The invention relates to an audio system for dynamic determination of a personalized acoustic transfer function. An eyewear apparatus includes an audio system. In one embodiment, an audio system includes a microphone array including a plurality of acoustic sensors. Each acoustic sensor is configured to detect sound within a local area around the microphone array. The audio system performs direction of arrival (DoA) estimation for a plurality of detected sounds. Based on the detected parameters of the sound and/or the DoA estimate, the audio system may then generate or update one or more acoustic transfer functions that are unique to the user. The audio system may use one or more acoustic transfer functions to generate audio content for the user.)

1. An audio system, comprising:

a microphone array comprising a plurality of acoustic sensors configured to detect sound within a local area around the microphone array, and at least some of the plurality of acoustic sensors are coupled to a near-eye display (NED);

a controller configured to:

estimating a direction of arrival (DoA) of the detected sound relative to a location of the NED within the local region; and is

Based on the estimate of the DoA, a transfer function associated with the audio system is updated.

2. The audio system of claim 1, wherein the transfer function is at least one of: a Head Related Transfer Function (HRTF) associated with the location of the NED within the local region and an Array Transfer Function (ATF) associated with the microphone array.

3. The audio system of claim 1, wherein the controller is further configured to:

identifying a source of the detected sound relative to the location of the NED.

4. The audio system of claim 1, wherein at least one of the plurality of acoustic sensors is placed inside an ear canal of a user.

5. The audio system according to claim 1, wherein at least some of the plurality of acoustic sensors are placed on a collar coupled to the NED and configured to be placed around a user's neck.

6. The audio system of claim 1, wherein the controller is further configured to:

identifying a second one of the detected sounds;

estimating a second DoA of the second detected sound relative to a second location of the NED within the local region;

determining that the second detected sound has an associated parameter within a threshold of a target parameter; and is

Generating a second transfer function based on the estimate of the second DoA, the second transfer function associated with the second location of the NED within the local region.

7. The audio system of claim 1, wherein the controller is further configured to:

identifying a second one of the detected sounds;

estimating a second DoA of the second detected sound relative to a second location of the NED within the local region;

determining that the second detected sound has an associated parameter within a threshold of a target parameter;

updating a pre-existing transfer function associated with the second location of the NED within the local region based on the estimate of the second DoA.

8. The audio system of claim 7, wherein a parameter describes a characteristic of the detected sound, the characteristic selected from the group consisting of frequency, amplitude, duration, and DoA.

9. The audio system of claim 1, further comprising:

a speaker component configured to provide audio content customized to a user based in part on the transfer function.

10. The audio system of claim 1, wherein the controller is further configured to determine the location of the NED based in part on at least one of: depth information of the local region and Inertial Measurement Unit (IMU) data for the NED.

11. The audio system of claim 9, wherein the depth information is from a depth camera component and the IMU data is from an IMU.

12. The audio system of claim 1, wherein the detected sound is an ambient sound.

13. A method, comprising:

monitoring, by a microphone array comprising a plurality of acoustic sensors, sound in a local area around the microphone array, and at least some of the plurality of acoustic sensors are coupled to a near-eye display (NED);

estimating a direction of arrival (DoA) of the detected sound relative to a location of the NED within the local region; and is

Updating a transfer function associated with the NED based on the estimate of the DoA.

14. The method of claim 13, wherein the transfer function is at least one of: a Head Related Transfer Function (HRTF) associated with the location of the NED within the local region and an Array Transfer Function (ATF) associated with the microphone array.

15. The method of claim 13, further comprising:

identifying a source of the detected sound relative to the location of the NED.

16. The method of claim 13, wherein at least one of the plurality of acoustic sensors is placed inside an ear canal of a user.

17. The method according to claim 13, wherein at least some of the plurality of acoustic sensors are placed on a collar coupled to the NED and configured to be placed around a user's neck.

18. The method of claim 13, further comprising:

identifying a second one of the detected sounds;

estimating a second DoA of the second detected sound relative to a second location of the NED within the local region;

determining that the second detected sound has an associated parameter within a threshold of a target parameter; and is

Generating a second transfer function based on the estimate of the second DoA, the second transfer function associated with the second location of the NED within the local region.

19. The method of claim 13, further comprising:

identifying a second one of the detected sounds;

estimating a second DoA of the second detected sound relative to a second location of the NED within the local region;

determining that the second detected sound has an associated parameter within a threshold of a target parameter; and is

Updating a pre-existing transfer function associated with the second location of the NED within the local region based on the estimate of the second DoA.

20. The method of claim 19, wherein a parameter describes a characteristic of the detected sound, the characteristic selected from the group consisting of frequency, amplitude, duration, and DoA.

21. The method of claim 13, further comprising:

generating audio content customized to the user based in part on the transfer function.

22. The method of claim 13, further comprising:

determining the location of the NED based in part on at least one of: depth information and Inertial Measurement Unit (IMU) data of the local region.

23. The method of claim 22, wherein the depth information is from a depth camera component and the IMU data is from an IMU.

24. The method of claim 13, wherein the detected sound is an ambient sound.

25. A non-transitory computer-readable medium storing instructions that, when executed by one or more processors, cause the one or more processors to perform operations comprising:

monitoring, by a microphone array comprising a plurality of acoustic sensors, sound in a local area around the microphone array, and at least some of the plurality of acoustic sensors are coupled to a near-eye display (NED);

estimating a direction of arrival (DoA) of the detected sound relative to a location of the NED within the local region; and is

Updating a transfer function associated with the NED based on the estimate of the DoA.

Technical Field

The present disclosure relates generally to stereo acoustics, and in particular to an audio system for dynamic determination of a personalized acoustic transfer function for a user.

Background

The sound perceived in both ears may differ depending on the direction and positioning of the sound source relative to each ear and the surrounding environment of the room in which the sound is perceived. Humans can determine the location of a sound source by comparing the sound perceived in each ear. In "surround sound" systems, multiple speakers use an acoustic transfer function to reproduce the directional aspect of the sound. The acoustic transfer function represents the relationship between the sound at its source location and how it is detected, for example by a microphone array or an individual. A single microphone array (or a person wearing the microphone array) may have several associated acoustic transfer functions for several different source placements in a local area around the microphone array (or around the person wearing the microphone array). Furthermore, the acoustic transfer function for the microphone array may be different based on the location and/or orientation of the microphone array in the local area. Furthermore, the acoustic sensors of the microphone array may be arranged in a large number of possible combinations and, thus, the associated acoustic transfer function is unique to the microphone array. Thus, determining the acoustic transfer function of each microphone array may require a direct evaluation, which may be a lengthy and expensive process in terms of time and resources required.

Disclosure of Invention

Drawings

Fig. 1 is a diagram illustrating an example of an eyewear apparatus including a microphone array according to one or more embodiments.

Fig. 2 is a diagram illustrating an example of a portion of an eyewear apparatus including an acoustic sensor as a microphone on a user's ear in accordance with one or more embodiments.

Fig. 3 is a diagram illustrating an example of an eyeglass apparatus including a neckband according to one or more embodiments.

FIG. 4 is a block diagram of an audio system in accordance with one or more embodiments.

Fig. 5 is a flow diagram illustrating a process of generating and updating a head-related transfer function of an eyewear apparatus including an audio system in accordance with one or more embodiments.

Fig. 6 is a system environment of an eyewear apparatus including an audio system in accordance with one or more embodiments.

The figures depict embodiments of the present disclosure for purposes of illustration only. One skilled in the art will readily recognize from the following description that alternative embodiments of the structures and methods illustrated herein may be employed without departing from the principles or fair benefits of the present disclosure described herein.

Embodiments relate to an audio system for dynamically determining an acoustic transfer function. The acoustic transfer function characterizes how sound is received from a point in space. In particular, the acoustic transfer function defines a relation between parameters of the sound at its source location and parameters of the sound detected, for example, by the microphone array or the ear of the user. The acoustic transfer function may be, for example, an Array Transfer Function (ATF) and/or a Head Related Transfer Function (HRTF). In one embodiment, an audio system includes a microphone array including a plurality of acoustic sensors. Each acoustic sensor is configured to detect sound within a local area around the microphone array. At least some of the plurality of acoustic sensors are coupled to a near-eye display (NED). The audio system further includes a controller configured to estimate a direction of arrival (DoA) of the sound detected by the microphone array relative to a location of the NED within the local area. Based on the parameters of the detected sound, the controller generates or updates an acoustic transfer function associated with the audio system. Each acoustic transfer function is associated with a particular location of the NED within the local region, such that the controller generates or updates a new acoustic transfer function as the location of the NED changes within the local region. In some implementations, the audio system generates audio content for a user wearing the NED using one or more acoustic transfer functions.

In some implementations, a method for dynamically determining an acoustic transfer function is described. The microphone array monitors sound in a local area around the microphone array. The microphone array includes a plurality of acoustic sensors. At least some of the plurality of acoustic sensors are coupled to a near-eye display (NED). A direction of arrival (DoA) of the detected sound relative to a position of the NED within the local region is estimated. Based on the DoA estimate, the acoustic transfer function associated with the NED is updated. The acoustic transfer function may be an array transfer function, e.g. a microphone array, or an HRTF associated with the user. In some implementations, a computer-readable medium may be configured to perform the steps of the method.