Sound effect output device, arithmetic device and sound effect control method thereof
阅读说明：本技术 音效输出装置、运算装置及其音效控制方法 (Sound effect output device, arithmetic device and sound effect control method thereof ) 是由 杜博仁 张嘉仁 曾凱盟 于 2018-07-20 设计创作，主要内容包括：本发明公开了一种音效输出装置、运算装置及其音效控制方法。音效控制方法包括以下步骤。接收一左声道原始信号及一右声道原始信号。转换该左声道原始信号及该右声道原始信号为一虚拟声源的一左声道虚拟信号及一右声道虚拟信号。检测该使用者的一转动角度。依据该转动角度,转换该左声道虚拟信号及该右声道虚拟信号为一左声道更新信号及一右声道更新信号。(The invention discloses sound effect output devices, arithmetic devices and a sound effect control method thereof, wherein the sound effect control method comprises the following steps of receiving left channel original signals and right channel original signals, converting the left channel original signals and the right channel original signals into left channel virtual signals and right channel virtual signals of a virtual sound source, detecting rotation angle of a user, and converting the left channel virtual signals and the right channel virtual signals into left channel update signals and right channel update signals according to the rotation angle.)
1, sound effect control method, comprising:
receiving a left channel original signal and a right channel original signal;
converting the original left channel signal and the original right channel signal into a left channel virtual signal and a right channel virtual signal of an virtual sound source;
detecting a user's degree of rotation, an
According to the rotation angle, the left channel virtual signal and the right channel virtual signal are converted into left channel update signals and right channel update signals.
2. The sound-effect control method of claim 1 wherein the step of converting the left channel original signal and the right channel original signal into the left channel virtual signal and the right channel virtual signal of the virtual sound source comprises:
obtaining a virtual sound source position relative to of the user;
obtaining four characteristic functions of the virtual sound source corresponding to left ear and right ear according to the position of the virtual sound source, and
and obtaining the left channel virtual signal and the right channel virtual signal according to the left channel original signal, the right channel original signal and the characteristic functions.
3. The sound effect control method of claim 2 wherein the step of converting the left channel virtual signal and the right channel virtual signal into the left channel update signal and the right channel update signal according to the rotation angle comprises:
obtaining virtual sound source updated position of the virtual sound source relative to the user according to the rotation angle, and
and obtaining the left channel updating signal and the right channel updating signal according to the left channel virtual signal, the right channel virtual signal and the virtual sound source updating position.
4. The sound effect control method of claim 3 wherein the virtual sound sources include st virtual speaker and 0 second virtual speaker, the virtual sound source locations include the th relative angle of the virtual speaker to the user and the second relative angle of the virtual speaker to the user, and the virtual sound source update locations include the th relative update angle of the virtual speaker to the user and the second relative update angle of the virtual speaker to the user .
5, A sound effect output device, comprising:
a receiving unit for receiving left channel original signal and right channel original signal;
a conversion unit for converting the original left channel signal and the original right channel signal into left channel virtual signal and right channel virtual signal of virtual sound source;
detecting unit for detecting rotation angle of of user;
a second conversion unit for converting the left channel virtual signal and the right channel virtual signal into left channel update signal and right channel update signal according to the rotation angle;
left channel output unit for outputting the left channel update signal, and
right channel output unit, for outputting the right channel update signal.
6. The sound effect output device of claim 5 wherein the st converting unit comprises:
a virtual position calculator to obtain virtual sound source position relative to the user's virtual sound source;
function calculator for obtaining four characteristic functions of the virtual sound source corresponding to left ear and right ear according to the virtual sound source position, and
a virtual signal calculator for obtaining the left channel virtual signal and the right channel virtual signal according to the left channel original signal, the right channel original signal and the characteristic functions.
7. The sound effect output device of claim 6 wherein the second converting unit comprises:
an updated position calculator for obtaining an updated position of the virtual sound source relative to the virtual sound source of the user according to the rotation angle, and
update signal calculator for obtaining left channel update signal and right channel update signal according to the left channel virtual signal, the right channel virtual signal and the virtual sound source update position.
8. The audio output device of claim 7 wherein the virtual sound sources include st virtual speaker and 0 second virtual speaker, the virtual sound source locations include a relative angle of the st virtual speaker to the th of the user and a second relative angle of the second virtual speaker to the of the user, and the virtual sound source update locations include a relative update angle of the st virtual speaker to the th of the user and a second relative update angle of the second virtual speaker to the of the user.
9, arithmetic device, which is connected to sound effect output device, the arithmetic device includes:
a receiving unit for receiving left channel original signal and right channel original signal;
a conversion unit for converting the original left channel signal and the original right channel signal into left channel virtual signal and right channel virtual signal of virtual sound source;
detecting unit for detecting user's rotation angle, and
a second conversion unit for converting the virtual left channel signal and the virtual right channel signal into left channel update signal and right channel update signal according to the rotation angle, the left channel update signal and the right channel update signal are transmitted to the audio output device.
10. The computing device of claim 9, wherein the conversion unit comprises:
a virtual position calculator to obtain virtual sound source position relative to the user's virtual sound source;
function calculator for obtaining four characteristic functions of the virtual sound source corresponding to left ear and right ear according to the virtual sound source position, and
a virtual signal calculator for obtaining the left channel virtual signal and the right channel virtual signal according to the left channel original signal, the right channel original signal and the characteristic functions.
11. The computing device of claim 10, wherein the second conversion unit comprises:
an updated position calculator for obtaining an updated position of the virtual sound source relative to the virtual sound source of the user according to the rotation angle, and
update signal calculator for obtaining left channel update signal and right channel update signal according to the left channel virtual signal, the right channel virtual signal and the virtual sound source update position.
12. The computing device of claim 11, wherein the virtual sound source comprises th virtual speaker and 0 second virtual speaker, wherein the virtual sound source locations comprise th th relative angle of the virtual speaker to the user and second relative angle of the second virtual speaker to the user, and wherein the virtual sound source update locations comprise th relative update angle of the th virtual speaker to the user and second relative update angle of the second virtual speaker to the user.
Technical Field
The present invention relates to sound effect output devices, computing devices and sound effect control methods thereof, and more particularly, to two-channel sound effect output devices, computing devices and sound effect control methods thereof.
Background
Taking a head-mounted display (HMD) as an example, a user wears the HMD and displays a Virtual Reality (VR) picture in front of the eye, and as the user moves or rotates, the HMD may present a corresponding picture to make the user feel in a certain virtual scene.
However, in the current application, although the picture can change along with the rotation of the user, the sound signal is still unchanged, so that the presence of the user is greatly reduced.
Disclosure of Invention
The invention relates to sound effect output devices, arithmetic devices and sound effect control methods thereof, which convert sound signals according to the rotation of a user so as to improve the presence of the user.
According to of the present invention, sound effect control methods are provided, the sound effect control methods include receiving a left channel original signal and a right channel original signal, converting the left channel original signal and the right channel original signal into a left channel virtual signal and a right channel virtual signal of a virtual sound source, detecting a rotation angle of the user, and converting the left channel virtual signal and the right channel virtual signal into a left channel update signal and an right channel update signal according to the rotation angle.
According to a second aspect of the present invention, an sound effect output device is provided, wherein the sound effect output device includes a receiving unit, a 0 st 1 converting unit, a 2 detecting unit, a 3 second converting unit, a 4 left channel output unit, and a 5 right channel output unit, the receiving unit is configured to receive 6 left channel original signals and right channel original signals, the converting unit is configured to convert the left channel original signals and the right channel original signals into left channel virtual signals and right channel virtual signals of a virtual sound source, the detecting unit is configured to detect a rotation angle of the user, the second converting unit is configured to convert the left channel virtual signals and the right channel virtual signals into left channel update signals and right channel update signals, the left channel output unit is configured to output the left channel update signals, and the right output unit is configured to output the right channel update signals.
According to a third aspect of the present invention, there are provided computing devices connected to a audio output device, the computing devices including a 0 receiving unit, a 1 st 2 th converting unit, a 3 detecting unit and a 4 second converting unit, the receiving unit being configured to receive 5 left channel original signals and right channel original signals, the converting unit being configured to convert the left channel original signals and the right channel original signals into left channel virtual signals and right channel virtual signals of a virtual sound source, the detecting unit being configured to detect a rotation angle of the user, the second converting unit being configured to convert the left channel virtual signals and the right channel virtual signals into left channel updated signals and right channel updated signals according to the rotation angle, the left channel updated signals and the right channel updated signals being transmitted to the audio output device.
In order to better appreciate the above and other aspects of the present invention, reference will now be made in detail to the embodiments illustrated in the accompanying drawings.
Drawings
FIG. 1 shows a schematic diagram of a sound effect output device, a head mounted display and a computing device implemented according to .
FIG. 2 is a block diagram of an audio output device.
FIG. 3 is a flowchart illustrating an embodiment of a sound effect control method according to .
Fig. 4 shows a schematic diagram of a virtual sound source.
Fig. 5 illustrates the rotation of the user.
FIG. 6 shows a schematic diagram of a sound effect output device, a head mounted display and a computing device implemented according to another .
Wherein, the reference numbers:
100. 100': sound effect output device
110: receiving unit
th conversion unit
121: virtual position calculator
122: function calculator
123: virtual signal calculator
130: detection unit
140: second conversion unit
141: update position calculator
142: update signal calculator
150: left channel output unit
160: right channel output unit
200. 200': head-mounted display
300. 300': arithmetic device
eL: left channel original signal
eR: original signal of right track
H0, H1, H2, H3: characteristic function
S: virtual sound source
S110, S120, S121, S122, S123, S130, S140, S141, S142: step (ii) of
S1 virtual horn
S2: second virtual loudspeaker
SL: left channel virtual signal
SR: right channel virtual signal
V2: displaying content
ZL: left channel update signal
ZR: right channel update signal
θ: angle of rotation
Relative angle of thetal th
θ R: second relative angle
Theta L' th relative update angle
θ R': second relative update angle
Detailed Description
Please refer to fig. 1, which illustrates a schematic diagram of audio output device 100, head mounted
Referring to FIG. 2, a block diagram of an audio output device 100 is shown, the audio output device 100 includes receiving units 110, , 0 th conversion units 120, 1 detection units 130, 2, second conversion units 140, 3, left channel output units 150, and 4, right channel output units 160, the receiving units 110 are used to receive signals, such as 5 wireless communication modules, or 6 wired network modules, the th conversion units 120 and the second conversion units 140 are, for example, circuits, chips, circuit boards, or storage devices storing sets of program codes, the detection units 130 are used to detect the rotation of a user, such as gyroscopes, accelerometers, or infrared detectors, the left channel output units 150 and the right channel output units 160 are, for example, earphones, and the operation of each component is described in detail in the following with reference to the flowchart.
Referring to fig. 3, a flow chart of the sound effect control method according to embodiment is shown, in step S110, the receiving unit 110 receives the left channel original signal eL and the right channel original signal eR., and the left channel original signal eL and the right channel original signal eR are conventionally directly and respectively transmitted to the left channel output unit 150 and the right channel output unit 160 for output, but in this embodiment, the left channel original signal eL and the right channel original signal eR are converted into the left channel update signal ZL and the right channel update signal ZR through the conversion unit 120 and the second conversion unit 140, so as to enhance the presence of the user.
In step S120, the converting unit 120 converts the original left channel signal eL and the original right channel signal eR into left channel virtual signal SL and right channel virtual signal SR. of the virtual sound source S. referring to fig. 4, a schematic diagram of the virtual sound source S is shown. if the virtual left channel signal SL and the virtual right channel signal SR generated by the virtual sound source S are known, the original left channel signal eL and the original right channel signal eR. can be derived through calculation of a Head Related Transfer Function (HRTF) technique, and the operation performed in step S120 is to utilize the original left channel signal eL and the original right channel signal eR to derive the virtual left channel signal SL and the virtual right channel signal SR in a backward direction.
In more detail, the step S120 includes steps S121 to S123. in the step S121, the virtual position calculator 121 of the th conversion unit 120 obtains a virtual sound source position of the virtual sound source S with respect to the user the virtual sound source S includes th th virtual horns S1 and second virtual horns S2. the virtual sound source position includes a th virtual horn S1 with respect to the user 'S th th relative angle θ L and a second virtual horn S2 with respect to the user' S second relative angle θ R.
In step S122, the function calculator 121 of the -th conversion unit 120 obtains characteristic functions H0, H1, H2, and H3 of the virtual sound source S corresponding to the left ear and right ear according to the virtual sound source position (i.e., the -th relative angle θ L and the second relative angle θ R).
In step S123, the virtual signal calculator 123 of the conversion unit 120 obtains the left channel virtual signal SL and the right channel virtual signal SR. according to the left channel original signal eL, the right channel original signal eR, the characteristic functions H0, H1, H2, and H3, for example, the virtual signal calculator 123 reversely derives the left channel virtual signal SL and the right channel virtual signal SR according to the following formula (1).
Next, in step S130, the detecting unit 130 detects rotation angle θ of the user, in the present embodiment, the rotation angle θ detected by the detecting unit 130 includes a direction value, for example, a counterclockwise rotation is taken as a positive direction, please refer to fig. 5, which illustrates the rotation of the user, and the detecting unit 130 can detect that the rotation angle θ is +90 degrees when the user rotates counterclockwise in fig. 5.
Then, in step S140, the second conversion unit 140 converts the left channel virtual signal SL and the right channel virtual signal SR into a left channel update signal ZL and a right channel update signal ZR according to the rotation angle θ. In this embodiment, under the condition that the virtual sound source S is unknown, the left channel virtual signal SL and the right channel virtual signal SR are obtained, and then the right channel virtual signal SR is derived as the left channel update signal ZL and the right channel update signal ZR according to the rotation of the user.
More specifically, step S140 includes steps S141-S142. in step S141, the updating position calculator 141 of the second conversion unit 140 obtains the updated position of the virtual sound source S relative to the user ' S virtual sound source according to the rotation angle θ. the updated position of the virtual sound source comprises the updated angle θ L ' of the th virtual speaker S1 relative to the user ' S , , and the updated angle θ R ' of the second virtual speaker S2 relative to the user ' S . for example, the updated position calculator 141 obtains the updated angle θ L ' of the th virtual speaker and the updated angle θ R ' according to the following equations (2) and (3).
θL'＝θL-θ……………………………………….(2)
θR'＝θR-θ……………………………………….(3)
In step S142, the update signal calculator 142 of the second conversion unit 140 obtains the left channel update signal ZL and the right channel update signal ZR according to the left channel virtual signal SL, the right channel virtual signal SR, and the virtual sound source update positions (i.e., the th relative update angle θ L 'and the second relative update angle θ R').
Then, in step S150, the left channel output unit 150 outputs a left channel update signal ZL. In step S160, the right channel output unit 160 outputs the right channel update signal ZR.
Thus , according to the rotation of the user, the original left channel original signal eL and the original right channel original signal eR can be converted into a left channel update signal ZL and a right channel update signal ZR to improve the presence of the user.
It should be noted that, the present embodiment is not just how to perform signal conversion, but the steps and the implementation of the components described above enable -like sound signals to be intercepted and converted into sound signals corresponding to the rotation of the user.
In particular, , the problem to be solved by this embodiment is how to convert the sound signal corresponding to the user's rotation when the virtual sound source is unknown, according to the above description, this embodiment proposes specific reverse-extrapolation techniques to obtain the virtual sound source, and further convert the sound signal corresponding to the user's rotation.
Referring to fig. 6, a schematic diagram of a sound
In this embodiment, when the detecting unit 130 is disposed on the
In summary, although the present invention has been described with reference to the above embodiments, the present invention is not limited thereto. Those skilled in the art can make various changes and modifications without departing from the spirit and scope of the invention. Therefore, the protection scope of the present invention should be determined by the appended claims.
- 上一篇：一种医用注射器针头装配设备
- 下一篇：一种音频信号处理方法及装置