阅读说明：本技术 信息处理装置、放音控制方法、放音控制程序及音响系统 (information processing device, playback control method, playback control program, and audio system ) 是由 冈田广毅 广木大介 于 2019-05-21 设计创作，主要内容包括：本发明提供一种信息处理装置,其具有可佩戴在用户的一侧耳朵上的佩戴部,所述信息处理装置具备：第一拾音部,其对外部音声进行拾音；放音部,其向用户的一侧耳朵进行放音；以及控制部,其在信息处理装置对车辆内规定条件是否成立进行判定且判定为规定条件成立的情况下,使放音部将由第一拾音部拾音得到的外部音声进行放音。(an information processing device having a wearing portion that can be worn on one ear of a user, the information processing device including: a first sound pickup unit that picks up external sound; a sound emitting unit emitting sound to one ear of a user; and a control unit that causes the sound reproduction unit to reproduce the external sound collected by the first sound collection unit when the information processing device determines whether or not a predetermined condition is satisfied in the vehicle and determines that the predetermined condition is satisfied.)

1. An information processing apparatus having a wearing portion wearable on one ear of a user,

The information processing device is provided with:

A first sound pickup unit that picks up external sound;

a sound emitting unit that emits sound to the one ear of the user; and

And a control unit that causes the sound emitting unit to emit the external sound collected by the first sound collecting unit when the information processing device determines whether or not a predetermined condition is satisfied in the vehicle and determines that the predetermined condition is satisfied.

2. The information processing apparatus according to claim 1,

The control part increases the sound pressure of the external sound to play sound when the sound playing part plays the external sound obtained by sound pickup of the first sound pickup part.

3. The information processing apparatus according to claim 1 or 2,

Further comprises another wearing part which can be worn on the other ear of the user,

When the wearable unit and the other wearable unit are worn on the one ear and the other ear of the user, the control unit issues a notification to the user to urge the user to remove one of the wearable unit and the other wearable unit if the predetermined condition is satisfied.

4. The information processing apparatus according to any one of claims 1 to 3,

The prescribed condition is that the user is seated on a driver's seat in the vehicle.

5. The information processing apparatus according to any one of claims 1 to 4,

the sound emitting unit emits an authentication sound of a predetermined frequency and sound pressure to an ear hole of the one ear of the user,

Further comprising a second sound pickup section for picking up an echo of the authentication sound from the ear hole,

The control unit authenticates the user based on the echo.

6. A sound reproduction control method executed by a computer of an information processing apparatus having a wearing portion wearable on one ear of a user, comprising: a sound pickup unit that picks up external sound; and a sound emitting unit emitting sound to the one ear of the user,

The playback control method comprises the following steps:

A step in which the information processing device determines whether or not a predetermined condition is satisfied in the vehicle; and

and a step of causing the sound emitting unit to emit the external sound collected by the sound collecting unit when the predetermined condition is determined to be satisfied in the determining step.

7. a computer-readable nonvolatile storage medium storing a playback control program that is executed by a computer of an information processing apparatus having a wearing portion that can be worn on one ear of a user, the information processing apparatus comprising: a sound pickup unit that picks up external sound; and a sound emitting unit emitting sound to the one ear of the user,

The playback control program comprises the following steps:

a step in which the information processing device determines whether or not a predetermined condition is satisfied in the vehicle; and

and a step of causing the sound emitting unit to emit the external sound collected by the sound collecting unit when the predetermined condition is determined to be satisfied in the determining step.

8. an audio system comprising an in-vehicle device and an information processing device worn on at least one ear of a user,

The in-vehicle apparatus includes a vehicle-side communication unit that communicates with the information processing device,

The information processing device is provided with:

A sound pickup unit that picks up external sound;

A sound emitting unit that emits sound to the at least one ear of the user;

a communication unit that communicates with the in-vehicle device; and

And a control unit that causes the sound emitting unit to emit the external sound collected by the sound collecting unit when the information processing apparatus determines whether or not a predetermined condition is satisfied in the vehicle based on a result of communication between the communication unit and the in-vehicle device and determines that the predetermined condition is satisfied.

Technical Field

the present invention relates to an information processing apparatus worn on the ear of a user, a sound reproduction control method thereof, a sound reproduction control program, and an acoustic system.

background

In recent years, information processing apparatuses (ear-worn devices) such as in-ear devices and head-worn devices have been proposed which have a complicated processing capability and can store content data such as music or play the content data by receiving the content data from an external device by a wireless method or the like. A user wearing such an information processing apparatus can easily listen to music or the like at any place, and can also receive various services by sound or the like. However, when driving a vehicle, if the information processing apparatus that seals the ear of the user plays music or the like, it will be difficult to hear surrounding sound, which is undesirable. In view of this, patent document 1 (japanese patent application laid-open No. 2008-100598) discloses an acoustic system for a vehicle, in which after a predetermined communication is established between a head-mounted information processing apparatus and an in-vehicle device, a notification urging the removal of the information processing apparatus is issued, or the playback of music or the like by the information processing apparatus is stopped.

in the acoustic system of patent document 1, when the user drives the vehicle, the information processing device with the ear sealed therein must be removed to allow the user to hear surrounding sound better, which is inconvenient for the user.

Disclosure of Invention

The present invention has been made in view of the above problems, and an object of the present invention is to provide an information processing device that improves convenience when driving a vehicle while wearing the information processing device.

In order to solve the above problem, one aspect of the present invention is an information processing apparatus having a wearing portion that can be worn on one ear of a user, the information processing apparatus including: a first sound pickup unit that picks up external sound; a sound emitting unit emitting sound to one ear of a user; and a control unit that causes the sound reproduction unit to reproduce the external sound collected by the first sound collection unit when the information processing device determines whether or not a predetermined condition is satisfied in the vehicle and determines that the predetermined condition is satisfied.

Thus, when the predetermined condition is satisfied, the state is switched to the state in which the external (ambient) sound is emitted, and therefore, for example, when the vehicle is likely to be driven, the ambient sound can be easily heard without removing the information processing device from the ear.

In addition, the control unit may increase the sound pressure of the external sound to generate sound when the sound generating unit generates the external sound collected by the first sound collecting unit.

This makes it possible to more easily hear the surrounding sound.

Further, the electronic device may further include another wearable unit that can be worn on the other ear of the user, and when the wearable unit and the other wearable unit are worn on the one ear and the other ear of the user, the control unit may issue a notification to the user to prompt the user to remove one of the wearable unit and the other wearable unit if a predetermined condition is satisfied.

Thus, when there is a regulation that the information processing device cannot be worn by both ears during driving, the user can be urged to drive in accordance with the regulation.

the predetermined condition may be that the user is seated in a driver seat in the vehicle.

This makes it possible to appropriately determine whether or not the user is likely to be driving the vehicle.

The sound emitting unit may emit the authentication sound having a predetermined frequency and sound pressure to an ear hole of one ear of the user, and the sound emitting unit may further include a second sound collecting unit that collects an echo of the authentication sound from the ear hole, and the control unit may perform the authentication of the user based on the echo.

This enables access control to the information processing device and the vehicle using the authentication result.

Another aspect of the present invention is a sound reproduction control method executed by a computer of an information processing apparatus having a wearing portion wearable on one ear of a user, comprising: a sound pickup unit that picks up external sound; and a sound reproduction unit for reproducing sound to one ear of the user, the sound reproduction control method includes the steps of: a step in which the information processing device determines whether or not a predetermined condition is satisfied in the vehicle; and a step of causing the sound reproduction unit to reproduce the external sound collected by the sound collection unit when the predetermined condition is determined to be satisfied in the determination step.

another aspect of the present invention is a computer-readable nonvolatile storage medium storing a playback control program executed by a computer of an information processing apparatus having a wearing portion that can be worn on one ear of a user, the information processing apparatus including: a sound pickup unit that picks up external sound; and a sound reproduction unit for reproducing sound to one ear of the user, wherein the sound reproduction control program includes the steps of: a step in which the information processing device determines whether or not a predetermined condition is satisfied in the vehicle; and a step of causing the sound reproduction unit to reproduce the external sound collected by the sound collection unit when the predetermined condition is determined to be satisfied in the determination step.

Another aspect of the present invention is an acoustic system including an in-vehicle device and an information processing apparatus worn on at least one ear of a user, the in-vehicle device including a vehicle-side communication unit that communicates with the information processing apparatus, the information processing apparatus including: a sound pickup unit that picks up external sound; a sound emitting unit that emits sound to at least one ear of a user; a communication unit that communicates with an in-vehicle device; and a control unit that causes the sound reproduction unit to reproduce the external sound collected by the sound collection unit when the information processing device determines whether or not a predetermined condition is satisfied in the vehicle based on a result of communication between the communication unit and the in-vehicle device and determines that the predetermined condition is satisfied.

Thus, when the predetermined condition is satisfied, the state is switched to the state in which the external (peripheral) sound is played, and therefore, for example, when the vehicle is driven, the peripheral sound can be easily heard without removing the information processing device from the ear.

ADVANTAGEOUS EFFECTS OF INVENTION

as described above, according to the present invention, when a predetermined condition is satisfied in a vehicle, the state is switched to a state in which an external (surrounding) sound is emitted, and therefore, for example, when the vehicle is driven, the surrounding sound can be easily heard without removing the information processing device from the ear, and an information processing device with improved convenience can be provided.

Drawings

Fig. 1 is a diagram showing an example of the configuration of an acoustic system according to an embodiment of the present invention.

Fig. 2 is a functional block diagram showing an acoustic system according to an embodiment of the present invention.

Fig. 3 is a sequence diagram illustrating a process according to an embodiment of the present invention.

Detailed Description

(summary)

As an example, the information processing apparatus according to the present invention is an in-ear type information processing apparatus worn on the ear of a user, and is a so-called ear-worn device capable of playing music or the like and providing services by sound or the like. The information processing device according to the present invention is capable of switching to an ambient sound mode in which, when a predetermined condition indicating that a user is likely to be driving is satisfied while the vehicle is in a vehicle, external sound is collected and played to the ear of the user, and allowing the user to easily hear surrounding sound while driving the vehicle without removing the information processing device from the ear.

(embodiment mode)

Hereinafter, one embodiment of the present invention will be described in detail with reference to the drawings.

< constitution >

Fig. 1 shows an example of the configuration of an acoustic system 100 according to the present embodiment. As one example, the audio system 100 includes the information processing apparatus 10 worn on one ear of the user, and the in-vehicle device 20 mounted on the vehicle. The information processing device 10 can perform wireless communication with the in-vehicle apparatus 20 when the distance from the in-vehicle apparatus 20 is within the predetermined range 500.

fig. 2 shows an example of a functional block diagram of the sound system 100. The information processing apparatus 10 includes a sound emitting unit 13 that emits sound to one ear of a user, a first sound collecting unit 11 that collects sound outside (around) the information processing apparatus 10, a second sound collecting unit 12 that collects sound in an ear canal (ear hole) of one ear of the user, a communication unit 14 that wirelessly communicates with an external device such as an in-vehicle device 20, and a control unit 15 that controls the above-described components. The above-described function is provided in a wearing portion worn on one ear of the user. Further, for example, at least part of the functions of the control section 15 may be provided in a separate portable device other than the wearing section.

The in-vehicle device 20 includes: a vehicle-side communication unit 21 that communicates with the information processing device 10 and the like; and a vehicle-side control unit 22 that controls the vehicle-side communication unit 21 and exchanges information with other in-vehicle devices.

< treatment >

Fig. 3 is a sequence diagram illustrating the processing of the information processing apparatus 10 and the in-vehicle device 20. The contents of the processing will be described with reference to fig. 3. This processing is started when the user wears the information processing device 10 on the ear, for example.

(step S101): the control unit 15 of the information processing device 10 causes the sound emitting unit 13 to emit an authentication sound of a predetermined frequency and a predetermined sound pressure into the ear hole of the user. The control unit 15 causes the second sound pickup unit 12 to pick up an echo of the authentication sound in the ear hole of the user. The sound pressure characteristic of the echo at each frequency has different modes in different ear holes. The control unit 15 calculates the degree of coincidence between the characteristics of the echo obtained by sound pickup and the earhole echo characteristics of the actual user registered in advance in the information processing device 10, and authenticates that the user is the actual user of the information processing device 10 when the degree of coincidence is higher than a predetermined value (first authentication). This first authentication is performed each time the user takes off the information processing device 10 from the ear and then wears it again.

(step S102): the control unit 15 of the information processing apparatus 10 causes the playback unit 13 to play back music or the like based on an operation from the user authenticated by the first authentication. The control unit 15 may operate in a noise reduction mode for canceling the external sound in the ear of the user by causing the sound emitting unit 13 to emit the external sound by collecting the external sound by the first sound collecting unit 11, generating a reverse sound of the collected external sound, and then causing the sound emitting unit 13 to emit the sound, or may operate in a noise reduction mode for canceling the external sound in the ear of the user without causing the sound emitting unit 13 to emit the music or the like

(step S103): if the user wearing the information processing apparatus 10 approaches the vehicle and comes within the above-described range 500 in order to ride the vehicle, communication between the information processing apparatus 10 and the in-vehicle device 20 is enabled. The control unit 15 of the information processing device 10 detects that communication is possible based on the communication unit 14 receiving the radio wave from the in-vehicle apparatus 20. The vehicle-side control unit 22 of the in-vehicle device 20 detects that communication is possible based on the reception of the radio wave from the information processing apparatus 10 by the vehicle-side communication unit 21.

(step S104): if the user performs a touch operation on the door handle of the vehicle and the sensor of the vehicle detects the operation, the vehicle-side control section 22 of the in-vehicle apparatus 20 acquires the detection result.

(step S105): the vehicle-side control unit 22 of the in-vehicle apparatus 20 performs the second authentication. The second authentication is performed in the following manner. That is, the vehicle-side control unit 22 communicates with the information processing apparatus 10 via the vehicle-side communication unit 21, and detects whether or not the information processing apparatus 10 is a device registered in advance based on the communication result. In addition, the result of the first authentication is received from the information processing apparatus 10. If the information processing apparatus 10 is a device that has been registered in advance and the result of the first authentication is successful, the vehicle-side control portion 22 authenticates that the user is a regular user of the vehicle. Alternatively, the vehicle-side control unit 22 may receive, from the information processing device 10, information indicating the echo of the user collected by the second sound collecting unit 12, instead of the result of the first authentication. In this case, the vehicle-side control unit 22 calculates the degree of coincidence between the information and the echo characteristics of the ear hole of the vehicle regular user registered in advance in the in-vehicle device 20 or in a predetermined query destination server, and authenticates that the user is the regular user of the vehicle when the degree of coincidence is higher than a predetermined value.

(step S106): if the second authentication is successful, the vehicle-side control portion 22 of the in-vehicle apparatus 20 releases the door lock.

(step S107): the user opens the door and enters the vehicle, starting the engine of the vehicle (turns on the power switch). The vehicle-side control unit 22 of the in-vehicle device 20 may perform the second authentication again at the timing when the ignition switch (power switch) is turned on.

(step S108): the vehicle-side control unit 22 of the in-vehicle device 20 transmits a notification corresponding to the user's start of the vehicle engine from the vehicle-side communication unit 21.

(step S109): if the communication unit 14 receives the notification, the control unit 15 of the information processing device 10 determines that a predetermined condition, which will be described later, is satisfied in the vehicle based on the notification. Thus, the control unit 15 stops playing music or the like or stops the operation of the noise reduction mode, and performs the operation of the ambient sound mode in which: the first sound pickup unit 11 picks up external sound, and the sound reproduction unit 13 reproduces the picked-up external sound so that the external sound reaches the user's ear. In this case, the sound to be played by the sound playing unit 13 may be sound obtained by amplifying sound collected by the first sound collecting unit 11 so that the user can hear external sound more clearly. In the ambient sound mode, the music or the like being played may be played in superimposition with the external sound as long as the user can hear the external sound. This completes the process. The contents and sequence of the above steps may be changed or omitted as appropriate.

Further, if the information processing apparatus 10 moves out of the above range 500 and cannot communicate with the in-vehicle device 20, the information processing apparatus 10 may resume playing music or the like or perform an operation of the noise reduction mode. Alternatively, the information processing device 10 may detect that the engine is stopped and the user gets off the vehicle or the driving is finished such as the door lock operation by the communication with the in-vehicle device 20, and resume the music playing or the like or perform the noise reduction mode operation in response to the detection.

As described above, when the information processing device 10 is worn by the main user of the vehicle and predetermined conditions such as the engine being started or the power switch being turned on are satisfied in the vehicle, the information processing device 10 becomes the ambient sound mode in which the ambient sound is easily heard. The predetermined condition is not limited to this, and the parking brake may be released after the engine start is detected. The predetermined condition may be that the user is seated on the driver seat. This condition can be detected by, for example, providing the vehicle-side communication unit 21 of the in-vehicle device 20 with a speaker for emitting an audible sound of a predetermined pattern or an inaudible sound such as an ultrasonic wave or a very low frequency sound into the vehicle, and performing positioning based on the sound pressure or the arrival time by performing communication by sound such as sound collection of the sound of the predetermined pattern by the first sound collection unit 11 of the information processing apparatus 10, thereby detecting that the user is seated in the driver's seat. In addition, communication by extremely weak radio waves whose arrival range is the range of the driver's seat may be used instead of the communication by sound. Thus, when the user is a fellow passenger who has not been authenticated in the second authentication, or the user has been authenticated in the second authentication, but only performs cargo handling or the like without starting the engine, or is not seated in the driver's seat, the operation of the information processing device 10 does not change, and music or the like can be comfortably listened to.

(modification 1)

By grouping the information processing devices 10 described in the above embodiments into two and appropriately cooperating by, for example, wireless communication or the like, it is possible to configure a single information processing device wearable on both ears having a wearable portion wearable on one ear and another wearable portion wearable on the other ear. In this case, the echo used for the authentication may be an echo of an ear on either side, or may be echoes of both ears. By performing the same processing as described above, when it is determined that the predetermined condition is satisfied in the vehicle, it is possible to switch to the ambient sound mode for both ears. In order to meet the later-described regulations, a notification may be given to urge the user to remove at least one of the wearing portion and the other wearing portion from the ear. The notification may be performed by sound, or may be performed by vibration with a built-in vibrator. The control unit 15 of the information processing apparatus may determine whether or not the wearing unit and the other wearing unit are worn on the ears, and may notify the user when both the wearing units are worn. As a method of determining whether or not each of the two is worn, for example, each of the wearing units may be provided with a contact sensor at a position in contact with each of the ears, and the determination may be made based on a detection result of the contact sensor, or may be made based on whether or not the echo of both ears can be obtained after the authentication sound is played.

In addition, the information processing device wearable on both ears described above may be configured such that the one information processing device 10 described in the above embodiment further includes another wearable portion worn on the other ear of the user, and the other wearable portion suitably includes a sound emitting portion, a sound pickup portion, a contact sensor for the other ear, a communication portion capable of communicating with the control portion 15, and the like, which are controllable by the control portion 15.

Some countries have regulations that prevent headphones or the like from being worn on both ears while driving. Therefore, in countries where such regulations exist, whether or not switching to the ambient sound mode is performed, it is necessary to be in a state where at least one ear is not plugged. By giving the above notification to the user, the user can be prompted to drive in compliance with the regulations. When the user has worn the information processing device 10 on both ears for a predetermined time period without regard to the notification, the control unit 15 of the information processing device 10 may detect this and notify the in-vehicle device 20 of the communication unit 14, and the vehicle-side control unit 22 of the in-vehicle device 20 may instruct the other in-vehicle device to stop the engine (or the motor) upon receiving the notification via the vehicle-side communication unit 21. Whereby driving that does not comply with the regulation can be forcibly prohibited.

(modification 2)

the information processing apparatus 10 described in the above embodiment and the information processing apparatus according to modification 1 may not include the second sound pickup unit 12 and may not perform the above-described echo-based user authentication. In this case, access control such as unlocking of the vehicle door lock may be performed by another smart key system or the like. In this case, if the information processing device 10 determines, through communication with the in-vehicle apparatus 20, or sound waves from the in-vehicle apparatus 20, that the predetermined conditions described above, such as the engine start or the user sitting in the driver's seat, are satisfied in the vehicle, and switches to the ambient sound mode, the user can easily hear the surrounding sound even when driving.

(Effect)

As described above, the information processing apparatus according to the present invention performs the process of switching to the ambient sound mode when the information processing apparatus is in the vehicle and the user is highly likely to drive, for example. Thus, the driving state of the user is determined, and when the user drives the vehicle, the user can easily hear the surrounding sound without removing the information processing device, thereby improving convenience. In addition, when the user is not driving, the operation of the information processing apparatus does not change, and the user can comfortably listen to music and the like. In addition, notification in accordance with regulations can be performed. In addition, the operation division corresponding to the above situation can be automatically performed. From this viewpoint, convenience can be improved. In addition, as in modification 2, when the information processing apparatus does not perform user authentication but the in-vehicle device independently performs user authentication, the process of associating (pairing) the information processing apparatus and the in-vehicle device in advance is not necessary, and the associated process can be omitted.

The embodiments of the present invention have been described above, but the present invention can be regarded as an information processing apparatus, a sound emission control method and a sound emission control program executed by a control unit provided in the information processing apparatus, a computer-readable nonvolatile storage medium storing the sound emission control program, and an acoustic system including the information processing apparatus and a vehicle-mounted device.

The present invention is useful for an information processing device and an acoustic system mounted on a vehicle or the like.