阅读说明：本技术 根据影像资讯判断是否播放音乐的音乐播放方法及其所对应的音乐播放系统 (Music playing method for judging whether to play music according to image information and corresponding music playing system ) 是由 不公告发明人 于 2019-10-18 设计创作，主要内容包括：本申请公开了一种根据影像资讯判断是否播放音乐的音乐播放方法及其所对应的音乐播放系统,该方法包括：透过一影像感测装置获得至少一侦测位置影像；判断该侦测位置影像是否满足至少一播放触发门槛；以及根据该侦测位置影像是否满足该播放触发门槛之结果启动一音频播放设备以输出至少一音频内容。通过本申请的上述技术方案,至少能够改善用户享受音乐的整体用户体验,而无需增加额外的硬件或组件。(The application discloses a music playing method for judging whether to play music according to image information and a corresponding music playing system, wherein the method comprises the following steps: obtaining at least one detected position image through an image sensing device; judging whether the detected position image meets at least one play triggering threshold; and starting an audio playing device to output at least one audio content according to the result of whether the detected position image meets the playing triggering threshold. Through the technical scheme of the application, the overall user experience of the user enjoying music can be improved at least, and extra hardware or components are not required to be added.)

1. A music playing method for determining whether to play music according to image information, comprising:

obtaining at least one detected position image through an image sensing device;

judging whether the detected position image meets at least one play triggering threshold; and

and starting an audio playing device to output at least one audio content according to the result of whether the detected position image meets the playing triggering threshold.

2. The method of claim 1, wherein the detected position image corresponds to a detected position.

3. The method of claim 1, wherein the plurality of detected position images correspond to a plurality of detected positions.

4. The method of claim 3, wherein the plurality of trigger thresholds are corresponding to the plurality of detected position images.

5. The method of claim 4, wherein the result of detecting whether the position image satisfies the playing triggering threshold comprises all permutation combinations of whether the position image satisfies the playing triggering threshold.

6. The method of claim 5, wherein the audio contents correspond to different results of whether the detected position image satisfies the playing triggering threshold.

7. The method of claim 1, wherein the triggering threshold is a threshold for determining whether the detected position image includes a human body image.

8. A music playing system, comprising:

an image sensing device for obtaining at least one detected position image;

an audio playing device for playing at least one audio content; and

a control unit connected to the image sensing device and the audio playing device for controlling the audio playing device to output at least one audio content according to the result of whether the detected position image satisfies at least one playing triggering threshold.

9. The music playing system of claim 8, wherein the control unit is built in the audio playing device.

10. The music playing system of claim 8, wherein the control unit is a separate device that is external to the image sensor and the audio playing device.

Technical Field

The application relates to a music playing method for judging whether to play music according to image information and a corresponding music playing system.

Background

In the present society, when a user wants to play music, the user often needs to control the audio playing device in a manual operation manner, so as to achieve the purpose of playing music. Even though the user has a habitual behavior of playing a specific music at a specific location, the user still needs to go through the same steps before playing the music each time, and such a boring behavior causes a hindrance to the user in listening to the music.

It is known that providing a music listening experience that is smooth for the user and avoids repetitive setting behaviors is a direction of research by those skilled in the art.

Disclosure of Invention

In view of the above problems in the related art, the present application provides a music playing method for determining whether to play music according to image information and a corresponding music playing system thereof, which can improve the overall user experience of the user enjoying music without adding additional hardware or components.

The technical scheme of the application is realized as follows:

according to an aspect of the present application, there is provided a music playing method for determining whether to play music according to image information, comprising:

obtaining at least one detected position image through an image sensing device;

judging whether the detected position image meets at least one play triggering threshold; and

and starting an audio playing device to output at least one audio content according to the result of whether the detected position image meets the playing triggering threshold.

According to an embodiment of the present application, the detected-position image corresponds to a detected position.

According to an embodiment of the present application, the plurality of detected position images correspond to a plurality of detected positions.

According to an embodiment of the present application, the plurality of playback trigger thresholds correspond to the plurality of detected position images.

According to an embodiment of the present application, the result of detecting whether the position image satisfies the playing triggering threshold includes all permutation combinations of whether the position image satisfies the playing triggering threshold.

According to an embodiment of the present application, the plurality of audio contents correspond to different results of whether the detected position image satisfies the play trigger threshold.

According to an embodiment of the application, the play trigger threshold is used for determining whether the detected position image includes a human body image.

According to another aspect of the present application, there is provided a music playing system including:

an image sensing device for obtaining at least one detected position image;

an audio playing device for playing at least one audio content; and

a control unit connected to the image sensing device and the audio playing device for controlling the audio playing device to output at least one audio content according to the result of whether the detected position image satisfies at least one playing triggering threshold.

According to an embodiment of the application, the control unit is built in the audio playing device.

According to an embodiment of the present application, the control unit is an independent device built outside the image sensing device and the audio playing device.

According to the technical scheme, the user experience is solved by the IP camera which is more and more popular and is very common in the family, the intelligent function can be easily provided by integrating with the Internet of things, the integral user experience of the user enjoying music is improved, no additional hardware or component is needed, and the design cost is not remarkably increased.

Drawings

In order to more clearly illustrate the embodiments of the present application or the technical solutions in the prior art, the drawings needed to be used in the embodiments will be briefly described below, and it is obvious that the drawings in the following description are only some embodiments of the present application, and it is obvious for those skilled in the art to obtain other drawings without creative efforts.

FIG. 1 is a flowchart illustrating a music playing method for determining whether to play music according to image information according to an embodiment of the present application;

fig. 2 is a block diagram of a music playing system according to an embodiment of the present application.

Detailed Description

The technical solutions in the embodiments of the present application will be clearly and completely described below with reference to the drawings in the embodiments of the present application, and it is obvious that the described embodiments are only a part of the embodiments of the present application, and not all of the embodiments. All other embodiments that can be derived from the embodiments given herein by a person of ordinary skill in the art are intended to be within the scope of the present disclosure.

FIG. 1 is a flowchart illustrating a music playing method for determining whether to play music according to image information according to an embodiment of the present application. As shown in fig. 1, a music playing method for determining whether to play music according to image information according to an embodiment of the present application includes the following steps:

s101: at least one detected position image is obtained through an image sensing device.

S102: and judging whether the detected position image meets at least one play triggering threshold.

S103: and starting an audio playing device to output at least one audio content according to the result of whether the detected position image meets the playing triggering threshold.

In step S101, the music playing method of the present application includes obtaining at least one detected position image through an image sensing device, where the image sensing device may be, but is not limited to, a network camera (IP camera), a television with an image capturing lens, a computer, an intelligent speaker, or other electronic devices with an image capturing lens. In addition, in step S101, the detected position image obtained by the image sensing device corresponds to the detected position. In some embodiments, the image sensing device obtains a plurality of detected position images for a plurality of detected positions; in another embodiment, the image sensing device obtains a detected position image for a detected position; in other words, the number of detected position images obtained by the image sensing device corresponds to the number of detected positions.

In step S102, the music playing method of the present application includes determining whether the detected position image satisfies a playing triggering threshold, where the playing triggering threshold is determining whether the detected position image includes a human body image, in other words, in step S102, determining whether a human body image appears at the detected position according to the detected position image obtained by the image sensing device. In some embodiments, the image sensing device obtains a detected position image for a detected position, so step S102 is to determine whether a human body image appears at the detected position; in another embodiment, the image sensing device obtains a plurality of detected position images for a plurality of detected positions, so step S102 determines whether there is a human body image at the plurality of detected positions, wherein the determination result can be divided into:

1. all the detection positions have human body images;

2. no human body image appears at all the detection positions; and

3. some of the detected positions have human body images.

Furthermore, 3, some of the detection positions have human body images, and the result corresponding to the number of the permutation and combination can be generated according to the detection positions and the number of the detection position images. In other words, in some embodiments, the result of detecting whether the position image satisfies the play trigger threshold includes all permutation combinations of detecting whether the position image satisfies the play trigger threshold.

In step S103, the music playing method of the present application includes activating an audio playing device to output audio content according to the determination result of S102, wherein the audio playing device may be but not limited to a sound box, a smart speaker, a portable speaker device or other electronic devices with speaker function, and the audio content may be but not limited to a song, a song list composed of songs or other multimedia content with output audio signals. In some embodiments, S103 may play different audio contents corresponding to the determination result of S102, for example, when the determination result of S102 is: all the detection positions have human body images, and S103 plays corresponding first audio contents according to the judgment result of S102; when the judgment result of the S102 is: if there is a human body image at a part of the detected positions, S103 plays the corresponding second audio content according to the judgment result of S102. Therefore, in some embodiments, the audio content is a result of whether a detected position image corresponding to a detected position satisfies the play trigger threshold; however, in another embodiment, the plurality of audio contents correspond to the determination results of the plurality of S102, in other words, the plurality of audio contents correspond to different results of detecting whether the position image satisfies the play trigger threshold.

Referring to fig. 2, fig. 2 is a system block diagram of a music playing system based on the method shown in fig. 1. It should be understood that the system block diagram shown in fig. 2 is merely exemplary, and any other suitable design may be made according to the actual application.

As shown in fig. 2, the music playing system of the present application includes an image sensing device 201, an audio playing device 202, and a control unit 203. The image sensor 201 is used to obtain the detected position image, wherein the image sensor 201 obtains the detected position image according to the detected position. The audio playing device 202 is used for playing audio content, wherein the audio playing device 202 can be, but not limited to, a sound box, a smart speaker, a portable speaker device or other electronic devices with speaker function, and the audio content can be, but not limited to, a song list composed of songs or other multimedia content with output audio signals. The control unit 203 is connected to the image sensing device 201 and the audio playing device 202, and is configured to control the audio playing device 202 to output audio content according to a result of whether the detected position image satisfies a playing triggering threshold, where the playing triggering threshold is to determine whether the detected position image includes a human body image, the control unit 203 may be a unit built in the audio playing device 202, or an independent device built outside the image sensing device 201 and the audio playing device 202, and the control unit 203 may control a chip, a processor, or other hardware with an operation processing capability.

Referring to the music playing system shown in fig. 2, in a use situation, when the user is present at the detected position, since the image sensing device 201 obtains the detected position image according to the detected position, the image sensing device 201 can obtain the detected position image including the human body image of the user. In this situation, since the control unit 203 obtains the detected position image including the human body image of the user, the control unit 203 determines that the detected position image satisfies the playing triggering threshold, and thus the control unit 203 controls the audio playing device 202 to output the corresponding audio content.

On the contrary, in another use situation, when the user is not present at the detected position, the image sensing device 201 obtains the detected position image without the human body image of the user. In this usage scenario, since the control unit 203 obtains the detected position image that does not include the human body image of the user, the control unit 203 determines that the detected position image does not satisfy the playing triggering threshold, and therefore the control unit 203 does not control the audio playing device 202 to output the audio content.

Human body image detection is part of computer vision technology and is one of the main targets of artificial intelligence. There are various methods for detecting human body images. In one embodiment, OpenCV may be employed to implement human image detection. OpenCV is one of the well-known real-time computer vision software libraries. OpenCV utilizes a histogram gradient object detector, which also provides a human detector, i.e., human image detection function. The human body image detection function of the present application can be stored in the control unit 203, or can be connected to an external server through the control unit 203 with a networking function, so as to use the human body image detection function stored in the control unit 203. In other embodiments, any suitable method may be used for human body detection, which is not limited in this application.

In one embodiment, the audio playback device 202 is a network audio device, and the stored data can be provided to the audio playback device 202 over a network to cause the audio playback device 202 to execute a predetermined custom playlist. The device control software may be integrated with the network audio device 203. The audio playback device 202 may be integrated with a server commonly referred to as a device cloud. The device cloud may identify the audio playback device 202 in an intranet or the internet to push data or messages from the cloud to the audio playback device 202. Thus, in addition to playing music messages in a conventional manner, more customized functionality can be provided to the user. E.g. playing a specific playlist, or playing a different playlist on a different weekday following some specific rules, etc.

Through the technical scheme, the video image technology and the IP camera for detecting the human body images at the listening position are utilized to detect whether the user appears at the specific position (listening position) selected by the user at home or not so as to control the network audio equipment to start playing music. The following scenario can thus be implemented: the user goes home from work and sits on the sofa, this video image is captured by the IP camera at home, the detection section on the media server detects by video streaming that the user is sitting on the sofa, and starts to transmit music to the audio device, e.g. smart speakers, using the relaxation playlist created by the user. Obviously, this does not require the user to perform a cumbersome procedure to start the music play, improving the overall user experience.

The above description is only exemplary of the present application and should not be taken as limiting the present application, as any modification, equivalent replacement, or improvement made within the spirit and principle of the present application should be included in the protection scope of the present application.