阅读说明：本技术 计算机设备的震动控制方法和系统 (Vibration control method and system for computer equipment ) 是由 时英选 吴勇 李超然 于 2020-06-01 设计创作，主要内容包括：本申请实施例提供了一种计算机设备的震动控制方法,所述方法包括：播放多媒体文件；获取所述多媒体文件的目标音频文件,并将所述目标音频文件切分为多个音频片段；检测各个音频片段,以根据检测结果从所述多个音频片段中获取目标音频片段；根据所述目标音频片段,确定所述多媒体文件的总播放时间区间中的目标时间区间；监测所述多媒体文件的当前播放时间点；及当所述当前播放时间点进入所述目标时间区间时,控制所述计算机设备中的震动元件执行第一类震动操作。在本申请实施例中,计算机设备在播放多媒体文件的过程中,增加了触觉方面的内容输出,有效增加了输出形式和互动方式和提升了与用户之间的互动,使用户有更真实的体验。(The embodiment of the application provides a vibration control method of computer equipment, which comprises the following steps: playing the multimedia file; acquiring a target audio file of the multimedia file, and segmenting the target audio file into a plurality of audio segments; detecting each audio clip to obtain a target audio clip from the plurality of audio clips according to the detection result; determining a target time interval in the total playing time interval of the multimedia file according to the target audio clip; monitoring the current playing time point of the multimedia file; and when the current playing time point enters the target time interval, controlling a vibration element in the computer equipment to execute a first type of vibration operation. In the embodiment of the application, the content output in the aspect of touch sense is increased in the process of playing the multimedia file by the computer equipment, the output form and the interaction mode are effectively increased, the interaction with a user is improved, and the user has more real experience.)

1. A method of shock control for a computer device, the method comprising:

playing the multimedia file;

acquiring a target audio file of the multimedia file, and segmenting the target audio file into a plurality of audio segments;

detecting each audio clip to obtain a target audio clip from the plurality of audio clips according to the detection result;

determining a target time interval in the total playing time interval of the multimedia file according to the target audio clip;

monitoring the current playing time point of the multimedia file; and

and when the current playing time point enters the target time interval, controlling a vibration element in the computer equipment to execute a first type of vibration operation.

2. The shock control method of a computer device according to claim 1, wherein obtaining an audio file of the multimedia file comprises:

extracting an initial audio file of the multimedia file;

determining a noise signal and a non-noise signal in the initial audio file according to the content of the multimedia file; and

and separating the noise signal and the non-noise signal in the initial audio file to obtain the target audio file corresponding to the non-noise signal.

3. The vibration control method of a computer device according to claim 2, wherein determining the noise signal and the non-noise signal in the initial audio file according to the content of the multimedia file comprises:

judging whether the content of the multimedia file is audio and video content of music; and

and if the content of the multimedia file is the audio and video content of music, determining that the voice signal in the initial audio file is the noise signal and the non-voice signal in the initial audio file is the non-noise signal.

4. The vibration control method of a computer device according to claim 1, wherein detecting each audio segment to obtain a target audio segment from the plurality of audio segments according to the detection result comprises:

identifying whether each audio segment is an audio mutation segment; and

and if one of the audio segments is the audio abrupt change segment, determining the audio segment as the target audio segment.

5. The shock control method of a computer device according to claim 4, wherein the audio break segment comprises at least one of the following features:

the amplitude of the energy change exceeds a first threshold value;

the pitch variation amplitude exceeds a second threshold; or

The tone variation amplitude exceeds a third threshold.

6. The vibration control method of a computer device according to claim 1, wherein detecting each audio segment to obtain a target audio segment from the plurality of audio segments according to the detection result comprises:

determining an audio category of the audio file; and

and performing a detection operation on the plurality of audio segments to acquire the target audio segment associated with the audio type.

7. The vibration control method of a computer apparatus according to claim 6, characterized in that:

the audio category is a music audio category and the target audio segment is an audio segment having a music drum point.

8. The vibration control method of a computer apparatus according to claim 6, characterized in that:

the audio category is a game audio category and the target audio clip is an audio clip with a gun shot sound spot.

9. The vibration control method of a computer device according to claim 1, wherein detecting each audio segment to obtain a target audio segment from the plurality of audio segments according to the detection result comprises:

acquiring characteristic parameters of each audio clip;

inputting the characteristic parameters of each audio clip into the trained deep neural network model; and

determining the target audio clip from the plurality of audio clips according to an output result of the deep neural network model.

10. The vibration control method of a computer apparatus according to any one of claims 1 to 9, further comprising:

detecting the audio power of each audio segment; and

and executing a second type of vibration operation on the vibration element in the computer equipment according to the audio power of each audio clip.

11. A shock control system for a computer device, comprising:

the playing module is used for playing the multimedia file;

the acquisition module is used for acquiring an audio file of the multimedia file and segmenting the audio file into a plurality of audio segments;

the detection module is used for detecting each audio clip so as to obtain a target audio clip from the plurality of audio clips according to the detection result;

the determining module is used for determining a target time interval in the total playing time interval of the multimedia file according to the target audio clip;

the monitoring module is used for monitoring the current playing time point of the multimedia file; and

and the control module is used for controlling the vibration element in the computer equipment to execute a first type of vibration operation when the current playing time point enters the target time interval.

12. A computer arrangement comprising a memory, a processor and a computer program stored on the memory and executable on the processor, characterized in that the processor is adapted to carry out the steps of the method of vibration control of a computer arrangement according to any of claims 1 to 10 when executing the computer program.

13. A computer-readable storage medium, in which a computer program is stored which is executable by at least one processor to cause the at least one processor to carry out the steps of the method of vibration control of a computer device according to any one of claims 1 to 10.

Technical Field

The embodiment of the application relates to the technical field of computers, in particular to a vibration control method and system for computer equipment, the computer equipment and a computer readable storage medium.

Background

More and more users have more and more interactivity with computer devices such as tablet computers and mobile phones, for example, watching movie videos or game videos. Along with the popularization of concepts such as augmented reality, virtual reality and the like, the entertainment requirements of people on computer equipment are higher and higher. However, when the current computer device plays video contents such as movies and games, the provided output form is single, the interaction mode is few, the user experience is poor, and the current entertainment requirements of people can not be met obviously.

Disclosure of Invention

An object of the embodiments of the present application is to provide a method, a system, a computer device and a computer-readable storage medium for controlling vibration of a computer device, which are used to solve the following problems: in the prior art, when multimedia files such as movies and games are played by computer equipment, the provided output form is single, the interaction modes are few, and the user experience is poor.

An aspect of an embodiment of the present application provides a method for controlling vibration of a computer device, the method including: playing the multimedia file; acquiring a target audio file of the multimedia file, and segmenting the target audio file into a plurality of audio segments; detecting each audio clip to obtain a target audio clip from the plurality of audio clips according to the detection result; determining a target time interval in the total playing time interval of the multimedia file according to the target audio clip; monitoring the current playing time point of the multimedia file; and when the current playing time point enters the target time interval, controlling a vibration element in the computer equipment to execute a first type of vibration operation.

Optionally, the obtaining an audio file of the multimedia file includes: extracting an initial audio file of the multimedia file; determining a noise signal and a non-noise signal in the initial audio file according to the content of the multimedia file; and separating the noise signal and the non-noise signal in the initial audio file to obtain the target audio file corresponding to the non-noise signal.

Optionally, determining a noise signal and a non-noise signal in the initial audio file according to the content of the multimedia file includes: judging whether the content of the multimedia file is audio and video content of music; and if the content of the multimedia file is the audio and video content of music, determining that the voice signal in the initial audio file is the noise signal and the non-voice signal in the initial audio file is the non-noise signal.

Optionally, detecting each audio segment to obtain a target audio segment from the multiple audio segments according to a detection result, includes: identifying whether each audio segment is an audio mutation segment; and if one of the audio segments is the audio abrupt change segment, determining the audio segment as the target audio segment.

Optionally, the audio mutant segment comprises at least one of the following features: the amplitude of the energy change exceeds a first threshold value; the pitch variation amplitude exceeds a second threshold; or the tone color variation amplitude exceeds a third threshold.

Optionally, detecting each audio segment to obtain a target audio segment from the multiple audio segments according to a detection result, includes: determining an audio category of the audio file; and detecting the plurality of audio segments to acquire the target audio segment associated with the audio type.

Optionally, the audio category is a music audio category, and the target audio segment is an audio segment with a music drumbeat.

Optionally, the audio category is a game audio category, and the target audio clip is an audio clip with a gunshot sound production point.

Optionally, detecting each audio segment to obtain a target audio segment from the multiple audio segments according to a detection result, includes: acquiring characteristic parameters of each audio clip; inputting the characteristic parameters of each audio clip into the trained deep neural network model; and determining the target audio clip from the plurality of audio clips according to the output result of the deep neural network model.

Optionally, the method further includes: detecting the audio power of each audio segment; and executing a second type of vibration operation on the vibration element in the computer equipment according to the audio power of each audio clip.

An aspect of an embodiment of the present application further provides a vibration control system of a computer device, including: the playing module is used for playing the multimedia file; the acquisition module is used for acquiring an audio file of the multimedia file and segmenting the audio file into a plurality of audio segments; the detection module is used for detecting each audio clip so as to obtain a target audio clip from the plurality of audio clips according to the detection result; the determining module is used for determining a target time interval in the total playing time interval of the multimedia file according to the target audio clip; the monitoring module is used for monitoring the current playing time point of the multimedia file; and the control module is used for controlling the vibration element in the computer equipment to execute a first type of vibration operation when the current playing time point enters the target time interval.

An aspect of the embodiments of the present application further provides a computer device, including a memory, a processor, and a computer program stored on the memory and executable on the processor, wherein the processor executes the computer program to implement the steps of the vibration control method of the computer device as described above.

An aspect of the embodiments of the present application further provides a computer-readable storage medium, including a memory, a processor, and a computer program stored on the memory and executable on the processor, wherein the processor executes the computer program to implement the steps of the vibration control method of the computer device as described above.

The vibration control method, system and device for the computer device and the computer readable storage medium enable the computer device to output audio content, video content and vibration in the process of playing multimedia files. Namely, in the process of playing the multimedia file, the computer equipment increases content output in the aspect of touch sense, effectively increases output forms and interaction modes, improves interaction with a user, and enables the user to have more real experience.

Drawings

Fig. 1 schematically illustrates an application environment diagram of a vibration control method of a computer device according to an embodiment of the present application;

FIG. 2 schematically illustrates another application environment diagram of a vibration control method of a computer device according to an embodiment of the present application;

FIG. 3 is a flow chart of a vibration control method of a computer device according to a first embodiment of the present application;

FIG. 4 is a diagram illustrating sub-steps of step S302 in FIG. 3;

FIG. 5 is a diagram illustrating sub-steps of step S402 in FIG. 4;

FIG. 6 is a diagram illustrating sub-steps of step S304 in FIG. 3;

FIG. 7 is a diagram illustrating another sub-step of step S304 in FIG. 3;

FIG. 8 is a diagram illustrating another sub-step of step S304 in FIG. 3;

FIG. 9 is a flowchart schematically illustrating a vibration control method of a computer device according to a first embodiment of the present application;

fig. 10 schematically shows a block diagram of a shock control system of a computer device according to a second embodiment of the present application; and

fig. 11 schematically shows a hardware architecture diagram of a computer device suitable for implementing a vibration control method of the computer device according to a third embodiment of the present application.

Detailed Description

In order to make the objects, technical solutions and advantages of the present application more apparent, the present application is described in further detail below with reference to the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are merely illustrative of the present application and are not intended to limit the present application. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present application.

It should be noted that the descriptions relating to "first", "second", etc. in the embodiments of the present application are only for descriptive purposes and are not to be construed as indicating or implying relative importance or implicitly indicating the number of technical features indicated. Thus, a feature defined as "first" or "second" may explicitly or implicitly include at least one such feature. In addition, technical solutions between various embodiments may be combined with each other, but must be realized by a person skilled in the art, and when the technical solutions are contradictory or cannot be realized, such a combination should not be considered to exist, and is not within the protection scope of the present application.

The computer device 2 may be configured to provide multimedia playing services. The multimedia play service may be configured to receive content via various transmission technologies and play the received content. The content may include content streams (e.g., video streams, audio streams), content files (e.g., video files, audio files), and/or other data.

The computer device 2 may be configured to access content and services of the provider network 4. The computer device 2 may be a mobile device such as a smartphone, tablet device, augmented reality/virtual reality device, smart watch, etc. that has a built-in vibrating element (e.g., a vibrating motor).

Computer device 2 may be associated with one or more users. A single user may use computer device 2 to access provider network 4. The computer device 2 may travel to various locations and use different networks to access the provider network 4.

Computer device 2 may include application 2A and other applications. Application 2A outputs (e.g., displays, renders, presents) the content to the user. The application 2A may be a multimedia player (e.g., a bilibili client), a browser client, or the like. As an example, as shown in fig. 1 and 2, fig. 1 shows a video screen when one music video is played by the application 2A, and fig. 2 shows a video screen when one game video is played by the application 2A.

In a video scene such as that illustrated in fig. 1 or fig. 2, the computer device 2 outputs visual information and auditory information, while also outputting tactile information in a vibrating manner. Namely, the method and the device can improve the interaction with the user by increasing the vibration, thereby realizing the omnibearing content output of vision, hearing and touch, and ensuring that the user feels more real. It should be noted that the video scenes shown in fig. 1 and fig. 2 are exemplary and are not intended to limit the scope of the present application.

Example one

Fig. 2 schematically shows a flowchart of a vibration control method of a computer device according to a first embodiment of the present application. It is to be understood that the flow charts in the embodiments of the present method are not intended to limit the order in which the steps are performed. The following description is made by way of example with the computer device 2 as the execution subject.

As shown in fig. 3, the vibration control method of the computer device 2 may include steps S300 to S310, in which:

step S300, playing the multimedia file.

The multimedia file is an integral file formed by combining audio content, image content, character content, animation content and the like. Of course, in other embodiments, the multimedia file may be a pure audio file.

The multimedia file may be a local file in the computer device 2 or an online file obtained via the internet.

The multimedia file may include various types of content, such as music-like audiovisual content as shown in fig. 1, game-like audiovisual content as shown in fig. 2, movie-like audiovisual content, or other types of content.

Step S302, a target audio file of the multimedia file is obtained, and the target audio file is segmented into a plurality of audio segments.

In order to prevent the noise signal from interfering with the subsequent detection operation to improve the detection accuracy, the target audio file should be an audio file without noise signal interference or within a preset range in which the noise signal interference is controlled, or an audio file with the noise signal removed.

The computer device 2 may separate an initial audio file from the multimedia file and perform noise disturbance detection on the initial audio file. And if the initial audio file is an audio file without noise signal interference or within a controlled preset range of noise signal interference, the computer equipment 2 takes the initial audio file as the target audio file. If the initial audio file is an audio file with excessive noise signal interference, the computer device 2 needs to pre-process the initial audio file to remove the noise signal in the initial audio file.

Which signals in the initial audio file can be considered as noise signals are determined from the content of the multimedia file. As shown in fig. 1, if the content of the multimedia file is audio-video content of music class, the speech signal in the initial audio file may be considered as a noise signal generating interference. As shown in fig. 4, step S302 may include steps S400 to S404, in which: step S400, extracting an initial audio file of the multimedia file; step S402, according to the content of the multimedia file, determining a noise signal and a non-noise signal in the initial audio file; step S404, separating the noise signal and the non-noise signal in the initial audio file to obtain the target audio file corresponding to the non-noise signal. In some embodiments, the computer device 2 may separate the noise signal and the non-noise signal in the initial audio file by a trained deep neural network model, a hidden markov model, or the like. In other embodiments, the computer device 2 may also implement the separation operation in step S402 by other ways, such as time domain analysis or frequency domain analysis.

For example, in step S402, the computer device 2 may obtain or determine the content of the multimedia file according to the classification of the multimedia file, the brief description, the comment keyword, and the like. Here, the content of the multimedia file includes, but is not limited to, a music class, a commentary class, and the like. The contents of the multimedia file are different, and the noise signal and the non-noise signal in the initial audio file are different. For example, if the content of the multimedia file is audio and video content of music, the voice signal in the initial audio file is used as a noise signal, and the non-voice signal is used as a non-noise signal; and if the content in the multimedia file is the narration type, taking the non-voice signal in the initial audio file as a noise signal, taking the voice signal as a non-noise signal and the like.

As an example, in some cases, the speech signal in the initial audio file may be considered to be a noisy signal that creates interference. As shown in fig. 5, step S402 may include steps S500 to S502, wherein: step S500, judging whether the content of the multimedia file is the audio and video content of music; step S502, if the content of the multimedia file is the audio and video content of music, determining that the voice signal in the initial audio file is the noise signal and the non-voice signal in the initial audio file is the non-noise signal. The method has the advantages that the human voice interference in the audio and video content of music can be eliminated, so that the accuracy of detecting the drum points of the subsequent drum points is improved.

Step S304, detecting each audio clip to obtain a target audio clip from the plurality of audio clips according to the detection result.

Illustratively, each audio clip may be 10 milliseconds.

Illustratively, the target audio segment should have a characteristic that distinguishes it from other audio segments of the plurality of audio segments. For example, the target audio segment may be more motivated by user experience than other audio segments of the plurality of audio segments.

In an exemplary embodiment, in order to quickly and accurately acquire the target audio clip from the plurality of audio clips, as shown in fig. 6, step S304 may include steps S600 to S602, wherein: step S600, identifying whether each audio segment is an audio mutation segment; step S602, if one of the audio segments is the abrupt audio segment, determining that the audio segment is the target audio segment. In some embodiments, computer device 2 may identify whether the respective audio segment is the abrupt audio segment by a trained deep neural network model, a hidden markov model, or the like. In other embodiments, the computer device 2 may also implement the identification operation in step S500 in other manners, such as time domain analysis or frequency domain analysis.

Among other things, model identification consists in identifying abrupt audio segments by their audio features (e.g., mel-frequency cepstral coefficients MFCC, fundamental frequency, etc.). The time domain analysis consists in finding audio abrupt segments by calculating the energy accumulation of the waveform file. The frequency domain analysis consists in finding audio abrupt segments by calculating spectral energy variations.

The audio mutant segment comprises at least one of the following features:

(1) the magnitude of the energy change exceeds a first threshold. The energy variation amplitude may refer to an energy variation amplitude inside the abrupt audio segment, or may refer to an energy variation amplitude between the abrupt audio segment and a previous audio segment adjacent to the abrupt audio segment. In some embodiments, the energy variation amplitude may be understood as an energy increase amplitude.

(2) The pitch change amplitude exceeds a second threshold. The pitch variation amplitude may refer to a pitch variation amplitude inside the abrupt audio segment, or may refer to a pitch variation amplitude between the abrupt audio segment and a previous audio segment adjacent to the abrupt audio segment. In some embodiments, the pitch change amplitude may be understood as a pitch increase amplitude.

(3) The tone variation amplitude exceeds a third threshold. The tone variation amplitude may refer to a tone variation amplitude inside the abrupt change segment of audio frequency, or may refer to a tone variation amplitude between the abrupt change segment of audio frequency and the immediately preceding audio segment. In some embodiments, the tone variation amplitude may be understood as a tone increase amplitude.

The above steps S600 to S602 provide a first way of obtaining the target audio clip. The following provides a second acquisition approach.

As previously described, the multimedia file may include various types of content, such as, for example, audio-visual content such as music, game, movie, or other types of content. The perception points of the users are different for different types of content. For example, for audio-video content of music class, the user focuses on the rhythm sensation; for the audio and video contents of games, users focus on threatening sounds such as gunshot and the like.

In an exemplary embodiment, in order to quickly and accurately acquire a target audio segment that conforms to the user' S emphasis (or stimulus point) from the plurality of audio segments, as shown in fig. 7, step S304 may include steps S700 to S702, where: step S700, determining the audio category of the audio file; step S702, performing a detection operation on the plurality of audio segments to obtain the target audio segment associated with the audio type. For example, the audio category is a music audio category, and the target audio segment is an audio segment with a music drumbeat; the audio category is a game audio category, and the target audio clip is an audio clip with a gun shot sound production point.

The following provides a third acquisition mode.

In an exemplary embodiment, in order to quickly and accurately acquire the target audio clip from the plurality of audio clips, as shown in fig. 8, step S304 may include steps S800 to S804, where: step S800, acquiring characteristic parameters of each audio clip; step S802, inputting the characteristic parameters of each audio clip into the trained deep neural network model; step S804, determining the target audio segment from the plurality of audio segments according to the output result of the deep neural network model. In some embodiments, the initial deep neural network model may be trained over a large amount of audio content of music classes to obtain a deep neural network model that finds music drum points. In other embodiments, the initial deep neural network model may be trained over a large amount of game-like audio content to derive a deep neural network model for finding gunshot or other special sounds. In other embodiments, the initial deep neural network model may be trained through a large amount of various audio contents to obtain a deep neural network model for finding various mutation points.

Step S306, according to the target audio clip, determining a target time interval in the total playing time interval of the multimedia file.

For example, the total playing time of the audio file is 30 seconds, the audio file is divided into 3000 audio segments, and the time length of each audio segment is 10 milliseconds, so that the 1 st audio segment is from 0 millisecond to 9 millisecond, the 2 nd audio segment is from 10 millisecond to 19 millisecond, the 3 rd audio segment is from 20 millisecond to 29 millisecond, …, and the 300 rd audio segment is from 29990 millisecond to 29999 millisecond. For example, if the 3 rd audio clip in the audio file is the target audio clip, the target time interval may be determined to be 20 ms to 29 ms based on the target audio clip.

Step S308, monitoring the current playing time point of the multimedia file.

The current playing time point is a playing time point corresponding to the multimedia content (video frame) currently being played. The play time point is a relative position point in the total play time interval. The current play time point corresponds to a current position point in a play progress bar displayed by the application 2A when the multimedia content is played.

Step S310, when the current playing time point enters the target time interval, controlling a vibration element in the computer device 2 to execute a first type of vibration operation.

The first type of shaking operation may be an impulse type shaking operation.

As an example, the content of the multimedia file is an audio-video content of a game class, and the target audio clip is an audio clip with a shot sound production point. When the computer device 2 plays the target audio segment of the multimedia file, the shot picture, the shot sound and the pulse type vibration operation in the target audio segment are output simultaneously. That is, the computer device 2 outputs the visual information and the auditory information and also outputs the tactile information in a vibration manner, so that the visual, auditory and tactile content output is realized, and the user experience is effectively improved.

In an exemplary embodiment, the computer device 2 may further perform a second type of vibration operation to further enhance the interaction with the user and enhance the user experience. As shown in fig. 9, the method may further include steps S900 to S902, wherein: step S900, detecting the audio power of each audio clip; and step S902, executing a second vibration operation on the vibration element in the computer equipment according to the audio power of each audio clip. The first type of shaking operation may be a constant shaking operation. The amplitude of the sustained shaking operation varies with the audio power of the individual audio segments. In this embodiment, the computer device 2 controls the vibration element to perform vibration operation through the pulse vibration signal and the continuous vibration signal in the process of playing the multimedia file, so as to improve the vibration experience.

According to the vibration control method of the computer equipment, the computer equipment can automatically detect each audio clip in the multimedia file in the process of playing the multimedia file, determine whether each audio clip (such as energy change, pitch change and the like) meets the condition of executing the first type of vibration operation according to the audio characteristics of each audio clip, determine the audio clip meeting the first type of vibration condition as the target audio clip, and execute the first type of vibration operation when the multimedia file is played to the target time interval corresponding to the target audio clip. That is to say, in the embodiment of the application, on the premise that the multimedia file itself does not provide any vibration information, the haptic information can be output in a vibration manner in a specific time interval (for example, a target time interval) while the visual information and the auditory information are still output, so that the user experience is improved, and the application range is wide.

According to the embodiment of the application, the visual, auditory and tactile omnibearing content output is realized by increasing the vibration mode, the output mode and the interaction mode are effectively increased, the interaction with a user is improved, and the user has more real experience.

Example two

Fig. 10 schematically shows a block diagram of a vibration control system of a computer device according to a second embodiment of the present application, which may be divided into one or more program modules, the one or more program modules being stored in a storage medium and executed by one or more processors to implement the embodiments of the present application. The program modules referred to in the embodiments of the present application refer to a series of computer program instruction segments that can perform specific functions, and the following description will specifically describe the functions of the program modules in the embodiments.

As shown in fig. 10, the vibration control system 1000 of the computer device may include a play module 1010, an acquisition module 1020, a detection module 1030, a determination module 1040, a monitoring module 1050, and a control module 1060, wherein:

a playing module 1010, configured to play a multimedia file;

an obtaining module 1020, configured to obtain an audio file of the multimedia file, and segment the audio file into multiple audio segments;

a detecting module 1030, configured to detect each audio segment, so as to obtain a target audio segment from the multiple audio segments according to a detection result;

a determining module 1040, configured to determine a target time interval in a total playing time interval of the multimedia file according to the target audio clip;

a monitoring module 1050 configured to monitor a current playing time point of the multimedia file; and

a control module 1060, configured to control a vibration element in the computer device to execute a first type of vibration operation when the current playing time point enters the target time interval.

In an exemplary embodiment, the obtaining module 1020 is further configured to: extracting an initial audio file of the multimedia file; determining a noise signal and a non-noise signal in the initial audio file according to the content of the multimedia file; and separating the noise signal and the non-noise signal in the initial audio file to obtain the target audio file corresponding to the non-noise signal.

In an exemplary embodiment, the obtaining module 1020 is further configured to: judging whether the content of the multimedia file is audio and video content of music; and if the content of the multimedia file is the audio and video content of music, determining that the voice signal in the initial audio file is the noise signal and the non-voice signal in the initial audio file is the non-noise signal.

In an exemplary embodiment, the obtaining module 1020 is further configured to: extracting an initial audio file of the multimedia file; and separating a voice signal and a non-voice signal in the initial audio file to obtain the target audio file corresponding to the non-voice signal.

In an exemplary embodiment, the detecting module 1030 is further configured to: identifying whether each audio segment is an audio mutation segment; and if one of the audio segments is the audio abrupt change segment, determining the audio segment as the target audio segment.

In an exemplary embodiment, the audio break segment includes one of the following features: the amplitude of the energy change exceeds a first threshold value; the pitch variation amplitude exceeds a second threshold; and the tone variation amplitude exceeds a third threshold.

In an exemplary embodiment, the detecting module 1030 is further configured to: determining an audio category of the audio file; and detecting the plurality of audio segments to acquire the target audio segment associated with the audio type.

In an exemplary embodiment, the audio category is a music audio category and the target audio segment is an audio segment having a music drum point.

In an exemplary embodiment, the audio category is a game audio category and the target audio piece is an audio piece having a gun shot sound spot.

In an exemplary embodiment, the detecting module 1030 is further configured to: acquiring characteristic parameters of each audio clip; inputting the characteristic parameters of each audio clip into the trained deep neural network model; and determining the target audio clip from the plurality of audio clips according to the output result of the deep neural network model.

In the exemplary embodiment, the control module 1060 is further configured to: detecting the audio power of each audio segment; and executing a second type of vibration operation on the vibration element in the computer equipment according to the audio power of each audio clip.

EXAMPLE III

Fig. 11 schematically shows a hardware architecture diagram of a computer device 2 suitable for implementing a vibration control method of the computer device according to a third embodiment of the present application. In the present embodiment, the computer device 2 is a device capable of automatically performing numerical calculation and/or information processing in accordance with a command set in advance or stored. For example, the server may be a smart phone, a tablet computer, a notebook computer, a desktop computer, a rack server, a blade server, a tower server, or a rack server (including an independent server or a server cluster composed of a plurality of servers). As shown in fig. 11, the computer device 2 includes at least, but is not limited to: memory 1110, processor 1120, network interface 1130, and vibrating element 1140 may be communicatively linked to each other via a system bus. Wherein:

the memory 1110 includes at least one type of computer-readable storage medium including a flash memory, a hard disk, a multimedia card, a card-type memory (e.g., SD or DX memory, etc.), a Random Access Memory (RAM), a Static Random Access Memory (SRAM), a read-only memory (ROM), an electrically erasable programmable read-only memory (EEPROM), a programmable read-only memory (PROM), a magnetic memory, a magnetic disk, an optical disk, and the like. In some embodiments, the storage 1110 may be an internal storage module of the computer device 2, such as a hard disk or a memory of the computer device 2. In other embodiments, the memory 1110 may also be an external storage device of the computer device 2, such as a plug-in hard disk, a Smart Media Card (SMC), a Secure Digital (SD) Card, a Flash memory Card (Flash Card), and the like, provided on the computer device 2. Of course, memory 1110 may also include both internal and external memory modules of computer device 2. In this embodiment, the memory 1110 is generally used for storing an operating system installed in the computer device 2 and various types of application software, such as program codes of a vibration control method of the computer device. In addition, the memory 1110 may also be used to temporarily store various types of data that have been output or are to be output.

Processor 1120 may be a Central Processing Unit (CPU), controller, microcontroller, microprocessor, or other data Processing chip in some embodiments. The processor 1120 is generally configured to control the overall operation of the computer device 2, such as performing control and processing related to data interaction or communication with the computer device 2. In this embodiment, the processor 1120 is configured to execute program codes stored in the memory 1110 or process data.

Network interface 1130 may include a wireless network interface or a wired network interface, and network interface 1130 is typically used to establish communication links between computer device 2 and other computer devices. For example, the network interface 1130 is used to connect the computer device 2 to an external terminal via a network, establish a data transmission channel and a communication link between the computer device 2 and the external terminal, and the like. The network may be a wireless or wired network such as an Intranet (Intranet), the Internet (Internet), a Global System of Mobile communication (GSM), Wideband Code Division Multiple Access (WCDMA), a 4G network, a 5G network, Bluetooth (Bluetooth), or Wi-Fi.

The vibration element 1140 may include a vibration motor for providing a vibration function.

It is noted that FIG. 11 only shows a computer device having components 1110 and 1140, but it is understood that not all of the shown components are required and that more or fewer components may be implemented instead.

In this embodiment, the vibration control method of the computer device stored in the memory 1110 may be further divided into one or more program modules and executed by one or more processors (in this embodiment, the processor 1120) to implement the embodiments of the present application.

Example four

The present application also provides a computer-readable storage medium having stored thereon a computer program which, when executed by a processor, implements the steps of the shock control method of the computer device in the embodiments.

In this embodiment, the computer-readable storage medium includes a flash memory, a hard disk, a multimedia card, a card type memory (e.g., SD or DX memory, etc.), a Random Access Memory (RAM), a Static Random Access Memory (SRAM), a Read Only Memory (ROM), an Electrically Erasable Programmable Read Only Memory (EEPROM), a Programmable Read Only Memory (PROM), a magnetic memory, a magnetic disk, an optical disk, and the like. In some embodiments, the computer readable storage medium may be an internal storage unit of the computer device, such as a hard disk or a memory of the computer device. In other embodiments, the computer readable storage medium may be an external storage device of the computer device, such as a plug-in hard disk, a Smart Media Card (SMC), a Secure Digital (SD) Card, a Flash memory Card (Flash Card), and the like provided on the computer device. Of course, the computer-readable storage medium may also include both internal and external storage devices of the computer device. In this embodiment, the computer-readable storage medium is generally used for storing an operating system and various types of application software installed in the computer device, for example, the program code of the vibration control method of the computer device in the embodiment, and the like. Further, the computer-readable storage medium may also be used to temporarily store various types of data that have been output or are to be output.

It will be apparent to those skilled in the art that the modules or steps of the embodiments of the present application described above may be implemented by a general purpose computing device, they may be centralized on a single computing device or distributed across a network of multiple computing devices, and alternatively, they may be implemented by program code executable by a computing device, such that they may be stored in a storage device and executed by a computing device, and in some cases, the steps shown or described may be performed in an order different from that described herein, or they may be separately fabricated into individual integrated circuit modules, or multiple ones of them may be fabricated into a single integrated circuit module. Thus, embodiments of the present application are not limited to any specific combination of hardware and software.

The above description is only a preferred embodiment of the present application, and not intended to limit the scope of the present application, and all modifications of equivalent structures and equivalent processes, which are made by the contents of the specification and the drawings of the present application, or which are directly or indirectly applied to other related technical fields, are included in the scope of the present application.