阅读说明：本技术 一种多媒体数据处理方法、装置、计算设备及存储介质 (Multimedia data processing method and device, computing equipment and storage medium ) 是由 陈世杰 赵西 于 2021-09-03 设计创作，主要内容包括：本发明公开了一种多媒体数据处理方法、装置、计算设备及存储介质,多媒体数据处理方法在计算设备中执行,该方法包括：获取输入法的输入框中输入的信息；从多媒体数据集合中确定与信息相匹配的至少一条多媒体数据；在输入法的显示框上至少显示多媒体数据的描述信息。(The invention discloses a multimedia data processing method, a device, a computing device and a storage medium, wherein the multimedia data processing method is executed in the computing device and comprises the following steps: acquiring information input in an input box of an input method; determining at least one piece of multimedia data matched with the information from the multimedia data set; and at least displaying the description information of the multimedia data on a display frame of the input method.)

1. A method of multimedia data processing, the method comprising:

acquiring information input in an input box of an input method;

determining at least one piece of multimedia data matching the information;

and at least displaying the description information of the multimedia data on a display frame of the input method.

2. The method of claim 1, further comprising the steps of:

when a selection instruction of the description information is monitored, detecting whether a target application interacting with the input method supports the multimedia data or not;

if yes, the multimedia data are sent to the target application;

and if not, generating a hypertext link of the multimedia data, and sending the hypertext link to the target application so as to display the multimedia data by jumping to an interface pointed by the hypertext link.

3. The method of claim 2, wherein the detecting whether a target application interacting with the input method supports the multimedia data when a selection instruction of the description information is monitored comprises:

extracting attribute information of the target application, wherein the attribute information at least comprises supported data types, sizes and formats;

and judging whether the target application supports the multimedia data or not according to the attribute information.

4. The method of claim 1, wherein the determining at least one piece of multimedia data matching the information comprises:

and matching the information with the description information of each multimedia data in the multimedia data set so as to match at least one multimedia data.

5. The method of claim 4, further comprising the step of generating the set of multimedia data comprising:

generating description information of each multimedia data, wherein the description information at least comprises: name, feature data of the multimedia data;

and respectively associating each description information with corresponding multimedia data.

6. The method of claim 2, wherein after the step of sending the multimedia data to the target application if supported, further comprising the step of:

presenting an input option interface on a display interface of the target application, wherein the input option interface at least comprises one of a play interface, a pause interface, a return interface, a replay interface and a save interface;

and responding to the trigger operation of the input option interface, and executing a corresponding action.

7. The method of claim 6, wherein the display interface of the target application is a rich text box.

8. A multimedia data processing apparatus comprising:

the acquisition module is suitable for acquiring information input in an input frame of an input method;

a determining module adapted to determine at least one piece of multimedia data matching the information;

and the display module is suitable for displaying the description information of the multimedia data in a display frame of the input method.

9. A computing device, comprising:

at least one processor; and

a memory storing program instructions configured for execution by the at least one processor, the program instructions comprising instructions for performing the method of any of claims 1-7.

10. A readable storage medium storing program instructions that, when read and executed by a computing device, cause the computing device to perform the method of any of claims 1-7.

Technical Field

The invention relates to the technical field of computers, in particular to a multimedia data processing method, a multimedia data processing device, a computing device and a storage medium.

Background

At present, the existing input method can input contents such as expression pictures, characters, common picture sets and common sentence sets (holiday blessings) and the like. However, the input method cannot directly input audio and video data, and a user can only obtain the audio and video data through related search, so that the problems of complex operation, low obtaining efficiency and the like exist.

Disclosure of Invention

In view of the above, the present invention has been made to provide a multimedia data processing method, apparatus, computing device and storage medium that overcome or at least partially solve the above-mentioned problems.

According to an aspect of the present invention, there is provided a multimedia data processing method, executed in a computing device, the method comprising: acquiring information input in an input box of an input method; determining at least one piece of multimedia data matched with the information; and at least displaying the description information of the multimedia data on a display frame of the input method.

Optionally, in the method for displaying multimedia data according to the input method of the present invention, the method further includes: when a selection instruction of the description information is monitored, detecting whether a target application interacting with an input method supports multimedia data or not; if so, sending the multimedia data to the target application; and if not, generating a hypertext link of the multimedia data, and sending the hypertext link to the target application so as to display the multimedia data by jumping to an interface pointed by the hypertext link.

Optionally, in the method for displaying multimedia data according to the input method of the present invention, when a selection instruction of the description information is monitored, the step of detecting whether a target application interacting with the input method supports multimedia data includes: extracting attribute information of the target application, wherein the attribute information at least comprises supported data types, sizes and formats; and judging whether the target application supports the multimedia data or not according to the attribute information.

Alternatively, in the method of displaying multimedia data according to the input method of the present invention, wherein the step of determining at least one piece of multimedia data matching the information includes: and matching the information with the description information of each multimedia data in the multimedia data set so as to match at least one multimedia data.

Optionally, in the method for displaying multimedia data according to the input method of the present invention, the method further includes a step of generating a multimedia data set, including: generating description information of each multimedia data, wherein the description information at least comprises: name, feature data of the multimedia data; and respectively associating each description information with the corresponding multimedia data.

Optionally, in the method for displaying multimedia data according to the input method of the present invention, after the step of sending the multimedia data to the target application if supported, the method further includes the steps of: presenting an input option interface on a display interface of the target application, wherein the input option interface at least comprises one of a playing interface, a pausing interface, a returning interface, a replaying interface and a saving interface; and responding to the triggering operation of the input option interface, and executing corresponding action.

Optionally, in the method for displaying multimedia data according to the input method of the present invention, the display interface of the target application is a rich text box.

According to still another aspect of the present invention, there is provided a multimedia data processing apparatus comprising: the acquisition module is suitable for acquiring information input in an input frame of an input method; a determining module adapted to determine at least one piece of multimedia data matching the information; and the display module is suitable for displaying the description information of the multimedia data in a display frame of the input method.

According to yet another aspect of the invention, there is provided a computing device comprising: at least one processor; and a memory storing program instructions, wherein the program instructions are configured to be executed by the at least one processor, the program instructions comprising instructions for performing the above-described method.

According to yet another aspect of the present invention, there is provided a readable storage medium storing program instructions which, when read and executed by a computing device, cause the computing device to perform the above-described method.

According to the scheme of the invention, the multimedia data is directly displayed on the display frame of the input method, the content input by the input method can be expanded, and the user can conveniently input the multimedia data by using the input method. So that the content which can be input by the input method is not limited to characters and pictures. The method has positive heuristic extension effect on the information which can be input by the input method.

The foregoing description is only an overview of the technical solutions of the present invention, and the embodiments of the present invention are described below in order to make the technical means of the present invention more clearly understood and to make the above and other objects, features, and advantages of the present invention more clearly understandable.

Drawings

Various other advantages and benefits will become apparent to those of ordinary skill in the art upon reading the following detailed description of the preferred embodiments. The drawings are only for purposes of illustrating the preferred embodiments and are not to be construed as limiting the invention. Also, like reference numerals are used to refer to like parts throughout the drawings. In the drawings:

FIG. 1 shows a schematic diagram of a computing device 100, according to one embodiment of the invention;

FIG. 2 shows a flow diagram of a method 200 of multimedia data processing according to one embodiment of the invention;

FIG. 3 shows a schematic diagram of an input method 300 according to one embodiment of the invention;

FIG. 4 shows a schematic diagram of an application scenario 400 according to one embodiment of the present invention;

FIG. 5 illustrates a flow diagram of an application scenario 500, according to one embodiment of the present invention;

fig. 6 shows a schematic diagram of a multimedia data processing apparatus 600 according to an embodiment of the invention.

Detailed Description

Exemplary embodiments of the present disclosure will be described in more detail below with reference to the accompanying drawings. While exemplary embodiments of the present disclosure are shown in the drawings, it should be understood that the present disclosure may be embodied in various forms and should not be limited to the embodiments set forth herein. Rather, these embodiments are provided so that this disclosure will be thorough and complete, and will fully convey the scope of the disclosure to those skilled in the art.

At present, in an application scenario where audio/video data needs to be acquired, a user generally inputs a keyword in a search engine, correspondingly selects required audio data from search results provided in the search engine, and then downloads the audio data to the local. The mode of acquiring audio and video data is too complicated.

In order to solve the problems in the prior art, the invention provides a scheme. One embodiment of the present invention provides a method for displaying multimedia data by an input method, which can be executed in a computing device. FIG. 1 shows a block diagram of a computing device 100, according to one embodiment of the invention. As shown in FIG. 1, in a basic configuration 102, a computing device 100 typically includes a system memory 106 and one or more processors 104. A memory bus 108 may be used for communication between the processor 104 and the system memory 106.

Depending on the desired configuration, the processor 104 may be any type of processing, including but not limited to: a microprocessor (μ P), a microcontroller (μ C), a Digital Signal Processor (DSP), or any combination thereof. The processor 104 may include one or more levels of cache, such as a level one cache 110 and a level two cache 112, a processor core 114, and registers 116. The example processor core 114 may include an Arithmetic Logic Unit (ALU), a Floating Point Unit (FPU), a digital signal processing core (DSP core), or any combination thereof. The example memory controller 118 may be used with the processor 104, or in some implementations the memory controller 118 may be an internal part of the processor 104.

Depending on the desired configuration, system memory 106 may be any type of memory, including but not limited to: volatile memory (such as RAM), non-volatile memory (such as ROM, flash memory, etc.), or any combination thereof. The physical memory in the computing device is usually referred to as a volatile memory RAM, and data in the disk needs to be loaded into the physical memory to be read by the processor 104. System memory 106 may include an operating system 120, one or more applications 122, and program data 124. The application 122 is actually a plurality of program instructions that direct the processor 104 to perform corresponding operations. In some embodiments, the application 122 may be arranged to execute instructions on an operating system with the program data 124 by the one or more processors 104 in some embodiments. Operating system 120 may be, for example, Linux, Windows, etc., which includes program instructions for handling basic system services and performing hardware dependent tasks. The application 122 includes program instructions for implementing various user-desired functions, and the application 122 may be, for example, but not limited to, a browser, instant messenger, a software development tool (e.g., an integrated development environment IDE, a compiler, etc.), and the like. When the application 122 is installed into the computing device 100, a driver module may be added to the operating system 120.

When the computing device 100 is started, the processor 104 reads program instructions of the operating system 120 from the memory 106 and executes them. The application 122 runs on top of the operating system 120, utilizing the operating system 120 and interfaces provided by the underlying hardware to implement various user-desired functions. When the user starts the application 122, the application 122 is loaded into the memory 106, and the processor 104 reads the program instructions of the application 122 from the memory 106 and executes the program instructions.

The computing device 100 also includes a storage device 132, the storage device 132 including removable storage 136 and non-removable storage 138, the removable storage 136 and the non-removable storage 138 each connected to the storage interface bus 134.

Computing device 100 may also include an interface bus 140 that facilitates communication from various interface devices (e.g., output devices 142, peripheral interfaces 144, and communication devices 146) to the basic configuration 102 via the bus/interface controller 130. The example output device 142 includes a graphics processing unit 148 and an audio processing unit 150. They may be configured to facilitate communication with various external devices, such as a display or speakers, via one or more a/V ports 152. Example peripheral interfaces 144 may include a serial interface controller 154 and a parallel interface controller 156, which may be configured to facilitate communication with external devices such as input devices (e.g., keyboard, mouse, pen, voice input device, touch input device) or other peripherals (e.g., printer, scanner, etc.) via one or more I/O ports 158. An example communication device 146 may include a network controller 160, which may be arranged to facilitate communications with one or more other computing devices 162 over a network communication link via one or more communication ports 164.

A network communication link may be one example of a communication medium. Communication media may typically be embodied by computer readable instructions, data structures, program modules, and may include any information delivery media, such as carrier waves or other transport mechanisms, in a modulated data signal. A "modulated data signal" may be a signal that has one or more of its data set or its changes made in such a manner as to encode information in the signal. By way of non-limiting example, communication media may include wired media such as a wired network or private-wired network, and various wireless media such as acoustic, Radio Frequency (RF), microwave, Infrared (IR), or other wireless media. The term computer readable media as used herein may include both storage media and communication media.

The computing device 100 also includes a storage interface bus 134 coupled to the bus/interface controller 130. The storage interface bus 134 is coupled to the storage device 132, and the storage device 132 is adapted to store data. An example storage device 132 may include removable storage 136 (e.g., CD, DVD, usb disk, removable hard disk, etc.) and non-removable storage 138 (e.g., hard disk drive HDD, etc.).

In the computing device 100 according to the invention, the application 122 comprises a plurality of program instructions that perform the method 200.

Fig. 2 shows a flow diagram of a multimedia data processing method 200 according to an embodiment of the invention. The method 200 is suitable for execution in a computing device, such as the computing device 100 described above.

As shown in fig. 2, the method 200 is intended to implement a multimedia data processing method, starting with step S202, and in step S202, information input in an input box of an input method is acquired. The input method refers to a coding method adopted for inputting various symbols into a computer or other equipment (such as a mobile phone). Generally, we directly refer to "input method software" as "input method", for example, refer to "search dog pinyin input method software" as "search dog pinyin input method". The input method software generally defaults to have some coding mode, such as pinyin coding in Chinese input method, also known as pinyin input method. Some input method software names are the coding names of the input method, such as a Wang code five-stroke font input method, a super-strong two-stroke input method and the like.

It should be noted that the information input by the input method is generally character information or voice information, which is generally input by using a computer keyboard or a mobile phone keyboard, and the input method in a broad sense also includes input methods such as handwriting, voice, OCR scanning reader, and tachograph, and the invention is not limited to which method is used for input. Handwriting recognition is typically used to identify text or other symbols from a user's handwritten font by means of a computer's handwriting recognition function. Speech recognition uses a microphone and speech recognition software to discriminate between words. The types of OCR software are many, and after the system recognizes the pattern, the system marks characters that cannot be confirmed, so as to input characters or symbols into the computer. The quick recording technology generally adopts a special quick recording keyboard and equipment, has international special quick recording equipment, and generally adopts a parallel-stroke operation (namely, a plurality of fingers press different key positions each time), so that the whole word can be displayed once each time.

In a specific example, as shown in fig. 3, fig. 3 shows a schematic structural diagram of an input method 300 according to an embodiment of the invention. In this example, a conventional keyboard input method is taken as an example. Fig. 3 shows an input method structure including an input frame and a display frame. The input box is directly corresponding to the displayed content based on the input operation of the keyboard by the user. For example, in the pinyin input method, the pinyin content input by the user is displayed in the input box. The display frame is the display content matched according to the content input in the input frame.

In step S204, at least one piece of multimedia data matching the information is determined. Specifically, the information is matched with description information of each multimedia data in the multimedia data set so as to be matched to at least one multimedia data. The multimedia data set stores various media data such as characters, pictures, photos, animations, audios and videos. The database may be a local database residing in the computing device, or a database residing in a remote server connected to the computing device, which is not limited in this application.

In one embodiment, a multimedia data set (also referred to as a multimedia database) is constructed based on metadata of multimedia data, such as audio, image, video, animation, etc., which is binary data that requires a computer, is unstructured and cannot be simply represented by a mathematical analytic expression. The multimedia database must obtain an interpretation of the content and information characteristics of the media objects, referred to as metadata, to complete the storage and retrieval application. The metadata is generated by a feature extraction function on the media object.

Specifically, in this implementation, the method for constructing the multimedia data set includes: firstly, generating description information of each multimedia data, wherein the description information at least comprises: the name of the multimedia data, the feature data, and the like describe data of the attribute information of the multimedia data. Characteristic data, i.e. metadata of the media data, such as size of the data, construction time of the data, etc. For example, for one fretwork of von scleral parlor, the description information may be "von scleral spring and night frets-5M", where "von scleral spring and night frets" is the name of the media data and 5M is the size of the media data (i.e., feature data).

In some embodiments, the description information may be text information, or may be other structure types such as pictures. The present application is not limited thereto.

Then, each description information is associated with the corresponding multimedia data.

In one particular example, a user may store favorite multimedia data in a multimedia data collection based on their own preferences. For example, the user may store a section of a favorite von scleral teacher's frets in the multimedia data set and generate information "von scleral 2012 spring-late frets" or "von scleral spring-late works" or the like of the section of the frets. The description information is then associated with the snippet to facilitate retrieval of multimedia data in the multimedia data set. When the information input in the input box of the input method is detected to be related to 'fenggong', the small item fragment is matched in the multimedia data set.

In step S206, at least description information of the multimedia data is displayed on the display frame of the input method. The description information may be description information of the matched multimedia data in the multimedia data set. And may be description information formed based on information entered in the input box as long as it can be correlated with the matched multimedia data. This is not limited in this application.

In a specific example, with continued reference to fig. 3, when the user inputs "fenggong" in the input frame of the input method, a plurality of display result contents matching the information of "fenggong" are correspondingly displayed in the display frame of the input method, wherein besides normal plain text information contents (such as "von sclera", "vogue", "feng gong", etc. in the figure), description information of multimedia data is displayed, such as description information of multimedia displayed at the 2 position in the figure.

In addition, the input method is generally used for servicing some inputtable applications, namely, the input operation is performed in the application program through the input method. Thus, in some embodiments, the multimedia data processing method 200 further comprises:

when a selection instruction of the description information is monitored, whether a target application interacting with the input method supports multimedia data or not is detected. In this embodiment, the selection instruction is an instruction for the user to select the content displayed in the display frame. Referring to fig. 3, the content displayed in the display frame corresponds to one identifier, for example, "von sclera" corresponds to identifier 1, and after the user selects the corresponding identifier through a hardware device such as a keyboard, the computing device sends the corresponding content to the display interface of the target application, for example, when the user triggers the corresponding "1" key on the keyboard, then "von sclera" is correspondingly input on the display interface of the target application. In addition to the selection operation by the number entry 1, the selection operation may be performed by a hardware device such as a mouse, and the selection operation may be performed by a click operation of a corresponding position by the user for a computing device having a touch function. The present application is not limited thereto.

In this embodiment, the display interface of the target application is a rich text box. Various multimedia data playing plug-ins such as pictures, animations, audio and video playing and the like are configured in the rich text box. In the embodiment, DTK (decaptin tool) is used as a development tool of the rich text box. The DTK is a set of UI graphic library developed based on Qt5, is convenient for compiling deep desktop and deep serial application in a unified way, and has the main functions of: and a single-instance interface is provided, so that the direct use is convenient. The system does not need to make wheels, provide a series of functions of XCB window moving, zooming and the like, provides a large amount of beautiful self-drawing controls, does not need a user to prepare a Qt control, and can be directly used. The data that the rich text box can support differs according to different configurations, e.g., some configured rich text boxes can support picture, audio, video, etc. data. Other configurations of rich text boxes may support data such as text-words, plain text, and the like. Also, some configured rich text boxes may support multimedia data in various formats of MP3, MP4, JGP, TFT, and the like. And, the size of the supportable multimedia data is different according to the configuration.

And then, judging whether the target application supports the multimedia data or not according to the attribute information.

When the description information of the multimedia data in the display frame is selected by the user, the multimedia data is sent to the target application because the description information is associated with the multimedia data. However, considering that the target application may not support the multimedia data (due to the limitation of multimedia format, etc.), the multimedia data cannot be presented on the display interface of the target application, resulting in failure of multimedia data transmission. Therefore, before sending multimedia data, it is necessary to determine whether the target application supports the multimedia data.

Preferably, checking whether the target application supports multimedia data may be performed by:

and extracting attribute information of the target application, wherein the attribute information at least comprises supported data types, sizes and formats.

In one particular example, the display interface of the target application is configured to support audio-visual data, MP3 and MP4 formats, and data within 10M size. When the multimedia data matched by the information in the input box are video data 1, video data 2 and video data 3. Wherein, the video data 1 is in MP4 format, and the size is 8M, which indicates that the display interface of the target application supports the video data 1. The video data 2 is in MP4 format and 20M in size, and since the size of the video data 2 is larger than the size that the display interface of the target application can bear, it indicates that the display interface of the target application does not support the video data 2. The video data 3 is in an ASF format, and the size is 8M, and since the display interface of the target application does not support the ASF format, it is indicated that the display interface of the target application does not support the video data 3.

It should be noted that, the user may also directly query the attribute information of the display interface of the target application to know the multimedia data that can be supported by the display interface of the target application. Because there is an information interaction between the rich text box made by DTK and the input method frame, the input method will display the attribute information of the rich text box by moving the mouse cursor to the icon of the input method, in which the multimedia data that can be supported by the input method is recorded.

And if the target application supports the multimedia data, sending the multimedia data to the target application. Specifically, whether other information exists in a clipboard of the computing device is scanned first, and if the information exists, the information in the clipboard is cached through a multimedia data plug-in a display interface (rich text box) of the target application. Then, the multimedia data matched from the multimedia data set is copied to the display interface of the target application by using the clipboard, and finally, the information cached by the multimedia data plug-in is copied to the clipboard again.

After the multimedia data is copied to the target application, operations such as playing the multimedia data can be performed, and therefore, in some embodiments, an input option interface is presented on a display interface of the target application, and the input option interface at least includes one of a playing interface, a pausing interface, a returning interface, a replaying interface and a saving interface. And responding to the triggering operation of the input option interface, and executing corresponding action.

Continuing with the foregoing example, as shown in FIG. 4, FIG. 4 shows a schematic diagram of an application scenario 400 according to one embodiment of the present invention. In fig. 4, after the user passes "von sclera classics small video clip" corresponding to the number key 2, an input option interface such as "play", "return", etc. is presented in the display interface of the target application. Then, responding to the triggering operation of the input option interface, and executing corresponding action. For example, when the user triggers the "play" interface, the play function is performed.

It should be further noted that the input option interface is embedded into the display interface of the target application in an embedded manner. The triggering operation of the input method option interface can be the same as the selection operation, and can also be triggered by setting a shortcut key. For example, a "play" interface is associated with the keyboard enter key, and when the user presses the enter key, the playing of the multimedia data is performed. In addition, the "play" character in the "play" interface shown in fig. 4 is merely an example, and other characters such as "determine" may be set. The present application is not limited thereto.

In a specific example, the user may save the matched multimedia data, and when the user triggers the saving interface, the corresponding multimedia data is saved into a database associated with the user, where the database may be the same as or different from the aforementioned multimedia data set. The user can set the database by himself, the favorite multimedia data of himself are saved in the database, and when the user inputs information in the input box, the multimedia data in the database are matched preferentially.

And if the target application does not support the multimedia data, generating a hypertext link of the multimedia data, and sending the hypertext link to the target application so as to display the multimedia data through jumping to an interface pointed by the hypertext link. Hypertext links to multimedia data are also known as hypermedia, and the like. The method is a technology for organizing and managing blocky multimedia information (including texts, images, videos and the like) by adopting a nonlinear mesh structure, and hypermedia is essentially the same as hypertext, but the hypertext technology is a pure text which is a managed object at the early stage of birth, so the technology is called hypertext. The hypertext is a web text which organizes various text information in different spaces by using a hyperlink method. Hypertext is a further user interface paradigm for displaying text and content related to text. Currently, hypertext generally exists as an electronic document, wherein the text contains links that can be linked to other locations or documents, allowing direct switching from the current reading location to the location pointed to by the hypertext link. The format of hypertext is many, and currently the most commonly used are hypertext markup language (an application under the standard universal markup language) and rich text format. With the rise and development of multimedia technology, the management objects of hypertext technology are expanded from plain text to multimedia, and the term hypermedia is generated to emphasize the change of the management objects. In addition, in this embodiment, the display frame of the input method may directly display the matched multimedia data and the segment of the multimedia data.

In one specific example, as shown in fig. 5, fig. 5 shows a flowchart of an application scenario 500 for playing audio-video data in a display box of an input method according to an embodiment of the present invention. The method comprises the following specific steps:

step S501, the user moves the mouse cursor to the input method.

Step S502, the input method detects the focus indicated by the mouse, and sends a request whether to support the multimedia data playing to the rich text box (the display box of the input method).

And S503, feeding back the supported multimedia types to an attribute description interface of the input method by the rich text money, and presenting the supported multimedia types to the user. Multimedia types include video, audio, pictures, text, and the like. It should be noted that, in this example, only the rich text box supports the multimedia data selected by the user.

Step S504, according to the information input by the user, matching corresponding multimedia data from the multimedia data set through a corresponding plug-in tool.

And step S505, copying the description information of the matched multimedia data to a rich text box to be displayed to a user. After the user matches the multimedia data through the input information, the plug-in tool caches the information in the clipboard of the computing device, copies the corresponding multimedia data from the multimedia data set to the clipboard, pastes the multimedia data to the rich text box, and re-places the information in the clipboard cached before into the clipboard.

And step S506, triggering an input option interface displayed by the rich text box.

And step S507, responding to the triggering operation of the user on the input option interface, and executing corresponding action.

In the multimedia data processing method 200 provided in this embodiment, the multimedia data can be directly sent to the target application through the input method, so that the content input by the input method can be expanded, and a user can conveniently input the multimedia data by using the input method. So that the content which can be input by the input method is not limited to characters and pictures. The method has positive heuristic extension effect on the information which can be input by the input method.

Fig. 6 shows a schematic diagram of a multimedia data processing apparatus 600 according to an embodiment of the invention. As shown in fig. 6, the multimedia data processing apparatus 600 includes: an acquisition module 610, a determination module 620, and a display module 630 coupled to one another.

The obtaining module 610 is adapted to obtain information input in an input box of an input method.

A determining module 620 adapted to determine at least one piece of multimedia data matching the information.

And a display module 630 adapted to display the description information of the multimedia data in a display frame of the input method.

It should be noted that the working principle of the multimedia data processing apparatus 600 provided in the present embodiment is similar to that of the multimedia data processing method 200, and for the relevant points, reference is made to the description of the multimedia data processing method 200, and no further description is given here.

The various techniques described herein may be implemented in connection with hardware or software or, alternatively, with a combination of both. Thus, the methods and apparatus of the present invention, or certain aspects or portions thereof, may take the form of program code (i.e., instructions) embodied in tangible media, such as removable hard drives, U.S. disks, floppy disks, CD-ROMs, or any other machine-readable storage medium, wherein, when the program is loaded into and executed by a machine, such as a computer, the machine becomes an apparatus for practicing the invention.

In the case of program code execution on programmable computers, the computing device will generally include a processor, a storage medium readable by the processor (including volatile and non-volatile memory and/or storage elements), at least one input device, and at least one output device. Wherein the memory is configured to store program code; the processor is configured to perform the method of the invention according to instructions in said program code stored in the memory.

By way of example, and not limitation, readable media may comprise readable storage media and communication media. Readable storage media store information such as computer readable instructions, data structures, program modules or other data. Communication media typically embodies computer readable instructions, data structures, program modules or other data in a modulated data signal such as a carrier wave or other transport mechanism and includes any information delivery media. Combinations of any of the above are also included within the scope of readable media.

In the description provided herein, algorithms and displays are not inherently related to any particular computer, virtual system, or other apparatus. Various general purpose systems may also be used with examples of this invention. The required structure for constructing such a system will be apparent from the description above. Moreover, the present invention is not directed to any particular programming language. It is appreciated that a variety of programming languages may be used to implement the teachings of the present invention as described herein, and any descriptions of specific languages are provided above to disclose preferred embodiments of the invention.

In the description provided herein, numerous specific details are set forth. It is understood, however, that embodiments of the invention may be practiced without these specific details. In some instances, well-known methods, structures and techniques have not been shown in detail in order not to obscure an understanding of this description.

Similarly, it should be appreciated that in the foregoing description of exemplary embodiments of the invention, various features of the invention are sometimes grouped together in a single embodiment, figure, or description thereof for the purpose of streamlining the disclosure and aiding in the understanding of one or more of the various inventive aspects. However, the disclosed method should not be interpreted as reflecting an intention that: that the invention as claimed requires more features than are expressly recited in each claim. Rather, as the following claims reflect, inventive aspects lie in less than all features of a single foregoing disclosed embodiment. Thus, the claims following the detailed description are hereby expressly incorporated into this detailed description, with each claim standing on its own as a separate embodiment of this invention.

Those skilled in the art will appreciate that the modules or units or components of the devices in the examples disclosed herein may be arranged in a device as described in this embodiment or alternatively may be located in one or more devices different from the devices in this example. The modules in the foregoing examples may be combined into one module or may be further divided into multiple sub-modules.

Those skilled in the art will appreciate that the modules in the device in an embodiment may be adaptively changed and disposed in one or more devices different from the embodiment. The modules or units or components of the embodiments may be combined into one module or unit or component, and furthermore they may be divided into a plurality of sub-modules or sub-units or sub-components. All of the features disclosed in this specification (including any accompanying claims, abstract and drawings), and all of the processes or elements of any method or apparatus so disclosed, may be combined in any combination, except combinations where at least some of such features and/or processes or elements are mutually exclusive. Each feature disclosed in this specification (including any accompanying claims, abstract and drawings) may be replaced by alternative features serving the same, equivalent or similar purpose, unless expressly stated otherwise.

Furthermore, those skilled in the art will appreciate that while some embodiments described herein include some features included in other embodiments, rather than other features, combinations of features of different embodiments are meant to be within the scope of the invention and form different embodiments. For example, in the following claims, any of the claimed embodiments may be used in any combination.

Furthermore, some of the described embodiments are described herein as a method or combination of method elements that can be performed by a processor of a computer system or by other means of performing the described functions. A processor having the necessary instructions for carrying out the method or method elements thus forms a means for carrying out the method or method elements. Further, the elements of the apparatus embodiments described herein are examples of the following apparatus: the apparatus is used to implement the functions performed by the elements for the purpose of carrying out the invention.

As used herein, unless otherwise specified the use of the ordinal adjectives "first", "second", "third", etc., to describe a common object, merely indicate that different instances of like objects are being referred to, and are not intended to imply that the objects so described must be in a given sequence, either temporally, spatially, in ranking, or in any other manner.

While the invention has been described with respect to a limited number of embodiments, those skilled in the art, having benefit of this description, will appreciate that other embodiments can be devised which do not depart from the scope of the invention as described herein. Furthermore, it should be noted that the language used in the specification has been principally selected for readability and instructional purposes, and may not have been selected to delineate or circumscribe the inventive subject matter. Accordingly, many modifications and variations will be apparent to those of ordinary skill in the art without departing from the scope and spirit of the appended claims. The present invention has been disclosed in an illustrative rather than a restrictive sense with respect to the scope of the invention, as defined in the appended claims.