阅读说明：本技术 信息处理装置、存储介质及信息处理方法 (Information processing apparatus, storage medium, and information processing method ) 是由 小川正和 于 2020-06-02 设计创作，主要内容包括：一种信息处理装置、存储介质及信息处理方法,所述信息处理装置具备：显示控制单元,控制成以还能够选择未被赋予字符信息的位置的状态显示赋予到动画中的字符信息的一览；及播放单元,在播放被赋予字符信息的动画时,从与在所显示的所述一览中选择的位置对应的播放时刻开始播放动画。(An information processing apparatus, a storage medium, and an information processing method, the information processing apparatus including: a display control unit that controls to display a list of character information added to the moving image in a state where a position to which character information is not added can also be selected; and a playback unit that, when playing back a moving image to which character information is added, starts playing back the moving image from a playback time corresponding to a position selected in the list displayed.)

1. An information processing apparatus includes:

a display control unit that controls to display a list of character information added to the moving image in a state where a position to which character information is not added can also be selected; and

and a playback unit that, when playing back a moving image to which character information is added, starts playing back the moving image from a playback time corresponding to a position selected in the list displayed.

2. The information processing apparatus according to claim 1, wherein,

the display control means displays the list of character information added to the moving image in a state in which the position to which the character information is not added can be selected by inserting the selection target information corresponding to the section of the moving image to which the character information is not added into the list display of the character information.

3. The information processing apparatus according to claim 2, wherein,

the display control means inserts and displays the selection target information in an amount corresponding to the playback time of a section of the moving image to which character information is not added, into a list display of character information.

4. The information processing apparatus according to claim 2, wherein,

the display control means inserts the number of blank lines corresponding to the playback time of the section of the moving image to which the character information is not added into the list display of the character information and displays the blank lines as the selection target information.

5. The information processing apparatus according to claim 2, wherein,

the character information includes subtitle information assigned to the animation and background character information included in the animation.

6. The information processing apparatus according to claim 5, wherein,

when the selection target information is inserted into the list display of character information, the display control means inserts more selection target information than at other positions at a position where the subtitle information is not provided in the moving picture and the background character information changes by a predetermined condition or more.

7. The information processing apparatus according to claim 5, wherein,

when the selected object information is inserted into the list display of character information, the display control means inserts more selected object information than at other positions at a position where the subtitle information is not provided in the moving image and where a scene of the moving image changes by a predetermined condition or more.

8. A storage medium storing a program for causing a computer to execute the steps of:

controlling to display a list of character information added to the moving image in a state where a position to which character information is not added can be selected; and

and a step of starting playing the moving image from a playing time corresponding to the position selected in the displayed list when playing the moving image to which the character information is added.

9. An information processing method, comprising the steps of:

a display control step of controlling to display a list of character information added to the moving image in a state where a position to which character information is not added can also be selected; and

and a playback step of, when playing back a moving image to which character information is added, starting playing back the moving image from a playback time corresponding to the position selected in the list displayed.

Technical Field

The invention relates to an information processing apparatus, a storage medium, and an information processing method.

Background

Patent document 1 discloses an information processing apparatus including: a display control unit that controls display of a display screen including a content display area and a subtitle display area; and an operation recognition unit that recognizes, when a 1 st operation on the subtitle display area is detected, an operation for performing a 2 nd process different from the 1 st process executed when the 1 st operation on the content display area is detected, the 1 st operation being a drag operation, and the 2 nd process being a playback speed change process.

Patent document 2 discloses an information processing apparatus including: a position change detection unit that detects a change in position of the operation body on the screen; a playback state control unit for controlling the playback state of the content; and a display control unit that displays a text list in which at least a part or all of the text data associated with elapsed time when the content is played is arranged in order of elapsed time on the screen, wherein the continuous change in position of the operation body includes a drag operation in the 2 nd axis direction, which is a movement of the operation body in the 2 nd axis direction perpendicular to the 1 st axis direction, which is an arrangement direction of the text data of the text list displayed on the screen, and the play state control unit changes the play state of the content by different control depending on whether or not the continuous change in position of the operation body detected by the position change detection unit on the text list displayed by the display control unit is a drag operation in the 2 nd axis direction.

Patent document 1: japanese patent No. 6044553

Patent document 2: japanese patent No. 6217645

When subtitles are added to a moving picture, a list of subtitles is displayed and a corresponding subtitle is selected from the list of subtitles, and the moving picture may be played from a position corresponding to the selected subtitle.

In this case, although the moving image can be played from a position of the moving image including character information such as subtitles, the moving image cannot be played from a position not including the character information.

Disclosure of Invention

An object of the present invention is to provide an information processing device, a storage medium, and an information processing method that can select a position not containing character information as a playback position of a moving image when selecting the playback position from a list display of character information added to the moving image.

[ information processing apparatus ]

The present invention according to claim 1 is an information processing apparatus including:

a display control unit that controls to display a list of character information added to the moving image in a state where a position to which character information is not added can also be selected; and

and a playback unit that, when playing back a moving image to which character information is added, starts playing back the moving image from a playback time corresponding to a position selected in the list displayed.

The present invention according to claim 2 is the information processing apparatus according to claim 1, wherein the display control means displays the list of character information added to the moving image in a state in which the position to which the character information is not added can be selected by inserting the selection target information corresponding to the section of the moving image to which the character information is not added into the list display of the character information.

In the present invention according to claim 3, in the information processing apparatus according to claim 2, the display control means inserts and displays the selection target information by the number corresponding to the playback time of the section of the moving image to which no character information is added, into a list display of character information.

The present invention according to claim 4 is the information processing apparatus according to claim 2, wherein the display control means inserts, in the list display of character information, the number of blank lines corresponding to the playback time of a section of the moving image to which no character information is added, and displays the blank lines as the selection target information.

The present invention according to claim 5 provides the information processing apparatus according to claim 2, wherein the character information includes subtitle information added to the moving picture and background character information included in the moving picture.

In the present invention according to claim 6, in the information processing apparatus according to claim 5, when the selection target information is inserted in the list display of character information, the display control means inserts more selection target information than at other positions in the moving image to which the subtitle information is not provided and the background character information changes by a predetermined condition or more.

In the present invention according to claim 7, in the information processing apparatus according to claim 5, when the selection object information is inserted in the list display of the character information, the display control means inserts the selection object information more than at other positions in the moving image where the subtitle information is not provided and the scene of the moving image changes by a predetermined condition or more.

[ storage Medium ]

The present invention according to claim 8 is a storage medium storing a program for causing a computer to execute:

controlling to display a list of character information added to the moving image in a state where a position to which character information is not added can be selected; and

and a step of starting playing the moving image from a playing time corresponding to the position selected in the displayed list when playing the moving image to which the character information is added.

[ information processing method ]

The present invention according to claim 9 is an information processing method including the steps of:

a display control step of controlling to display a list of character information added to the moving image in a state where a position to which character information is not added can also be selected; and

and a playback step of, when playing back a moving image to which character information is added, starting playing back the moving image from a playback time corresponding to the position selected in the list displayed.

Effects of the invention

According to the 1 st aspect of the present invention, it is possible to provide an information processing apparatus capable of selecting a position not including character information as a playback position of a moving image when selecting a playback position from a list display of character information added to the moving image.

According to the 2 nd aspect of the present invention, it is possible to provide an information processing apparatus capable of selecting a position not including character information as a playback position of a moving image when selecting a playback position from a list display of character information added to the moving image.

According to the 3 rd aspect of the present invention, it is possible to provide an information processing apparatus capable of selecting a position not containing character information as a playback position of a moving image when selecting a playback position from a list display of character information added to the moving image.

According to the 4 th aspect of the present invention, it is possible to provide an information processing apparatus capable of selecting a position not including character information as a playback position of a moving image when the playback position is selected from a list display of character information added to the moving image.

According to the 5 th aspect of the present invention, it is possible to provide an information processing apparatus capable of selecting a position not containing character information as a playback position of a moving image even when a background character is contained in the moving image when the playback position is selected from a list display of character information added to the moving image.

According to the 6 th aspect of the present invention, it is possible to provide an information processing apparatus capable of selecting a switching position of a page not including subtitle information as a playback position of a moving image when the playback position is selected from a list display of character information added to the moving image.

According to the 7 th aspect of the present invention, it is possible to provide an information processing apparatus capable of selecting a switching position of a moving image not including subtitle information as a playback position of the moving image when the playback position is selected from a list display of character information added to the moving image.

According to the 8 th aspect of the present invention, it is possible to provide a storage medium capable of selecting a position not containing character information as a playback position of a moving image when selecting a playback position from a list display of character information added to the moving image.

According to the 9 th aspect of the present invention, it is possible to provide an information processing method capable of selecting a position not containing character information as a playback position of a moving image when selecting a playback position from a list display of character information added to the moving image.

Drawings

Embodiments of the present invention will be described in detail with reference to the following drawings.

Fig. 1 is a system diagram showing a configuration of a multimedia content generation system according to an embodiment of the present invention;

fig. 2 is a block diagram showing a hardware configuration of the editing processing server 10 according to the embodiment of the present invention;

fig. 3 is a block diagram showing a functional configuration of the editing processing server 10 according to the embodiment of the present invention;

fig. 4 is a flowchart showing a schematic process in the editing processing server 10 according to the embodiment of the present invention;

fig. 5 is a diagram for explaining outline of blank line generation processing in the editing processing server 10 according to the embodiment of the present invention;

fig. 6 is a diagram showing an example of a display screen displayed on the terminal device 20;

fig. 7 is a diagram showing an example of a display screen displayed on the terminal device 20;

fig. 8 is a diagram showing an example of a display screen displayed on the terminal device 20;

fig. 9 is a diagram showing an example of a display screen displayed on the terminal device 20;

fig. 10 is a diagram showing an example of a display screen displayed on the terminal device 20;

fig. 11 is a diagram showing an example of a display screen displayed on the terminal device 20;

fig. 12 is a diagram showing an example of a display screen displayed on the terminal device 20.

Description of the symbols

10-edit processing server, 11-CPU, 12-memory, 13-storage device, 14-communication Interface (IF), 15-User Interface (UI) device, 16-control bus, 20-terminal device, 30-network, 31-data communication section, 32-control section, 33-data storage section, 41-acquisition section, 42-detection section, 43-blank line generation section, 44-display control section, 45-user operation reception section, 46-playback section, 50-caption region, 52-caption information, 53-blank line, 60-text region, 62-caption text region, 64-background character information.

Detailed Description

Next, embodiments of the present invention will be described in detail with reference to the drawings.

Fig. 1 is a system diagram showing a configuration of a multimedia content generating system according to an embodiment of the present invention.

As shown in fig. 1, a multimedia content generation system according to an embodiment of the present invention is configured by an editing processing server 10 and a terminal device 20 such as a personal computer (hereinafter, simply referred to as a computer) connected to each other via a network 30.

The multimedia content generation system of the present embodiment generates multimedia content in which various contents such as moving images, still images, voices, characters, and automatic translations are combined. According to the multimedia content generating system of the present embodiment, for example, it is possible to generate multimedia content such as inserting a subtitle into a moving picture and playing the moving picture from a position where the subtitle is inserted or playing the moving picture from a position where the subtitle is not inserted.

Here, subtitles are used to display information such as explanation, dialogue, translation, and the like on a screen in a moving picture such as a movie or a television using characters, and the subtitles can be transmitted and received as subtitle information between the terminal device 20 and the editing processing server 10.

The editing processing server 10 is an information processing apparatus in which editing software for editing such various contents and generating multimedia contents is installed. The terminal device 20 reads the moving image and generates multimedia content using editing software operating on the editing processing server 10.

It is also possible to install such editing software directly into the computer or other terminal device 20 for use, instead of installing it into the editing processing server 10.

Next, fig. 2 shows a hardware configuration of the editing processing server 10 in the multimedia content generating system according to the present embodiment.

As shown in fig. 2, the editing processing server 10 includes a CPU11, a memory 12, a storage device 13 such as a Hard Disk Drive (HDD), a communication Interface (IF)14 for transmitting and receiving data to and from an external device such as a terminal device 20 via a network 30, and a User Interface (UI) device 15 including a touch panel or a liquid crystal display and a keyboard. These constituent elements are connected to each other via a control bus 16.

The CPU11 executes predetermined processing in accordance with a control program stored in the memory 12 or the storage device 13 to control the operation of the editing processing server 10. In the present embodiment, the CPU11 is described as a device that reads out and executes a control program stored in the memory 12 or the storage device 13, but the program may be stored in a storage medium such as a CD-ROM and supplied to the CPU 11.

Fig. 3 is a block diagram showing a functional configuration of the editing processing server 10 realized by executing the control program.

As shown in fig. 3, the editing processing server 10 of the present embodiment includes a data communication unit 31, a control unit 32, and a data storage unit 33.

The data communication unit 31 performs data communication with the terminal device 20 via the network 30.

The control unit 32 controls the operation of the editing processing server 10, and includes an acquisition unit 41, a detection unit 42, a blank line generation unit 43, a display control unit 44, a user operation reception unit 45, and a playback unit 46.

The data storage unit 33 stores various content data such as movie data to be edited.

The display control unit 44 controls a screen displayed on the terminal device 20.

The acquisition unit 41 acquires character information from the moving image. Here, the character information includes subtitle information assigned to the moving picture and background character information included in the moving picture. Here, the background character information is character information included in the moving picture as a background, and is, for example, slide material in the moving picture.

The detection unit 42 detects a segment to which character information is not given from the moving picture. Specifically, the detection unit 42 detects a no-character information section when a section to which character information is not given of the moving image is equal to or greater than a predetermined value, and does not detect a no-character information section when the section is smaller than the predetermined value. For example, the detection unit 42 detects a no-character information section when the section of the moving image to which no character information is given is 10 seconds or more, and does not detect a no-character information section when the section is less than 10 seconds. Here, the segment to which the character information is not given is the time from the subtitle end time to the next subtitle start time.

The blank line generation unit 43 sets the time length of the no-character information section detected by the detection unit 42 as 1 line number, divides the detected no-character information section by the time length of the blank line 1 line number, calculates the number of lines of the corresponding blank line, and generates the blank line of the calculated number of lines. For example, if 10 seconds is used as the time length of the blank line 1, the blank line generation unit 43 calculates 30 ÷ 10 ═ 3 when the detected no-character information segment is 30 seconds, and generates blank lines of 3 lines.

That is, the display control unit 44 inserts and displays the number of blank lines corresponding to the playback time of the section of the moving image to which no character information is added, into the list display of the character information.

The display control unit 44 performs control as follows: the character information acquired by the acquisition unit 41 and the blank line generated by the blank line generation unit 43 are linked to display a list of the character information. Here, the blank line functions as selection target information that can be selected by the user operation reception unit 45.

That is, the display control unit 44 performs control as follows: the list of character information is displayed based on the character information acquired by the acquisition unit 41 and the number of blank lines corresponding to the playback time of the section of the moving image to which the character information is not given.

The display control unit 44 performs control as follows: a list of character information added to a moving image is displayed in a state where a position to which character information is not added can be selected.

By inserting blank lines corresponding to sections of the moving image to which character information is not given into the list display of character information, the display control unit 44 controls as follows: a list of character information added to a moving image is displayed in a state where a position to which character information is not added can be selected.

When inserting a blank line in the list display of character information, the display control unit 44 inserts more blank lines than other positions at a position where caption information is not given to the moving picture and where the background character information changes more than a predetermined condition.

When a blank line is inserted in the list display of the character information, the display control unit 44 controls the display unit as follows: in a position where subtitle information is not given to a moving picture and a scene of the moving picture changes more than a predetermined condition, a blank line is inserted more than in other positions.

The user operation reception unit 45 receives a position selected by the user in a list of character information added to the moving image.

When playing a moving image to which character information is added, the playing section 46 starts playing the moving image from the playing time corresponding to the position received by the user operation receiving section 45 in the list of displayed character information.

Next, the operation of the editing processing server 10 in the multimedia content generating system according to the present embodiment will be described in detail with reference to the drawings.

First, an outline of the operation in the editing processing server 10 will be described with reference to flowcharts of fig. 4 and 5. Here, description will be made using a case where subtitle information added to a moving picture is acquired from the moving picture as character information.

First, in step S10, the acquisition unit 41 acquires subtitle information from the moving picture. Specifically, the caption information is acquired from a moving picture to which caption information such as text data is added.

Then, in step S11, the detection unit 42 detects a segment to which subtitle information is not added from the moving picture. Specifically, the detection unit 42 determines whether or not the time from the subtitle end time to the next subtitle start time is 10 seconds or longer. That is, the detection unit 42 determines whether or not the segment to which the caption information is not added is 10 seconds or more.

When the time from the subtitle end time to the next subtitle start time is less than 10 seconds, the detection unit 42 returns to the process of step S10.

When the time from the subtitle end time to the next subtitle start time is 10 seconds or longer, that is, when the segment to which the subtitle information is not given is 10 seconds or longer, the detection unit 42 performs blank line generation processing, which will be described later, in step S12.

Then, in step S13, the blank line generation unit 43 inserts the blank lines of the line count calculated in step S12. That is, the display control unit 44 inserts and displays the number of blank lines corresponding to the playback time of the section of the moving image to which the subtitle information is not added, into the list display of the character information.

Next, the blank line generation processing in step S12 will be described.

First, in step S20, the blank line generator 43 calculates the length G1 of the subtitle-free section to which subtitle information is assigned, which is not detected by the detector 42. Specifically, a time G1 from the subtitle end time to the next subtitle start time is calculated.

Then, in step S21, the blank line generation unit 43 calculates a quotient Q1 obtained by dividing the length G1 of the subtitle-free section by the length U of the blank line per 1 line.

Then, in step S22, it is determined whether the length G1 of the no-subtitle section is evenly divided by the length U of the blank line per 1 line.

Then, if it is determined in step S22 that the blank line is divided exactly, it is determined in step S23 that the number of blank lines is Q1, and the process proceeds to the above-described step S13.

If it is determined in step S22 that the blank line is not divided exactly, it is determined in step S24 that the number of blank lines is Q1+1, and the process proceeds to step S13.

Next, an operation on the display screen of the terminal device 20 will be described with reference to fig. 6 to 9.

As shown in fig. 6, a caption area 50 for displaying caption information and the like is displayed below the display screen of the terminal device 20.

When the subtitle region 50 is clicked, the playing of the moving picture is temporarily stopped, and the subtitle region 50 expands in the vertical direction as shown in fig. 7. The subtitle region 50 can be extended to all regions of the display screen of the terminal apparatus 20. The subtitle region 50 is displayed superimposed on the moving image with a certain degree of transparency to allow the following moving image to be visually recognized. Here, the click refers to an operation of touching (e.g., tapping with a finger or a stylus) the display screen with a finger or the like.

As shown in fig. 7, a list of character information in which the caption information 52 acquired by the acquisition unit 41 and the blank line 53 generated by the blank line generation unit 43 are connected in time series is displayed in the caption area 50. That is, a section without subtitles is displayed as a blank line 53. Then, the blank lines 53 of the number corresponding to the playback time of the section without subtitles are inserted into the list display of the character information and displayed. The blank line 53 serves as selection object information corresponding to a section without subtitles. That is, by selecting the blank line 53, playback can be started from a desired position of a section without subtitles. Further, since the subtitle region 50 is transmissive and displayed superimposed on the moving image as described above, the playback can be started from a desired position while checking the thumbnail of the corresponding moving image.

In the temporarily stopped state, the next character information list is displayed by sliding upward in the subtitle area 50, and the previous character information list is displayed by sliding downward in the subtitle area 50. Here, the sliding is an operation of sliding a finger or the like while contacting the display screen.

Then, by clicking a predetermined position of the subtitle information 52 in the list of character information displayed in the subtitle region 50, the moving picture can be played from the playback position corresponding to the clicked subtitle information.

Then, by selecting and clicking the blank line 53 in the list of character information displayed in the subtitle area 50, the moving image can be played from the playback position corresponding to the clicked blank line as shown in fig. 8.

In the temporarily stopped state, by clicking an arbitrary position within the subtitle region 50 as shown in fig. 8, the subtitle region 50 is reduced to a predetermined size as shown in fig. 9, and the playing of the moving picture can be started from the position. That is, even in a section without the subtitle information 52, the reduced subtitle region 50 is displayed on the display screen of the terminal device 20, and by clicking the subtitle region 50, a list of character information can be displayed.

That is, the moving picture can be played from a position including the subtitle information, or from a position not including the subtitle information.

Next, an operation on the display screen of the terminal device 20 when background character information is included in a moving image as character information will be described with reference to fig. 10 and 11.

As shown in fig. 10, when the moving image is a lecture performed using slide material, a whiteboard, or the like, background character information is included in the moving image as character information.

A subtitle region 50 containing subtitle information is displayed below the display screen of the terminal device 20. Then, a text area 60 containing background character information is displayed on the display screen of the terminal device 20. The subtitle region 50 and the text region 60 are displayed superimposed on the moving image while having a certain degree of transparency to allow the moving image below to be visually recognized.

When the caption area 50 or the text area 60 is clicked, the playing of the moving picture is temporarily stopped, and as shown in fig. 11, a caption text area 62 including the caption area 50 and the text area 60 is displayed in all areas of the display screen of the terminal device 20.

The caption text region 62 displays a list of character information in which the background character information 64 acquired by the acquisition unit 41, the caption information 52 acquired by the acquisition unit 41, and the blank line 53 generated by the blank line generation unit 43 are chronologically connected. That is, a section without subtitles is displayed as a blank line 53. Then, the blank lines 53 of the number corresponding to the playback time of the section without subtitles are inserted into the list display of the character information and displayed. The blank line 53 serves as selection object information corresponding to a section without subtitles. That is, by selecting the blank line 53, playback can be started from a desired position of a section without subtitles.

In this temporary stop state, the next character information list is displayed by sliding upward in the subtitle text area 62, and the previous character information list is displayed by sliding downward in the subtitle text area 62.

In addition, by clicking a predetermined position of the subtitle information 52 or the background character information 64 in the list of character information displayed in the subtitle text area 62, the moving picture can be played from the playback position corresponding to the clicked subtitle information or background character information.

Then, by selecting and clicking the blank line 53 in the list of character information displayed in the subtitle text area 62, the moving image can be played from the playback position corresponding to the clicked blank line.

That is, the moving picture can be played from a position including character information such as subtitle information or background character information, or from a position not including character information.

When inserting a blank line in the list display of character information, the blank line generation unit 43 inserts more blank lines than other positions at a position where subtitle information is not provided in the moving picture and where the background character information changes more than a predetermined condition. Specifically, for example, more (e.g., 5 lines) of blank lines are inserted at the position where the background character information such as a slide or material is switched. Thus, the user can start playing the moving picture at the timing of switching from the page of the slide, the material, or the like when playing the moving picture.

When inserting a blank line in the list display of the character information, the blank line generation unit 43 inserts more blank lines than other positions at a position where subtitle information is not provided in the moving image and where the scene of the moving image changes by a predetermined condition or more. Specifically, for example, a position where the lecturer is replaced after the lecture is ended is inserted with more (e.g., 5 lines) blank lines than other positions. Thus, the user can start playing the animation from the timing of replacing the instructor when playing the animation.

Fig. 12 is a diagram showing a modification of the list of character information displayed in the subtitle area 50.

As shown in fig. 12, in the subtitle region 50, time positions 70 corresponding to the subtitle information 52 and the blank line 53 are displayed, respectively. That is, the animation can be played from the time position 70 of the animation including the subtitle information 52, and the animation can also be played from the time position 70 of the blank line 53 not including the subtitle information 52. That is, the position to be played can be confirmed in time.

In the present embodiment, the description has been given using the case of acquiring caption information added to a moving picture, but the present invention is not limited to this, and can be similarly applied even when the caption information is acquired by voice recognizing a voice of a moving picture.

The foregoing description of the embodiments of the invention has been presented for purposes of illustration and description. The embodiments of the present invention do not fully encompass the present invention, and the present invention is not limited to the disclosed embodiments. It is obvious that various changes and modifications will be apparent to those skilled in the art to which the present invention pertains. The embodiments were chosen and described in order to best explain the principles of the invention and its applications. Thus, other skilled in the art can understand the present invention by various modifications assumed to be optimal for the specific use of various embodiments. The scope of the invention is defined by the following claims and their equivalents.