阅读说明：本技术 群呼方法、计算机装置及计算机可读记录介质 (Group calling method, computer device and computer-readable recording medium ) 是由 金娜怜 于 2020-10-13 设计创作，主要内容包括：本发明公开了群呼方法、计算机装置及计算机可读记录介质。一实施例的群呼方法可包括：参与步骤,参与群呼会话；指定步骤,在维持上述群呼会话的状态下,根据对于上述计算机装置所包括的触摸屏画面的触摸手势,将参与上述群呼会话的多个参与人员中的至少一个参与人员指定为耳语对象；构成步骤,在指定上述耳语对象的期间,以使通过上述计算机装置所包括的输入装置输入的影像及音频中的至少一个向上述耳语对象传递的方式构成耳语数据包；以及传输步骤,通过上述群呼会话向服务器传输上述耳语数据包。(The invention discloses a group call method, a computer device and a computer readable recording medium. A group call method of an embodiment may comprise: a participation step of participating in a group call session; a designation step of designating at least one participant among a plurality of participants participating in the group call session as a whisper object based on a touch gesture on a touch screen included in the computer device while the group call session is maintained; a configuration step of configuring a whisper packet so that at least one of an image and an audio input through an input device included in the computer device is transmitted to the whisper object while the whisper object is specified; and a transmission step of transmitting the whisper packet to a server through the group call session.)

1. A group call method implemented by a computer apparatus comprising at least one processor, comprising:

a participation step of participating in a group call session by the at least one processor;

a designation step of designating, by the at least one processor, at least one participant among a plurality of participants who participate in the group call session as a whisper object in accordance with a gesture on a touch screen included in the computer device while the group call session is maintained;

a configuration step of configuring, by the at least one processor, a whisper packet so that at least one of an image and an audio input through an input device included in the computer device is delivered to the whisper object while the whisper object is specified; and

a transmission step of transmitting the whisper packet to a server through the group call session by the at least one processor.

2. A group call method according to claim 1, wherein the step of specifying said whisper object comprises:

a display step of displaying an object corresponding to each of the plurality of participants on the touch screen;

a recognition step of recognizing an object indicated by a touch generated and maintained for a set time or longer on the touch screen; and

and a specifying step of specifying a participant corresponding to the recognized object as the whisper object while the touch is maintained.

3. A group call method according to claim 1, wherein the step of specifying said whisper object comprises:

a setting step of setting a whisper group including at least one of the plurality of participants in a state where the group call session is maintained;

an activation step of activating the whisper group according to a touch gesture set for the touch screen; and

a designation step of designating at least one participant included in the whisper group as the whisper object while the whisper group is activated.

4. Group call method according to claim 3,

in the step of setting the whisper groups, two or more whisper groups including at least one participant are set,

in the step of activating the whisper group, one of the two or more whisper groups is selectively activated according to the set touch gesture.

5. A group call method according to claim 3, characterized in that said whisper group is also automatically set, by said server, for each of said at least one participant included in said whisper group in response to setting of said whisper group.

6. A group call method according to claim 3, wherein the step of setting said whisper group comprises:

a display step of displaying a plurality of objects and a whisper group setting area corresponding to each of the plurality of participants on the touch screen;

a recognition step of recognizing an object moved to the setting area by a drag-and-drop gesture; and

including the step of including a participant corresponding to the identified object in the whisper team.

7. A group call method according to claim 3, wherein the step of setting said whisper group comprises:

a display step of displaying a plurality of objects and a whisper group generation button corresponding to each of the plurality of participants on the touch screen;

a recognition step of recognizing an object indicated by a touch generated on the touch screen in a state where the whisper group generation button is activated; and

including the step of including a participant corresponding to the identified object in the whisper team.

8. The group call method according to claim 3, wherein in the activating step, the whisper group is activated according to a slide gesture in a first direction with respect to the touch screen.

9. The group call method according to claim 1, further comprising:

a receiving step of receiving, by the at least one processor, a whisper packet from the server; and

an output step of modulating, by the at least one processor, the audio included in the received whisper packet to output the audio through an output device included in the computer device.

10. The group call method according to claim 1, further comprising:

a receiving step of receiving, by the at least one processor, a whisper packet from the server; and

a display step of displaying, by the at least one processor, a plurality of objects corresponding to each of the plurality of participants through the touch screen, and highlighting and displaying an object corresponding to a participant who transmitted the received whisper packet.

11. A computer-readable recording medium characterized in that a computer program for executing the method of any one of claims 1 to 10 in a computer apparatus is recorded.

12. A computer device, characterized in that,

comprising at least one processor embodied to execute computer-readable instructions,

participating in a group call session through the at least one processor,

designating at least one participant among a plurality of participants participating in the group call session as a whisper object according to a touch gesture on a touch screen included in the computer device while the group call session is maintained,

while the whisper object is designated, a whisper packet is configured so that at least one of an image and an audio input through an input device included in the computer device is transmitted to the whisper object,

and transmitting the whisper packet to a server through the group call session.

13. The computer apparatus of claim 12, wherein the at least one processor,

displaying an object corresponding to each of the plurality of participants on the touch screen,

recognizing an object indicated by a touch generated and maintained for a set time or longer on the touch screen,

while the touch is maintained, designating a participant corresponding to the recognized object as the whisper object.

14. The computer apparatus of claim 12, wherein the at least one processor,

setting a whisper group including at least one of the plurality of participants in a state where the group call session is maintained,

activating the whisper group according to a set touch gesture with respect to the touch screen,

designating at least one participant included in the whisper group as the whisper object during the whisper group being activated.

15. The computer apparatus of claim 12, wherein the at least one processor,

receiving the whisper packet from the server,

and modulating the audio included in the received whisper packet to output the modulated audio through an output device included in the computer device, or displaying a plurality of objects corresponding to each of the plurality of participants through the touch screen, and highlighting an object corresponding to a participant who transmitted the received whisper packet, or highlighting an object corresponding to a participant of a whisper group set by the participant who transmitted the received whisper packet.

Technical Field

The following description relates to a group call method and system using whisper.

Background

The call among a plurality of persons is a group call in which a plurality of persons are simultaneously communicating. For example, a group call server having a mode conversion function and a mode conversion method are disclosed in korean laid-open patent No. 10-2005-0034455. A group call, which is one of the real-time call service forms, can deliver media such as audio data and video to a call partner. However, the data communicated in the group call is transmitted to all of the corresponding instances participating in the group call. For example, in the example of a group call involving 5 users, such as the first user, the second user, the third user, the fourth user, and the fifth user, the data of the audio/video, etc. of the first user is delivered to the remaining second user, the third user, the fourth user, and the fifth user. In other words, in the prior art group call, data is always broadcast.

Disclosure of Invention

The present invention provides a group call method and system, which can instantly select a desired participant (or a group of participants) to whisper with the selected participant (or group of participants) in the process of making a group call with all participants of the group call.

The present invention provides a group call method for a computer apparatus including at least one processor, comprising: a participation step of participating in a group call session by the at least one processor; a designation step of designating, by the at least one processor, at least one participant among a plurality of participants who participate in the group call session as a whisper object in accordance with a gesture on a touch screen included in the computer device while the group call session is maintained; a configuration step of configuring, by the at least one processor, a whisper packet so that at least one of an image and an audio input through an input device included in the computer device is delivered to the whisper object while the whisper object is specified; and a transmission step of transmitting, by the at least one processor, the whisper packet to a server through the group call session.

According to one embodiment, the specifying of the whisper object includes: a display step of displaying an object corresponding to each of the plurality of participants on the touch screen; a recognition step of recognizing an object indicated by a touch generated and maintained for a set time or longer on the touch screen; and a specifying step of specifying a participant corresponding to the recognized object as the whisper object while maintaining the touch.

According to still another embodiment, the specifying of the whisper object includes: a setting step of setting a whisper group including at least one of the plurality of participants in a state where the group call session is maintained; an activation step of activating the whisper group according to a touch gesture set for the touch screen; and a designation step of designating at least one participant included in the whisper group as the whisper object while the whisper group is activated.

According to another embodiment, the present invention is characterized in that in the step of setting the whisper groups, two or more whisper groups including at least one participant are set, respectively, and in the step of activating the whisper groups, one of the two or more whisper groups is selectively activated according to the set touch gesture.

According to still another embodiment, the present invention is characterized in that the server further automatically sets the whisper group for each of the at least one participant included in the whisper group in response to the setting of the whisper group.

According to still another embodiment, the present invention is characterized in that the step of setting the whisper group includes: a display step of displaying a plurality of objects and a whisper group setting area corresponding to each of the plurality of participants on the touch screen; a recognition step of recognizing an object moved to the setting area by a drag-and-drop gesture; and including a step of including the participant corresponding to the identified object in the whisper group.

According to still another embodiment, the present invention is characterized in that the step of setting the whisper group includes: a display step of displaying a plurality of objects and a whisper group generation button corresponding to each of the plurality of participants on the touch screen; a recognition step of recognizing an object indicated by a touch generated on the touch screen in a state where the whisper group generation button is activated; and including a step of including the participant corresponding to the identified object in the whisper group.

According to still another embodiment, the activation step activates the whisper group according to a slide gesture along a first direction with respect to the touch panel screen.

According to another embodiment, the present invention is characterized in that the group call method further includes: a receiving step of receiving, by the at least one processor, a whisper packet from the server; and an output step of modulating, by the at least one processor, the audio included in the received whisper packet to output the audio through an output device included in the computer device.

According to another embodiment, the present invention is characterized in that the group call method further includes: a receiving step of receiving, by the at least one processor, a whisper packet from the server; and a display step of displaying, by the at least one processor, a plurality of objects corresponding to each of the plurality of participants through the touch screen, and emphatically displaying an object corresponding to a participant who transmitted the received whisper packet.

According to another embodiment, the present invention is characterized in that the group call method further includes: a receiving step of receiving, by the at least one processor, a whisper packet from the server; and a display step of displaying, by the at least one processor, a plurality of objects corresponding to each of the plurality of participants through the touch screen, and highlighting a plurality of objects corresponding to participants of a whisper group set by the participant who transmitted the received whisper packet.

The present invention provides a computer program stored in a computer-readable recording medium for executing a group call method in a computer apparatus in combination with the computer apparatus.

The present invention provides a computer-readable recording medium having recorded thereon a program for executing the above method in a computer apparatus.

The present invention provides a computer device including at least one processor that executes computer-readable instructions, the computer device participating in a group call session via the at least one processor, designating at least one participant among a plurality of participants participating in the group call session as a whisper object based on a touch gesture on a touch screen included in the computer device while the group call session is maintained, configuring a whisper packet so that at least one of an image and an audio input via an input device included in the computer device is transmitted to the whisper object while the whisper object is designated, and transmitting the whisper packet to a server via the group call session.

During a group call with all participants of the group call, whispering can be performed with the selected participant (or group of participants) by instantaneously selecting the desired participant (or group of participants).

Drawings

Fig. 1 is a diagram showing an example of a network environment of an embodiment of the present invention.

FIG. 2 is a block diagram illustrating an example of a computer apparatus of an embodiment of the invention.

Fig. 3 is a diagram showing an example of an overview of a group call system of an embodiment of the present invention.

Fig. 4 to 6 are diagrams showing an example of a group call procedure according to an embodiment of the present invention.

Fig. 7 is a diagram illustrating an example of an extended container format based on an extended transport protocol according to an embodiment of the present invention.

Fig. 8 is a diagram illustrating an example of an extended container format based on an extended transport protocol according to an embodiment of the present invention.

Fig. 9 and 10 are diagrams showing examples of screens for selecting a whisper object according to an embodiment of the present invention.

Fig. 11 is a diagram showing an example of a screen in a case where a whisper packet is received according to an embodiment of the present invention.

Fig. 12 and 13 are diagrams showing an example of setting a whisper group according to an embodiment of the present invention.

Fig. 14 and 15 are diagrams showing another example of setting a whisper group according to an embodiment of the present invention.

Fig. 16 is a diagram showing an example of activating a whisper group according to an embodiment of the present invention.

Fig. 17 is a diagram showing an example of a screen included in a case where whisper is received in a whisper group according to an embodiment of the present invention.

Fig. 18 is a flowchart illustrating an example of a group call method according to an embodiment of the present invention.

Detailed Description

Hereinafter, embodiments will be described in detail with reference to the accompanying drawings.

The group call system of the embodiment of the invention can be realized by at least one computer device, and the group call method of the embodiment of the invention can be executed by at least one computer device in the group call system. In this case, the computer program according to an embodiment of the present invention may be installed and driven in a computer device, and the computer device may execute the group call method according to an embodiment of the present invention under the control of the driven computer program. The computer program described above may be stored in a computer-readable recording medium for the purpose of executing a group call method in a computer in combination with a computer apparatus.

Fig. 1 is a diagram showing an example of a network environment of an embodiment of the present invention. The network environment of fig. 1 illustrates an example including a plurality of electronic devices 110, 120, 130, 140, a plurality of servers 150, 160, and a network 170. Fig. 1 is an example for explaining the present invention, and the number of electronic devices or the number of servers is not limited to that shown in fig. 1. The network environment of fig. 1 is one example of a plurality of environments to which the present invention is applicable, and the environment applicable to the present embodiment is not limited to the network environment of fig. 1.

The plurality of electronic devices 110, 120, 130, 140 may be fixed-type terminals or mobile-type terminals implemented by computer means. Examples of the plurality of electronic devices 110, 120, 130, 140 include smart phones (smart phones), mobile phones, navigation devices, computers, notebook computers, Digital broadcast terminals, Personal Digital Assistants (PDAs), Portable Multimedia Players (PMPs), tablet computers, and the like. As an example, fig. 1 shows a smartphone as an example of the electronic device 110, but in the embodiment of the present invention, the electronic device 110 may be one of a plurality of physical computer apparatuses that can communicate with other electronic devices 120, 130, 140 and/or servers 150, 160 via the network 170 by using a wireless or wired communication method.

The communication method is not limited, and may include a communication method using a communication network (for example, a mobile communication network, a wired internet, a wireless internet, a broadcast network) which the network 170 can include, and short-range wireless communication between a plurality of devices. For example, the network 170 may include any network of one or more of Personal Area Network (PAN), Local Area Network (LAN), Campus Area Network (CAN), Metropolitan Area Network (MAN), Wide Area Network (WAN), broadband network (BBN), internet, and the like. Also, network 170 may include, but is not limited to, any one or more of a network topology having a bus network, a star network, a ring network, a mesh network, a star bus network, a tree or hierarchical (hierarchical) network, and the like.

Each of the servers 150, 160 may be implemented as a computer device or devices that communicate with a plurality of electronic devices 110, 120, 130, 140 over a network 170 to provide instructions, code, files, content, services, etc. For example, the server 150 may be a system that provides services (e.g., a group call service (or a voice conference service), a message service, a mail service, a social network service, a map service, a translation service, a financial service, a settlement service, a search service, a content providing service, etc.) to a plurality of electronic devices 110, 120, 130, 140 connected through a network 170.

FIG. 2 is a block diagram illustrating an example of a computer apparatus of an embodiment of the invention. Each of the plurality of electronic devices 110, 120, 130, 140 or each of the plurality of servers 150, 160 described above may be implemented by the computer apparatus 200 shown in fig. 2.

As shown in fig. 2, the computer device 200 may include a memory 210, a processor 220, a communication interface 230, and an input/output interface 240. The memory 210 is a computer-readable recording medium and may include a Random Access Memory (RAM), a Read Only Memory (ROM), and a permanent mass storage device (permanent mass storage device) such as a disk drive. Where read-only memory and a persistent mass storage device such as a disk drive may be included in computer device 200 as additional persistent storage devices as distinguished from memory 210. Also, the memory 210 may store an operating system and at least one program code. The software structural elements described above may be loaded into the memory 210 from a computer-readable recording medium different from the memory 210. Such additional computer-readable recording media may include computer-readable recording media for floppy disk drives, magnetic disks, magnetic tapes, DVD/CD-ROM drives, memory cards, and the like. In another embodiment, the software structural elements may be loaded to the memory 210 through the communication interface 230, not through the computer-readable recording medium. For example, the software structural elements are loaded into the memory 210 of the computer device 200 based on a computer program installed in a file received over the network 170.

The processor 220 may perform basic arithmetic, logic, and input-output operations to process instructions of a computer program. The instructions may be provided to processor 220 through memory 210 or communication interface 230. For example, the processor 220 may execute the received instructions according to program code stored in a recording device, such as the memory 210.

The communication interface 230 provides a function of the computer device 200 and another device (for example, the storage device described above) to communicate with each other via the network 170. For example, under the control of the communication interface 230, the processor 220 of the computer device 200 may transmit requests, instructions, data, files, and the like generated from program codes stored in a recording device such as the memory 210 to other devices via the network 170. Conversely, signals or instructions, data, files, etc. from other devices may be communicated to the computer device 200 over the network 170 through the communication interface 230 of the computer device 200. Signals or instructions, data, etc. received through communication interface 230 may be transferred to processor 220 or memory 210, and files, etc. may be stored in a storage medium (the above-described persistent storage) that computer device 200 may also include.

The input-output interface 240 may be a unit for interfacing with the input-output device 250. For example, the input device may include a microphone, a keyboard, a mouse, or the like, and the output device may include a display, a speaker, or the like. As another example, the input/output interface 240 may be a unit for interfacing with a device in which input and output functions such as a touch screen are combined into one. At least one of the input and output devices 250 may form a unit with the computer device 200. Such as a smartphone, for example, may be implemented in a form that includes a touch screen, microphone, speaker, etc. in computer device 200.

Also, in another embodiment, computer device 200 may include more or fewer structural elements than those of FIG. 2. However, most of the prior art structural elements need not be explicitly shown. For example, the computer device 200 may include at least a portion of the input/output device 250 described above, or may further include other structural elements such as a transceiver (transceiver), a database, and the like.

Fig. 3 is a diagram showing an example of an overview of a group call system of an embodiment of the present invention. The group call system of the present embodiment may be constituted by a server 310 providing a group call service and a client apparatus 320 for a plurality of participants. In this case, unlike the past, according to the embodiment of the present invention, the server 310 and the plurality of client devices 320 can communicate with each other through an extended transmission protocol capable of including destination information in a data packet. For example, consider the case of a first client device 321, a second client device 322, and a third client device 323 participating in multiple client devices 320 in one group call instance. In this case, each of the plurality of client devices 321, 322, 323 participating in the corresponding group call instance may designate a particular participant to transmit the data packet. For example, the first client device 321 may designate the third client device 323 to deliver media such as audio or video.

In other words, the participants of the group call service of the present embodiment may transmit data to all participants corresponding to the group call instance, or may transmit data to a specific participant or a group of specific participants.

Fig. 4 to 6 are diagrams showing an example of a group call procedure according to an embodiment of the present invention.

Fig. 4 shows an example of a first user 410 (user 1), a second user 420 (user 2) and a third user 430 (user 3) participating in a group call. Wherein each of the plurality of users 410, 420, 430 may correspond to one of the plurality of client devices 320 illustrated by fig. 3 above. In this case, the server 310 may manage a table containing source identifiers (Srcid) and connection information for a plurality of users 410, 420, 430, as shown in table 440. The source identifier (Srcid) has a unique value for each group call and, in general, can be used to identify from which user's source (e.g., user a's audio source or user B's video source, etc.) the data received from the server 310 is transmitted. Further, according to some embodiments of the present invention, a source identifier may be associated with the connection information for identifying to which user's source data transmitted from one of the plurality of client devices 320 to the server should be delivered, i.e., for identifying destination information of the data. Although not shown, such source identifier (Srcid) and connection information may be managed as a table together with other information related to the plurality of users 410, 420, 430. Upon receiving call-related information such as a media type to be transmitted and received and a request to start or participate in a group call from a client apparatus of each user, server 310 may manage a table such as table 440 by assigning one or more source identifiers based on the call-related information received from the client apparatus. Server 310 may then transmit the source identifier assigned to the corresponding client device to the client device that initiated or participated in the group call. Also, in the presence of other users already participating in the group call, the server 310 may transmit to the client devices of the users participating in the group call a source identifier related to at least a portion of the other users already participating in the group call. Also, during the group call, the server 310 may transmit a source identifier associated with at least a portion of the other users participating in the group call to the client devices of the users participating in the group call based on a request from the client devices or based on a determination by the server 310. For example, assume a case where the third user 430 participates in a group call with the first user 410 and the second user 420 using the third client device 323 having only an audio device during a group call with the first user 410 and the second user 420 both using video and audio. If the server 310 receives the call-related information of the third user together with a request for participating in the group call from the third user 430, the server 310 may assign the source identifier Src5 to the third user 430, and store it in the table by associating the source identifier Src5 with the connection information ip3/port1 corresponding to the source identifier Src 5. In this case, the server 310 may transmit the source identifier Src5 allocated to the third user 430 and the source identifier information of the first user 410 and the second user 420 having participated in the group call to the third client device 323 of the third user 430. Also, the server 310 may inform the first user 410 and the second user 420, who have participated in the group call, that the source identifier of the third user 430 is Src 5.

Assume a case where the first user 410 does not designate at least a part of users when the first user 410, the second user 420, and the third user 430 participate in the group call, as shown in fig. 4, a packet "P1" and a packet "P2" are transmitted to the server 310. In this case, the packet "P1" and the packet "P2" may contain source identifiers, respectively. For example, where the packet "P1" includes audio data and the packet "P2" includes video data, the packet "P1" may include the source identifier Src1 for the first user 410 for audio and the packet "P2" may include the source identifier Src2 for the first user 410 for video. In this case, the server 310 may know that the packet "P1" includes audio data through the source identifier Src1 included in the packet "P1", and deliver the packet "P1" to the user devices of the second user 420 and the third user 430 having audio sources through ip2/port1 and ip3/port1 using the table 440. The server 310 can know that the packet "P2" includes video data through the source identifier Src2 included in the packet "P2", and can deliver the packet "P2" to the user device of the second user 420 having a video source through the ip2/port2 using the table 440. In this case, the third user 430 is not assigned a video source, and thus, the packet "P2" is not delivered to the third user 430.

Fig. 5 shows an example of a process in which a first subscriber 410 only delivers his own audio and video to a second subscriber 420 during a group call. In the case where a request for delivering only audio and video to the second subscriber 420 is input from the first subscriber 410 during the group call, destination information may be included in a data packet transmitted from the first subscriber 410 to deliver the data packet, unlike the case where no destination is specified. In the group call process, as a request for delivering only audio and video to the second user 420 is input from the first user 410, based on the source identifiers of the other users received from the server (for example, refer to table 510 of fig. 5), the source identifier Src3 may be designated in the packet "P3" containing the audio of the first user 410 as destination information, and the packet "P4" containing the video of the first user 410 may designate the source identifier Src4 as destination information. In this case, the server 310 may transfer the packet "P3" to the ip2/port1 of the second user 420 corresponding to the source identifier Src3 specified in the packet "P3" and transfer the packet "P4" to the ip2/port2 of the second user 420 corresponding to the source identifier Src4 specified in the packet "P4" with reference to the table 440 of fig. 4. The source identifier may be assigned to the data packet from the first subscriber 410 during the group call until the request to deliver only its audio or video from the first subscriber 410 to the second subscriber 420 is released.

Fig. 6 shows an example of a process in which a first subscriber 410 delivers only his own video to a second subscriber 420 and only his own audio to a third subscriber 430 during a group call. In the case where a request for delivering only own video to the second user 420 and delivering only own audio to the third user 430 is input from the first user 410 during the group call, destination information may be included in the packet transmitted from the first user 410 to deliver the packet, unlike the case where no destination is specified. In the group call process, as a request for delivering only own video to the second user 420 is input from the first user 410, and delivering only own audio to the third user 430, the source identifier Src4 may be designated as destination information in the packet "P5" related to the video of the first user 1 and the source identifier Src5 may be designated as destination information in the packet "P6" related to the audio of the first user, based on the source identifiers of the other users received from the server (for example, refer to table 510 of fig. 6). In this case, the server 310 may transfer the packet "P5" to the ip2/port2 □ of the second user 420 corresponding to the source identifier Src4 specified in the packet "P5" and transfer the packet "P6" to the ip3/port1 of the third user 430 corresponding to the source identifier Src5 specified in the packet "P6" with reference to the table 440 of fig. 4.

As described above, in order to specify the destination information, the existing transmission protocol may be extended. Existing transmission protocols deliver data packets in the form of broadcasts to all participants, so that no destination needs to be specified, for which no field exists for containing destination information. In contrast, in the present embodiment, the existing transport protocol can be extended by adding a field for specifying destination information to an area reserved in the header of a packet based on the existing transport protocol.

Alternatively, more than two users may be designated for one packet. In fig. 7 is considered a situation where a fourth user 710 (user 4) and a fifth user 720 (user 5) are also participating in the group call instance in addition to the first user 410, the second user 420 and the third user 430. Also, fig. 7 shows an example in which the first user 410 designates the second user 420 and the fifth user 720 to deliver audio data. In the case where a request for delivering audio only to the second subscriber 420 and the fifth subscriber 720 is input from the first subscriber 410 during the group call, destination information may be included in a data packet transmitted from the first subscriber 410 to deliver the data packet, unlike the case where a destination is not designated. In the group call process, as a request for delivering audio only to the second user 420 and the fifth user 720 is input from the first user 410, the source identifiers Src3 and Src8 may be designated in the packet "P7" containing the audio of the first user 410 as destination information based on the source identifiers of the other users received from the server (for example, refer to table 730 of fig. 7). In this case, the server 310 delivers the data package "P7" to the second user and the fifth user through the connection information of the second user 420 corresponding to the source identifier Src3 and the connection information of the fifth user 720 corresponding to the source identifier Src8 designated in the data package "P7", respectively.

Fig. 8 is a diagram showing an example of an extended container format of an extended transport protocol according to an embodiment of the present invention. Fig. 8 shows a container format 800 of a Transport Protocol of the extended Real-time Transport Protocol (RTP). In this case, a destination synchronization source (dSSRC) for managing a destination is redefined in a manner corresponding to a Synchronization Source (SSRC) for managing a source in a transmission protocol of the extended real-time transmission protocol. In this case, a first dashed box 810 may present a field for recording the destination synchronization source in the real-time transport protocol data packet header. Here, the recording destination sync source refers to an identifier of the recording destination sync source. Also, the D-CNTs for counting the number of destination synchronous sources can be redefined so as to correspond to the CC for counting the number of synchronous sources. In fig. 8, a second dotted box 820 may represent a field for counting the number of destination synchronization sources. In this case, the client may specify other clients to transfer the data packet by adding a destination sync source to the data packet, and the server 310 may transmit the data packet to a corresponding destination by confirming the destination of the transfer data packet from the destination sync source included in the data packet received by the client.

Fig. 9 and 10 are diagrams showing examples of screens for selecting a whisper object according to an embodiment of the present invention.

The first screen 900 of fig. 9 may be a terminal screen of any user participating in a group call. The terminal screen of the user can be formed by a touch screen. In this case, a plurality of videos included in a plurality of packets received from a plurality of participants who participate in the group call can be displayed on the first screen 900 through an object for each participant. Multiple data packets may be routed through a server for the group call and delivered to the various participants. Also, the plurality of audios (for example, the voice of each of the plurality of participants) included in the plurality of data packets may be output through an output device (for example, a speaker) such as a speaker included in the user terminal. In addition, in the user terminal, the video and/or audio input through the input device (e.g., a camera and/or a microphone) may be routed through the server and may be delivered to the respective participants.

The second screen 1000 of fig. 10 shows an example where the user selects a participant who needs to send whisper himself during the group call. For example, the user may touch an area of an object corresponding to a participant who needs to transmit whisper among a plurality of objects displayed on the terminal screen (a plurality of objects displaying videos of a plurality of participants). In this case, the user terminal may recognize the object of the maintained touch, and constitute the whisper packet in such a manner that only the image and/or audio input during the maintained touch may be delivered to the participant corresponding to the recognized object. For example, the second screen 1000 shows an example in which the user inputs a long press gesture to a region where an object of the video of the "sixth user (user 6)" is displayed. In this case, the user terminal can transmit the whisper packet to the server for the group call so that only the video and/or audio input while maintaining the long-press gesture is transmitted to the "sixth user". In this case, the server may deliver only whisper packets to the "sixth user". In this case, when the long press gesture is released, the video and/or audio input thereafter is again transmitted to all the participants of the group call as shown in the first screen 900. In other words, the user can quickly and easily send whisper to the corresponding participant by simply touching the object corresponding to the participant who needs to make whisper on the screen while making a group call, and can quickly return to the group call again by simply releasing the touch.

Fig. 11 is a diagram showing an example of a screen in a case where a whisper packet is received according to an embodiment of the present invention. The third screen 1100 shows an example of a case where other participants send whisper. The third screen 1100 shows a state in which the image of the "first user" is highlighted as the "first user" sends whisper to the user. In this case, the user terminal may output by modulating whisper of the "first user", in other words, audio contained in the received whisper packet, and thus, may output with emphasis on the voice of the "first user". For example, audio corresponding to whispering may be modulated and output by a howling process. In this case, the user can easily identify the participant who sends whisper to himself.

Fig. 12 and 13 are diagrams showing an example of setting a whisper group according to an embodiment of the present invention.

The fourth screen 1200 of fig. 12 shows an area 1210 for setting a whisper group. In the fourth screen 1200, as the user moves an object to be included in the whisper group to the above-described area 1210 by Drag and Drop (D & D) among a plurality of objects displaying images of a plurality of participants, the corresponding participant can be easily added to the whisper group.

In the fifth screen 1300 of fig. 13, the first display 1310 shows that one participant is included in the whisper team, which may include four participants, as the user moves an object corresponding to the one participant toward the above-described area 1210 in the fourth screen 1200. In the same manner, the user can set a whisper group by moving a plurality of objects corresponding to a plurality of participants who need to participate in the whisper group to the above-described area 1210. The number of the plurality of participants that can be included in the whisper group can be freely set according to the embodiment without being additionally limited.

Fig. 14 and 15 are diagrams showing another example of setting a whisper group according to an embodiment of the present invention.

The sixth screen 1400 of FIG. 14 shows a button 1410 for entering for selecting a number of participants to be included in a whisper team. As the user selects button 1410 (as an example, touching the area of display button 1410 with a finger), the corresponding mode may be activated. In addition, in a state where the corresponding mode is activated, when the user selects the corresponding button 1410 again, the corresponding mode may be deactivated.

A seventh screen 1500 of fig. 15 shows an example in which, in a state in which the user has activated a plurality of participants who are to be included in the whisper group, the plurality of participants participate in the whisper group corresponding to an object selected as an object for displaying images of the plurality of participants is selected (for example, an area where the object is displayed is touched with a finger). The seventh screen 1500 shows an example in which, as the user selects "sixth user" and "eleventh user (user 11)", the corresponding object is indicated that the corresponding participant has been selected for the whisper group. In this case, the second display 1530 may show the number of the plurality of participants selected by the user in the above-described mode. As an example, the second display 1530 shows two participants in a whisper group that may include four participants. As another example, the second display 1530 can be determined based on the profiles of the participants included in the whisper team. As described above, the number of the plurality of participants that can be included in the whisper group can be freely set according to the embodiment without being additionally limited.

Although not shown, according to another embodiment, when a whisper group is set by a user of a terminal, according to one of fig. 12 to 15, the user setting the terminal of the corresponding whisper group may be automatically included in the whisper group without additional input.

Fig. 16 is a diagram showing an example of activating a whisper group according to an embodiment of the present invention. Fig. 16 shows an example in which the user activates the whisper group as shown in the eighth screen 1600 by a preset touch gesture (in the present embodiment, a slide in the first direction) in the process of making a group call as shown in the first screen 900 of fig. 9 explained earlier. For example, if a slide from the right side to the left side is recognized in first screen 900, the terminal of the user may activate a set whisper group. In this case, the eighth screen 1600 shows an example of activating a whisper group that includes four participants (a first user, a sixth user, a tenth user (user 10), and a twelfth user (user 12)). During the activation of the corresponding whisper group, the whisper packets are structured in such a way that only images and/or audio input through the input means (camera and/or microphone) of the user's terminal are delivered to a plurality of participants included in the whisper group. If a slide in the second direction (for example, a slide from the left side to the right side) is recognized in eighth screen 1600, the user's terminal may deactivate the whisper team and may again handle the call with all participants of the group call as shown in first screen 900. As another example, a plurality of whisper groups may be set by the user. As a specific example, a first whisper group including four participants (first user, sixth user, tenth user, and twelfth user) and a second whisper group including three participants (third user, sixth user, and ninth user (user 9)) may be set. In this case, when a slide from the right side to the left side is recognized in the first screen 900, the terminal of the user may activate the first whisper group, and when a slide from the right side to the left side is recognized again, the terminal of the user may activate the second whisper group. In contrast, when a slide from the left side to the right side is recognized in a state where the second whisper group is activated, the first whisper group may be activated again, and when a slide from the left side to the right side is recognized in a state where the first whisper group is activated, the whisper group may be deactivated, and a call with all participants of the group call may be handled as shown in the first screen 900. In the present embodiment, the sliding used is illustrative for quickly activating the whisper group, and it can be easily understood from the above description that the whisper group can be activated and/or deactivated by other touch gestures.

Fig. 17 is a diagram showing an example of a screen included in a case where whisper is received in a whisper group according to an embodiment of the present invention. If the other participants set the whisper group by the inclusion user, the whisper group including the user may be automatically generated, and if the whisper group is activated and the whisper packet is received, the terminal of the user may highlight and display a plurality of objects corresponding to a plurality of participants (a first user, a sixth user, a tenth user, and a twelfth user) of the whisper group, as shown in a ninth screen 1700 of fig. 17. In this case, as described above, the audio delivered by the whisper packet may be modulated and output. For example, the user's terminal may modulate audio contained in a whispering gallery packet by a howling process and then output the modulated audio through a speaker. When one user (for example, the first user) sets a whisper group, the corresponding whisper group is automatically set for the other participants (the sixth user, the tenth user, and the twelfth user) of the whisper group, so that all the participants of the whisper group can pass whisper to the corresponding whisper group.

Fig. 18 is a flowchart illustrating an example of a group call method according to an embodiment of the present invention. The group call method of embodiments of the present invention may be performed by a computer device 200 implementing a client participating in a group call session. In this case, the processor 220 of the computer device 200 may execute code of an operating system or a control instruction (instruction) based on at least one program code included in the memory 210. The processor 220 may control the computer device 200 to enable the computer device 200 to execute a plurality of steps (steps 1810 to 1860) included in the method of fig. 18 according to the control instruction provided by the code stored in the computer device 200.

In step 1810, computer device 200 may participate in a group call session. If the computer device 200 is engaged in a group call session, a group call may be made with other participants who are engaged in the corresponding group call session. As described above, during a group call, data packets containing video and/or audio may be broadcast to a plurality of participants participating in the group call session.

In step 1820, in a state in which the group call session is maintained, the computer device 200 may designate at least one participant of the plurality of participants participating in the group call session as a whisper object according to a touch gesture with respect to a touch screen included in the computer device 200. Among them, the touch screen may be included in the input and output device 250 described with reference to fig. 2.

In one embodiment, the computer device 200 may display an object corresponding to each of the plurality of participants on the touch screen, and identify an object indicated by a touch occurring and maintained for a predetermined time or longer on the touch screen. In this case, the computer apparatus 200 may designate a participant corresponding to the object recognized during the period in which the touch is maintained as a whisper object. When the corresponding touch is released, the corresponding participant can be released from the whisper object. In other words, among a plurality of objects corresponding to each of a plurality of participant persons displayed on the touch screen, the user can quickly designate a whisper object to transmit whispers only by touching and releasing the object of the participant person required for the touch.

In another embodiment, in the state of maintaining the group call session, the computer device 200 may set a whisper group including at least one participant of the plurality of participants, and may activate the whisper group according to a preset touch gesture with respect to the touch screen. As an example, the computer device 200 may activate the whisper group according to a swipe gesture along a first direction relative to the touchscreen display. In a state in which the whisper group is activated, the computer device 200 may deactivate the whisper group in a case where a slide gesture in a second direction opposite to the first direction occurs. In this case, the computer apparatus 200 may designate at least one participant included in the whisper group as a whisper object during the time when the whisper group is activated. In other words, the user may activate and/or deactivate the whisper group by a simple touch gesture, and among all participants, may simply send whisper to a plurality of participants belonging to the whisper group.

As an example for setting the whisper group, the computer apparatus 200 may display a plurality of objects corresponding to each of a plurality of participants and a whisper group setting area on the touch screen. In this case, the user can move an object that needs to be included in a participant of the whisper team to the above-described setting area using a drag-and-drop gesture. In this case, the computer device 200 can recognize the object moving to the setting area and include the participant corresponding to the recognized object in the whisper group, thereby easily and quickly setting the whisper group.

As another embodiment for setting a whisper group, the computer apparatus 200 may display a plurality of objects corresponding to each of a plurality of participants and a whisper group generation button on the touch screen. In this case, in a state where the whisper group generation button is activated, the user can select a participant by selecting an object that needs to be included in the whisper group participant (for example, by touching an area where a corresponding object is displayed with a finger). In this case, the computer device 200 can recognize the object indicated by the touch generated on the touch screen and include the participant corresponding to the recognized object in the whisper group, thereby allowing easy and quick setting of the whisper group.

In step 1830, while the whisper object is designated, the computer device 200 may construct a whisper packet so as to transmit at least one of an image and an audio input through an input device included in the computer device 200 to the whisper object. In this case, how to construct the whisper packet is explained in detail by fig. 3 to 8. The input device may include a camera and/or a microphone, as an example, which may also be included in the input-output device 250 illustrated in fig. 2.

In step 1840, the computer device 200 may transmit the whisper packet to the server over the group call session. In this case, the server may deliver only the whisper packet to the corresponding participant, whereby whisper can be promptly processed. In this case, how the server delivers the whisper packet to the corresponding participant is explained in detail by fig. 3 to 8.

In step 1850, computer device 200 may receive a whisper packet from a server. For example, in the case where other participants of the group call session designate the user as a whisper object, whisper packets from the terminals of the other participants may be transmitted to the computing device 200 through the server.

In step 1860, the computer device 200 may modulate audio included in the received whisper packet to output through an output device (for example, a speaker included in the computer device 200) included in the computer device 200, or display a plurality of objects corresponding to each of a plurality of participants through a touch screen, and emphatically display an object corresponding to a participant who transmitted the received whisper packet, or emphatically display a plurality of objects corresponding to a plurality of participants of a whisper group set by the participant who transmitted the received whisper packet. For example, when the other participant transmits a whisper packet by designating the user as a whisper object, the object corresponding to the participant transmitting the whisper packet may be highlighted, and the audio of the corresponding participant included in the whisper packet may be modulated and output. As another example, in the case where any participant included in the whisper group transmits a whisper packet, the corresponding whisper packet may be delivered to a plurality of participants included in the corresponding whisper group. In this case, the computer device 200 may modulate and output all of the audio of the whisper packets transmitted by the plurality of participants included in the whisper group, and in this case, may highlight all of the plurality of objects corresponding to the plurality of participants included in the whisper group and display them on the touch screen.

As described above, according to the embodiments of the present invention, in the course of conducting a group call with all participants of the group call, whisper can be conducted with the selected participant (or group of participants) by instantaneously selecting the participant (or group of participants).

The system or apparatus described above can be realized by hardware components, software components, or a combination of hardware components and software components. For example, the devices and components described in the embodiments may be implemented by one or more general purpose computers or special purpose computers (e.g., processors, controllers, ALUs, digital signal processors (digital signal processors), microcomputers, Field Programmable Gate Arrays (FPGAs), Programmable Logic Units (PLUs), microprocessors, or any other devices that can execute instructions and respond thereto). The processing device may execute an Operating System (OS) and one or more software applications executing on the OS. Also, the processing device may enable access, storage, manipulation, processing, and generation of data in response to execution of the software. For ease of understanding, there are cases where a processing device is described as being applicable to only one, but those skilled in the art to which the present invention pertains may be familiar with the ability of a processing device to include multiple processing elements and/or multiple types of processing elements. For example, the processing device may include multiple processors or a processor and a controller. And, other processing configurations such as parallel processors (parallel processors) may also be included.

The software may include a computer program (computer program), code, instructions (instructions), or a combination of one or more of them, to configure the processing device to operate as desired or to instruct the processing device independently or in combination (collectively). The software and/or data may be embodied (embody) on any type of machine, component, physical device, virtual device, computer storage medium or device for the purpose of interpreting instructions or data by the processing device or providing instructions or data to the processing device. The software may be distributed over network coupled computer systems and may be stored or executed in a distributed fashion. The software and data may be stored in more than one computer-readable recording medium.

The methods of the embodiments may be embodied in the form of program instructions that are executable by various computer units and recorded in computer-readable media. The computer readable media described above may contain program instructions, data files, data structures, etc., alone or in combination. The medium continues to store the computer-executable program or may be temporarily stored for execution or download. Also, the medium may be various recording units or storage units in the form of a single or a combination of one or more hardware, and is not limited to a medium directly connected to one computer system, but may be dispersed over a network. By way of illustration of media, there may be included magnetic media such as hard disks, floppy disks, magnetic tape, optical recording media such as CD-ROMs and DVDs, magneto-optical media such as floppy disks (floppy disks), read-only memories (ROM's), random access memories (RAM's), flash memories, and the like, configured to store program instructions. Examples of the other media include an application store for distributing applications, a website for supplying or distributing various other types of software, and a recording medium or a storage medium managed by a server or the like. Examples of the program instructions include machine language codes formed by a compiler and high-level language codes that can be executed by a computer using an interpreter or the like.

As described above, although the embodiments have been described with reference to the limited embodiments and the accompanying drawings, various modifications and variations can be made by those skilled in the art to which the present invention pertains from the above description. For example, even if the described techniques are performed in a different order than the described methods, and/or structural elements of the described systems, structures, devices, circuits, etc. are combined or combined in a different manner than the described methods, or replaced or substituted with other structural elements or equivalents, appropriate results can be achieved.

Therefore, other examples, other embodiments, and equivalents to the claimed invention also fall within the claimed invention.