阅读说明：本技术 云游戏控制系统和方法 (Cloud game control system and method ) 是由 刘奕晨 范志刚 卢涛 于 2020-06-18 设计创作，主要内容包括：本发明公开了一种云游戏控制系统和方法。其中,该系统包括：服务器,用于接收终端设备发送的控制指令,并在控制指令对应至少两个待显示图像的情况下,依据控制指令调整至少两个待显示图像,并将调整后的至少两个待显示图像返回终端设备,以及,启动至少一个摄像头采集用户图像；终端设备,用于显示控制键,并将控制键触发的控制指令发送至服务器,并向至少一个显示设备转发服务器依据控制指令返回的至少两个待显示图像和接收至少一个摄像头发送的用户图像。本发明解决了由于现有技术中在实现云端端游的实现过程中仍需借助传统物理外接设备且无法实时获取队友画面,导致的操作效率降低的技术问题。(The invention discloses a cloud game control system and a cloud game control method. Wherein, this system includes: the server is used for receiving a control instruction sent by the terminal equipment, adjusting at least two images to be displayed according to the control instruction under the condition that the control instruction corresponds to at least two images to be displayed, returning the adjusted at least two images to be displayed to the terminal equipment, and starting at least one camera to collect user images; and the terminal equipment is used for displaying the control key, sending the control instruction triggered by the control key to the server, forwarding at least two images to be displayed returned by the server according to the control instruction to the at least one display equipment and receiving the user image sent by the at least one camera. The invention solves the technical problem of reduced operation efficiency caused by the fact that the traditional physical external equipment still needs to be used in the realization process of the cloud end-to-end game in the prior art and teammate pictures cannot be obtained in real time.)

1. A cloud gaming control system, comprising:

the system comprises a server, terminal equipment, at least one display device and at least one camera; wherein the content of the first and second substances,

the server is connected with the terminal equipment and the at least one camera and is used for receiving a control instruction sent by the terminal equipment, adjusting the at least two images to be displayed according to the control instruction under the condition that the control instruction corresponds to the at least two images to be displayed, returning the adjusted at least two images to be displayed to the terminal equipment and starting the at least one camera to acquire user images;

the terminal device is respectively connected with the at least one display device, the server and the at least one camera, and is used for displaying a control key, sending a control instruction triggered by the control key to the server, forwarding the at least two images to be displayed returned by the server according to the control instruction to the at least one display device and receiving the user image sent by the at least one camera;

the at least one display device is connected with the terminal device and is used for displaying the at least two images to be displayed and the user image forwarded by the terminal device.

2. The system of claim 1, wherein the server comprises: at least one operating system, wherein,

each operating system in the at least one operating system is connected with the terminal device, or each operating system is connected with each terminal device in a one-to-one correspondence manner, and each operating system comprises a drive control module, which is used for receiving a control instruction sent by the terminal device, correspondingly converting the control instruction and a game operating key, and forwarding the converted control instruction to an image processor pool.

3. The system of claim 2, further comprising: and the image processor pool is connected with the at least one operating system and used for acquiring at least two images to be displayed of the at least one operating system and adjusting the at least two images to be displayed according to the converted control command to obtain at least two adjusted images to be displayed.

4. The system of claim 3, wherein the pool of image processors comprises a first sender and an image processing module, wherein,

the image processing module is used for acquiring the number, images and display positions of the images displayed in the at least one operating system according to the control instruction; executing corresponding operations in the number of the images, the images and the display positions according to the control instruction, and updating the adjusted images to obtain the adjusted at least two images to be displayed;

the first sending terminal is connected with the image processing module and used for sending the adjusted at least two images to be displayed.

5. The system according to claim 4, wherein the first sending end is further configured to send the number of images, the images, and the display positions to the terminal device, so that the terminal device forwards the number of images, the images, and the display positions to the at least one display device.

6. The system of any one of claims 1 to 5, wherein the at least one camera comprises: and the second sending end is connected with the terminal equipment and used for starting a camera to collect a user image according to the control instruction and sending the user image to the terminal equipment.

7. The system according to any one of claims 1 to 5, wherein one display device of the at least one display device displays at least two images to be displayed, and/or each display device of the at least one display device respectively displays an image of the at least two images to be displayed.

8. A cloud game control method applied to the system of any one of claims 1 to 7, comprising:

receiving a control instruction sent by the terminal equipment;

under the condition that the control instruction corresponds to at least two images to be displayed, adjusting the at least two images to be displayed according to the control instruction, and starting at least one camera to collect user images;

and returning the at least two adjusted images to be displayed and the user image to the terminal equipment.

9. The method of claim 8, wherein the receiving the control instruction sent by the terminal device comprises:

connecting each operating system in the at least one operating system with the terminal equipment, or connecting each operating system with each terminal equipment in a one-to-one correspondence manner, and receiving a control instruction sent by the terminal equipment;

and correspondingly converting the control instruction and the game operation key, and forwarding the converted control instruction to the image processor pool.

10. The method according to claim 8 or 9, wherein in a case that the control instruction corresponds to at least two images to be displayed, adjusting the at least two images to be displayed according to the control instruction, and wherein starting at least one camera to capture a user image comprises:

according to the control instruction, if the control instruction comprises processing of at least two images to be displayed, adjusting the at least two images to be displayed according to the control instruction to obtain at least two adjusted images to be displayed;

starting a camera to collect a user image according to the control instruction, and sending the user image to the terminal equipment;

wherein, adjusting at least two images to be displayed according to the control instruction, and obtaining the adjusted at least two images to be displayed includes: acquiring the number, images and display positions of the images displayed in the at least one operating system according to the control instruction; and executing corresponding operation in the number of the images, the images and the display positions according to the control instruction, and updating the adjusted images to obtain the adjusted at least two images to be displayed.

11. The method of claim 10, further comprising:

and sending the image number, the image and the display position to the terminal equipment, so that the terminal equipment forwards the image number, the image and the display position to the at least one display equipment.

12. A cloud game control method applied to the system of any one of claims 1 to 7, comprising:

displaying a control key;

sending a control instruction triggered by the control key to a server;

and forwarding the at least two images to be displayed and the user image which are returned by the server according to the control instruction to at least one display device.

13. The method of claim 12, further comprising:

before the control key is displayed, logging in the server and sending a setting instruction to the server, wherein the setting instruction is used for setting the number, images and display positions of the images displayed in the server;

receiving at least two images to be displayed returned by the server according to the setting instruction;

forwarding the at least two images to be displayed to the at least one display device.

14. The method according to claim 13, wherein forwarding the at least two images to be displayed to the at least one display device comprises:

acquiring the connection relation between each image of the at least two images to be displayed and the at least one display device;

and sending the at least two images to be displayed to the at least one display device according to the connection relation.

15. The method of claim 12, wherein sending the control instruction triggered by the control key to a server comprises:

under the condition that the virtual handle driving module is arranged in the terminal equipment, converting the control instruction triggered by the control key into a game handle key control instruction;

and sending the game handle key control instruction to the server.

Technical Field

The invention relates to the technical field of computers, in particular to a cloud game control system and a cloud game control method.

Background

Existing game control methods include keyboard and mouse control, gamepad control, touch screen control, and the like. The cloud games can be divided into two categories of hand games and end games, wherein most of the games of the hand games are controlled by a touch screen (a small amount of game handles are also controlled), the games are controlled by the touch screen of a mobile phone, and control events of the touch screen of the game terminal are injected into a mobile phone operating system of VM/PM so as to be injected into the cloud games.

Most games of the end games are controlled by a keyboard mouse and a joystick, the game terminal is usually controlled by a keyboard mouse or a joystick connected to the game terminal, and the control event of the keyboard mouse or the joystick of the game terminal is transmitted to the cloud and then injected into a desktop operating system of the VM/PM and further into the cloud games.

How to control the game of the cloud end game through the touch screen of the hand game is a problem to be solved.

Aiming at the problem that the operation efficiency is reduced because the traditional physical external equipment still needs to be used in the realization process of realizing the cloud end-to-end game in the prior art and teammate pictures cannot be obtained in real time, an effective solution is not provided at present.

Disclosure of Invention

The embodiment of the invention provides a cloud game control system and a cloud game control method, which at least solve the technical problem that in the prior art, the operation efficiency is reduced because the traditional physical external equipment is still needed in the implementation process of cloud end games and teammates pictures cannot be obtained in real time.

According to an aspect of an embodiment of the present invention, there is provided a cloud game control system including: the system comprises a server, terminal equipment, at least one display device and at least one camera; the server is connected with the terminal equipment and the at least one camera and used for receiving a control instruction sent by the terminal equipment, adjusting the at least two images to be displayed according to the control instruction under the condition that the control instruction corresponds to the at least two images to be displayed, returning the adjusted at least two images to be displayed to the terminal equipment and starting the at least one camera to acquire user images; the terminal equipment is respectively connected with the at least one display equipment, the server and the at least one camera and is used for displaying the control key, sending a control instruction triggered by the control key to the server, forwarding at least two images to be displayed returned by the server according to the control instruction to the at least one display equipment and receiving the user image sent by the at least one camera; and the display equipment is connected with the terminal equipment and is used for displaying the at least two images to be displayed and the user image forwarded by the terminal equipment.

Optionally, the server includes: and each operating system comprises a drive control module and is used for receiving the control instruction sent by the terminal equipment, correspondingly converting the control instruction and the game operating key and forwarding the converted control instruction to the image processor pool.

Further, optionally, the system further includes: and the image processor pool is connected with the at least one operating system and used for acquiring at least two images to be displayed of the at least one operating system and adjusting the at least two images to be displayed according to the converted control instruction to obtain the adjusted at least two images to be displayed.

Optionally, the image processor pool includes a first sending end and an image processing module, where the image processing module is configured to obtain, according to the control instruction, the number of images, the images, and the display position displayed in the at least one operating system; corresponding operations are executed in the number of the images, the images and the display positions according to the control instructions, and the adjusted images are updated to obtain at least two adjusted images to be displayed; and the first sending end is connected with the image processing module and used for sending the adjusted at least two images to be displayed.

Further, optionally, the first sending end is further configured to send the number of images, the images, and the display positions to the terminal device, so that the terminal device forwards the number of images, the images, and the display positions to at least one display device.

Optionally, the at least one camera includes: and the second sending end is connected with the terminal equipment and used for starting the camera to collect the user image according to the control instruction and sending the user image to the terminal equipment.

Optionally, one display device of the at least one display device displays at least two images to be displayed, and/or each display device of the at least one display device respectively displays images of the at least two images to be displayed correspondingly.

According to another aspect of the embodiments of the present invention, there is also provided a cloud game control method applied to the above system, including: receiving a control instruction sent by terminal equipment; under the condition that the control instruction corresponds to at least two images to be displayed, adjusting the at least two images to be displayed according to the control instruction, and starting at least one camera to collect user images; and returning the adjusted at least two images to be displayed and the user image to the terminal equipment.

Optionally, the receiving the control instruction sent by the terminal device includes: connecting each operating system in at least one operating system with the terminal equipment, or connecting each operating system with each terminal equipment in a one-to-one correspondence manner, and receiving a control instruction sent by the terminal equipment; and correspondingly converting the control command and the game operation key, and forwarding the converted control command to the image processor pool.

Further, optionally, under the condition that the control instruction corresponds to the at least two images to be displayed, adjusting the at least two images to be displayed according to the control instruction, and starting the at least one camera to acquire the user image includes: according to the control instruction, if the control instruction comprises processing of at least two images to be displayed, adjusting the at least two images to be displayed according to the control instruction to obtain at least two adjusted images to be displayed; starting a camera to collect a user image according to the control instruction, and sending the user image to the terminal equipment; wherein, adjust at least two images to be displayed according to the control instruction, and obtaining at least two images to be displayed after the adjustment includes: acquiring the number, images and display positions of the images displayed in at least one operating system according to the control instruction; and executing corresponding operations in the number of the images, the images and the display positions according to the control instruction, and updating the adjusted images to obtain at least two adjusted images to be displayed.

Optionally, the method further includes: and sending the image number, the image and the display position to the terminal equipment so that the terminal equipment forwards the image number, the image and the display position to at least one display equipment.

According to another aspect of the embodiments of the present invention, there is also provided a cloud game control method applied to the above system, including: displaying a control key; sending a control instruction triggered by the control key to a server; and forwarding the at least two images to be displayed and the user image which are returned by the server according to the control instruction to at least one display device.

Optionally, the method further includes: before the control key is displayed, logging in a server and sending a setting instruction to the server, wherein the setting instruction is used for setting the number, the images and the display positions of the images displayed in the server; receiving at least two images to be displayed returned by the server according to the setting instruction; at least two images to be displayed are forwarded to at least one display device.

Further, optionally, forwarding the at least two images to be displayed to the at least one display device includes: acquiring the connection relation between each image of at least two images to be displayed and at least one display device; and sending the at least two images to be displayed to at least one display device according to the connection relation.

Optionally, sending the control instruction triggered by the control key to the server includes: under the condition that the virtual handle driving module is arranged in the terminal equipment, converting a control instruction triggered by a control key into a game handle key control instruction; and sending the game handle key control instruction to a server.

In the embodiment of the invention, the server is connected with the terminal equipment and the at least one camera and is used for receiving the control instruction sent by the terminal equipment, adjusting the at least two images to be displayed according to the control instruction under the condition that the control instruction corresponds to the at least two images to be displayed, returning the adjusted at least two images to be displayed to the terminal equipment, and starting the at least one camera to collect the user images; the terminal equipment is respectively connected with the at least one display equipment, the server and the at least one camera and is used for displaying the control key, sending a control instruction triggered by the control key to the server, forwarding at least two images to be displayed returned by the server according to the control instruction to the at least one display equipment and receiving the user image sent by the at least one camera; the display device is connected with the terminal device and used for displaying at least two images to be displayed and user images forwarded by the terminal device, and the purpose of improving the operating environment of the cloud end-end game is achieved, so that the technical effect of improving the operating efficiency is achieved, and the technical problem that in the prior art, the operation efficiency is reduced because the traditional physical external device is still needed in the implementation process of the cloud end-end game and team friend images cannot be obtained in real time is solved.

Drawings

The accompanying drawings, which are included to provide a further understanding of the invention and are incorporated in and constitute a part of this application, illustrate embodiment(s) of the invention and together with the description serve to explain the invention without limiting the invention. In the drawings:

FIG. 1 is a schematic diagram of a cloud gaming control system according to an embodiment of the invention;

fig. 2 is a schematic display diagram of a terminal device in a cloud game control system according to an embodiment of the present invention;

fig. 3 is a schematic diagram of a cloud gaming control system according to an embodiment of the invention;

FIG. 4 is a schematic diagram of another cloud game control system according to an embodiment of the invention;

FIG. 5 is a schematic diagram of an image thumbnail in a terminal device in another cloud game control system according to an embodiment of the invention;

fig. 6 is a flowchart of a cloud game control method in a server according to an embodiment of the present invention;

fig. 7 is a flowchart of a cloud game control method in a terminal device according to an embodiment of the present invention.

Detailed Description

In order to make the technical solutions of the present invention better understood, the technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are only a part of the embodiments of the present invention, and not all of the embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.

It should be noted that the terms "first," "second," and the like in the description and claims of the present invention and in the drawings described above are used for distinguishing between similar elements and not necessarily for describing a particular sequential or chronological order. It is to be understood that the data so used is interchangeable under appropriate circumstances such that the embodiments of the invention described herein are capable of operation in sequences other than those illustrated or described herein. Furthermore, the terms "comprises," "comprising," and "having," and any variations thereof, are intended to cover a non-exclusive inclusion, such that a process, method, system, article, or apparatus that comprises a list of steps or elements is not necessarily limited to those steps or elements expressly listed, but may include other steps or elements not expressly listed or inherent to such process, method, article, or apparatus.