阅读说明：本技术 服务请求处理方法、控制方法、装置、系统及电子设备 (Service request processing method, control method, device, system and electronic equipment ) 是由 刘廷伟 聂大鹏 闵庆欢 朱照远 于 2018-08-22 设计创作，主要内容包括：本发明实施例提供了一种服务请求处理方法、控制方法、装置、系统及电子设备,其中,服务回源的控制方法包括：获取预设时间段内各个CDN边缘节点的新增回源服务请求的数量,确定CDN处理系统的新增回源服务请求的速率；根据源站处理服务请求的能力速率和CDN处理系统的新增回源服务请求的速率,确定服务回源比例；将所述服务回源比例下发到各个所述CDN边缘节点。本发明实施例能够实现服务请求的有序回源,维护源站运行的稳定性,优化用户体验。(The embodiment of the invention provides a service request processing method, a control method, a device, a system and electronic equipment, wherein the control method of a service return source comprises the following steps: acquiring the number of newly increased back-source service requests of each CDN edge node in a preset time period, and determining the rate of the newly increased back-source service requests of a CDN processing system; determining a service back-to-source ratio according to the capacity rate of the source station for processing the service request and the rate of the newly added back-to-source service request of the CDN processing system; and sending the service back source proportion to each CDN edge node. The embodiment of the invention can realize the ordered source returning of the service request, maintain the running stability of the source station and optimize the user experience.)

1. A method of controlling a back-to-source service, comprising:

acquiring the number of newly increased back-source service requests of each CDN edge node in a preset time period, and determining the rate of the newly increased back-source service requests of a CDN processing system;

determining a service back-to-source ratio according to the capacity rate of the source station for processing the service request and the rate of the newly added back-to-source service request of the CDN processing system;

and transmitting the service back-source ratio to each CDN edge node.

2. The method of claim 1, wherein the obtaining the number of the newly added back-to-source service requests of each CDN edge node within the preset time period comprises:

and determining the number of newly added back-source service requests of each CDN edge node in a preset time period according to the notification times and the service request reporting probability of the newly added back-source service requests from each CDN edge node received in the preset time period.

3. The method of claim 1, wherein the determining the serving back-to-source ratio according to an upper limit of a capacity rate of the source station for processing the service request and a rate of the new back-to-source service request of the CDN processing system comprises:

and calculating the ratio of the capacity rate to the rate of the newly added back-to-source service request of the CDN processing system as a service back-to-source ratio.

4. The method of claim 2, wherein the method further comprises:

and determining the service request reporting probability according to the rate of the newly added back-to-source service request of the CDN processing system, wherein the rate of the newly added back-to-source service request of the CDN processing system and the service request reporting probability are changed in the opposite direction.

5. A control device for back-to-source service, comprising:

a newly-added request rate determining unit, configured to obtain the number of newly-added back-source service requests of each CDN edge node in a preset time period, and determine a rate of the newly-added back-source service requests of the CDN processing system;

the service back-to-source ratio determining unit is used for determining a service back-to-source ratio according to the capacity rate of the source station for processing the service request and the rate of a newly added back-to-source service request of the CDN processing system;

and the service back-to-source ratio issuing unit is used for issuing the service back-to-source ratio to each CDN edge node.

6. The apparatus of claim 5, wherein the obtaining of the number of new back-to-source service requests of each CDN edge node in the preset time period includes:

and determining the number of the newly added back-source service requests of each CDN edge node according to the notification times and the service request reporting probability of the newly added back-source service requests from each CDN edge node received in a preset time period.

7. The apparatus of claim 5, wherein the determining a serving back-to-source ratio according to a capability rate of the source station to process the service request and a rate of the new back-to-source service request of the CDN processing system comprises:

and calculating the ratio of the capacity rate to the rate of the newly added back-to-source service request as a service back-to-source ratio.

8. The apparatus of claim 6, wherein the apparatus further comprises:

and the service request reporting probability determining unit is used for determining the service request reporting probability according to the rate of the newly increased back-to-source service request of the CDN processing system, wherein the rate of the newly increased back-to-source service request of the CDN processing system and the service request reporting probability are changed in the opposite direction.

9. An electronic device, comprising:

a memory for storing a program;

a processor, coupled to the memory, for executing the program for:

acquiring the number of newly increased back-source service requests of each CDN edge node in a preset time period, and determining the rate of the newly increased back-source service requests of a CDN processing system;

determining a service back-to-source ratio according to the capacity rate of the source station for processing the service request and the rate of the newly added back-to-source service request of the CDN processing system;

and transmitting the service back-source ratio to each CDN edge node.

10. A service request processing method, comprising:

obtaining a token of the service request;

if the token is a service token, forwarding the service request to the source station;

and if the token is a queuing token, determining whether to issue a service token to the service request according to the information carried in the queuing token and the service return source ratio.

11. The method of claim 10, wherein the service request carries identification information associated with a source client, and the obtaining a token of the service request comprises:

and generating a token of the service request according to the identification information.

12. The method of claim 11, wherein the client is a browser architecture based client and the identification information is cookie information.

13. The method of claim 11, wherein the generating the token for the service request according to the identification information comprises:

acquiring user information associated with the identification information;

and generating a token of the service request according to the user information, wherein the information carried in the token comprises expiration time and/or user grade.

14. The method of claim 13, wherein the determining whether to issue the service token to the service request according to the information carried in the queuing token and the service back-to-source ratio comprises:

if the expiration time and/or the user level carried in the queuing token indicate that the service token can be issued, determining whether to issue the service token to the service request according to the service source returning proportion;

and if the expiration time and/or the user level carried in the queuing token indicate that the service token cannot be issued, distributing a new queuing token for the service request to indicate that the client sending the service request continues to queue.

15. The method of claim 12, wherein said assigning a new queuing token for the service request comprises:

cookie information for generating a new queuing token is created and sent to the client.

16. The method of claim 10, further comprising:

counting the number of the issued service tokens, and sending a notice of a newly added back source service request to a CDN central node according to the service request reporting probability;

and receiving the service back-to-source ratio sent by the CDN central node.

17. A service request processing apparatus comprising:

a token obtaining unit for obtaining a token of the service request;

a service request forwarding unit, configured to forward the service request to the source station when the token acquired by the token acquisition unit is the service token;

and the service request queuing unit is used for determining whether to issue the service token to the service request according to the information carried in the queuing token and the service return source proportion under the condition that the token acquired by the token acquisition unit is the queuing token.

18. The apparatus of claim 17, wherein the service request carries identification information associated with a source client thereof, and the obtaining a token of the service request comprises:

and generating a token of the service request according to the identification information.

19. The apparatus of claim 18, wherein the client is a browser architecture based client and the identification information is cookie information.

20. The apparatus of claim 18, wherein the generating the token for the service request from the identification information comprises:

acquiring user information associated with the identification information;

and generating a token of the service request according to the user information, wherein the token carries an expiration time and/or a user grade.

21. The apparatus of claim 20, wherein the determining whether to issue the service token to the service request according to the information carried in the queued token and the service back-to-source ratio comprises:

if the expiration time and/or the user level carried in the queuing token indicate that the service token can be issued, determining whether to issue the service token to the service request according to the service source returning proportion;

and if the expiration time and/or the user level carried in the queuing token indicate that the service token cannot be issued, distributing a new queuing token for the service request to indicate that the client sending the service request continues to queue.

22. The apparatus of claim 19, wherein said issuing a service token to the service request comprises: cookie information for generating a service token is created and transmitted to the client.

23. The apparatus of claim 17, further comprising:

counting the number of the issued service tokens, and sending a notice of a newly added back source service request to a CDN central node according to the service request reporting probability;

and receiving the service back-to-source ratio sent by the CDN central node.

24. An electronic device, comprising:

a memory for storing a program;

a processor, coupled to the memory, for executing the program for:

obtaining a token of the service request;

if the token is a service token, forwarding the service request to the source station;

and if the token is a queuing token, determining whether to issue a service token to the service request according to the information carried in the queuing token and the service return source ratio.

25. A CDN processing system comprising a CDN central node and a plurality of CDN edge nodes, wherein:

the CDN edge node is used for counting the number of issued service tokens and sending a notice of a newly added back source service request to the CDN center node; receiving a service source returning proportion issued by the CDN central node, and performing service source returning control on the service request according to the service source returning proportion;

the CDN central node is used for determining the number of newly added back-source service requests of each CDN edge node within a preset time period according to the notice of the newly added back-source service requests sent by each CDN edge node, and determining the rate of the newly added back-source service requests of the CDN processing system; and determining a service back-to-source ratio according to the capacity rate of the source station for processing the service request and the rate of the newly added back-to-source service request, and sending the service back-to-source ratio to each CDN edge node.

26. The system of claim 25, wherein:

the counting of the number of the issued service tokens and the sending of the notification of the newly added back-to-source service request to the CDN central node include:

counting the number of issued service tokens, and sending a notice of a newly added back-source service request to a CDN central node according to the service request reporting probability;

the determining, according to the notification of the newly added back-source service request sent by each CDN edge node, the number of the newly added back-source service requests of each CDN edge node within a preset time period includes:

and determining the number of the newly added back-source service requests of each CDN edge node according to the notification times and the service request reporting probability of the newly added back-source service requests sent by each CDN edge node received in a preset time period.

Technical Field

The present disclosure relates to a service request processing method, a control method, a device, a system, and an electronic device, and in particular, to a service request processing method, a device, a system, and an electronic device, and belongs to the field of computer technologies.

Background

With the rapid development of the internet industry, the demand of users for network services is increasing day by day. Although the processing capacity and network bandwidth of the website server are increasing, when an emergency event that the access amount of the user service request is increased sharply occurs, such as breaking news, spring ticketing, etc., the source station providing the service is often in danger of being crashed, and the user service request is also in case of access failure, which results in very poor user experience. CDN (Content Delivery Network) technology is gradually developed on this basis. The CDN is a content delivery network built on the network, and performs load balancing, traffic scheduling, and the like on access to a service request from a user by means of edge servers deployed in various places, thereby reducing network congestion and improving response speed of user access. Because the processing capacity of the source station is limited, in order to solve the source station crash phenomenon caused by the sharp increase of the user access amount, the prior art usually directly cancels a part of service requests in a preset fixed proportion, and only reserves the service requests in the preset proportion to return to the source station for processing. Thus, although the processing pressure of the source station is relieved to a certain extent, the user experience is poor, and the phenomenon that the source station is broken down cannot be effectively avoided.

Disclosure of Invention

Embodiments of the present invention provide a service request processing method, a service request control device, a service request processing system, and an electronic device, which can implement ordered resource returning of service requests, maintain stability of operation of a source station, and optimize user experience.

The embodiment of the invention provides a control method for a service return source, which comprises the following steps:

acquiring the number of newly increased back-source service requests of each CDN edge node in a preset time period, and determining the rate of the newly increased back-source service requests of a CDN processing system;

determining a service back-to-source ratio according to the capacity rate of the source station for processing the service request and the rate of the newly added back-to-source service request of the CDN processing system;

and transmitting the service back-source ratio to each CDN edge node.

The embodiment of the invention also provides a control device for the service return source, which comprises:

a newly-added request rate determining unit, configured to obtain the number of newly-added back-source service requests of each CDN edge node in a preset time period, and determine a rate of the newly-added back-source service requests of the CDN processing system;

the service back-to-source ratio determining unit is used for determining a service back-to-source ratio according to the capacity rate of the source station for processing the service request and the rate of a newly added back-to-source service request of the CDN processing system;

and the service back-to-source ratio issuing unit is used for issuing the service back-to-source ratio to each CDN edge node.

An embodiment of the present invention further provides an electronic device, including:

a memory for storing a program;

a processor, coupled to the memory, for executing the program for:

acquiring the number of newly increased back-source service requests of each CDN edge node in a preset time period, and determining the rate of the newly increased back-source service requests of a CDN processing system;

determining a service back-to-source ratio according to the capacity rate of the source station for processing the service request and the rate of the newly added back-to-source service request of the CDN processing system;

and transmitting the service back-source ratio to each CDN edge node.

The embodiment of the invention also provides a service request processing method, which comprises the following steps:

obtaining a token of the service request;

if the token is a service token, forwarding the service request to the source station;

and if the token is a queuing token, determining whether to issue a service token to the service request according to the information carried in the queuing token and the service return source ratio.

An embodiment of the present invention further provides a service request processing apparatus, including:

a token obtaining unit for obtaining a token of the service request;

a service request forwarding unit, configured to forward the service request to the source station when the token acquired by the token acquisition unit is the service token;

and the service request queuing unit is used for determining whether to issue the service token to the service request according to the information carried in the queuing token and the service return source proportion under the condition that the token acquired by the token acquisition unit is the queuing token.

An embodiment of the present invention further provides another electronic device, including:

a memory for storing a program;

a processor, coupled to the memory, for executing the program for:

obtaining a token of the service request;

if the token is a service token, forwarding the service request to the source station;

and if the token is a queuing token, determining whether to issue a service token to the service request according to the information carried in the queuing token and the service return source ratio.

An embodiment of the present invention further provides a CDN processing system, including: CDN center node and a plurality of CDN edge node, wherein:

the CDN edge node is used for counting the number of issued service tokens and sending a notice of a newly added back source service request to the CDN center node; receiving a service source returning proportion issued by the CDN central node, and performing service source returning control on the service request according to the service source returning proportion;

the CDN central node is used for determining the number of newly added back-source service requests of each CDN edge node within a preset time period according to the notice of the newly added back-source service requests sent by each CDN edge node, and determining the rate of the newly added back-source service requests of the CDN processing system; and determining a service back-to-source ratio according to the capacity rate of the source station for processing the service request and the rate of the newly added back-to-source service request, and sending the service back-to-source ratio to each CDN edge node.

The embodiment of the invention provides a service request processing method, a service request control device, a service request system and electronic equipment. Therefore, on one hand, the ordered source returning of the service requests can be realized, on the other hand, the service source returning proportion is adjusted based on the processing capacity of the source station, and the running stability of the source station can be maintained, so that the user experience is optimized.

The foregoing description is only an overview of the technical solutions of the present invention, and the embodiments of the present invention are described below in order to make the technical means of the present invention more clearly understood and to make the above and other objects, features, and advantages of the present invention more clearly understandable.

Drawings

FIG. 1 is a logic diagram illustrating the back-to-source processing of a service request according to an embodiment of the present invention;

FIG. 2 is a schematic structural diagram of a CDN processing system according to an embodiment of the present invention;

fig. 3a is a first flowchart illustrating a method for controlling a service return source according to a first embodiment of the present invention;

fig. 3b is a flowchart illustrating a control method of a service return source according to a first embodiment of the present invention;

fig. 4a is a schematic structural diagram of a control apparatus for a service return source according to a second embodiment of the present invention;

fig. 4b is a schematic structural diagram of a control apparatus for a service return source according to a second embodiment of the present invention;

fig. 5 is a first schematic structural diagram of an electronic device according to an embodiment of the present invention;

fig. 6 is a flowchart illustrating a service request processing method according to a fourth embodiment of the present invention;

fig. 7 is a schematic structural diagram of a service request processing apparatus according to a fifth embodiment of the present invention;

fig. 8 is a schematic structural diagram of an electronic device according to an embodiment of the present invention.

Detailed Description

Exemplary embodiments of the present disclosure will be described in more detail below with reference to the accompanying drawings. While exemplary embodiments of the present disclosure are shown in the drawings, it should be understood that the present disclosure may be embodied in various forms and should not be limited to the embodiments set forth herein. Rather, these embodiments are provided so that this disclosure will be thorough and complete, and will fully convey the scope of the disclosure to those skilled in the art.

Description of terms:

a CDN (Content Delivery Network) is a Content Delivery Network constructed on a Network, and a user can obtain required Content nearby by using functional modules of load balancing, Content Delivery, scheduling, and the like of a central platform by means of edge servers deployed in various places, so as to reduce Network congestion and improve user access response speed and hit rate.

And dynamic acceleration refers to relying on CDN nodes among global nodes to realize nearby access of users in various regions, detecting the quality of a link, and forwarding the flow to a source station through an optimal network link to help a service to solve the problem of unsmooth access or overhigh delay of the global users.

Tokens (tokens), which represent objects that perform the right to perform certain operations.

In order to facilitate the explanation of the technical solution of the embodiment of the present invention, the following names are defined in the description process:

and the service returning refers to the process of returning the service request to the source station for processing.

Specifically, in the following embodiments, the CDN edge node issues a service token according to a service source return ratio to generate a newly generated service request with a service token, and the service request is allowed to access the source station to obtain a service provided by the source station. The new addition is to distinguish the CDN edge node from the back-source service request generated based on the service token that has been issued.

The service back-to-source ratio (in this document, referred to as Servicepct) refers to a ratio of service requests returned to the source station to queued service requests, which may be allowed to be used by the CDN edge nodes according to the capability of the source station to process the service requests.

The service request reporting probability (in part of the content, denoted by realtemp) refers to the proportion of new back-source service requests that can be reported to the decision center. The service request reporting probability can be preset, and can also be dynamically set according to the number of newly added back-source service requests.

At present, although the processing capacity and network bandwidth of a website server are continuously increased, when an emergency event that the access amount of a user service request is greatly increased occurs, such as major news, spring ticketing, and the like, a source station providing a service is often in danger of being crashed, and the user service request is also in a situation that access fails, so that the user experience is very poor. The CDN can perform load balancing, traffic scheduling, and the like on access of a service request from a user, thereby reducing network congestion and improving response speed of user access. In the prior art, because the processing capacity of the source station is limited, in order to solve the source station crash phenomenon caused by the sharp increase of the user access amount, the number of the service request access source stations is generally controlled by a fixed proportion. When the access amount of the user service request is increased sharply and exceeds the processing capacity of the source station, a part of the service requests are directly cancelled at a preset fixed proportion, and only the service requests with the preset proportion are reserved for returning to the source. For example, the access amount of the current service request is 10000, and the fixed proportion of the service requests that can be returned to the source is set to 50%, then only 5000 service requests can normally access the source station, and the rest 5000 service requests cannot access and return the page where the service request fails to the user. On the other hand, when the access amount of the service requests sharply increases, the policy cannot effectively protect the source station, and if the processing capacity of the source station can only bear 2000 service requests at the same time, even if the policy is executed, 5000 service requests after returning to the source still crash the source station, so that the meaning of returning to the source control is lost.

The technical principle of the embodiment of the invention is as follows: on one hand, the service requests are controlled to be queued orderly by issuing the service tokens and/or queuing tokens to the service requests, on the other hand, in the process of acquiring the service tokens, the service source returning proportion can be dynamically determined based on the processing capacity of the source station and the number of newly added source returning service requests in a preset time period, the service tokens are issued according to the service source returning proportion, and when the service requests carry the service tokens, the service requests can be forwarded to the source station. Therefore, on one hand, ordered source returning of the service requests can be realized, on the other hand, the service source returning proportion is dynamically adjusted based on the processing capacity of the source station and the specific situation of the newly added source returning service requests, the running stability of the source station can be maintained, and therefore user experience is optimized.

Fig. 1 is a logic diagram of service request back-to-source processing according to an embodiment of the present invention, which illustrates respective processing flows at both sides of a CDN edge node and a client, and the service request back-to-source processing logic is mainly divided into two aspects of processing a service request and controlling a service back-to-source, which will be described in detail below.

The service request processing mainly realizes the orderly queuing of the service requests through multi-stage judgment. Firstly, a CDN edge node receives a service request sent by a client, judges whether the service request carries a service token and/or a queuing token, and forwards the service request to a source station if the service request carries the service token; if the service request carries the queuing token, whether the service token is issued to the service request can be judged according to the information of the expiration time and/or the user level carried in the queuing token, if the expiration time carried in the queuing token is expired and/or the user level is higher and meets the condition of issuing the service token preferentially, the service token can be issued to the service request, otherwise, the client corresponding to the service request is indicated to return to the queuing page for continuing queuing. Therefore, through the queuing mechanism of the two-level tokens of the service request, the defect that an error page is directly returned to the terminal once the service return cannot be carried out in the prior art is overcome.

It should be noted that, in the embodiment of the present invention, the client may be a client based on a browser architecture, and the client itself may be implemented as a browser, or may be a client of an embedded browser architecture. The browser-based architecture may leverage cookie technology to assist in implementing the queuing mechanism described above. In particular, the service token and/or queuing token may be generated based on cookie information for the browser. The cookie information of the browser contains multidimensional user information, such as user friendliness and user level, and differentiated tokens can be generated according to the multidimensional user information, such as expiration time, user level and user friendliness of tokens obtained by different users can be different.

In addition, when the expiration time carried in the queuing token is expired and/or the user level is higher, the condition of issuing the service token preferentially is met, the service request is only indicated to obtain the opportunity of obtaining the service token, but the service token is not necessarily obtained. Whether the service request can obtain a service token also depends on the service back-to-source ratio, which will be described in more detail below.

In the process of issuing the service token, if the expiration time carried in the current queuing token is expired and/or the user level is higher, the condition of issuing the service token preferentially is met, and the issuing of the service token can be further controlled through the service source returning proportion. The service back-to-source ratio refers to the ratio of service requests that can be allowed back to the source station to queued service requests, depending on the ability of the source station to process the service requests. The CDN edge node may issue a service token for the queued service request according to the service back-to-source ratio.

The control of the service back source is mainly executed through the CDN central node side. As shown in fig. 1, first, the rate of the newly added back-to-source service request of the CDN processing system is determined by counting the rate of the newly added back-to-source service request of each CDN edge node; then, determining the service back-to-source ratio by combining the rate of the newly added back-to-source service request of the CDN processing system and based on the capability of the source station for processing the service request, wherein the service back-to-source ratio can be obtained by calculating the ratio of the rate of the capability of the source station for processing the service request to the rate of the newly added back-to-source service request; and finally, the currently determined service back-to-source ratio is issued to each CDN edge node in the CDN processing system, and the CDN edge nodes can issue service tokens to the service requests in the queue according to the service back-to-source ratio, so that the control of the service back-to-source is realized.

It should be noted that, in the process of counting the number of the newly added back-source service requests by the CDN edge node, the counting may be performed by using a preset or dynamically set service request reporting probability. For example, the service request reporting probability may be preset to 1/1000, and then the report is only reported to the CDN central node once in every 1000 new back-to-source service requests, and the CDN central node may calculate the number of new back-to-source service requests for each CDN edge node according to the reported notification times of the new back-to-source service requests and in combination with the preset service request reporting probability. In addition, the service request reporting probability can be specifically determined according to the rate of the newly added back-to-source service request, and when the rate of the newly added back-to-source service request is higher, the service request reporting probability is correspondingly reduced; otherwise, the service request reporting probability is correspondingly increased. This reduces the statistical frequency and enables fast sensing when the number of service requests increases dramatically.

Fig. 2 is a schematic structural diagram of a CDN processing system according to an embodiment of the present invention. As shown, in the CDN processing system, a plurality of CDN edge nodes 11 and CDN central nodes 12 are included. On one hand, the CDN edge node 11 interacts with the client 13, receives a service request sent by the client, and performs service back-to-source processing on the service request meeting the back-to-source condition, that is, forwards the service request to the source station 14; on the other hand, the CDN central node 12 interacts with the CDN central node, reports data related to the service request, and receives control information delivered by the CDN central node 12. The source station is the server or cluster of servers that actually provide the service. Secondary CDN nodes may also exist between the CDN edge node 11 and the source station 14, and these secondary CDN nodes are mainly used for performing routing control and the like, and are omitted in fig. 2 since there is no direct association with the core processing mechanism according to the embodiment of the present invention.

Specifically, the CDN edge node is configured to count the number of issued service tokens and send a notification of a newly added back-to-source service request to the CDN center node; receiving a service source returning proportion issued by the CDN central node, and performing service source returning control on the service request according to the service source returning proportion; the CDN central node is used for determining the number of newly-added back-source service requests of each CDN edge node in a preset time period according to the notice of the newly-added back-source service requests sent by each CDN edge node, and determining the rate of the newly-added back-source service requests of the CDN processing system; and determining a service back-to-source ratio according to the capacity rate of the source station for processing the service request and the rate of the newly added back-to-source service request, and transmitting the back-to-source ratio to each CDN edge node.

It should be noted that, based on the logic of the service request back-to-source processing, the CDN edge node may also send a notification of a new back-to-source service request to the CDN center node according to the service request reporting probability; correspondingly, the CDN central node may determine the number of newly added back-source service requests of each CDN edge node according to the notification times and the service request reporting probability of the newly added back-source service requests sent by each CDN edge node received within the preset time period.

The technical solution of the present application is further illustrated by the following examples.