阅读说明：本技术 一种基于人脸识别的公交pos机 (Public transit pos machine based on face identification ) 是由 邹凤 张世强 王金刚 孙宏飞 钱贵涛 于 2021-06-22 设计创作，主要内容包括：本发明公开了一种基于人脸识别的公交pos机,通过实时与远程支付控制中心通信进行支付确认；远程支付控制中心,包括：多个区域验证服务器以及总端验证服务器；区域验证服务器用于在给定的通讯距离内与车载支付终端进行实时通讯,并对车载支付终端上传的生物特征识别支付信息进行乘客身份验证；若验证成功,则直接扣费,若验证失败,则将乘客的生物特征识别支付信息发送总端验证服务器进行二次验证,若二次验证成功则向区域验证服务器返回成功信息进行扣费,若失败,则返回判定失败信息。通过一次验证不成功的情况下再进行二次验证,两次均失败才判定为验证失败,从而提高了对生物特征验证的识别率和准确性。(The invention discloses a public transportation pos machine based on face recognition, which is communicated with a remote payment control center in real time to confirm payment; a remote payment control center comprising: a plurality of regional authentication servers and a head end authentication server; the regional verification server is used for carrying out real-time communication with the vehicle-mounted payment terminal within a given communication distance and carrying out passenger identity verification on the biological characteristic identification payment information uploaded by the vehicle-mounted payment terminal; if the verification is successful, directly deducting the fee, if the verification is failed, sending the biometric feature identification payment information of the passenger to a main verification server for secondary verification, if the secondary verification is successful, returning success information to an area verification server for deducting the fee, and if the secondary verification is failed, returning failure judgment information. And the verification is determined to be failed after two times of failures through secondary verification under the condition that the primary verification is unsuccessful, so that the identification rate and the accuracy of the biological characteristic verification are improved.)

1. The utility model provides a public transit pos machine based on face identification, includes on-vehicle payment terminal, its characterized in that: through communicating in real time with a remote payment control center for payment confirmation, the remote payment control center comprising: a plurality of regional authentication servers and a head end authentication server; the vehicle-mounted payment terminal comprises payment acquisition equipment, a main control unit and payment prompt equipment;

the area verification server is used for carrying out real-time communication with the vehicle-mounted payment terminal within a given communication distance, analyzing the passenger payment data packet which is uploaded by the main control unit and is encrypted and packaged, and verifying the identity information of the passenger; if the verification is successful, the passenger binding account is deducted through a deduction module; if the verification fails, the passenger payment data packet is sent to the main verification server for verification; when the verification server returns verification success information, the passenger binding account is deducted through a deduction module, otherwise, the payment is judged to fail; the regional verification server sends a payment verification result to the main control unit; the passenger binding account is a digital RMB account;

the main terminal verification server is used for decrypting the passenger payment data packet by using a server identity verification code corresponding to the area verification server and then carrying out secondary identity verification, if the passenger payment data packet passes the verification, sending verification success information to the area verification server, and classifying and storing payment information returned by the area verification server; otherwise, sending verification failure information to the area verification server;

the payment acquisition equipment is used for acquiring passenger payment information in a biometric identification payment acquisition mode and sending the passenger payment information to the main control unit;

the main control unit is used for sending vehicle-mounted identity identification information to the main terminal verification server, calling a preset vehicle-mounted terminal shift schedule to determine the main terminal verification server of a vehicle-mounted terminal circuit path after the vehicle-mounted identity verification is successful, and informing the main terminal verification server to configure a payment deduction operation environment for the vehicle-mounted payment terminal; the passenger payment data packet is used for encrypting and packaging the passenger payment information into the passenger payment data packet and sending the passenger payment data packet to the regional verification server; receiving the payment verification result and sending the payment prompting device;

and the payment prompting device is used for carrying out synchronous voice prompting according to the payment verification result sent by the main control unit.

2. The bus pos machine based on the face recognition as claimed in claim 1, wherein the payment acquisition device comprises a first payment acquisition device and a second payment acquisition device;

the first payment acquisition equipment is used for acquiring passenger payment information in an acquisition mode of automatic coin feeding payment, card swiping payment and code scanning payment;

the second payment acquisition equipment is used for acquiring passenger payment information in a biometric identification payment acquisition mode; the biological characteristic recognition payment comprises at least two recognition payment modes of fingerprints, human faces, voiceprints and irises.

3. The bus pos machine based on the face recognition as claimed in claim 2,

the fee deduction module comprises a first fee deduction submodule and a second fee deduction submodule;

the first fee deduction submodule is used for automatically deducting fees under the payment fee deduction operating environment of the passenger adopting the first payment acquisition equipment;

and the second payment deduction sub-module is used for automatically deducting the fee under the payment deduction operation environment of the passenger adopting the second payment acquisition equipment.

4. The bus pos machine based on the face recognition as claimed in claim 3, wherein the first fee deduction sub-module is configured to recognize whether a payment mode of a passenger belongs to a card payment or a code scanning payment; if the payment is card swiping payment, determining whether the current passenger bus card information is matched with certain registered information in the fee deduction list or not based on a preset fee deduction list, and automatically deducting the fee in a background if the current passenger bus card information is matched with the certain registered information in the fee deduction list; if the payment belongs to code scanning payment, starting a correlation program to communicate with each large payment platform, determining whether code scanning information provided by a user is matched with information in a user list of any payment platform, and automatically deducting the fee if the code scanning information provided by the user is matched with the information in the user list of any payment platform;

the second payment deduction sub-module is used for simultaneously acquiring fingerprint identification payment and face identification payment information of passengers and generating a user identity identification information data packet based on the fingerprint identification payment and the face identification payment information; respectively checking whether the fingerprint information and the face information are legal users of equipment authentication; if so, determining that the user information is correct and authorizing to carry out payment settlement; otherwise, prompting that the verification fails and the subsequent payment settlement can not be continued, wherein the settlement mode adopts a digital RMB form.

5. The bus pos machine based on the face recognition according to claim 4, wherein the verifying whether the fingerprint information and the face information are both legal users of the device authentication comprises:

communicating with the area verification server to determine whether the currently uploaded fingerprint information can be found in the fingerprint information database, and if so, determining that the verification is passed;

judging whether the currently uploaded fingerprint information can be found in a fingerprint information database through an equation (1);

where o is the currently uploaded fingerprint information, p is the fingerprint in the fingerprint information database, V_mRepresenting confidence, V, of the currently uploaded fingerprint information features_nRepresenting confidence of fingerprint features in fingerprint information database, and value range [0, 1%]，l_n(. indicates the features extracted using the twin network trained with contrast loss, f_oDenotes de-noising the fingerprint information,representing the third derivative of the outline, and o ', p' representing the fingerprint information after binarization; fa represents the maximum similarity between the currently uploaded fingerprint and the fingerprint in the fingerprint information database, and if the similarity is greater than a threshold value, the currently uploaded fingerprint information can be found in the fingerprint information database;

communicating with the regional verification server to determine whether the currently uploaded face information can be found in the face information database, and if so, determining that the verification is passed;

judging whether the uploaded face information can be found in a face information database or not through the formula (2);

where r is the currently uploaded face information, b is the face in the face information database, V_cIndicating the current positionConfidence of uploaded face information features, V_dRepresenting the confidence of the face features in the face information database, and the value range [0,1 ]]，l_d(. indicates the features extracted using the twin network trained with contrast loss, f_rThe method comprises the following steps that () represents that five-sense organ features are extracted by using a convolution network trained by cross entropy, and r ', b' represents serialized face information; rl represents the maximum similarity between the currently uploaded face and the face in the face information database, and if the similarity is greater than a threshold value, the currently uploaded face information can be found in the face information database.

6. The bus pos machine based on the face recognition, as claimed in claim 5, wherein the process of encrypting and packaging the passenger payment information into the passenger payment data packet comprises:

encrypting the second payment information, the time when uploading and the position information into encrypted information of a fixed number of bits based on a first encryption algorithm; encrypting the vehicle-mounted identity recognition information into encrypted information of a fixed number of bits based on a second encryption algorithm; the two pieces of encrypted information form a complete information;

the first encryption algorithm has a higher level of confidentiality than the second encryption algorithm; a decryption algorithm of the first encryption algorithm and a decryption algorithm of the second encryption algorithm are built in the corresponding area verification server;

and configuring the second encryption algorithm or the third encryption algorithm to encrypt the area authentication service identity verification code.

7. The bus pos machine based on face recognition according to claim 6, wherein the passenger payment data packet comprises: fingerprint information, face information, and user information-temporary id;

after the regional verification server verifies that the fingerprint information and the face information are legal users authenticated by equipment, the temporary id of the user information is determined to be user authorized information and is authorized to carry out payment settlement; otherwise, prompting that the verification fails and the subsequent payment settlement can not be continued.

8. The public transportation pos machine based on the face recognition as claimed in claim 7, wherein the determining that the user information-temporary id is user authorized information and authorizing payment settlement comprises:

replacing the user information-temporary id with user authorized information, wherein the user authorized information is verification information generated after the fingerprint information and the face information are combined and encrypted;

and searching whether the information matched with the verification information exists in the authorization information database, and determining that the payment settlement can be authorized when the matching degree is consistent.

9. The bus pos machine based on the face recognition according to claim 8, wherein the first payment collection device is provided with an image collector; the image collector is used for identifying the face value of the coin and recording the coin amount of each coin.

10. The bus pos machine based on the face recognition as claimed in claim 9, wherein the first payment collection device is further provided with an alarm prompter for alarming when the coin amount is less than a prescribed minimum amount.

Technical Field

The invention relates to the technical field of intelligent bus taking payment, in particular to a bus pos machine based on face recognition.

Background

With the continuous development of information network technology, people have more and more scenes of applying digital RMB in life, at present, the main mode of using the digital RMB is to scan a two-dimensional code and pay through a bound bank account, and the mode of scanning the code and paying can be applied to bus taking payment of public transport and subway, but the operation of opening the two-dimensional code still needs to be carried out by a mobile phone every time of taking a bus, so that the operation is not convenient enough; meanwhile, the recognition rate of the two-dimensional code recognition device on the existing bus is general, and the phenomenon that the passengers getting on the bus behind the bus are affected due to the fact that the passengers getting on the bus are blocked at the bus door due to code scanning failure often occurs. In addition, the bus passengers also comprise a large number of special passengers, including the old, children, soldiers, disabled people and the like, and the riding treatment of the special passengers is different, so that the preferential treatment of riding enjoyment through two-dimensional code payment cannot be realized.

At present, the public prior art includes bus riding payment methods for paying by collecting passenger biological characteristics, but when the biological characteristic identification system cannot accurately judge the collected individual biological characteristics (for example, a user does not update the biological characteristic information of the user for a long time, the passenger is a public face, and the like), the biological characteristic identification verification fails.

Disclosure of Invention

The invention provides a public transport pos machine based on face recognition, and aims to overcome the technical problem.

The invention discloses a public transport pos machine based on face recognition, which comprises a vehicle-mounted payment terminal, wherein the vehicle-mounted payment terminal is communicated with a remote payment control center in real time to confirm payment, and the remote payment control center comprises: a plurality of regional authentication servers and a head end authentication server; the vehicle-mounted payment terminal comprises payment acquisition equipment, a main control unit and payment prompt equipment; the area verification server is used for carrying out real-time communication with the vehicle-mounted payment terminal within a given communication distance, analyzing the passenger payment data packet which is uploaded by the main control unit and is encrypted and packaged, and verifying the identity information of the passenger; if the verification is successful, the passenger binding account is deducted through a deduction module; if the verification fails, the passenger payment data packet is sent to the main verification server for verification; the passenger binding account is a digital RMB account; when the verification server returns verification success information, the passenger binding account is deducted through a deduction module, otherwise, the payment is judged to fail; the regional verification server sends a payment verification result to the main control unit; the main terminal verification server is used for decrypting the passenger payment data packet by using a server identity verification code corresponding to the area verification server and then carrying out secondary identity verification, if the passenger payment data packet passes the verification, sending verification success information to the area verification server, and classifying and storing payment information returned by the area verification server; otherwise, sending verification failure information to the area verification server; the payment acquisition equipment is used for acquiring passenger payment information in a biometric identification payment acquisition mode and sending the passenger payment information to the main control unit; the main control unit is used for sending vehicle-mounted identity identification information to the main terminal verification server, calling a preset vehicle-mounted terminal shift schedule to determine the main terminal verification server of a vehicle-mounted terminal circuit path after the vehicle-mounted identity verification is successful, and informing the main terminal verification server to configure a payment deduction operation environment for the vehicle-mounted payment terminal; the passenger payment data packet is used for encrypting and packaging the passenger payment information into the passenger payment data packet and sending the passenger payment data packet to the regional verification server; receiving the payment verification result and sending the payment prompting device; and the payment prompting device is used for carrying out synchronous voice prompting according to the payment verification result sent by the main control unit.

Further, the payment acquisition equipment comprises first payment acquisition equipment and second payment acquisition equipment; the first payment acquisition equipment is used for acquiring passenger payment information in an acquisition mode of automatic coin feeding payment, card swiping payment and code scanning payment; the second payment acquisition equipment is used for acquiring passenger payment information in a biometric identification payment acquisition mode; the biological characteristic recognition payment comprises at least two recognition payment modes of fingerprints, human faces, voiceprints and irises.

Further, the fee deduction module comprises a first fee deduction submodule and a second fee deduction submodule; the first fee deduction submodule is used for automatically deducting fees under the payment fee deduction operating environment of the passenger adopting the first payment acquisition equipment; and the second payment deduction sub-module is used for automatically deducting the fee under the payment deduction operation environment of the passenger adopting the second payment acquisition equipment.

Further, the first deduction sub-module is used for identifying whether the payment mode of the passenger belongs to card swiping payment or code scanning payment; if the payment is card swiping payment, determining whether the current passenger bus card information is matched with certain registered information in the fee deduction list or not based on a preset fee deduction list, and automatically deducting the fee in a background if the current passenger bus card information is matched with the certain registered information in the fee deduction list; if the payment belongs to code scanning payment, starting a correlation program to communicate with each large payment platform, determining whether code scanning information provided by a user is matched with information in a user list of any payment platform, and automatically deducting the fee if the code scanning information provided by the user is matched with the information in the user list of any payment platform; the second payment deduction sub-module is used for simultaneously acquiring fingerprint identification payment and face identification payment information of passengers and generating a user identity identification information data packet based on the fingerprint identification payment and the face identification payment information; respectively checking whether the fingerprint information and the face information are legal users of equipment authentication; if so, determining that the user information is correct and authorizing to carry out payment settlement; otherwise, prompting that the verification fails and the subsequent payment settlement can not be continued, wherein the settlement mode adopts a digital RMB form.

Further, the verifying whether the fingerprint information and the face information are both legal users of the device authentication includes: communicating with the area verification server to determine whether the currently uploaded fingerprint information can be found in the fingerprint information database, and if so, determining that the verification is passed;

judging whether the currently uploaded fingerprint information can be found in a fingerprint information database through an equation (1);

where o is the currently uploaded fingerprint information, p is the fingerprint in the fingerprint information database, V_mRepresenting confidence, V, of the currently uploaded fingerprint information features_nRepresenting confidence of fingerprint features in fingerprint information database, and value range [0, 1%]，l_n(. indicates the features extracted using the twin network trained with contrast loss, f_oDenotes de-noising the fingerprint information,representing the third derivative of the outline, and o ', p' representing the fingerprint information after binarization; fa represents the maximum similarity between the currently uploaded fingerprint and the fingerprint in the fingerprint information database, and if the similarity is greater than a threshold value, the currently uploaded fingerprint information can be found in the fingerprint information database;

communicating with the regional verification server to determine whether the currently uploaded face information can be found in the face information database, and if so, determining that the verification is passed;

judging whether the uploaded face information can be found in a face information database or not through the formula (2);

where r is the currently uploaded face information, b is the face in the face information database, V_cRepresenting the confidence, V, of the currently uploaded facial information features_dRepresenting the confidence of the face features in the face information database, and the value range [0,1 ]]，l_d(. indicates the features extracted using the twin network trained with contrast loss, f_rThe method comprises the following steps that () represents that five-sense organ features are extracted by using a convolution network trained by cross entropy, and r ', b' represents serialized face information; rl denotes currentAnd if the similarity is greater than the threshold value, the currently uploaded face information can be found in the face information database.

Further, the process of encrypting and packaging the passenger payment information into the passenger payment data packet comprises: encrypting the second payment information, the time when uploading and the position information into encrypted information of a fixed number of bits based on a first encryption algorithm; encrypting the vehicle-mounted identity recognition information into encrypted information of a fixed number of bits based on a second encryption algorithm; the two pieces of encrypted information form a complete information; the first encryption algorithm has a higher level of confidentiality than the second encryption algorithm; a decryption algorithm of the first encryption algorithm and a decryption algorithm of the second encryption algorithm are built in the corresponding area verification server; and configuring the second encryption algorithm or the third encryption algorithm to encrypt the area authentication service identity verification code.

Further, the passenger payment data packet includes: fingerprint information, face information, and user information-temporary id; after the regional verification server verifies that the fingerprint information and the face information are legal users authenticated by equipment, the temporary id of the user information is determined to be user authorized information and is authorized to carry out payment settlement; otherwise, prompting that the verification fails and the subsequent payment settlement can not be continued.

Further, the determining that the user information-temporary id is user authorized information and authorizing payment settlement includes: replacing the user information-temporary id with user authorized information, wherein the user authorized information is verification information generated after the fingerprint information and the face information are combined and encrypted; and searching whether the information matched with the verification information exists in the authorization information database, and determining that the payment settlement can be authorized when the matching degree is consistent.

Furthermore, the first auxiliary collecting device is provided with an image collector; the image collector is used for identifying the face value of the coin and recording the coin amount of each coin.

Furthermore, the first payment collection equipment is also provided with an alarm prompter, and when the coin amount is smaller than the specified minimum amount, an alarm is given.

The invention carries out payment confirmation by real-time communication with a remote payment control center; a remote payment control center comprising: a plurality of regional authentication servers and a head end authentication server; the regional verification server is used for carrying out real-time communication with the vehicle-mounted payment terminal within a given communication distance and carrying out passenger identity verification on the biological characteristic identification payment information uploaded by the vehicle-mounted payment terminal; if the verification is successful, directly deducting the fee, if the verification is failed, sending the biometric feature identification payment information of the passenger to a main verification server for secondary verification, if the secondary verification is successful, returning success information to an area verification server for deducting the fee, and if the secondary verification is failed, returning failure judgment information. And the verification is determined to be failed after two times of failures through secondary verification under the condition that the primary verification is unsuccessful, so that the identification rate and the accuracy of the biological characteristic verification are improved.

Drawings

In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings needed to be used in the description of the embodiments or the prior art will be briefly introduced below, and it is obvious that the drawings in the following description are some embodiments of the present invention, and for those skilled in the art, other drawings can be obtained according to these drawings without creative efforts.

Fig. 1 is a schematic structural diagram of a public transportation pos machine based on face recognition.

Detailed Description

In order to make the objects, technical solutions and advantages of the embodiments of the present invention clearer, the technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are some, but not all, embodiments of the present invention. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.

As shown in fig. 1, the embodiment provides a public transportation pos machine based on face recognition, which includes a vehicle-mounted payment terminal, which communicates with a remote payment control center in real time to confirm payment, wherein the remote payment control center includes a plurality of area verification servers and a head end verification server; the vehicle-mounted payment terminal comprises payment acquisition equipment, a main control unit and payment prompt equipment;

the regional verification server is used for carrying out real-time communication with the vehicle-mounted payment terminal within a given communication distance, analyzing the passenger payment data packet which is uploaded by the main control unit and is encrypted and packaged, and verifying the identity information of the passenger; if the verification is successful, the passenger binding account is deducted through a deduction module; if the verification fails, the passenger payment data packet is sent to a main verification server for verification; when the verification server of the main terminal returns verification success information, the passenger binding account is deducted through a deduction module, otherwise, the payment failure is judged; the regional verification server sends a payment verification result to the main control unit;

the system comprises a plurality of regional verification servers and a plurality of regional verification servers, wherein the regional verification servers are distributed in each bus route region of a city and comprise a payment verification system, a biological characteristic verification system, a user account database and a biological characteristic database. The user logs in a bus service system in advance before taking a bus, and the bus service system is connected with the area verification server. The user needs to input personal basic information and personal bank card information, and binds the bank card recharge amount, and the information is stored in the user account database. Then inputting personal biological characteristic information, wherein the biological characteristic information comprises face information and fingerprint information, and can also input information such as iris, voiceprint and the like, and the personal biological characteristic information is stored in a biological characteristic database.

The main terminal verification server is used for decrypting the passenger payment data packet by using the server identity verification code corresponding to the area verification server and then carrying out secondary identity verification, if the passenger payment data packet passes the verification, the verification success information is sent to the area verification server, and the payment information returned by the area verification server is classified and stored; otherwise, sending verification failure information to the regional verification server;

the main terminal verification server also comprises a payment verification system, a biological characteristic verification system, a user account database and a biological characteristic database. But the data in the biological characteristic database in the main terminal verification server is based on the biological characteristic data of the public security system, and the reliability and the recognition degree of the data are higher compared with those of the biological characteristic data in the regional verification server.

The payment acquisition equipment is used for acquiring passenger payment information in a biometric identification payment acquisition mode and transmitting the passenger payment information to the main control unit;

the main control unit has the first important function that when the vehicle-mounted payment terminal is started, vehicle-mounted identity identification information is sent to the main terminal verification server, and after the vehicle-mounted identity is successfully verified, a preset vehicle-mounted terminal shift list is called to determine the main terminal verification server of a vehicle-mounted terminal circuit path and inform the main terminal verification server of configuring a payment deduction operation environment for the vehicle-mounted payment terminal; the second function is to encrypt and package passenger payment information into passenger payment data packets, send the passenger payment data packets to the regional verification server, receive payment verification results and send payment prompting devices.

And the payment prompting device is used for carrying out synchronous voice prompting according to the payment verification result sent by the main control unit. The payment prompt can display the payment result only through the display screen, and can also add voice prompt.

In this embodiment, the payment collection device includes a first payment collection device and a second payment collection device;

the first payment acquisition equipment is used for acquiring passenger payment information in an acquisition mode of automatic coin feeding payment, card swiping payment and code scanning payment;

the second payment acquisition equipment is used for acquiring passenger payment information in a biometric identification payment acquisition mode; biometric payments include fingerprint payments and face payments. The second payment collection equipment, including face identification ware, fingerprint identification ware, two kinds at least in the iris recognizer, the voiceprint recognizer, adopt dual authentication's purpose, because some face identification equipment, the risk that B is discerned as A probably appears when facing masses face, the benefit of dual authentication is when reducing the risk, suitably reduces the equipment cost to face identification equipment's precision requirement.

In the embodiment, a biological feature recognition combination of a face recognizer and a fingerprint recognizer is adopted, after a passenger gets on a vehicle, the passenger looks at the face recognizer from the front, the face recognizer recognizes the face feature information of the first biological feature information, and the acquired face information is used for matching with the face feature information of the user stored in the biological feature server to obtain a matching degree result 1. The passenger inputs fingerprint information through the fingerprint recognizer, the fingerprint recognizer recognizes the fingerprint characteristic information of the second biological characteristic information, the collected fingerprint information is matched with the user fingerprint information stored in the biological characteristic server to obtain a matching degree result 2, and the user account information to which the biological characteristic information of the user belongs is called in the payment server according to the matching degree result to send a payment information confirmation instruction.

In this embodiment, the fee deduction module includes a first fee deduction submodule and a second fee deduction submodule; the first fee deduction submodule is used for automatically deducting fees under the payment fee deduction operating environment that passengers adopt the first payment collection equipment; and the second payment deduction sub-module is used for automatically deducting the fee under the payment deduction operating environment that the passenger adopts the second payment acquisition equipment.

Wherein, the passenger adopts the process of carrying out automatic deduction under the payment deduction operational environment of first collection equipment of paying, includes: identifying whether the payment mode of the passenger belongs to card swiping payment or code scanning payment; if the payment is card swiping payment, determining whether the current passenger bus card information is matched with certain registered information in the fee deduction list or not based on a preset fee deduction list, and automatically deducting the fee in a background mode if the current passenger bus card information is matched with the certain registered information in the fee deduction list; if the payment belongs to code scanning payment, starting a correlation program to communicate with each large payment platform, determining whether code scanning information provided by a user is matched with information in a user list of any payment platform, and automatically deducting the fee if the code scanning information provided by the user is matched with the information in the user list of any payment platform;

the passenger adopts the process of carrying out automatic deduction under the payment deduction operational environment of second payment collection equipment, includes: fingerprint identification payment and face identification payment information of passengers are collected at the same time, and a user identity identification information data packet is generated based on the fingerprint identification payment and the face identification payment information; respectively checking whether the fingerprint information and the face information are legal users of equipment authentication; if so, determining that the user information is correct and authorizing to carry out payment settlement; otherwise, prompting that the verification fails and the subsequent payment settlement can not be continued, wherein the settlement mode adopts a digital RMB mode.

Wherein, the process of verifying whether the fingerprint information and the face information are legal users of the equipment authentication comprises the following steps: communicating with the area verification server, determining whether the currently uploaded fingerprint information can be found in the fingerprint information database, and if so, determining that the verification is passed;

judging whether the currently uploaded fingerprint information can be found in a fingerprint information database through an equation (1);

where o is the currently uploaded fingerprint information, p is the fingerprint in the fingerprint information database, V_mRepresenting confidence, V, of the currently uploaded fingerprint information features_nRepresenting confidence of fingerprint features in fingerprint information database, and value range [0, 1%]，l_n(. indicates the features extracted using the twin network trained with contrast loss, f_oDenotes de-noising the fingerprint information,representing the third derivative of the outline, and o ', p' representing the fingerprint information after binarization; fa represents the maximum similarity between the currently uploaded fingerprint and the fingerprint in the fingerprint information database, and if the similarity is greater than a threshold value, the currently uploaded fingerprint information can be found in the fingerprint information database;

communicating with a regional verification server, determining whether the currently uploaded face information can be found in a face information database, and if so, determining that the verification is passed;

judging whether the uploaded face information can be found in a face information database or not through the formula (2);

where r is the currently uploaded face information, b is the face in the face information database, V_cRepresenting the confidence, V, of the currently uploaded facial information features_dRepresenting the confidence of the face features in the face information database, and the value range [0,1 ]]，l_d(. indicates the features extracted using the twin network trained with contrast loss, f_rThe method comprises the following steps that () represents that five-sense organ features are extracted by using a convolution network trained by cross entropy, and r ', b' represents serialized face information; rl represents the maximum similarity between the currently uploaded face and the face in the face information database, and if the similarity is greater than a threshold value, the currently uploaded face information can be found in the face information database.

In this embodiment, the process of encrypting and packaging the second passenger payment data packet includes: encrypting the second payment information, the time when uploading and the position information into encrypted information of a fixed number of bits based on a first encryption algorithm; encrypting the vehicle-mounted identity recognition information into encrypted information of a fixed number of bits based on a second encryption algorithm; the two pieces of encrypted information form a complete information; the first encryption algorithm has a higher security level than the second encryption algorithm; a decryption algorithm of the first encryption algorithm and a decryption algorithm of the second encryption algorithm are built in the corresponding area verification server; and configuring a second encryption algorithm or a third encryption algorithm to encrypt the area authentication service identity authentication code.

In this embodiment, the user identification information data packet includes: fingerprint information, face information, and user information-temporary id; after the fingerprint information and the face information are verified to be legal users of equipment authentication, determining that the user information-temporary id is user authorized information and authorizing to carry out payment settlement; otherwise, prompting that the verification fails and the subsequent payment settlement can not be continued.

The method for determining the temporary id as the user information-temporary id is authorized information of the user and authorizing payment settlement comprises the following steps: replacing the user information-temporary id with user authorized information, wherein the user authorized information is verification information generated after fingerprint information and face information are combined and encrypted; and searching whether the information matched with the verification information exists in the authorization information database, and determining that the payment settlement can be authorized when the matching degree is consistent.

In this embodiment, the money box of the first payment collection device is provided with an image collector, which is used for identifying the face value of automatic coin feeding and recording the coin feeding amount at each time, so as to carry out amount statistics subsequently.

In this embodiment, the first payment collection device is further provided with an alarm prompter, and when the coin amount is smaller than the specified minimum amount, the alarm prompter gives an alarm to prevent some non-civilized passengers from escaping the ticket or paying the bus without the specified coin amount.

Finally, it should be noted that: the above embodiments are only used to illustrate the technical solution of the present invention, and not to limit the same; while the invention has been described in detail and with reference to the foregoing embodiments, it will be understood by those skilled in the art that: the technical solutions described in the foregoing embodiments may still be modified, or some or all of the technical features may be equivalently replaced; and the modifications or the substitutions do not make the essence of the corresponding technical solutions depart from the scope of the technical solutions of the embodiments of the present invention.