阅读说明：本技术 一种用于封样送检的取样系统 (Sampling system for sealed sample submission ) 是由 朱富云 李学均 唐玉婷 曹岑 朱卫 徐冰 陈金华 戴相龙 曹新 蒋勇 王晓鹏 于 2020-07-28 设计创作，主要内容包括：本发明提供了一种用于封样送检的取样系统,该用于封样送检的取样系统通过与样品相关的图像数据和/或射频信号数据来确定取样工学中针对样品对象的取样顺序参数和/或取样动作参数,并根据该取样顺序参数和/或该取样动作参数,对每一个样品对象进行适应性的取样操作,这样能够保证在封样送检过程中的取样操作高效地针对相应的样品对象进行快速地和准确地取样,从而确保封样送检的精确性和安全性。(The invention provides a sampling system for seal sample submission, which determines sampling sequence parameters and/or sampling action parameters aiming at sample objects in sampling engineering through image data and/or radio frequency signal data related to samples, and carries out adaptive sampling operation on each sample object according to the sampling sequence parameters and/or the sampling action parameters, so that the sampling operation in the seal sample submission process can be ensured to efficiently and accurately sample the corresponding sample object, and the accuracy and the safety of the seal sample submission are ensured.)

1. A sampling system for seal sample submission, comprising: the sampling system for seal sample submission comprises a sample object characteristic information determining module, a sample object state information determining module, a sample object sampling parameter determining module and a sample object sampling executing module; wherein the content of the first and second substances,

the sample object characteristic information determining module is used for determining image characteristic information and/or radio frequency characteristic information of each sample object according to the image data and/or radio frequency signal data of all sample objects corresponding to the sealed sample submission;

the sample object state information determining module is used for determining complete state information and/or layout state information corresponding to each sample object according to the image characteristic information and/or the radio frequency characteristic information;

the sample object sampling parameter determining module is used for determining a sampling sequence parameter and/or a sampling action parameter corresponding to each sample object according to the complete state information and/or the layout state information;

the sample object sampling execution module is used for carrying out adaptive sampling operation on each sample object according to the sampling sequence parameter and/or the sampling action parameter;

further, the sample object characteristic information determining module comprises a video data obtaining sub-module, an image characteristic information determining sub-module, a radio frequency data obtaining sub-module and a radio frequency characteristic information determining sub-module; wherein the content of the first and second substances,

the video data acquisition sub-module is used for carrying out multi-view visual shooting on all sample objects corresponding to the seal sample submission so as to obtain multi-view video data corresponding to all the sample objects;

the image characteristic information determining submodule is used for extracting multi-view image frames corresponding to the multi-view video data, and calculating parallax characteristic information and/or depth change characteristic information of each sample object to serve as the image characteristic information;

the radio frequency data acquisition sub-module is used for carrying out radio frequency signal detection on all sample objects corresponding to the seal sample submission so as to obtain radio frequency signal transmission data corresponding to all the sample objects;

the radio frequency characteristic information determining submodule is used for extracting radio frequency signal propagation intensity change characteristic information and/or radio frequency signal propagation direction angle change characteristic information corresponding to the radio frequency signal transmission data to serve as the radio frequency characteristic information;

further, the sample object state information determining module comprises a three-dimensional reconstruction image generating submodule, a radio frequency signal representation value generating submodule, a real-time sample form determining submodule, a complete state information calculating submodule and a layout state information calculating submodule; wherein

The three-dimensional reconstruction image generation sub-module is used for carrying out entity reconstruction processing on three-dimensional space on the parallax characteristic information and/or the depth change characteristic information in the image characteristic information so as to generate a three-dimensional reconstruction image on each sample object;

the radio frequency signal characteristic value generation submodule is used for carrying out radio frequency signal propagation mode reproduction processing on the radio frequency signal propagation intensity change characteristic information and/or the radio frequency signal propagation direction angle change characteristic information in the radio frequency characteristic information so as to generate a radio frequency signal characteristic value related to each sample object;

the real-time sample form determining submodule is used for determining the real-time sample entity form and the real-time sample six-degree-of-freedom pose form of each sample object according to the three-dimensional reconstruction image and the radio frequency signal representation value;

the complete state information calculation submodule is used for calculating the form difference between the real-time sample entity form and the preset standard sample entity form so as to obtain the complete state information;

the layout state information calculation submodule is used for calculating the form difference between the real-time sample six-degree-of-freedom pose form and the preset standard sample six-degree-of-freedom pose form so as to obtain the layout state information;

the sampling system for the seal sample submission comprises the following steps:

step S1, acquiring image data and/or radio frequency signal data of all sample objects corresponding to the seal sample submission, and determining image characteristic information and/or radio frequency characteristic information of each sample object;

step S2, according to the image characteristic information and/or the radio frequency characteristic information, determining the complete state information and/or the layout state information corresponding to each sample object;

step S3, determining sampling sequence parameters and/or sampling action parameters corresponding to each sample object according to the complete state information and/or the layout state information;

step S4, according to the sampling sequence parameter and/or the sampling action parameter, carrying out adaptive sampling operation on each sample object;

in step S2, determining the complete state information and/or the layout state information corresponding to each sample object according to the image feature information and/or the radio frequency feature information specifically includes:

step S201, carrying out entity reconstruction processing about three-dimensional space on the parallax characteristic information and/or depth change characteristic information in the image characteristic information so as to generate a three-dimensional reconstruction image about each sample object;

step S202, radio frequency signal propagation mode reproduction processing is carried out on the radio frequency signal propagation intensity change characteristic information and/or the radio frequency signal propagation direction angle change characteristic information in the radio frequency characteristic information, and therefore a radio frequency signal characterization value related to each sample object is generated;

step S203, determining the real-time sample entity form and the real-time sample six-degree-of-freedom pose form of each sample object according to the three-dimensional reconstruction image and the radio frequency signal representation value;

step S204, calculating the form difference between the real-time sample entity form and a preset standard sample entity form so as to obtain the complete state information;

and S205, calculating the form difference between the real-time sample six-degree-of-freedom pose form and the preset standard sample six-degree-of-freedom pose form so as to obtain the layout state information.

2. The sampling system for block sample submission of claim 1, wherein:

in step S1, image data and/or radio frequency signal data of all sample objects corresponding to the seal sample submission are obtained, so as to determine that the image characteristic information and/or radio frequency characteristic information for each sample object specifically includes,

step S101, performing multi-view visual shooting on all sample objects corresponding to the seal sample submission so as to obtain multi-view video data corresponding to all the sample objects;

step S102, extracting multi-view image frames corresponding to the multi-view video data, and calculating parallax characteristic information and/or depth change characteristic information of each sample object to serve as the image characteristic information;

step S103, performing radio frequency signal detection on all sample objects corresponding to the seal sample submission so as to obtain radio frequency signal transmission data corresponding to all the sample objects;

step S104, extracting the radio frequency signal transmission data corresponding to the radio frequency signal propagation intensity change characteristic information and/or the radio frequency signal propagation direction angle change characteristic information to be used as the radio frequency characteristic information.

3. The sampling system for block sample submission of claim 1, wherein:

in step S4, the adaptive sampling operation performed on each sample object according to the sampling sequence parameter and/or the sampling motion parameter specifically includes,

step S401, determining the number n of samples corresponding to the sampling operation according to the following formula

In the formula, n is the number of samples corresponding to the sampling operation, epsilon is the difference degree of the preset samples, chi is the statistic under the requirement of the preset confidence level, M is the total number of all samples, w is the preset confidence level, and the sampling sequence parameter is adjusted according to the number n of the samples;

step S402, according to the adjusted sampling sequence parameters, carrying out real-time sampling sequencing adjustment processing on all the sample objects;

step S403, according to the result of the real-time sampling sorting adjustment, performing a sampling operation adapted to the sampling action parameter on the currently targeted sample object.

4. The sampling system for block sample submission of claim 1, wherein: the sample object sampling parameter determining module comprises a sampling operation correlation value calculating operator module, a sampling sequence parameter determining sub-module and a sampling action parameter determining sub-module; wherein the content of the first and second substances,

the sampling operation correlation value calculating operator module is used for calculating a sampling operation confidence value and a sampling operation difficulty value corresponding to each sample object according to the complete state information and/or the layout state information and a preset sample evaluation deep learning neural network model;

the sampling sequence parameter determining submodule is used for carrying out classification and sequencing processing on all the sample objects according to the sampling operation confidence value so as to obtain a sampling sequence parameter corresponding to each sample object;

the sampling action parameter determining submodule is used for carrying out sampling action mode matching processing on all the sample objects according to the sampling operation difficulty value so as to obtain a sampling action parameter corresponding to each sample object;

the sample object sampling execution module comprises a sampling sequencing adjustment processing submodule and a sampling operation execution submodule; wherein the content of the first and second substances,

the sampling sequencing adjustment processing submodule is used for carrying out real-time sampling sequencing adjustment processing on all the sample objects according to the sampling sequence parameters;

and the sampling operation execution sub-module is used for executing the sampling operation which is adaptive to the sampling action parameters on the current targeted sample object according to the real-time sampling sequencing adjustment processing result.

Technical Field

The invention relates to the technical field of seal sample submission, in particular to a sampling method and a sampling system for seal sample submission.

Background

The sample needs to pass through the process step of sampling in the process of seal sample submission, and whether the sampling process step is executed correctly or not can directly influence the performability and safety of subsequent seal sample submission, and the execution requirements of the sampling process steps corresponding to different samples are different, so that the error of seal sample submission can be caused if the error occurs in the sampling of a sample target in the process of sampling. At present, in order to ensure that a sampling process corresponding to the seal sample submission can be correctly executed, a corresponding mark is usually added to a sample so as to determine that the sampling process can perform sampling operation on the correct sample. It can be seen that the sampling of the seal sample submission in the prior art cannot perform the corresponding sampling operation on the sample object quickly and accurately.

Disclosure of Invention

Aiming at the defects in the prior art, the invention provides a sampling method and a sampling system for seal sample submission, the sampling method and the system for the seal sample submission acquire the image data and/or the radio frequency signal data of all sample objects corresponding to the seal sample submission, thereby determining image characteristic information and/or radio frequency characteristic information for each sample object, determining complete state information and/or layout state information corresponding to each sample object according to the image characteristic information and/or the radio frequency characteristic information, determining sampling sequence parameters and/or sampling action parameters corresponding to each sample object according to the complete state information and/or the layout state information, according to the sampling sequence parameter and/or the sampling action parameter, carrying out adaptive sampling operation on each sample object; therefore, the sampling method and the sampling system for the seal sample submission determine the sampling sequence parameter and/or the sampling action parameter aiming at the sample object in the sampling engineering process through the image data and/or the radio frequency signal data related to the sample, and carry out the adaptive sampling operation on each sample object according to the sampling sequence parameter and/or the sampling action parameter, so that the sampling operation in the seal sample submission process can be ensured to efficiently and accurately sample the corresponding sample object, and the accuracy and the safety of the seal sample submission are ensured.

The invention provides a sampling method for seal sample submission, which is characterized by comprising the following steps:

step S1, acquiring image data and/or radio frequency signal data of all sample objects corresponding to the seal sample submission, and determining image characteristic information and/or radio frequency characteristic information of each sample object;

step S2, according to the image characteristic information and/or the radio frequency characteristic information, determining the complete state information and/or the layout state information corresponding to each sample object;

step S3, determining sampling sequence parameters and/or sampling action parameters corresponding to each sample object according to the complete state information and/or the layout state information;

step S4, according to the sampling sequence parameter and/or the sampling action parameter, carrying out adaptive sampling operation on each sample object;

further, in the step S1, image data and/or radio frequency signal data of all sample objects corresponding to the seal sample submission are obtained, so as to determine that the image characteristic information and/or the radio frequency characteristic information for each sample object specifically includes,

step S101, performing multi-view visual shooting on all sample objects corresponding to the seal sample submission so as to obtain multi-view video data corresponding to all the sample objects;

step S102, extracting multi-view image frames corresponding to the multi-view video data, and calculating parallax characteristic information and/or depth change characteristic information of each sample object to serve as the image characteristic information;

step S103, performing radio frequency signal detection on all sample objects corresponding to the seal sample submission so as to obtain radio frequency signal transmission data corresponding to all the sample objects;

step S104, extracting radio frequency signal propagation strength change characteristic information and/or radio frequency signal propagation direction angle change characteristic information corresponding to the radio frequency signal transmission data to serve as the radio frequency characteristic information;

further, in the step S2, the determining the complete status information and/or the layout status information corresponding to each sample object according to the image characteristic information and/or the radio frequency characteristic information specifically includes,

step S201, carrying out entity reconstruction processing about three-dimensional space on the parallax characteristic information and/or depth change characteristic information in the image characteristic information so as to generate a three-dimensional reconstruction image about each sample object;

step S202, radio frequency signal propagation mode reproduction processing is carried out on the radio frequency signal propagation intensity change characteristic information and/or the radio frequency signal propagation direction angle change characteristic information in the radio frequency characteristic information, and therefore a radio frequency signal characterization value related to each sample object is generated;

step S203, determining the real-time sample entity form and the real-time sample six-degree-of-freedom pose form of each sample object according to the three-dimensional reconstruction image and the radio frequency signal representation value;

step S204, calculating the form difference between the real-time sample entity form and a preset standard sample entity form so as to obtain the complete state information;

step S205, calculating the form difference between the real-time sample six-degree-of-freedom pose form and the preset standard sample six-degree-of-freedom pose form so as to obtain the layout state information;

further, in the step S3, the determining the sampling sequence and/or the sampling action parameters corresponding to each sample object according to the complete status information and/or the layout status information specifically includes,

step S301, calculating a sampling operation confidence value and a sampling operation difficulty value corresponding to each sample object according to the complete state information and/or the layout state information and a preset sample evaluation deep learning neural network model;

step S302, according to the sampling operation confidence value, all sample objects are subjected to classification and sequencing processing, so that a sampling sequence parameter corresponding to each sample object is obtained;

step S303, according to the sampling operation difficulty value, sampling action pattern matching processing is carried out on all the sample objects, so as to obtain sampling action parameters corresponding to each sample object, which is specifically,

A. calculating the difficulty value of sampling the sample according to the following formula

In the above formula, σ is the sample-taking difficulty value, n_zFor the number of steps included in the corresponding z-th process step, A_iFor the difficulty factor, δ, corresponding to the ith step_iD is the number of process steps contained in the sample sampling;

B. determining a matching sampling motion pattern according to the following formula

In the above-mentioned formula,the method comprises the following steps that a sampling action mode is adopted, S is the sampling action mode which is simple to operate, SS is the sampling action mode which is general to operate, SSS is the sampling action mode which is difficult to operate, and a and b are preset values;

C. calculating the corresponding sampling motion parameter according to the following formula

In the above formula, w is the corresponding sampling motion parameter,in the sampling operation mode, d is the number of process steps included in the sample sampling, and is the difficulty value of the z-th process step, and z is 1, 2, … and d;

further, in the step S4, the adaptively sampling operation performed on each sample object according to the sampling sequence parameter and/or the sampling action parameter specifically includes,

step S401, determining the number n of samples corresponding to the sampling operation according to the following formula

In the formula, n is the number of samples corresponding to the sampling operation, epsilon is the difference degree of the preset samples, chi is the statistic under the requirement of the preset confidence level, M is the total number of all samples, w is the preset confidence level, and the sampling sequence parameter is adjusted according to the number n of the samples;

step S402, according to the adjusted sampling sequence parameters, carrying out real-time sampling sequencing adjustment processing on all the sample objects;

step S403, according to the result of the real-time sampling sorting adjustment, performing a sampling operation adapted to the sampling action parameter on the currently targeted sample object.

The invention also provides a sampling system for seal sample submission, which is characterized in that:

the sampling system for seal sample submission comprises a sample object characteristic information determining module, a sample object state information determining module, a sample object sampling parameter determining module and a sample object sampling executing module; wherein the content of the first and second substances,

the sample object characteristic information determining module is used for determining image characteristic information and/or radio frequency characteristic information of each sample object according to the image data and/or radio frequency signal data of all sample objects corresponding to the sealed sample submission;

the sample object state information determining module is used for determining complete state information and/or layout state information corresponding to each sample object according to the image characteristic information and/or the radio frequency characteristic information;

the sample object sampling parameter determining module is used for determining a sampling sequence parameter and/or a sampling action parameter corresponding to each sample object according to the complete state information and/or the layout state information;

the sample object sampling execution module is used for carrying out adaptive sampling operation on each sample object according to the sampling sequence parameter and/or the sampling action parameter;

further, the sample object characteristic information determining module comprises a video data obtaining sub-module, an image characteristic information determining sub-module, a radio frequency data obtaining sub-module and a radio frequency characteristic information determining sub-module; wherein the content of the first and second substances,

the video data acquisition sub-module is used for carrying out multi-view visual shooting on all sample objects corresponding to the seal sample submission so as to obtain multi-view video data corresponding to all the sample objects;

the image characteristic information determining submodule is used for extracting multi-view image frames corresponding to the multi-view video data, and calculating parallax characteristic information and/or depth change characteristic information of each sample object to serve as the image characteristic information;

the radio frequency data acquisition sub-module is used for carrying out radio frequency signal detection on all sample objects corresponding to the seal sample submission so as to obtain radio frequency signal transmission data corresponding to all the sample objects;

the radio frequency characteristic information determining submodule is used for extracting radio frequency signal propagation intensity change characteristic information and/or radio frequency signal propagation direction angle change characteristic information corresponding to the radio frequency signal transmission data to serve as the radio frequency characteristic information;

further, the sample object state information determining module comprises a three-dimensional reconstruction image generating submodule, a radio frequency signal representation value generating submodule, a real-time sample form determining submodule, a complete state information calculating submodule and a layout state information calculating submodule; wherein

The three-dimensional reconstruction image generation sub-module is used for carrying out entity reconstruction processing on three-dimensional space on the parallax characteristic information and/or the depth change characteristic information in the image characteristic information so as to generate a three-dimensional reconstruction image on each sample object;

the radio frequency signal characteristic value generation submodule is used for carrying out radio frequency signal propagation mode reproduction processing on the radio frequency signal propagation intensity change characteristic information and/or the radio frequency signal propagation direction angle change characteristic information in the radio frequency characteristic information so as to generate a radio frequency signal characteristic value related to each sample object;

the real-time sample form determining submodule is used for determining the real-time sample entity form and the real-time sample six-degree-of-freedom pose form of each sample object according to the three-dimensional reconstruction image and the radio frequency signal representation value;

the complete state information calculation submodule is used for calculating the form difference between the real-time sample entity form and the preset standard sample entity form so as to obtain the complete state information;

the layout state information calculation submodule is used for calculating the form difference between the real-time sample six-degree-of-freedom pose form and the preset standard sample six-degree-of-freedom pose form so as to obtain the layout state information;

further, the sample object sampling parameter determining module comprises a sampling operation correlation value calculating sub-module, a sampling sequence parameter determining sub-module and a sampling action parameter determining sub-module; wherein the content of the first and second substances,

the sampling operation correlation value calculating operator module is used for calculating a sampling operation confidence value and a sampling operation difficulty value corresponding to each sample object according to the complete state information and/or the layout state information and a preset sample evaluation deep learning neural network model;

the sampling sequence parameter determining submodule is used for carrying out classification and sequencing processing on all the sample objects according to the sampling operation confidence value so as to obtain a sampling sequence parameter corresponding to each sample object;

the sampling action parameter determining submodule is used for carrying out sampling action mode matching processing on all the sample objects according to the sampling operation difficulty value so as to obtain a sampling action parameter corresponding to each sample object;

further, the sample object sampling execution module comprises a sampling sequencing adjustment processing submodule and a sampling operation execution submodule; wherein the content of the first and second substances,

the sampling sequencing adjustment processing submodule is used for carrying out real-time sampling sequencing adjustment processing on all the sample objects according to the sampling sequence parameters;

and the sampling operation execution sub-module is used for executing the sampling operation which is adaptive to the sampling action parameters on the current targeted sample object according to the real-time sampling sequencing adjustment processing result.

Compared with the prior art, the sampling method and the sampling system for seal sample submission determine image characteristic information and/or radio frequency characteristic information of each sample object by acquiring image data and/or radio frequency signal data of all sample objects corresponding to the seal sample submission, determine complete state information and/or layout state information corresponding to each sample object according to the image characteristic information and/or the radio frequency characteristic information, determine sampling sequence parameters and/or sampling action parameters corresponding to each sample object according to the complete state information and/or the layout state information, and perform adaptive sampling operation on each sample object according to the sampling sequence parameters and/or the sampling action parameters; therefore, the sampling method and the sampling system for the seal sample submission determine the sampling sequence parameter and/or the sampling action parameter aiming at the sample object in the sampling engineering process through the image data and/or the radio frequency signal data related to the sample, and carry out the adaptive sampling operation on each sample object according to the sampling sequence parameter and/or the sampling action parameter, so that the sampling operation in the seal sample submission process can be ensured to efficiently and accurately sample the corresponding sample object, and the accuracy and the safety of the seal sample submission are ensured.

Additional features and advantages of the invention will be set forth in the description which follows, and in part will be obvious from the description, or may be learned by practice of the invention. The objectives and other advantages of the invention will be realized and attained by the structure particularly pointed out in the written description and claims hereof as well as the appended drawings.

The technical solution of the present invention is further described in detail by the accompanying drawings and embodiments.

Drawings

In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings used in the description of the embodiments or the prior art will be briefly described below, it is obvious that the drawings in the following description are only some embodiments of the present invention, and for those skilled in the art, other drawings can be obtained according to the drawings without creative efforts.

Fig. 1 is a schematic flow chart of a sampling method for seal sample inspection according to the present invention.

Fig. 2 is a schematic structural diagram of a sampling system for seal sample submission according to the present invention.

Detailed Description

The technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are only a part of the embodiments of the present invention, and not all of the embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.

Fig. 1 is a schematic flow chart of a sampling method for seal sample submission according to an embodiment of the present invention. The sampling method for seal sample submission comprises the following steps:

step S1, acquiring image data and/or radio frequency signal data of all sample objects corresponding to the seal sample submission, and determining image characteristic information and/or radio frequency characteristic information of each sample object;

step S2, according to the image characteristic information and/or the radio frequency characteristic information, determining the complete state information and/or the layout state information corresponding to each sample object;

step S3, according to the complete state information and/or the layout state information, determining the sampling sequence parameter and/or the sampling action parameter corresponding to each sample object;

in step S4, an adaptive sampling operation is performed on each sample object according to the sampling sequence parameter and/or the sampling operation parameter.

Preferably, in step S1, image data and/or radio frequency signal data of all sample objects corresponding to the seal sample submission are acquired, so as to determine that the image characteristic information and/or the radio frequency characteristic information for each sample object specifically includes,

step S101, performing multi-view visual shooting on all sample objects corresponding to the seal sample submission so as to obtain multi-view video data corresponding to all the sample objects;

step S102, extracting multi-view image frames corresponding to the multi-view video data, and calculating parallax characteristic information and/or depth change characteristic information of each sample object to serve as the image characteristic information;

step S103, performing radio frequency signal detection on all sample objects corresponding to the seal sample submission so as to obtain radio frequency signal transmission data corresponding to all the sample objects;

step S104, extracting the radio frequency signal transmission data corresponding to the radio frequency signal propagation intensity change characteristic information and/or the radio frequency signal propagation direction angle change characteristic information as the radio frequency characteristic information.

Preferably, in step S2, determining the complete status information and/or the layout status information corresponding to each sample object according to the image characteristic information and/or the radio frequency characteristic information specifically includes,

step S201, carrying out entity reconstruction processing about three-dimensional space on the parallax characteristic information and/or depth change characteristic information in the image characteristic information so as to generate a three-dimensional reconstruction image about each sample object;

step S202, radio frequency signal propagation mode reproduction processing is carried out on the radio frequency signal propagation intensity change characteristic information and/or the radio frequency signal propagation direction angle change characteristic information in the radio frequency characteristic information, and therefore a radio frequency signal characterization value related to each sample object is generated;

step S203, determining the real-time sample entity form and the real-time sample six-degree-of-freedom pose form of each sample object according to the three-dimensional reconstruction image and the radio frequency signal representation value;

step S204, calculating the form difference between the real-time sample entity form and the preset standard sample entity form so as to obtain the complete state information;

and S205, calculating the form difference between the real-time sample six-degree-of-freedom pose form and the preset standard sample six-degree-of-freedom pose form so as to obtain the layout state information.

Preferably, in the step S3, determining the sampling sequence and/or the sampling action parameters corresponding to each sample object according to the complete status information and/or the layout status information specifically includes,

step S301, according to the complete state information and/or the layout state information, and according to a preset sample evaluation deep learning neural network model, calculating a sampling operation confidence value and a sampling operation difficulty value corresponding to each sample object;

step S302, according to the sampling operation confidence value, all sample objects are classified and sorted, so as to obtain a sampling sequence parameter corresponding to each sample object;

step S303, according to the sampling operation difficulty value, sampling action pattern matching processing is performed on all the sample objects, so as to obtain a sampling action parameter corresponding to each sample object, which is specifically,

A. calculating the difficulty value of sampling the sample according to the following formula

In the above formula, σ is the difficulty value of the sample sampling, n_zFor the number of steps included in the corresponding z-th process step, A_iFor the difficulty factor, δ, corresponding to the ith step_iD is the number of process steps contained in the sample sampling;

B. determining a matching sampling motion pattern according to the following formula

In the above-mentioned formula,for the sampling action mode, S is simple in operationThe SS is a general sampling action mode, the SSS is a sampling action mode which is difficult to operate, and a and b are preset values;

C. calculating the corresponding sampling motion parameter according to the following formula

In the above formula, w is the corresponding sampling motion parameter,in the sampling operation mode, d is the number of process steps included in the sample sampling, and is the difficulty value of the z-th process step, and z is 1, 2, … and d;

through the process, the difficulty level of the sampling operation of the sample can be determined, the influence of the sampling step number and the detailed rule requirement on the difficulty is considered when the sampling difficulty of the sample is calculated, and meanwhile, the difficulty level can be used as a basis for the subsequent sampling sequence arrangement.

Preferably, in the step S4, the adaptively sampling operation performed on each sample object according to the sampling sequence parameter and/or the sampling action parameter specifically includes,

step S401, determining the number n of samples corresponding to the sampling operation according to the following formula

In the formula, n is the number of samples corresponding to the sampling operation, epsilon is the difference degree of the preset samples, chi is the statistic under the requirement of the preset confidence level, M is the total number of all samples, w is the preset confidence level, and the sampling sequence parameter is adjusted according to the number n of the samples;

step S402, according to the adjusted sampling sequence parameter, real-time sampling sequence adjustment processing is carried out on all the sample objects;

step S403, according to the result of the real-time sampling sequence adjustment process, performing a sampling operation adapted to the sampling operation parameter on the currently targeted sample object.

According to the technical scheme, adaptive sampling operation is carried out on each sample object according to the sampling sequence parameter and/or the sampling action parameter, the number of samples corresponding to the sampling operation is firstly determined, then real-time sampling sequencing adjustment processing is carried out on all the sample objects, and finally the sampling operation adaptive to the sampling action parameter is executed on the current targeted sample object. In the above scheme, firstly, the number of samples corresponding to the sampling operation is determined, so that the operation amount can be reduced, and the characteristics of the samples can also be obtained by operating the number of samples corresponding to the sampling operation.

Fig. 2 is a schematic structural diagram of a sampling system for seal sample submission according to an embodiment of the present invention. The sampling system for seal sample submission comprises a sample object characteristic information determining module, a sample object state information determining module, a sample object sampling parameter determining module and a sample object sampling executing module; wherein the content of the first and second substances,

the sample object characteristic information determining module is used for determining image characteristic information and/or radio frequency characteristic information of each sample object according to the image data and/or radio frequency signal data of all sample objects corresponding to the sealed sample submission;

the sample object state information determining module is used for determining complete state information and/or layout state information corresponding to each sample object according to the image characteristic information and/or the radio frequency characteristic information;

the sample object sampling parameter determining module is used for determining a sampling sequence parameter and/or a sampling action parameter corresponding to each sample object according to the complete state information and/or the layout state information;

the sample object sampling execution module is used for carrying out adaptive sampling operation on each sample object according to the sampling sequence parameter and/or the sampling action parameter.

Preferably, the sample object characteristic information determining module comprises a video data obtaining sub-module, an image characteristic information determining sub-module, a radio frequency data obtaining sub-module and a radio frequency characteristic information determining sub-module; wherein the content of the first and second substances,

the video data acquisition sub-module is used for carrying out multi-view visual shooting on all sample objects corresponding to the seal sample submission so as to obtain multi-view video data corresponding to all the sample objects;

the image characteristic information determining submodule is used for extracting a multi-view image frame corresponding to the multi-view video data, and calculating parallax characteristic information and/or depth change characteristic information of each sample object to serve as the image characteristic information;

the radio frequency data acquisition sub-module is used for carrying out radio frequency signal detection on all sample objects corresponding to the seal sample submission so as to obtain radio frequency signal transmission data corresponding to all the sample objects;

the radio frequency characteristic information determining submodule is used for extracting radio frequency signal propagation strength change characteristic information and/or radio frequency signal propagation direction angle change characteristic information corresponding to the radio frequency signal transmission data to serve as the radio frequency characteristic information.

Preferably, the sample object state information determining module comprises a three-dimensional reconstruction image generating submodule, a radio frequency signal representation value generating submodule, a real-time sample form determining submodule, a complete state information calculating submodule and a layout state information calculating submodule; wherein

The three-dimensional reconstruction image generation sub-module is used for carrying out entity reconstruction processing on three-dimensional space on the parallax characteristic information and/or the depth change characteristic information in the image characteristic information so as to generate a three-dimensional reconstruction image on each sample object;

the radio frequency signal characteristic value generation submodule is used for carrying out radio frequency signal propagation mode reproduction processing on the radio frequency signal propagation intensity change characteristic information and/or the radio frequency signal propagation direction angle change characteristic information in the radio frequency characteristic information so as to generate a radio frequency signal characteristic value related to each sample object;

the real-time sample form determining submodule is used for determining the real-time sample entity form and the real-time sample six-degree-of-freedom pose form of each sample object according to the three-dimensional reconstruction image and the radio frequency signal representation value;

the complete state information calculation submodule is used for calculating the form difference between the real-time sample entity form and the preset standard sample entity form so as to obtain the complete state information;

the layout state information calculation submodule is used for calculating the form difference between the real-time sample six-degree-of-freedom pose form and the preset standard sample six-degree-of-freedom pose form so as to obtain the layout state information.

Preferably, the sample object sampling parameter determining module comprises a sampling operation correlation value calculating sub-module, a sampling sequence parameter determining sub-module and a sampling action parameter determining sub-module; wherein the content of the first and second substances,

the sampling operation correlation value calculation operator module is used for calculating a sampling operation confidence value and a sampling operation difficulty value corresponding to each sample object according to the complete state information and/or the layout state information and a preset sample evaluation deep learning neural network model;

the sampling sequence parameter determining submodule is used for carrying out classification and sequencing processing on all the sample objects according to the sampling operation confidence value so as to obtain a sampling sequence parameter corresponding to each sample object;

the sampling action parameter determining submodule is used for carrying out sampling action mode matching processing on all the sample objects according to the sampling operation difficulty value so as to obtain the sampling action parameter corresponding to each sample object.

Preferably, the sample object sampling execution module comprises a sampling sequence adjustment processing submodule and a sampling operation execution submodule; wherein the content of the first and second substances,

the sampling sequencing adjustment processing submodule is used for carrying out real-time sampling sequencing adjustment processing on all the sample objects according to the sampling sequence parameter;

the sampling operation execution sub-module is used for executing the sampling operation which is adaptive to the sampling action parameter on the current aimed sample object according to the real-time sampling sequencing adjustment processing result.

As can be seen from the above description, the sampling method and system for seal sample submission determine the sampling sequence parameter and/or the sampling action parameter for the sample object in the sampling engineering through the image data and/or the radio frequency signal data related to the sample, and perform the adaptive sampling operation on each sample object according to the sampling sequence parameter and/or the sampling action parameter, so as to ensure that the sampling operation in the seal sample submission process efficiently samples the corresponding sample object quickly and accurately, thereby ensuring the accuracy and safety of the seal sample submission.

It will be apparent to those skilled in the art that various changes and modifications may be made in the present invention without departing from the spirit and scope of the invention. Thus, if such modifications and variations of the present invention fall within the scope of the claims of the present invention and their equivalents, the present invention is also intended to include such modifications and variations.