Commodity settlement method, server, electronic device, medium, and terminal

文档序号：1420003 发布日期：2020-03-13 浏览：8次中文

阅读说明：本技术 商品结算方法、服务器、电子设备、介质和终端 (Commodity settlement method, server, electronic device, medium, and terminal ) 是由刘永凯金炫熊自成黄光远侯冬梅于 2018-09-06 设计创作，主要内容包括：本说明书提供商品结算方法、服务器、电子设备、介质和终端。所述方法可以包括：接收结算终端提供的图像和重量；对所述图像进行识别,得出所述图像所表示的商品的商品信息；根据所述商品信息和所述重量生成结算信息；将所述结算信息发送给所述结算终端,以用于所述结算终端进行结算。给消费者带来了便利。(The present specification provides a commodity settlement method, a server, an electronic device, a medium, and a terminal. The method may include: receiving an image and a weight provided by a settlement terminal; identifying the image to obtain commodity information of a commodity represented by the image; generating settlement information according to the commodity information and the weight; and sending the settlement information to the settlement terminal for settlement by the settlement terminal. Bringing convenience to consumers.)

1. A method for settling a commodity, the method comprising:

receiving an image and a weight provided by a settlement terminal;

identifying the image to obtain commodity information of a commodity represented by the image;

generating settlement information according to the commodity information and the weight;

and sending the settlement information to the settlement terminal for settlement by the settlement terminal.

2. The method according to claim 1, wherein the step of recognizing the image and obtaining commodity information of a commodity represented by the image comprises:

analyzing the constituent elements of the commodity in the image; wherein the constituent elements represent specified characteristics of the commodity;

determining the commodity identification of the commodity according to the constituent elements;

accordingly, the step of generating settlement information based on the commodity and the weight includes:

and determining settlement information according to the unit price determined by the commodity identification and the weight.

3. The method according to claim 1, wherein the step of identifying the image to obtain the commodity represented by the image comprises:

extracting characteristic values of a plurality of specified dimensions in the image;

constructing an image feature vector of the image according to the obtained plurality of feature values; wherein the image feature vector is used to characterize the image;

matching the image feature vectors in a feature vector set to obtain target feature vectors, wherein commodities corresponding to the target feature vectors are used as commodities represented by the images; the feature vector set comprises a plurality of feature vectors, and each feature vector corresponds to one commodity information.

4. The method according to claim 1, wherein the step of recognizing the image and obtaining commodity information of a commodity represented by the image comprises:

dividing the image into at least a first region and a second region;

respectively extracting feature values of a plurality of specified dimensions in the first region and the second region;

respectively constructing a first image feature vector of the first region and a second image feature vector of the second region according to the obtained plurality of feature values;

matching the first image feature vector and the second image feature vector in a feature vector set respectively to obtain a first target feature vector corresponding to the first image feature vector and a second target feature vector corresponding to the second image feature vector, wherein at least one of a commodity corresponding to the first target feature vector and a commodity corresponding to the second target feature vector is used as a commodity represented by the image; the feature vector set comprises a plurality of feature vectors, and each feature vector corresponds to one commodity information.

5. The method according to claim 1, wherein the step of identifying the image and obtaining the commodity information of the commodity represented by the image comprises:

dividing the image into a plurality of regions; wherein each region comprises image data of at least a portion of the image;

identifying the plurality of areas to obtain a target commodity information set; the target commodity information set comprises a plurality of commodity information, and each commodity information corresponds to one commodity;

combining the commodity information in the target commodity information set to obtain a plurality of target commodity information subsets;

and comparing the total weight of the commodities represented by the commodity information in the plurality of target commodity information subsets with the received weight respectively, and taking the commodity represented by the target commodity information subset with the total weight closest to the received weight as the commodity represented by the image.

6. The method of claim 1, wherein prior to generating settlement information from the commodity and the weight, the method further comprises:

sending the identified commodity information of the commodity to the settlement terminal for the settlement terminal to display the commodity information;

accordingly, when the confirmation information transmitted from the settlement terminal is received, the settlement information is generated based on the commodity and the weight.

7. The method of claim 1, further comprising:

receiving a settlement request aiming at the settlement information sent by a client;

generating a composition report of the commodity according to the commodity;

sending the component report to the client for presentation by the client.

8. The method of claim 1, further comprising:

acquiring identity information of a client for settling the settlement information; wherein the identity information is used to identify a user using the client;

acquiring body information of the user identified by the identity information;

generating a dietary health report based on the commodity and the physical information;

sending the dietary health report to the client for presentation by the client.

9. The method of claim 1, further comprising:

acquiring a health plan of a user; wherein the wellness programme is used to constrain the user's behaviour;

and generating a shopping suggestion according to the health plan, the commodity information and the weight.

10. A server, comprising:

the acquisition module is used for receiving the image and the weight provided by the settlement terminal;

the identification module is used for identifying the image to obtain commodity information of the commodity represented by the image;

the information generation module is used for generating settlement information according to the commodity information and the weight;

and the information sending module is used for sending the settlement information to the settlement terminal so as to be used for settlement by the settlement terminal.

11. An electronic device, comprising: a network communication unit and a processor;

the network communication unit receives the image and the weight provided by the settlement terminal; and sending the settlement information generated by the processor to the settlement terminal for settlement by the settlement terminal;

the processor is used for identifying the image to obtain commodity information of the commodity represented by the image; and generating settlement information according to the commodity information.

12. A computer storage medium having computer program instructions stored thereon that when executed implement: receiving an image and a weight provided by a settlement terminal; identifying the image to obtain commodity information of a commodity represented by the image; generating settlement information according to the commodity information and the weight; and sending the settlement information to the settlement terminal for settlement by the settlement terminal.

13. A settlement terminal, comprising:

the weighing part is provided with a loading surface and is used for weighing objects on the loading surface;

a shooting part for shooting the image of the object on the object carrying surface;

a display part electrically connected with the weighing part and the shooting part and used for displaying the weight output by the weighing part and the image; the display part is also used for displaying settlement information of the object placed on the object carrying surface;

a support portion supporting the display portion above the weighing portion;

and the communication part is used for receiving settlement information fed back by the settlement center so as to be used for the display part to display.

14. A settlement terminal, comprising:

the weighing part is provided with a loading surface and is used for weighing objects on the loading surface;

a shooting part for shooting the image of the object on the object carrying surface;

a support portion supporting the display portion above the weighing portion;

and a calculation unit for recognizing the image, obtaining the product indicated by the image, and generating settlement information from the product and the weight.

15. The terminal according to claim 14, wherein the operation unit recognizes the image and obtains product information of a product represented by the image, and includes: analyzing constituent elements of a commodity in the image, wherein the constituent elements represent specified features of the commodity; determining the commodity identification of the commodity according to the constituent elements; and determining settlement information according to the unit price determined by the commodity identification and the weight.

16. The terminal according to claim 14, wherein the operation unit recognizes the image and obtains product information of a product represented by the image, and includes: extracting characteristic values of a plurality of specified dimensions in the image; constructing an image feature vector of the image according to the obtained plurality of feature values, wherein the image feature vector is used for representing the image; and matching the image characteristic vectors in a characteristic vector set to obtain target characteristic vectors, wherein commodities corresponding to the target characteristic vectors are used as commodities represented by the image, the characteristic vector set comprises a plurality of characteristic vectors, and each characteristic vector corresponds to one commodity information.

17. The terminal according to claim 14, wherein the operation unit recognizes the image and obtains product information of a product represented by the image, and includes: dividing the image into at least a first region and a second region; respectively extracting feature values of a plurality of specified dimensions in the first region and the second region; respectively constructing a first image feature vector of the first region and a second image feature vector of the second region according to the obtained plurality of feature values; and respectively matching the first image feature vector and the second image feature vector in a feature vector set to obtain a first target feature vector corresponding to the first image feature vector and a second target feature vector corresponding to the second image feature vector, wherein at least one of a commodity corresponding to the first target feature vector and a commodity corresponding to the second target feature vector is used as a commodity represented by the image, the feature vector set comprises a plurality of feature vectors, and each feature vector corresponds to one commodity information.

18. The terminal according to claim 14, wherein the operation unit recognizes the image and obtains product information of a product represented by the image, and includes: dividing the image into a plurality of regions; wherein each region comprises image data of at least a portion of the image; identifying the plurality of areas to obtain a target commodity information set; the target commodity information set comprises a plurality of commodity information, and each commodity information corresponds to one commodity; combining the commodity information in the target commodity information set to obtain a plurality of target commodity information subsets; and comparing the total weight of the commodities represented by the commodity information in the plurality of target commodity information subsets with the received weight respectively, and taking the commodity represented by the target commodity information subset with the total weight closest to the received weight as the commodity represented by the image.

19. A commodity settlement method applied to a settlement terminal includes:

acquiring an image and weight of a commodity;

identifying the image to obtain commodity information of a commodity represented by the image;

generating settlement information according to the commodity information and the weight;

and displaying the settlement information.

20. The method according to claim 19, wherein the step of recognizing the image and obtaining commodity information of the commodity represented by the image comprises:

analyzing the constituent elements of the commodity in the image; wherein the constituent elements represent specified characteristics of the commodity;

determining the commodity identification of the commodity according to the constituent elements;

accordingly, the step of generating settlement information based on the commodity and the weight includes:

and determining settlement information according to the unit price determined by the commodity identification and the weight.

21. The method according to claim 19, wherein the step of recognizing the image and obtaining commodity information of the commodity represented by the image comprises:

extracting characteristic values of a plurality of specified dimensions in the image;

constructing an image feature vector of the image according to the obtained plurality of feature values; wherein the image feature vector is used to characterize the image;

22. The method according to claim 19, wherein the step of recognizing the image and obtaining commodity information of the commodity represented by the image comprises:

dividing the image into at least a first region and a second region;

respectively extracting feature values of a plurality of specified dimensions in the first region and the second region;

respectively constructing a first image feature vector of the first region and a second image feature vector of the second region according to the obtained plurality of feature values;

23. The method of claim 19, wherein prior to generating settlement information from the commodity and the weight, the method further comprises:

and displaying the identified commodity information of the commodity for the user to confirm.

24. The method according to claim 19, wherein the step of identifying the image and obtaining the commodity information of the commodity represented by the image comprises:

dividing the image into a plurality of regions; wherein each region comprises image data of at least a portion of the image;

combining the commodity information in the target commodity information set to obtain a plurality of target commodity information subsets;

25. A commodity recommendation method is applied to a client side, and comprises the following steps:

acquiring an image and a weight associated with the image;

identifying the image to obtain commodity information of a commodity represented by the image; wherein the weight represents a weight of the item;

acquiring a health plan of a user of the client; wherein the wellness programme is used to constrain the user's behaviour;

generating a shopping recommendation according to the health plan, the commodity information and the weight.

26. A commodity recommendation method is applied to a client side, and comprises the following steps:

acquiring commodity information and weight; wherein the weight represents a weight of the article represented by the article information;

and generating a shopping suggestion according to the health plan of the user of the client, the commodity information and the weight.

Technical Field

The present disclosure relates to the field of computer internet, and in particular, to a method, a server, an electronic device, a medium, and a terminal for commodity settlement.

Background

In the existing shopping settlement scene, a mode of settlement by a salesperson is mostly adopted. For example, a user purchases a plurality of apples, places the assessment in a plastic bag, finds a salesperson in a supermarket to weigh the apples, and finally carries the weighed apples to a cashier for settlement.

In the shopping process, more links need to pay labor, and more inconvenience exists.

Disclosure of Invention

The embodiment of the specification provides a commodity settlement method, a server, an electronic device, a medium and a terminal. The shopping process of the consumer can be facilitated.

An embodiment of the present specification provides a commodity settlement method, including: receiving an image and a weight provided by a settlement terminal; identifying the image to obtain commodity information of a commodity represented by the image; generating settlement information according to the commodity information and the weight; and sending the settlement information to the settlement terminal for settlement by the settlement terminal.

An embodiment of the present specification provides a server, including: the acquisition module is used for receiving the image and the weight provided by the settlement terminal; the identification module is used for identifying the image to obtain commodity information of the commodity represented by the image; the information generation module is used for generating settlement information according to the commodity information and the weight; and the information sending module is used for sending the settlement information to the settlement terminal so as to be used for settlement by the settlement terminal.

An embodiment of the present specification provides an electronic device, including: a network communication unit and a processor; the network communication unit receives the image and the weight provided by the settlement terminal; and sending the settlement information generated by the processor to the settlement terminal for settlement by the settlement terminal; the processor is used for identifying the image to obtain commodity information of the commodity represented by the image; and generating settlement information according to the commodity information.

The present specification embodiments provide a computer storage medium having computer program instructions stored thereon that, when executed, implement: receiving an image and a weight provided by a settlement terminal; identifying the image to obtain commodity information of a commodity represented by the image; generating settlement information according to the commodity information and the weight; and sending the settlement information to the settlement terminal for settlement by the settlement terminal.

An embodiment of the present specification provides a settlement terminal including: the weighing part is provided with a loading surface and is used for weighing objects on the loading surface; a shooting part for shooting the image of the object on the object carrying surface; a display part electrically connected with the weighing part and the shooting part and used for displaying the weight output by the weighing part and the image; the display part is also used for displaying settlement information of the object placed on the object carrying surface; a support portion supporting the display portion above the weighing portion; and the communication part is used for receiving settlement information fed back by the settlement center so as to be used for the display part to display.

An embodiment of the present specification provides a settlement terminal including: the weighing part is provided with a loading surface and is used for weighing objects on the loading surface; a shooting part for shooting the image of the object on the object carrying surface; a display part electrically connected with the weighing part and the shooting part and used for displaying the weight output by the weighing part and the image; the display part is also used for displaying settlement information of the object placed on the object carrying surface; a support portion supporting the display portion above the weighing portion; and a calculation unit for recognizing the image, obtaining the product indicated by the image, and generating settlement information from the product and the weight.

An embodiment of the present specification provides a commodity settlement method applied to a settlement terminal, including: acquiring an image and weight of a commodity; identifying the image to obtain commodity information of a commodity represented by the image; generating settlement information according to the commodity information and the weight; and displaying the settlement information.

An embodiment of the present specification provides a commodity recommendation method, which is applied to a client, and the method includes: acquiring an image and a weight associated with the image; identifying the image to obtain commodity information of a commodity represented by the image; wherein the weight represents a weight of the item; acquiring a health plan of a user of the client; wherein the wellness programme is used to constrain the user's behaviour; generating a shopping recommendation according to the health plan, the commodity information and the weight.

An embodiment of the present specification provides a commodity recommendation method, which is applied to a client, and the method includes: acquiring commodity information and weight; wherein the weight represents a weight of the article represented by the article information; and generating a shopping suggestion according to the health plan of the user of the client, the commodity information and the weight.

The embodiments of the present specification perform settlement based on the image and the weight of the product. Therefore, the system can be applied to occasions without needing a salesman to settle accounts, and the labor is saved. Moreover, after the consumer selects the commodity, the commodity can be placed on a settlement terminal provided with the service of the commodity settlement system, and the settlement terminal can automatically analyze, provide settlement information and correspondingly execute a settlement function, so that convenience is brought to the consumer.

Drawings

The accompanying drawings, which are included to provide a further understanding of embodiments of the specification, are incorporated in and constitute a part of this specification, illustrate embodiments of the specification and together with the description serve to explain the principles of the specification. It is obvious that the drawings in the following description are only some embodiments of the present description, and that for a person skilled in the art, other drawings can be derived from them without inventive exercise. In the drawings:

fig. 1 is a schematic view of a scenario interaction of a commodity settlement system according to an embodiment of the present disclosure;

fig. 2 is a functional block diagram of a commodity settlement system according to an embodiment of the present disclosure;

fig. 3 is a schematic diagram of a settlement terminal provided in an embodiment of the present specification.

Detailed Description

In order to make the technical solutions in the present specification better understood, the technical solutions in the embodiments of the present specification will be clearly and completely described below with reference to the drawings in the embodiments of the present specification, and it is obvious that the described embodiments are only a part of the embodiments of the present specification, but not all embodiments. All other embodiments obtained by a person of ordinary skill in the art without any inventive work based on the embodiments in the present specification shall fall within the protection scope of the present specification.

Referring to fig. 1 and 3, in an example scenario, a consumer has a meal at a self-service restaurant, can select food autonomously, and can settle at a settlement terminal. The settlement terminal may include a weighing part, a photographing part, a display part, a support part, and a communication part (not shown in fig. 3).

In this scenario example, the food selected by the consumer for lunch may include: steaming pumpkin, vegetable salad and a cup of fruit juice. The consumer brings the foods to a settlement terminal for settlement.

In the present scenario example, the consumer places the foods one by one on the loading surface of the weighing section. The weighing part may be provided with a weighing sensor that can output the weight of an object placed on the object bearing surface. Specifically, steamed pumpkins are placed on a carrying surface, and the weight of the pumpkins is 100g, the weight of the vegetable salad is 50g, and the weight of the fruit juice is 80 g.

In this scene example, the image capturing unit captures an image of the commodity placed on the object-carrying surface to obtain a picture of the commodity. And sending the picture to a settlement center through a communication part. The settlement center can identify the commodities in the pictures to obtain commodity information of the commodities. And feeding back the commodity information to a communication part of the settlement terminal, and displaying the commodity information through a display part. Specifically, the image of the steamed pumpkin is taken by the image taking part of the settlement terminal, and then the image is sent to the settlement center through the communication part. The settlement center identifies the pictures to obtain the commodity information of the commodities in the pictures, namely the steamed pumpkin. And feeding back commodity information 'steamed pumpkins' to the settlement terminal. Similarly, the settlement terminal sends the pictures of the vegetable salad and the fruit juice to the settlement center to obtain the corresponding commodity information of the vegetable salad and the fruit juice respectively.

In this scenario, the settlement terminal receives the merchandise information fed back from the settlement center, and displays the merchandise information, the corresponding weight, and the amount of money on the display unit. Specifically, the display unit of the settlement terminal may display three data columns in a list format, where the first column is commodity information, the second column is weight, and the third column is amount.

In this scenario example, the consumer may view the content presented by the presentation. And checks whether there is an error, etc. The consumer can click on the confirmation button of the display page to indicate that the information displayed for the display is correct. Then, the display part of the settlement terminal enters a settlement interface.

In this scenario example, the settlement interface may include a settlement identifier for the client to scan. Specifically, for example, the settlement interface displays a two-dimensional code, and the user scans the two-dimensional code using the client of the payment function to perform settlement. The settlement interface may also be a two-dimensional code indicating the user identity displayed at the client, and a scanning device of the settlement device may scan the two-dimensional code to perform settlement.

In this scenario, when the settlement center receives a settlement request from the client, the identity information of the consumer can be obtained according to the settlement request. Further, the clearing house can read the body information corresponding to the identity information. The physical information may include the age, height, blood pressure, blood lipids, weight, medical history of the consumer, and the like. The clearing house can generate a diet health report according to the physical information of the user and the commodity. The dietary health report can include the composition analysis of the purchased goods and whether the physical health of the consumer is beneficial. For example, consumers have a history of diabetes, and some peanut grains are contained in the purchased "vegetable salad", and the peanut grains are easy to cause the blood sugar to rise rapidly, so that the diabetic patients are contraindicated to eat the vegetable salad. Furthermore, "orange juice" is also a food which is easy to rapidly raise blood sugar, and is also a food which is contraindicated for diabetics.

In this scenario example, the clearing house may send a diet health report to the consumer's client, so for the consumer to review.

Please refer to fig. 2. The embodiment of the specification provides a commodity settlement system. The commodity settlement system comprises an acquisition module, an identification module, an information generation module and a settlement module. The commodity settlement system can realize the commodity settlement method during operation, and the two methods can be explained in contrast, and are not described herein again.

In this embodiment, the acquisition module is used to acquire an image and a weight. Specifically, the acquiring module may be configured to acquire an image and a weight of the commodity. The image may be an image including a commodity. That is, the image may be formed by shooting for the commodity. The weight may be the weight of the item represented in the image. Specifically, for example, one electronic device may be provided with a weighing portion, and a camera is provided above the weighing portion. When monitoring that goods are placed on the weighing part, the camera can shoot images when the electric signal which is output by the weighing part and represents the weight is changed. The camera may be aligned with the weighing portion so that the captured image may include the item being weighed.

In this embodiment, the acquisition module may be actively acquiring the image and the weight. For example, the obtaining module actively reads the output electric signal of the weighing part at intervals, obtains an image shot by the camera, and corresponds the two images. The acquisition module can also obtain image and weight passively, and the portion of weighing can be after the sensing placed commodity, just output the signal of telecommunication that represents commodity weight promptly, and at this moment, the acquisition module receives this signal of telecommunication and reachs the weight of commodity, and the image of the commodity of receiving the camera shooting.

In this embodiment, the recognition module is configured to recognize the image and obtain the product information of the product represented by the image. The recognition module may capture features of a number of specified dimensions for the image to form a characterization vector for the image from the captured features. Thus, the characterization vector can be matched with the commodity vectors in the preset vector set. Each merchandise vector may correspond to a merchandise. In this way, the commodity represented by the commodity vector matching the characterization vector may be associated with the characterization vector. Further, further settlement can be performed in conjunction with the weight. Of course, the above recognition is not limited to the vector matching. The algorithm for the recognition module to recognize the image may include, but is not limited to: genetic algorithms and neural network algorithms, etc. And will not be described in detail herein.

In this embodiment, the article information may include an article identification. The item identification may be used to uniquely identify an item. Specifically, the item identifier may be an item number assigned to each item by the seller. Each category of goods may correspond to a goods number. As such, the merchandise may be identified by a merchandise number. Further, the commodity information may include a commodity name. In this way, the corresponding product can be represented by the name unique to each product. When multiple commodities have duplicate names, the commodities can be distinguished by manufacturers.

The information generating module is used for generating settlement information according to the commodity information and the weight. In the present embodiment, the settlement information may include the name of the commodity to be settled, the weight, the unit price, the total price, and the like. This provides a data basis for further consumer settlement operations.

In this embodiment, the information generating module may perform matching in the product information set according to the identified product information to obtain a product name, a unit price, and the like corresponding to the product information. Specifically, a plurality of data items such as "commodity number", "commodity name", "commodity unit price", and "manufacturer" may be stored in the commodity information set in a corresponding manner. For example, the product information may be "125798", and the product information "125798" may be matched with the product number to obtain a product name corresponding to the matched product number, which is called "tomato super egg", and has a unit price of 30 yuan/500 g. Thus, in combination with the weight obtained, a corresponding total price can be derived. For example, the weight is 150g and the total price is 9 yuan. Of course, the information generation module can also be an interface for providing information input so as to input the unit price of the commodity.

The settlement module is used for providing a settlement function and performing settlement operation aiming at settlement information. Specifically, a payment function of third party payment software or a payment function of internet banking can be provided. Specifically, for example, a payment function of the internet bank, such as payment of money, WeChat payment, or financial payment.

The commodity settlement system provided by the embodiment of the present specification can realize settlement according to the image and the weight of the commodity. Therefore, the system can be applied to occasions without needing a salesman to settle accounts, and the labor is saved. Moreover, after the consumer selects the commodity, the commodity can be placed on a settlement terminal provided with the service of the commodity settlement system, and the settlement terminal can automatically analyze, provide settlement information and correspondingly execute a settlement function, so that convenience is brought to the consumer.

In one embodiment, the recognizing module recognizes the image to obtain the commodity information of the commodity represented by the image, and may include: analyzing constituent elements of a commodity in the image, wherein the constituent elements represent specified features of the commodity; and determining the commodity identification of the commodity according to the constituent elements. Correspondingly, the information generating module may generate settlement information according to the commodity and the weight, and may include: and determining settlement information according to the unit price determined by the commodity identification and the weight.

In the present embodiment, the constituent elements may be features that can characterize the color, shape, and pattern of the commodity in the image. Specifically, for example, the constituent elements may include colors in an image, shapes formed by the colors, ratios between the colors, and the like. By analyzing each constituent element, commodity information of the commodity in the image is obtained. Specifically, for example, the overall shape of the commercial colors in the image, including yellow and green, is circular, and the ratio between the colors may be about 60% yellow and about 40% green. And comparing the structural elements with the commodity description of the existing commodity to obtain the commodity identification of the commodity. Specifically, for example, the description of the article "orange" includes "generally circular, having yellow and green colors, the yellow ratio being about 50% to 70%, and the green ratio being about 30% to 50%". Thus, matching the above-described constituent elements with the description of the article results in the article in the image being an "orange" and the article being identified as "843958".

In the present embodiment, the constituent elements of the image can be analyzed from the perspective of the designated features set in advance. In this way, when specifying the description information of the product, the description can be made with respect to the angle of the above-described specified feature. Therefore, the commodities in the image can be identified conveniently through the constituent elements, and then the commodity identification of the commodities can be obtained.

In one embodiment, the recognizing module recognizes the image to obtain the commodity information of the commodity represented by the image, and may include: extracting characteristic values of a plurality of specified dimensions in the image; constructing an image feature vector of the image according to the obtained plurality of feature values; wherein the image feature vector is used to characterize the image; matching the image feature vectors in a feature vector set to obtain target feature vectors, wherein commodities corresponding to the target feature vectors are used as commodities represented by the images; the feature vector set comprises a plurality of feature vectors, and each feature vector corresponds to one commodity information.

In this embodiment, a plurality of dimensions may be set to perform feature extraction on an image. Specifically, the feature value of the image may be extracted from the perspective of the image pixel. Specifically, for example, the dimension reduction processing may be performed on a pixel matrix constituting the image, and the dimension reduction may be performed in a convolution manner or in a mapping manner. For example, the convolution matrix is used to perform convolution dimension reduction with the pixel matrix of the image, or a plurality of adjacent pixels in the appointed pixel matrix are mapped to a value, and the value represents the plurality of adjacent pixels. Thus, a characteristic value can be obtained through processing of a plurality of levels. In the method, a plurality of convolution matrixes with different dimensions can be set, so that characteristic values of the plurality of dimensions can be obtained.

In the present embodiment, a predetermined number of pixels may be selected from a pixel matrix of an image to generate one eigenvalue. Specifically, for example, one eigenvalue may be derived every 3 × 3 matrix, starting from the upper left corner of the pixel matrix. The eigenvalues may characterize the pixels in the 3 x 3 matrix. In this way, a plurality of eigenvalues can be obtained. In the present embodiment, the obtained plurality of feature values may be arranged to form an image feature vector. As such, the image feature vector may characterize the image.

In the present embodiment, the feature vector set includes a plurality of feature vectors, and one commodity is represented by each feature vector. And matching the image characteristic vector with the characteristic vector in the characteristic vector set to obtain a target characteristic vector. In this way, the product represented by the target feature vector can be regarded as a product corresponding to the image feature vector and can be regarded as a product identified for the image. Specifically, when matching the image feature vector with the feature vector, a matching value can be obtained by vector-to-bit product and summation. When the matching value is greater than a predetermined threshold, the feature vector may be considered to match the image feature vector, and the feature vector may be regarded as a target feature vector. Or respectively obtaining matching values by the image feature vectors and the feature vectors in the feature vector set, and thus, taking the feature vector corresponding to the maximum value in the matching values as the target feature vector.

In this embodiment, the image is represented by the image feature vector, and then the commodity corresponding to the final image feature vector is obtained by matching the image feature vector with the feature vector. Thus, the commodity shown in the image can be accurately identified. Specifically, the feature vector corresponds to the commodity, and a manner of storing the feature vector and the commodity information correspondingly may be adopted. Thus, commodity information corresponding to the image feature vector is obtained. Further, settlement processing and the like may be further performed based on the product information of the product.

In one embodiment, the identifying module may identify the image to obtain the commodity information of the commodity represented by the image, and may include: dividing the image into at least a first region and a second region; respectively extracting feature values of a plurality of specified dimensions in the first region and the second region; respectively constructing a first image feature vector of the first region and a second image feature vector of the second region according to the obtained plurality of feature values; matching the first image feature vector and the second image feature vector in a feature vector set respectively to obtain a first target feature vector corresponding to the first image feature vector and a second target feature vector corresponding to the second image feature vector, wherein at least one of a commodity corresponding to the first target feature vector and a commodity corresponding to the second target feature vector is used as a commodity represented by the image; the feature vector set comprises a plurality of feature vectors, and each feature vector corresponds to one commodity information.

In this embodiment, a plurality of regions may be divided for an image. Therefore, one image feature vector can be generated for each region, and then the target feature vectors can be obtained through matching. Ultimately, it may be achieved that a plurality of goods represented in the identified image are derived.

In the present embodiment, the image is divided into a plurality of regions, and the image may be divided into a plurality of regions by a predetermined number of pixels according to a predetermined rule. Specifically, for example, the pixels of one image are 1024 × 768, and the image may be divided into two regions, 512 × 768 respectively. Of course, the division into two regions is not limited to the average. Of course, it may be divided into 3 or more regions, etc.

In one embodiment, the recognizing module recognizes the image to obtain the commodity information of the commodity represented by the image, and may include: dividing the image into a plurality of regions; wherein each region comprises image data of at least a portion of the image; identifying the plurality of areas to obtain a target commodity information set; the target commodity information set comprises a plurality of commodity information, and each commodity information corresponds to one commodity; combining the commodity information in the target commodity information set to obtain a plurality of target commodity information subsets; and comparing the total weight of the commodities represented by the commodity information in the plurality of target commodity information subsets with the received weight respectively, and taking the commodity represented by the target commodity information subset with the total weight closest to the received weight as the commodity represented by the image.

In the present embodiment, an image is divided into a plurality of regions, and then each region is identified. Further, in the case of identification, the product information that meets a certain condition with respect to the area may be regarded as corresponding to the product information. Therefore, a plurality of commodity information can be correspondingly obtained in each area. Therefore, commodities represented in the image can be comprehensively evaluated, and accuracy is improved.

In the present embodiment, the target product information set is obtained by identifying each region, and the matching method by specifying the feature value of the feature described in the foregoing embodiment may be adopted, or the feature vector matching method may be adopted. Specifically, for example, a constituent element is derived for each area, and a plurality of product identifiers are determined from the constituent elements. That is, the description information of the product including the component may be regarded as corresponding to the area. Thus, the commodity information set can be formed according to the commodity identification. Or obtaining a plurality of feature values of specified dimensions of each region to form a region feature vector corresponding to each region, and further matching the region feature vectors in the feature vector set to obtain a plurality of target feature vectors. The result value obtained by summing the products of the alignment of the regional feature vectors and the feature vectors in the feature vector set can be compared with the specified threshold, and the feature vectors with the result value larger than the specified threshold are all used as the target feature vectors. Each target feature vector may correspond to one item of merchandise information. In this way, the commodity information corresponding to each of the plurality of target feature vectors may form a target commodity information set.

In the present embodiment, the combination of the product information in the target product information set is performed in order to obtain a plurality of products represented in the image more accurately. Specifically, the formation process of the target commodity information set already forms a certain degree of relevance with each area. That is, the article represented by the image data in the area may be the article represented by the article information. In this way, the product information in the target product information set is combined, and the combination in which the total weight of the product indicated by the product information is closest to the acquired weight is selected as the product information of the product obtained by image recognition. Specifically, for example, the acquired image corresponds to a weight of 200 g. The number of the image partitions is 3, and the image partitions are respectively a first area, a second area and a third area. The commodity information obtained by identifying the first area may represent commodities such as 'fried shredded potatoes', 'sour and hot shredded potatoes', 'fried shredded potatoes with green peppers', 'meat-fried cane shoots', and 'egg-fried cane shoots'. The commodity information identified in the second area may represent commodities such as "braised pork with brown sauce", "stewed beef", "braised pork with bean curd and" sirloin with potatoes ". The commodity information obtained by the identification in the third area may represent commodities such as 'steamed pomfret', 'braised pomfret' and 'baked pomfret'.

In the present embodiment, a plurality of combinations of product information may be combined, and one of the product information that can be represented in each area may be selected and combined. Specifically, for example, the first target commodity information subset may be "shredded potatoes fried with brown sauce", "braised pork", and "steamed pomfret", and the second target commodity information subset may be "shredded potatoes fried with brown sauce", "braised pork", and "steamed pomfret", and similarly, a plurality of target commodity information subsets are formed, and no further description is given. In this manner, the commodity weight can be set in advance for each commodity information. Thus, each subset of target item information corresponds to a total weight. Further, a target product information subset having a total weight closest to the weight corresponding to the image is obtained, and the product indicated by the target product information subset is set as the product indicated by the image, and the settlement is performed. Specifically, for example, the first target commodity information subset represents a total weight of 150g, the second target commodity information subset represents a total weight of 195g, and the remaining target commodity information subsets represent total weights of 230g, 170g, 221g, and so on. Wherein the second target commodity information subset indicates that the total weight of the commodity is closest to the acquired weight of 200g, and the commodity indicated by the second target commodity information subset is taken as the commodity indicated by the image.

In one embodiment, the system may further comprise a report generation module: receiving a settlement request aiming at the settlement information sent by a client; generating a composition report of the commodity according to the commodity; sending the component report to the client for presentation by the client.

In the present embodiment, the settlement request may be accompanied by user information of the user who uses the client. The user information may be used to identify the user. Further, a settlement operation can be performed based on the user information. That is, the price of the settlement information can be paid from the resource account corresponding to the user information.

In this embodiment, the composition report may be used to represent the composition in the commodity for review by the user of the client. Specifically, for example, the commodity may be a food, and the ingredient report may record information on specific ingredients of the commodity, such as fat content, vitamin content, protein content, and the like.

In one embodiment, the system may further include a statement-of-health generation module. The statement-of-health generating module may obtain identity information of a client that settles for the settlement information; wherein the identity information is used to identify a user using the client; acquiring body information of the user identified by the identity information; generating a dietary health report based on the commodity and the physical information; sending the dietary health report to the client for presentation by the client.

In this embodiment, the body information of the user identified by the identity information may be acquired, and a health information acquisition request may be sent to the client of the user. The client feeds back the body information of the health report generation module user. The physical information may include height, weight, disease history, daily amount of exercise, sleep conditions, food contraindications, and the like. The health report generation module can give diet suggestions to the user according to the body information of the user, the combination of the ingredients and the efficacy of food and the like. And, the statement-of-health generating module may further include evaluating and suggesting the physical condition of the user.

In one embodiment, the system further comprises a suggestion generation module: acquiring a health plan of the user; wherein the wellness programme is used to constrain the user's behaviour; and generating a shopping suggestion according to the health plan, the commodity information and the weight.

In this embodiment, the health plan may be used to guide the user's life. In particular, the health plan may be used to guide the diet of the user. In particular, the user may be instructed as to the type and amount of food intake. In this way, the health of the user is benefited by restricting the diet of the user through the health plan. Specifically, for example, the user specifies that the goal of a health plan is to lose weight, with the health plan having a nutritional content that indicates a recommended daily intake for each meal. Such as calories, proteins, carbohydrates, fat, dietary fiber, calcium and iron, etc., are not listed. Thus, the user can recommend whether to buy the food according to the nutrient content of the food.

In this embodiment, the manner of acquiring the health plan of the user may include sending an acquisition request to the server to receive the health plan fed back by the server. Alternatively, the health plan stored locally at the client is read.

In the present embodiment, the specific type and number of the product can be obtained from the product information and the weight. In this way, the composition of the commodity, as well as the components of the different components, can be analyzed. The components of the good may be combined with the user's health plan to determine whether certain components of the good do not comply with the health plan. If the amount of some ingredients in the product is too high, it is not suitable for the consumer to eat. Further, a shopping recommendation may be derived suggesting a reduction in the number of purchases of the item. Of course, certain goods may be suitable for the user to eat, and the user may also be advised to purchase in a shopping advice. Specifically, for example, where the lunch food that the user is preparing to purchase is vegetarian, the shopping recommendations may include recommendations for purchasing certain meats, supplementing protein.

The embodiment of the specification provides a commodity settlement system. The commodity settlement system may include a settlement terminal and a settlement center.

Please refer to fig. 3. In this embodiment, the settlement terminal may be a settlement device provided in a merchant. The settlement terminal may include a weighing part, a photographing part, a display part, a support part, and a communication part (not shown).

In this embodiment, the weighing part may have a loading surface for weighing the object on the loading surface. The weighing part may be provided with a weight sensor. The weighing device is used for weighing commodities placed on the carrying surface, and can output electric signals representing the weight of the commodities.

In this embodiment, the imaging unit may image an image of an object on the object mount surface. The photographing part may include a camera. The camera can face the object carrying surface. In this way, the image captured by the imaging unit may include the commodity placed on the object-bearing surface.

In this embodiment, the display unit may be electrically connected to the weighing unit and the imaging unit, and display the weight and the image output by the weighing unit; the display part is also used for displaying settlement information of the object placed on the object carrying surface. The presentation portion may include a display. The display may be an LCD display or a CRT display or the like.

In this embodiment, a support portion may support the display portion above the weighing portion. The support portion may include a case having a certain mechanical strength. So that the supporting part can support the display part. Moreover, the supporting part can be connected show portion and the portion of weighing, so, integrate into a whole with settlement terminal, be convenient for the bulk movement and settle.

In this embodiment, the communication unit may transmit the image and the weight to a settlement center, and the communication unit is further configured to receive settlement information fed back by the settlement center for displaying by the display unit. In the present embodiment, the communication unit may be a network communication module that is created in accordance with a network protocol. Specifically, the communication unit may be a module that performs communication via a twisted pair or a module that performs communication via a wireless network.

In this embodiment, the communication unit may transmit the image and the weight to the settlement center, so that the settlement center may perform image recognition to obtain the product indicated by the image, and further perform a subsequent settlement operation.

In one embodiment, the present specification provides a server. The server operates as a settlement center.

In the present embodiment, the server may include an electronic device having a certain arithmetic processing capability, which may have a network communication unit, a processor, a memory, and the like. Of course, the server may also refer to software running in the electronic device. The server may also be a distributed server, may be a system having a plurality of processors, detection devices, network communication modules, and the like that cooperate, or may also be a server cluster formed by a plurality of servers. Of course, the server may also use cloud technology, so as to implement the functions of the server in a cloud computing manner.

In this embodiment, the network communication unit may be a device that performs network data communication in compliance with a network communication protocol. The network communication unit may serve as a receiving module of the server, or the server may run a receiving module formed by a software program.

In this embodiment, the processing module and the detecting module may be run in the processor of the server, and specific implementation functions and effects thereof may be explained with reference to other embodiments.

In this embodiment, the processor may be implemented in any suitable manner. For example, the processor may take the form of, for example, a microprocessor or processor and a computer-readable medium that stores computer-readable program code (e.g., software or firmware) executable by the (micro) processor, logic gates, switches, an Application Specific Integrated Circuit (ASIC), a programmable logic controller, an embedded microcontroller, and so forth.

In this embodiment, the server may operate the obtaining module, the identifying module and the information generating module described in the foregoing embodiments. In an embodiment, the acquisition module may include the network communication unit so that the acquisition module may communicate with the settlement terminal to acquire the image and the weight generated by the settlement terminal in compliance with a network communication protocol. The server also comprises an information sending module used for sending the settlement information generated by the information generating module to a settlement terminal for settlement by the settlement terminal. The information sending module and the obtaining module may share the network communication unit. In this manner, it is possible to communicate with the settlement terminal through the network communication unit. Further, the aforementioned modules may refer to the introduction and comparison explanations of the aforementioned embodiments, and are not described again.

In one embodiment, the information generating module may be configured to provide the identified commodity information of the commodity to a settlement terminal for the settlement terminal to display the commodity information before generating settlement information according to the commodity and the weight; accordingly, the settlement information is generated based on the commodity and the weight only when the confirmation information is received.

In this embodiment, the information generation module may provide the commodity information to the settlement terminal so that the settlement terminal displays the common consumer confirmation. In this manner, the consumer may be given the opportunity to make a final confirmation. In this case, the consumer can confirm whether the product is a product to be purchased or whether the product information is correct, based on the product information.

In this embodiment, the receipt of the confirmation information can indicate that the consumer has confirmed that the product information is correct, and can further generate settlement information. Otherwise, it may be cancelled and the settlement information is not generated.

In one embodiment, the server may further include the report generation module. In this manner, the consumer may be provided with an ingredient to purchase the merchandise. In another embodiment, the server may further include the statement-of-health generating module. In this way, some advice may be given that the consumer is healthy.

In one embodiment, the present specification provides an electronic device. The electronic device may include: a network communication unit and a processor.

In this embodiment, the network communication unit may be configured to receive an image and a weight provided by a settlement terminal; and sending the settlement information to the settlement terminal for settlement by the settlement terminal.

In this embodiment, the processor may be configured to identify the image and obtain commodity information of a commodity represented by the image; and generating settlement information according to the commodity information.

In this embodiment, the network communication unit may be a device that performs network data communication in compliance with a network communication protocol. The processor may be implemented in any suitable way. For example, the processor may take the form of, for example, a microprocessor or processor and a computer-readable medium that stores computer-readable program code (e.g., software or firmware) executable by the (micro) processor, logic gates, switches, an Application Specific Integrated Circuit (ASIC), a programmable logic controller, an embedded microcontroller, and so forth.

In one embodiment, the present specification provides a computer storage medium having computer program instructions stored therein. The computer program instructions when executed may implement: receiving an image and a weight provided by a settlement terminal; identifying the image to obtain commodity information of a commodity represented by the image; generating settlement information according to the commodity information and the weight; and sending the settlement information to the settlement terminal for settlement by the settlement terminal.

In this embodiment, the computer storage medium includes, but is not limited to, a Random Access Memory (RAM), a Read-Only Memory (ROM), a Cache (Cache), a Hard Disk Drive (HDD), or a Memory Card (Memory Card).

In this embodiment, specific functions implemented by the computer storage medium can be explained with reference to other embodiments.

The embodiment of the specification also provides a settlement terminal. The settlement terminal may include: weighing part, shooting part, show portion, supporting part and arithmetic part.

In this embodiment, the weighing part may have a loading surface for weighing the object on the loading surface.

In this embodiment, the imaging unit may be configured to capture an image of an object on the object mount surface.

In this embodiment, the display unit may be electrically connected to the weighing unit and the imaging unit, and configured to display the weight and the image output by the weighing unit; the display part is also used for displaying settlement information of the object placed on the object carrying surface.

In this embodiment, the support portion may be used to support the display portion above the weighing portion.

In this embodiment, the calculation unit may recognize the image, obtain the product indicated by the image, and generate settlement information from the product and the weight.

In the present embodiment, the arithmetic unit may be a processor having a certain arithmetic capability. Which may be a large scale integrated circuit. The operation part can be operated with software to realize the service function. The arithmetic section may be implemented in any suitable manner. For example, the processor may take the form of, for example, a microprocessor or processor and a computer-readable medium that stores computer-readable program code (e.g., software or firmware) executable by the (micro) processor, logic gates, switches, an Application Specific Integrated Circuit (ASIC), a programmable logic controller, an embedded microcontroller, and so forth.

In this embodiment, the functions and effects of the weighing unit, the shooting unit, the displaying unit, the supporting unit, and the calculating unit, which are specifically realized, can be referred to the comparison explanation of the foregoing embodiments, and are not described in detail.

In one embodiment, the acquiring module, the identifying module, the information generating module and the settlement module described in the foregoing embodiments may be operated in the settlement terminal. And the settlement module can also display settlement information. Thus, the system can be conveniently consulted by consumers. The settlement terminal can realize the settlement method when in operation. In one embodiment, the settlement method comprises: acquiring an image and weight of a commodity; identifying the image to obtain commodity information of a commodity represented by the image; generating settlement information according to the commodity information and the weight; and displaying the settlement information.

In one embodiment, the settlement terminal may present the identified product information of the product for confirmation by a user prior to generating settlement information based on the product and the weight. Specifically, the settlement terminal may display the commodity information in the display part, for example, in a list manner, so as to be confirmed by the consumer, thereby avoiding errors.