阅读说明：本技术 衣物展示方法和装置、电子设备、计算机可读存储介质 (Clothes display method and device, electronic equipment and computer readable storage medium ) 是由 胡蒙 段怡斐 李祥明 于 2021-06-30 设计创作，主要内容包括：本发明公开了一种衣物展示方法和装置、电子设备及计算机可读存储介质,所述衣物展示方法应用于衣物处理设备中,包括：获取衣物处理设备的洗衣筒内衣物的图像；对图像进行处理,以获取图像中每个像素点存在衣物的概率值；根据每个像素点存在衣物的概率值生成热力图；根据热力图和图像生成显性化图像,并控制衣物处理设备对显性化图像进行展示。本发明的展示方法,通过获取图像中每个像素点存在衣物的概率值生成热力图,并与图像生成显性化图像进行展示,使用户可以直接感受算法效果,实现与用户的交互。(The invention discloses a clothes display method and device, electronic equipment and a computer readable storage medium, wherein the clothes display method is applied to clothes processing equipment and comprises the following steps: acquiring an image of laundry in a laundry drum of a laundry treatment device; processing the image to obtain the probability value of clothes existing in each pixel point in the image; generating a thermodynamic diagram according to the probability value of clothes existing in each pixel point; and generating an explicit image according to the thermodynamic diagram and the image, and controlling the clothes processing equipment to display the explicit image. According to the display method, the probability value of clothes existing in each pixel point in the image is obtained to generate the thermodynamic diagram, and the thermodynamic diagram and the image are generated into the explicit image for display, so that a user can directly feel the algorithm effect, and interaction with the user is realized.)

1. A clothes display method is characterized by being applied to a clothes treatment device, and the method comprises the following steps:

acquiring an image of laundry in a laundry drum of the laundry treatment apparatus;

processing the image to obtain the probability value of clothes existing in each pixel point in the image;

generating a thermodynamic diagram according to the probability value of clothes existing in each pixel point;

generating an dominating image according to the thermodynamic diagram and the image, and controlling the clothes treatment equipment to display the dominating image.

2. The garment presentation method of claim 1, wherein generating an overt image from the thermodynamic diagram and the image comprises:

superimposing the thermodynamic map on the image to generate the dominating image.

3. The clothing presentation method of claim 1, wherein generating a thermodynamic diagram according to the probability value of the clothing existence at each pixel point comprises:

acquiring a display color corresponding to the probability value of clothes existing in each pixel point;

and generating the thermodynamic diagram according to the acquired different display colors.

4. The clothing display method of claim 1, wherein processing the image to obtain a probability value of clothing at each pixel point in the image comprises:

and carrying out segmentation prediction on the image by adopting a deep convolutional neural network so as to obtain the probability value of clothes existing at each pixel point in the image.

5. The clothing presentation method of claim 4, wherein the performing segmentation prediction on the image using a deep convolutional neural network comprises:

processing the image through a lower convolution module in the deep convolution neural network to obtain the characteristics of the clothes;

and processing the characteristics of the clothes through an upper convolution module in the deep convolution neural network so as to obtain the probability value of clothes existing in each pixel point in the image.

6. The garment presentation method according to any one of claims 1-5, further comprising:

acquiring the number of pixel points with the probability value larger than a first preset value;

determining the volume ratio of the clothes in the washing drum according to the number of the pixel points and the total number of the pixel points in the image;

and acquiring a washing water level according to the volume ratio, and controlling the clothes treatment equipment according to the washing water level.

7. The garment presentation method of claim 6, further comprising:

and determining that a confirmation instruction of the user to the dominance image is received, or determining that the confirmation instruction of the user is not received within a first preset time, and acquiring the volume ratio of the clothes in the washing drum.

8. A clothes display device, which is applied to clothes processing equipment, and comprises:

an acquisition module for acquiring an image of laundry in a laundry drum of the laundry treatment apparatus;

the image processing module is used for processing the image to acquire the probability value of clothes existing in each pixel point in the image;

the generating module is used for generating thermodynamic diagrams according to the probability value of clothes existing in each pixel point;

and the display control module is used for generating an explicit image according to the thermodynamic diagram and the image and controlling the clothes treatment equipment to display the explicit image.

9. An electronic device, comprising: the clothes display system comprises a memory, a processor and a clothes display program which is stored on the memory and can run on the processor, wherein when the processor executes the clothes display program, the clothes display method according to any one of claims 1-7 is realized.

10. A computer-readable storage medium, on which a clothing presentation program is stored, which when executed by a processor implements a clothing presentation method according to any one of claims 1 to 7.

Technical Field

The present invention relates to the field of home appliances, and in particular, to a clothes display method, a clothes display apparatus, an electronic device, and a computer-readable storage medium.

Background

At present, the intellectualization and interconnection trend of household electrical appliances develops rapidly, a plurality of household electrical appliances are endowed with an intelligent function, a plurality of artificial intelligence algorithms are embedded into the household electrical appliances, and the washing machine is not exceptional. However, most of the intelligent products on the market at present only have 'intelligent' labels, and users cannot really feel the intelligent effect; in addition, the intelligent function lacks interaction with the user, the intelligent function cannot be upgraded, and the high-quality life requirement of people cannot be met.

Disclosure of Invention

The present invention is directed to solving, at least to some extent, one of the technical problems in the related art. Therefore, a first object of the present invention is to provide a method for displaying clothes, which generates a thermodynamic diagram by obtaining a probability value of clothes existing in each pixel point in an image, and displays the thermodynamic diagram and an explicit image generated from the image, so that a user can directly feel an algorithm effect, thereby realizing interaction with the user.

A second object of the present invention is to provide a clothes display device.

A third object of the invention is to propose an electronic device.

A fourth object of the invention is to propose a computer-readable storage medium.

In order to achieve the above object, a clothes display method is provided in an embodiment of a first aspect of the present invention, which is applied to a clothes processing apparatus, and includes: acquiring an image of laundry in a laundry drum of the laundry treatment apparatus; processing the image to obtain the probability value of clothes existing in each pixel point in the image; generating a thermodynamic diagram according to the probability value of clothes existing in each pixel point; generating an dominating image according to the thermodynamic diagram and the image, and controlling the clothes treatment equipment to display the dominating image.

According to the clothes display method, firstly, an image of clothes in a washing drum of the clothes processing equipment is obtained, the probability value of clothes existing at each pixel point in the image is obtained through processing the image, then, a thermodynamic diagram is generated according to the probability value of clothes existing at each pixel point, an explicit image is generated according to the thermodynamic diagram and the image, and the clothes processing equipment is controlled to display the explicit image. Therefore, the method generates the thermodynamic diagram by acquiring the probability value of clothes existing in each pixel point in the image, and generates the explicit image with the image for displaying, so that a user can directly feel the algorithm effect, and the interaction with the user is realized.

In addition, the clothes display method according to the above embodiment of the present invention may further have the following additional technical features:

according to one embodiment of the invention, generating an explicative image from the thermodynamic map and the image comprises: superimposing the thermodynamic map on the image to generate the dominating image.

According to one embodiment of the invention, generating a thermodynamic diagram according to the probability value of clothes existing in each pixel point comprises the following steps: acquiring a display color corresponding to the probability value of clothes existing in each pixel point; and generating the thermodynamic diagram according to the acquired different display colors.

According to an embodiment of the present invention, processing the image to obtain a probability value of clothes existing at each pixel point in the image includes: and carrying out segmentation prediction on the image by adopting a deep convolutional neural network so as to obtain the probability value of clothes existing at each pixel point in the image.

According to one embodiment of the invention, the segmentation prediction of the image by using the deep convolutional neural network comprises the following steps: processing the image through a lower convolution module in the deep convolution neural network to obtain the characteristics of the clothes; and processing the characteristics of the clothes through an upper convolution module in the deep convolution neural network so as to obtain the probability value of clothes existing in each pixel point in the image.

According to an embodiment of the present invention, the above clothing displaying method further includes: acquiring the number of pixel points with the probability value larger than a first preset value; determining the volume ratio of the clothes in the washing drum according to the number of the pixel points and the total number of the pixel points in the image; and acquiring a washing water level according to the volume ratio, and controlling the clothes treatment equipment according to the washing water level.

According to an embodiment of the present invention, the above clothing displaying method further includes: and determining that a confirmation instruction of the user to the dominance image is received, or determining that the confirmation instruction of the user is not received within a first preset time, and acquiring the volume ratio of the clothes in the washing drum.

In order to achieve the above object, a second aspect of the present invention provides a clothes display device, applied to a clothes treatment apparatus, the device including: an acquisition module for acquiring an image of laundry in a laundry drum of the laundry treatment apparatus; the image processing module is used for processing the image to acquire the probability value of clothes existing in each pixel point in the image; the generating module is used for generating thermodynamic diagrams according to the probability value of clothes existing in each pixel point; and the display control module is used for generating an explicit image according to the thermodynamic diagram and the image and controlling the clothes treatment equipment to display the explicit image.

According to the clothes display device provided by the embodiment of the invention, the image of clothes in the washing drum of the clothes processing equipment is obtained through the obtaining module, the image is processed through the image processing module so as to obtain the probability value of clothes existing in each pixel point in the image, the thermodynamic diagram is generated through the generating module according to the probability value of clothes existing in each pixel point, the display control module generates an explicit image according to the thermodynamic diagram and the image, and the clothes processing equipment is controlled to display the explicit image. Therefore, the device generates thermodynamic diagrams by acquiring the probability value of clothes existing in each pixel point in the images, and generates an explicit image with the images for displaying, so that a user can directly feel the algorithm effect, and interaction with the user is realized.

To achieve the above object, an electronic device according to a third aspect of the present invention includes: the clothes display system comprises a memory, a processor and a clothes display program which is stored on the memory and can run on the processor, wherein when the processor executes the clothes display program, the clothes display method is realized.

According to the electronic equipment provided by the embodiment of the invention, the clothes display method is realized by executing the clothes display program through the processor, and the user can directly feel the algorithm effect and realize the interaction with the user by displaying the explicit image.

In order to achieve the above object, a computer-readable storage medium according to a fourth aspect of the present invention is provided, on which a clothes display program is stored, and the clothes display program realizes the clothes display method when being executed by a processor.

According to the computer-readable storage medium of the embodiment of the invention, the clothes display method is realized by executing the clothes display program, and the user can directly feel the algorithm effect by displaying the explicit image, so that the interaction with the user is realized.

Additional aspects and advantages of the invention will be set forth in part in the description which follows and, in part, will be obvious from the description, or may be learned by practice of the invention.

Drawings

Fig. 1 is a flowchart of a clothes displaying method according to an embodiment of the present invention;

fig. 2 is a schematic view of an explicit display washing machine of a laundry display method according to an embodiment of the present invention;

FIG. 3 is a block diagram of a garment display device according to an embodiment of the invention;

fig. 4 is a block diagram of an electronic device according to an embodiment of the invention.

Detailed Description

Reference will now be made in detail to embodiments of the present invention, examples of which are illustrated in the accompanying drawings, wherein like or similar reference numerals refer to the same or similar elements or elements having the same or similar function throughout. The embodiments described below with reference to the drawings are illustrative and intended to be illustrative of the invention and are not to be construed as limiting the invention.

A clothing presentation method, a clothing presentation apparatus, an electronic device, and a computer-readable storage medium according to embodiments of the present invention will be described below with reference to the accompanying drawings.

Fig. 1 is a flowchart of a clothing displaying method according to an embodiment of the present invention. In one embodiment of the invention, the clothes display method can be applied to the clothes treatment equipment, so that a user can visually check the state and the position of clothes in a washing drum on a display screen of the clothes treatment equipment. The clothes treatment device can be a pulsator washing machine, a drum washing machine, a stirring washing machine, a jet washing machine, a drying all-in-one machine, a clothes dryer and other devices with a display screen.

As shown in fig. 1, the clothes displaying method according to the embodiment of the present invention may include the steps of:

s1, acquiring an image of the laundry inside the washing drum of the laundry treating device.

Specifically, taking the laundry treating apparatus as an example of a drum type washing machine, as shown in fig. 2, the drum type washing machine 100 has a side-opening structure, the washing machine door 110 is located at one side of the drum type washing machine 100, and the washing machine door 110 is configured in a circular shape adapted to a washing tub of the drum type washing machine 100. The drum type washing machine 100 is provided with a touch screen display and control area 130 above the same side as the washing machine door 110, and a user can selectively control an operation program of the washing machine through the touch screen display and control area 130. The middle part of the washing machine door 110 is provided with a camera 120, and the camera 120 is used for shooting and collecting clothes in the washing drum. In a specific application process, a user puts clothes into the washing drum, closes the door 110 of the washing machine, and opens the start button in the touch screen display and control area 130, so that the camera 120 receives a trigger signal and shoots the inside of the washing drum to acquire an image of the clothes in the washing drum. The shooting action of the camera 120 can be triggered by a power-on signal of the clothes treatment device. When the user puts the clothes again, the shooting action of the camera 120 is triggered again through the closing of the washing machine door 110, that is, the clothes in the washing drum are shot again to form a new image, and at the moment, the newly acquired image is used as an image which needs to be processed subsequently.

It should be noted that the installation position of the camera 120 is only a specific implementation manner of an embodiment of the present invention. On the premise of ensuring effective collection of images in the washing machine barrel, the optimal installation position can be selected according to the structure of the washing machine. Such as: the washing machine door of the pulsator washing machine is on the top, so that the camera can be installed above the pulsator washing machine, i.e., on the washing machine door. In addition, the installation position of the camera and the parameters of the camera have a crucial influence on the image quality of clothes in the washing drum, so that the camera is selected and assembled according to the requirements of the washing machine.

And S2, processing the image to obtain the probability value of clothes existing in each pixel point in the image.

According to an embodiment of the present invention, processing the image to obtain a probability value of clothes existing at each pixel point in the image further includes: and (3) carrying out segmentation prediction on the image by adopting a deep convolutional neural network so as to obtain the probability value of clothes existing at each pixel point in the image.

Further, according to an embodiment of the present invention, the performing segmentation prediction on the image by using a deep convolutional neural network includes: processing the image through a lower convolution module in the deep convolution neural network to obtain the characteristics of the clothes; the characteristics of the clothes are processed through an upper convolution module in the deep convolution neural network so as to obtain the probability value of clothes existing in each pixel point in the image.

Specifically, the image shot by the camera is uploaded to the server side in a photo encryption mode so as to ensure personal privacy security. When the server receives the image, the image is processed in a deep convolution neural network mode, and then the image is calculated on the basis of the characteristic value of the image. And the deep convolution neural network processes the image received by the server end in a hole convolution mode through the lower convolution module. The void convolution characteristic grabbing technology improves the identification accuracy of the position and the volume of the clothes, so that the identification accuracy of the empty drum reaches 100%, and the identification accuracy of small clothes reaches 98%. For example, a piece of clothes is put in the washing drum, and an image shot by the camera is the washing drum with the piece of clothes, wherein the inner wall of the washing drum is inevitably subjected to image acquisition in order to ensure that the image in the washing drum is effectively shot by the camera, and when the number of the clothes is less, the coverage area of the washing drum is reduced, and the image area of the inner wall of the washing drum in the image shot by the opposite camera is increased. When the lower convolution module processes the image, the image is trained according to a preset model, and the characteristic information of the clothes, including the material information, can be obtained. The upper convolution module processes the clothes features extracted by the lower convolution module, and the probability value of clothes existing in each pixel point in the image can be obtained.

And S3, generating a thermodynamic diagram according to the probability value of clothes existing in each pixel point.

According to one embodiment of the invention, generating a thermodynamic diagram according to the probability value of clothes existing in each pixel point comprises the following steps: and generating a thermodynamic diagram according to the acquired different display colors. The corresponding relationship between the display color and the probability value may be preset, for example, the larger the probability value is, the darker the color is, the smaller the probability value is, and the lighter the color is.

Specifically, after the probability value that clothes exist in each pixel point in the image is acquired through the embodiment, the thermodynamic diagram is generated through the deep convolutional neural network according to the corresponding relation between the probability value and the display color. When the probability value is within a certain interval, the probability value corresponds to one display color, and the probability values are sequentially corresponding to the order of red, orange, yellow, green, blue and purple from large to small, for example, when the probability value is between [0.8 and 1], the corresponding display color is red, and when the probability value is between [0 and 0.2], the corresponding display color is purple. And determining the display color according to the relationship between the set display color and the probability value of the clothes at the pixel point, thereby generating a corresponding thermodynamic diagram.

It should be noted that the correspondence between the display color and the clothing existence probability value is only a specific description of an embodiment of the present invention, and in order to ensure the developing accuracy of the thermodynamic diagram, a plurality of display colors may be set, so as to refine the relationship between the clothing existence probability value and the display colors.

And S4, generating an explicit image according to the thermodynamic diagram and the image, and controlling the clothes processing equipment to display the explicit image.

In one embodiment of the invention, generating an explicated image from the thermodynamic map and the image comprises: the thermodynamic diagram is superimposed on the image to generate an explicated image.

Specifically, the thermodynamic diagram obtained according to the corresponding relation between the display color and the probability value of the clothes is superposed on the image of the clothes in the washing drum acquired by the original camera, the thermodynamic diagram result after data processing and the corresponding image are superposed to obtain a corresponding dominant image, the dominant image is displayed through a touch screen of the washing machine and a display screen in a control area, and a user can view the dominant image through the area, so that the artificial intelligence algorithm has a dominant effect, and the user can directly feel the algorithm effect and know the position of the clothes in the washing drum.

According to an embodiment of the present invention, the clothing display method further includes: and determining that a confirmation instruction of the user for the visualized image is received, or determining that the confirmation instruction of the user is not received within a first preset time, and acquiring the volume ratio of the clothes in the washing drum. The first preset time may be set according to an actual application, for example, the first preset time may be 10 s.

Specifically, the display of the dominance image is displayed through a touch screen of the washing machine, so that a user can check the dominance image and judge whether the dominance image is objected, namely whether the overlapping degree of the acquired dominance image and the original clothes image meets the requirement. When the user does not disagree with the dominant image, a confirmation instruction can be sent through a touch key in the touch screen display; when the user disagrees with the dominant image, a cancel instruction can be sent through a touch key in the touch screen display, the image of the clothes in the washing drum is obtained again at the moment, the operation is carried out on the clothes image, and the dominant image is generated. When the explicit images with the different meanings output by the user are subjected to marking, the server side marks the explicit images with the different meanings, uniformly arranges the marked explicit images in a preset period, and optimizes and improves the performance of the depth convolution model based on the explicit images.

When the server receives a confirmation instruction of the user or receives no feedback information of the user within a first preset time (such as 10s), the server considers that the user has no objection to the domination image, and determines the volume ratio of the clothes in the washing drum according to the clothes existence probability value to further determine the washing water level.

In order to improve the accuracy of the data calculation result, in the whole clothes identification process, the camera shoots a plurality of images of clothes in the washing machine barrel, and outputs a plurality of dominant images through the operation, so that a user can select the optimal dominant image, determine the washing water level according to the volume ratio corresponding to the dominant image and perform washing operation. When the first preset time is counted down and no reaction is finished, the dominance image at the first position can be selected as the subsequent washing water level determination basis. And when there is an objection to the dominance image, repeating the image capturing and recognizing process.

According to an embodiment of the present invention, the clothing displaying method may further include: acquiring the number of pixel points with probability values larger than a first preset value; determining the volume ratio of the clothes in the washing drum according to the number of the pixel points and the total number of the pixel points in the image; and acquiring a washing water level according to the volume ratio, and controlling the clothes treatment equipment according to the washing water level. The first preset value may be preset according to practical applications, for example, the first preset value may be 0.8.

Specifically, the above-mentioned probability value may be set to be between 0 and 1, where 0 represents that no laundry exists, 1 represents that laundry exists, and a value between 0 and 1 represents that a probability value exists, and for example, when the probability value is 0.8, it is considered that there is a high possibility that laundry exists; when the probability value is 0.2, it is considered that the probability of the presence of laundry is small, that is, the closer the probability value is to 1, the greater the probability of the presence of laundry is, and the closer to 0, the smaller the probability of the presence of laundry is. After the probability value between 0 and 1 is determined for each pixel point in the clothes image by adopting a deep convolutional neural network, whether clothes exist is determined by combining with the set probability value. When the probability value is greater than 0.8, the pixel point is determined to have clothes; and when the probability value corresponding to the pixel point is less than or equal to 0.8, determining that no clothing exists in the pixel point.

Assuming that the total number of all pixel points in the image acquired by the camera is N, the total number of the pixel points with the probability value larger than 0.8 (the first preset value) is acquired and recorded as N, and then the volume ratio of the clothes in the washing machine cylinder is N/N. The system can be used for carrying out a corresponding relation table or a calculation formula of the volume ratio and the washing water level in advance to form a database. When the volume ratio is obtained, calling the corresponding relation between the volume ratio and the washing water level in the database, finding out the corresponding washing water level, and then controlling a water inlet in the clothes treatment equipment according to the washing water level, thereby realizing the precision control of the washing water level according to the clothes volume ratio.

It should be noted that the above-mentioned confirmation method of the volume ratio between the laundry and the washing drum is only an embodiment of the present invention, i.e. a specific description is made on the premise of a structure that a camera is installed in the middle of the door of the washing machine. In order to improve the calculation accuracy of the volume ratio, the accuracy of the probability value of clothes existing in each pixel point in the image can be improved by installing a plurality of cameras, and further the calculation accuracy of the volume ratio is improved.

In addition, in the above manner, the acquired clothes image is sent to the cloud server, and a series of processing is performed through the cloud server to generate an explicit image and obtain the washing water level of the clothes processing equipment. It is of course also possible to generate an explicative image and obtain the wash water level of the laundry treating apparatus by the control chip of the laundry treating apparatus itself.

In conclusion, the clothes display method includes the steps that an image in a washing drum is shot based on a built-in camera of the washing machine, the image is uploaded to a server in an encryption mode, a deep convolutional neural network is adopted in the server to extract characteristic values in the image, the identification accuracy of positions and volumes of clothes is guaranteed, the probability of clothes existence of each pixel point in the image is predicted, the prediction result is output in a thermodynamic diagram mode, the thermodynamic diagram and an initial image are further synthesized into an explicit image, the explicit image is finally transmitted to a washing machine end, and the display and control area of the washing machine is used for displaying, so that an artificial intelligence algorithm has an explicit effect, a user can directly feel the algorithm effect, and the result is interacted and fed back. If the user does not disagree with the dominating image or does not respond within a first preset time, counting and calculating the total number of pixel points with the clothes existence probability larger than a first preset value, dividing the total number of the pixel points by the number of the pixel points of the washing machine barrel to obtain the volume ratio of the clothes in the barrel, and recommending the washing water level according to the volume ratio. And if the user disagrees with the dominance image, re-carrying out the image shooting and identifying process. In addition, for images with different meanings for users, the server side can regularly arrange the images, the models are optimized and the performance is improved based on the images, the interaction between the intelligent function and the users is improved, and the upgrading of the intelligent function is realized.

In summary, according to the clothing display method provided by the embodiment of the invention, the probability value of clothing existing in each pixel point in the image is obtained to generate the thermodynamic diagram, and the thermodynamic diagram and the image are displayed to generate the explicit image, so that the user can directly feel the algorithm effect, and the interaction with the user is realized.

Corresponding to the embodiment, the invention further provides a clothes display device.

Fig. 3 is a block diagram of a laundry displaying apparatus according to an embodiment of the present invention. In one embodiment of the present invention, the clothes display device can be applied to a clothes treatment apparatus, such as a pulsator washing machine, a drum washing machine, a pulsator washing machine, a jet washing machine, a dryer, etc., so that a user can visually check the state and position of clothes in a washing tub on a display screen of the clothes treatment apparatus.

As shown in fig. 3, the clothes display apparatus may include: an acquisition module 10, an image processing module 20, a generation module 30 and a presentation control module 40.

Wherein the acquisition module 10 is used for acquiring an image of laundry inside a laundry drum of a laundry treatment apparatus. The image processing module 20 is configured to process the image to obtain a probability value that each pixel point in the image has clothes. The generating module 30 is configured to generate a thermodynamic diagram according to the probability value of the clothes existing in each pixel point. The display control module 40 is used for generating an explicit image according to the thermodynamic diagram and the image and controlling the clothes processing equipment to display the explicit image.

According to an embodiment of the present invention, the presentation control module 40 generates an dominating image from the thermodynamic diagram and the image, and is specifically configured to: the thermodynamic diagram is superimposed on the image to generate an explicated image.

According to an embodiment of the present invention, the presentation control module 30 generates a thermodynamic diagram according to the probability value of the existence of the clothes at each pixel point, specifically configured to: and generating a thermodynamic diagram according to the acquired different display colors.

According to an embodiment of the present invention, the image processing module 20 processes the image to obtain a probability value that each pixel point in the image has clothes, and is specifically configured to: and (3) carrying out segmentation prediction on the image by adopting a deep convolutional neural network so as to obtain the probability value of clothes existing at each pixel point in the image.

According to an embodiment of the present invention, the image processing module 20 performs segmentation prediction on the image by using a deep convolutional neural network, and is specifically configured to: processing the image through a lower convolution module in the deep convolution neural network to obtain the characteristics of the clothes; the characteristics of the clothes are processed through an upper convolution module in the deep convolution neural network so as to obtain the probability value of clothes existing in each pixel point in the image.

According to an embodiment of the present invention, the image processing module 20 is specifically configured to: acquiring the number of pixel points with probability values larger than a first preset value; determining the volume ratio of the clothes in the washing drum according to the number of the pixel points and the total number of the pixel points in the image; and acquiring a washing water level according to the volume ratio, and controlling the clothes treatment equipment according to the washing water level.

According to one embodiment of the present invention, the presentation control module 40 is further configured to: and determining that a confirmation instruction of the user to the dominance image is received, or determining that the confirmation instruction of the user is not received within a first preset time, and acquiring the volume ratio of the clothes in the washing drum.

It should be noted that, for details not disclosed in the clothes displaying apparatus according to the embodiment of the present invention, please refer to details disclosed in the clothes displaying method according to the above embodiment of the present invention, and detailed description thereof is omitted here.

According to the clothes display device, the probability value of clothes existing in each pixel point in the image is obtained to generate the thermodynamic diagram, and the thermodynamic diagram and the image are generated into the explicit image for displaying, so that a user can directly feel the algorithm effect, and interaction with the user is realized.

Corresponding to the above embodiment, the present invention further provides an electronic device 200.

As shown in fig. 4, the electronic device 200 may include: the clothes display system comprises a memory 210, a processor 220 and a clothes display program which is stored on the memory 210 and can run on the processor 220, wherein when the processor 220 executes the clothes display program, the clothes display method is realized.

According to the electronic equipment provided by the embodiment of the invention, the clothes display method is realized by executing the clothes display program through the processor, so that a user can directly feel the algorithm effect and realize the interaction with the user.

In correspondence with the above embodiment, the present invention further provides a computer readable storage medium, on which a clothes display program is stored, which when executed by a processor implements the clothes display method described above.

According to the computer-readable storage medium of the embodiment of the invention, the clothes display method is realized by executing the clothes display program, so that a user can directly feel the algorithm effect and realize the interaction with the user.

It should be noted that the logic and/or steps represented in the flowcharts or otherwise described herein, such as an ordered listing of executable instructions that can be considered to implement logical functions, can be embodied in any computer-readable medium for use by or in connection with an instruction execution system, apparatus, or device, such as a computer-based system, processor-containing system, or other system that can fetch the instructions from the instruction execution system, apparatus, or device and execute the instructions. For the purposes of this description, a "computer-readable medium" can be any means that can contain, store, communicate, propagate, or transport the program for use by or in connection with the instruction execution system, apparatus, or device. More specific examples (a non-exhaustive list) of the computer-readable medium would include the following: an electrical connection (electronic device) having one or more wires, a portable computer diskette (magnetic device), a Random Access Memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber device, and a portable compact disc read-only memory (CDROM). Additionally, the computer-readable medium could even be paper or another suitable medium upon which the program is printed, as the program can be electronically captured, via for instance optical scanning of the paper or other medium, then compiled, interpreted or otherwise processed in a suitable manner if necessary, and then stored in a computer memory.

It should be understood that portions of the present invention may be implemented in hardware, software, firmware, or a combination thereof. In the above embodiments, the various steps or methods may be implemented in software or firmware stored in memory and executed by a suitable instruction execution system. For example, if implemented in hardware, as in another embodiment, any one or combination of the following techniques, which are known in the art, may be used: a discrete logic circuit having a logic gate circuit for implementing a logic function on a data signal, an application specific integrated circuit having an appropriate combinational logic gate circuit, a Programmable Gate Array (PGA), a Field Programmable Gate Array (FPGA), or the like.

In the description herein, references to the description of the term "one embodiment," "some embodiments," "an example," "a specific example," or "some examples," etc., mean that a particular feature, structure, material, or characteristic described in connection with the embodiment or example is included in at least one embodiment or example of the invention. In this specification, the schematic representations of the terms used above do not necessarily refer to the same embodiment or example.

Although embodiments of the present invention have been shown and described above, it is understood that the above embodiments are exemplary and should not be construed as limiting the present invention, and that variations, modifications, substitutions and alterations can be made to the above embodiments by those of ordinary skill in the art within the scope of the present invention.