Reading device, reading method, reading program, and settlement processing method
阅读说明：本技术 读取装置、读取方法以及读取程序、和结算处理方法 (Reading device, reading method, reading program, and settlement processing method ) 是由 高尾亮 于 2019-08-27 设计创作，主要内容包括：提供能简单且迅速读取复合符号的读取装置、读取方法以及读取程序、和结算处理方法。用动态图像拍摄将多个符号显示在同一处且显示根据观察的角度而变化的复合符号。从通过拍摄得到的动态图像检测复合符号中所含的符号。另外,基于得到的动态图像来判定复合符号的真假。(Provided are a reading device, a reading method, a reading program, and a settlement processing method, which can simply and quickly read a composite symbol. A plurality of symbols are displayed at the same place by moving image shooting and a composite symbol that changes according to the angle of observation is displayed. A symbol included in the composite symbol is detected from a moving image obtained by photographing. In addition, the authenticity of the composite symbol is determined based on the obtained moving image.)
1. A reading apparatus is characterized by comprising:
a moving image acquisition unit that acquires a moving image obtained by imaging a composite symbol while relatively moving or changing an angle, wherein the composite symbol is displayed in a switched manner in accordance with an observation angle by a lenticular lens sheet or a microlens array sheet, and each of the symbols is composed of a code;
a symbol detection unit that detects the symbol from the moving image; and
a true/false determination unit that determines whether the composite symbol is true or false based on the moving image.
2. The reading apparatus according to claim 1,
the reading apparatus further includes:
a decoding unit that decodes the symbol detected by the symbol detection unit,
the true/false determination unit determines whether or not the composite symbol is true based on the decoding result of the decoding unit.
3. The reading apparatus according to claim 1 or 2,
the true-false determination section determines true-false of the composite symbol based on an order of the symbols detected in time-series order from the moving image.
4. A reading apparatus according to any one of claims 1 to 3,
the true/false determination unit determines true/false of the composite symbol based on transition of switching of the symbol detected from the moving image.
5. A reading apparatus according to any one of claims 1 to 4,
the rate of occurrence of each of the symbols of the composite symbol is different when viewed at a continuously changing angle at a speed,
the true-false determination section determines true-false of the composite symbol based on an appearance ratio of each of the symbols detected from the moving image.
6. A reading apparatus according to any one of claims 1 to 5,
the reading apparatus further includes:
a symbol number information acquisition unit that acquires information on the number of symbols included in the composite symbol,
the symbol detection unit ends the detection process when all the symbols included in the composite symbol are detected.
7. The reading apparatus according to claim 6,
the symbol number information acquisition unit acquires, from the symbol, information on the number of symbols included in the composite symbol when the information on the number of symbols included in the composite symbol is stored in the symbol.
8. A reading apparatus according to any one of claims 1 to 7,
when the color of the symbol is switched in accordance with the switching of the symbol, the symbol detection unit detects the switching of the color of the symbol from the moving image to detect the symbol.
9. A reading apparatus according to any one of claims 1 to 7,
in the composite symbol, strip-shaped images whose color, density, or pattern changes in accordance with the switching of the symbol are arranged adjacently along a reading direction,
the symbol detection unit detects the symbol by detecting switching of a color, density, or pattern of the band-shaped image.
10. A reading apparatus according to any one of claims 1 to 7,
the reading apparatus further includes:
a display unit that displays the moving image,
the display unit displays a frame in which the composite symbol is received, in a manner to be superimposed on the moving image.
11. A reading method, comprising the steps of:
acquiring a moving image obtained by imaging a composite symbol while relatively moving or changing an angle of the composite symbol, wherein the composite symbol is displayed in a switched manner in accordance with an observation angle by a lenticular lens sheet or a microlens array sheet, and each of the symbols is composed of a code;
detecting the symbol from the dynamic image;
determining a true or false of the composite symbol based on the dynamic image.
12. A reading program for causing a computer to function as:
acquiring a moving image obtained by imaging a composite symbol while relatively moving or changing an angle of the composite symbol, wherein the composite symbol is displayed in a switched manner in accordance with an observation angle by a lenticular lens sheet or a microlens array sheet, and each of the symbols is composed of a code;
detecting the symbol from the dynamic image;
determining a true or false of the composite symbol based on the dynamic image.
13. A recording medium which is non-transitory and readable by a computer, wherein when an instruction stored in the recording medium is read by the computer, the computer is caused to execute a reading function,
the reading function includes the following functions:
acquiring a moving image obtained by imaging a composite symbol while relatively moving or changing an angle of the composite symbol, wherein the composite symbol is displayed in a switched manner in accordance with an observation angle by a lenticular lens sheet or a microlens array sheet, and each of the symbols is composed of a code;
detecting the symbol from the dynamic image;
determining a true or false of the composite symbol based on the dynamic image.
14. A settlement processing method is a settlement processing method based on codes, and is characterized by comprising the following steps:
acquiring a moving image obtained by imaging a composite symbol while relatively moving or changing an angle of the composite symbol, wherein the composite symbol is displayed in a switched manner in accordance with an observation angle by a lenticular lens sheet or a microlens array sheet, and each of the symbols is composed of the code;
detecting the symbol from the dynamic image; and
determining a true or false of the composite symbol based on the dynamic image.
Technical Field
The present invention relates to a composite symbol in which a plurality of symbols are displayed at the same position and which changes depending on the angle of observation, and a reading device, a reading method, a reading program, and a settlement processing method for reading the composite symbol.
Background
Due to the spread of bar codes and two-dimensional codes, the codes (symbols) are not limited to reading of information, but are also widely used as traceability management, entry and exit management, settlement means, and the like. On the other hand, damage due to the code being forged may also occur. For example, in a system in which a user reads a code with a smartphone or the like to settle accounts, there is a risk that the code displayed in a shop or the like is replaced or replaced with an improper code.
Patent documents 1 and 2 propose techniques for preventing the forgery of symbols by displaying a plurality of symbols at the same position by using a technique for displaying a change in the angle of observation. A technique (composite symbol) that shows a structure that changes according to the angle of observation as described above cannot be copied by a copying machine or the like, and is also difficult to manufacture, and therefore forgery can be effectively prevented. In addition, since a plurality of symbols can be read, a high degree of authenticity determination can be performed.
However, such a composite symbol requires in principle that all symbols are read at the time of the reading. Conventionally, each symbol is individually photographed and read. That is, the position of the reading device is changed so that the display is switched to individually photograph each symbol.
Disclosure of Invention
Problems to be solved by the invention
However, the conventional reading method of individually photographing a displayed symbol and reading the symbol requires repeated photographing, and thus has a drawback that the reading requires labor and time.
The present invention has been made in view of such circumstances, and an object thereof is to provide a reading apparatus, a reading method, a reading program, and a settlement processing method that can easily and quickly read a composite symbol.
Means for solving the problems
Means for solving the above problems are as follows.
(1) A reading device is provided with: a moving image acquisition unit that acquires a moving image obtained by imaging a composite symbol that displays a plurality of symbols at the same position and that changes in display angle according to observation angle while moving or changing the angle relative to the composite symbol; a symbol detection unit that detects a symbol from a moving image; and a true/false determination unit that determines whether the composite symbol is true or false based on the moving image.
(2) In the reading apparatus of the above (1), the true-false judging section judges the true or false of the composite symbol based on the order of symbols detected in time-series order from the moving image.
(3) In the reading apparatus of the above (1) or (2), the true/false determination section determines the true/false of the composite symbol based on transition of switching of the symbol detected from the moving image.
(4) In the reading apparatus of any one of the above (1) to (3), the true-false judging section judges true or false of the composite symbol based on the appearance ratio of each symbol detected from the dynamic image in a case where the appearance ratio of each symbol is different when the composite symbol is observed while continuously changing the angle.
(5) The reading apparatus according to any one of the above (1) to (4), further comprising a symbol number information acquisition unit that acquires information on the number of symbols included in the composite symbol, wherein the symbol detection unit ends the detection process when all symbols included in the composite symbol are detected.
(6) In the reading device of the above (5), the symbol number information acquiring unit acquires the information on the number of symbols included in the composite symbol from the symbol when the information on the number of symbols included in the composite symbol is stored in the symbol.
(7) In the reading device of any one of the above (1) to (6), when the color of the symbol is switched in accordance with the switching of the symbol, the symbol detection section detects the symbol by detecting the switching of the color of the symbol from the dynamic image.
(8) In the reading apparatus according to any one of the above (1) to (6), in a case where a line graph that changes in accordance with the switching of the symbol is arranged adjacent to the composite symbol, the symbol detection section detects the switching of the line graph to detect the symbol.
(9) In the reading apparatus of the above (8), the color of the line graph changes in accordance with the switching of the symbol.
(10) The reading device according to any one of the above (1) to (9) further includes a display unit that displays a moving image, and the frame in which the composite symbol is received is displayed on the moving image in a superimposed manner on the display unit.
(11) In the reading apparatus of any one of the above (1) to (10), the symbol is constituted by a code.
(12) In the reading apparatus of any one of the above (1) to (11), the symbol to be displayed of the composite symbol is changed depending on the angle of observation by the lenticular lens sheet or the microlens array sheet.
(13) A reading method comprising the steps of: acquiring a moving image obtained by imaging a composite symbol while relatively moving or changing an angle, wherein the composite symbol displays a plurality of symbols at the same position and the display changes according to an observation angle; detecting a symbol from the dynamic image; and determining the authenticity of the composite symbol based on the moving image.
(14) A reading program that causes a computer to realize functions of: acquiring a moving image obtained by imaging a composite symbol while relatively moving or changing an angle, wherein the composite symbol displays a plurality of symbols at the same position and the display changes according to an observation angle; detecting a symbol from the dynamic image; and determining the authenticity of the composite symbol based on the moving image.
(15) A composite symbol in which a plurality of symbols are displayed at the same position and the display changes depending on the angle of observation, wherein when N and M are integers satisfying N > M, the symbols are generated from N pieces of divided data obtained by dividing original data into N pieces, and the pieces of divided data are generated from at least M pieces of divided data so that the original data can be restored.
(16) In the composite symbol of the above (15), a gap is provided between the chips of adjacent symbols in one lens.
(17) The composite symbol of (15) or (16) has a symbol indicating a reading direction.
(18) In the composite symbol of any one of (15) to (17) above, the symbol is constituted by a code.
(19) A settlement processing method is a settlement processing method based on codes, and comprises the following steps: acquiring a moving image obtained by imaging a composite code while relatively moving or changing an angle, wherein the composite code displays a plurality of codes at the same position and the display changes according to an observation angle; detecting a code from the moving image; and determining the authenticity of the composite symbol based on the moving image.
Effects of the invention
According to the present invention, a complex symbol can be read simply and quickly.
Drawings
Fig. 1 is a conceptual diagram of a composite symbol.
Fig. 2 is a perspective view showing a schematic structure of a lenticular lens sheet.
Fig. 3 is a conceptual diagram of generation of a lenticular image.
Fig. 4 is a cross-sectional view showing a schematic structure of a lenticular printed matter.
Fig. 5 is a block diagram showing an example of a hardware configuration of a smartphone.
Fig. 6 is a functional block diagram of a smartphone as a reading apparatus.
Fig. 7 is a conceptual diagram of shooting of a moving image for reading.
Fig. 8 is a flowchart showing the procedure of the process of reading a composite symbol.
Fig. 9 is a diagram showing an example of a method for facilitating recognition of symbol switching.
Fig. 10 is a diagram showing an example of a method for facilitating recognition of symbol switching.
Fig. 11 is a diagram showing a schematic configuration of a composite symbol in the case where 5 symbols are switched.
Fig. 12 is a conceptual diagram of detection of a symbol.
Fig. 13 is a conceptual diagram of interference in a composite symbol.
Fig. 14 is a cross-sectional view showing a schematic configuration of a composite symbol in the case where the appearance ratio of the symbol is changed.
Fig. 15 is a diagram showing an example of display of the shooting frame.
Fig. 16 is a perspective view showing a schematic structure of a microlens array sheet.
Fig. 17 is a perspective view showing another example of the lenticular lens sheet.
Fig. 18 is a view showing a schematic structure of a lenticular lens sheet having a smoothed surface.
Fig. 19 is a conceptual diagram of a configuration for clarifying symbol switching by a gap.
Fig. 20 is a diagram showing an example of display of symbols in the reading direction.
Fig. 21 is a diagram showing an example of a case where a composite symbol is displayed while being wobbled.
Fig. 22 is an enlarged sectional view showing a schematic structure of a lenticular lens sheet having an ink receiving layer.
Detailed Description
Hereinafter, preferred embodiments of the present invention will be described in detail with reference to the accompanying drawings.
[ composite symbol ]
First, the composite symbol will be explained.
The composite symbol has a structure in which a plurality of symbols are displayed at the same place and display is changed depending on the angle of observation. The symbol includes a bar Code, a two-dimensional Code (for example, a QR Code (registered trademark), a CP Code (Computer pure Code), and the like), a symbol, characters (including pictorial characters, and the like), a figure, a pattern (including a pattern, and the like), and the like.
Fig. 1 is a conceptual diagram of a composite symbol.
Fig. 1 shows an example of a case where 2 symbols (the 1 st symbol Sy1 and the 2 nd symbol Sy2) are displayed. Fig. 1 shows a case where a two-dimensional code (here, a QR code) is displayed as a symbol. Fig. 1 shows an example of changing the display by using a lenticular lens sheet. In addition, when the symbol is formed of a code, it is particularly referred to as a "composite code".
As shown in fig. 1, when the composite symbol Sy is viewed from the 1 st viewpoint P1, the 1 st symbol Sy1 (1 st two-dimensional code) is displayed. When the composite symbol Sy is viewed from the 2 nd viewpoint P2, the 2 nd symbol Sy2 (2 nd two-dimensional code) is displayed. In addition, at a position intermediate between the 1 st viewpoint P1 and the 2 nd viewpoint P2, an image in which the 1 st symbol Sy1 and the 2 nd symbol Sy interfere with each other is displayed. As such, the display of the composite symbol Sy varies according to the angle of observation.
Fig. 2 is a perspective view showing a schematic structure of a lenticular lens sheet.
The lenticular lens sheet LS has a structure in which a large number of unit lenses UL having a flat convex shape (semi-cylindrical shape) extending linearly are arranged in one direction. The direction in which the unit lenses UL extend (Y direction in the drawing) and the direction in which the unit lenses are arranged (X direction in the drawing) are orthogonal to each other. Generally, the lenticular lens sheet LS is made of resin. The lenticular lens sheet LS is classified into categories (lens resolution) according to the number of unit lenses UL Per 1 Inch (LPI; Line Per Inc).
When a lenticular lens sheet is used, the composite symbol is produced as a lenticular print. Lenticular prints are produced by producing a lenticular image of a given format and printing the lenticular image directly onto a lenticular lens sheet. Alternatively, the printed matter on which the lenticular image is printed is produced by laminating the lenticular lens sheet and the printed matter. The lenticular image is generated by synthesizing a plurality of symbols to be displayed in a given manner.
Fig. 3 is a conceptual diagram of generation of a lenticular image.
Fig. 3 shows an example of a case where 2 images (1 st image IA and 2 nd image IB) are switched and displayed. The lenticular image IR is generated by dividing the 1 st image IA and the 2 nd image IB into strip-shaped patches IA and IB, respectively, and arranging the divided patches IA and IB in a staggered pattern. That is, the cut-out patches IA and IB from the images IA and IB are alternately arranged from the ends.
Fig. 4 is a cross-sectional view showing a schematic structure of a lenticular printed matter, and is a view showing a relationship between a lenticular lens sheet and a lenticular image.
As shown in fig. 4, 1 unit lens UL is placed on each of 1 of the diffusers Ia and Ib, and lenticular images are printed on the lenticular lens sheet LS. Alternatively, a printed matter on which a lenticular image is printed is attached.
[ reading device ]
The reading device is constituted by a computer provided with a camera (imaging unit). Here, a case where the reading device is configured by a smartphone will be described as an example.
Fig. 5 is a block diagram showing an example of a hardware configuration of a smartphone.
As shown in fig. 5, the
The camera unit (imaging unit) 18 captures an optical image of the subject imaged by the imaging lens by an area image sensor (two-dimensional image sensor). The imaging lens includes a focus adjustment function, a light amount adjustment function, and the like. The area image sensor is constituted by a color solid-state imaging element such as a CCD (charge coupled device) having a predetermined color filter array (for example, bayer array), a CMOS (Complementary Metal Oxide Semiconductor), or the like. The
The
Fig. 6 is a functional block diagram of a smartphone as a reading apparatus.
As shown in fig. 6, the
The moving image acquisition unit 31 acquires a moving image from the
Fig. 7 is a conceptual diagram of shooting of a moving image for reading.
Fig. 7 is a conceptual diagram of a case where the smartphone side is moved to perform shooting. As shown in fig. 7, the composite symbol Sy is photographed while the
The reading direction is a direction in which the display of the composite symbol Sy is switched (an alternative direction). This direction is the arrangement direction of the lenses constituting the lenticular lens sheet of composite symbol Sy. In the example shown in fig. 7, the unit lenses of the lenticular lens sheet are arranged along the X direction, and the viewpoint is shifted along the direction (X direction), whereby the display of the composite symbol Sy changes. In the case of imaging, the
When the composite symbol Sy is shifted, the composite symbol side may be moved to perform imaging. Further, the imaging may be performed by continuously changing the inclination of the composite symbol Sy with respect to the
The symbol number information acquisition unit 32 acquires information on the number of symbols included in the composite symbol. The number of symbols included in the composite symbol is a so-called alternate number, and is the number of symbols to be switched. Therefore, the case where 2 symbols are switched is "2". In the present embodiment, information on the number of symbols included in the composite symbol is stored in the EEPROM 14. The symbol number information acquisition unit 32 acquires information on the number of symbols included in the composite symbol from the EEPROM 14.
The symbol detection unit 33 detects a symbol from a moving image obtained by imaging. That is, images of frames acquired in time series are analyzed, and a symbol is detected from a moving image. The symbol detection unit 33 detects a decodable portion as a symbol. Therefore, unclear portions that cannot be decoded, portions where images that cannot be decoded are captured without defects, and the like are not detected as symbols. The symbol detection unit 33 records the image of the detected symbol in the RAM 13. Further, after a decodable symbol is detected, even if the same symbol is detected, no image is recorded. When all the symbols included in the composite symbol are detected, the symbol detection unit 33 ends the detection process. That is, when the number of symbols acquired by the symbol number information acquisition unit 32 is detected, the symbol detection processing is terminated.
The decoding unit 34 decodes the detected symbol. The decoding unit 34 analyzes the image of the symbol stored in the RAM13, and decodes the symbol.
The true/false determination unit 35 determines the true/false of the read (captured) composite symbol Sy based on the moving image obtained by the capturing. In the present embodiment, when all the symbols included in a composite symbol are detected and all the detected symbols are true, it is determined that the composite symbol is true. Therefore, for example, when only 2 symbols are detected for a composite symbol including 3 symbols, it is determined that the symbol is not legitimate. For example, even when all the symbols are detected, even when 1 improper symbol is included, it is determined that the symbol is improper. The true or false of each detected symbol is determined based on the decoding result, for example. That is, if the legitimate information is decoded, it is determined to be authentic, and if the illegitimate information is decoded, it is determined to be illegitimate.
The
[ reading of composite symbol ]
Next, a process of reading a composite symbol by the reading apparatus (smartphone) according to the present embodiment will be described. Here, as a composite symbol, as shown in fig. 1, a case where 2 two-dimensional codes (QR codes) are displayed in a switched manner according to an observation angle will be described as an example.
Fig. 8 is a flowchart showing the procedure of the process of reading a composite symbol (reading method).
First, information on the number of symbols included in a composite symbol to be read is acquired (step S1). Here, it is "2". This information is read from the EEPROM 14.
Next, a moving image (including a moving image obtained by continuously shooting still images) obtained by shooting the composite symbol is acquired (step S2). As described above, the composite symbol is photographed by moving the
Next, a symbol (two-dimensional code) is detected from the acquired moving image (step S3). The detected symbols are sequentially recorded to the RAM 13.
It is determined whether all symbols are detected (step S4). If all the symbols are detected, the detection process is terminated. Further, the shooting (acquisition of moving image) is ended.
Next, each detected symbol is decoded (step S5). Then, the true or false of the composite symbol is determined based on the result of this decoding (step S6). As described above, the composite symbol is determined to be true when all the symbols contained therein are detected and all the detected symbols are true.
Whether or not the read composite symbol is true is determined based on the determination result of true or false (step S7). When the read composite symbol is true, the subsequent processing is performed based on the read information (decoded information) (step S8). For example, based on the read information, a WEB site is accessed, or authentication processing is performed, or settlement processing is performed. On the other hand, if the read composite symbol is not correct, the subsequent processing is suspended (step S9).
As described above, in the present embodiment, a composite symbol is captured as a moving image, a symbol is detected from the obtained moving image, and a true/false determination is performed. This enables the composite symbol to be read easily and quickly.
[ modified examples ]
[ variation of the method for acquiring information on the number of symbols ]
In the above embodiment, the information on the number of symbols included in the composite symbol to be read is set in advance on the reading device (smartphone) side. The method of acquiring information on the number of symbols included in the composite symbol is not limited to this.
It is also possible to record N symbols on the composite symbol side, and read the information to acquire information on the number of symbols included. Specifically, information on the total number (information on the number of symbols included in the composite symbol) is recorded in each symbol, and the information on the number of symbols is obtained by reading the information from the symbol. Further, information that the symbol is the second symbol may be recorded in each symbol. For example, a QR code, which is one of two-dimensional codes, has a linking function, and can be expressed by dividing 1 symbol into a plurality of symbols. In this case, an indicator indicating the number of divisions and the number of the symbols is stored in each of the divided symbols. Therefore, by reading the indicator, information on the number of symbols can be obtained from each symbol.
Further, the user may manually input the information on the number of symbols to the reading device. Alternatively, the information may be automatically acquired from the outside through a network or the like.
[ variation of method for detecting symbol ]
In the present invention, the symbol is detected from a moving image (including a moving image obtained by continuously shooting a still image), but in this case, it is preferable to make the switching of the symbol easy to recognize. A method for improving the symbol detection accuracy will be described below.
(1) Changing the colour of each symbol
Fig. 9 is a diagram showing an example of a method for facilitating recognition of symbol switching.
Fig. 9 shows an example of a case where 3 symbols (1 st symbol Sy1, 2 nd symbol Sy2, and 3 rd symbol Sy3) are displayed by switching using a lenticular lens sheet.
The 3 symbols are printed in different colors. For example, the 1 st symbol Sy1 is printed in black, the 2 nd symbol Sy2 is printed in magenta, and the 3 rd symbol Sy3 is printed in cyan. The symbol detection unit 33 detects switching of symbols based on switching of colors, and detects each symbol. This enables each symbol included in the composite symbol Sy to be detected with higher accuracy. The color of each symbol may be different from at least adjacent symbols.
(2) Utilization of line graph
Fig. 10 is a diagram showing an example of a method for facilitating recognition of symbol switching.
Fig. 10 shows an example of a case where 3 symbols (1 st symbol Sy1, 2 nd symbol Sy2, and 3 rd symbol Sy3) are displayed by switching using a lenticular lens sheet.
As shown in fig. 10, a line graph CC made of a strip image is displayed in parallel with the composite symbol Sy. The line drawing CC is arranged along the reading direction (X direction in the drawing) of the composite symbol Sy. The color of the line graph CC changes in conjunction with the switching of the symbols. For example, red at the position where the symbol Sy1 is visually recognized, orange at the position where the symbol Sy2 is visually recognized, and yellow at the position where the symbol Sy3 is visually recognized. Therefore, by detecting the switching of the color of the chart CC, the switching of the symbol can be detected. This enables each symbol included in the composite symbol Sy to be detected with higher accuracy.
In this example, the color of the line graph is switched, but the configuration of the line graph is not limited to this. Further, a mode in which the density is changed in conjunction with the switching of the symbol, a mode in which the pattern is changed in conjunction with the switching of the symbol, or the like can be adopted.
[ variation of method for determining authenticity of composite symbol ]
In the above-described embodiment, when all the symbols included in the composite symbol are detected and all the detected symbols are true, the composite symbol is determined to be true. The method of determining the authenticity of the composite symbol is not limited to this. In the following, another example of a method of determining the authenticity of a composite symbol is described.
(1) True and false determination using detected order
In a composite symbol that displays a configuration that switches according to the angle of observation, when the reading device is moved in one direction to perform imaging, the images that are imaged are switched in a fixed order.
Fig. 11 is a diagram showing a schematic configuration of a composite symbol in the case where 5 symbols are switched.
Fig. 11 shows an example of switching the display of each symbol by the lenticular lens sheet LS. In the lenticular lens sheet LS, the strip-shaped diffusion sheets Ia to Ie cut out from the images constituting the respective symbols are printed in a predetermined order along the arrangement direction of the lenses (x direction in the drawing). Specifically, the patch IA cut out from the 1 st image IA constituting the 1 st symbol, the patch IB cut out from the 2 nd image IB constituting the 2 nd symbol, the patch IC cut out from the 3 rd image IC constituting the 3 rd symbol, the patch ID cut out from the 4 th image ID constituting the 4 th symbol, and the patch IE cut out from the 5 th image IE constituting the 5 th symbol are printed in this order.
Fig. 12 is a conceptual diagram of detection of a symbol.
When the composite symbol Sy of the structure shown in fig. 11 is read in a given reading direction (X direction in the drawing), symbols are detected in the order of "symbol 1 Sy1 → symbol 2 Sy2 → symbol 3 Sy3 → symbol 4 Sy4 → symbol 5 Sy 5".
Therefore, by using the information of the order of detection, it is possible to determine whether the composite symbol Sy is true or false. That is, the order of symbols detected in time series from a moving picture is detected, and whether or not the symbols are detected in a regular order is determined to determine whether or not the symbols are true. In this case, if the detection is not performed in the normal order, it is determined that the composite symbol is not legitimate.
In addition, this determination method can be used in combination with other determination methods. For example, the determination may be made that all symbols included in the composite symbol are detected in a normal order and all detected symbols are true.
When the composite symbol having the structure of the lenticular lens sheet is observed while being moved in one direction, the display is repeatedly switched in a predetermined pattern. For example, in the case of the above-described composite symbol including 5 symbols, the display is repeated and switched in a mode of "symbol 1 Sy1 → symbol 2 Sy2 → symbol 3 Sy3 → symbol 4 Sy4 → symbol 5 Sy 5". In this case, there are the following cases depending on the position where reading is started: detected in the order of "symbol 2 Sy2 → symbol 3 Sy3 → symbol 4 Sy4 → symbol 5 Sy5 → symbol 1 Sy 1", or detected in the order of "symbol 3 Sy3 → symbol 4 Sy4 → symbol 5 Sy5 → symbol 1 Sy1 → symbol 2 Sy 2". Therefore, in such a case, the order is determined in consideration of repetition. For example, whether the order is normal or not is determined based on the first detected symbol. For example, when the 3 rd symbol Sy3 is detected first, when it is detected in the order of "the 3 rd symbol Sy3 → the 4 th symbol Sy4 → the 5 th symbol Sy5 → the 1 st symbol Sy1 → the 2 nd symbol Sy 2", it is determined that the detection is performed in the normal order. Alternatively, whether the order is normal or not is determined by comparison with the repeated pattern.
(2) True and false determination using transition of handover
In a composite symbol displaying a configuration switched according to an observation angle, if observation is continued while changing the observation position, an image of disturbance appears at an intermediate position of the switching.
Fig. 13 is a conceptual diagram of interference in a composite symbol.
A composite symbol Sy shown in fig. 13 is a composite symbol having a structure in which 2 symbols are switched by the lenticular lens sheet. As shown in fig. 13, the composite symbol Sy visually recognizes the 1 st symbol Sy1 (here, numeral 1) at the 1 st viewpoint P1 and the 2 nd symbol Sy2 (here, numeral 2) at the 2 nd viewpoint P2. On the other hand, the image Im in which the 1 st symbol Sy1 and the 2 nd symbol Sy2 coexist is visually recognized at the 3 rd viewpoint P3 that is the middle of the 1 st viewpoint P1 and the 2 nd viewpoint P2. The ratio of interference varies corresponding to the position, and the interference amount of the 1 st symbol Sy1 becomes larger as approaching the 1 st viewpoint P1. In addition, as approaching the 2 nd viewpoint P2, the interference amount of the 2 nd symbol Sy2 becomes larger.
As described above, in the composite symbol displaying a configuration that is switched according to the angle of observation, the display changes stepwise at the time of switching of the display. Therefore, by using the transition of the switching of the display, the authenticity determination can be performed.
For example, the authenticity determination can be performed based on the presence or absence of detection of an interference image appearing before and after switching. For example, in the example shown in fig. 13, the true or false is determined according to whether or not the images (interference images) Im in which the 1 st symbol Sy1 and the 2 nd symbol Sy2 are interfered are detected. If the interference image is detected, a true composite symbol is determined, and if not, an improper composite symbol is determined.
In the case of making a more strict determination, a change in the time series of switching may be added to the determination criterion. That is, the change in the interference ratio that changes in time series may be compared to determine whether the interference ratio is true or false. For example, when the interference ratio of 2 symbols changes with a predetermined transition, it can be determined that the interference ratio is true.
The determination method of this embodiment can also be used in combination with other determination methods. For example, when all symbols included in a composite symbol are detected in a normal order and all detected symbols are true and the symbols change in a predetermined pattern, it is determined that the symbols are true.
By performing the authenticity determination using the transition of the switching as in this example, it is possible to appropriately prevent, for example, an improper reading in which the symbols included in the composite symbol are aligned and captured.
(3) True and false determination based on the rate of occurrence of changing symbols
In a composite symbol or the like in which the display configuration is switched by a lenticular lens, the appearance ratio of each symbol can be adjusted. For example, in a composite symbol configured by switching 2 symbols, when the composite symbol is observed while continuously changing the angle, one symbol can be displayed for a longer period than the other symbol.
Fig. 14 is a cross-sectional view showing a schematic configuration of a composite symbol in a case where the appearance ratio of the symbol is changed.
Fig. 14 shows an example of switching the display of 2 symbols (1 st symbol and 2 nd symbol) by the lenticular lens sheet LS.
As shown in fig. 14, when the display of 2 symbols is switched by the lenticular lens sheet LS, the area ratio of the patches Ia and Ib of each image disposed in 1 unit lens UL is changed in order to change the appearance ratio of each symbol. For example, when the appearance ratio of the 1 st symbol to the 2 nd symbol is 2: 1, the area ratio of the patch IA cut out from the image (1 st image) IA constituting the 1 st symbol to the patch IB cut out from the image (2 nd image) IB constituting the 2 nd symbol is 2: 1. Thus, when the reading device is moved at a constant speed to perform imaging, the 1 st symbol and the 2 nd symbol are imaged at an appearance ratio of substantially 2: 1.
In this way, when a complex symbol having a different appearance ratio is read, it is possible to perform a true/false determination using information on the appearance ratio. That is, when each symbol is imaged at the same appearance ratio (including substantially the same appearance ratio) as that of each symbol set in the composite symbol, the composite symbol is determined to be true. Alternatively, when the symbols are detected at the same rate from the captured moving image, the composite symbol is determined to be true.
The determination method of this example can also be used in combination with other determination methods. For example, when all symbols included in a composite symbol are detected in a regular order and the detected symbols are true and each symbol is captured at a pre-occurrence ratio, it is determined that the symbol is true.
(4) Other methods for determining authenticity
When the color of the symbol also changes depending on the angle of observation, it is also possible to perform a true/false determination using information on the change in the color of each symbol.
[ variation of decoding method ]
In decoding, it is preferable to perform image correction as needed. For example, it is possible to perform processing for correcting distortion of an image caused by oblique shooting.
[ modification of hardware configuration of reading apparatus ]
In the above-described embodiments, the case where the smartphone functions as the reader has been described as an example, but the configuration of the reader is not limited to this. It can also be configured as a dedicated reading device. A portable terminal (for example, a mobile phone, a tablet computer, a pda (personal digital assistant), a notebook computer, or the like) having a camera function similarly to a smartphone can also function as a reader.
In addition, hardware for implementing the present invention can be constituted by various processors (processors). Among the various processors are: a Central Processing Unit (CPU), which is a general-purpose processor that executes a program to function as various processing units; a processor Programmable Logic Device (PLD) such as an FPGA (Field Programmable Gate Array) capable of changing a circuit configuration after manufacturing; a processor, such as an ASIC (Application Specific Integrated Circuit), having a Circuit configuration designed specifically for executing a Specific process, that is, a dedicated electrical Circuit. The 1 processing unit constituting the examination support device may be constituted by 1 of the various processors described above, or may be constituted by 2 or more processors of the same kind or different kinds. For example, 1 processing unit may be constituted by a plurality of FPGAs or a combination of a CPU and an FPGA. Further, the plurality of processing units may be constituted by 1 processor. As an example of configuring the plurality of processing units by 1 processor, the first embodiment is as follows: as typified by a computer such as a client or a server, 1 processor is configured by a combination of 1 or more CPUs and software, and functions as a plurality of processing units. The second mode is as follows: as typified by a System On Chip (SoC) or the like, a processor is used in which the functions of the entire System including a plurality of processing units are realized by 1 IC (Integrated Circuit) Chip. As described above, the various processing units are configured using 1 or more of the various processors described above as hardware structures. Further, the hardware structure of these various processors is more specifically an electric circuit (circuit) in which circuit elements such as semiconductor elements are combined.
[ supporting function of photographing ]
When the reading device includes a display unit (including a case where a device having a display such as a smartphone functions as the reading device), it is preferable to display a moving image during shooting on the display unit (to display a so-called live view image). This makes it possible to capture a moving image while confirming the replacement of the composite symbol on the display unit.
In the case of displaying the moving image during shooting on the display unit, it is preferable that a frame (shooting frame) in which the composite symbol is received is displayed (superimposed) on the moving image during shooting.
Fig. 15 is a diagram showing an example of display of the shooting frame.
Fig. 15 shows an example of a case where the
The shooting frame F is set in consideration of the shortest shooting Distance (m.o.d.) of the
In addition, when information on the reading direction (direction in which the reading apparatus is moved) can be acquired, it is preferable that the information be also displayed on the display unit. In the example shown in fig. 15, an arrow AD indicating the reading direction is displayed on the display (display section) 15.
[ modified examples of composite symbols ]
(1) Content of the switched symbol
As described above, the symbols constituting the composite symbol include codes (bar codes, two-dimensional codes, and the like), symbols, characters (including pictorial characters, and the like), figures, patterns, and the like. The composite symbol does not necessarily have to be constituted by the same kind of symbol, and may be constituted by combining other kinds of symbols. For example, the two-dimensional code may be combined with a bar code, or the two-dimensional code may be combined with characters or the like.
In addition to the QR Code, two-dimensional codes of various specifications such as PDF417, Veri Code (Veri Code), Maxi Code (Maxi Code), and Data Matrix (Data Matrix) can be used as the two-dimensional Code. In addition, the structure can be matrix type (matrix code) or stack type (stack code).
The number of symbols to be switched is not particularly limited, and can be arbitrarily set within a realizable range. For example, a configuration in which 2 to 5 symbols are switched can be adopted.
(2) Unit for switching display
In the above embodiment, the lenticular lens sheet is used as the means for switching the display, but the means for switching the display is not limited to this. Otherwise, the same function can be achieved by, for example, a microlens array sheet.
Fig. 16 is a perspective view showing a schematic structure of a microlens array sheet.
The microlens array sheet MS has a structure in which micro lenses (microlenses) ML are arranged in a matrix. The microlens array sheet MS has a function (alternate function) of switching display according to the angle of observation, as with the lenticular lens sheet.
Fig. 17 is a perspective view showing another example of the lenticular lens sheet.
The lenticular lens sheet LS shown in fig. 17 has a prism shape as a unit lens UL. That is, the lenticular lens sheet LS of the present configuration has a structure in which a large number of prism-shaped unit lenses UL are arranged in one direction. The lenticular lens sheet LS having such a configuration can also provide an alternative effect, and can switch the display depending on the angle of observation.
In the structure, the surfaces of the lenticular lens sheet and the microlens array sheet are uneven. Such surface irregularities are flattened or deposited with use, and may not be readable any more. Such a problem can be solved by smoothing the surfaces of the lenticular lens sheet and the microlens array sheet.
Fig. 18 is a view showing a schematic structure of a lenticular lens sheet having a smooth surface.
In the example shown in fig. 18, the surface of the lenticular lens sheet LS is covered with a flat protective layer PL to maintain the lens effect and smooth the surface. This enables stable display switching even when the display device is used for a long period of time.
(3) Technique for facilitating detection of symbols
As described above, the composite symbol can be clearly switched by changing the color of each symbol or by using a line graph, and can be easily detected. In addition, it is also effective to provide a certain gap between the patches of the image of each symbol arranged in 1 unit lens. This reduces interference and makes it possible to clarify the switching of each symbol.
Fig. 19 is a conceptual diagram of a configuration for clarifying symbol switching by a gap.
Fig. 19 shows an example of a case where 2 symbols (1 st symbol and 2 nd symbol) are displayed. When 2 symbols are displayed, a strip-shaped patch IA cut out from an image (1 st image) IA representing the 1 st symbol and a strip-shaped patch IB cut out from an image (2 nd image) IB representing the 2 nd symbol are arranged within the 1 unit lens UL. In this case, a constant gap (band-shaped gap) C is provided between the patches Ia and Ib of each image. By disposing the gap C, interference (afterimage of switching) can be reduced, and switching can be made clear.
(4) Techniques to improve security
In the composite symbol, the image constituting each symbol is printed with a special ink, whereby the security can be further improved. For example, by performing printing using fluorescent ink, special ink (ink that is previously adjusted (toned) in order to express colors that cannot be reproduced in three primary colors in printing), or the like, security can be further improved. In this case, too, the reader side needs to be able to read the symbol printed with the ink.
In addition, when a lenticular lens sheet or a microlens array sheet is used for switching between displays, it is also effective to use a lenticular lens sheet or a microlens array sheet having a high lens resolution. By using a lenticular lens sheet or a microlens array sheet having a high lens resolution, the ease of manufacturing is improved, and the safety can be further improved. For example, if the resolution of the lens is 200LPI or more, not only the production of the lenticular lens sheet itself but also printing becomes difficult, and thus forgery can be effectively prevented. Further, by reducing the size of the symbol, forgery can be made more difficult.
(5) Techniques to improve robustness
Even in the case where a portion of the symbols are not read, robustness can be improved by constructing the symbols in such a way that the original data can be recovered from the remaining symbols. For example, in a composite symbol having a configuration in which N symbols are switched, even when some of the symbols are not read, the original data can be recovered from the remaining M symbols (N and M are integers satisfying N > M). Such a configuration is configured to, for example, redundantly divide original data into N pieces of data, and generate a symbol from each of the divided pieces of data, so that the original data can be recovered from any of the M pieces of divided data. In addition, by using a known error correction technique, a composite symbol capable of restoring original data can be generated even when a part of the symbol is not read. For example, when switching is performed by 3 symbols, the original data can be restored by reading only 2 symbols.
By using a symbol having high robustness, such as a QR code, for each symbol, the robustness of reading of each symbol can be improved.
[ technique for improving convenience of reading ]
In the case of switching the display of the symbol using the lenticular lens sheet, the direction of reading is defined. That is, the unit lenses need to be moved and read along the arrangement direction of the unit lenses. Therefore, by showing the reading direction, the convenience of reading can be improved. For example, a symbol indicating the reading direction is displayed adjacent to the composite symbol.
Fig. 20 is a diagram showing an example of display of symbols indicating the reading direction.
In the example shown in fig. 20, an arrow AD is displayed (printed) adjacent to the composite symbol Sy as a mark indicating the reading direction. By displaying such an arrow AD, the reading direction becomes clear, and the reading operation can be facilitated.
Alternatively, a symbol indicating the reading direction may be displayed on the composite symbol itself. That is, the composite symbol is configured such that when viewed at a certain angle, a symbol (for example, an arrow) indicating the reading direction is displayed.
In addition, in order to improve the convenience of reading, the composite symbol may be slid or swung as a display mode of the composite symbol.
Fig. 21 is a diagram showing an example of displaying a composite symbol in a wobbling manner.
In the example shown in fig. 21, the composite symbol Sy is displayed on a
As described above, by displaying the composite symbol Sy by swinging or moving, a desired moving image can be captured only by covering the reading apparatus. Therefore, the convenience of reading can be improved.
[ production of composite symbol ]
As described above, in the case of a composite symbol in which a display configuration is switched using a lenticular lens sheet, a lenticular image can be directly printed on the lenticular lens sheet to produce the composite symbol. In this case, an ink jet printer can be used as the printing means.
In the case of printing by the ink jet method, the lenticular lens sheet preferably includes an ink receiving layer on the printing surface.
Fig. 22 is an enlarged sectional view showing a schematic structure of a lenticular lens sheet having an ink receiving layer.
As shown in fig. 21, the lenticular lens sheet LS of the present example is a resin lenticular lens sheet, and includes: a resin layer LS1 as a substrate; a lens layer LS2 provided on one surface side of the resin layer LS 1; and an ink receiving layer LS3 provided on the other side of the resin layer LS 1.
The ink receiving layer LS3 contains particles and a resin, and has a porous structure (for example, a void ratio of 50% or more). The ink receiving layer LS3 absorbs the ink (for example, aqueous ink) applied by the ink jet, and fixes the ink inside the layer. This enables direct formation of a high-definition image on the lenticular lens sheet. By using the lenticular lens sheet LS having the ink receiving layer LS3, the lenticular image can be directly printed on the lenticular lens sheet LS by an ink jet printer. This makes it possible to omit steps such as bonding and to improve the efficiency of manufacturing the composite symbol. In addition, even when an image of a high-definition symbol is printed on the lenticular lens sheet LS having a high resolution, a high-quality image can be printed.
In the case where the lenticular image is directly printed on the transparent lenticular lens sheet LS in this manner, it is preferable to attach a printed matter to a base sheet having a high reflectance (for example, a white base sheet) in order to improve the readability of the symbol. Or, after printing the lenticular image, the entire surface is preferably further coated with white ink (so-called white-on (white-over)).
[ use of composite symbol ]
The use of the composite symbol is not particularly limited. For example, the present invention can be used for the purposes of authenticity determination of an article, authenticity determination of a person, settlement processing, confirmation of belonging information, entry and exit management, traceability management, and the like.
Description of reference numerals
10 Intelligent mobile phone (reading device)
11 CPU
12 ROM
13 RAM
14 EEPROM
16 touch panel
17 GPS receiving unit
18 video camera part
19 microphone part
20 speaker part
21 communication unit
21A antenna
22 short-distance wireless communication unit
22A antenna
23 sensor part
24 medium driver
25 memory card
26 bus
31 moving image acquiring part
32 symbol number information acquisition unit
33 symbol detection unit
34 decoding unit
35 true and false determination unit
40 display panel
41 bench
42 shaft
AD indicates an arrow in the reading direction
C gap
CC line graph
F shooting frame
IA No. 1 image
IB 2 nd image
IC No. 3 image
ID No. 4 image
IE 5 th image
IR cylindrical lens image
Ia Loose tablet of 1 st image
Ib No. 2 Loose tablet
Loose piece of Ic 3 rd image
Id 4 th image splats
Ie 5 th image
Im image
LS lenticular lens sheet
LS1 resin layer
LS2 lens layer
LS3 ink receptive layer
MS microlens array sheet
P1 viewpoint 1
P2 viewpoint 2
P3 viewpoint 3
PL protective layer
Sy composite symbol
Sy1 symbol 1
Sy2 symbol 2
Sy3 symbol 3
Sy4 symbol 4
Sy5 symbol 5
UL unit lens
Order of processing for reading of S1-S9 composite symbol